2024-02-20T07:43:15.516 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:43:15.516 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555 --owner scheduled_pdonnell@teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/orig.config.yaml 2024-02-20T07:43:15.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:43:15.664 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555 branch: wip-batrick-testing-20240220.022152 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7568555' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240220.022152 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240220.022152 sha1: 3d72bcfd7affbb4a923c191d212814b4934cfeaa owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9910 sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: wip-batrick-testing-20240220.022152 suite_path: /home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 3d72bcfd7affbb4a923c191d212814b4934cfeaa targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjThjwwiWI+uS+mEFY92OsJyaqw6JI4p34FT+L0KMALDmo8tNGaHvyuxwOAE67qv330ikS3xpwdYkYxBJM3FWQ= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkz7roD3V7ksYM2l746nvo4btUKXSZnVhGKtOBk2+4XCKobDCPSabFs8sQN9NDrDp9JxeO2GQWCQKrWV4QyE/o= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - full_sequential_finally: - sleep: duration: 3600 - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-20_07:23:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-20T07:43:15.664 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa; will attempt to use it 2024-02-20T07:43:15.665 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks 2024-02-20T07:43:15.665 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-20T07:43:15.667 INFO:teuthology.task.internal:Checking packages... 2024-02-20T07:43:15.693 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '91ff50e903dcc99ee3ecf9523050878eb452da5c' 2024-02-20T07:43:15.693 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:43:15.693 INFO:teuthology.packaging:ref: None 2024-02-20T07:43:15.693 INFO:teuthology.packaging:tag: None 2024-02-20T07:43:15.693 INFO:teuthology.packaging:branch: wip-batrick-testing-20240220.022152 2024-02-20T07:43:15.693 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:43:15.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240220.022152 2024-02-20T07:43:15.933 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1587.g91ff50e9 2024-02-20T07:43:15.935 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-20T07:43:15.943 INFO:teuthology.task.internal:no buildpackages task found 2024-02-20T07:43:15.943 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-20T07:43:15.954 INFO:teuthology.task.internal:Saving configuration 2024-02-20T07:43:15.980 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-20T07:43:15.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-20T07:43:16.018 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 07:38:13.501796', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjThjwwiWI+uS+mEFY92OsJyaqw6JI4p34FT+L0KMALDmo8tNGaHvyuxwOAE67qv330ikS3xpwdYkYxBJM3FWQ='} 2024-02-20T07:43:16.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 07:38:13.503238', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkz7roD3V7ksYM2l746nvo4btUKXSZnVhGKtOBk2+4XCKobDCPSabFs8sQN9NDrDp9JxeO2GQWCQKrWV4QyE/o='} 2024-02-20T07:43:16.040 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-20T07:43:16.051 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-20T07:43:16.052 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-20T07:43:16.052 INFO:teuthology.run_tasks:Running task console_log... 2024-02-20T07:43:16.135 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e2eec00d0>, signals=[15]) 2024-02-20T07:43:16.136 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-20T07:43:16.145 INFO:teuthology.task.internal:Opening connections... 2024-02-20T07:43:16.145 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T07:43:16.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:16.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-02-20T07:43:16.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:16.328 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-20T07:43:16.341 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-02-20T07:43:16.360 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-02-20T07:43:16.360 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-02-20T07:43:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-02-20T07:43:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:16.419 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:16.419 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:16.419 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:16.419 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:16.419 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:16.419 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-02-20T07:43:16.445 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-02-20T07:43:16.463 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-02-20T07:43:16.463 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-02-20T07:43:16.519 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:16.520 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:16.521 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:16.521 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:16.521 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:16.521 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:16.521 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:16.521 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-02-20T07:43:16.545 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-20T07:43:16.561 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-20T07:43:16.572 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-20T07:43:16.572 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-02-20T07:43:16.574 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-02-20T07:43:16.590 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-20T07:43:16.603 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-20T07:43:16.603 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-02-20T07:43:16.632 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-02-20T07:43:16.747 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-20T07:43:16.805 INFO:teuthology.run_tasks:Running task kernel... 2024-02-20T07:43:16.828 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-20T07:43:16.829 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-20T07:43:16.829 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-20T07:43:16.830 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-20T07:43:16.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T07:43:16.846 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-02-20T07:43:16.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T07:43:16.847 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-02-20T07:43:16.904 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-361.el9.x86_64 2024-02-20T07:43:16.904 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.14.0-361.el9.x86_64 2024-02-20T07:43:16.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-02-20T07:43:16.906 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-361.el9.x86_64 2024-02-20T07:43:16.907 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-361.el9.x86_64 2024-02-20T07:43:16.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-02-20T07:43:18.958 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-20T07:43:19.105 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-20T07:43:20.367 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-02-20T07:43:20.730 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-02-20T07:43:21.682 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-02-20T07:43:24.530 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-02-20T07:43:25.674 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.0 MB 00:04 2024-02-20T07:43:27.908 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-02-20T07:43:29.747 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.1 MB 00:01 2024-02-20T07:43:31.323 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2024-02-20T07:43:32.092 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.1 MB 00:00 2024-02-20T07:43:32.652 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-02-20T07:43:33.526 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2024-02-20T07:43:36.502 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 20 MB 00:02 2024-02-20T07:43:37.533 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-02-20T07:43:39.806 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-20T07:43:39.806 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-20T07:43:39.907 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-20T07:43:39.911 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-02-20T07:43:39.912 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:43:39.913 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 100 M 2024-02-20T07:43:39.913 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 123 M 2024-02-20T07:43:39.913 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:43:40.300 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 16 MB/s | 6.1 MB 00:00 2024-02-20T07:43:40.892 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-02-20T07:43:41.617 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 25 MB/s | 33 MB 00:01 2024-02-20T07:43:41.627 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 5.3 kB/s | 1.7 kB 00:00 2024-02-20T07:43:42.225 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 17 MB/s | 39 MB 00:02 2024-02-20T07:43:42.228 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:43:42.229 INFO:teuthology.orchestra.run.smithi194.stdout:Total 43 MB/s | 100 MB 00:02 2024-02-20T07:43:42.229 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:43:42.594 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:43:42.594 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:43:43.620 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:43:43.621 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:43:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-20T07:43:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-20T07:43:43.903 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:43:43.911 INFO:teuthology.orchestra.run.smithi123.stdout:Install 4 Packages 2024-02-20T07:43:43.912 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:43:43.912 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 100 M 2024-02-20T07:43:43.912 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 123 M 2024-02-20T07:43:43.912 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:43:44.694 INFO:teuthology.orchestra.run.smithi123.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 7.7 MB/s | 6.1 MB 00:00 2024-02-20T07:43:45.753 INFO:teuthology.orchestra.run.smithi123.stdout:(2/4): kernel-modules-core-5.14.0-421.el9.x86_6 32 MB/s | 33 MB 00:01 2024-02-20T07:43:45.953 INFO:teuthology.orchestra.run.smithi123.stdout:(3/4): kernel-core-5.14.0-421.el9.x86_64.rpm 10 MB/s | 21 MB 00:02 2024-02-20T07:43:46.029 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:43:46.429 INFO:teuthology.orchestra.run.smithi123.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 16 MB/s | 39 MB 00:02 2024-02-20T07:43:46.431 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:43:46.431 INFO:teuthology.orchestra.run.smithi123.stdout:Total 40 MB/s | 100 MB 00:02 2024-02-20T07:43:46.432 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:43:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-20T07:43:46.792 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:43:46.792 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:43:46.800 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:43:47.800 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:43:47.800 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:43:49.588 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:43:49.786 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:43:50.179 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:43:50.969 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-20T07:43:51.095 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:43:53.904 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:43:54.073 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:43:54.521 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:43:54.631 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:43:58.770 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:43:59.069 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:43:59.390 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:03.762 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:28.761 INFO:teuthology.orchestra.run.smithi194.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-20T07:44:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:44:28.832 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-20T07:44:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:44:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:44:29.649 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:44:30.144 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-02-20T07:44:30.276 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:30.276 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-20T07:44:30.276 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-20T07:44:30.276 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-20T07:44:30.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-20T07:44:30.277 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-20T07:44:30.277 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-02-20T07:44:30.277 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-02-20T07:44:30.384 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:30.385 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-20T07:44:30.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-02-20T07:44:30.418 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 68.el9 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8264254 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-02-20T07:44:30.419 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:44:30.420 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-02-20T07:44:30.421 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-20T07:44:30.421 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-421.el9.x86_64 2024-02-20T07:44:30.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-20T07:44:31.084 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-02-20T07:44:32.521 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-20T07:44:32.558 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-02-20T07:44:32.561 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-02-20T07:44:32.616 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.UUdMblcdjk 2024-02-20T07:44:32.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UUdMblcdjk 2024-02-20T07:44:32.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.UUdMblcdjk 2024-02-20T07:44:32.830 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.UUdMblcdjk is 6KB 2024-02-20T07:44:32.879 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.UUdMblcdjk 2024-02-20T07:44:32.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-02-20T07:44:32.958 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-20T07:44:32.958 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-20T07:44:32.958 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-20T07:44:32.958 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-20T07:44:32.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-20T07:44:33.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-02-20T07:44:33.154 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:33.154 INFO:teuthology.orchestra.run.smithi123.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-20T07:44:33.154 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:44:33.225 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:33.632 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-20T07:44:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-20T07:44:33.633 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-20T07:44:34.079 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:44:34.080 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:44:34.599 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-02-20T07:44:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-20T07:44:34.783 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-20T07:44:34.783 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-20T07:44:34.783 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-20T07:44:34.783 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-20T07:44:34.783 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2024-02-20T07:44:34.783 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-02-20T07:44:34.891 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-20T07:44:34.891 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-20T07:44:34.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.06 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 68.el9 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Group : Unspecified 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 8264254 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-20T07:44:34.932 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : builder@centos.org 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:44:34.933 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2024-02-20T07:44:34.934 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-20T07:44:34.934 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 5.14.0-421.el9.x86_64 2024-02-20T07:44:34.935 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-20T07:44:35.529 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-02-20T07:44:36.831 INFO:teuthology.orchestra.run.smithi123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-20T07:44:36.861 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-02-20T07:44:36.863 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-02-20T07:44:36.878 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.AbwbC7C6c8 2024-02-20T07:44:36.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AbwbC7C6c8 2024-02-20T07:44:36.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.AbwbC7C6c8 2024-02-20T07:44:37.084 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.AbwbC7C6c8 is 6KB 2024-02-20T07:44:37.134 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.AbwbC7C6c8 2024-02-20T07:44:37.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2024-02-20T07:44:37.220 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-20T07:44:37.221 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-20T07:44:37.221 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-20T07:44:37.221 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-20T07:44:37.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-20T07:44:37.361 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-02-20T07:45:03.140 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-20T07:45:03.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:45:03.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:07.368 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-20T07:45:07.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:45:07.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:21.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-02-20T07:45:25.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-20T07:45:30.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:45:30.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:33.532 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-02-20T07:45:34.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:45:34.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:37.884 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-20T07:45:45.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:45:45.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:49.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:45:49.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:46:17.724 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-02-20T07:46:18.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:46:18.242 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-20T07:46:18.243 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-02-20T07:46:18.268 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-421.el9.x86_64 2024-02-20T07:46:18.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-20T07:46:18.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-20T07:46:18.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-20T07:46:19.270 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-20T07:46:19.270 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-20T07:46:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-02-20T07:46:19.386 DEBUG:teuthology.parallel:result is None 2024-02-20T07:46:21.714 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-02-20T07:46:22.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:46:22.116 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-20T07:46:22.117 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-02-20T07:46:22.132 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-421.el9.x86_64 2024-02-20T07:46:22.133 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-20T07:46:22.133 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-20T07:46:22.133 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-20T07:46:23.136 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-20T07:46:23.136 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-20T07:46:23.221 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2024-02-20T07:46:23.260 DEBUG:teuthology.parallel:result is None 2024-02-20T07:46:23.260 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-20T07:46:23.267 INFO:teuthology.task.internal:Creating test directory... 2024-02-20T07:46:23.268 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-20T07:46:23.270 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-20T07:46:23.293 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-20T07:46:23.304 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-20T07:46:23.381 INFO:teuthology.task.internal:Creating archive directory... 2024-02-20T07:46:23.381 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-20T07:46:23.383 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-20T07:46:23.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-20T07:46:23.508 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-20T07:46:23.509 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-20T07:46:23.511 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-20T07:46:23.547 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-20T07:46:23.550 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-20T07:46:23.561 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-20T07:46:23.564 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-20T07:46:23.566 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-20T07:46:23.580 INFO:teuthology.task.internal:Configuring sudo... 2024-02-20T07:46:23.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-20T07:46:23.610 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-20T07:46:23.640 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-20T07:46:23.651 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-20T07:46:23.651 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-20T07:46:23.677 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-20T07:46:23.696 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-20T07:46:23.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-20T07:46:23.838 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-20T07:46:23.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-20T07:46:23.922 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:46:23.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-20T07:46:23.988 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-20T07:46:24.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-20T07:46:24.083 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-20T07:46:24.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-20T07:46:24.212 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:46:24.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-20T07:46:24.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-02-20T07:46:24.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-02-20T07:46:24.325 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-20T07:46:24.379 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-20T07:46:24.841 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-20T07:46:24.850 INFO:teuthology.task.internal:Starting timer... 2024-02-20T07:46:24.850 INFO:teuthology.run_tasks:Running task pcp... 2024-02-20T07:46:24.894 INFO:teuthology.run_tasks:Running task selinux... 2024-02-20T07:46:24.910 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-20T07:46:24.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-02-20T07:46:24.967 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-02-20T07:46:24.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-02-20T07:46:25.016 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-02-20T07:46:25.018 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-20T07:46:25.018 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-02-20T07:46:25.049 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-02-20T07:46:25.050 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-02-20T07:46:25.068 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-02-20T07:46:25.068 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-02-20T07:46:25.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-20T07:46:25.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T07:46:25.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-20T07:46:25.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T07:46:25.145 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-20T07:46:25.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-02-20T07:46:25.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-02-20T07:46:25.227 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-20T07:46:25.237 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-20T07:46:25.243 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-20T07:46:25.375 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-20T07:46:25.392 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-20T07:46:25.394 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-20T07:50:38.838 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-02-20T07:50:38.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:50:38.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:50:38.930 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-02-20T07:50:39.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-20T07:50:39.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:50:39.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:50:39.101 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-02-20T07:50:39.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-02-20T07:50:39.180 INFO:teuthology.run_tasks:Running task clock... 2024-02-20T07:50:39.197 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-20T07:50:39.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-20T07:50:39.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-20T07:50:39.200 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-20T07:50:39.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-20T07:50:39.228 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-20T07:50:39.245 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-20T07:50:39.251 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-20T07:50:39.268 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-20T07:50:39.274 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-02-20T07:50:39.287 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-02-20T07:50:39.297 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-02-20T07:50:39.303 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-20T07:50:39.311 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-02-20T07:50:39.319 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-20T07:50:39.327 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-20T07:50:39.343 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-20T07:50:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-02-20T07:50:39.373 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-20T07:50:39.373 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-02-20T07:50:39.373 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.373 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.374 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.374 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.395 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T07:50:39.399 INFO:teuthology.run_tasks:Running task install... 2024-02-20T07:50:39.408 DEBUG:teuthology.task.install:project ceph 2024-02-20T07:50:39.408 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '91ff50e903dcc99ee3ecf9523050878eb452da5c'}} 2024-02-20T07:50:39.408 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '91ff50e903dcc99ee3ecf9523050878eb452da5c'} 2024-02-20T07:50:39.409 INFO:teuthology.task.install:Using flavor: default 2024-02-20T07:50:39.414 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-20T07:50:39.414 INFO:teuthology.task.install:extra packages: [] 2024-02-20T07:50:39.415 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91ff50e903dcc99ee3ecf9523050878eb452da5c', 'tag': None, 'wait_for_package': False} 2024-02-20T07:50:39.415 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:50:39.415 INFO:teuthology.packaging:ref: None 2024-02-20T07:50:39.415 INFO:teuthology.packaging:tag: None 2024-02-20T07:50:39.415 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:50:39.415 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:50:39.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-20T07:50:39.418 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91ff50e903dcc99ee3ecf9523050878eb452da5c', 'tag': None, 'wait_for_package': False} 2024-02-20T07:50:39.418 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:50:39.418 INFO:teuthology.packaging:ref: None 2024-02-20T07:50:39.418 INFO:teuthology.packaging:tag: None 2024-02-20T07:50:39.418 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:50:39.418 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:50:39.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-20T07:50:39.653 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/ 2024-02-20T07:50:39.653 INFO:teuthology.task.install.rpm:Package version is 17.2.7-521.gc80e7168 2024-02-20T07:50:39.766 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-20T07:50:39.766 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:50:39.766 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-20T07:50:39.793 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-20T07:50:39.794 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:50:39.794 INFO:teuthology.packaging:ref: None 2024-02-20T07:50:39.794 INFO:teuthology.packaging:tag: None 2024-02-20T07:50:39.794 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:50:39.794 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:50:39.794 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-20T07:50:39.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-20T07:50:39.865 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/ 2024-02-20T07:50:39.865 INFO:teuthology.task.install.rpm:Package version is 17.2.7-521.gc80e7168 2024-02-20T07:50:39.944 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-20T07:50:39.973 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/c80e7168938c48b49e5ce2e002f48bf150b5f4a4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-20T07:50:40.115 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:50:40.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-20T07:50:40.142 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-02-20T07:50:40.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-02-20T07:50:40.148 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-20T07:50:40.148 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:50:40.148 INFO:teuthology.packaging:ref: None 2024-02-20T07:50:40.149 INFO:teuthology.packaging:tag: None 2024-02-20T07:50:40.149 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:50:40.149 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:50:40.149 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-20T07:50:40.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-20T07:50:40.298 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-20T07:50:40.365 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-02-20T07:50:40.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-02-20T07:50:40.391 INFO:teuthology.orchestra.run.smithi123.stdout:74 files removed 2024-02-20T07:50:40.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw 2024-02-20T07:50:40.601 INFO:teuthology.orchestra.run.smithi194.stdout:74 files removed 2024-02-20T07:50:40.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2024-02-20T07:50:41.259 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 247 kB/s | 77 kB 00:00 2024-02-20T07:50:41.266 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 144 kB/s | 77 kB 00:00 2024-02-20T07:50:41.808 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 19 kB/s | 9.1 kB 00:00 2024-02-20T07:50:41.826 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 18 kB/s | 9.1 kB 00:00 2024-02-20T07:50:42.569 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 2.5 kB/s | 1.8 kB 00:00 2024-02-20T07:50:42.642 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 2.2 kB/s | 1.8 kB 00:00 2024-02-20T07:50:43.129 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-20T07:50:43.286 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-20T07:50:44.613 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2024-02-20T07:50:44.786 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2024-02-20T07:50:47.777 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-02-20T07:50:49.536 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-02-20T07:50:53.712 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-02-20T07:50:54.727 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 835 kB/s | 8.0 MB 00:09 2024-02-20T07:50:55.437 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 15 kB 00:00 2024-02-20T07:50:58.072 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 20 MB 00:02 2024-02-20T07:50:59.020 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-02-20T07:51:03.006 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-02-20T07:51:04.554 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.1 MB 00:01 2024-02-20T07:51:05.609 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:17.2.7-521.gc80e7168.el9 ceph 14 M 2024-02-20T07:51:05.614 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 3.1 M 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.9 M 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:17.2.7-521.gc80e7168.el9 ceph 5.0 M 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:17.2.7-521.gc80e7168.el9 ceph 23 M 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:17.2.7-521.gc80e7168.el9 ceph 25 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 635 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 457 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-20T07:51:05.615 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 4.9 M 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 45 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:17.2.7-521.gc80e7168.el9 ceph 116 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:17.2.7-521.gc80e7168.el9 ceph 156 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:17.2.7-521.gc80e7168.el9 ceph 320 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 293 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:17.2.7-521.gc80e7168.el9 ceph 99 k 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:51:05.616 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:05.617 INFO:teuthology.orchestra.run.smithi123.stdout:Install 22 Packages 2024-02-20T07:51:05.617 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 2 Packages 2024-02-20T07:51:05.617 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:05.617 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 58 M 2024-02-20T07:51:05.617 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:51:06.012 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2024-02-20T07:51:07.415 INFO:teuthology.orchestra.run.smithi123.stdout:(1/24): ceph-radosgw-17.2.7-521.gc80e7168.el9.x 8.9 MB/s | 14 MB 00:01 2024-02-20T07:51:07.456 INFO:teuthology.orchestra.run.smithi123.stdout:(2/24): ceph-selinux-17.2.7-521.gc80e7168.el9.x 608 kB/s | 25 kB 00:00 2024-02-20T07:51:07.523 INFO:teuthology.orchestra.run.smithi123.stdout:(3/24): libcephfs2-17.2.7-521.gc80e7168.el9.x86 9.3 MB/s | 635 kB 00:00 2024-02-20T07:51:07.574 INFO:teuthology.orchestra.run.smithi123.stdout:(4/24): libradosstriper1-17.2.7-521.gc80e7168.e 9.0 MB/s | 457 kB 00:00 2024-02-20T07:51:07.940 INFO:teuthology.orchestra.run.smithi123.stdout:(5/24): librgw2-17.2.7-521.gc80e7168.el9.x86_64 13 MB/s | 4.9 MB 00:00 2024-02-20T07:51:07.982 INFO:teuthology.orchestra.run.smithi123.stdout:(6/24): python3-ceph-argparse-17.2.7-521.gc80e7 1.1 MB/s | 45 kB 00:00 2024-02-20T07:51:08.024 INFO:teuthology.orchestra.run.smithi123.stdout:(7/24): python3-ceph-common-17.2.7-521.gc80e716 2.7 MB/s | 116 kB 00:00 2024-02-20T07:51:08.083 INFO:teuthology.orchestra.run.smithi123.stdout:(8/24): python3-cephfs-17.2.7-521.gc80e7168.el9 2.6 MB/s | 156 kB 00:00 2024-02-20T07:51:08.142 INFO:teuthology.orchestra.run.smithi123.stdout:(9/24): python3-rados-17.2.7-521.gc80e7168.el9. 5.4 MB/s | 320 kB 00:00 2024-02-20T07:51:08.209 INFO:teuthology.orchestra.run.smithi123.stdout:(10/24): python3-rbd-17.2.7-521.gc80e7168.el9.x 4.3 MB/s | 293 kB 00:00 2024-02-20T07:51:08.267 INFO:teuthology.orchestra.run.smithi123.stdout:(11/24): python3-rgw-17.2.7-521.gc80e7168.el9.x 1.7 MB/s | 99 kB 00:00 2024-02-20T07:51:08.359 INFO:teuthology.orchestra.run.smithi123.stdout:(12/24): ceph-base-17.2.7-521.gc80e7168.el9.x86 2.0 MB/s | 5.0 MB 00:02 2024-02-20T07:51:08.543 INFO:teuthology.orchestra.run.smithi123.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 280 kB/s | 44 kB 00:00 2024-02-20T07:51:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 530 kB/s | 159 kB 00:00 2024-02-20T07:51:08.677 INFO:teuthology.orchestra.run.smithi123.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 661 kB 00:00 2024-02-20T07:51:08.702 INFO:teuthology.orchestra.run.smithi123.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 282 kB 00:00 2024-02-20T07:51:08.727 INFO:teuthology.orchestra.run.smithi123.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 829 kB/s | 41 kB 00:00 2024-02-20T07:51:08.794 INFO:teuthology.orchestra.run.smithi123.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-02-20T07:51:08.819 INFO:teuthology.orchestra.run.smithi123.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.6 MB/s | 309 kB 00:00 2024-02-20T07:51:08.837 INFO:teuthology.orchestra.run.smithi123.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-20T07:51:08.920 INFO:teuthology.orchestra.run.smithi123.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-02-20T07:51:09.629 INFO:teuthology.orchestra.run.smithi123.stdout:(22/24): librbd1-17.2.7-521.gc80e7168.el9.x86_6 4.1 MB/s | 2.9 MB 00:00 2024-02-20T07:51:11.312 INFO:teuthology.orchestra.run.smithi123.stdout:(23/24): ceph-common-17.2.7-521.gc80e7168.el9.x 4.1 MB/s | 23 MB 00:05 2024-02-20T07:51:12.270 INFO:teuthology.orchestra.run.smithi123.stdout:(24/24): librados2-17.2.7-521.gc80e7168.el9.x86 918 kB/s | 3.1 MB 00:03 2024-02-20T07:51:12.275 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:51:12.275 INFO:teuthology.orchestra.run.smithi123.stdout:Total 8.7 MB/s | 58 MB 00:06 2024-02-20T07:51:12.275 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:51:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:51:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:51:12.764 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:51:12.764 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:51:13.999 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:51:14.337 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-20T07:51:14.415 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:14.609 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 3/26 2024-02-20T07:51:14.657 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:14.746 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:14.791 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-20T07:51:14.820 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-20T07:51:15.249 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-20T07:51:15.285 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 8/26 2024-02-20T07:51:15.347 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 8/26 2024-02-20T07:51:15.376 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-20T07:51:15.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x 10/26 2024-02-20T07:51:15.448 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 11/26 2024-02-20T07:51:15.510 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 12/26 2024-02-20T07:51:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:15.603 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:15.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-20T07:51:15.695 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-20T07:51:15.728 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-20T07:51:16.025 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-20T07:51:16.050 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 18/26 2024-02-20T07:51:16.139 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 18/26 2024-02-20T07:51:16.212 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 19/26 2024-02-20T07:51:16.236 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86 20/26 2024-02-20T07:51:18.610 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:18.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:19.181 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:19.235 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 22/26 2024-02-20T07:51:19.327 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 22/26 2024-02-20T07:51:19.344 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-20T07:51:19.345 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-20T07:51:19.345 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:21.373 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 20 MB 00:15 2024-02-20T07:51:26.279 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-02-20T07:51:28.462 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:28.856 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:51:28.865 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:51:28.865 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:51:28.865 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:17.2.7-521.gc80e7168.el9 ceph 14 M 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 3.1 M 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.9 M 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:17.2.7-521.gc80e7168.el9 ceph 5.0 M 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:17.2.7-521.gc80e7168.el9 ceph 23 M 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:17.2.7-521.gc80e7168.el9 ceph 25 k 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 635 k 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-20T07:51:28.866 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 457 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:17.2.7-521.gc80e7168.el9 ceph 4.9 M 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 45 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:17.2.7-521.gc80e7168.el9 ceph 116 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:17.2.7-521.gc80e7168.el9 ceph 156 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:17.2.7-521.gc80e7168.el9 ceph 320 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 293 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:17.2.7-521.gc80e7168.el9 ceph 99 k 2024-02-20T07:51:28.867 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:Install 22 Packages 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 2 Packages 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 58 M 2024-02-20T07:51:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:51:29.728 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 24/26 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 24/26 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-20T07:51:29.800 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:29.802 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-20T07:51:29.908 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-20T07:51:29.908 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:51:30.971 INFO:teuthology.orchestra.run.smithi194.stdout:(1/24): ceph-common-17.2.7-521.gc80e7168.el9.x8 13 MB/s | 23 MB 00:01 2024-02-20T07:51:31.013 INFO:teuthology.orchestra.run.smithi194.stdout:(2/24): ceph-selinux-17.2.7-521.gc80e7168.el9.x 607 kB/s | 25 kB 00:00 2024-02-20T07:51:31.071 INFO:teuthology.orchestra.run.smithi194.stdout:(3/24): libcephfs2-17.2.7-521.gc80e7168.el9.x86 11 MB/s | 635 kB 00:00 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 1/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 3/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 5/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 6/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 7/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x 8/26 2024-02-20T07:51:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86 9/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 10/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 11/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 12/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-20T07:51:31.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:31.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-20T07:51:31.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 25/26 2024-02-20T07:51:31.130 INFO:teuthology.orchestra.run.smithi194.stdout:(4/24): libradosstriper1-17.2.7-521.gc80e7168.e 7.7 MB/s | 457 kB 00:00 2024-02-20T07:51:31.389 INFO:teuthology.orchestra.run.smithi194.stdout:(5/24): librgw2-17.2.7-521.gc80e7168.el9.x86_64 19 MB/s | 4.9 MB 00:00 2024-02-20T07:51:31.431 INFO:teuthology.orchestra.run.smithi194.stdout:(6/24): python3-ceph-argparse-17.2.7-521.gc80e7 1.1 MB/s | 45 kB 00:00 2024-02-20T07:51:31.473 INFO:teuthology.orchestra.run.smithi194.stdout:(7/24): python3-ceph-common-17.2.7-521.gc80e716 2.7 MB/s | 116 kB 00:00 2024-02-20T07:51:31.523 INFO:teuthology.orchestra.run.smithi194.stdout:(8/24): python3-cephfs-17.2.7-521.gc80e7168.el9 3.1 MB/s | 156 kB 00:00 2024-02-20T07:51:31.582 INFO:teuthology.orchestra.run.smithi194.stdout:(9/24): python3-rados-17.2.7-521.gc80e7168.el9. 5.4 MB/s | 320 kB 00:00 2024-02-20T07:51:31.632 INFO:teuthology.orchestra.run.smithi194.stdout:(10/24): python3-rbd-17.2.7-521.gc80e7168.el9.x 5.7 MB/s | 293 kB 00:00 2024-02-20T07:51:31.682 INFO:teuthology.orchestra.run.smithi194.stdout:(11/24): python3-rgw-17.2.7-521.gc80e7168.el9.x 2.0 MB/s | 99 kB 00:00 2024-02-20T07:51:31.857 INFO:teuthology.orchestra.run.smithi194.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 909 kB/s | 159 kB 00:00 2024-02-20T07:51:31.908 INFO:teuthology.orchestra.run.smithi194.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-02-20T07:51:32.025 INFO:teuthology.orchestra.run.smithi194.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2024-02-20T07:51:32.083 INFO:teuthology.orchestra.run.smithi194.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-02-20T07:51:32.134 INFO:teuthology.orchestra.run.smithi194.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-20T07:51:32.137 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.139 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:32.139 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-20T07:51:32.139 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:32.139 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:51:32.485 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-test 2024-02-20T07:51:32.642 INFO:teuthology.orchestra.run.smithi194.stdout:(17/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 607 kB/s | 309 kB 00:00 2024-02-20T07:51:32.759 INFO:teuthology.orchestra.run.smithi194.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-02-20T07:51:32.859 INFO:teuthology.orchestra.run.smithi194.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2024-02-20T07:51:33.058 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:31 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:51:33.134 INFO:teuthology.orchestra.run.smithi194.stdout:(20/24): thrift-0.15.0-2.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-02-20T07:51:33.221 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:17.2.7-521.gc80e7168.el9 ceph 48 M 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:17.2.7-521.gc80e7168.el9 ceph 163 k 2024-02-20T07:51:33.222 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2024-02-20T07:51:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 49 M 2024-02-20T07:51:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 196 M 2024-02-20T07:51:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:51:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:(21/24): librados2-17.2.7-521.gc80e7168.el9.x86 12 MB/s | 3.1 MB 00:00 2024-02-20T07:51:33.435 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-02-20T07:51:33.486 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-02-20T07:51:33.553 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-02-20T07:51:33.577 INFO:teuthology.orchestra.run.smithi194.stdout:(22/24): librbd1-17.2.7-521.gc80e7168.el9.x86_6 17 MB/s | 2.9 MB 00:00 2024-02-20T07:51:33.673 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.8 MB/s | 217 kB 00:00 2024-02-20T07:51:33.862 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): libcephsqlite-17.2.7-521.gc80e7168.el9.x 255 kB/s | 163 kB 00:00 2024-02-20T07:51:34.119 INFO:teuthology.orchestra.run.smithi194.stdout:(23/24): ceph-base-17.2.7-521.gc80e7168.el9.x86 1.0 MB/s | 5.0 MB 00:04 2024-02-20T07:51:36.004 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): ceph-test-17.2.7-521.gc80e7168.el9.x86_6 17 MB/s | 48 MB 00:02 2024-02-20T07:51:36.007 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:51:36.007 INFO:teuthology.orchestra.run.smithi123.stdout:Total 18 MB/s | 49 MB 00:02 2024-02-20T07:51:36.007 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:51:36.025 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:51:36.025 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:51:36.410 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:51:36.410 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:51:36.988 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:51:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-20T07:51:37.103 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-20T07:51:37.159 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-20T07:51:37.204 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-20T07:51:37.232 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 5/6 2024-02-20T07:51:40.469 INFO:teuthology.orchestra.run.smithi194.stdout:(24/24): ceph-radosgw-17.2.7-521.gc80e7168.el9. 1.3 MB/s | 14 MB 00:11 2024-02-20T07:51:40.472 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:51:40.472 INFO:teuthology.orchestra.run.smithi194.stdout:Total 5.0 MB/s | 58 MB 00:11 2024-02-20T07:51:40.472 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:51:40.506 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:51:40.507 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:51:40.958 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:51:40.959 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:51:41.650 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 5/6 2024-02-20T07:51:41.722 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 6/6 2024-02-20T07:51:42.182 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:51:42.509 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-20T07:51:42.570 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:42.662 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:42.748 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 3/26 2024-02-20T07:51:42.772 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:42.861 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-20T07:51:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-20T07:51:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-20T07:51:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 8/26 2024-02-20T07:51:43.470 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 8/26 2024-02-20T07:51:43.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-20T07:51:43.534 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x 10/26 2024-02-20T07:51:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 11/26 2024-02-20T07:51:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 12/26 2024-02-20T07:51:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:43.718 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:43.757 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-20T07:51:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-20T07:51:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-20T07:51:44.023 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 6/6 2024-02-20T07:51:44.024 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 1/6 2024-02-20T07:51:44.024 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 2/6 2024-02-20T07:51:44.024 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-20T07:51:44.024 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-20T07:51:44.024 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-20T07:51:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-20T07:51:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 18/26 2024-02-20T07:51:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 18/26 2024-02-20T07:51:44.318 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 19/26 2024-02-20T07:51:44.341 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86 20/26 2024-02-20T07:51:44.428 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-16.el9.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:44.429 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:51:44.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph 2024-02-20T07:51:45.294 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:43 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:51:45.467 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:51:45.469 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================== 2024-02-20T07:51:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:51:45.469 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================== 2024-02-20T07:51:45.470 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:51:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:17.2.7-521.gc80e7168.el9 ceph 6.5 k 2024-02-20T07:51:45.470 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:51:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.1 M 2024-02-20T07:51:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:17.2.7-521.gc80e7168.el9 ceph 1.4 M 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 239 k 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:17.2.7-521.gc80e7168.el9 ceph 3.7 M 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 15 M 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-20T07:51:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-20T07:51:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-20T07:51:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-20T07:51:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-20T07:51:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-20T07:51:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-20T07:51:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-20T07:51:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-20T07:51:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================== 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout:Install 33 Packages 2024-02-20T07:51:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:45.478 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 27 M 2024-02-20T07:51:45.478 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 99 M 2024-02-20T07:51:45.478 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:51:46.099 INFO:teuthology.orchestra.run.smithi123.stdout:(1/33): ceph-17.2.7-521.gc80e7168.el9.x86_64.rp 26 kB/s | 6.5 kB 00:00 2024-02-20T07:51:46.508 INFO:teuthology.orchestra.run.smithi123.stdout:(2/33): ceph-mds-17.2.7-521.gc80e7168.el9.x86_6 3.1 MB/s | 2.1 MB 00:00 2024-02-20T07:51:46.774 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 21/26 2024-02-20T07:51:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 22/26 2024-02-20T07:51:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 22/26 2024-02-20T07:51:47.479 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-20T07:51:47.479 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-20T07:51:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:51:47.491 INFO:teuthology.orchestra.run.smithi123.stdout:(3/33): ceph-osd-17.2.7-521.gc80e7168.el9.x86_6 16 MB/s | 15 MB 00:00 2024-02-20T07:51:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:47.533 INFO:teuthology.orchestra.run.smithi123.stdout:(4/33): ceph-mgr-17.2.7-521.gc80e7168.el9.x86_6 855 kB/s | 1.4 MB 00:01 2024-02-20T07:51:47.558 INFO:teuthology.orchestra.run.smithi123.stdout:(5/33): ceph-mgr-modules-core-17.2.7-521.gc80e7 3.5 MB/s | 239 kB 00:00 2024-02-20T07:51:47.709 INFO:teuthology.orchestra.run.smithi123.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 254 kB/s | 32 kB 00:00 2024-02-20T07:51:47.734 INFO:teuthology.orchestra.run.smithi123.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 720 kB/s | 144 kB 00:00 2024-02-20T07:51:47.759 INFO:teuthology.orchestra.run.smithi123.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 945 kB/s | 47 kB 00:00 2024-02-20T07:51:47.776 INFO:teuthology.orchestra.run.smithi123.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 925 kB/s | 39 kB 00:00 2024-02-20T07:51:47.843 INFO:teuthology.orchestra.run.smithi123.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-02-20T07:51:47.960 INFO:teuthology.orchestra.run.smithi123.stdout:(11/33): ceph-mon-17.2.7-521.gc80e7168.el9.x86_ 2.0 MB/s | 3.7 MB 00:01 2024-02-20T07:51:47.994 INFO:teuthology.orchestra.run.smithi123.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 5.3 MB/s | 1.1 MB 00:00 2024-02-20T07:51:48.019 INFO:teuthology.orchestra.run.smithi123.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 588 kB/s | 103 kB 00:00 2024-02-20T07:51:48.052 INFO:teuthology.orchestra.run.smithi123.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 124 kB 00:00 2024-02-20T07:51:48.078 INFO:teuthology.orchestra.run.smithi123.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 1.9 MB/s | 113 kB 00:00 2024-02-20T07:51:48.103 INFO:teuthology.orchestra.run.smithi123.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.2 MB/s | 187 kB 00:00 2024-02-20T07:51:48.162 INFO:teuthology.orchestra.run.smithi123.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 402 kB/s | 43 kB 00:00 2024-02-20T07:51:48.187 INFO:teuthology.orchestra.run.smithi123.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-02-20T07:51:48.203 INFO:teuthology.orchestra.run.smithi123.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 255 kB/s | 11 kB 00:00 2024-02-20T07:51:48.220 INFO:teuthology.orchestra.run.smithi123.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 530 kB/s | 18 kB 00:00 2024-02-20T07:51:48.237 INFO:teuthology.orchestra.run.smithi123.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 691 kB/s | 23 kB 00:00 2024-02-20T07:51:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 581 kB/s | 19 kB 00:00 2024-02-20T07:51:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2024-02-20T07:51:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-02-20T07:51:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-02-20T07:51:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-02-20T07:51:48.380 INFO:teuthology.orchestra.run.smithi123.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-02-20T07:51:48.406 INFO:teuthology.orchestra.run.smithi123.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-02-20T07:51:48.431 INFO:teuthology.orchestra.run.smithi123.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-02-20T07:51:48.456 INFO:teuthology.orchestra.run.smithi123.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-02-20T07:51:48.482 INFO:teuthology.orchestra.run.smithi123.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-02-20T07:51:48.507 INFO:teuthology.orchestra.run.smithi123.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-02-20T07:51:48.532 INFO:teuthology.orchestra.run.smithi123.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-02-20T07:51:48.537 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:51:48.537 INFO:teuthology.orchestra.run.smithi123.stdout:Total 8.7 MB/s | 27 MB 00:03 2024-02-20T07:51:48.537 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:51:48.575 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:51:48.576 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:51:48.914 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:51:48.915 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:51:50.159 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:51:50.218 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-20T07:51:50.250 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-20T07:51:50.283 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-20T07:51:50.375 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-20T07:51:50.453 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-20T07:51:50.494 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-20T07:51:50.567 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-20T07:51:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-20T07:51:50.658 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-20T07:51:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-20T07:51:50.762 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-20T07:51:50.954 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-20T07:51:51.004 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-20T07:51:51.034 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-20T07:51:51.068 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-20T07:51:51.098 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-20T07:51:51.174 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-20T07:51:51.217 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-20T07:51:51.250 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-20T07:51:51.290 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-20T07:51:51.325 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-20T07:51:51.360 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-20T07:51:51.448 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-20T07:51:51.500 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-20T07:51:51.570 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-20T07:51:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-20T07:51:51.832 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-20T07:51:51.994 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.n 28/33 2024-02-20T07:51:52.021 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 29/33 2024-02-20T07:51:52.045 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 29/33 2024-02-20T07:51:52.045 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:52.046 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-20T07:51:52.046 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-20T07:51:52.046 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-20T07:51:52.046 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:53.431 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 30/33 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 30/33 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-20T07:51:53.457 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:53.839 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 31/33 2024-02-20T07:51:53.863 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 31/33 2024-02-20T07:51:53.863 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:53.864 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-20T07:51:53.864 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-20T07:51:53.864 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-20T07:51:53.864 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:54.065 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 32/33 2024-02-20T07:51:54.088 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 32/33 2024-02-20T07:51:54.088 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:54.088 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-20T07:51:54.088 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-20T07:51:54.088 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-20T07:51:54.089 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:54.154 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:17.2.7-521.gc80e7168.el9.x86_64 33/33 2024-02-20T07:51:55.802 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-2:17.2.7-521.gc80e7168.el9.x86_64 33/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:17.2.7-521.gc80e7168.el9.x86_64 1/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 2/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 3/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 4/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 5/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.n 6/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-20T07:51:55.803 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-20T07:51:55.804 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-20T07:51:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-20T07:51:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-20T07:51:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-20T07:51:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:56.724 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:51:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-02-20T07:51:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:51:57.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-base 2024-02-20T07:51:57.611 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:55 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:51:57.724 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:51:57.777 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:51:57.778 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:51:57.778 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:51:57.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install cephadm 2024-02-20T07:51:58.116 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 24/26 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 24/26 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-20T07:51:58.194 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:51:58.195 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-20T07:51:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-20T07:51:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:51:58.409 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:56 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:51:58.572 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 80 k 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:51:58.573 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:51:58.574 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 80 k 2024-02-20T07:51:58.574 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 364 k 2024-02-20T07:51:58.574 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:51:59.020 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm-17.2.7-521.gc80e7168.el9.noarch.rpm 180 kB/s | 80 kB 00:00 2024-02-20T07:51:59.021 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:51:59.021 INFO:teuthology.orchestra.run.smithi123.stdout:Total 180 kB/s | 80 kB 00:00 2024-02-20T07:51:59.022 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:51:59.026 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:51:59.026 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:51:59.028 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:51:59.029 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:51:59.109 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 1/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 3/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 4/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 5/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 6/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 7/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x 8/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86 9/26 2024-02-20T07:51:59.493 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 10/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 11/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 12/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 13/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:17.2.7-521.gc80e7168.el9.x86_64 23/26 2024-02-20T07:51:59.494 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-20T07:51:59.495 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 25/26 2024-02-20T07:51:59.542 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:51:59.618 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:51:59.982 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:00.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:00.292 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:00.293 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:00.293 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:00.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-immutable-object-cache 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.566 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-20T07:52:00.567 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:00.568 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:00.939 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2024-02-20T07:52:01.087 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:59 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:01.250 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-521.gc80e7168.el9 ceph 137 k 2024-02-20T07:52:01.251 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 137 k 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 379 k 2024-02-20T07:52:01.252 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:01.520 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:35 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:01.693 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:17.2.7-521.gc80e7168.el9 ceph 48 M 2024-02-20T07:52:01.694 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:17.2.7-521.gc80e7168.el9 ceph 163 k 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-02-20T07:52:01.695 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:01.696 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 49 M 2024-02-20T07:52:01.696 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 196 M 2024-02-20T07:52:01.696 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:01.749 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-immutable-object-cache-17.2.7-521.gc80e716 275 kB/s | 137 kB 00:00 2024-02-20T07:52:01.750 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:01.750 INFO:teuthology.orchestra.run.smithi123.stdout:Total 275 kB/s | 137 kB 00:00 2024-02-20T07:52:01.750 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:01.757 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:01.758 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:01.811 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:01.811 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:01.906 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-02-20T07:52:01.948 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-20T07:52:01.970 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:01.998 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-20T07:52:02.025 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:02.049 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:02.049 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:02.049 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-20T07:52:02.049 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:02.057 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-02-20T07:52:02.224 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): libcephsqlite-17.2.7-521.gc80e7168.el9.x 308 kB/s | 163 kB 00:00 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:03.032 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:03.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr 2024-02-20T07:52:03.856 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:01 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:03.969 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:04.021 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:04.022 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:04.022 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:04.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-dashboard 2024-02-20T07:52:04.654 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:02 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:04.819 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:04.820 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 1.7 M 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 23 k 2024-02-20T07:52:04.821 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 15 k 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-20T07:52:04.822 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:04.823 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:04.823 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:04.823 INFO:teuthology.orchestra.run.smithi123.stdout:Install 7 Packages 2024-02-20T07:52:04.823 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:04.824 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.0 M 2024-02-20T07:52:04.824 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 8.1 M 2024-02-20T07:52:04.824 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:05.160 INFO:teuthology.orchestra.run.smithi123.stdout:(1/7): ceph-grafana-dashboards-17.2.7-521.gc80e 85 kB/s | 23 kB 00:00 2024-02-20T07:52:05.210 INFO:teuthology.orchestra.run.smithi123.stdout:(2/7): ceph-prometheus-alerts-17.2.7-521.gc80e7 45 kB/s | 15 kB 00:00 2024-02-20T07:52:05.336 INFO:teuthology.orchestra.run.smithi123.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 52 kB/s | 9.0 kB 00:00 2024-02-20T07:52:05.520 INFO:teuthology.orchestra.run.smithi123.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 167 kB/s | 31 kB 00:00 2024-02-20T07:52:05.545 INFO:teuthology.orchestra.run.smithi123.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 122 kB/s | 41 kB 00:00 2024-02-20T07:52:05.770 INFO:teuthology.orchestra.run.smithi123.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 754 kB/s | 188 kB 00:00 2024-02-20T07:52:06.295 INFO:teuthology.orchestra.run.smithi123.stdout:(7/7): ceph-mgr-dashboard-17.2.7-521.gc80e7168. 1.2 MB/s | 1.7 MB 00:01 2024-02-20T07:52:06.296 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:06.297 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2024-02-20T07:52:06.297 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:06.371 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:06.371 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:06.407 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): ceph-test-17.2.7-521.gc80e7168.el9.x86_6 10 MB/s | 48 MB 00:04 2024-02-20T07:52:06.410 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:06.410 INFO:teuthology.orchestra.run.smithi194.stdout:Total 10 MB/s | 49 MB 00:04 2024-02-20T07:52:06.411 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:06.430 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:06.430 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:06.674 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:06.746 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-20T07:52:06.780 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-20T07:52:06.826 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-20T07:52:06.829 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:06.830 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:06.859 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-20T07:52:06.887 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.no 5/7 2024-02-20T07:52:07.114 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.n 6/7 2024-02-20T07:52:07.148 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 7/7 2024-02-20T07:52:07.408 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:07.487 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-20T07:52:07.521 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-20T07:52:07.568 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-20T07:52:07.606 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-20T07:52:07.634 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 5/6 2024-02-20T07:52:07.665 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 7/7 2024-02-20T07:52:07.665 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.n 1/7 2024-02-20T07:52:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 2/7 2024-02-20T07:52:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.no 3/7 2024-02-20T07:52:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-20T07:52:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-20T07:52:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-20T07:52:07.965 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-20T07:52:07.965 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:07.965 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:07.965 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:07.966 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:08.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-20T07:52:08.760 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:06 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:08.927 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================== 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================== 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 7.4 M 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:52:08.928 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:08.929 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================== 2024-02-20T07:52:08.930 INFO:teuthology.orchestra.run.smithi123.stdout:Install 12 Packages 2024-02-20T07:52:08.930 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:08.930 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 37 M 2024-02-20T07:52:08.930 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 209 M 2024-02-20T07:52:08.931 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:09.127 INFO:teuthology.orchestra.run.smithi123.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 235 kB/s | 32 kB 00:00 2024-02-20T07:52:09.152 INFO:teuthology.orchestra.run.smithi123.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 727 kB/s | 17 kB 00:00 2024-02-20T07:52:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-20T07:52:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-02-20T07:52:09.486 INFO:teuthology.orchestra.run.smithi123.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2024-02-20T07:52:09.553 INFO:teuthology.orchestra.run.smithi123.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-02-20T07:52:09.578 INFO:teuthology.orchestra.run.smithi123.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 217 kB 00:00 2024-02-20T07:52:09.828 INFO:teuthology.orchestra.run.smithi123.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 802 kB 00:00 2024-02-20T07:52:10.007 INFO:teuthology.orchestra.run.smithi123.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-02-20T07:52:10.029 INFO:teuthology.orchestra.run.smithi123.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 981 kB/s | 194 kB 00:00 2024-02-20T07:52:10.112 INFO:teuthology.orchestra.run.smithi123.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-02-20T07:52:10.912 INFO:teuthology.orchestra.run.smithi123.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-5 3.9 MB/s | 7.4 MB 00:01 2024-02-20T07:52:10.915 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:10.915 INFO:teuthology.orchestra.run.smithi123.stdout:Total 19 MB/s | 37 MB 00:01 2024-02-20T07:52:10.934 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:10.959 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:10.959 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:11.389 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:11.389 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:12.070 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 5/6 2024-02-20T07:52:12.087 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:12.164 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 6/6 2024-02-20T07:52:12.177 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-20T07:52:12.208 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-20T07:52:12.302 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-20T07:52:12.337 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-20T07:52:12.514 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-20T07:52:12.544 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-20T07:52:12.627 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-20T07:52:13.295 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-20T07:52:13.415 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-20T07:52:14.395 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 6/6 2024-02-20T07:52:14.395 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 1/6 2024-02-20T07:52:14.395 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 2/6 2024-02-20T07:52:14.395 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-20T07:52:14.395 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-20T07:52:14.396 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-20T07:52:14.652 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-20T07:52:14.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-16.el9.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:14.795 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:15.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2024-02-20T07:52:15.676 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:49 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:15.688 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-20T07:52:15.717 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 12/12 2024-02-20T07:52:15.845 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:15.847 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================== 2024-02-20T07:52:15.847 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:15.847 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================== 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:17.2.7-521.gc80e7168.el9 ceph 6.5 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.1 M 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:17.2.7-521.gc80e7168.el9 ceph 1.4 M 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 239 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:17.2.7-521.gc80e7168.el9 ceph 3.7 M 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 15 M 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-20T07:52:15.848 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-20T07:52:15.849 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================== 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout:Install 33 Packages 2024-02-20T07:52:15.850 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:15.851 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 27 M 2024-02-20T07:52:15.851 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 99 M 2024-02-20T07:52:15.851 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:16.159 INFO:teuthology.orchestra.run.smithi194.stdout:(1/33): ceph-17.2.7-521.gc80e7168.el9.x86_64.rp 40 kB/s | 6.5 kB 00:00 2024-02-20T07:52:16.393 INFO:teuthology.orchestra.run.smithi194.stdout:(2/33): ceph-mds-17.2.7-521.gc80e7168.el9.x86_6 5.2 MB/s | 2.1 MB 00:00 2024-02-20T07:52:16.685 INFO:teuthology.orchestra.run.smithi194.stdout:(3/33): ceph-mon-17.2.7-521.gc80e7168.el9.x86_6 7.0 MB/s | 3.7 MB 00:00 2024-02-20T07:52:16.760 INFO:teuthology.orchestra.run.smithi194.stdout:(4/33): ceph-mgr-modules-core-17.2.7-521.gc80e7 3.1 MB/s | 239 kB 00:00 2024-02-20T07:52:16.835 INFO:teuthology.orchestra.run.smithi194.stdout:(5/33): ceph-mgr-17.2.7-521.gc80e7168.el9.x86_6 1.7 MB/s | 1.4 MB 00:00 2024-02-20T07:52:16.894 INFO:teuthology.orchestra.run.smithi194.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2024-02-20T07:52:16.911 INFO:teuthology.orchestra.run.smithi194.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 427 kB/s | 32 kB 00:00 2024-02-20T07:52:16.928 INFO:teuthology.orchestra.run.smithi194.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-20T07:52:16.944 INFO:teuthology.orchestra.run.smithi194.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-02-20T07:52:16.978 INFO:teuthology.orchestra.run.smithi194.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-20T07:52:17.029 INFO:teuthology.orchestra.run.smithi194.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-02-20T07:52:17.054 INFO:teuthology.orchestra.run.smithi194.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-02-20T07:52:17.079 INFO:teuthology.orchestra.run.smithi194.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-20T07:52:17.104 INFO:teuthology.orchestra.run.smithi194.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-20T07:52:17.130 INFO:teuthology.orchestra.run.smithi194.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-02-20T07:52:17.280 INFO:teuthology.orchestra.run.smithi194.stdout:(16/33): ceph-osd-17.2.7-521.gc80e7168.el9.x86_ 17 MB/s | 15 MB 00:00 2024-02-20T07:52:17.347 INFO:teuthology.orchestra.run.smithi194.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 179 kB/s | 43 kB 00:00 2024-02-20T07:52:17.389 INFO:teuthology.orchestra.run.smithi194.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2024-02-20T07:52:17.414 INFO:teuthology.orchestra.run.smithi194.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 605 kB/s | 172 kB 00:00 2024-02-20T07:52:17.439 INFO:teuthology.orchestra.run.smithi194.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-02-20T07:52:17.465 INFO:teuthology.orchestra.run.smithi194.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-02-20T07:52:17.490 INFO:teuthology.orchestra.run.smithi194.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-02-20T07:52:17.515 INFO:teuthology.orchestra.run.smithi194.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-02-20T07:52:17.540 INFO:teuthology.orchestra.run.smithi194.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-02-20T07:52:17.566 INFO:teuthology.orchestra.run.smithi194.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-02-20T07:52:17.591 INFO:teuthology.orchestra.run.smithi194.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-02-20T07:52:17.608 INFO:teuthology.orchestra.run.smithi194.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-02-20T07:52:17.641 INFO:teuthology.orchestra.run.smithi194.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-02-20T07:52:17.667 INFO:teuthology.orchestra.run.smithi194.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-02-20T07:52:17.684 INFO:teuthology.orchestra.run.smithi194.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-02-20T07:52:17.717 INFO:teuthology.orchestra.run.smithi194.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 605 kB/s | 20 kB 00:00 2024-02-20T07:52:17.768 INFO:teuthology.orchestra.run.smithi194.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-02-20T07:52:17.792 INFO:teuthology.orchestra.run.smithi194.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.9 MB/s | 427 kB 00:00 2024-02-20T07:52:17.796 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:17.796 INFO:teuthology.orchestra.run.smithi194.stdout:Total 14 MB/s | 27 MB 00:01 2024-02-20T07:52:17.796 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:17.833 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:17.833 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:18.185 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:18.186 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:18.225 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 12/12 2024-02-20T07:52:18.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 1/12 2024-02-20T07:52:18.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-20T07:52:18.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-20T07:52:18.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-20T07:52:18.733 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-20T07:52:18.733 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-20T07:52:18.734 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:18.735 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:19.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-rook 2024-02-20T07:52:19.422 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:19.470 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-20T07:52:19.502 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-20T07:52:19.544 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-20T07:52:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-20T07:52:19.665 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:17 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-20T07:52:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-20T07:52:19.832 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 47 k 2024-02-20T07:52:19.833 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:19.834 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:19.835 INFO:teuthology.orchestra.run.smithi123.stdout:Install 13 Packages 2024-02-20T07:52:19.835 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:19.835 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-20T07:52:19.835 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.0 M 2024-02-20T07:52:19.835 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 26 M 2024-02-20T07:52:19.836 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:19.888 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-20T07:52:19.927 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-20T07:52:19.975 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-20T07:52:20.031 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-20T07:52:20.191 INFO:teuthology.orchestra.run.smithi123.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 163 kB/s | 24 kB 00:00 2024-02-20T07:52:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-20T07:52:20.216 INFO:teuthology.orchestra.run.smithi123.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 103 kB/s | 18 kB 00:00 2024-02-20T07:52:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-20T07:52:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-20T07:52:20.325 INFO:teuthology.orchestra.run.smithi123.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2024-02-20T07:52:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-20T07:52:20.350 INFO:teuthology.orchestra.run.smithi123.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 174 kB 00:00 2024-02-20T07:52:20.377 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-20T07:52:20.384 INFO:teuthology.orchestra.run.smithi123.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-02-20T07:52:20.409 INFO:teuthology.orchestra.run.smithi123.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 731 kB/s | 43 kB 00:00 2024-02-20T07:52:20.435 INFO:teuthology.orchestra.run.smithi123.stdout:(7/13): ceph-mgr-rook-17.2.7-521.gc80e7168.el9. 121 kB/s | 47 kB 00:00 2024-02-20T07:52:20.451 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-20T07:52:20.486 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-20T07:52:20.519 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-20T07:52:20.543 INFO:teuthology.orchestra.run.smithi123.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 203 kB/s | 32 kB 00:00 2024-02-20T07:52:20.560 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-20T07:52:20.593 INFO:teuthology.orchestra.run.smithi123.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 81 kB/s | 15 kB 00:00 2024-02-20T07:52:20.594 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-20T07:52:20.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-20T07:52:20.652 INFO:teuthology.orchestra.run.smithi123.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 934 kB/s | 203 kB 00:00 2024-02-20T07:52:20.718 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-20T07:52:20.768 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-20T07:52:20.777 INFO:teuthology.orchestra.run.smithi123.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 321 kB/s | 59 kB 00:00 2024-02-20T07:52:20.810 INFO:teuthology.orchestra.run.smithi123.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.8 MB/s | 1.0 MB 00:00 2024-02-20T07:52:20.836 INFO:teuthology.orchestra.run.smithi123.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 488 kB/s | 90 kB 00:00 2024-02-20T07:52:20.838 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:20.838 INFO:teuthology.orchestra.run.smithi123.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-02-20T07:52:20.838 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-20T07:52:20.851 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:20.851 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:20.948 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:20.948 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-20T07:52:21.093 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-20T07:52:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.n 28/33 2024-02-20T07:52:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 29/33 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 29/33 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-20T07:52:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:21.468 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:21.648 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-20T07:52:21.703 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-20T07:52:21.759 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-20T07:52:21.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-20T07:52:21.845 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-20T07:52:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-20T07:52:22.040 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-20T07:52:22.105 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-20T07:52:22.624 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 30/33 2024-02-20T07:52:22.650 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 30/33 2024-02-20T07:52:22.650 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:22.650 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-20T07:52:22.650 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-20T07:52:22.650 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-20T07:52:22.651 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:22.831 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-20T07:52:22.877 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-20T07:52:22.910 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-20T07:52:22.956 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-20T07:52:22.980 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 13/13 2024-02-20T07:52:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 31/33 2024-02-20T07:52:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 31/33 2024-02-20T07:52:23.048 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:23.048 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-20T07:52:23.048 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-20T07:52:23.048 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-20T07:52:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:23.258 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 32/33 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 32/33 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-20T07:52:23.282 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:23.348 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:17.2.7-521.gc80e7168.el9.x86_64 33/33 2024-02-20T07:52:23.797 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 13/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 1/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-20T07:52:23.798 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-20T07:52:24.184 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-20T07:52:24.184 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-20T07:52:24.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:24.186 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:24.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-cephadm 2024-02-20T07:52:25.016 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:23 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:25.066 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-2:17.2.7-521.gc80e7168.el9.x86_64 33/33 2024-02-20T07:52:25.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:17.2.7-521.gc80e7168.el9.x86_64 1/33 2024-02-20T07:52:25.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 2/33 2024-02-20T07:52:25.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 3/33 2024-02-20T07:52:25.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 4/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 5/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.n 6/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-20T07:52:25.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-20T07:52:25.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-20T07:52:25.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-20T07:52:25.180 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 121 k 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-20T07:52:25.181 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 6.8 M 2024-02-20T07:52:25.182 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 33 M 2024-02-20T07:52:25.183 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:25.670 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 806 kB/s | 227 kB 00:00 2024-02-20T07:52:25.887 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): ceph-mgr-cephadm-17.2.7-521.gc80e7168.el 243 kB/s | 121 kB 00:00 2024-02-20T07:52:25.987 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.6 MB/s | 5.8 MB 00:00 2024-02-20T07:52:26.012 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 462 kB/s | 58 kB 00:00 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:26.058 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-20T07:52:26.059 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-20T07:52:26.060 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-20T07:52:26.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-20T07:52:26.061 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:26.061 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:26.137 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 340 kB/s | 51 kB 00:00 2024-02-20T07:52:26.204 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-02-20T07:52:26.206 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:26.206 INFO:teuthology.orchestra.run.smithi123.stdout:Total 6.6 MB/s | 6.8 MB 00:01 2024-02-20T07:52:26.207 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:26.216 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:26.216 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:26.305 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:26.306 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:26.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-base 2024-02-20T07:52:26.599 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:26.768 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-20T07:52:26.831 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-20T07:52:26.987 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:00 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:27.102 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-base-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:27.152 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:27.153 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:52:27.153 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:27.224 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install cephadm 2024-02-20T07:52:27.336 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-20T07:52:27.416 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-20T07:52:27.472 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-20T07:52:27.510 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 6/6 2024-02-20T07:52:27.820 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:01 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:27.995 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 80 k 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:27.996 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 80 k 2024-02-20T07:52:27.997 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 364 k 2024-02-20T07:52:27.997 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:28.190 INFO:teuthology.orchestra.run.smithi194.stdout:cephadm-17.2.7-521.gc80e7168.el9.noarch.rpm 416 kB/s | 80 kB 00:00 2024-02-20T07:52:28.191 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:28.192 INFO:teuthology.orchestra.run.smithi194.stdout:Total 412 kB/s | 80 kB 00:00 2024-02-20T07:52:28.192 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:28.197 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:28.197 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:28.199 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:28.199 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:28.279 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:28.360 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 6/6 2024-02-20T07:52:28.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/6 2024-02-20T07:52:28.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-20T07:52:28.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-20T07:52:28.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-20T07:52:28.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-20T07:52:28.612 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-20T07:52:28.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-20T07:52:28.705 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:28.705 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:28.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-fuse 2024-02-20T07:52:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:29.447 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/1 2024-02-20T07:52:29.448 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:29.448 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:29.448 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:29.448 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:29.448 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:29.528 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:27 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:29.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-immutable-object-cache 2024-02-20T07:52:29.693 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:29.693 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:29.693 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-02-20T07:52:29.693 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:29.693 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 812 k 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout:Install 2 Packages 2024-02-20T07:52:29.694 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:29.695 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 891 k 2024-02-20T07:52:29.695 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 2.6 M 2024-02-20T07:52:29.695 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:29.889 INFO:teuthology.orchestra.run.smithi123.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 404 kB/s | 79 kB 00:00 2024-02-20T07:52:30.245 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:04 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:30.348 INFO:teuthology.orchestra.run.smithi123.stdout:(2/2): ceph-fuse-17.2.7-521.gc80e7168.el9.x86_6 1.2 MB/s | 812 kB 00:00 2024-02-20T07:52:30.349 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:30.349 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.3 MB/s | 891 kB 00:00 2024-02-20T07:52:30.349 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:30.369 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:30.369 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:30.409 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-521.gc80e7168.el9 ceph 137 k 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:52:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:30.411 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 137 k 2024-02-20T07:52:30.411 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 379 k 2024-02-20T07:52:30.411 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:30.444 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:30.444 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:30.647 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:30.651 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-immutable-object-cache-17.2.7-521.gc80e716 571 kB/s | 137 kB 00:00 2024-02-20T07:52:30.652 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:30.652 INFO:teuthology.orchestra.run.smithi194.stdout:Total 567 kB/s | 137 kB 00:00 2024-02-20T07:52:30.652 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:30.659 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:30.660 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:30.711 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:30.712 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:30.785 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-20T07:52:30.855 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2/2 2024-02-20T07:52:30.862 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:30.935 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:30.960 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:30.960 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:30.960 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-20T07:52:30.960 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:31.579 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2/2 2024-02-20T07:52:31.580 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/2 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:31.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.e 1/1 2024-02-20T07:52:31.947 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:31.947 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:31.947 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:31.947 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:31.948 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:32.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados-devel 2024-02-20T07:52:32.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2024-02-20T07:52:32.750 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:30 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:32.794 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:06 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:32.907 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-mgr-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:32.917 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:17.2.7-521.gc80e7168.el9 ceph 126 k 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:32.918 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 126 k 2024-02-20T07:52:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 448 k 2024-02-20T07:52:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:32.958 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:32.959 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:52:32.959 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:33.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2024-02-20T07:52:33.143 INFO:teuthology.orchestra.run.smithi123.stdout:librados-devel-17.2.7-521.gc80e7168.el9.x86_64. 564 kB/s | 126 kB 00:00 2024-02-20T07:52:33.144 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:33.144 INFO:teuthology.orchestra.run.smithi123.stdout:Total 560 kB/s | 126 kB 00:00 2024-02-20T07:52:33.144 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:33.150 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:33.150 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:33.205 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:33.206 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:33.352 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:33.458 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:33.602 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:07 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:33.770 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 1.7 M 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 23 k 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 15 k 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-20T07:52:33.771 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout:Install 7 Packages 2024-02-20T07:52:33.772 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:33.773 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.0 M 2024-02-20T07:52:33.773 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 8.1 M 2024-02-20T07:52:33.773 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:33.941 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:34.012 INFO:teuthology.orchestra.run.smithi194.stdout:(1/7): ceph-prometheus-alerts-17.2.7-521.gc80e7 74 kB/s | 15 kB 00:00 2024-02-20T07:52:34.112 INFO:teuthology.orchestra.run.smithi194.stdout:(2/7): ceph-grafana-dashboards-17.2.7-521.gc80e 79 kB/s | 23 kB 00:00 2024-02-20T07:52:34.213 INFO:teuthology.orchestra.run.smithi194.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 45 kB/s | 9.0 kB 00:00 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:34.277 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:34.397 INFO:teuthology.orchestra.run.smithi194.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 167 kB/s | 31 kB 00:00 2024-02-20T07:52:34.438 INFO:teuthology.orchestra.run.smithi194.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 126 kB/s | 41 kB 00:00 2024-02-20T07:52:34.472 INFO:teuthology.orchestra.run.smithi194.stdout:(6/7): ceph-mgr-dashboard-17.2.7-521.gc80e7168. 2.6 MB/s | 1.7 MB 00:00 2024-02-20T07:52:34.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs2 2024-02-20T07:52:34.647 INFO:teuthology.orchestra.run.smithi194.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 753 kB/s | 188 kB 00:00 2024-02-20T07:52:34.649 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:34.649 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.3 MB/s | 2.0 MB 00:00 2024-02-20T07:52:34.650 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:34.657 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:34.657 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:34.725 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:34.726 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:35.029 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-20T07:52:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-20T07:52:35.112 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:33 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-20T07:52:35.194 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-20T07:52:35.222 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.no 5/7 2024-02-20T07:52:35.230 INFO:teuthology.orchestra.run.smithi123.stdout:Package libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:35.283 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:35.284 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:35.285 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:35.357 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs-devel 2024-02-20T07:52:35.451 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.n 6/7 2024-02-20T07:52:35.484 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 7/7 2024-02-20T07:52:35.932 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:33 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:35.996 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 7/7 2024-02-20T07:52:35.996 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.n 1/7 2024-02-20T07:52:35.996 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 2/7 2024-02-20T07:52:35.996 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.no 3/7 2024-02-20T07:52:35.996 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-20T07:52:35.997 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-20T07:52:35.997 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-20T07:52:36.097 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:36.097 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:17.2.7-521.gc80e7168.el9 ceph 25 k 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 25 k 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 110 k 2024-02-20T07:52:36.098 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-20T07:52:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-20T07:52:36.322 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-20T07:52:36.322 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-20T07:52:36.322 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:36.322 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:36.521 INFO:teuthology.orchestra.run.smithi123.stdout:libcephfs-devel-17.2.7-521.gc80e7168.el9.x86_64 59 kB/s | 25 kB 00:00 2024-02-20T07:52:36.522 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:36.522 INFO:teuthology.orchestra.run.smithi123.stdout:Total 59 kB/s | 25 kB 00:00 2024-02-20T07:52:36.522 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:36.526 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:36.526 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:36.527 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:36.528 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:36.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-20T07:52:36.615 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:36.720 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:37.103 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:37.137 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:11 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================== 2024-02-20T07:52:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================== 2024-02-20T07:52:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 7.4 M 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================== 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:Install 12 Packages 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 37 M 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 209 M 2024-02-20T07:52:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:37.385 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:37.495 INFO:teuthology.orchestra.run.smithi194.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 221 kB/s | 32 kB 00:00 2024-02-20T07:52:37.537 INFO:teuthology.orchestra.run.smithi194.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 424 kB/s | 17 kB 00:00 2024-02-20T07:52:37.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados2 2024-02-20T07:52:37.579 INFO:teuthology.orchestra.run.smithi194.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 824 kB/s | 34 kB 00:00 2024-02-20T07:52:37.630 INFO:teuthology.orchestra.run.smithi194.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-02-20T07:52:37.813 INFO:teuthology.orchestra.run.smithi194.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-02-20T07:52:37.872 INFO:teuthology.orchestra.run.smithi194.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-02-20T07:52:37.897 INFO:teuthology.orchestra.run.smithi194.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-02-20T07:52:38.064 INFO:teuthology.orchestra.run.smithi194.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 802 kB 00:00 2024-02-20T07:52:38.137 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:36 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:38.253 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:38.268 INFO:teuthology.orchestra.run.smithi194.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-02-20T07:52:38.298 INFO:teuthology.orchestra.run.smithi194.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 839 kB/s | 194 kB 00:00 2024-02-20T07:52:38.305 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:38.306 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:38.306 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:38.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librbd1 2024-02-20T07:52:38.523 INFO:teuthology.orchestra.run.smithi194.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 966 kB/s | 245 kB 00:00 2024-02-20T07:52:38.955 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:36 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:39.071 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:39.120 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:39.121 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:39.121 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:39.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rados 2024-02-20T07:52:39.348 INFO:teuthology.orchestra.run.smithi194.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-5 3.7 MB/s | 7.4 MB 00:01 2024-02-20T07:52:39.351 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:39.351 INFO:teuthology.orchestra.run.smithi194.stdout:Total 18 MB/s | 37 MB 00:02 2024-02-20T07:52:39.372 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:39.396 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:39.396 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:39.767 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:37 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:39.826 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:39.826 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:39.881 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:39.934 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:39.936 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:39.936 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:40.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rgw 2024-02-20T07:52:40.524 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:40.583 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:38 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:40.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-20T07:52:40.627 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-20T07:52:40.695 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:40.719 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-20T07:52:40.747 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:40.748 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:40.748 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:40.764 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-20T07:52:40.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-cephfs 2024-02-20T07:52:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-20T07:52:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-20T07:52:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-20T07:52:41.398 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:39 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:41.511 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:41.562 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:41.563 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:41.563 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:41.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rbd 2024-02-20T07:52:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-20T07:52:41.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-20T07:52:42.218 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:40 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:42.332 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:52:42.384 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:42.385 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-02-20T07:52:42.386 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:42.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-fuse 2024-02-20T07:52:43.033 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:41 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:43.082 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-20T07:52:43.199 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:43.200 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:43.200 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 81 k 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 81 k 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 222 k 2024-02-20T07:52:43.201 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:43.724 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-fuse-17.2.7-521.gc80e7168.el9.x86_64.rpm 155 kB/s | 81 kB 00:00 2024-02-20T07:52:43.725 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:43.725 INFO:teuthology.orchestra.run.smithi123.stdout:Total 155 kB/s | 81 kB 00:00 2024-02-20T07:52:43.725 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:43.732 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:43.732 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:43.788 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:43.788 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:43.920 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:44.031 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:44.116 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-20T07:52:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 12/12 2024-02-20T07:52:44.416 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:44.725 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:44.725 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:44.725 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:44.725 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:44.726 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:44.935 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-mirror 2024-02-20T07:52:45.515 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:43 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:45.685 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.9 M 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:45.686 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:45.687 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:45.687 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.9 M 2024-02-20T07:52:45.687 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 12 M 2024-02-20T07:52:45.687 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:46.554 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-mirror-17.2.7-521.gc80e7168.el9.x86_64.rpm 3.4 MB/s | 2.9 MB 00:00 2024-02-20T07:52:46.554 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:46.555 INFO:teuthology.orchestra.run.smithi123.stdout:Total 3.4 MB/s | 2.9 MB 00:00 2024-02-20T07:52:46.555 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:46.564 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:46.564 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:46.631 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 12/12 2024-02-20T07:52:46.631 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e71 1/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-20T07:52:46.632 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-20T07:52:46.637 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:46.637 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-20T07:52:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-20T07:52:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:47.123 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:47.508 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2024-02-20T07:52:48.087 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:22 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:48.253 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 47 k 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-20T07:52:48.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:48.255 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:48.256 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2024-02-20T07:52:48.256 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:48.256 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.0 M 2024-02-20T07:52:48.256 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 26 M 2024-02-20T07:52:48.256 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:48.477 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 138 kB/s | 24 kB 00:00 2024-02-20T07:52:48.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-nbd 2024-02-20T07:52:48.501 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 89 kB/s | 18 kB 00:00 2024-02-20T07:52:48.594 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 174 kB 00:00 2024-02-20T07:52:48.619 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2024-02-20T07:52:48.661 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.1 MB/s | 211 kB 00:00 2024-02-20T07:52:48.686 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 639 kB/s | 43 kB 00:00 2024-02-20T07:52:48.720 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): ceph-mgr-rook-17.2.7-521.gc80e7168.el9. 113 kB/s | 47 kB 00:00 2024-02-20T07:52:49.072 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:47 ago on Tue 20 Feb 2024 07:51:02 AM UTC. 2024-02-20T07:52:49.238 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-02-20T07:52:49.238 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 165 k 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 165 k 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 477 k 2024-02-20T07:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-02-20T07:52:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 16 kB/s | 15 kB 00:00 2024-02-20T07:52:49.737 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 30 kB/s | 32 kB 00:01 2024-02-20T07:52:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-nbd-17.2.7-521.gc80e7168.el9.x86_64.rpm 309 kB/s | 165 kB 00:00 2024-02-20T07:52:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:49.774 INFO:teuthology.orchestra.run.smithi123.stdout:Total 308 kB/s | 165 kB 00:00 2024-02-20T07:52:49.774 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-02-20T07:52:49.782 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-02-20T07:52:49.782 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-02-20T07:52:49.837 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-02-20T07:52:49.837 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-02-20T07:52:49.984 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-02-20T07:52:50.086 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:50.312 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 127 kB/s | 203 kB 00:01 2024-02-20T07:52:50.530 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:52:50.874 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-02-20T07:52:50.904 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 809 kB/s | 1.0 MB 00:01 2024-02-20T07:52:50.929 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 50 kB/s | 59 kB 00:01 2024-02-20T07:52:50.954 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 140 kB/s | 90 kB 00:00 2024-02-20T07:52:50.960 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:50.960 INFO:teuthology.orchestra.run.smithi194.stdout:Total 774 kB/s | 2.0 MB 00:02 2024-02-20T07:52:50.961 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:50.976 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:50.976 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:51.082 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:51.083 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:51.111 DEBUG:teuthology.parallel:result is None 2024-02-20T07:52:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-20T07:52:51.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-20T07:52:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-20T07:52:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-20T07:52:51.964 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-20T07:52:52.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-20T07:52:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-20T07:52:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-20T07:52:52.934 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-20T07:52:52.987 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-20T07:52:53.021 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-20T07:52:53.066 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-20T07:52:53.091 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 13/13 2024-02-20T07:52:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 13/13 2024-02-20T07:52:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 1/13 2024-02-20T07:52:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-20T07:52:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-20T07:52:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-20T07:52:54.269 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-20T07:52:54.269 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:54.269 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:54.270 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:52:54.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-cephadm 2024-02-20T07:52:55.098 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:29 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:52:55.264 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:17.2.7-521.gc80e7168.el9 ceph-noarch 121 k 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:52:55.265 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-02-20T07:52:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:52:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 6.8 M 2024-02-20T07:52:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 33 M 2024-02-20T07:52:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:52:55.472 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 227 kB 00:00 2024-02-20T07:52:55.813 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 5.8 MB 00:00 2024-02-20T07:52:56.189 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 765 kB/s | 548 kB 00:00 2024-02-20T07:52:56.289 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 509 kB/s | 51 kB 00:00 2024-02-20T07:52:56.606 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): ceph-mgr-cephadm-17.2.7-521.gc80e7168.el 94 kB/s | 121 kB 00:01 2024-02-20T07:52:58.447 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 22 kB/s | 58 kB 00:02 2024-02-20T07:52:58.449 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:52:58.450 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.1 MB/s | 6.8 MB 00:03 2024-02-20T07:52:58.450 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:52:58.461 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:52:58.461 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:52:58.555 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:52:58.555 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:52:58.852 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:52:59.028 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-20T07:52:59.082 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-20T07:52:59.594 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-20T07:52:59.675 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-20T07:52:59.731 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-20T07:52:59.760 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 6/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 6/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 1/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-20T07:53:00.636 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:17.2.7-521.gc80e7168.el9.noarch 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-20T07:53:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-20T07:53:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-20T07:53:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:00.958 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:01.215 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2024-02-20T07:53:01.826 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:35 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:01.999 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:01.999 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:01.999 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-02-20T07:53:01.999 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 812 k 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout:Install 2 Packages 2024-02-20T07:53:02.000 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:02.001 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 891 k 2024-02-20T07:53:02.001 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 2.6 M 2024-02-20T07:53:02.001 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:02.132 INFO:teuthology.orchestra.run.smithi194.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 601 kB/s | 79 kB 00:00 2024-02-20T07:53:02.432 INFO:teuthology.orchestra.run.smithi194.stdout:(2/2): ceph-fuse-17.2.7-521.gc80e7168.el9.x86_6 1.8 MB/s | 812 kB 00:00 2024-02-20T07:53:02.434 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:02.435 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.0 MB/s | 891 kB 00:00 2024-02-20T07:53:02.435 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:02.455 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:02.455 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:02.531 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:02.531 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:02.853 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-20T07:53:02.925 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2/2 2024-02-20T07:53:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2/2 2024-02-20T07:53:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/2 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:03.990 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:04.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados-devel 2024-02-20T07:53:04.851 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:38 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:05.017 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:17.2.7-521.gc80e7168.el9 ceph 126 k 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:05.018 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:53:05.019 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:05.019 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 126 k 2024-02-20T07:53:05.019 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 448 k 2024-02-20T07:53:05.019 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:05.328 INFO:teuthology.orchestra.run.smithi194.stdout:librados-devel-17.2.7-521.gc80e7168.el9.x86_64. 409 kB/s | 126 kB 00:00 2024-02-20T07:53:05.329 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:05.329 INFO:teuthology.orchestra.run.smithi194.stdout:Total 407 kB/s | 126 kB 00:00 2024-02-20T07:53:05.329 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:05.334 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:05.334 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:05.390 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:05.391 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:05.531 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:05.642 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:06.148 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:06.456 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:53:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:06.456 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:06.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2024-02-20T07:53:07.285 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:41 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:07.403 INFO:teuthology.orchestra.run.smithi194.stdout:Package libcephfs2-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:07.454 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:07.455 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:07.455 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:07.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2024-02-20T07:53:08.093 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:42 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:08.259 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:17.2.7-521.gc80e7168.el9 ceph 25 k 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:53:08.260 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:08.261 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 25 k 2024-02-20T07:53:08.261 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 110 k 2024-02-20T07:53:08.261 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:08.497 INFO:teuthology.orchestra.run.smithi194.stdout:libcephfs-devel-17.2.7-521.gc80e7168.el9.x86_64 106 kB/s | 25 kB 00:00 2024-02-20T07:53:08.497 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:08.497 INFO:teuthology.orchestra.run.smithi194.stdout:Total 105 kB/s | 25 kB 00:00 2024-02-20T07:53:08.497 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:08.501 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:08.501 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:08.502 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:08.503 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:09.079 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:09.347 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:09.347 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:09.348 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:09.348 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:53:09.348 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:09.348 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:09.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2024-02-20T07:53:10.108 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:44 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:10.225 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:10.277 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:10.278 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:10.278 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:10.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2024-02-20T07:53:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:44 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:11.085 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:11.086 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:11.086 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:11.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rados 2024-02-20T07:53:11.731 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:45 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:11.852 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rados-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:11.906 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:11.907 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:11.907 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:11.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rgw 2024-02-20T07:53:12.551 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:46 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:12.665 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rgw-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:12.716 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:12.717 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:12.717 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:12.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-cephfs 2024-02-20T07:53:13.361 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:47 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:13.476 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-cephfs-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:13.527 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:13.528 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:13.528 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:13.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rbd 2024-02-20T07:53:14.170 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:48 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:14.285 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rbd-2:17.2.7-521.gc80e7168.el9.x86_64 is already installed. 2024-02-20T07:53:14.337 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:14.338 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-02-20T07:53:14.338 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:14.411 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2024-02-20T07:53:14.995 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:48 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:15.163 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:17.2.7-521.gc80e7168.el9 ceph 81 k 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:15.164 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:53:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:15.165 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 81 k 2024-02-20T07:53:15.165 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 222 k 2024-02-20T07:53:15.165 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:15.582 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-fuse-17.2.7-521.gc80e7168.el9.x86_64.rpm 195 kB/s | 81 kB 00:00 2024-02-20T07:53:15.583 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:15.583 INFO:teuthology.orchestra.run.smithi194.stdout:Total 194 kB/s | 81 kB 00:00 2024-02-20T07:53:15.583 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:15.590 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:15.590 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:15.646 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:15.647 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:15.888 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:16.303 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:16.599 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:16.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-mirror 2024-02-20T07:53:17.407 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:51 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:17.577 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:17.2.7-521.gc80e7168.el9 ceph 2.9 M 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:53:17.578 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:17.579 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.9 M 2024-02-20T07:53:17.579 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 12 M 2024-02-20T07:53:17.579 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:17.978 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-mirror-17.2.7-521.gc80e7168.el9.x86_64.rpm 7.4 MB/s | 2.9 MB 00:00 2024-02-20T07:53:17.979 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:17.979 INFO:teuthology.orchestra.run.smithi194.stdout:Total 7.3 MB/s | 2.9 MB 00:00 2024-02-20T07:53:17.979 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:17.989 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:17.989 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:18.061 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:18.062 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:18.464 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:18.521 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-20T07:53:18.545 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:19.678 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:53:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:19.678 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:19.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-nbd 2024-02-20T07:53:20.518 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:54 ago on Tue 20 Feb 2024 07:51:26 AM UTC. 2024-02-20T07:53:20.683 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-02-20T07:53:20.684 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:20.684 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-02-20T07:53:20.684 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:20.684 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-02-20T07:53:20.684 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:17.2.7-521.gc80e7168.el9 ceph 165 k 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 165 k 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 477 k 2024-02-20T07:53:20.685 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-02-20T07:53:21.224 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-nbd-17.2.7-521.gc80e7168.el9.x86_64.rpm 307 kB/s | 165 kB 00:00 2024-02-20T07:53:21.251 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:53:21.252 INFO:teuthology.orchestra.run.smithi194.stdout:Total 306 kB/s | 165 kB 00:00 2024-02-20T07:53:21.252 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-02-20T07:53:21.252 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-02-20T07:53:21.252 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-02-20T07:53:21.287 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-02-20T07:53:21.287 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-02-20T07:53:21.471 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-02-20T07:53:21.570 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:22.031 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 1/1 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:17.2.7-521.gc80e7168.el9.x86_64 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:53:22.381 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-02-20T07:53:22.594 DEBUG:teuthology.parallel:result is None 2024-02-20T07:53:22.594 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:53:22.594 INFO:teuthology.packaging:ref: None 2024-02-20T07:53:22.594 INFO:teuthology.packaging:tag: None 2024-02-20T07:53:22.594 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:53:22.594 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:53:22.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-20T07:53:22.816 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-20T07:53:22.841 INFO:teuthology.orchestra.run.smithi123.stdout:17.2.7-521.gc80e7168.el9 2024-02-20T07:53:22.842 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-521.gc80e7168.el9 2024-02-20T07:53:22.842 INFO:teuthology.task.install:The correct ceph version 17.2.7-521.gc80e7168 is installed. 2024-02-20T07:53:22.843 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-20T07:53:22.844 INFO:teuthology.packaging:ref: None 2024-02-20T07:53:22.844 INFO:teuthology.packaging:tag: None 2024-02-20T07:53:22.844 INFO:teuthology.packaging:branch: quincy 2024-02-20T07:53:22.844 INFO:teuthology.packaging:sha1: 91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T07:53:22.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-20T07:53:23.302 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-20T07:53:23.323 INFO:teuthology.orchestra.run.smithi194.stdout:17.2.7-521.gc80e7168.el9 2024-02-20T07:53:23.323 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-521.gc80e7168.el9 2024-02-20T07:53:23.323 INFO:teuthology.task.install:The correct ceph version 17.2.7-521.gc80e7168 is installed. 2024-02-20T07:53:23.325 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-20T07:53:23.325 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:53:23.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-20T07:53:23.358 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:53:23.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-20T07:53:23.391 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-20T07:53:23.391 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:53:23.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-02-20T07:53:23.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-20T07:53:23.497 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:53:23.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-02-20T07:53:23.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-20T07:53:23.592 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-20T07:53:23.592 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:53:23.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-20T07:53:23.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-20T07:53:23.689 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:53:23.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-20T07:53:23.715 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-20T07:53:23.781 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-20T07:53:23.782 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:53:23.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-02-20T07:53:23.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-20T07:53:23.876 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:53:23.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-02-20T07:53:23.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-20T07:53:23.969 INFO:teuthology.run_tasks:Running task print... 2024-02-20T07:53:23.980 INFO:teuthology.task.print:**** done install task... 2024-02-20T07:53:23.980 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-20T07:53:24.074 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '91ff50e903dcc99ee3ecf9523050878eb452da5c'} 2024-02-20T07:53:24.074 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-20T07:53:24.074 INFO:tasks.cephadm:Cluster fsid is 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:53:24.075 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-20T07:53:24.075 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-20T07:53:24.075 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi123': '172.21.15.123', 'mon.smithi194': '172.21.15.194'} 2024-02-20T07:53:24.075 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-20T07:53:24.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-02-20T07:53:24.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-02-20T07:53:24.130 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-20T07:53:24.130 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.461 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 20 07:53 /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.461 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.708 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 20 07:53 /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.709 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.724 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-20T07:53:24.749 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-20T07:53:24.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-20T07:53:24.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-20T07:53:25.628 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-20T07:53:25.665 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-20T07:54:33.157 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T07:54:33.158 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)", 2024-02-20T07:54:33.158 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e", 2024-02-20T07:54:33.158 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-02-20T07:54:33.158 INFO:teuthology.orchestra.run.smithi123.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b" 2024-02-20T07:54:33.158 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-02-20T07:54:33.159 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T07:54:39.631 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-02-20T07:54:39.631 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)", 2024-02-20T07:54:39.632 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e", 2024-02-20T07:54:39.632 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-02-20T07:54:39.632 INFO:teuthology.orchestra.run.smithi194.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b" 2024-02-20T07:54:39.632 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-02-20T07:54:39.632 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-02-20T07:54:39.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-02-20T07:54:39.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-02-20T07:54:39.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-02-20T07:54:39.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-02-20T07:54:39.786 INFO:tasks.cephadm:Writing seed config... 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-20T07:54:39.788 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-20T07:54:39.789 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-20T07:54:39.790 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-20T07:54:39.791 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-20T07:54:39.791 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:54:39.791 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-20T07:54:39.817 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1f99de10-cfc5-11ee-95bb-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-20T07:54:39.817 DEBUG:teuthology.orchestra.run.smithi123:mon.smithi123> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service 2024-02-20T07:54:39.859 INFO:tasks.cephadm:Bootstrapping... 2024-02-20T07:54:39.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.123 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-20T07:54:40.068 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-02-20T07:54:40.069 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '1f99de10-cfc5-11ee-95bb-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.123', '--skip-admin-label'] 2024-02-20T07:54:40.094 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-20T07:54:40.095 INFO:teuthology.orchestra.run.smithi123.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-20T07:54:40.095 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying podman|docker is present... 2024-02-20T07:54:40.119 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-20T07:54:40.119 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying lvm2 is present... 2024-02-20T07:54:40.119 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying time synchronization is in place... 2024-02-20T07:54:40.127 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-20T07:54:40.127 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-20T07:54:40.133 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-20T07:54:40.133 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:54:40.140 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-02-20T07:54:40.146 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-02-20T07:54:40.146 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-02-20T07:54:40.146 INFO:teuthology.orchestra.run.smithi123.stdout:Repeating the final host check... 2024-02-20T07:54:40.170 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-20T07:54:40.170 INFO:teuthology.orchestra.run.smithi123.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-20T07:54:40.170 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl is present 2024-02-20T07:54:40.170 INFO:teuthology.orchestra.run.smithi123.stdout:lvcreate is present 2024-02-20T07:54:40.176 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-20T07:54:40.176 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-20T07:54:40.182 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-20T07:54:40.182 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:54:40.189 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-02-20T07:54:40.195 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-02-20T07:54:40.195 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-02-20T07:54:40.195 INFO:teuthology.orchestra.run.smithi123.stdout:Host looks OK 2024-02-20T07:54:40.195 INFO:teuthology.orchestra.run.smithi123.stdout:Cluster fsid: 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:40.196 INFO:teuthology.orchestra.run.smithi123.stdout:Acquiring lock 140186820459008 on /run/cephadm/1f99de10-cfc5-11ee-95bb-87774f69a715.lock 2024-02-20T07:54:40.196 INFO:teuthology.orchestra.run.smithi123.stdout:Lock 140186820459008 acquired on /run/cephadm/1f99de10-cfc5-11ee-95bb-87774f69a715.lock 2024-02-20T07:54:40.196 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 3300 ... 2024-02-20T07:54:40.196 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 6789 ... 2024-02-20T07:54:40.196 INFO:teuthology.orchestra.run.smithi123.stdout:Base mon IP(s) is [172.21.15.123:3300, 172.21.15.123:6789], mon addrv is [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-02-20T07:54:40.199 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.123 metric 100 2024-02-20T07:54:40.199 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.123 metric 100 2024-02-20T07:54:40.202 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-20T07:54:40.202 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-20T07:54:40.202 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-02-20T07:54:40.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-20T07:54:40.206 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-02-20T07:54:40.206 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-02-20T07:54:40.206 INFO:teuthology.orchestra.run.smithi123.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-20T07:54:40.206 INFO:teuthology.orchestra.run.smithi123.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-20T07:54:40.207 INFO:teuthology.orchestra.run.smithi123.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-20T07:54:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e 2024-02-20T07:54:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-20T07:54:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Getting image source signatures 2024-02-20T07:54:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:f8275265412e57f06c462f3ab36d3ba9cb1e55305ee9294fe928d41e45938854 2024-02-20T07:54:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-20T07:54:40.773 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying config sha256:10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e 2024-02-20T07:54:40.773 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-20T07:54:41.710 INFO:teuthology.orchestra.run.smithi123.stdout:ceph: stdout ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable) 2024-02-20T07:54:41.710 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph version: ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable) 2024-02-20T07:54:41.710 INFO:teuthology.orchestra.run.smithi123.stdout:Extracting ceph user uid/gid from container image... 2024-02-20T07:54:42.749 INFO:teuthology.orchestra.run.smithi123.stdout:stat: stdout 167 167 2024-02-20T07:54:42.749 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial keys... 2024-02-20T07:54:43.687 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDDWtRlPhJEBhAAx9MpXrJ+QEPCNDVq4uxmYA== 2024-02-20T07:54:44.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDEWtRlVWybABAALUB+kKBaQNcq5awS+NfdYA== 2024-02-20T07:54:45.565 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDEWtRlUfkUMxAAazoUXdgecvpwhBBLOsaSNw== 2024-02-20T07:54:45.565 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial monmap... 2024-02-20T07:54:46.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-20T07:54:46.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool for smithi123 [v2:172.21.15.123:3300,v1:172.21.15.123:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = octopus 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: set fsid to 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:54:46.530 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mon... 2024-02-20T07:54:49.471 INFO:teuthology.orchestra.run.smithi123.stdout:create mon.smithi123 on 2024-02-20T07:54:49.884 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-20T07:54:50.276 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-20T07:54:50.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target. 2024-02-20T07:54:50.668 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target. 2024-02-20T07:54:50.919 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123 2024-02-20T07:54:50.919 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service: Unit ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service not loaded. 2024-02-20T07:54:51.122 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target.wants/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service → /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@.service. 2024-02-20T07:54:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:51 smithi123 podman[28991]: 2024-02-20 07:54:51.261429373 +0000 UTC m=+0.017826241 image pull 10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e quay.ceph.io/ceph-ci/ceph:quincy 2024-02-20T07:54:52.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:52 smithi123 podman[28991]: 2024-02-20 07:54:52.185241022 +0000 UTC m=+0.941637935 container create 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-20T07:54:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 podman[28991]: 2024-02-20 07:54:54.027810395 +0000 UTC m=+2.784207264 container init 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-20T07:54:54.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 podman[28991]: 2024-02-20 07:54:54.031785505 +0000 UTC m=+2.788182374 container start 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-c80e716, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214) 2024-02-20T07:54:54.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 ceph-mon[29010]: mkfs 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:54.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 ceph-mon[29010]: mon.smithi123 is new leader, mons smithi123 in quorum (ranks 0) 2024-02-20T07:54:54.791 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-20T07:54:54.791 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-02-20T07:54:54.800 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-20T07:54:54.800 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:54:54.800 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-02-20T07:54:54.803 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-02-20T07:54:54.803 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon to start... 2024-02-20T07:54:54.804 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon... 2024-02-20T07:54:55.112 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 bash[28991]: 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 2024-02-20T07:54:55.112 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:54 smithi123 systemd[1]: Started Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T07:54:55.413 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:55 smithi123 ceph-mon[29010]: mon.smithi123 is new leader, mons smithi123 in quorum (ranks 0) 2024-02-20T07:54:55.414 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:55 smithi123 ceph-mon[29010]: monmap e1: 1 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T07:54:55.414 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:55 smithi123 ceph-mon[29010]: fsmap 2024-02-20T07:54:55.414 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:55 smithi123 ceph-mon[29010]: osdmap e1: 0 total, 0 up, 0 in 2024-02-20T07:54:55.414 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:55 smithi123 ceph-mon[29010]: mgrmap e1: no daemons active 2024-02-20T07:54:56.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout cluster: 2024-02-20T07:54:56.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout id: 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:56.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-20T07:54:56.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout services: 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi123 (age 1.42761s) 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout data: 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pgs: 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.445+0000 7f210a608700 1 Processor -- start 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.445+0000 7f210a608700 1 -- start start 2024-02-20T07:54:56.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.445+0000 7f210a608700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.445+0000 7f210a608700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104104790 con 0x7f2104103e40 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.446+0000 7f2103fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.446+0000 7f2103fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52146/0 (socket says 172.21.15.123:52146) 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.446+0000 7f2103fff700 1 -- 172.21.15.123:0/2037619057 learned_addr learned my addr 172.21.15.123:0/2037619057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.446+0000 7f2103fff700 1 -- 172.21.15.123:0/2037619057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21041048d0 con 0x7f2104103e40 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.446+0000 7f2103fff700 1 --2- 172.21.15.123:0/2037619057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20f40098e0 tx=0x7f20f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbba15b07d1a72f server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f2102ffd700 1 -- 172.21.15.123:0/2037619057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f400b860 con 0x7f2104103e40 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f2102ffd700 1 -- 172.21.15.123:0/2037619057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400b9c0 con 0x7f2104103e40 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f2102ffd700 1 -- 172.21.15.123:0/2037619057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f400bc90 con 0x7f2104103e40 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 -- 172.21.15.123:0/2037619057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 msgr2=0x7f2104104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 --2- 172.21.15.123:0/2037619057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20f40098e0 tx=0x7f20f4009250 comp rx=0 tx=0).stop 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 -- 172.21.15.123:0/2037619057 shutdown_connections 2024-02-20T07:54:56.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 --2- 172.21.15.123:0/2037619057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104104250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 -- 172.21.15.123:0/2037619057 >> 172.21.15.123:0/2037619057 conn(0x7f21040fc580 msgr2=0x7f21040fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 -- 172.21.15.123:0/2037619057 shutdown_connections 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.447+0000 7f210a608700 1 -- 172.21.15.123:0/2037619057 wait complete. 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f210a608700 1 Processor -- start 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f210a608700 1 -- start start 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f210a608700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f210a608700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104111570 con 0x7f2104103e40 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f2103fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f2103fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52162/0 (socket says 172.21.15.123:52162) 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.448+0000 7f2103fff700 1 -- 172.21.15.123:0/1066763082 learned_addr learned my addr 172.21.15.123:0/1066763082 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2103fff700 1 -- 172.21.15.123:0/1066763082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40094f0 con 0x7f2104103e40 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2103fff700 1 --2- 172.21.15.123:0/1066763082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20f4003080 tx=0x7f20f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f401c5c0 con 0x7f2104103e40 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f401c720 con 0x7f2104103e40 2024-02-20T07:54:56.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2104111770 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f401ca30 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104112410 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f20f401a450 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.449+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f20f402e790 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.450+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210405f5c0 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.452+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f20f401a890 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.520+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2104064ad0 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f2100ff9700 1 -- 172.21.15.123:0/1066763082 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7f20f401aa30 con 0x7f2104103e40 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 msgr2=0x7f2104111030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f210a608700 1 --2- 172.21.15.123:0/1066763082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20f4003080 tx=0x7f20f4016000 comp rx=0 tx=0).stop 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 shutdown_connections 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f210a608700 1 --2- 172.21.15.123:0/1066763082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2104103e40 0x7f2104111030 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.521+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 >> 172.21.15.123:0/1066763082 conn(0x7f21040fc580 msgr2=0x7f2104107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.522+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 shutdown_connections 2024-02-20T07:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:55.522+0000 7f210a608700 1 -- 172.21.15.123:0/1066763082 wait complete. 2024-02-20T07:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:mon is available 2024-02-20T07:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:Assimilating anything we can from ceph.conf... 2024-02-20T07:54:56.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:56 smithi123 ceph-mon[29010]: from='client.? 172.21.15.123:0/1066763082' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-20T07:54:57.123 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f866233c700 1 Processor -- start 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f866233c700 1 -- start start 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f866233c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f866233c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1030c0 con 0x7f865c102770 2024-02-20T07:54:57.124 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f865bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f865bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52176/0 (socket says 172.21.15.123:52176) 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.510+0000 7f865bfff700 1 -- 172.21.15.123:0/2411308891 learned_addr learned my addr 172.21.15.123:0/2411308891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f865bfff700 1 -- 172.21.15.123:0/2411308891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c103200 con 0x7f865c102770 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f865bfff700 1 --2- 172.21.15.123:0/2411308891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098e0 tx=0x7f864c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd89c263888ad26 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f865affd700 1 -- 172.21.15.123:0/2411308891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f864c00b860 con 0x7f865c102770 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f865affd700 1 -- 172.21.15.123:0/2411308891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00b9c0 con 0x7f865c102770 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f865affd700 1 -- 172.21.15.123:0/2411308891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f864c00bc90 con 0x7f865c102770 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 -- 172.21.15.123:0/2411308891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 msgr2=0x7f865c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 --2- 172.21.15.123:0/2411308891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098e0 tx=0x7f864c009250 comp rx=0 tx=0).stop 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 -- 172.21.15.123:0/2411308891 shutdown_connections 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 --2- 172.21.15.123:0/2411308891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c102b80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 -- 172.21.15.123:0/2411308891 >> 172.21.15.123:0/2411308891 conn(0x7f865c0fded0 msgr2=0x7f865c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 -- 172.21.15.123:0/2411308891 shutdown_connections 2024-02-20T07:54:57.125 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.511+0000 7f866233c700 1 -- 172.21.15.123:0/2411308891 wait complete. 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f866233c700 1 Processor -- start 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f866233c700 1 -- start start 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f866233c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f866233c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1112d0 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f865bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f865bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52192/0 (socket says 172.21.15.123:52192) 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.512+0000 7f865bfff700 1 -- 172.21.15.123:0/443597124 learned_addr learned my addr 172.21.15.123:0/443597124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f865bfff700 1 -- 172.21.15.123:0/443597124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0094f0 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f865bfff700 1 --2- 172.21.15.123:0/443597124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f864c003080 tx=0x7f864c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f864c01c5c0 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c01c720 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c1114d0 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f864c01ca30 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c1120c0 con 0x7f865c102770 2024-02-20T07:54:57.126 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f864c01a450 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.513+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f864c02e790 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.514+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c05f5c0 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.516+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f864c01a890 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.582+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f865c103b90 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f864c02ee80 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f8658ff9700 1 -- 172.21.15.123:0/443597124 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f864c037590 con 0x7f865c102770 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 msgr2=0x7f865c110d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f866233c700 1 --2- 172.21.15.123:0/443597124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f864c003080 tx=0x7f864c016000 comp rx=0 tx=0).stop 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 shutdown_connections 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f866233c700 1 --2- 172.21.15.123:0/443597124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865c102770 0x7f865c110d90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.586+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 >> 172.21.15.123:0/443597124 conn(0x7f865c0fded0 msgr2=0x7f865c1054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.587+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 shutdown_connections 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:56.587+0000 7f866233c700 1 -- 172.21.15.123:0/443597124 wait complete. 2024-02-20T07:54:57.127 INFO:teuthology.orchestra.run.smithi123.stdout:Generating new minimal ceph.conf... 2024-02-20T07:54:57.231 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:57 smithi123 ceph-mon[29010]: from='client.? 172.21.15.123:0/443597124' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-20T07:54:57.231 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:57 smithi123 ceph-mon[29010]: from='client.? 172.21.15.123:0/443597124' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-20T07:54:58.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 ceph-mon[29010]: from='client.? 172.21.15.123:0/2903292630' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:54:58.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.543+0000 7fd9777c4700 1 Processor -- start 2024-02-20T07:54:58.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd9777c4700 1 -- start start 2024-02-20T07:54:58.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd9777c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:58.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd9777c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701030c0 con 0x7fd970102770 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd975560700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd975560700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52196/0 (socket says 172.21.15.123:52196) 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd975560700 1 -- 172.21.15.123:0/2320595978 learned_addr learned my addr 172.21.15.123:0/2320595978 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd975560700 1 -- 172.21.15.123:0/2320595978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970103200 con 0x7fd970102770 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd975560700 1 --2- 172.21.15.123:0/2320595978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd9600098e0 tx=0x7fd960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef658d68aabb2167 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd967fff700 1 -- 172.21.15.123:0/2320595978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd96000b860 con 0x7fd970102770 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd967fff700 1 -- 172.21.15.123:0/2320595978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd96000be50 con 0x7fd970102770 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.544+0000 7fd967fff700 1 -- 172.21.15.123:0/2320595978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd960010380 con 0x7fd970102770 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 -- 172.21.15.123:0/2320595978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 msgr2=0x7fd970102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 --2- 172.21.15.123:0/2320595978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd9600098e0 tx=0x7fd960009250 comp rx=0 tx=0).stop 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 -- 172.21.15.123:0/2320595978 shutdown_connections 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 --2- 172.21.15.123:0/2320595978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970102b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 -- 172.21.15.123:0/2320595978 >> 172.21.15.123:0/2320595978 conn(0x7fd9700fded0 msgr2=0x7fd970100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:58.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 -- 172.21.15.123:0/2320595978 shutdown_connections 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.545+0000 7fd9777c4700 1 -- 172.21.15.123:0/2320595978 wait complete. 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd9777c4700 1 Processor -- start 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd9777c4700 1 -- start start 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd9777c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd9777c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970111aa0 con 0x7fd970102770 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd975560700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd975560700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52210/0 (socket says 172.21.15.123:52210) 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd975560700 1 -- 172.21.15.123:0/2903292630 learned_addr learned my addr 172.21.15.123:0/2903292630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd975560700 1 -- 172.21.15.123:0/2903292630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600094f0 con 0x7fd970102770 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd975560700 1 --2- 172.21.15.123:0/2903292630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd960000c00 tx=0x7fd960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9600107c0 con 0x7fd970102770 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd960010db0 con 0x7fd970102770 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd970111ca0 con 0x7fd970102770 2024-02-20T07:54:58.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.546+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd96001ad00 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.547+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970112940 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.547+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd960024440 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.547+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd960019710 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.548+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97005f5c0 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.550+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd9600426d0 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.615+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd9701045e0 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.615+0000 7fd965ffb700 1 -- 172.21.15.123:0/2903292630 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fd960031020 con 0x7fd970102770 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 msgr2=0x7fd970111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 --2- 172.21.15.123:0/2903292630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd960000c00 tx=0x7fd960009250 comp rx=0 tx=0).stop 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 shutdown_connections 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 --2- 172.21.15.123:0/2903292630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd970102770 0x7fd970111560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 >> 172.21.15.123:0/2903292630 conn(0x7fd9700fded0 msgr2=0x7fd9700ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 shutdown_connections 2024-02-20T07:54:58.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:54:57.616+0000 7fd9777c4700 1 -- 172.21.15.123:0/2903292630 wait complete. 2024-02-20T07:54:58.248 INFO:teuthology.orchestra.run.smithi123.stdout:Restarting the monitor... 2024-02-20T07:54:58.520 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 systemd[1]: Stopping Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T07:54:58.844 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[29006]: 2024-02-20T07:54:58.556+0000 7faacd47f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi123 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T07:54:58.845 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[29006]: 2024-02-20T07:54:58.556+0000 7faacd47f700 -1 mon.smithi123@0(leader) e1 *** Got Signal Terminated *** 2024-02-20T07:54:58.845 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 podman[29259]: 2024-02-20 07:54:58.597524931 +0000 UTC m=+0.199527325 container died 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=quincy-c80e716, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T07:54:59.116 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 podman[29259]: 2024-02-20 07:54:58.939496931 +0000 UTC m=+0.541499331 container cleanup 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=quincy-c80e716, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS) 2024-02-20T07:54:59.116 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:58 smithi123 bash[29259]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123 2024-02-20T07:54:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 podman[29273]: 2024-02-20 07:54:59.11566984 +0000 UTC m=+0.515937244 container remove 9f1a51d40902cdc90c1b8e9cd6fde769eb148ecc6286b3bc3db2366b17b997a2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=quincy-c80e716, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-20T07:54:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service: Deactivated successfully. 2024-02-20T07:54:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 systemd[1]: Stopped Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T07:54:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 systemd[1]: Starting Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T07:54:59.860 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 podman[29365]: 2024-02-20 07:54:59.566451026 +0000 UTC m=+0.111683004 container create d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=quincy-c80e716, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 podman[29365]: 2024-02-20 07:54:59.472361429 +0000 UTC m=+0.017593368 image pull 10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e quay.ceph.io/ceph-ci/ceph:quincy 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 podman[29365]: 2024-02-20 07:54:59.761631241 +0000 UTC m=+0.306863179 container init d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-c80e716, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 podman[29365]: 2024-02-20 07:54:59.764609729 +0000 UTC m=+0.309841664 container start d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c80e716, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: set uid:gid to 167:167 (ceph:ceph) 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable), process ceph-mon, pid 2 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: pidfile_write: ignore empty --pid-file 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: load: jerasure load: lrc 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: RocksDB version: 6.15.5 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Compile date Feb 19 2024 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: DB SUMMARY 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: DB Session ID: D65EDIGPHU62JNNCRLIA 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: CURRENT file: CURRENT 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: IDENTITY file: IDENTITY 2024-02-20T07:54:59.861 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-20T07:54:59.862 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi123/store.db dir, Total Num: 1, files: 000008.sst 2024-02-20T07:54:59.862 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi123/store.db: 000010.log size: 97597 ; 2024-02-20T07:54:59.862 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.error_if_exists: 0 2024-02-20T07:54:59.862 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.create_if_missing: 0 2024-02-20T07:54:59.862 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.paranoid_checks: 1 2024-02-20T07:54:59.863 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-20T07:54:59.863 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.env: 0x55608257fa80 2024-02-20T07:54:59.863 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.fs: Posix File System 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.info_log: 0x556084a4dcc0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_file_opening_threads: 16 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.statistics: (nil) 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.use_fsync: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_log_file_size: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.keep_log_file_num: 1000 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.recycle_log_file_num: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_fallocate: 1 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_mmap_reads: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_mmap_writes: 0 2024-02-20T07:54:59.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.use_direct_reads: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.create_missing_column_families: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.db_log_dir: 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi123/store.db 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.advise_random_on_open: 1 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.db_write_buffer_size: 0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.write_buffer_manager: 0x5560857c2ae0 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-20T07:54:59.865 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.rate_limiter: (nil) 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.wal_recovery_mode: 2 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.enable_thread_tracking: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.enable_pipelined_write: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.unordered_write: 0 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.row_cache: None 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.wal_filter: None 2024-02-20T07:54:59.866 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_ingest_behind: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.preserve_deletes: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.two_write_queues: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.manual_wal_flush: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.atomic_flush: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.log_readahead_size: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.best_efforts_recovery: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.allow_data_in_errors: 0 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.db_host_id: __hostname__ 2024-02-20T07:54:59.867 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_background_jobs: 2 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_background_compactions: -1 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_subcompactions: 1 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_total_wal_size: 0 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_open_files: -1 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bytes_per_sync: 0 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-20T07:54:59.868 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_readahead_size: 0 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_background_flushes: -1 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Compression algorithms supported: 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kZSTD supported: 0 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kXpressCompression supported: 0 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kLZ4HCCompression supported: 1 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kZlibCompression supported: 1 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kSnappyCompression supported: 1 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kLZ4Compression supported: 1 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: kBZip2Compression supported: 0 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000009 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-20T07:54:59.869 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.merge_operator: 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_filter: None 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_filter_factory: None 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.sst_partitioner_factory: None 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556084aa2f58) 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks: 1 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_top_level_index_and_filter: 1 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_type: 0 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_index_type: 0 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_shortening: 1 2024-02-20T07:54:59.870 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: hash_index_allow_collision: 1 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: checksum: 1 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: no_block_cache: 0 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache: 0x556084ad5090 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_name: BinnedLRUCache 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_options: 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: capacity : 536870912 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: num_shard_bits : 4 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: strict_capacity_limit : 0 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: high_pri_pool_ratio: 0.000 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_compressed: (nil) 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: persistent_cache: (nil) 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size: 4096 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size_deviation: 10 2024-02-20T07:54:59.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_restart_interval: 16 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_block_restart_interval: 1 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: metadata_block_size: 4096 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: partition_filters: 0 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: use_delta_encoding: 1 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: whole_key_filtering: 1 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: verify_compression: 0 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: read_amp_bytes_per_bit: 0 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: format_version: 4 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_index_compression: 1 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_align: 0 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.write_buffer_size: 33554432 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_write_buffer_number: 2 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression: NoCompression 2024-02-20T07:54:59.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression: Disabled 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.prefix_extractor: nullptr 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.num_levels: 7 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-20T07:54:59.873 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.level: 32767 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.strategy: 0 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compression_opts.enabled: false 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.target_file_size_base: 67108864 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-20T07:54:59.874 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.arena_block_size: 4194304 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.disable_auto_compactions: 0 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-20T07:54:59.875 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.table_properties_collectors: 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.inplace_update_support: 0 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-20T07:54:59.876 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.bloom_locality: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.max_successive_merges: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.paranoid_file_checks: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.force_consistency_checks: 1 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.report_bg_io_stats: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.ttl: 2592000 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.enable_blob_files: false 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.min_blob_size: 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.blob_file_size: 268435456 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-20T07:54:59.877 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415699790436, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415699791266, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92722, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90817, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13386, "raw_average_key_size": 49, "raw_value_size": 83505, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708415699, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "f8059b2c-b301-4742-89e0-94baf77ddae8", "db_session_id": "D65EDIGPHU62JNNCRLIA"}} 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415699791681, "job": 1, "event": "recovery_finished"} 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi123/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x556084a69180 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: DB pointer 0x556084b3e000 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** DB Stats ** 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:54:59.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: L0 2/0 92.35 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Sum 2/0 92.35 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T07:54:59.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative compaction: 0.00 GB write, 29.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval compaction: 0.00 GB write, 29.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.880 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: L0 2/0 92.35 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Sum 2/0 92.35 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T07:54:59.881 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative compaction: 0.00 GB write, 28.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: starting mon.smithi123 rank 0 at public addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] at bind addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi123 fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???) e1 preinit fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).mds e1 new map 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).mds e1 print_map 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: e1 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T07:54:59.882 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: legacy client fscid: -1 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: No filesystems configured 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 bash[29365]: d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 2024-02-20T07:54:59.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 systemd[1]: Started Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T07:54:59.883 INFO:teuthology.orchestra.run.smithi123.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-20T07:55:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mon.smithi123 is new leader, mons smithi123 in quorum (ranks 0) 2024-02-20T07:55:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: monmap e1: 1 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T07:55:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: fsmap 2024-02-20T07:55:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: osdmap e1: 0 total, 0 up, 0 in 2024-02-20T07:55:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:54:59 smithi123 ceph-mon[29383]: mgrmap e1: no daemons active 2024-02-20T07:55:02.901 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:02 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2671654764' entity='client.admin' 2024-02-20T07:55:02.904 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.800+0000 7f4b8bca5700 1 Processor -- start 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b8bca5700 1 -- start start 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b8bca5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b8bca5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841058c0 con 0x7f4b84071480 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b89a41700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b89a41700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35062/0 (socket says 172.21.15.123:35062) 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.801+0000 7f4b89a41700 1 -- 172.21.15.123:0/968256835 learned_addr learned my addr 172.21.15.123:0/968256835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:02.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b89a41700 1 -- 172.21.15.123:0/968256835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84105a00 con 0x7f4b84071480 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b89a41700 1 --2- 172.21.15.123:0/968256835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4b740098e0 tx=0x7f4b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2136d2d6a7fa219 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b88a3f700 1 -- 172.21.15.123:0/968256835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b7400b860 con 0x7f4b84071480 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b88a3f700 1 -- 172.21.15.123:0/968256835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4b7400be50 con 0x7f4b84071480 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b88a3f700 1 -- 172.21.15.123:0/968256835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b74010380 con 0x7f4b84071480 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b8bca5700 1 -- 172.21.15.123:0/968256835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 msgr2=0x7f4b84105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b8bca5700 1 --2- 172.21.15.123:0/968256835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4b740098e0 tx=0x7f4b74009250 comp rx=0 tx=0).stop 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b8bca5700 1 -- 172.21.15.123:0/968256835 shutdown_connections 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b8bca5700 1 --2- 172.21.15.123:0/968256835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84105380 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.802+0000 7f4b8bca5700 1 -- 172.21.15.123:0/968256835 >> 172.21.15.123:0/968256835 conn(0x7f4b840fcdd0 msgr2=0x7f4b840ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 -- 172.21.15.123:0/968256835 shutdown_connections 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 -- 172.21.15.123:0/968256835 wait complete. 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 Processor -- start 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 -- start start 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b8bca5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84101280 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b89a41700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b89a41700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35070/0 (socket says 172.21.15.123:35070) 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.803+0000 7f4b89a41700 1 -- 172.21.15.123:0/2671654764 learned_addr learned my addr 172.21.15.123:0/2671654764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b89a41700 1 -- 172.21.15.123:0/2671654764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740094f0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b89a41700 1 --2- 172.21.15.123:0/2671654764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006b00 tx=0x7f4b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b740107c0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4b74010db0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84101480 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b7401acf0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84101910 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4b74024440 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.804+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4b74019710 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.805+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8404bed0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.807+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4b740426d0 con 0x7f4b84071480 2024-02-20T07:55:02.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.873+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4b84106810 con 0x7f4b84071480 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.875+0000 7f4b7a7fc700 1 -- 172.21.15.123:0/2671654764 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4b74031020 con 0x7f4b84071480 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 msgr2=0x7f4b84102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 --2- 172.21.15.123:0/2671654764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006b00 tx=0x7f4b74009250 comp rx=0 tx=0).stop 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 shutdown_connections 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 --2- 172.21.15.123:0/2671654764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b84071480 0x7f4b84102e00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 >> 172.21.15.123:0/2671654764 conn(0x7f4b840fcdd0 msgr2=0x7f4b840fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 shutdown_connections 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:01.876+0000 7f4b8bca5700 1 -- 172.21.15.123:0/2671654764 wait complete. 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-20T07:55:02.912 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mgr... 2024-02-20T07:55:02.913 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 9283 ... 2024-02-20T07:55:03.100 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mgr.smithi123.kwyrtl 2024-02-20T07:55:03.100 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mgr.smithi123.kwyrtl.service: Unit ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mgr.smithi123.kwyrtl.service not loaded. 2024-02-20T07:55:03.251 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715.target.wants/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mgr.smithi123.kwyrtl.service → /etc/systemd/system/ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@.service. 2024-02-20T07:55:03.869 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-20T07:55:03.869 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-02-20T07:55:03.876 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-20T07:55:03.904 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:55:03.904 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-02-20T07:55:03.904 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-02-20T07:55:03.905 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-20T07:55:03.905 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-02-20T07:55:03.905 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-20T07:55:03.905 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:55:03.906 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-02-20T07:55:03.906 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-20T07:55:03.906 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr to start... 2024-02-20T07:55:03.906 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr... 2024-02-20T07:55:04.677 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:04 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/638593996' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1f99de10-cfc5-11ee-95bb-87774f69a715", 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-20T07:55:04.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-20T07:55:04.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-20T07:55:04.976 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-20T07:55:04.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-02-20T07:54:54.106878+0000", 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.296+0000 7f3604385700 1 Processor -- start 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.296+0000 7f3604385700 1 -- start start 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.296+0000 7f3604385700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.296+0000 7f3604385700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1030c0 con 0x7f35fc102770 2024-02-20T07:55:04.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.297+0000 7f3602121700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.297+0000 7f3602121700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35116/0 (socket says 172.21.15.123:35116) 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.297+0000 7f3602121700 1 -- 172.21.15.123:0/3694798400 learned_addr learned my addr 172.21.15.123:0/3694798400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.297+0000 7f3602121700 1 -- 172.21.15.123:0/3694798400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc103200 con 0x7f35fc102770 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.297+0000 7f3602121700 1 --2- 172.21.15.123:0/3694798400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35f80098e0 tx=0x7f35f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac57f689d4989fdd server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.298+0000 7f360111f700 1 -- 172.21.15.123:0/3694798400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35f800b860 con 0x7f35fc102770 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.298+0000 7f360111f700 1 -- 172.21.15.123:0/3694798400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f35f800be50 con 0x7f35fc102770 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.298+0000 7f360111f700 1 -- 172.21.15.123:0/3694798400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35f8009e80 con 0x7f35fc102770 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.298+0000 7f3604385700 1 -- 172.21.15.123:0/3694798400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 msgr2=0x7f35fc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.298+0000 7f3604385700 1 --2- 172.21.15.123:0/3694798400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35f80098e0 tx=0x7f35f8009250 comp rx=0 tx=0).stop 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- 172.21.15.123:0/3694798400 shutdown_connections 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 --2- 172.21.15.123:0/3694798400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc102b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- 172.21.15.123:0/3694798400 >> 172.21.15.123:0/3694798400 conn(0x7f35fc0fded0 msgr2=0x7f35fc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- 172.21.15.123:0/3694798400 shutdown_connections 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- 172.21.15.123:0/3694798400 wait complete. 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 Processor -- start 2024-02-20T07:55:04.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- start start 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.299+0000 7f3604385700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc077190 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3602121700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3602121700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35132/0 (socket says 172.21.15.123:35132) 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3602121700 1 -- 172.21.15.123:0/638593996 learned_addr learned my addr 172.21.15.123:0/638593996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3602121700 1 -- 172.21.15.123:0/638593996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80094f0 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3602121700 1 --2- 172.21.15.123:0/638593996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f35f800b440 tx=0x7f35f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35f801a7a0 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc077390 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f35f801ad90 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35f80193c0 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.300+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc077820 con 0x7f35fc102770 2024-02-20T07:55:04.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.301+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f35f80197a0 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.301+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f35f802da40 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.301+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc04bed0 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.305+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f35f8024440 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.376+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f35fc1045e0 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.377+0000 7f35f2ffd700 1 -- 172.21.15.123:0/638593996 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f35f802dca0 con 0x7f35fc102770 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 msgr2=0x7f35fc078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 --2- 172.21.15.123:0/638593996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f35f800b440 tx=0x7f35f8009250 comp rx=0 tx=0).stop 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 shutdown_connections 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 --2- 172.21.15.123:0/638593996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35fc102770 0x7f35fc078d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 >> 172.21.15.123:0/638593996 conn(0x7f35fc0fded0 msgr2=0x7f35fc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 shutdown_connections 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:04.378+0000 7f3604385700 1 -- 172.21.15.123:0/638593996 wait complete. 2024-02-20T07:55:04.981 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (1/15)... 2024-02-20T07:55:07.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:07 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/898492808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-20T07:55:08.481 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:08.481 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1f99de10-cfc5-11ee-95bb-87774f69a715", 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-02-20T07:55:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-20T07:55:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-20T07:55:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-02-20T07:54:54.106878+0000", 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-20T07:55:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.400+0000 7feef2710700 1 Processor -- start 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.400+0000 7feef2710700 1 -- start start 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.400+0000 7feef2710700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.400+0000 7feef2710700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec1030c0 con 0x7feeec102770 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35140/0 (socket says 172.21.15.123:35140) 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeebfff700 1 -- 172.21.15.123:0/3672462161 learned_addr learned my addr 172.21.15.123:0/3672462161 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeebfff700 1 -- 172.21.15.123:0/3672462161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec103200 con 0x7feeec102770 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeebfff700 1 --2- 172.21.15.123:0/3672462161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feedc0098e0 tx=0x7feedc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ffd6102880d56c server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeeaffd700 1 -- 172.21.15.123:0/3672462161 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feedc00b860 con 0x7feeec102770 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeeaffd700 1 -- 172.21.15.123:0/3672462161 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7feedc00be50 con 0x7feeec102770 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.401+0000 7feeeaffd700 1 -- 172.21.15.123:0/3672462161 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feedc010380 con 0x7feeec102770 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 -- 172.21.15.123:0/3672462161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 msgr2=0x7feeec102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 --2- 172.21.15.123:0/3672462161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feedc0098e0 tx=0x7feedc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:08.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 -- 172.21.15.123:0/3672462161 shutdown_connections 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 --2- 172.21.15.123:0/3672462161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec102b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 -- 172.21.15.123:0/3672462161 >> 172.21.15.123:0/3672462161 conn(0x7feeec0fded0 msgr2=0x7feeec100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 -- 172.21.15.123:0/3672462161 shutdown_connections 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.402+0000 7feef2710700 1 -- 172.21.15.123:0/3672462161 wait complete. 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feef2710700 1 Processor -- start 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feef2710700 1 -- start start 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feef2710700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feef2710700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec111a40 con 0x7feeec102770 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feeebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feeebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35146/0 (socket says 172.21.15.123:35146) 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feeebfff700 1 -- 172.21.15.123:0/898492808 learned_addr learned my addr 172.21.15.123:0/898492808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.403+0000 7feeebfff700 1 -- 172.21.15.123:0/898492808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0094f0 con 0x7feeec102770 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feeebfff700 1 --2- 172.21.15.123:0/898492808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feedc00b440 tx=0x7feedc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:08.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feedc010760 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7feedc010d50 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec111c40 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feedc024d80 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec1128e0 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feedc01a6b0 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.404+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feedc02d900 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.405+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec05f5c0 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.407+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feedc0108c0 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.477+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7feeec1045e0 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.478+0000 7feee8ff9700 1 -- 172.21.15.123:0/898492808 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7feedc010a60 con 0x7feeec102770 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 msgr2=0x7feeec111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 --2- 172.21.15.123:0/898492808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feedc00b440 tx=0x7feedc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 shutdown_connections 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 --2- 172.21.15.123:0/898492808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeec102770 0x7feeec111500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 >> 172.21.15.123:0/898492808 conn(0x7feeec0fded0 msgr2=0x7feeec0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:08.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 shutdown_connections 2024-02-20T07:55:08.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:07.479+0000 7feef2710700 1 -- 172.21.15.123:0/898492808 wait complete. 2024-02-20T07:55:08.489 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (2/15)... 2024-02-20T07:55:10.871 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: Activating manager daemon smithi123.kwyrtl 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: mgrmap e2: smithi123.kwyrtl(active, starting, since 0.00282154s) 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:10.872 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:10 smithi123 ceph-mon[29383]: from='mgr.14100 172.21.15.123:0/1794109822' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:11.555 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1f99de10-cfc5-11ee-95bb-87774f69a715", 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-02-20T07:55:11.556 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-20T07:55:11.557 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-20T07:55:11.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-02-20T07:54:54.106878+0000", 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:11.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.870+0000 7f122e42f700 1 Processor -- start 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.870+0000 7f122e42f700 1 -- start start 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.870+0000 7f122e42f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.870+0000 7f122e42f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281030c0 con 0x7f1228102770 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1227fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1227fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59546/0 (socket says 172.21.15.123:59546) 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1227fff700 1 -- 172.21.15.123:0/3332270141 learned_addr learned my addr 172.21.15.123:0/3332270141 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1227fff700 1 -- 172.21.15.123:0/3332270141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228103200 con 0x7f1228102770 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1227fff700 1 --2- 172.21.15.123:0/3332270141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12180098e0 tx=0x7f1218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc2a989eb07542e server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1226ffd700 1 -- 172.21.15.123:0/3332270141 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f121800b860 con 0x7f1228102770 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1226ffd700 1 -- 172.21.15.123:0/3332270141 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f121800be50 con 0x7f1228102770 2024-02-20T07:55:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.871+0000 7f1226ffd700 1 -- 172.21.15.123:0/3332270141 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1218010380 con 0x7f1228102770 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 -- 172.21.15.123:0/3332270141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 msgr2=0x7f1228102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 --2- 172.21.15.123:0/3332270141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12180098e0 tx=0x7f1218009250 comp rx=0 tx=0).stop 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 -- 172.21.15.123:0/3332270141 shutdown_connections 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 --2- 172.21.15.123:0/3332270141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228102b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 -- 172.21.15.123:0/3332270141 >> 172.21.15.123:0/3332270141 conn(0x7f12280fded0 msgr2=0x7f1228100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 -- 172.21.15.123:0/3332270141 shutdown_connections 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.872+0000 7f122e42f700 1 -- 172.21.15.123:0/3332270141 wait complete. 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f122e42f700 1 Processor -- start 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f122e42f700 1 -- start start 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f122e42f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f122e42f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228111d50 con 0x7f1228102770 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f1227fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f1227fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59552/0 (socket says 172.21.15.123:59552) 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f1227fff700 1 -- 172.21.15.123:0/2618932037 learned_addr learned my addr 172.21.15.123:0/2618932037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f1227fff700 1 -- 172.21.15.123:0/2618932037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180094f0 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.873+0000 7f1227fff700 1 --2- 172.21.15.123:0/2618932037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f121800b440 tx=0x7f1218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1218010760 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1218010d50 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228111f50 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1218024d80 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228112bf0 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.874+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 2) v1 ==== 43124+0+0 (secure 0 0 0) 0x7f121801a430 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.875+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122805f5c0 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.875+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f121804a130 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.877+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f121801a6e0 con 0x7f1228102770 2024-02-20T07:55:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.945+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f122804bed0 con 0x7f1228102770 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.945+0000 7f1224ff9700 1 -- 172.21.15.123:0/2618932037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f12180233a0 con 0x7f1228102770 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 msgr2=0x7f1228111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 --2- 172.21.15.123:0/2618932037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f121800b440 tx=0x7f1218009250 comp rx=0 tx=0).stop 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 shutdown_connections 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 --2- 172.21.15.123:0/2618932037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1228102770 0x7f1228111810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 >> 172.21.15.123:0/2618932037 conn(0x7f12280fded0 msgr2=0x7f12280fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 shutdown_connections 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:10.946+0000 7f122e42f700 1 -- 172.21.15.123:0/2618932037 wait complete. 2024-02-20T07:55:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (3/15)... 2024-02-20T07:55:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:11 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2618932037' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-20T07:55:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:11 smithi123 ceph-mon[29383]: mgrmap e3: smithi123.kwyrtl(active, since 1.00552s) 2024-02-20T07:55:13.977 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:13 smithi123 ceph-mon[29383]: mgrmap e4: smithi123.kwyrtl(active, since 2s) 2024-02-20T07:55:14.761 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:14.761 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1f99de10-cfc5-11ee-95bb-87774f69a715", 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-02-20T07:54:54.106878+0000", 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-20T07:55:14.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.987+0000 7fcfeeb17700 1 Processor -- start 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfeeb17700 1 -- start start 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfeeb17700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfeeb17700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81058a0 con 0x7fcfe8076c40 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfec8b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfec8b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59564/0 (socket says 172.21.15.123:59564) 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfec8b3700 1 -- 172.21.15.123:0/419423380 learned_addr learned my addr 172.21.15.123:0/419423380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfec8b3700 1 -- 172.21.15.123:0/419423380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe81059e0 con 0x7fcfe8076c40 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfec8b3700 1 --2- 172.21.15.123:0/419423380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0098e0 tx=0x7fcfdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a42ebbad5f931a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfe77fe700 1 -- 172.21.15.123:0/419423380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfdc00b860 con 0x7fcfe8076c40 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfe77fe700 1 -- 172.21.15.123:0/419423380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcfdc00be50 con 0x7fcfe8076c40 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.988+0000 7fcfe77fe700 1 -- 172.21.15.123:0/419423380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfdc010380 con 0x7fcfe8076c40 2024-02-20T07:55:14.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 -- 172.21.15.123:0/419423380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 msgr2=0x7fcfe8105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/419423380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0098e0 tx=0x7fcfdc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 -- 172.21.15.123:0/419423380 shutdown_connections 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/419423380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8105360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 -- 172.21.15.123:0/419423380 >> 172.21.15.123:0/419423380 conn(0x7fcfe80fcdd0 msgr2=0x7fcfe80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 -- 172.21.15.123:0/419423380 shutdown_connections 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.989+0000 7fcfeeb17700 1 -- 172.21.15.123:0/419423380 wait complete. 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfeeb17700 1 Processor -- start 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfeeb17700 1 -- start start 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfeeb17700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfeeb17700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8111d60 con 0x7fcfe8076c40 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfec8b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfec8b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59568/0 (socket says 172.21.15.123:59568) 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfec8b3700 1 -- 172.21.15.123:0/3489610755 learned_addr learned my addr 172.21.15.123:0/3489610755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:14.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.990+0000 7fcfec8b3700 1 -- 172.21.15.123:0/3489610755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0094f0 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfec8b3700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006d40 tx=0x7fcfdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfdc010760 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcfdc010d50 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe8111f60 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfdc024d20 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe8112c00 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.991+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fcfdc02e440 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.992+0000 7fcfe57fa700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 0x7fcfd8038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.992+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe805f5c0 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.992+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcfdc04a7a0 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.992+0000 7fcfe7fff700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 0x7fcfd8038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.992+0000 7fcfe7fff700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 0x7fcfd8038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009990 tx=0x7fcfd4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:13.997+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcfdc018940 con 0x7fcfe8076c40 2024-02-20T07:55:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.249+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcfe804bed0 con 0x7fcfe8076c40 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.249+0000 7fcfe57fa700 1 -- 172.21.15.123:0/3489610755 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fcfdc049090 con 0x7fcfe8076c40 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.252+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 msgr2=0x7fcfd8038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.252+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 0x7fcfd8038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009990 tx=0x7fcfd4006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.252+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 msgr2=0x7fcfe8111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.252+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006d40 tx=0x7fcfdc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 shutdown_connections 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fcfd8036740 0x7fcfd8038bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 --2- 172.21.15.123:0/3489610755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe8076c40 0x7fcfe8111820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 >> 172.21.15.123:0/3489610755 conn(0x7fcfe80fcdd0 msgr2=0x7fcfe80ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 shutdown_connections 2024-02-20T07:55:14.769 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:14.253+0000 7fcfeeb17700 1 -- 172.21.15.123:0/3489610755 wait complete. 2024-02-20T07:55:14.770 INFO:teuthology.orchestra.run.smithi123.stdout:mgr is available 2024-02-20T07:55:14.987 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3489610755' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-20T07:55:15.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.160+0000 7f1d51a18700 1 Processor -- start 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.160+0000 7f1d51a18700 1 -- start start 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.160+0000 7f1d51a18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.160+0000 7f1d51a18700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1030c0 con 0x7f1d4c102770 2024-02-20T07:55:15.948 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59582/0 (socket says 172.21.15.123:59582) 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d4affd700 1 -- 172.21.15.123:0/3034221400 learned_addr learned my addr 172.21.15.123:0/3034221400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d4affd700 1 -- 172.21.15.123:0/3034221400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c103200 con 0x7f1d4c102770 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d4affd700 1 --2- 172.21.15.123:0/3034221400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0098e0 tx=0x7f1d3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5048439a63a92 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d49ffb700 1 -- 172.21.15.123:0/3034221400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d3c00b860 con 0x7f1d4c102770 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d49ffb700 1 -- 172.21.15.123:0/3034221400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1d3c00be50 con 0x7f1d4c102770 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.161+0000 7f1d49ffb700 1 -- 172.21.15.123:0/3034221400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d3c010380 con 0x7f1d4c102770 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 -- 172.21.15.123:0/3034221400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 msgr2=0x7f1d4c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 --2- 172.21.15.123:0/3034221400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0098e0 tx=0x7f1d3c009250 comp rx=0 tx=0).stop 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 -- 172.21.15.123:0/3034221400 shutdown_connections 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 --2- 172.21.15.123:0/3034221400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c102b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 -- 172.21.15.123:0/3034221400 >> 172.21.15.123:0/3034221400 conn(0x7f1d4c0fded0 msgr2=0x7f1d4c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 -- 172.21.15.123:0/3034221400 shutdown_connections 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.162+0000 7f1d51a18700 1 -- 172.21.15.123:0/3034221400 wait complete. 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d51a18700 1 Processor -- start 2024-02-20T07:55:15.949 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d51a18700 1 -- start start 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d51a18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d51a18700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c111aa0 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d4affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59592/0 (socket says 172.21.15.123:59592) 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d4affd700 1 -- 172.21.15.123:0/1005837613 learned_addr learned my addr 172.21.15.123:0/1005837613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d4affd700 1 -- 172.21.15.123:0/1005837613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0094f0 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d4affd700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b440 tx=0x7f1d3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.163+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d3c010760 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1d3c010d50 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d3c01ae20 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c111ca0 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c112940 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f1d3c02e440 con 0x7f1d4c102770 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.164+0000 7f1d337fe700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 0x7f1d34038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.165+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1d3c04a750 con 0x7f1d4c102770 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.165+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c05f5c0 con 0x7f1d4c102770 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.165+0000 7f1d4a7fc700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 0x7f1d34038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.165+0000 7f1d4a7fc700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 0x7f1d34038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009990 tx=0x7f1d40006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.169+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1d3c018940 con 0x7f1d4c102770 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.348+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f1d4c04bed0 con 0x7f1d4c102770 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.349+0000 7f1d337fe700 1 -- 172.21.15.123:0/1005837613 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f1d3c018350 con 0x7f1d4c102770 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 msgr2=0x7f1d34038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 0x7f1d34038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009990 tx=0x7f1d40006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 msgr2=0x7f1d4c111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b440 tx=0x7f1d3c009250 comp rx=0 tx=0).stop 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 shutdown_connections 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f1d34036790 0x7f1d34038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:15.951 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 --2- 172.21.15.123:0/1005837613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d4c102770 0x7f1d4c111560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:15.952 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 >> 172.21.15.123:0/1005837613 conn(0x7f1d4c0fded0 msgr2=0x7f1d4c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:15.952 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 shutdown_connections 2024-02-20T07:55:15.952 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:15.351+0000 7f1d51a18700 1 -- 172.21.15.123:0/1005837613 wait complete. 2024-02-20T07:55:15.952 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling cephadm module... 2024-02-20T07:55:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:15 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1005837613' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-20T07:55:17.093 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:16 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/4257702587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0be512a700 1 Processor -- start 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0be512a700 1 -- start start 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0be512a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0be512a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0101fc0 con 0x7f0be0101670 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59608/0 (socket says 172.21.15.123:59608) 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.389+0000 7f0bded9d700 1 -- 172.21.15.123:0/1397358044 learned_addr learned my addr 172.21.15.123:0/1397358044 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:17.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0bded9d700 1 -- 172.21.15.123:0/1397358044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0102100 con 0x7f0be0101670 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0bded9d700 1 --2- 172.21.15.123:0/1397358044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400bb80 tx=0x7f0bd400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41edd782c4095d72 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0bddd9b700 1 -- 172.21.15.123:0/1397358044 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bd400dd00 con 0x7f0be0101670 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0bddd9b700 1 -- 172.21.15.123:0/1397358044 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0bd400de60 con 0x7f0be0101670 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0bddd9b700 1 -- 172.21.15.123:0/1397358044 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bd40188a0 con 0x7f0be0101670 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0be512a700 1 -- 172.21.15.123:0/1397358044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 msgr2=0x7f0be0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0be512a700 1 --2- 172.21.15.123:0/1397358044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400bb80 tx=0x7f0bd400b4f0 comp rx=0 tx=0).stop 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0be512a700 1 -- 172.21.15.123:0/1397358044 shutdown_connections 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0be512a700 1 --2- 172.21.15.123:0/1397358044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be0101a80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.390+0000 7f0be512a700 1 -- 172.21.15.123:0/1397358044 >> 172.21.15.123:0/1397358044 conn(0x7f0be00fcdd0 msgr2=0x7f0be00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 -- 172.21.15.123:0/1397358044 shutdown_connections 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 -- 172.21.15.123:0/1397358044 wait complete. 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 Processor -- start 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 -- start start 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0be512a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0113c20 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59624/0 (socket says 172.21.15.123:59624) 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.391+0000 7f0bded9d700 1 -- 172.21.15.123:0/4257702587 learned_addr learned my addr 172.21.15.123:0/4257702587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0bded9d700 1 -- 172.21.15.123:0/4257702587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd400b790 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0bded9d700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4018460 tx=0x7f0bd400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bd4018e10 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0bd4010c00 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bd4021550 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be0113e20 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.392+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be0114ac0 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.393+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f0bd40217d0 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.393+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be005f5c0 con 0x7f0be0101670 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.393+0000 7f0bc77fe700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 0x7f0bc8038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:17.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.393+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0bd4014070 con 0x7f0be0101670 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.393+0000 7f0bde59c700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 0x7f0bc8038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.394+0000 7f0bde59c700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 0x7f0bc8038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009990 tx=0x7f0bd0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.398+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0bd400ed90 con 0x7f0be0101670 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.630+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0be004bed0 con 0x7f0be0101670 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.804+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f0bd4044d50 con 0x7f0be0101670 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.805+0000 7f0bc77fe700 1 -- 172.21.15.123:0/4257702587 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0bd400e360 con 0x7f0be0101670 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 msgr2=0x7f0bc8038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 0x7f0bc8038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009990 tx=0x7f0bd0006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 msgr2=0x7f0be01136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4018460 tx=0x7f0bd400b4f0 comp rx=0 tx=0).stop 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 shutdown_connections 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7f0bc8036740 0x7f0bc8038bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 --2- 172.21.15.123:0/4257702587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0be0101670 0x7f0be01136e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:17.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 >> 172.21.15.123:0/4257702587 conn(0x7f0be00fcdd0 msgr2=0x7f0be00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:17.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 shutdown_connections 2024-02-20T07:55:17.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:16.808+0000 7f0be512a700 1 -- 172.21.15.123:0/4257702587 wait complete. 2024-02-20T07:55:17.998 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:17 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/4257702587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-20T07:55:17.998 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:17 smithi123 ceph-mon[29383]: mgrmap e5: smithi123.kwyrtl(active, since 6s) 2024-02-20T07:55:18.617 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "smithi123.kwyrtl", 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa20ab0a700 1 Processor -- start 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa20ab0a700 1 -- start start 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa20ab0a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa20ab0a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041058c0 con 0x7fa204076c20 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa2088a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa2088a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59664/0 (socket says 172.21.15.123:59664) 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.790+0000 7fa2088a6700 1 -- 172.21.15.123:0/3996113914 learned_addr learned my addr 172.21.15.123:0/3996113914 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:18.618 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.791+0000 7fa2088a6700 1 -- 172.21.15.123:0/3996113914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204105a00 con 0x7fa204076c20 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.791+0000 7fa2088a6700 1 --2- 172.21.15.123:0/3996113914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80098e0 tx=0x7fa1f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517d597c3307ac07 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.791+0000 7fa2037fe700 1 -- 172.21.15.123:0/3996113914 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1f800b860 con 0x7fa204076c20 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.791+0000 7fa2037fe700 1 -- 172.21.15.123:0/3996113914 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa1f800be50 con 0x7fa204076c20 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.791+0000 7fa2037fe700 1 -- 172.21.15.123:0/3996113914 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1f8010380 con 0x7fa204076c20 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3996113914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 msgr2=0x7fa204105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3996113914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80098e0 tx=0x7fa1f8009250 comp rx=0 tx=0).stop 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3996113914 shutdown_connections 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3996113914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204105380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3996113914 >> 172.21.15.123:0/3996113914 conn(0x7fa2040fcdd0 msgr2=0x7fa2040ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3996113914 shutdown_connections 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3996113914 wait complete. 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 Processor -- start 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.792+0000 7fa20ab0a700 1 -- start start 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa20ab0a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:18.619 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa20ab0a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa204111a60 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2088a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2088a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59672/0 (socket says 172.21.15.123:59672) 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2088a6700 1 -- 172.21.15.123:0/3207490198 learned_addr learned my addr 172.21.15.123:0/3207490198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2088a6700 1 -- 172.21.15.123:0/3207490198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80094f0 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2088a6700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006d40 tx=0x7fa1f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1f8010760 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa204111c60 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa1f8010d50 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1f8024d20 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.793+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa204112900 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.794+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa1f801a450 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.794+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20405f5c0 con 0x7fa204076c20 2024-02-20T07:55:18.620 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.794+0000 7fa2017fa700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 0x7fa1f4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.795+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa1f804a830 con 0x7fa204076c20 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.795+0000 7fa203fff700 1 -- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 msgr2=0x7fa1f4038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.795+0000 7fa203fff700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 0x7fa1f4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.799+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa1f8018940 con 0x7fa204076c20 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.996+0000 7fa203fff700 1 -- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 msgr2=0x7fa1f4038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:17.996+0000 7fa203fff700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 0x7fa1f4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.038+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa204112c40 con 0x7fa204076c20 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.039+0000 7fa2017fa700 1 -- 172.21.15.123:0/3207490198 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa1f8018350 con 0x7fa204076c20 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.040+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 msgr2=0x7fa1f4038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.040+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 0x7fa1f4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.040+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 msgr2=0x7fa204111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.040+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006d40 tx=0x7fa1f8009250 comp rx=0 tx=0).stop 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 shutdown_connections 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7fa1f40367e0 0x7fa1f4038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:18.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 --2- 172.21.15.123:0/3207490198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa204076c20 0x7fa204111520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:18.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 >> 172.21.15.123:0/3207490198 conn(0x7fa2040fcdd0 msgr2=0x7fa2040fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:18.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 shutdown_connections 2024-02-20T07:55:18.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:18.041+0000 7fa20ab0a700 1 -- 172.21.15.123:0/3207490198 wait complete. 2024-02-20T07:55:18.622 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-02-20T07:55:18.622 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 5... 2024-02-20T07:55:18.860 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:18 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3207490198' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: Active manager daemon smithi123.kwyrtl restarted 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: Activating manager daemon smithi123.kwyrtl 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: osdmap e2: 0 total, 0 up, 0 in 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: mgrmap e6: smithi123.kwyrtl(active, starting, since 0.00296984s) 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T07:55:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:23 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:24.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:24 smithi123 ceph-mon[29383]: Found migration_current of "None". Setting to last migration. 2024-02-20T07:55:24.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:24 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T07:55:24.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:24 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T07:55:24.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:24 smithi123 ceph-mon[29383]: mgrmap e7: smithi123.kwyrtl(active, since 1.00518s) 2024-02-20T07:55:24.607 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:24 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.031+0000 7ff3a4a35700 1 Processor -- start 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.031+0000 7ff3a4a35700 1 -- start start 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff3a4a35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff3a4a35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01030c0 con 0x7ff3a0102770 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38698/0 (socket says 172.21.15.123:38698) 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39e59c700 1 -- 172.21.15.123:0/58278051 learned_addr learned my addr 172.21.15.123:0/58278051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:24.917 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39e59c700 1 -- 172.21.15.123:0/58278051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0103200 con 0x7ff3a0102770 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39e59c700 1 --2- 172.21.15.123:0/58278051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098e0 tx=0x7ff390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6bdc06d2c7ee1a server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39d59a700 1 -- 172.21.15.123:0/58278051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff39000b860 con 0x7ff3a0102770 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39d59a700 1 -- 172.21.15.123:0/58278051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff39000be50 con 0x7ff3a0102770 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.032+0000 7ff39d59a700 1 -- 172.21.15.123:0/58278051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff390010380 con 0x7ff3a0102770 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 -- 172.21.15.123:0/58278051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 msgr2=0x7ff3a0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/58278051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098e0 tx=0x7ff390009250 comp rx=0 tx=0).stop 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 -- 172.21.15.123:0/58278051 shutdown_connections 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/58278051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0102b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 -- 172.21.15.123:0/58278051 >> 172.21.15.123:0/58278051 conn(0x7ff3a00fded0 msgr2=0x7ff3a0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 -- 172.21.15.123:0/58278051 shutdown_connections 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.033+0000 7ff3a4a35700 1 -- 172.21.15.123:0/58278051 wait complete. 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff3a4a35700 1 Processor -- start 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff3a4a35700 1 -- start start 2024-02-20T07:55:24.918 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff3a4a35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff3a4a35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0111a40 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38708/0 (socket says 172.21.15.123:38708) 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff39e59c700 1 -- 172.21.15.123:0/1460040611 learned_addr learned my addr 172.21.15.123:0/1460040611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff39e59c700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900094f0 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff39e59c700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b440 tx=0x7ff390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3900107c0 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0111c40 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff390010db0 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.034+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff39001ada0 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.035+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a01128e0 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.035+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ff390024480 con 0x7ff3a0102770 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.035+0000 7ff38effd700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:24.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.035+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff388039350 con 0x7ff388036790 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.036+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff39004ad10 con 0x7ff3a0102770 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.036+0000 7ff39dd9b700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.036+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.237+0000 7ff39dd9b700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.237+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.638+0000 7ff39dd9b700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:19.638+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:20.439+0000 7ff39dd9b700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:20.439+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:22.040+0000 7ff39dd9b700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1899432870 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:22.040+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:23.309+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7ff3900249b0 con 0x7ff3a0102770 2024-02-20T07:55:24.920 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:23.310+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 msgr2=0x7ff388038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:23.310+0000 7ff38effd700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.310+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7ff39002c390 con 0x7ff3a0102770 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.311+0000 7ff38effd700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 0x7ff38803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.311+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff388039350 con 0x7ff388039fc0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.311+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 0x7ff38803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.311+0000 7ff39dd9b700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 0x7ff38803c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff3940039d0 tx=0x7ff394009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.312+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7ff388039350 con 0x7ff388039fc0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff3a01120d0 con 0x7ff388039fc0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff38effd700 1 -- 172.21.15.123:0/1460040611 <== mgr.14120 v2:172.21.15.123:6800/4006637556 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff3a01120d0 con 0x7ff388039fc0 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 msgr2=0x7ff38803c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 0x7ff38803c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff3940039d0 tx=0x7ff394009350 comp rx=0 tx=0).stop 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 msgr2=0x7ff3a0111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b440 tx=0x7ff390009250 comp rx=0 tx=0).stop 2024-02-20T07:55:24.921 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 shutdown_connections 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7ff388039fc0 0x7ff38803c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a0102770 0x7ff3a0111500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 --2- 172.21.15.123:0/1460040611 >> [v2:172.21.15.123:6800/1899432870,v1:172.21.15.123:6801/1899432870] conn(0x7ff388036790 0x7ff388038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 >> 172.21.15.123:0/1460040611 conn(0x7ff3a00fded0 msgr2=0x7ff3a00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.318+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 shutdown_connections 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:24.319+0000 7ff3a4a35700 1 -- 172.21.15.123:0/1460040611 wait complete. 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 5 is available 2024-02-20T07:55:24.922 INFO:teuthology.orchestra.run.smithi123.stdout:Setting orchestrator backend to cephadm... 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:24] ENGINE Bus STARTING 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:24] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:24] ENGINE Bus STARTED 2024-02-20T07:55:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:25 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd08024700 1 Processor -- start 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd08024700 1 -- start start 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd08024700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd08024700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00103170 con 0x7fcd00076c20 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd05dc0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd05dc0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38786/0 (socket says 172.21.15.123:38786) 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd05dc0700 1 -- 172.21.15.123:0/2514661634 learned_addr learned my addr 172.21.15.123:0/2514661634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd05dc0700 1 -- 172.21.15.123:0/2514661634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00107cc0 con 0x7fcd00076c20 2024-02-20T07:55:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.330+0000 7fcd05dc0700 1 --2- 172.21.15.123:0/2514661634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ff026ec5f7e470 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd04dbe700 1 -- 172.21.15.123:0/2514661634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccfc00b860 con 0x7fcd00076c20 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd04dbe700 1 -- 172.21.15.123:0/2514661634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fccfc00be50 con 0x7fcd00076c20 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd04dbe700 1 -- 172.21.15.123:0/2514661634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccfc010380 con 0x7fcd00076c20 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 -- 172.21.15.123:0/2514661634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 msgr2=0x7fcd00107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 --2- 172.21.15.123:0/2514661634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 -- 172.21.15.123:0/2514661634 shutdown_connections 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 --2- 172.21.15.123:0/2514661634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00107780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 -- 172.21.15.123:0/2514661634 >> 172.21.15.123:0/2514661634 conn(0x7fcd000fcdd0 msgr2=0x7fcd000ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 -- 172.21.15.123:0/2514661634 shutdown_connections 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.331+0000 7fcd08024700 1 -- 172.21.15.123:0/2514661634 wait complete. 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd08024700 1 Processor -- start 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd08024700 1 -- start start 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd08024700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:26.055 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd08024700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00113f70 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd05dc0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd05dc0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38800/0 (socket says 172.21.15.123:38800) 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd05dc0700 1 -- 172.21.15.123:0/1318566773 learned_addr learned my addr 172.21.15.123:0/1318566773 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.332+0000 7fcd05dc0700 1 -- 172.21.15.123:0/1318566773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0094f0 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fcd05dc0700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00b440 tx=0x7fccfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccfc0107c0 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fccfc010db0 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00114170 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccfc01ad30 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd00114e10 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.333+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7fccfc010920 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.334+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0005f5c0 con 0x7fcd00076c20 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.334+0000 7fccf67fc700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 0x7fccec038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:26.056 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.334+0000 7fcd055bf700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 0x7fccec038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.334+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fccfc04aa90 con 0x7fcd00076c20 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.334+0000 7fcd055bf700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 0x7fccec038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009990 tx=0x7fccf0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.339+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fccfc018760 con 0x7fcd00076c20 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.536+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd00108b80 con 0x7fccec0366b0 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.543+0000 7fccf67fc700 1 -- 172.21.15.123:0/1318566773 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcd00108b80 con 0x7fccec0366b0 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 msgr2=0x7fccec038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 0x7fccec038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009990 tx=0x7fccf0006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 msgr2=0x7fcd00113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00b440 tx=0x7fccfc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 shutdown_connections 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fccec0366b0 0x7fccec038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 --2- 172.21.15.123:0/1318566773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd00076c20 0x7fcd00113a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 >> 172.21.15.123:0/1318566773 conn(0x7fcd000fcdd0 msgr2=0x7fcd000fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:26.057 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 shutdown_connections 2024-02-20T07:55:26.058 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:25.545+0000 7fcd08024700 1 -- 172.21.15.123:0/1318566773 wait complete. 2024-02-20T07:55:26.835 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:26 smithi123 ceph-mon[29383]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:26.835 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:26 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:26.836 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:26 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:26.836 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:26 smithi123 ceph-mon[29383]: mgrmap e8: smithi123.kwyrtl(active, since 2s) 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.393+0000 7f375978c700 1 Processor -- start 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.393+0000 7f375978c700 1 -- start start 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.393+0000 7f375978c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.393+0000 7f375978c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541036e0 con 0x7f3754102d90 2024-02-20T07:55:27.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38806/0 (socket says 172.21.15.123:38806) 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f3752ffd700 1 -- 172.21.15.123:0/2088266721 learned_addr learned my addr 172.21.15.123:0/2088266721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f3752ffd700 1 -- 172.21.15.123:0/2088266721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754103820 con 0x7f3754102d90 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f3752ffd700 1 --2- 172.21.15.123:0/2088266721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37440098e0 tx=0x7f3744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d391ac5ab40f91 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f37527fc700 1 -- 172.21.15.123:0/2088266721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f374400b860 con 0x7f3754102d90 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f37527fc700 1 -- 172.21.15.123:0/2088266721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f374400be50 con 0x7f3754102d90 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.394+0000 7f37527fc700 1 -- 172.21.15.123:0/2088266721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3744010380 con 0x7f3754102d90 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- 172.21.15.123:0/2088266721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 msgr2=0x7f37541031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 --2- 172.21.15.123:0/2088266721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37440098e0 tx=0x7f3744009250 comp rx=0 tx=0).stop 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- 172.21.15.123:0/2088266721 shutdown_connections 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 --2- 172.21.15.123:0/2088266721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541031a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- 172.21.15.123:0/2088266721 >> 172.21.15.123:0/2088266721 conn(0x7f37540fc580 msgr2=0x7f37540fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- 172.21.15.123:0/2088266721 shutdown_connections 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- 172.21.15.123:0/2088266721 wait complete. 2024-02-20T07:55:27.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 Processor -- start 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.395+0000 7f375978c700 1 -- start start 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f375978c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f375978c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754113f20 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38808/0 (socket says 172.21.15.123:38808) 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f3752ffd700 1 -- 172.21.15.123:0/2611964456 learned_addr learned my addr 172.21.15.123:0/2611964456 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f3752ffd700 1 -- 172.21.15.123:0/2611964456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440094f0 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f3752ffd700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f374400b440 tx=0x7f3744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37440107c0 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754114120 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3744010db0 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f374401ada0 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.396+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754114dc0 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.397+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3744024480 con 0x7f3754102d90 2024-02-20T07:55:27.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.397+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375405f5c0 con 0x7f3754102d90 2024-02-20T07:55:27.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.397+0000 7f374bfff700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 0x7f3740038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:27.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.397+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f374404aed0 con 0x7f3754102d90 2024-02-20T07:55:27.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.397+0000 7f374a7fc700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 0x7f3740038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:27.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.398+0000 7f374a7fc700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 0x7f3740038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f373c009990 tx=0x7f373c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:27.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.402+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f374402e440 con 0x7f3754102d90 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.585+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f3754108b40 con 0x7f3740036790 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.586+0000 7f374bfff700 1 -- 172.21.15.123:0/2611964456 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f3754108b40 con 0x7f3740036790 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 msgr2=0x7f3740038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 0x7f3740038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f373c009990 tx=0x7f373c006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 msgr2=0x7f37541139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f374400b440 tx=0x7f3744009250 comp rx=0 tx=0).stop 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 shutdown_connections 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f3740036790 0x7f3740038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 --2- 172.21.15.123:0/2611964456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3754102d90 0x7f37541139e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 >> 172.21.15.123:0/2611964456 conn(0x7f37540fc580 msgr2=0x7f37540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 shutdown_connections 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:26.588+0000 7f375978c700 1 -- 172.21.15.123:0/2611964456 wait complete. 2024-02-20T07:55:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:Generating ssh key... 2024-02-20T07:55:27.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:27 smithi123 ceph-mon[29383]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:28.642 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f93a5647700 1 Processor -- start 2024-02-20T07:55:28.642 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f93a5647700 1 -- start start 2024-02-20T07:55:28.642 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f93a5647700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:28.642 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f93a5647700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0079110 con 0x7f93a0078d00 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38820/0 (socket says 172.21.15.123:38820) 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939effd700 1 -- 172.21.15.123:0/3784207332 learned_addr learned my addr 172.21.15.123:0/3784207332 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939effd700 1 -- 172.21.15.123:0/3784207332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0077750 con 0x7f93a0078d00 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939effd700 1 --2- 172.21.15.123:0/3784207332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93900098e0 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc911cffc3cc309d server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.615+0000 7f939dffb700 1 -- 172.21.15.123:0/3784207332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f939000b860 con 0x7f93a0078d00 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f939dffb700 1 -- 172.21.15.123:0/3784207332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f939000be50 con 0x7f93a0078d00 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f939dffb700 1 -- 172.21.15.123:0/3784207332 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9390010380 con 0x7f93a0078d00 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 -- 172.21.15.123:0/3784207332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 msgr2=0x7f93a0077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 --2- 172.21.15.123:0/3784207332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93900098e0 tx=0x7f9390009250 comp rx=0 tx=0).stop 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 -- 172.21.15.123:0/3784207332 shutdown_connections 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 --2- 172.21.15.123:0/3784207332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a0077210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 -- 172.21.15.123:0/3784207332 >> 172.21.15.123:0/3784207332 conn(0x7f93a00fded0 msgr2=0x7f93a0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 -- 172.21.15.123:0/3784207332 shutdown_connections 2024-02-20T07:55:28.643 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.616+0000 7f93a5647700 1 -- 172.21.15.123:0/3784207332 wait complete. 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f93a5647700 1 Processor -- start 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f93a5647700 1 -- start start 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f93a5647700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f93a5647700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0113d00 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f939effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f939effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38826/0 (socket says 172.21.15.123:38826) 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f939effd700 1 -- 172.21.15.123:0/652458141 learned_addr learned my addr 172.21.15.123:0/652458141 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.617+0000 7f939effd700 1 -- 172.21.15.123:0/652458141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094f0 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f939effd700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9390006b00 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93900107c0 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9390010db0 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a0113f00 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f939001acf0 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.618+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a0114ba0 con 0x7f93a0078d00 2024-02-20T07:55:28.644 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f93900193c0 con 0x7f93a0078d00 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a005f5c0 con 0x7f93a0078d00 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f93877fe700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 0x7f9388038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f939004a650 con 0x7f93a0078d00 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f939e7fc700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 0x7f9388038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.619+0000 7f939e7fc700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 0x7f9388038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9394009990 tx=0x7f9394006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.623+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9390022930 con 0x7f93a0078d00 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:27.805+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f93a0100210 con 0x7f9388036790 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.084+0000 7f93877fe700 1 -- 172.21.15.123:0/652458141 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f93a0100210 con 0x7f9388036790 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 msgr2=0x7f9388038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 0x7f9388038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9394009990 tx=0x7f9394006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 msgr2=0x7f93a01137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9390006b00 tx=0x7f9390009250 comp rx=0 tx=0).stop 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 shutdown_connections 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9388036790 0x7f9388038c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:28.645 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 --2- 172.21.15.123:0/652458141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93a0078d00 0x7f93a01137c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:28.646 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 >> 172.21.15.123:0/652458141 conn(0x7f93a00fded0 msgr2=0x7f93a00ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:28.646 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 shutdown_connections 2024-02-20T07:55:28.646 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:28.086+0000 7f93a5647700 1 -- 172.21.15.123:0/652458141 wait complete. 2024-02-20T07:55:28.743 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:28 smithi123 ceph-mon[29383]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:28.744 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:28 smithi123 ceph-mon[29383]: Generating ssh key... 2024-02-20T07:55:28.744 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:28 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:28.744 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:28 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUicyjVhmmWg8GoPaW8HvEzK7eqeQWahkQduey3W1mcorEqDj1xm5wOFOzFWJP4BXjYbUZf4BF15qJY6hfg2vNYN7RX11hPN9hadl/zOWyAlm2bD0JgpbPTefPHxGvxJfEq9X8v8uju6rCcSWGE7RxGEOsa1AvukWzGqo2+4UN+2AWqxSK3Bm+HaxuA/S3qGjsNVX9RWQBPn97CiD+5c25+NheoS0EQMdxuuwNeFugpPODJ0lbwJPllUsgpbN8zA9bkorDO7oO3veOSsaBIdZvpcWBS707P4lIhyYoI941ZnBMWCS8UEOagLRUUGi7LBjdp7sWfj4DvTREVN+QilRXhR9h6eWIyfYGuMx8R+r+Ug2vExnNOJ+7mPMEYYGVJwFeS3wE0PEWo6/xsGdzoALINWciy4OoDr+fb8Z9k7loAnBlzENTW3heLIMZSwiAxV4TXg4G92NxrP0XmVq2/YjKerx2CpYFjwhHtEODEqPyPeulqSOvM4whZURoIe+dW68= ceph-1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.033+0000 7f28e167e700 1 Processor -- start 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.033+0000 7f28e167e700 1 -- start start 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28e167e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28e167e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc101fc0 con 0x7f28dc101670 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49528/0 (socket says 172.21.15.123:49528) 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28daffd700 1 -- 172.21.15.123:0/162984050 learned_addr learned my addr 172.21.15.123:0/162984050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:29.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28daffd700 1 -- 172.21.15.123:0/162984050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc102100 con 0x7f28dc101670 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28daffd700 1 --2- 172.21.15.123:0/162984050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098e0 tx=0x7f28cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6b3b66aa6a210 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28d9ffb700 1 -- 172.21.15.123:0/162984050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28cc00b860 con 0x7f28dc101670 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28d9ffb700 1 -- 172.21.15.123:0/162984050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f28cc00be50 con 0x7f28dc101670 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.034+0000 7f28d9ffb700 1 -- 172.21.15.123:0/162984050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28cc010380 con 0x7f28dc101670 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 -- 172.21.15.123:0/162984050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 msgr2=0x7f28dc101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 --2- 172.21.15.123:0/162984050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098e0 tx=0x7f28cc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 -- 172.21.15.123:0/162984050 shutdown_connections 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 --2- 172.21.15.123:0/162984050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc101a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 -- 172.21.15.123:0/162984050 >> 172.21.15.123:0/162984050 conn(0x7f28dc0fcdd0 msgr2=0x7f28dc0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 -- 172.21.15.123:0/162984050 shutdown_connections 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.035+0000 7f28e167e700 1 -- 172.21.15.123:0/162984050 wait complete. 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 Processor -- start 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 -- start start 2024-02-20T07:55:29.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc111d60 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49544/0 (socket says 172.21.15.123:49544) 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28daffd700 1 -- 172.21.15.123:0/3844064920 learned_addr learned my addr 172.21.15.123:0/3844064920 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28daffd700 1 -- 172.21.15.123:0/3844064920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0094f0 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28daffd700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00b440 tx=0x7f28cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28cc010760 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f28cc010d50 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28cc024d80 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc111f60 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.036+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc112c00 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.037+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f28cc01a450 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.037+0000 7f28c37fe700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 0x7f28c4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.037+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f28cc04aa80 con 0x7f28dc101670 2024-02-20T07:55:29.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.038+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc05f5c0 con 0x7f28dc101670 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.038+0000 7f28da7fc700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 0x7f28c4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.038+0000 7f28da7fc700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 0x7f28c4038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009990 tx=0x7f28d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.042+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f28cc01acb0 con 0x7f28dc101670 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.225+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f28dc1034e0 con 0x7f28c40367e0 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.226+0000 7f28c37fe700 1 -- 172.21.15.123:0/3844064920 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f28dc1034e0 con 0x7f28c40367e0 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.227+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 msgr2=0x7f28c4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.227+0000 7f28e167e700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 0x7f28c4038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009990 tx=0x7f28d0006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.227+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 msgr2=0x7f28dc111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.227+0000 7f28e167e700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00b440 tx=0x7f28cc009250 comp rx=0 tx=0).stop 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 shutdown_connections 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f28c40367e0 0x7f28c4038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 --2- 172.21.15.123:0/3844064920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28dc101670 0x7f28dc111820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 >> 172.21.15.123:0/3844064920 conn(0x7f28dc0fcdd0 msgr2=0x7f28dc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 shutdown_connections 2024-02-20T07:55:29.819 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:29.228+0000 7f28e167e700 1 -- 172.21.15.123:0/3844064920 wait complete. 2024-02-20T07:55:29.820 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-20T07:55:29.820 INFO:teuthology.orchestra.run.smithi123.stdout:Adding key to root@localhost authorized_keys... 2024-02-20T07:55:29.820 INFO:teuthology.orchestra.run.smithi123.stdout:Adding host smithi123... 2024-02-20T07:55:31.097 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:30 smithi123 ceph-mon[29383]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:32.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:31 smithi123 ceph-mon[29383]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:32.999 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:32 smithi123 ceph-mon[29383]: Deploying cephadm binary to smithi123 2024-02-20T07:55:32.999 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:32 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:32.999 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:32 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Added host 'smithi123' with addr '172.21.15.123' 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b97176700 1 Processor -- start 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b97176700 1 -- start start 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b97176700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b97176700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b901030c0 con 0x7f2b90102770 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b94f12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b94f12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49552/0 (socket says 172.21.15.123:49552) 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b94f12700 1 -- 172.21.15.123:0/2578016470 learned_addr learned my addr 172.21.15.123:0/2578016470 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.242+0000 7f2b94f12700 1 -- 172.21.15.123:0/2578016470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90103200 con 0x7f2b90102770 2024-02-20T07:55:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b94f12700 1 --2- 172.21.15.123:0/2578016470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b840098e0 tx=0x7f2b84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920bff635b2a1e9d server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b8f7fe700 1 -- 172.21.15.123:0/2578016470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b8400b860 con 0x7f2b90102770 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b8f7fe700 1 -- 172.21.15.123:0/2578016470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2b8400be50 con 0x7f2b90102770 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b8f7fe700 1 -- 172.21.15.123:0/2578016470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b84010380 con 0x7f2b90102770 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 -- 172.21.15.123:0/2578016470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 msgr2=0x7f2b90102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 --2- 172.21.15.123:0/2578016470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b840098e0 tx=0x7f2b84009250 comp rx=0 tx=0).stop 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 -- 172.21.15.123:0/2578016470 shutdown_connections 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 --2- 172.21.15.123:0/2578016470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90102b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 -- 172.21.15.123:0/2578016470 >> 172.21.15.123:0/2578016470 conn(0x7f2b900fded0 msgr2=0x7f2b90100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 -- 172.21.15.123:0/2578016470 shutdown_connections 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.243+0000 7f2b97176700 1 -- 172.21.15.123:0/2578016470 wait complete. 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b97176700 1 Processor -- start 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b97176700 1 -- start start 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b97176700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b97176700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90111ad0 con 0x7f2b90102770 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b94f12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:33.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b94f12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49560/0 (socket says 172.21.15.123:49560) 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.244+0000 7f2b94f12700 1 -- 172.21.15.123:0/3994271708 learned_addr learned my addr 172.21.15.123:0/3994271708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b94f12700 1 -- 172.21.15.123:0/3994271708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840094f0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b94f12700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000c00 tx=0x7f2b84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b840107c0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b90111cd0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2b84010db0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b8401ad00 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.245+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b90112970 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f2b840193c0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9005f5c0 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b8d7fa700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 0x7f2b80038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2b8404a680 con 0x7f2b90102770 2024-02-20T07:55:33.008 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b8ffff700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 0x7f2b80038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.246+0000 7f2b8ffff700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 0x7f2b80038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009990 tx=0x7f2b7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.250+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2b84022930 con 0x7f2b90102770 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:30.436+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b901001b0 con 0x7f2b80036790 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.417+0000 7f2b8d7fa700 1 -- 172.21.15.123:0/3994271708 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2b901001b0 con 0x7f2b80036790 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 msgr2=0x7f2b80038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 0x7f2b80038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009990 tx=0x7f2b7c006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 msgr2=0x7f2b90111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000c00 tx=0x7f2b84009250 comp rx=0 tx=0).stop 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 shutdown_connections 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f2b80036790 0x7f2b80038c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 --2- 172.21.15.123:0/3994271708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b90102770 0x7f2b90111590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 >> 172.21.15.123:0/3994271708 conn(0x7f2b900fded0 msgr2=0x7f2b900ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 shutdown_connections 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:32.420+0000 7f2b97176700 1 -- 172.21.15.123:0/3994271708 wait complete. 2024-02-20T07:55:33.009 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying mon service with default placement... 2024-02-20T07:55:33.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:33 smithi123 ceph-mon[29383]: Added host smithi123 2024-02-20T07:55:33.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:33 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-20T07:55:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.385+0000 7fba10371700 1 Processor -- start 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.385+0000 7fba10371700 1 -- start start 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.386+0000 7fba10371700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.386+0000 7fba10371700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba081058c0 con 0x7fba08071480 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.386+0000 7fba0e10d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.386+0000 7fba0e10d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49564/0 (socket says 172.21.15.123:49564) 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.386+0000 7fba0e10d700 1 -- 172.21.15.123:0/1806317001 learned_addr learned my addr 172.21.15.123:0/1806317001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba0e10d700 1 -- 172.21.15.123:0/1806317001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08101160 con 0x7fba08071480 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba0e10d700 1 --2- 172.21.15.123:0/1806317001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba040098e0 tx=0x7fba04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ee70b85c9d0f08 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba0d10b700 1 -- 172.21.15.123:0/1806317001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba0400b860 con 0x7fba08071480 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba0d10b700 1 -- 172.21.15.123:0/1806317001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba0400be50 con 0x7fba08071480 2024-02-20T07:55:34.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba0d10b700 1 -- 172.21.15.123:0/1806317001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba04010380 con 0x7fba08071480 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba10371700 1 -- 172.21.15.123:0/1806317001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 msgr2=0x7fba08105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.387+0000 7fba10371700 1 --2- 172.21.15.123:0/1806317001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba040098e0 tx=0x7fba04009250 comp rx=0 tx=0).stop 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- 172.21.15.123:0/1806317001 shutdown_connections 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 --2- 172.21.15.123:0/1806317001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08105380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- 172.21.15.123:0/1806317001 >> 172.21.15.123:0/1806317001 conn(0x7fba080fcdd0 msgr2=0x7fba080ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:34.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- 172.21.15.123:0/1806317001 shutdown_connections 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- 172.21.15.123:0/1806317001 wait complete. 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 Processor -- start 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- start start 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.388+0000 7fba10371700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08113cc0 con 0x7fba08071480 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.389+0000 7fba0e10d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.389+0000 7fba0e10d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49570/0 (socket says 172.21.15.123:49570) 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.389+0000 7fba0e10d700 1 -- 172.21.15.123:0/2036881037 learned_addr learned my addr 172.21.15.123:0/2036881037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.389+0000 7fba0e10d700 1 -- 172.21.15.123:0/2036881037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094f0 con 0x7fba08071480 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.389+0000 7fba0e10d700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba04006b00 tx=0x7fba04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba040107c0 con 0x7fba08071480 2024-02-20T07:55:34.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba04010db0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba08113ec0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba0401acf0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba08114b60 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.390+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fba040193c0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.391+0000 7fb9feffd700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 0x7fb9f4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.391+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fba0404b4d0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.391+0000 7fba0d90c700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 0x7fb9f4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.391+0000 7fba0d90c700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 0x7fb9f4038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009990 tx=0x7fb9f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.391+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba08114350 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.396+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fba040196c0 con 0x7fba08071480 2024-02-20T07:55:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.599+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fba08114e60 con 0x7fb9f40367e0 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.603+0000 7fb9feffd700 1 -- 172.21.15.123:0/2036881037 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fba08114e60 con 0x7fb9f40367e0 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 msgr2=0x7fb9f4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 0x7fb9f4038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009990 tx=0x7fb9f8006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 msgr2=0x7fba08113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba04006b00 tx=0x7fba04009250 comp rx=0 tx=0).stop 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 shutdown_connections 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fb9f40367e0 0x7fb9f4038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 --2- 172.21.15.123:0/2036881037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba08071480 0x7fba08113780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 >> 172.21.15.123:0/2036881037 conn(0x7fba080fcdd0 msgr2=0x7fba081036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 shutdown_connections 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:33.605+0000 7fba10371700 1 -- 172.21.15.123:0/2036881037 wait complete. 2024-02-20T07:55:34.317 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying mgr service with default placement... 2024-02-20T07:55:34.878 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:34 smithi123 ceph-mon[29383]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:34.905 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:34 smithi123 ceph-mon[29383]: Saving service mon spec with placement count:5 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.704+0000 7f0698aae700 1 Processor -- start 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.704+0000 7f0698aae700 1 -- start start 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f0698aae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f0698aae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0694105960 con 0x7f0694076b80 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:35.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49576/0 (socket says 172.21.15.123:49576) 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069259c700 1 -- 172.21.15.123:0/998737956 learned_addr learned my addr 172.21.15.123:0/998737956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069259c700 1 -- 172.21.15.123:0/998737956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694105aa0 con 0x7f0694076b80 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069259c700 1 --2- 172.21.15.123:0/998737956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06880098e0 tx=0x7f0688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bf3f5b7ab5e606 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069159a700 1 -- 172.21.15.123:0/998737956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f068800b860 con 0x7f0694076b80 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069159a700 1 -- 172.21.15.123:0/998737956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f068800be50 con 0x7f0694076b80 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.705+0000 7f069159a700 1 -- 172.21.15.123:0/998737956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0688010380 con 0x7f0694076b80 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 -- 172.21.15.123:0/998737956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 msgr2=0x7f0694105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 --2- 172.21.15.123:0/998737956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06880098e0 tx=0x7f0688009250 comp rx=0 tx=0).stop 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 -- 172.21.15.123:0/998737956 shutdown_connections 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 --2- 172.21.15.123:0/998737956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694105420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:35.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 -- 172.21.15.123:0/998737956 >> 172.21.15.123:0/998737956 conn(0x7f06940fcdd0 msgr2=0x7f06940ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 -- 172.21.15.123:0/998737956 shutdown_connections 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 -- 172.21.15.123:0/998737956 wait complete. 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.706+0000 7f0698aae700 1 Processor -- start 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0698aae700 1 -- start start 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0698aae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0698aae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0694111ac0 con 0x7f0694076b80 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f069259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f069259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49588/0 (socket says 172.21.15.123:49588) 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f069259c700 1 -- 172.21.15.123:0/254465873 learned_addr learned my addr 172.21.15.123:0/254465873 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f069259c700 1 -- 172.21.15.123:0/254465873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880094f0 con 0x7f0694076b80 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f069259c700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0688003050 tx=0x7f0688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0688010760 con 0x7f0694076b80 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0694111cc0 con 0x7f0694076b80 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0688010d50 con 0x7f0694076b80 2024-02-20T07:55:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f068801ae20 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.707+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0694112960 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.708+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f068802e440 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.708+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069405f5c0 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.708+0000 7f0682ffd700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 0x7f067c038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.708+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f068804a6a0 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.709+0000 7f0691d9b700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 0x7f067c038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.709+0000 7f0691d9b700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 0x7f067c038c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0684009990 tx=0x7f0684006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.713+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0688018760 con 0x7f0694076b80 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.927+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f06941134e0 con 0x7f067c036770 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.931+0000 7f0682ffd700 1 -- 172.21.15.123:0/254465873 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f06941134e0 con 0x7f067c036770 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 msgr2=0x7f067c038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:35.528 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 0x7f067c038c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0684009990 tx=0x7f0684006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 msgr2=0x7f0694111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0688003050 tx=0x7f0688009250 comp rx=0 tx=0).stop 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 shutdown_connections 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f067c036770 0x7f067c038c20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 --2- 172.21.15.123:0/254465873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0694076b80 0x7f0694111580 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 >> 172.21.15.123:0/254465873 conn(0x7f06940fcdd0 msgr2=0x7f06940fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.933+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 shutdown_connections 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:34.934+0000 7f0698aae700 1 -- 172.21.15.123:0/254465873 wait complete. 2024-02-20T07:55:35.529 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying crash service with default placement... 2024-02-20T07:55:36.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:35 smithi123 ceph-mon[29383]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:36.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:35 smithi123 ceph-mon[29383]: Saving service mgr spec with placement count:2 2024-02-20T07:55:36.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:35 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:37.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:37 smithi123 ceph-mon[29383]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:37.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:37 smithi123 ceph-mon[29383]: Saving service crash spec with placement * 2024-02-20T07:55:37.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:37 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:37.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:37 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:37.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-20T07:55:37.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9c763700 1 Processor -- start 2024-02-20T07:55:37.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9c763700 1 -- start start 2024-02-20T07:55:37.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9c763700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9c763700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941030c0 con 0x7f5c94102770 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9a4ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9a4ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49590/0 (socket says 172.21.15.123:49590) 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9a4ff700 1 -- 172.21.15.123:0/3569336396 learned_addr learned my addr 172.21.15.123:0/3569336396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.907+0000 7f5c9a4ff700 1 -- 172.21.15.123:0/3569336396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94103200 con 0x7f5c94102770 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9a4ff700 1 --2- 172.21.15.123:0/3569336396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c900098e0 tx=0x7f5c90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff9cb3c11382b39 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c994fd700 1 -- 172.21.15.123:0/3569336396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c9000b860 con 0x7f5c94102770 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c994fd700 1 -- 172.21.15.123:0/3569336396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5c9000be50 con 0x7f5c94102770 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c994fd700 1 -- 172.21.15.123:0/3569336396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c90010380 con 0x7f5c94102770 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 -- 172.21.15.123:0/3569336396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 msgr2=0x7f5c94102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3569336396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c900098e0 tx=0x7f5c90009250 comp rx=0 tx=0).stop 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 -- 172.21.15.123:0/3569336396 shutdown_connections 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3569336396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94102b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:37.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 -- 172.21.15.123:0/3569336396 >> 172.21.15.123:0/3569336396 conn(0x7f5c940fded0 msgr2=0x7f5c94100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 -- 172.21.15.123:0/3569336396 shutdown_connections 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.908+0000 7f5c9c763700 1 -- 172.21.15.123:0/3569336396 wait complete. 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9c763700 1 Processor -- start 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9c763700 1 -- start start 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9c763700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9c763700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94111aa0 con 0x7f5c94102770 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9a4ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9a4ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49592/0 (socket says 172.21.15.123:49592) 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9a4ff700 1 -- 172.21.15.123:0/3075955843 learned_addr learned my addr 172.21.15.123:0/3075955843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.909+0000 7f5c9a4ff700 1 -- 172.21.15.123:0/3075955843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900094f0 con 0x7f5c94102770 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c9a4ff700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b440 tx=0x7f5c90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c90010760 con 0x7f5c94102770 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5c90010d50 con 0x7f5c94102770 2024-02-20T07:55:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c9001ae20 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c94111ca0 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.910+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94112940 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f5c900108c0 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9405f5c0 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c8affd700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 0x7f5c80038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5c9004a680 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c99cfe700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 0x7f5c80038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.911+0000 7f5c99cfe700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 0x7f5c80038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009990 tx=0x7f5c84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:35.915+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5c90018920 con 0x7f5c94102770 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.115+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c94100190 con 0x7f5c800367e0 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.119+0000 7f5c8affd700 1 -- 172.21.15.123:0/3075955843 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f5c94100190 con 0x7f5c800367e0 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 msgr2=0x7f5c80038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 0x7f5c80038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009990 tx=0x7f5c84006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:37.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 msgr2=0x7f5c94111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b440 tx=0x7f5c90009250 comp rx=0 tx=0).stop 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 shutdown_connections 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f5c800367e0 0x7f5c80038c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 --2- 172.21.15.123:0/3075955843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102770 0x7f5c94111560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 >> 172.21.15.123:0/3075955843 conn(0x7f5c940fded0 msgr2=0x7f5c940ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 shutdown_connections 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:36.123+0000 7f5c9c763700 1 -- 172.21.15.123:0/3075955843 wait complete. 2024-02-20T07:55:37.314 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying prometheus service with default placement... 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f752d474700 1 Processor -- start 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f752d474700 1 -- start start 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f752d474700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f752d474700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75281058a0 con 0x7f7528076c40 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49604/0 (socket says 172.21.15.123:49604) 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.757+0000 7f7526ffd700 1 -- 172.21.15.123:0/3643136105 learned_addr learned my addr 172.21.15.123:0/3643136105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f7526ffd700 1 -- 172.21.15.123:0/3643136105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75281059e0 con 0x7f7528076c40 2024-02-20T07:55:38.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f7526ffd700 1 --2- 172.21.15.123:0/3643136105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f7520009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3ab7c33f04f84e server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f7525ffb700 1 -- 172.21.15.123:0/3643136105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75200092e0 con 0x7f7528076c40 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f7525ffb700 1 -- 172.21.15.123:0/3643136105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7520012430 con 0x7f7528076c40 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f7525ffb700 1 -- 172.21.15.123:0/3643136105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75200075a0 con 0x7f7528076c40 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f752d474700 1 -- 172.21.15.123:0/3643136105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 msgr2=0x7f7528105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.758+0000 7f752d474700 1 --2- 172.21.15.123:0/3643136105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f7520009840 comp rx=0 tx=0).stop 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- 172.21.15.123:0/3643136105 shutdown_connections 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 --2- 172.21.15.123:0/3643136105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528105360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- 172.21.15.123:0/3643136105 >> 172.21.15.123:0/3643136105 conn(0x7f75280fcdd0 msgr2=0x7f75280ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- 172.21.15.123:0/3643136105 shutdown_connections 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- 172.21.15.123:0/3643136105 wait complete. 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 Processor -- start 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- start start 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f752d474700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7528111db0 con 0x7f7528076c40 2024-02-20T07:55:38.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.759+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49606/0 (socket says 172.21.15.123:49606) 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f7526ffd700 1 -- 172.21.15.123:0/4000397351 learned_addr learned my addr 172.21.15.123:0/4000397351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f7526ffd700 1 -- 172.21.15.123:0/4000397351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009ae0 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f7526ffd700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75200127d0 tx=0x7f7520009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75200092e0 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7520007d30 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7528111fb0 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75200259a0 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.760+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7528112c50 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f7520019050 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f750f7fe700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 0x7f7510038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f752004a150 con 0x7f7528076c40 2024-02-20T07:55:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752805f5c0 con 0x7f7528076c40 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f75267fc700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 0x7f7510038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.761+0000 7f75267fc700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 0x7f7510038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f751c009990 tx=0x7f751c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.766+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7520017080 con 0x7f7528076c40 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.970+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f75281068d0 con 0x7f7510036790 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.974+0000 7f750f7fe700 1 -- 172.21.15.123:0/4000397351 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f75281068d0 con 0x7f7510036790 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.976+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 msgr2=0x7f7510038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.976+0000 7f752d474700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 0x7f7510038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f751c009990 tx=0x7f751c006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.976+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 msgr2=0x7f7528111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.976+0000 7f752d474700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75200127d0 tx=0x7f7520009840 comp rx=0 tx=0).stop 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 shutdown_connections 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f7510036790 0x7f7510038c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 --2- 172.21.15.123:0/4000397351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7528076c40 0x7f7528111870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 >> 172.21.15.123:0/4000397351 conn(0x7f75280fcdd0 msgr2=0x7f75280ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 shutdown_connections 2024-02-20T07:55:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:37.977+0000 7f752d474700 1 -- 172.21.15.123:0/4000397351 wait complete. 2024-02-20T07:55:38.490 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying grafana service with default placement... 2024-02-20T07:55:39.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:38 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:39.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:38 smithi123 ceph-mon[29383]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:39.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:38 smithi123 ceph-mon[29383]: Saving service prometheus spec with placement count:1 2024-02-20T07:55:39.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:38 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:39.635 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f7666983700 1 Processor -- start 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f7666983700 1 -- start start 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f7666983700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f7666983700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660103560 con 0x7f7660102c10 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f765ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f765ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54336/0 (socket says 172.21.15.123:54336) 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f765ffff700 1 -- 172.21.15.123:0/217148799 learned_addr learned my addr 172.21.15.123:0/217148799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f765ffff700 1 -- 172.21.15.123:0/217148799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76601036a0 con 0x7f7660102c10 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.874+0000 7f765ffff700 1 --2- 172.21.15.123:0/217148799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76500098e0 tx=0x7f7650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819771aff4f5fbb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f765effd700 1 -- 172.21.15.123:0/217148799 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765000b860 con 0x7f7660102c10 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f765effd700 1 -- 172.21.15.123:0/217148799 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f765000be90 con 0x7f7660102c10 2024-02-20T07:55:39.636 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f765effd700 1 -- 172.21.15.123:0/217148799 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76500103c0 con 0x7f7660102c10 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 -- 172.21.15.123:0/217148799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 msgr2=0x7f7660103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 --2- 172.21.15.123:0/217148799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76500098e0 tx=0x7f7650009250 comp rx=0 tx=0).stop 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 -- 172.21.15.123:0/217148799 shutdown_connections 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 --2- 172.21.15.123:0/217148799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f7660103020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 -- 172.21.15.123:0/217148799 >> 172.21.15.123:0/217148799 conn(0x7f76600fc580 msgr2=0x7f76600fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 -- 172.21.15.123:0/217148799 shutdown_connections 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.875+0000 7f7666983700 1 -- 172.21.15.123:0/217148799 wait complete. 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f7666983700 1 Processor -- start 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f7666983700 1 -- start start 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f7666983700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f7666983700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660111df0 con 0x7f7660102c10 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f765ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f765ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54346/0 (socket says 172.21.15.123:54346) 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f765ffff700 1 -- 172.21.15.123:0/880018013 learned_addr learned my addr 172.21.15.123:0/880018013 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:39.637 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f765ffff700 1 -- 172.21.15.123:0/880018013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094f0 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.876+0000 7f765ffff700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76500105b0 tx=0x7f7650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7650010630 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7650010c60 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7660111ff0 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765001ad70 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660112420 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.877+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f7650022420 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.878+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766004bed0 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.878+0000 7f765cff9700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 0x7f7648038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.878+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f765001e070 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.878+0000 7f765f7fe700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 0x7f7648038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.878+0000 7f765f7fe700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 0x7f7648038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7654009990 tx=0x7f7654006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:38.882+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7650020920 con 0x7f7660102c10 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.087+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f766010b2e0 con 0x7f76480367e0 2024-02-20T07:55:39.638 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.092+0000 7f765cff9700 1 -- 172.21.15.123:0/880018013 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f766010b2e0 con 0x7f76480367e0 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.094+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 msgr2=0x7f7648038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.094+0000 7f7666983700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 0x7f7648038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7654009990 tx=0x7f7654006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.094+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 msgr2=0x7f76601118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.094+0000 7f7666983700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76500105b0 tx=0x7f7650009250 comp rx=0 tx=0).stop 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 shutdown_connections 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f76480367e0 0x7f7648038c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 --2- 172.21.15.123:0/880018013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7660102c10 0x7f76601118b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 >> 172.21.15.123:0/880018013 conn(0x7f76600fc580 msgr2=0x7f76600fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 shutdown_connections 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:39.095+0000 7f7666983700 1 -- 172.21.15.123:0/880018013 wait complete. 2024-02-20T07:55:39.639 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying node-exporter service with default placement... 2024-02-20T07:55:40.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:40 smithi123 ceph-mon[29383]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:40.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:40 smithi123 ceph-mon[29383]: Saving service grafana spec with placement count:1 2024-02-20T07:55:40.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:40 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-20T07:55:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f886c21d700 1 Processor -- start 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f886c21d700 1 -- start start 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f886c21d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f886c21d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641031d0 con 0x7f8864071420 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f8869fb9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f8869fb9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54362/0 (socket says 172.21.15.123:54362) 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.337+0000 7f8869fb9700 1 -- 172.21.15.123:0/1859503020 learned_addr learned my addr 172.21.15.123:0/1859503020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.338+0000 7f8869fb9700 1 -- 172.21.15.123:0/1859503020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864107d20 con 0x7f8864071420 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.338+0000 7f8869fb9700 1 --2- 172.21.15.123:0/1859503020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88540098e0 tx=0x7f8854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0ab1d792196258 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.338+0000 7f8868fb7700 1 -- 172.21.15.123:0/1859503020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f885400b860 con 0x7f8864071420 2024-02-20T07:55:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.338+0000 7f8868fb7700 1 -- 172.21.15.123:0/1859503020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f885400be90 con 0x7f8864071420 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.338+0000 7f8868fb7700 1 -- 172.21.15.123:0/1859503020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88540103c0 con 0x7f8864071420 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- 172.21.15.123:0/1859503020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 msgr2=0x7f88641077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 --2- 172.21.15.123:0/1859503020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88540098e0 tx=0x7f8854009250 comp rx=0 tx=0).stop 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- 172.21.15.123:0/1859503020 shutdown_connections 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 --2- 172.21.15.123:0/1859503020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641077e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- 172.21.15.123:0/1859503020 >> 172.21.15.123:0/1859503020 conn(0x7f88640fcdd0 msgr2=0x7f88640ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- 172.21.15.123:0/1859503020 shutdown_connections 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- 172.21.15.123:0/1859503020 wait complete. 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 Processor -- start 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- start start 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.339+0000 7f886c21d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864113d20 con 0x7f8864071420 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f8869fb9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f8869fb9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54378/0 (socket says 172.21.15.123:54378) 2024-02-20T07:55:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f8869fb9700 1 -- 172.21.15.123:0/4281403990 learned_addr learned my addr 172.21.15.123:0/4281403990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f8869fb9700 1 -- 172.21.15.123:0/4281403990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540094f0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f8869fb9700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88540094c0 tx=0x7f8854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8854010890 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8854010ec0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8864113f20 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88540243f0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.340+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8864114bc0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.341+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f885402d3f0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.341+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886405f5c0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.341+0000 7f885a7fc700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 0x7f8850038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.341+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f885404a4b0 con 0x7f8864071420 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.341+0000 7f88697b8700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 0x7f8850038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.342+0000 7f88697b8700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 0x7f8850038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8860009990 tx=0x7f8860006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.346+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f88540193c0 con 0x7f8864071420 2024-02-20T07:55:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.555+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f88640ff100 con 0x7f88500367e0 2024-02-20T07:55:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.566+0000 7f885a7fc700 1 -- 172.21.15.123:0/4281403990 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f88640ff100 con 0x7f88500367e0 2024-02-20T07:55:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 msgr2=0x7f8850038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 0x7f8850038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8860009990 tx=0x7f8860006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 msgr2=0x7f88641137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88540094c0 tx=0x7f8854009250 comp rx=0 tx=0).stop 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 shutdown_connections 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f88500367e0 0x7f8850038c90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 --2- 172.21.15.123:0/4281403990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8864071420 0x7f88641137e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 >> 172.21.15.123:0/4281403990 conn(0x7f88640fcdd0 msgr2=0x7f88640fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 shutdown_connections 2024-02-20T07:55:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:40.569+0000 7f886c21d700 1 -- 172.21.15.123:0/4281403990 wait complete. 2024-02-20T07:55:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying alertmanager service with default placement... 2024-02-20T07:55:41.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:41 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:41.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:41 smithi123 ceph-mon[29383]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:41.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:41 smithi123 ceph-mon[29383]: Saving service node-exporter spec with placement * 2024-02-20T07:55:41.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:41 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:42.314 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b96ba700 1 Processor -- start 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b96ba700 1 -- start start 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b96ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b96ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b41058a0 con 0x7fe4b4076c40 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54380/0 (socket says 172.21.15.123:54380) 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b2ffd700 1 -- 172.21.15.123:0/988858153 learned_addr learned my addr 172.21.15.123:0/988858153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.523+0000 7fe4b2ffd700 1 -- 172.21.15.123:0/988858153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b41059e0 con 0x7fe4b4076c40 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b2ffd700 1 --2- 172.21.15.123:0/988858153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40098e0 tx=0x7fe4a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952e7374648461be server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b1ffb700 1 -- 172.21.15.123:0/988858153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a400b860 con 0x7fe4b4076c40 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b1ffb700 1 -- 172.21.15.123:0/988858153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4a400be90 con 0x7fe4b4076c40 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b1ffb700 1 -- 172.21.15.123:0/988858153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a40103c0 con 0x7fe4b4076c40 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 -- 172.21.15.123:0/988858153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 msgr2=0x7fe4b4105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:42.315 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/988858153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40098e0 tx=0x7fe4a4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 -- 172.21.15.123:0/988858153 shutdown_connections 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/988858153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4105360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 -- 172.21.15.123:0/988858153 >> 172.21.15.123:0/988858153 conn(0x7fe4b40fcdd0 msgr2=0x7fe4b40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 -- 172.21.15.123:0/988858153 shutdown_connections 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.524+0000 7fe4b96ba700 1 -- 172.21.15.123:0/988858153 wait complete. 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b96ba700 1 Processor -- start 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b96ba700 1 -- start start 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b96ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b96ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4111da0 con 0x7fe4b4076c40 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54396/0 (socket says 172.21.15.123:54396) 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b2ffd700 1 -- 172.21.15.123:0/1699818830 learned_addr learned my addr 172.21.15.123:0/1699818830 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.525+0000 7fe4b2ffd700 1 -- 172.21.15.123:0/1699818830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40094f0 con 0x7fe4b4076c40 2024-02-20T07:55:42.316 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe4b2ffd700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4003080 tx=0x7fe4a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a4011920 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4a4010d60 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4111fa0 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a40243f0 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.526+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b4112c40 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fe4a402d3f0 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe49b7fe700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 0x7fe49c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b405f5c0 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe4a404a4e0 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe4b27fc700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 0x7fe49c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.527+0000 7fe4b27fc700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 0x7fe49c038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009990 tx=0x7fe4a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.532+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe4a4018b40 con 0x7fe4b4076c40 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.749+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4b4106970 con 0x7fe49c036790 2024-02-20T07:55:42.317 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.755+0000 7fe49b7fe700 1 -- 172.21.15.123:0/1699818830 <== mgr.14120 v2:172.21.15.123:6800/4006637556 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fe4a8009e60 con 0x7fe49c036790 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 msgr2=0x7fe49c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 0x7fe49c038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009990 tx=0x7fe4a8006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 msgr2=0x7fe4b4111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4003080 tx=0x7fe4a4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 shutdown_connections 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe49c036790 0x7fe49c038c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 --2- 172.21.15.123:0/1699818830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4b4076c40 0x7fe4b4111860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 >> 172.21.15.123:0/1699818830 conn(0x7fe4b40fcdd0 msgr2=0x7fe4b40ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 shutdown_connections 2024-02-20T07:55:42.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:41.757+0000 7fe4b96ba700 1 -- 172.21.15.123:0/1699818830 wait complete. 2024-02-20T07:55:42.668 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:42 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:42.669 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:42 smithi123 ceph-mon[29383]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:42.669 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:42 smithi123 ceph-mon[29383]: Saving service alertmanager spec with placement count:1 2024-02-20T07:55:42.669 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:42 smithi123 ceph-mon[29383]: from='mgr.14120 172.21.15.123:0/924187596' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:43.821 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94ea21b700 1 Processor -- start 2024-02-20T07:55:43.821 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94ea21b700 1 -- start start 2024-02-20T07:55:43.821 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94ea21b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:43.821 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94ea21b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4101fc0 con 0x7f94e4101670 2024-02-20T07:55:43.821 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54400/0 (socket says 172.21.15.123:54400) 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.687+0000 7f94e37fe700 1 -- 172.21.15.123:0/3551973570 learned_addr learned my addr 172.21.15.123:0/3551973570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.688+0000 7f94e37fe700 1 -- 172.21.15.123:0/3551973570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4102100 con 0x7f94e4101670 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.688+0000 7f94e37fe700 1 --2- 172.21.15.123:0/3551973570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94d40098e0 tx=0x7f94d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb0b305cab2400e server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.688+0000 7f94e27fc700 1 -- 172.21.15.123:0/3551973570 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d400b860 con 0x7f94e4101670 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.688+0000 7f94e27fc700 1 -- 172.21.15.123:0/3551973570 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d400be90 con 0x7f94e4101670 2024-02-20T07:55:43.822 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.688+0000 7f94e27fc700 1 -- 172.21.15.123:0/3551973570 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d40103c0 con 0x7f94e4101670 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 -- 172.21.15.123:0/3551973570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 msgr2=0x7f94e4101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 --2- 172.21.15.123:0/3551973570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94d40098e0 tx=0x7f94d4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 -- 172.21.15.123:0/3551973570 shutdown_connections 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 --2- 172.21.15.123:0/3551973570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4101a80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 -- 172.21.15.123:0/3551973570 >> 172.21.15.123:0/3551973570 conn(0x7f94e40fcdd0 msgr2=0x7f94e40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:43.823 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 -- 172.21.15.123:0/3551973570 shutdown_connections 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.689+0000 7f94ea21b700 1 -- 172.21.15.123:0/3551973570 wait complete. 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94ea21b700 1 Processor -- start 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94ea21b700 1 -- start start 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94ea21b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94ea21b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4076c10 con 0x7f94e4101670 2024-02-20T07:55:43.824 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54412/0 (socket says 172.21.15.123:54412) 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94e37fe700 1 -- 172.21.15.123:0/1071283297 learned_addr learned my addr 172.21.15.123:0/1071283297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.690+0000 7f94e37fe700 1 -- 172.21.15.123:0/1071283297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40094f0 con 0x7f94e4101670 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94e37fe700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94d4006b00 tx=0x7f94d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d40109a0 con 0x7f94e4101670 2024-02-20T07:55:43.825 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d401a430 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d40245b0 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4076e10 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.691+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4114970 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f94d4024830 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94cbfff700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 0x7f94cc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f94d401aaa0 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e404bed0 con 0x7f94e4101670 2024-02-20T07:55:43.826 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94e2ffd700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 0x7f94cc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:43.827 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.692+0000 7f94e2ffd700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 0x7f94cc038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009990 tx=0x7f94d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:43.827 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.700+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f94d4018db0 con 0x7f94e4101670 2024-02-20T07:55:43.827 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.888+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f94e41034b0 con 0x7f94e4101670 2024-02-20T07:55:43.827 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.892+0000 7f94cbfff700 1 -- 172.21.15.123:0/1071283297 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f94d4018350 con 0x7f94e4101670 2024-02-20T07:55:43.827 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 msgr2=0x7f94cc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 0x7f94cc038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009990 tx=0x7f94d8006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 msgr2=0x7f94e4114270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94d4006b00 tx=0x7f94d4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 shutdown_connections 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f94cc036790 0x7f94cc038c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:43.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 --2- 172.21.15.123:0/1071283297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e4101670 0x7f94e4114270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:43.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.894+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 >> 172.21.15.123:0/1071283297 conn(0x7f94e40fcdd0 msgr2=0x7f94e40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:43.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.895+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 shutdown_connections 2024-02-20T07:55:43.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:42.895+0000 7f94ea21b700 1 -- 172.21.15.123:0/1071283297 wait complete. 2024-02-20T07:55:44.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:43 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1071283297' entity='client.admin' 2024-02-20T07:55:44.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:43 smithi123 ceph-mon[29383]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc2580d700 1 Processor -- start 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc2580d700 1 -- start start 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc2580d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc2580d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc201014b0 con 0x7fdc20100b60 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc1effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc1effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54428/0 (socket says 172.21.15.123:54428) 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc1effd700 1 -- 172.21.15.123:0/1794113718 learned_addr learned my addr 172.21.15.123:0/1794113718 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.560+0000 7fdc1effd700 1 -- 172.21.15.123:0/1794113718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc201015f0 con 0x7fdc20100b60 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc1effd700 1 --2- 172.21.15.123:0/1794113718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc100098e0 tx=0x7fdc10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f79e5bd19cdda39 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc1dffb700 1 -- 172.21.15.123:0/1794113718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc1000b860 con 0x7fdc20100b60 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc1dffb700 1 -- 172.21.15.123:0/1794113718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc1000be90 con 0x7fdc20100b60 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc1dffb700 1 -- 172.21.15.123:0/1794113718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc100103c0 con 0x7fdc20100b60 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 -- 172.21.15.123:0/1794113718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 msgr2=0x7fdc20100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 --2- 172.21.15.123:0/1794113718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc100098e0 tx=0x7fdc10009250 comp rx=0 tx=0).stop 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 -- 172.21.15.123:0/1794113718 shutdown_connections 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 --2- 172.21.15.123:0/1794113718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20100f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 -- 172.21.15.123:0/1794113718 >> 172.21.15.123:0/1794113718 conn(0x7fdc200fc580 msgr2=0x7fdc200fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 -- 172.21.15.123:0/1794113718 shutdown_connections 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.561+0000 7fdc2580d700 1 -- 172.21.15.123:0/1794113718 wait complete. 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc2580d700 1 Processor -- start 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc2580d700 1 -- start start 2024-02-20T07:55:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc2580d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc2580d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20111fd0 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc1effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc1effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54440/0 (socket says 172.21.15.123:54440) 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.562+0000 7fdc1effd700 1 -- 172.21.15.123:0/2311983366 learned_addr learned my addr 172.21.15.123:0/2311983366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc1effd700 1 -- 172.21.15.123:0/2311983366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094f0 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc1effd700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc10011650 tx=0x7fdc10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc10010890 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc10010ec0 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc201121d0 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc1001a430 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.563+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc20112e70 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fdc1001a6b0 con 0x7fdc20100b60 2024-02-20T07:55:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc077fe700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 0x7fdc08038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdc1004a4e0 con 0x7fdc20100b60 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc1e7fc700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 0x7fdc08038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc20112660 con 0x7fdc20100b60 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.564+0000 7fdc1e7fc700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 0x7fdc08038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009990 tx=0x7fdc14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.569+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdc1002d3f0 con 0x7fdc20100b60 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.751+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fdc2005f5c0 con 0x7fdc20100b60 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.754+0000 7fdc077fe700 1 -- 172.21.15.123:0/2311983366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fdc10024430 con 0x7fdc20100b60 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 msgr2=0x7fdc08038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 0x7fdc08038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009990 tx=0x7fdc14006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 msgr2=0x7fdc20111a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc10011650 tx=0x7fdc10009250 comp rx=0 tx=0).stop 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 shutdown_connections 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fdc08036790 0x7fdc08038c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 --2- 172.21.15.123:0/2311983366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc20100b60 0x7fdc20111a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:45.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 >> 172.21.15.123:0/2311983366 conn(0x7fdc200fc580 msgr2=0x7fdc200fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:45.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 shutdown_connections 2024-02-20T07:55:45.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:44.756+0000 7fdc2580d700 1 -- 172.21.15.123:0/2311983366 wait complete. 2024-02-20T07:55:45.300 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling the dashboard module... 2024-02-20T07:55:45.925 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:45 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2311983366' entity='client.admin' 2024-02-20T07:55:47.115 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:46 smithi123 ceph-mon[29383]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:55:47.115 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:46 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3112113005' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.681+0000 7f9974b11700 1 Processor -- start 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.681+0000 7f9974b11700 1 -- start start 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.681+0000 7f9974b11700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.681+0000 7f9974b11700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99701030c0 con 0x7f9970102770 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54444/0 (socket says 172.21.15.123:54444) 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996e59c700 1 -- 172.21.15.123:0/1695092794 learned_addr learned my addr 172.21.15.123:0/1695092794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996e59c700 1 -- 172.21.15.123:0/1695092794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970103200 con 0x7f9970102770 2024-02-20T07:55:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996e59c700 1 --2- 172.21.15.123:0/1695092794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99600098e0 tx=0x7f9960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94db69d7ce9884ac server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996d59a700 1 -- 172.21.15.123:0/1695092794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f996000b860 con 0x7f9970102770 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996d59a700 1 -- 172.21.15.123:0/1695092794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f996000be90 con 0x7f9970102770 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.682+0000 7f996d59a700 1 -- 172.21.15.123:0/1695092794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99600103c0 con 0x7f9970102770 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- 172.21.15.123:0/1695092794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 msgr2=0x7f9970102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 --2- 172.21.15.123:0/1695092794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99600098e0 tx=0x7f9960009250 comp rx=0 tx=0).stop 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- 172.21.15.123:0/1695092794 shutdown_connections 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 --2- 172.21.15.123:0/1695092794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970102b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- 172.21.15.123:0/1695092794 >> 172.21.15.123:0/1695092794 conn(0x7f99700fded0 msgr2=0x7f9970100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- 172.21.15.123:0/1695092794 shutdown_connections 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- 172.21.15.123:0/1695092794 wait complete. 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 Processor -- start 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.683+0000 7f9974b11700 1 -- start start 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f9974b11700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:47.401 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f9974b11700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9970077190 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f996e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f996e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54460/0 (socket says 172.21.15.123:54460) 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f996e59c700 1 -- 172.21.15.123:0/3112113005 learned_addr learned my addr 172.21.15.123:0/3112113005 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f996e59c700 1 -- 172.21.15.123:0/3112113005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600094f0 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f996e59c700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9960011680 tx=0x7f9960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9960010890 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9960010ec0 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9970077390 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99600243f0 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.684+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9970077820 con 0x7f9970102770 2024-02-20T07:55:47.402 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.685+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f996002d3f0 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.685+0000 7f995effd700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 0x7f9958038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.685+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997004bed0 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.685+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f996004a240 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.685+0000 7f996dd9b700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 0x7f9958038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.686+0000 7f996dd9b700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 0x7f9958038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9964009990 tx=0x7f9964006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.690+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f996002b8e0 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:45.924+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f9970077f30 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.808+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f996001a430 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.810+0000 7f995effd700 1 -- 172.21.15.123:0/3112113005 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f996002c350 con 0x7f9970102770 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 msgr2=0x7f9958038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 0x7f9958038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9964009990 tx=0x7f9964006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:47.403 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 msgr2=0x7f9970078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9960011680 tx=0x7f9960009250 comp rx=0 tx=0).stop 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 shutdown_connections 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f9958036790 0x7f9958038c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 --2- 172.21.15.123:0/3112113005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9970102770 0x7f9970078d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 >> 172.21.15.123:0/3112113005 conn(0x7f99700fded0 msgr2=0x7f99700ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 shutdown_connections 2024-02-20T07:55:47.404 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:46.813+0000 7f9974b11700 1 -- 172.21.15.123:0/3112113005 wait complete. 2024-02-20T07:55:48.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:47 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3112113005' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-20T07:55:48.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:47 smithi123 ceph-mon[29383]: mgrmap e9: smithi123.kwyrtl(active, since 23s) 2024-02-20T07:55:48.690 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "smithi123.kwyrtl", 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.815+0000 7f50303d9700 1 Processor -- start 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.815+0000 7f50303d9700 1 -- start start 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.815+0000 7f50303d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f50303d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281030d0 con 0x7f5028102780 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502e175700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502e175700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54480/0 (socket says 172.21.15.123:54480) 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502e175700 1 -- 172.21.15.123:0/1182297277 learned_addr learned my addr 172.21.15.123:0/1182297277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:48.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502e175700 1 -- 172.21.15.123:0/1182297277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028103210 con 0x7f5028102780 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502e175700 1 --2- 172.21.15.123:0/1182297277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50240098e0 tx=0x7f5024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46352dab81bf44b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502d173700 1 -- 172.21.15.123:0/1182297277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502400b860 con 0x7f5028102780 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502d173700 1 -- 172.21.15.123:0/1182297277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502400be90 con 0x7f5028102780 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.816+0000 7f502d173700 1 -- 172.21.15.123:0/1182297277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50240103c0 con 0x7f5028102780 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 -- 172.21.15.123:0/1182297277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 msgr2=0x7f5028102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 --2- 172.21.15.123:0/1182297277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50240098e0 tx=0x7f5024009250 comp rx=0 tx=0).stop 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 -- 172.21.15.123:0/1182297277 shutdown_connections 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 --2- 172.21.15.123:0/1182297277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028102b90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 -- 172.21.15.123:0/1182297277 >> 172.21.15.123:0/1182297277 conn(0x7f50280fdf00 msgr2=0x7f5028100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 -- 172.21.15.123:0/1182297277 shutdown_connections 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.817+0000 7f50303d9700 1 -- 172.21.15.123:0/1182297277 wait complete. 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f50303d9700 1 Processor -- start 2024-02-20T07:55:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f50303d9700 1 -- start start 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f50303d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f50303d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028111ad0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f502e175700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f502e175700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54486/0 (socket says 172.21.15.123:54486) 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f502e175700 1 -- 172.21.15.123:0/2528556411 learned_addr learned my addr 172.21.15.123:0/2528556411 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f502e175700 1 -- 172.21.15.123:0/2528556411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240094f0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f502e175700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5024011680 tx=0x7f5024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.818+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5024010890 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.819+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028111cd0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.819+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5024010ec0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.819+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50240243f0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.819+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028112970 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.819+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f502402d3f0 con 0x7f5028102780 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.820+0000 7f501effd700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 0x7f5014038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:48.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.820+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f502404a2d0 con 0x7f5028102780 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.820+0000 7f502d974700 1 -- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 msgr2=0x7f5014038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.820+0000 7f502d974700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 0x7f5014038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.820+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5028112160 con 0x7f5028102780 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:47.824+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f502402b8e0 con 0x7f5028102780 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.021+0000 7f502d974700 1 -- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 msgr2=0x7f5014038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.021+0000 7f502d974700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 0x7f5014038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.068+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f5028112c10 con 0x7f5028102780 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.068+0000 7f501effd700 1 -- 172.21.15.123:0/2528556411 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f502402b2f0 con 0x7f5028102780 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 msgr2=0x7f5014038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 0x7f5014038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 msgr2=0x7f5028111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5024011680 tx=0x7f5024009250 comp rx=0 tx=0).stop 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 shutdown_connections 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7f50140367e0 0x7f5014038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:48.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 --2- 172.21.15.123:0/2528556411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5028102780 0x7f5028111590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 >> 172.21.15.123:0/2528556411 conn(0x7f50280fdf00 msgr2=0x7f50280ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 shutdown_connections 2024-02-20T07:55:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:48.070+0000 7f50303d9700 1 -- 172.21.15.123:0/2528556411 wait complete. 2024-02-20T07:55:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-02-20T07:55:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 9... 2024-02-20T07:55:48.939 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:48 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2528556411' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: Active manager daemon smithi123.kwyrtl restarted 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: Activating manager daemon smithi123.kwyrtl 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: osdmap e3: 0 total, 0 up, 0 in 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: mgrmap e10: smithi123.kwyrtl(active, starting, since 0.00400022s) 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T07:55:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T07:55:53.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:53.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:53 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:55:54.622 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T07:55:54.623 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T07:55:54.623 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:54 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:53] ENGINE Bus STARTING 2024-02-20T07:55:54.623 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:54.623 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:54 smithi123 ceph-mon[29383]: mgrmap e11: smithi123.kwyrtl(active, since 1.00787s) 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe462320700 1 Processor -- start 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe462320700 1 -- start start 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe462320700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe462320700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c101fc0 con 0x7fe45c101670 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48734/0 (socket says 172.21.15.123:48734) 2024-02-20T07:55:54.925 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.064+0000 7fe45bfff700 1 -- 172.21.15.123:0/1118045945 learned_addr learned my addr 172.21.15.123:0/1118045945 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.065+0000 7fe45bfff700 1 -- 172.21.15.123:0/1118045945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c102100 con 0x7fe45c101670 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.065+0000 7fe45bfff700 1 --2- 172.21.15.123:0/1118045945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4440098e0 tx=0x7fe444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178597e629b712 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.065+0000 7fe45affd700 1 -- 172.21.15.123:0/1118045945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe44400b860 con 0x7fe45c101670 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.065+0000 7fe45affd700 1 -- 172.21.15.123:0/1118045945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe44400be90 con 0x7fe45c101670 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.065+0000 7fe45affd700 1 -- 172.21.15.123:0/1118045945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4440103c0 con 0x7fe45c101670 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- 172.21.15.123:0/1118045945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 msgr2=0x7fe45c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 --2- 172.21.15.123:0/1118045945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4440098e0 tx=0x7fe444009250 comp rx=0 tx=0).stop 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- 172.21.15.123:0/1118045945 shutdown_connections 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 --2- 172.21.15.123:0/1118045945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c101a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- 172.21.15.123:0/1118045945 >> 172.21.15.123:0/1118045945 conn(0x7fe45c0fcdd0 msgr2=0x7fe45c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- 172.21.15.123:0/1118045945 shutdown_connections 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- 172.21.15.123:0/1118045945 wait complete. 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 Processor -- start 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.066+0000 7fe462320700 1 -- start start 2024-02-20T07:55:54.926 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe462320700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe462320700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0714b0 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48742/0 (socket says 172.21.15.123:48742) 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe45bfff700 1 -- 172.21.15.123:0/4127680237 learned_addr learned my addr 172.21.15.123:0/4127680237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe45bfff700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440094f0 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe45bfff700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4440090b0 tx=0x7fe444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe444010840 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe444010e70 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe444024e40 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0716b0 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.067+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c1149f0 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fe44401a4c0 con 0x7fe45c101670 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe458ff9700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4480393a0 con 0x7fe4480367e0 2024-02-20T07:55:54.927 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe44404a7d0 con 0x7fe45c101670 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe45b7fe700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.068+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.269+0000 7fe45b7fe700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.269+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.670+0000 7fe45b7fe700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:49.670+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:50.471+0000 7fe45b7fe700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:50.471+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:52.072+0000 7fe45b7fe700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4006637556 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:52.072+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:53.329+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7fe444024430 con 0x7fe45c101670 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:53.329+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 msgr2=0x7fe448038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:53.329+0000 7fe458ff9700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:54.928 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.332+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fe444016d40 con 0x7fe45c101670 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.332+0000 7fe458ff9700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 0x7fe44803c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.332+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4480393a0 con 0x7fe44803a070 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.333+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 0x7fe44803c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.333+0000 7fe45b7fe700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 0x7fe44803c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0039d0 tx=0x7fe44c009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.334+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fe4480393a0 con 0x7fe44803a070 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe45c04bed0 con 0x7fe44803a070 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe458ff9700 1 -- 172.21.15.123:0/4127680237 <== mgr.14162 v2:172.21.15.123:6800/41210014 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fe45c04bed0 con 0x7fe44803a070 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 msgr2=0x7fe44803c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 0x7fe44803c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0039d0 tx=0x7fe44c009350 comp rx=0 tx=0).stop 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 msgr2=0x7fe45c114270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4440090b0 tx=0x7fe444009250 comp rx=0 tx=0).stop 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 shutdown_connections 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe44803a070 0x7fe44803c450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe45c101670 0x7fe45c114270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 --2- 172.21.15.123:0/4127680237 >> [v2:172.21.15.123:6800/4006637556,v1:172.21.15.123:6801/4006637556] conn(0x7fe4480367e0 0x7fe448038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.340+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 >> 172.21.15.123:0/4127680237 conn(0x7fe45c0fcdd0 msgr2=0x7fe45c0fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.341+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 shutdown_connections 2024-02-20T07:55:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:54.341+0000 7fe462320700 1 -- 172.21.15.123:0/4127680237 wait complete. 2024-02-20T07:55:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 9 is available 2024-02-20T07:55:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:Generating a dashboard self-signed certificate... 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:53] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: [20/Feb/2024:07:55:53] ENGINE Bus STARTED 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:56.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:55 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d9cd1700 1 Processor -- start 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d9cd1700 1 -- start start 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d9cd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d9cd1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4105900 con 0x7f57d4071440 2024-02-20T07:55:56.195 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48800/0 (socket says 172.21.15.123:48800) 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d37fe700 1 -- 172.21.15.123:0/2274088424 learned_addr learned my addr 172.21.15.123:0/2274088424 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.349+0000 7f57d37fe700 1 -- 172.21.15.123:0/2274088424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4105a40 con 0x7f57d4071440 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d37fe700 1 --2- 172.21.15.123:0/2274088424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57c40098e0 tx=0x7f57c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62134d86ba41e939 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d27fc700 1 -- 172.21.15.123:0/2274088424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57c400b860 con 0x7f57d4071440 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d27fc700 1 -- 172.21.15.123:0/2274088424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57c400be90 con 0x7f57d4071440 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d27fc700 1 -- 172.21.15.123:0/2274088424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57c40103c0 con 0x7f57d4071440 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d9cd1700 1 -- 172.21.15.123:0/2274088424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 msgr2=0x7f57d41053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.350+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/2274088424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57c40098e0 tx=0x7f57c4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- 172.21.15.123:0/2274088424 shutdown_connections 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/2274088424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41053c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- 172.21.15.123:0/2274088424 >> 172.21.15.123:0/2274088424 conn(0x7f57d40fcdd0 msgr2=0x7f57d40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- 172.21.15.123:0/2274088424 shutdown_connections 2024-02-20T07:55:56.196 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- 172.21.15.123:0/2274088424 wait complete. 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 Processor -- start 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- start start 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.351+0000 7f57d9cd1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4111af0 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48806/0 (socket says 172.21.15.123:48806) 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d37fe700 1 -- 172.21.15.123:0/3782143792 learned_addr learned my addr 172.21.15.123:0/3782143792 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d37fe700 1 -- 172.21.15.123:0/3782143792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40094f0 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d37fe700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57c40094c0 tx=0x7f57c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57c4010890 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57c4010ec0 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57c40243f0 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.352+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d4111cf0 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.353+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d4112990 con 0x7f57d4071440 2024-02-20T07:55:56.197 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.353+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f57c402d3f0 con 0x7f57d4071440 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.354+0000 7f57bbfff700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 0x7f57bc038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.354+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d405f5c0 con 0x7f57d4071440 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.354+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f57c404a210 con 0x7f57d4071440 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.354+0000 7f57d2ffd700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 0x7f57bc038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.354+0000 7f57d2ffd700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 0x7f57bc038bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009990 tx=0x7f57c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.359+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f57c402b8e0 con 0x7f57d4071440 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.560+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f57d40ff0d0 con 0x7f57bc036710 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.603+0000 7f57bbfff700 1 -- 172.21.15.123:0/3782143792 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f57d40ff0d0 con 0x7f57bc036710 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.605+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 msgr2=0x7f57bc038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.605+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 0x7f57bc038bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009990 tx=0x7f57c8006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.605+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 msgr2=0x7f57d41115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57c40094c0 tx=0x7f57c4009250 comp rx=0 tx=0).stop 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 shutdown_connections 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f57bc036710 0x7f57bc038bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:56.198 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 --2- 172.21.15.123:0/3782143792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57d4071440 0x7f57d41115b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:56.199 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 >> 172.21.15.123:0/3782143792 conn(0x7f57d40fcdd0 msgr2=0x7f57d40fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:56.199 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 shutdown_connections 2024-02-20T07:55:56.199 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:55.606+0000 7f57d9cd1700 1 -- 172.21.15.123:0/3782143792 wait complete. 2024-02-20T07:55:56.199 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial admin user... 2024-02-20T07:55:56.910 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:56 smithi123 ceph-mon[29383]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:56.910 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:56 smithi123 ceph-mon[29383]: mgrmap e12: smithi123.kwyrtl(active, since 2s) 2024-02-20T07:55:58.210 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:57 smithi123 ceph-mon[29383]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:55:58.211 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:57 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kX0fDUoV/9TqJRB/odHFreP8Il/zbAiJRHUPWckzmdxeU1o5IumFm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708415757, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256b5b3700 1 Processor -- start 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256b5b3700 1 -- start start 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256b5b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256b5b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25641046d0 con 0x7f2564103d80 2024-02-20T07:55:58.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256934f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256934f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48816/0 (socket says 172.21.15.123:48816) 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256934f700 1 -- 172.21.15.123:0/199221074 learned_addr learned my addr 172.21.15.123:0/199221074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256934f700 1 -- 172.21.15.123:0/199221074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564104810 con 0x7f2564103d80 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.615+0000 7f256934f700 1 --2- 172.21.15.123:0/199221074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25600098e0 tx=0x7f2560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f0c5ca6cd32790 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f255bfff700 1 -- 172.21.15.123:0/199221074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256000b860 con 0x7f2564103d80 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f255bfff700 1 -- 172.21.15.123:0/199221074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f256000be90 con 0x7f2564103d80 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f255bfff700 1 -- 172.21.15.123:0/199221074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25600103c0 con 0x7f2564103d80 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 -- 172.21.15.123:0/199221074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 msgr2=0x7f2564104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 --2- 172.21.15.123:0/199221074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25600098e0 tx=0x7f2560009250 comp rx=0 tx=0).stop 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 -- 172.21.15.123:0/199221074 shutdown_connections 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 --2- 172.21.15.123:0/199221074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f2564104190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 -- 172.21.15.123:0/199221074 >> 172.21.15.123:0/199221074 conn(0x7f25640fc580 msgr2=0x7f25640fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 -- 172.21.15.123:0/199221074 shutdown_connections 2024-02-20T07:55:58.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.616+0000 7f256b5b3700 1 -- 172.21.15.123:0/199221074 wait complete. 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256b5b3700 1 Processor -- start 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256b5b3700 1 -- start start 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256b5b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256b5b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564101a40 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256934f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256934f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48820/0 (socket says 172.21.15.123:48820) 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256934f700 1 -- 172.21.15.123:0/2736277762 learned_addr learned my addr 172.21.15.123:0/2736277762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256934f700 1 -- 172.21.15.123:0/2736277762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600094f0 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.617+0000 7f256934f700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2560006b00 tx=0x7f2560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.618+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25600109a0 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.618+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f256001a430 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.618+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2564101c40 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.618+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25600245b0 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.618+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25641020d0 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f25600247e0 con 0x7f2564103d80 2024-02-20T07:55:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f2559ffb700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 0x7f2550038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f256004a8e0 con 0x7f2564103d80 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256410b680 con 0x7f2564103d80 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f2568b4e700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 0x7f2550038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.619+0000 7f2568b4e700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 0x7f2550038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2554009990 tx=0x7f2554006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.623+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f25600189a0 con 0x7f2564103d80 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:56.833+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f256405f3e0 con 0x7f2550036830 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.059+0000 7f2559ffb700 1 -- 172.21.15.123:0/2736277762 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f256405f3e0 con 0x7f2550036830 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 msgr2=0x7f2550038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 0x7f2550038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2554009990 tx=0x7f2554006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 msgr2=0x7f25641035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2560006b00 tx=0x7f2560009250 comp rx=0 tx=0).stop 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 shutdown_connections 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2550036830 0x7f2550038ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 --2- 172.21.15.123:0/2736277762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2564103d80 0x7f25641035c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:58.222 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 >> 172.21.15.123:0/2736277762 conn(0x7f25640fc580 msgr2=0x7f25640fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:58.223 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 shutdown_connections 2024-02-20T07:55:58.223 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:57.061+0000 7f256b5b3700 1 -- 172.21.15.123:0/2736277762 wait complete. 2024-02-20T07:55:58.223 INFO:teuthology.orchestra.run.smithi123.stdout:Fetching dashboard port number... 2024-02-20T07:55:59.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:55:58 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3312242339' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 8443 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe672c87700 1 Processor -- start 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe672c87700 1 -- start start 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe672c87700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe672c87700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1030c0 con 0x7fe66c102770 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe670a23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:59.458 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe670a23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52682/0 (socket says 172.21.15.123:52682) 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.675+0000 7fe670a23700 1 -- 172.21.15.123:0/4275580113 learned_addr learned my addr 172.21.15.123:0/4275580113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.676+0000 7fe670a23700 1 -- 172.21.15.123:0/4275580113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c103200 con 0x7fe66c102770 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.676+0000 7fe670a23700 1 --2- 172.21.15.123:0/4275580113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6600098e0 tx=0x7fe660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf128c43b962ade server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.676+0000 7fe66b7fe700 1 -- 172.21.15.123:0/4275580113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe66000b860 con 0x7fe66c102770 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.676+0000 7fe66b7fe700 1 -- 172.21.15.123:0/4275580113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe66000be90 con 0x7fe66c102770 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.676+0000 7fe66b7fe700 1 -- 172.21.15.123:0/4275580113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6600103c0 con 0x7fe66c102770 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- 172.21.15.123:0/4275580113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 msgr2=0x7fe66c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 --2- 172.21.15.123:0/4275580113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6600098e0 tx=0x7fe660009250 comp rx=0 tx=0).stop 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- 172.21.15.123:0/4275580113 shutdown_connections 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 --2- 172.21.15.123:0/4275580113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c102b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- 172.21.15.123:0/4275580113 >> 172.21.15.123:0/4275580113 conn(0x7fe66c0fded0 msgr2=0x7fe66c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- 172.21.15.123:0/4275580113 shutdown_connections 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- 172.21.15.123:0/4275580113 wait complete. 2024-02-20T07:55:59.459 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 Processor -- start 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- start start 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.677+0000 7fe672c87700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c111b00 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe670a23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe670a23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52688/0 (socket says 172.21.15.123:52688) 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe670a23700 1 -- 172.21.15.123:0/3312242339 learned_addr learned my addr 172.21.15.123:0/3312242339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe670a23700 1 -- 172.21.15.123:0/3312242339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600094f0 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe670a23700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6600090b0 tx=0x7fe660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe660010840 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe660010e70 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe660024e40 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c111d00 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.678+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c1129a0 con 0x7fe66c102770 2024-02-20T07:55:59.460 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.679+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fe66001a4e0 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.679+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c05f5c0 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.679+0000 7fe6697fa700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 0x7fe65c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.679+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe66004aa30 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.679+0000 7fe66bfff700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 0x7fe65c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.680+0000 7fe66bfff700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 0x7fe65c038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe658009990 tx=0x7fe658006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.684+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe660018940 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.865+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fe66c04bed0 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.866+0000 7fe6697fa700 1 -- 172.21.15.123:0/3312242339 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fe660018350 con 0x7fe66c102770 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 msgr2=0x7fe65c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 0x7fe65c038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe658009990 tx=0x7fe658006e40 comp rx=0 tx=0).stop 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 msgr2=0x7fe66c1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6600090b0 tx=0x7fe660009250 comp rx=0 tx=0).stop 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 shutdown_connections 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe65c0367e0 0x7fe65c038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:59.461 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 --2- 172.21.15.123:0/3312242339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66c102770 0x7fe66c1115c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:55:59.462 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 >> 172.21.15.123:0/3312242339 conn(0x7fe66c0fded0 msgr2=0x7fe66c0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:55:59.462 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 shutdown_connections 2024-02-20T07:55:59.462 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:58.868+0000 7fe672c87700 1 -- 172.21.15.123:0/3312242339 wait complete. 2024-02-20T07:55:59.465 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-20T07:55:59.465 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-02-20T07:55:59.472 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-20T07:55:59.472 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-02-20T07:55:59.472 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-02-20T07:55:59.472 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph Dashboard is now available at: 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout: URL: https://smithi123.front.sepia.ceph.com:8443/ 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout: User: admin 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout: Password: bjtr0zwegs 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:55:59.474 INFO:teuthology.orchestra.run.smithi123.stdout:Saving cluster configuration to /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config directory 2024-02-20T07:55:59.475 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling autotune for osd_memory_target 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.895+0000 7f8959d71700 1 Processor -- start 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.895+0000 7f8959d71700 1 -- start start 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.895+0000 7f8959d71700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.895+0000 7f8959d71700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954101fc0 con 0x7f8954101670 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f89537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f89537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52690/0 (socket says 172.21.15.123:52690) 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f89537fe700 1 -- 172.21.15.123:0/3958876876 learned_addr learned my addr 172.21.15.123:0/3958876876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f89537fe700 1 -- 172.21.15.123:0/3958876876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954102100 con 0x7f8954101670 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f89537fe700 1 --2- 172.21.15.123:0/3958876876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f894400bb80 tx=0x7f894400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3681c4b3292b7199 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f8952ffd700 1 -- 172.21.15.123:0/3958876876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f894400dd00 con 0x7f8954101670 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f8952ffd700 1 -- 172.21.15.123:0/3958876876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f894400de60 con 0x7f8954101670 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.896+0000 7f8952ffd700 1 -- 172.21.15.123:0/3958876876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8944018920 con 0x7f8954101670 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 -- 172.21.15.123:0/3958876876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 msgr2=0x7f8954101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 --2- 172.21.15.123:0/3958876876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f894400bb80 tx=0x7f894400b4f0 comp rx=0 tx=0).stop 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 -- 172.21.15.123:0/3958876876 shutdown_connections 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 --2- 172.21.15.123:0/3958876876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954101a80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 -- 172.21.15.123:0/3958876876 >> 172.21.15.123:0/3958876876 conn(0x7f89540fcdd0 msgr2=0x7f89540ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 -- 172.21.15.123:0/3958876876 shutdown_connections 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 -- 172.21.15.123:0/3958876876 wait complete. 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.897+0000 7f8959d71700 1 Processor -- start 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8959d71700 1 -- start start 2024-02-20T07:56:00.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8959d71700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8959d71700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954113ca0 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f89537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f89537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52702/0 (socket says 172.21.15.123:52702) 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f89537fe700 1 -- 172.21.15.123:0/2429253586 learned_addr learned my addr 172.21.15.123:0/2429253586 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f89537fe700 1 -- 172.21.15.123:0/2429253586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894400b790 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f89537fe700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f89440106a0 tx=0x7f894400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f894400dc70 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8944010c30 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8954113ea0 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8944021550 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.898+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8954114b40 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.899+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f8944021810 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.899+0000 7f8950ff9700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 0x7f8940038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.899+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8944014070 con 0x7f8954101670 2024-02-20T07:56:00.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.899+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895405f5c0 con 0x7f8954101670 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.899+0000 7f894affd700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 0x7f8940038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.900+0000 7f894affd700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 0x7f8940038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f893c009990 tx=0x7f893c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.904+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8944026030 con 0x7f8954101670 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:55:59.921+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f8944020db0 con 0x7f8954101670 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.088+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f895404bed0 con 0x7f8954101670 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.088+0000 7f8950ff9700 1 -- 172.21.15.123:0/2429253586 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f89440260c0 con 0x7f8954101670 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 msgr2=0x7f8940038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 0x7f8940038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f893c009990 tx=0x7f893c006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 msgr2=0x7f8954113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f89440106a0 tx=0x7f894400b4f0 comp rx=0 tx=0).stop 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 shutdown_connections 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f8940036790 0x7f8940038c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 --2- 172.21.15.123:0/2429253586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8954101670 0x7f8954113760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:00.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 >> 172.21.15.123:0/2429253586 conn(0x7f89540fcdd0 msgr2=0x7f89541063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 shutdown_connections 2024-02-20T07:56:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:00.090+0000 7f8959d71700 1 -- 172.21.15.123:0/2429253586 wait complete. 2024-02-20T07:56:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:00 smithi123 ceph-mon[29383]: mgrmap e13: smithi123.kwyrtl(active, since 6s) 2024-02-20T07:56:01.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb49ad91700 1 Processor -- start 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb49ad91700 1 -- start start 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb49ad91700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb49ad91700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494079110 con 0x7fb494078d00 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb498b2d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb498b2d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52704/0 (socket says 172.21.15.123:52704) 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb498b2d700 1 -- 172.21.15.123:0/1860868120 learned_addr learned my addr 172.21.15.123:0/1860868120 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.020+0000 7fb498b2d700 1 -- 172.21.15.123:0/1860868120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494077750 con 0x7fb494078d00 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb498b2d700 1 --2- 172.21.15.123:0/1860868120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4880098e0 tx=0x7fb488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded19df4ac6f7cde server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb4937fe700 1 -- 172.21.15.123:0/1860868120 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb48800b860 con 0x7fb494078d00 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb4937fe700 1 -- 172.21.15.123:0/1860868120 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb48800be90 con 0x7fb494078d00 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb4937fe700 1 -- 172.21.15.123:0/1860868120 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4880103c0 con 0x7fb494078d00 2024-02-20T07:56:01.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb49ad91700 1 -- 172.21.15.123:0/1860868120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 msgr2=0x7fb494077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb49ad91700 1 --2- 172.21.15.123:0/1860868120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4880098e0 tx=0x7fb488009250 comp rx=0 tx=0).stop 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb49ad91700 1 -- 172.21.15.123:0/1860868120 shutdown_connections 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb49ad91700 1 --2- 172.21.15.123:0/1860868120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494077210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.021+0000 7fb49ad91700 1 -- 172.21.15.123:0/1860868120 >> 172.21.15.123:0/1860868120 conn(0x7fb4940fdea0 msgr2=0x7fb4941002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 -- 172.21.15.123:0/1860868120 shutdown_connections 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 -- 172.21.15.123:0/1860868120 wait complete. 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 Processor -- start 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 -- start start 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb49ad91700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494113c40 con 0x7fb494078d00 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.022+0000 7fb498b2d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb498b2d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52708/0 (socket says 172.21.15.123:52708) 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb498b2d700 1 -- 172.21.15.123:0/3954449031 learned_addr learned my addr 172.21.15.123:0/3954449031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb498b2d700 1 -- 172.21.15.123:0/3954449031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880094f0 con 0x7fb494078d00 2024-02-20T07:56:01.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb498b2d700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4880090b0 tx=0x7fb488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4880118f0 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb488010d10 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494113e40 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb488024e70 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.023+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494114ae0 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.024+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb48801a550 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.024+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49405f5c0 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.024+0000 7fb4917fa700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 0x7fb484038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.024+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb48804a750 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.024+0000 7fb493fff700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 0x7fb484038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.025+0000 7fb493fff700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 0x7fb484038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb480009990 tx=0x7fb480006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.029+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb488018db0 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.313+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fb49404bed0 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.318+0000 7fb4917fa700 1 -- 172.21.15.123:0/3954449031 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb488018350 con 0x7fb494078d00 2024-02-20T07:56:01.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 msgr2=0x7fb484038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 0x7fb484038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb480009990 tx=0x7fb480006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 msgr2=0x7fb494113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4880090b0 tx=0x7fb488009250 comp rx=0 tx=0).stop 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 shutdown_connections 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb484036830 0x7fb484038ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.320+0000 7fb49ad91700 1 --2- 172.21.15.123:0/3954449031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb494078d00 0x7fb494113700 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.321+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 >> 172.21.15.123:0/3954449031 conn(0x7fb4940fdea0 msgr2=0x7fb4940ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.321+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 shutdown_connections 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-02-20T07:56:01.321+0000 7fb49ad91700 1 -- 172.21.15.123:0/3954449031 wait complete. 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.884 INFO:teuthology.orchestra.run.smithi123.stdout:Or, if you are only running a single cluster on this host: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: ceph telemetry on 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout:For more information see: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:01.885 INFO:teuthology.orchestra.run.smithi123.stdout:Bootstrap complete. 2024-02-20T07:56:01.917 INFO:tasks.cephadm:Fetching config... 2024-02-20T07:56:01.917 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:56:01.917 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-20T07:56:01.974 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-20T07:56:01.974 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:56:01.974 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-20T07:56:02.029 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-20T07:56:02.029 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:56:02.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/keyring of=/dev/stdout 2024-02-20T07:56:02.096 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-20T07:56:02.097 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:56:02.097 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-20T07:56:02.152 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-20T07:56:02.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUicyjVhmmWg8GoPaW8HvEzK7eqeQWahkQduey3W1mcorEqDj1xm5wOFOzFWJP4BXjYbUZf4BF15qJY6hfg2vNYN7RX11hPN9hadl/zOWyAlm2bD0JgpbPTefPHxGvxJfEq9X8v8uju6rCcSWGE7RxGEOsa1AvukWzGqo2+4UN+2AWqxSK3Bm+HaxuA/S3qGjsNVX9RWQBPn97CiD+5c25+NheoS0EQMdxuuwNeFugpPODJ0lbwJPllUsgpbN8zA9bkorDO7oO3veOSsaBIdZvpcWBS707P4lIhyYoI941ZnBMWCS8UEOagLRUUGi7LBjdp7sWfj4DvTREVN+QilRXhR9h6eWIyfYGuMx8R+r+Ug2vExnNOJ+7mPMEYYGVJwFeS3wE0PEWo6/xsGdzoALINWciy4OoDr+fb8Z9k7loAnBlzENTW3heLIMZSwiAxV4TXg4G92NxrP0XmVq2/YjKerx2CpYFjwhHtEODEqPyPeulqSOvM4whZURoIe+dW68= ceph-1f99de10-cfc5-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-20T07:56:02.233 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUicyjVhmmWg8GoPaW8HvEzK7eqeQWahkQduey3W1mcorEqDj1xm5wOFOzFWJP4BXjYbUZf4BF15qJY6hfg2vNYN7RX11hPN9hadl/zOWyAlm2bD0JgpbPTefPHxGvxJfEq9X8v8uju6rCcSWGE7RxGEOsa1AvukWzGqo2+4UN+2AWqxSK3Bm+HaxuA/S3qGjsNVX9RWQBPn97CiD+5c25+NheoS0EQMdxuuwNeFugpPODJ0lbwJPllUsgpbN8zA9bkorDO7oO3veOSsaBIdZvpcWBS707P4lIhyYoI941ZnBMWCS8UEOagLRUUGi7LBjdp7sWfj4DvTREVN+QilRXhR9h6eWIyfYGuMx8R+r+Ug2vExnNOJ+7mPMEYYGVJwFeS3wE0PEWo6/xsGdzoALINWciy4OoDr+fb8Z9k7loAnBlzENTW3heLIMZSwiAxV4TXg4G92NxrP0XmVq2/YjKerx2CpYFjwhHtEODEqPyPeulqSOvM4whZURoIe+dW68= ceph-1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:56:02.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUicyjVhmmWg8GoPaW8HvEzK7eqeQWahkQduey3W1mcorEqDj1xm5wOFOzFWJP4BXjYbUZf4BF15qJY6hfg2vNYN7RX11hPN9hadl/zOWyAlm2bD0JgpbPTefPHxGvxJfEq9X8v8uju6rCcSWGE7RxGEOsa1AvukWzGqo2+4UN+2AWqxSK3Bm+HaxuA/S3qGjsNVX9RWQBPn97CiD+5c25+NheoS0EQMdxuuwNeFugpPODJ0lbwJPllUsgpbN8zA9bkorDO7oO3veOSsaBIdZvpcWBS707P4lIhyYoI941ZnBMWCS8UEOagLRUUGi7LBjdp7sWfj4DvTREVN+QilRXhR9h6eWIyfYGuMx8R+r+Ug2vExnNOJ+7mPMEYYGVJwFeS3wE0PEWo6/xsGdzoALINWciy4OoDr+fb8Z9k7loAnBlzENTW3heLIMZSwiAxV4TXg4G92NxrP0XmVq2/YjKerx2CpYFjwhHtEODEqPyPeulqSOvM4whZURoIe+dW68= ceph-1f99de10-cfc5-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-20T07:56:02.293 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUicyjVhmmWg8GoPaW8HvEzK7eqeQWahkQduey3W1mcorEqDj1xm5wOFOzFWJP4BXjYbUZf4BF15qJY6hfg2vNYN7RX11hPN9hadl/zOWyAlm2bD0JgpbPTefPHxGvxJfEq9X8v8uju6rCcSWGE7RxGEOsa1AvukWzGqo2+4UN+2AWqxSK3Bm+HaxuA/S3qGjsNVX9RWQBPn97CiD+5c25+NheoS0EQMdxuuwNeFugpPODJ0lbwJPllUsgpbN8zA9bkorDO7oO3veOSsaBIdZvpcWBS707P4lIhyYoI941ZnBMWCS8UEOagLRUUGi7LBjdp7sWfj4DvTREVN+QilRXhR9h6eWIyfYGuMx8R+r+Ug2vExnNOJ+7mPMEYYGVJwFeS3wE0PEWo6/xsGdzoALINWciy4OoDr+fb8Z9k7loAnBlzENTW3heLIMZSwiAxV4TXg4G92NxrP0XmVq2/YjKerx2CpYFjwhHtEODEqPyPeulqSOvM4whZURoIe+dW68= ceph-1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:56:02.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-20T07:56:02.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:02 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3954449031' entity='client.admin' 2024-02-20T07:56:02.559 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 -- 172.21.15.123:0/482487783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 msgr2=0x7f10780fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 --2- 172.21.15.123:0/482487783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f10780fbed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f106c0048c0 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 -- 172.21.15.123:0/482487783 shutdown_connections 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 --2- 172.21.15.123:0/482487783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f10780fbed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 -- 172.21.15.123:0/482487783 >> 172.21.15.123:0/482487783 conn(0x7f10780f71a0 msgr2=0x7f10780f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 -- 172.21.15.123:0/482487783 shutdown_connections 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.594+0000 7f107db9d700 1 -- 172.21.15.123:0/482487783 wait complete. 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f107db9d700 1 Processor -- start 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f107db9d700 1 -- start start 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f107db9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f107db9d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1078066810 con 0x7f10780fbac0 2024-02-20T07:56:04.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f10777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f10777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52728/0 (socket says 172.21.15.123:52728) 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f10777fe700 1 -- 172.21.15.123:0/371147580 learned_addr learned my addr 172.21.15.123:0/371147580 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.595+0000 7f10777fe700 1 -- 172.21.15.123:0/371147580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10780fbac0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f10777fe700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f106c009680 tx=0x7f106c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f106c00bed0 con 0x7f10780fbac0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1078066a10 con 0x7f10780fbac0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f106c00b5c0 con 0x7f10780fbac0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f106c01c5b0 con 0x7f10780fbac0 2024-02-20T07:56:04.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.596+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1078110330 con 0x7f10780fbac0 2024-02-20T07:56:04.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f106c01c820 con 0x7f10780fbac0 2024-02-20T07:56:04.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f105ffff700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 0x7f1060038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:04.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f106c049af0 con 0x7f10780fbac0 2024-02-20T07:56:04.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f1076ffd700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 0x7f1060038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:04.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1078105890 con 0x7f10780fbac0 2024-02-20T07:56:04.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.597+0000 7f1076ffd700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 0x7f1060038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1068009990 tx=0x7f1068006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:04.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.607+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f106c023300 con 0x7f10780fbac0 2024-02-20T07:56:04.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.796+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1078101880 con 0x7f10780fbac0 2024-02-20T07:56:04.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.803+0000 7f105ffff700 1 -- 172.21.15.123:0/371147580 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f106c011b60 con 0x7f10780fbac0 2024-02-20T07:56:04.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 msgr2=0x7f1060038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:04.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 0x7f1060038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1068009990 tx=0x7f1068006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 msgr2=0x7f107810fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f106c009680 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 shutdown_connections 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f1060036820 0x7f1060038cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 --2- 172.21.15.123:0/371147580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10780fbac0 0x7f107810fbb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.804+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 >> 172.21.15.123:0/371147580 conn(0x7f10780f71a0 msgr2=0x7f10780f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.806+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 shutdown_connections 2024-02-20T07:56:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:04.806+0000 7f107db9d700 1 -- 172.21.15.123:0/371147580 wait complete. 2024-02-20T07:56:05.677 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: Deploying daemon crash.smithi123 on smithi123 2024-02-20T07:56:05.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:05 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/371147580' entity='client.admin' 2024-02-20T07:56:05.703 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-20T07:56:05.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-20T07:56:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 -- 172.21.15.123:0/1431337212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 msgr2=0x7feb040fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 --2- 172.21.15.123:0/1431337212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb040fcfe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feaf40048c0 tx=0x7feaf4009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 -- 172.21.15.123:0/1431337212 shutdown_connections 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 --2- 172.21.15.123:0/1431337212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb040fcfe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 -- 172.21.15.123:0/1431337212 >> 172.21.15.123:0/1431337212 conn(0x7feb040f8270 msgr2=0x7feb040fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 -- 172.21.15.123:0/1431337212 shutdown_connections 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.894+0000 7feb08b8d700 1 -- 172.21.15.123:0/1431337212 wait complete. 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb08b8d700 1 Processor -- start 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb08b8d700 1 -- start start 2024-02-20T07:56:08.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb08b8d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb08b8d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0410d430 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb0259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb0259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43564/0 (socket says 172.21.15.123:43564) 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.895+0000 7feb0259c700 1 -- 172.21.15.123:0/3097858304 learned_addr learned my addr 172.21.15.123:0/3097858304 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feb0259c700 1 -- 172.21.15.123:0/3097858304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4005040 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feb0259c700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009680 tx=0x7feaf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaf400bed0 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0410d630 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feaf400b5c0 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaf401c5b0 con 0x7feb040fcbd0 2024-02-20T07:56:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.896+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0410e2d0 con 0x7feb040fcbd0 2024-02-20T07:56:08.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.897+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7feaf401c7d0 con 0x7feb040fcbd0 2024-02-20T07:56:08.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.897+0000 7feaf2ffd700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 0x7feaec038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:08.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.897+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae40052e0 con 0x7feb040fcbd0 2024-02-20T07:56:08.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.897+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feaf404ab90 con 0x7feb040fcbd0 2024-02-20T07:56:08.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.897+0000 7feb01d9b700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 0x7feaec038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:08.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.898+0000 7feb01d9b700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 0x7feaec038d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009990 tx=0x7feaf8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:08.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:08.902+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7feaf4011dd0 con 0x7feb040fcbd0 2024-02-20T07:56:09.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.100+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7feae4000bf0 con 0x7feaec0368c0 2024-02-20T07:56:09.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.103+0000 7feaf2ffd700 1 -- 172.21.15.123:0/3097858304 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feae4000bf0 con 0x7feaec0368c0 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 msgr2=0x7feaec038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 0x7feaec038d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009990 tx=0x7feaf8006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 msgr2=0x7feb0410cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009680 tx=0x7feaf4009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 shutdown_connections 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7feaec0368c0 0x7feaec038d70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 --2- 172.21.15.123:0/3097858304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040fcbd0 0x7feb0410cef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 >> 172.21.15.123:0/3097858304 conn(0x7feb040f8270 msgr2=0x7feb040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 shutdown_connections 2024-02-20T07:56:09.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:09.105+0000 7feb08b8d700 1 -- 172.21.15.123:0/3097858304 wait complete. 2024-02-20T07:56:09.868 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-02-20T07:56:09.868 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:56:09.868 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-02-20T07:56:09.886 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:56:09.886 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:56:09.944 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-02-20T07:56:09.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch host add smithi194 2024-02-20T07:56:10.218 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:56:10.362 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:56:10.362 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:10.362 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:10.362 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:10.362 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:10.363 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:10.363 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:10 smithi123 ceph-mon[29383]: Deploying daemon node-exporter.smithi123 on smithi123 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 -- 172.21.15.123:0/9613262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 msgr2=0x7f29ac0fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 --2- 172.21.15.123:0/9613262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac0fbee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f299c0048c0 tx=0x7f299c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 -- 172.21.15.123:0/9613262 shutdown_connections 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 --2- 172.21.15.123:0/9613262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac0fbee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 -- 172.21.15.123:0/9613262 >> 172.21.15.123:0/9613262 conn(0x7f29ac0f7190 msgr2=0x7f29ac0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 -- 172.21.15.123:0/9613262 shutdown_connections 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 -- 172.21.15.123:0/9613262 wait complete. 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.634+0000 7f29b266c700 1 Processor -- start 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29b266c700 1 -- start start 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29b266c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29b266c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac10d400 con 0x7f29ac0fbad0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43588/0 (socket says 172.21.15.123:43588) 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29abfff700 1 -- 172.21.15.123:0/328197055 learned_addr learned my addr 172.21.15.123:0/328197055 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29abfff700 1 -- 172.21.15.123:0/328197055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c005040 con 0x7f29ac0fbad0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29abfff700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f299c009680 tx=0x7f299c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f299c00bed0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f299c00b5c0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac10d600 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f299c01c5b0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.635+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac10e2a0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.636+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f299c01c820 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.636+0000 7f29a97fa700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 0x7f2998038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.636+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac05f5c0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.636+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f299c049ba0 con 0x7f29ac0fbad0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.636+0000 7f29a3fff700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 0x7f2998038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.637+0000 7f29a3fff700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 0x7f2998038cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2994009990 tx=0x7f2994006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.641+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f299c013420 con 0x7f29ac0fbad0 2024-02-20T07:56:11.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:11.841+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f29ac10ee30 con 0x7f2998036820 2024-02-20T07:56:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:11 smithi123 ceph-mon[29383]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:56:13.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:12 smithi123 ceph-mon[29383]: Deploying cephadm binary to smithi194 2024-02-20T07:56:13.974 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-02-20T07:56:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.973+0000 7f29a97fa700 1 -- 172.21.15.123:0/328197055 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f29ac10ee30 con 0x7f2998036820 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.975+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 msgr2=0x7f2998038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.975+0000 7f29b266c700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 0x7f2998038cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2994009990 tx=0x7f2994006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 msgr2=0x7f29ac10cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f299c009680 tx=0x7f299c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 shutdown_connections 2024-02-20T07:56:13.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2998036820 0x7f2998038cd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 --2- 172.21.15.123:0/328197055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29ac0fbad0 0x7f29ac10cec0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 >> 172.21.15.123:0/328197055 conn(0x7f29ac0f7190 msgr2=0x7f29ac065960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 shutdown_connections 2024-02-20T07:56:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:13.976+0000 7f29b266c700 1 -- 172.21.15.123:0/328197055 wait complete. 2024-02-20T07:56:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:14 smithi123 ceph-mon[29383]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:14 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:14 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:14.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch host ls --format=json 2024-02-20T07:56:15.292 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:56:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:15 smithi123 ceph-mon[29383]: Added host smithi194 2024-02-20T07:56:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:15 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:15 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:15 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:15 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 -- 172.21.15.123:0/1888884905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 msgr2=0x7fb3a00fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 --2- 172.21.15.123:0/1888884905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a00fbed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3900048c0 tx=0x7fb390009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 -- 172.21.15.123:0/1888884905 shutdown_connections 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 --2- 172.21.15.123:0/1888884905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a00fbed0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 -- 172.21.15.123:0/1888884905 >> 172.21.15.123:0/1888884905 conn(0x7fb3a00f71a0 msgr2=0x7fb3a00f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 -- 172.21.15.123:0/1888884905 shutdown_connections 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.698+0000 7fb3a6562700 1 -- 172.21.15.123:0/1888884905 wait complete. 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb3a6562700 1 Processor -- start 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb3a6562700 1 -- start start 2024-02-20T07:56:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb3a6562700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb3a6562700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a010d420 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb39ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb39ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43604/0 (socket says 172.21.15.123:43604) 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.699+0000 7fb39ffff700 1 -- 172.21.15.123:0/922976193 learned_addr learned my addr 172.21.15.123:0/922976193 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb39ffff700 1 -- 172.21.15.123:0/922976193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390005040 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb39ffff700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb390009680 tx=0x7fb390009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb39000bed0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a010d620 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb39000b5c0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb39001c5b0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.700+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a010e2c0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb39001c820 con 0x7fb3a00fbac0 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a005f5c0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb39cff9700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 0x7fb388038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb390049af0 con 0x7fb3a00fbac0 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb39f7fe700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 0x7fb388038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.701+0000 7fb39f7fe700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 0x7fb388038cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb394009990 tx=0x7fb394006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.706+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb390023300 con 0x7fb3a00fbac0 2024-02-20T07:56:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.937+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3a010eea0 con 0x7fb388036820 2024-02-20T07:56:16.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.938+0000 7fb39cff9700 1 -- 172.21.15.123:0/922976193 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fb3a010eea0 con 0x7fb388036820 2024-02-20T07:56:16.939 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T07:56:16.940 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 msgr2=0x7fb388038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 0x7fb388038cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb394009990 tx=0x7fb394006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 msgr2=0x7fb3a010cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb390009680 tx=0x7fb390009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 shutdown_connections 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fb388036820 0x7fb388038cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 --2- 172.21.15.123:0/922976193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3a00fbac0 0x7fb3a010cee0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.940+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 >> 172.21.15.123:0/922976193 conn(0x7fb3a00f71a0 msgr2=0x7fb3a00663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:16.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.941+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 shutdown_connections 2024-02-20T07:56:16.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:16.941+0000 7fb3a6562700 1 -- 172.21.15.123:0/922976193 wait complete. 2024-02-20T07:56:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:16 smithi123 ceph-mon[29383]: Deploying daemon alertmanager.smithi123 on smithi123 2024-02-20T07:56:17.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:16 smithi123 ceph-mon[29383]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:17.523 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-20T07:56:17.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd crush tunables default 2024-02-20T07:56:17.776 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:56:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:18 smithi123 ceph-mon[29383]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-20T07:56:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:18 smithi123 ceph-mon[29383]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:18 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:20.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 -- 172.21.15.123:0/3319970176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 msgr2=0x7f40980fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 --2- 172.21.15.123:0/3319970176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f40980fcfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40880048c0 tx=0x7f4088009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 -- 172.21.15.123:0/3319970176 shutdown_connections 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 --2- 172.21.15.123:0/3319970176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f40980fcfd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 -- 172.21.15.123:0/3319970176 >> 172.21.15.123:0/3319970176 conn(0x7f40980f82a0 msgr2=0x7f40980fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 -- 172.21.15.123:0/3319970176 shutdown_connections 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.036+0000 7f409d0b2700 1 -- 172.21.15.123:0/3319970176 wait complete. 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f409d0b2700 1 Processor -- start 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f409d0b2700 1 -- start start 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f409d0b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f409d0b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409810f5e0 con 0x7f40980fcbc0 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f4096d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f4096d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53096/0 (socket says 172.21.15.123:53096) 2024-02-20T07:56:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f4096d9d700 1 -- 172.21.15.123:0/2582827173 learned_addr learned my addr 172.21.15.123:0/2582827173 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f4096d9d700 1 -- 172.21.15.123:0/2582827173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088005040 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.037+0000 7f4096d9d700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4088009680 tx=0x7f4088009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f408800bed0 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409810f7e0 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f408800b5c0 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f408801c5b0 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098110480 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.038+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f408801c820 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.039+0000 7f407f7fe700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 0x7f4080038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.039+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409805f5c0 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.039+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4088049a90 con 0x7f40980fcbc0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.039+0000 7f409659c700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 0x7f4080038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.039+0000 7f409659c700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 0x7f4080038cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f408c009990 tx=0x7f408c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:20.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.044+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4088023300 con 0x7f40980fcbc0 2024-02-20T07:56:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.241+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4098110fa0 con 0x7f40980fcbc0 2024-02-20T07:56:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.822+0000 7f407f7fe700 1 -- 172.21.15.123:0/2582827173 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4088011b60 con 0x7f40980fcbc0 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 msgr2=0x7f4080038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 0x7f4080038cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f408c009990 tx=0x7f408c006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 msgr2=0x7f409810f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4088009680 tx=0x7f4088009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 shutdown_connections 2024-02-20T07:56:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4080036820 0x7f4080038cd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 --2- 172.21.15.123:0/2582827173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40980fcbc0 0x7f409810f0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 >> 172.21.15.123:0/2582827173 conn(0x7f40980f82a0 msgr2=0x7f40980fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 shutdown_connections 2024-02-20T07:56:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:56:20.824+0000 7f409d0b2700 1 -- 172.21.15.123:0/2582827173 wait complete. 2024-02-20T07:56:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-02-20T07:56:21.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:20 smithi123 ceph-mon[29383]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:21.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:20 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2582827173' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-20T07:56:22.170 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:21 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2582827173' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-20T07:56:22.170 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:21 smithi123 ceph-mon[29383]: osdmap e4: 0 total, 0 up, 0 in 2024-02-20T07:56:22.194 INFO:tasks.cephadm:Adding mon.smithi123 on smithi123 2024-02-20T07:56:22.194 INFO:tasks.cephadm:Adding mon.smithi194 on smithi194 2024-02-20T07:56:22.194 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch apply mon '2;smithi123:172.21.15.123=smithi123;smithi194:172.21.15.194=smithi194' 2024-02-20T07:56:22.446 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:22.497 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:23.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:22 smithi123 ceph-mon[29383]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.937+0000 7f51f3198700 1 -- 172.21.15.194:0/136188316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 msgr2=0x7f51ec0fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.937+0000 7f51f3198700 1 --2- 172.21.15.194:0/136188316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec0fcfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51e00048c0 tx=0x7f51e0009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.937+0000 7f51f3198700 1 -- 172.21.15.194:0/136188316 shutdown_connections 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.937+0000 7f51f3198700 1 --2- 172.21.15.194:0/136188316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec0fcfd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.937+0000 7f51f3198700 1 -- 172.21.15.194:0/136188316 >> 172.21.15.194:0/136188316 conn(0x7f51ec0f82a0 msgr2=0x7f51ec0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 -- 172.21.15.194:0/136188316 shutdown_connections 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 -- 172.21.15.194:0/136188316 wait complete. 2024-02-20T07:56:23.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 Processor -- start 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 -- start start 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f3198700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec10d3d0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f0f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.938+0000 7f51f0f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47670/0 (socket says 172.21.15.194:47670) 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51f0f34700 1 -- 172.21.15.194:0/3340331689 learned_addr learned my addr 172.21.15.194:0/3340331689 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51f0f34700 1 -- 172.21.15.194:0/3340331689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0005040 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51f0f34700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009680 tx=0x7f51e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51e000bed0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51e000b5c0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec10d5d0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51e001c5b0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.939+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec10e270 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.940+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f51e001c7d0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.940+0000 7f51e97fa700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 0x7f51dc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:23.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.940+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f51e0049c90 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.940+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec05f5c0 con 0x7f51ec0fcbc0 2024-02-20T07:56:23.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.941+0000 7f51ebfff700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 0x7f51dc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:23.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.941+0000 7f51ebfff700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 0x7f51dc038d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009990 tx=0x7f51d8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:23.945+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f51e0023300 con 0x7f51ec0fcbc0 2024-02-20T07:56:24.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.134+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 --> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi123:172.21.15.123=smithi123;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f51ec10ee40 con 0x7f51dc036870 2024-02-20T07:56:24.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.141+0000 7f51e97fa700 1 -- 172.21.15.194:0/3340331689 <== mgr.14162 v2:172.21.15.123:6800/41210014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f51ec10ee40 con 0x7f51dc036870 2024-02-20T07:56:24.142 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.142+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 msgr2=0x7f51dc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.142+0000 7f51f3198700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 0x7f51dc038d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009990 tx=0x7f51d8006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.142+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 msgr2=0x7f51ec10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.142+0000 7f51f3198700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009680 tx=0x7f51e0009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 shutdown_connections 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f51dc036870 0x7f51dc038d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 --2- 172.21.15.194:0/3340331689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0fcbc0 0x7f51ec10ce90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:24.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 >> 172.21.15.194:0/3340331689 conn(0x7f51ec0f82a0 msgr2=0x7f51ec0f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:24.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 shutdown_connections 2024-02-20T07:56:24.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:24.143+0000 7f51f3198700 1 -- 172.21.15.194:0/3340331689 wait complete. 2024-02-20T07:56:24.739 DEBUG:teuthology.orchestra.run.smithi194:mon.smithi194> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi194.service 2024-02-20T07:56:24.744 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:24.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:24.991 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:24 smithi123 ceph-mon[29383]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:24.991 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:24 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:25.017 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:25.064 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi123:172.21.15.123=smithi123;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: Saving service mon spec with placement smithi123:172.21.15.123=smithi123;smithi194:172.21.15.194=smithi194;count:2 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-20T07:56:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:25 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078791307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 msgr2=0x7fa49c0fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078791307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c0fcfe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0048c0 tx=0x7fa48c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078791307 shutdown_connections 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078791307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c0fcfe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078791307 >> 172.21.15.194:0/2078791307 conn(0x7fa49c0f8290 msgr2=0x7fa49c0fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078791307 shutdown_connections 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078791307 wait complete. 2024-02-20T07:56:26.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 Processor -- start 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- start start 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.469+0000 7fa4a3aad700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c10d400 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a1849700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a1849700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47686/0 (socket says 172.21.15.194:47686) 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a1849700 1 -- 172.21.15.194:0/2078526669 learned_addr learned my addr 172.21.15.194:0/2078526669 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:26.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a1849700 1 -- 172.21.15.194:0/2078526669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c005040 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a1849700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009680 tx=0x7fa48c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:26.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa48c00bed0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa48c00b5c0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c10d600 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa48c01c5b0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.470+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c10e2a0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.471+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa48c013420 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.471+0000 7fa4927fc700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 0x7fa488038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.471+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c05f5c0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.471+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa48c049b90 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.471+0000 7fa4a1048700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 0x7fa488038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:26.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.472+0000 7fa4a1048700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 0x7fa488038cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa498009990 tx=0x7fa498006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:26.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.476+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa48c013a80 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.728+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa49c10edf0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.729+0000 7fa4927fc700 1 -- 172.21.15.194:0/2078526669 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa48c02b6d0 con 0x7fa49c0fcbd0 2024-02-20T07:56:26.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:26.730 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 msgr2=0x7fa488038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 0x7fa488038cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa498009990 tx=0x7fa498006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 msgr2=0x7fa49c10cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009680 tx=0x7fa48c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 shutdown_connections 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fa488036820 0x7fa488038cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 --2- 172.21.15.194:0/2078526669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa49c0fcbd0 0x7fa49c10cec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 >> 172.21.15.194:0/2078526669 conn(0x7fa49c0f8290 msgr2=0x7fa49c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 shutdown_connections 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:26.731+0000 7fa4a3aad700 1 -- 172.21.15.194:0/2078526669 wait complete. 2024-02-20T07:56:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:27.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:26 smithi123 ceph-mon[29383]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:26 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-20T07:56:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:26 smithi123 ceph-mon[29383]: Deploying daemon grafana.smithi123 on smithi123 2024-02-20T07:56:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:26 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2078526669' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:28.257 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:28.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:28.502 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:28.549 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:29.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:28 smithi123 ceph-mon[29383]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:29.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:28 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 -- 172.21.15.194:0/1652429796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 msgr2=0x7f6e180fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 --2- 172.21.15.194:0/1652429796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e180fbee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e080048c0 tx=0x7f6e08009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 -- 172.21.15.194:0/1652429796 shutdown_connections 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 --2- 172.21.15.194:0/1652429796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e180fbee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 -- 172.21.15.194:0/1652429796 >> 172.21.15.194:0/1652429796 conn(0x7f6e180f7190 msgr2=0x7f6e180f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 -- 172.21.15.194:0/1652429796 shutdown_connections 2024-02-20T07:56:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.977+0000 7f6e20783700 1 -- 172.21.15.194:0/1652429796 wait complete. 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e20783700 1 Processor -- start 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e20783700 1 -- start start 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e20783700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e20783700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1810d400 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e1e51f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e1e51f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47708/0 (socket says 172.21.15.194:47708) 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e1e51f700 1 -- 172.21.15.194:0/3984011248 learned_addr learned my addr 172.21.15.194:0/3984011248 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e1e51f700 1 -- 172.21.15.194:0/3984011248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08005040 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.978+0000 7f6e1e51f700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009680 tx=0x7f6e08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0800bed0 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1810d600 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e0800b5c0 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0801c5b0 con 0x7f6e180fbad0 2024-02-20T07:56:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1810e2a0 con 0x7f6e180fbad0 2024-02-20T07:56:29.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.979+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f6e08013420 con 0x7f6e180fbad0 2024-02-20T07:56:29.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.980+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1805f5c0 con 0x7f6e180fbad0 2024-02-20T07:56:29.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.980+0000 7f6e0effd700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 0x7f6e04038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:29.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.980+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6e08049ba0 con 0x7f6e180fbad0 2024-02-20T07:56:29.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.980+0000 7f6e1dd1e700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 0x7f6e04038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:29.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.980+0000 7f6e1dd1e700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 0x7f6e04038cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009990 tx=0x7f6e14006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:29.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:29.985+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6e08025400 con 0x7f6e180fbad0 2024-02-20T07:56:30.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.241+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e1810edf0 con 0x7f6e180fbad0 2024-02-20T07:56:30.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.241+0000 7f6e0effd700 1 -- 172.21.15.194:0/3984011248 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6e08004d30 con 0x7f6e180fbad0 2024-02-20T07:56:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:30.242 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:30.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 msgr2=0x7f6e04038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:30.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 0x7f6e04038cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009990 tx=0x7f6e14006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:30.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 msgr2=0x7f6e1810cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:30.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009680 tx=0x7f6e08009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:30.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 shutdown_connections 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f6e04036820 0x7f6e04038cd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 --2- 172.21.15.194:0/3984011248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e180fbad0 0x7f6e1810cec0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 >> 172.21.15.194:0/3984011248 conn(0x7f6e180f7190 msgr2=0x7f6e18065960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 shutdown_connections 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:30.243+0000 7f6e20783700 1 -- 172.21.15.194:0/3984011248 wait complete. 2024-02-20T07:56:30.244 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:30 smithi123 ceph-mon[29383]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:30 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3984011248' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:31.778 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:31.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:32.027 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:32.084 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:33.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:32 smithi123 ceph-mon[29383]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- 172.21.15.194:0/3747033296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 msgr2=0x7f2da00fc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 --2- 172.21.15.194:0/3747033296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da00fc4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d900048c0 tx=0x7f2d90009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- 172.21.15.194:0/3747033296 shutdown_connections 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 --2- 172.21.15.194:0/3747033296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da00fc4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- 172.21.15.194:0/3747033296 >> 172.21.15.194:0/3747033296 conn(0x7f2da00f69c0 msgr2=0x7f2da00f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- 172.21.15.194:0/3747033296 shutdown_connections 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- 172.21.15.194:0/3747033296 wait complete. 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 Processor -- start 2024-02-20T07:56:33.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.422+0000 7f2da4c44700 1 -- start start 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2da4c44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2da4c44700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00fba00 con 0x7f2da00fc0d0 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d9e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d9e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47736/0 (socket says 172.21.15.194:47736) 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d9e59c700 1 -- 172.21.15.194:0/2933388312 learned_addr learned my addr 172.21.15.194:0/2933388312 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d9e59c700 1 -- 172.21.15.194:0/2933388312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90005040 con 0x7f2da00fc0d0 2024-02-20T07:56:33.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d9e59c700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009300 tx=0x7f2d90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d90004e60 con 0x7f2da00fc0d0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00fbc00 con 0x7f2da00fc0d0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d90009680 con 0x7f2da00fc0d0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d9001c5b0 con 0x7f2da00fc0d0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.423+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da0110390 con 0x7f2da00fc0d0 2024-02-20T07:56:33.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.424+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f2d90013420 con 0x7f2da00fc0d0 2024-02-20T07:56:33.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.424+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0105800 con 0x7f2da00fc0d0 2024-02-20T07:56:33.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.424+0000 7f2d8effd700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 0x7f2d88038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:33.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.424+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2d90049b30 con 0x7f2da00fc0d0 2024-02-20T07:56:33.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.425+0000 7f2d9dd9b700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 0x7f2d88038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:33.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.425+0000 7f2d9dd9b700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 0x7f2d88038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009990 tx=0x7f2d94006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:33.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.433+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2d90013980 con 0x7f2da00fc0d0 2024-02-20T07:56:33.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.685+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2da004bed0 con 0x7f2da00fc0d0 2024-02-20T07:56:33.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.686+0000 7f2d8effd700 1 -- 172.21.15.194:0/2933388312 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2d90011370 con 0x7f2da00fc0d0 2024-02-20T07:56:33.687 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:33.687 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:33.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 msgr2=0x7f2d88038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:33.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 0x7f2d88038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009990 tx=0x7f2d94006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:33.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 msgr2=0x7f2da010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:33.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009300 tx=0x7f2d90009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:33.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 shutdown_connections 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d88036870 0x7f2d88038d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 --2- 172.21.15.194:0/2933388312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2da00fc0d0 0x7f2da010fc10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 >> 172.21.15.194:0/2933388312 conn(0x7f2da00f69c0 msgr2=0x7f2da00f7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 shutdown_connections 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:33.688+0000 7f2da4c44700 1 -- 172.21.15.194:0/2933388312 wait complete. 2024-02-20T07:56:33.690 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:33 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2933388312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:35.193 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:35.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:34 smithi123 ceph-mon[29383]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:35.444 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:35.493 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:36.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 -- 172.21.15.194:0/2587406812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 msgr2=0x7fedf4070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:36.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/2587406812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf4070380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fede40048c0 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 -- 172.21.15.194:0/2587406812 shutdown_connections 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/2587406812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf4070380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 -- 172.21.15.194:0/2587406812 >> 172.21.15.194:0/2587406812 conn(0x7fedf40f8330 msgr2=0x7fedf40fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 -- 172.21.15.194:0/2587406812 shutdown_connections 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.804+0000 7fedf9ef0700 1 -- 172.21.15.194:0/2587406812 wait complete. 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf9ef0700 1 Processor -- start 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf9ef0700 1 -- start start 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf9ef0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf9ef0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf410f650 con 0x7fedf4071e70 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:54330/0 (socket says 172.21.15.194:54330) 2024-02-20T07:56:36.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf37fe700 1 -- 172.21.15.194:0/3352860283 learned_addr learned my addr 172.21.15.194:0/3352860283 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.805+0000 7fedf37fe700 1 -- 172.21.15.194:0/3352860283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fedf4071e70 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedf37fe700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fede4009b80 tx=0x7fede4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fede400b5c0 con 0x7fedf4071e70 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fede400be70 con 0x7fedf4071e70 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf410f850 con 0x7fedf4071e70 2024-02-20T07:56:36.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fede401c660 con 0x7fedf4071e70 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.806+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf41104f0 con 0x7fedf4071e70 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fede4013420 con 0x7fedf4071e70 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf405f5c0 con 0x7fedf4071e70 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedebfff700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 0x7fede0038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fede4049a60 con 0x7fedf4071e70 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedf2ffd700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 0x7fede0038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.807+0000 7fedf2ffd700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 0x7fede0038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feddc009990 tx=0x7feddc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:36.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:36.812+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fede4013b10 con 0x7fedf4071e70 2024-02-20T07:56:37.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.063+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fedf404bed0 con 0x7fedf4071e70 2024-02-20T07:56:37.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.064+0000 7fedebfff700 1 -- 172.21.15.194:0/3352860283 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fede4011370 con 0x7fedf4071e70 2024-02-20T07:56:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 msgr2=0x7fede0038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 0x7fede0038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feddc009990 tx=0x7feddc006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 msgr2=0x7fedf410f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fede4009b80 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 shutdown_connections 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fede0036870 0x7fede0038d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:37.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 --2- 172.21.15.194:0/3352860283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedf4071e70 0x7fedf410f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:37.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 >> 172.21.15.194:0/3352860283 conn(0x7fedf40f8330 msgr2=0x7fedf40f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:37.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 shutdown_connections 2024-02-20T07:56:37.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:37.066+0000 7fedf9ef0700 1 -- 172.21.15.194:0/3352860283 wait complete. 2024-02-20T07:56:37.068 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:36 smithi123 ceph-mon[29383]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:37 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3352860283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:38.687 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:38.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:38.935 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:38.983 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:39.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:38 smithi123 ceph-mon[29383]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:40.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- 172.21.15.194:0/1702511373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 msgr2=0x7f2c700fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:40.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/1702511373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c700fb290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0048c0 tx=0x7f2c6c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- 172.21.15.194:0/1702511373 shutdown_connections 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/1702511373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c700fb290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- 172.21.15.194:0/1702511373 >> 172.21.15.194:0/1702511373 conn(0x7f2c700f6920 msgr2=0x7f2c700f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- 172.21.15.194:0/1702511373 shutdown_connections 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- 172.21.15.194:0/1702511373 wait complete. 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 Processor -- start 2024-02-20T07:56:40.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- start start 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c77ffd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7010d420 con 0x7f2c700fae80 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.258+0000 7f2c75d99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c75d99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:54346/0 (socket says 172.21.15.194:54346) 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c75d99700 1 -- 172.21.15.194:0/2630055125 learned_addr learned my addr 172.21.15.194:0/2630055125 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c75d99700 1 -- 172.21.15.194:0/2630055125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c005040 con 0x7f2c700fae80 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c75d99700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c000c00 tx=0x7f2c6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:40.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c6c00b5c0 con 0x7f2c700fae80 2024-02-20T07:56:40.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c6c00be70 con 0x7f2c700fae80 2024-02-20T07:56:40.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7010d620 con 0x7f2c700fae80 2024-02-20T07:56:40.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c6c01c590 con 0x7f2c700fae80 2024-02-20T07:56:40.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.259+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7010e2c0 con 0x7f2c700fae80 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.260+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f2c6c01c850 con 0x7f2c700fae80 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.260+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7005f5c0 con 0x7f2c700fae80 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.260+0000 7f2c667fc700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 0x7f2c5c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.260+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2c6c049b60 con 0x7f2c700fae80 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.260+0000 7f2c75598700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 0x7f2c5c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:40.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.261+0000 7f2c75598700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 0x7f2c5c038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009990 tx=0x7f2c60006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:40.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.265+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2c6c025400 con 0x7f2c700fae80 2024-02-20T07:56:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.517+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2c7010ee10 con 0x7f2c700fae80 2024-02-20T07:56:40.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.518+0000 7f2c667fc700 1 -- 172.21.15.194:0/2630055125 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2c6c011370 con 0x7f2c700fae80 2024-02-20T07:56:40.519 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:40.519 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 msgr2=0x7f2c5c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 0x7f2c5c038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009990 tx=0x7f2c60006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 msgr2=0x7f2c7010cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c000c00 tx=0x7f2c6c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 shutdown_connections 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2c5c036870 0x7f2c5c038d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 --2- 172.21.15.194:0/2630055125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c700fae80 0x7f2c7010cee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 >> 172.21.15.194:0/2630055125 conn(0x7f2c700f6920 msgr2=0x7f2c700f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 shutdown_connections 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:40.520+0000 7f2c77ffd700 1 -- 172.21.15.194:0/2630055125 wait complete. 2024-02-20T07:56:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:40 smithi123 ceph-mon[29383]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2630055125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:42.081 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:42.081 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:42.332 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:42.380 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:42 smithi123 ceph-mon[29383]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:43.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 -- 172.21.15.194:0/3460253620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 msgr2=0x7f2d380fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3460253620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d380fcfe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d280048c0 tx=0x7f2d28009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 -- 172.21.15.194:0/3460253620 shutdown_connections 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3460253620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d380fcfe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 -- 172.21.15.194:0/3460253620 >> 172.21.15.194:0/3460253620 conn(0x7f2d380f8290 msgr2=0x7f2d380fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 -- 172.21.15.194:0/3460253620 shutdown_connections 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.848+0000 7f2d3e104700 1 -- 172.21.15.194:0/3460253620 wait complete. 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d3e104700 1 Processor -- start 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d3e104700 1 -- start start 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d3e104700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d3e104700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3810d410 con 0x7f2d380fcbd0 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:53364/0 (socket says 172.21.15.194:53364) 2024-02-20T07:56:43.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.849+0000 7f2d377fe700 1 -- 172.21.15.194:0/3177526614 learned_addr learned my addr 172.21.15.194:0/3177526614 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d377fe700 1 -- 172.21.15.194:0/3177526614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28005040 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d377fe700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009b80 tx=0x7f2d28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d2800b5c0 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d2800be70 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3810d610 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d2801c660 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.850+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3810e2b0 con 0x7f2d380fcbd0 2024-02-20T07:56:43.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f2d2801c8d0 con 0x7f2d380fcbd0 2024-02-20T07:56:43.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3805f5c0 con 0x7f2d380fcbd0 2024-02-20T07:56:43.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d1ffff700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 0x7f2d20038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:43.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2d28049bb0 con 0x7f2d380fcbd0 2024-02-20T07:56:43.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d36ffd700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 0x7f2d20038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:43.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.851+0000 7f2d36ffd700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 0x7f2d20038d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009990 tx=0x7f2d2c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:43.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:43.856+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2d28011550 con 0x7f2d380fcbd0 2024-02-20T07:56:44.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.110+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2d3810ee00 con 0x7f2d380fcbd0 2024-02-20T07:56:44.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.110+0000 7f2d1ffff700 1 -- 172.21.15.194:0/3177526614 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2d28011370 con 0x7f2d380fcbd0 2024-02-20T07:56:44.112 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:44.112 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:44.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 msgr2=0x7f2d20038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:44.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 0x7f2d20038d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009990 tx=0x7f2d2c006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:44.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 msgr2=0x7f2d3810ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009b80 tx=0x7f2d28009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 shutdown_connections 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f2d20036870 0x7f2d20038d20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 --2- 172.21.15.194:0/3177526614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d380fcbd0 0x7f2d3810ced0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 >> 172.21.15.194:0/3177526614 conn(0x7f2d380f8290 msgr2=0x7f2d380f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 shutdown_connections 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:44.112+0000 7f2d3e104700 1 -- 172.21.15.194:0/3177526614 wait complete. 2024-02-20T07:56:44.114 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:44 smithi123 ceph-mon[29383]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:44 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3177526614' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:45.649 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:45.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:45.891 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:45.938 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:46 smithi123 ceph-mon[29383]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- 172.21.15.194:0/254883866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 msgr2=0x7ff7700fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 --2- 172.21.15.194:0/254883866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fb2b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7600048c0 tx=0x7ff760009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- 172.21.15.194:0/254883866 shutdown_connections 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 --2- 172.21.15.194:0/254883866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fb2b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- 172.21.15.194:0/254883866 >> 172.21.15.194:0/254883866 conn(0x7ff7700f6920 msgr2=0x7ff7700f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- 172.21.15.194:0/254883866 shutdown_connections 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- 172.21.15.194:0/254883866 wait complete. 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 Processor -- start 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.419+0000 7ff7766fa700 1 -- start start 2024-02-20T07:56:47.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff7766fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:47.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff7766fa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700fbe40 con 0x7ff7700faea0 2024-02-20T07:56:47.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:47.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:53378/0 (socket says 172.21.15.194:53378) 2024-02-20T07:56:47.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76ffff700 1 -- 172.21.15.194:0/4012307967 learned_addr learned my addr 172.21.15.194:0/4012307967 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76ffff700 1 -- 172.21.15.194:0/4012307967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760005040 con 0x7ff7700faea0 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76ffff700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff760009330 tx=0x7ff760009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff760004e60 con 0x7ff7700faea0 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700fc040 con 0x7ff7700faea0 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700fc530 con 0x7ff7700faea0 2024-02-20T07:56:47.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7600096b0 con 0x7ff7700faea0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.420+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7600255c0 con 0x7ff7700faea0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.421+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff760013420 con 0x7ff7700faea0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.421+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770106950 con 0x7ff7700faea0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.421+0000 7ff76cff9700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 0x7ff758038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.421+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff760049bb0 con 0x7ff7700faea0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.422+0000 7ff76f7fe700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 0x7ff758038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:47.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.422+0000 7ff76f7fe700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 0x7ff758038d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff764009990 tx=0x7ff764006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:47.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.426+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff7600123c0 con 0x7ff7700faea0 2024-02-20T07:56:47.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.682+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff770102940 con 0x7ff7700faea0 2024-02-20T07:56:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.682+0000 7ff76cff9700 1 -- 172.21.15.194:0/4012307967 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff760023300 con 0x7ff7700faea0 2024-02-20T07:56:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:47.684 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 msgr2=0x7ff758038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 0x7ff758038d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff764009990 tx=0x7ff764006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 msgr2=0x7ff7700fd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff760009330 tx=0x7ff760009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 shutdown_connections 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7ff758036870 0x7ff758038d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 --2- 172.21.15.194:0/4012307967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700faea0 0x7ff7700fd9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.684+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 >> 172.21.15.194:0/4012307967 conn(0x7ff7700f6920 msgr2=0x7ff7700f76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.685+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 shutdown_connections 2024-02-20T07:56:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:47.685+0000 7ff7766fa700 1 -- 172.21.15.194:0/4012307967 wait complete. 2024-02-20T07:56:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:47 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/4012307967' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:48 smithi123 ceph-mon[29383]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:49.279 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:49.279 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:49.526 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:49.573 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:51.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 -- 172.21.15.194:0/1823592644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 msgr2=0x7fe7e40fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1823592644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e40fcfe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c60 tx=0x7fe7dc004d10 comp rx=0 tx=0).stop 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 -- 172.21.15.194:0/1823592644 shutdown_connections 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1823592644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e40fcfe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 -- 172.21.15.194:0/1823592644 >> 172.21.15.194:0/1823592644 conn(0x7fe7e40f8270 msgr2=0x7fe7e40fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 -- 172.21.15.194:0/1823592644 shutdown_connections 2024-02-20T07:56:51.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.098+0000 7fe7e924a700 1 -- 172.21.15.194:0/1823592644 wait complete. 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e924a700 1 Processor -- start 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e924a700 1 -- start start 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e924a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e924a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e410d400 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:51.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:53402/0 (socket says 172.21.15.194:53402) 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e2d9d700 1 -- 172.21.15.194:0/1645099839 learned_addr learned my addr 172.21.15.194:0/1645099839 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.099+0000 7fe7e2d9d700 1 -- 172.21.15.194:0/1645099839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc009940 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7e2d9d700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0097d0 tx=0x7fe7dc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7dc01d440 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e410d600 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7dc01da70 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7dc012a10 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.100+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e410e2a0 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fe7dc019040 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e405f5c0 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7db7fe700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 0x7fe7d0038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe7dc04a4c0 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7e259c700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 0x7fe7d0038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:51.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.101+0000 7fe7e259c700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 0x7fe7d0038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009990 tx=0x7fe7cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:51.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.106+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe7dc02e530 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:50 smithi123 ceph-mon[29383]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:51.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.365+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe7e410ed90 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.366+0000 7fe7db7fe700 1 -- 172.21.15.194:0/1645099839 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe7dc017070 con 0x7fe7e40fcbd0 2024-02-20T07:56:51.367 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:51.367 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 msgr2=0x7fe7d0038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 0x7fe7d0038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009990 tx=0x7fe7cc006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 msgr2=0x7fe7e410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0097d0 tx=0x7fe7dc004d10 comp rx=0 tx=0).stop 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 shutdown_connections 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fe7d0036870 0x7fe7d0038d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 --2- 172.21.15.194:0/1645099839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e40fcbd0 0x7fe7e410cec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 >> 172.21.15.194:0/1645099839 conn(0x7fe7e40f8270 msgr2=0x7fe7e40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 shutdown_connections 2024-02-20T07:56:51.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:51.368+0000 7fe7e924a700 1 -- 172.21.15.194:0/1645099839 wait complete. 2024-02-20T07:56:51.370 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:52.202 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:51 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/1645099839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:52.871 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:52.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:53.081 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:52 smithi123 ceph-mon[29383]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:53.119 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:53.165 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:54.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 -- 172.21.15.194:0/2743277414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 msgr2=0x7f91800fc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:54.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 --2- 172.21.15.194:0/2743277414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f91800fc360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f917c0048c0 tx=0x7f917c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:54.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 -- 172.21.15.194:0/2743277414 shutdown_connections 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 --2- 172.21.15.194:0/2743277414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f91800fc360 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 -- 172.21.15.194:0/2743277414 >> 172.21.15.194:0/2743277414 conn(0x7f91800f6920 msgr2=0x7f91800f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 -- 172.21.15.194:0/2743277414 shutdown_connections 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.603+0000 7f9187323700 1 -- 172.21.15.194:0/2743277414 wait complete. 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f9187323700 1 Processor -- start 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f9187323700 1 -- start start 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f9187323700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f9187323700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180113a50 con 0x7f91800fbf50 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f91850bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f91850bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:44684/0 (socket says 172.21.15.194:44684) 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f91850bf700 1 -- 172.21.15.194:0/3018994209 learned_addr learned my addr 172.21.15.194:0/3018994209 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f91850bf700 1 -- 172.21.15.194:0/3018994209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c005040 con 0x7f91800fbf50 2024-02-20T07:56:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.604+0000 7f91850bf700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f917c009300 tx=0x7f917c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f917c004e60 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f917c009680 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f917c01c5b0 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9180113c50 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91801148f0 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.605+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f917c013420 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.606+0000 7f9175ffb700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 0x7f916c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.606+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f917c049a50 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.606+0000 7f91848be700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 0x7f916c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.606+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918005f5c0 con 0x7f91800fbf50 2024-02-20T07:56:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.606+0000 7f91848be700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 0x7f916c038d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:54.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.611+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f917c013980 con 0x7f91800fbf50 2024-02-20T07:56:54.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.866+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9180115300 con 0x7f91800fbf50 2024-02-20T07:56:54.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.867+0000 7f9175ffb700 1 -- 172.21.15.194:0/3018994209 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f917c011370 con 0x7f91800fbf50 2024-02-20T07:56:54.868 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:54.868 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 msgr2=0x7f916c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 0x7f916c038d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 msgr2=0x7f9180113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f917c009300 tx=0x7f917c009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 shutdown_connections 2024-02-20T07:56:54.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f916c036870 0x7f916c038d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:54.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 --2- 172.21.15.194:0/3018994209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91800fbf50 0x7f9180113510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:54.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 >> 172.21.15.194:0/3018994209 conn(0x7f91800f6920 msgr2=0x7f91800fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:54.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 shutdown_connections 2024-02-20T07:56:54.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:54.869+0000 7f9187323700 1 -- 172.21.15.194:0/3018994209 wait complete. 2024-02-20T07:56:54.871 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:55.151 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:54 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:56.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:55 smithi123 ceph-mon[29383]: Deploying daemon prometheus.smithi123 on smithi123 2024-02-20T07:56:56.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:55 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3018994209' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:56.376 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:56.376 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:56:56.628 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:56.675 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:56:57.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:56 smithi123 ceph-mon[29383]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:58.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 -- 172.21.15.194:0/644662055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 msgr2=0x7f71b00fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:58.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 --2- 172.21.15.194:0/644662055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b00fbed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71a00048c0 tx=0x7f71a0009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:58.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 -- 172.21.15.194:0/644662055 shutdown_connections 2024-02-20T07:56:58.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 --2- 172.21.15.194:0/644662055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b00fbed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:58.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 -- 172.21.15.194:0/644662055 >> 172.21.15.194:0/644662055 conn(0x7f71b00f71a0 msgr2=0x7f71b00f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:58.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 -- 172.21.15.194:0/644662055 shutdown_connections 2024-02-20T07:56:58.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.101+0000 7f71b54b3700 1 -- 172.21.15.194:0/644662055 wait complete. 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.102+0000 7f71b54b3700 1 Processor -- start 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.102+0000 7f71b54b3700 1 -- start start 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.102+0000 7f71b54b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.102+0000 7f71b54b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b010c370 con 0x7f71b00fbac0 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71aeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71aeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:44708/0 (socket says 172.21.15.194:44708) 2024-02-20T07:56:58.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71aeffd700 1 -- 172.21.15.194:0/2618070359 learned_addr learned my addr 172.21.15.194:0/2618070359 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71aeffd700 1 -- 172.21.15.194:0/2618070359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0005040 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71aeffd700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009b80 tx=0x7f71a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a000b5c0 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71a000be70 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b010c570 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a001c660 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.103+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b010d130 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.104+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f71a001c7c0 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.104+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b004bed0 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.104+0000 7f71977fe700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 0x7f7198038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.104+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f71a0049bb0 con 0x7f71b00fbac0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.105+0000 7f71ae7fc700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 0x7f7198038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:56:58.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.105+0000 7f71ae7fc700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 0x7f7198038d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009990 tx=0x7f71a4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:56:58.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.109+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f71a0013420 con 0x7f71b00fbac0 2024-02-20T07:56:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.364+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71b0101880 con 0x7f71b00fbac0 2024-02-20T07:56:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.365+0000 7f71977fe700 1 -- 172.21.15.194:0/2618070359 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f71a0011370 con 0x7f71b00fbac0 2024-02-20T07:56:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:56:58.366 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:56:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 msgr2=0x7f7198038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 0x7f7198038d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009990 tx=0x7f71a4006e40 comp rx=0 tx=0).stop 2024-02-20T07:56:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 msgr2=0x7f71b010be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:56:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009b80 tx=0x7f71a0009e30 comp rx=0 tx=0).stop 2024-02-20T07:56:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 shutdown_connections 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f71980368c0 0x7f7198038d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 --2- 172.21.15.194:0/2618070359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b00fbac0 0x7f71b010be30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 >> 172.21.15.194:0/2618070359 conn(0x7f71b00f71a0 msgr2=0x7f71b00f7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 shutdown_connections 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:56:58.367+0000 7f71b54b3700 1 -- 172.21.15.194:0/2618070359 wait complete. 2024-02-20T07:56:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:56:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:58 smithi123 ceph-mon[29383]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:56:59.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:58 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2618070359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:56:59.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:56:58 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:56:59.855 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:56:59.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:00.104 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:00.150 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:01.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:00 smithi123 ceph-mon[29383]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:01.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- 172.21.15.194:0/2703217898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 msgr2=0x7f4edc0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2703217898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc0fbed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0048c0 tx=0x7f4ecc009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- 172.21.15.194:0/2703217898 shutdown_connections 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2703217898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc0fbed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- 172.21.15.194:0/2703217898 >> 172.21.15.194:0/2703217898 conn(0x7f4edc0f71a0 msgr2=0x7f4edc0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- 172.21.15.194:0/2703217898 shutdown_connections 2024-02-20T07:57:01.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- 172.21.15.194:0/2703217898 wait complete. 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 Processor -- start 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.610+0000 7f4ee466e700 1 -- start start 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee466e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee466e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc10d420 con 0x7f4edc0fbac0 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee240a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee240a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:44730/0 (socket says 172.21.15.194:44730) 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee240a700 1 -- 172.21.15.194:0/2680142349 learned_addr learned my addr 172.21.15.194:0/2680142349 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:01.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee240a700 1 -- 172.21.15.194:0/2680142349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc005040 con 0x7f4edc0fbac0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.611+0000 7f4ee240a700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009680 tx=0x7f4ecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc00bed0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc10d620 con 0x7f4edc0fbac0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ecc00b5c0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc01c5b0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc10e2c0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f4ecc013420 con 0x7f4edc0fbac0 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.612+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc05f5c0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.613+0000 7f4ed2ffd700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 0x7f4ec8038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.613+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4ecc049ba0 con 0x7f4edc0fbac0 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.613+0000 7f4ee1c09700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 0x7f4ec8038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:01.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.613+0000 7f4ee1c09700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 0x7f4ec8038cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009990 tx=0x7f4ed8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:01.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.617+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4ecc025400 con 0x7f4edc0fbac0 2024-02-20T07:57:01.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.872+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4edc10e640 con 0x7f4edc0fbac0 2024-02-20T07:57:01.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.873+0000 7f4ed2ffd700 1 -- 172.21.15.194:0/2680142349 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4ecc004d30 con 0x7f4edc0fbac0 2024-02-20T07:57:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:01.874 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 msgr2=0x7f4ec8038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 0x7f4ec8038cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009990 tx=0x7f4ed8006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 msgr2=0x7f4edc10cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009680 tx=0x7f4ecc009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 shutdown_connections 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f4ec8036820 0x7f4ec8038cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 --2- 172.21.15.194:0/2680142349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4edc0fbac0 0x7f4edc10cee0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.875+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 >> 172.21.15.194:0/2680142349 conn(0x7f4edc0f71a0 msgr2=0x7f4edc0f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.876+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 shutdown_connections 2024-02-20T07:57:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:01.876+0000 7f4ee466e700 1 -- 172.21.15.194:0/2680142349 wait complete. 2024-02-20T07:57:01.878 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:03.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:02 smithi123 ceph-mon[29383]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:03.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:02 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2680142349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:03.445 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:03.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:03.702 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:03.750 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 -- 172.21.15.194:0/1701984042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 msgr2=0x7f7a980fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1701984042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a980fbed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0048c0 tx=0x7f7a8c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 -- 172.21.15.194:0/1701984042 shutdown_connections 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1701984042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a980fbed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 -- 172.21.15.194:0/1701984042 >> 172.21.15.194:0/1701984042 conn(0x7f7a980f71a0 msgr2=0x7f7a980f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 -- 172.21.15.194:0/1701984042 shutdown_connections 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.167+0000 7f7a9d188700 1 -- 172.21.15.194:0/1701984042 wait complete. 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a9d188700 1 Processor -- start 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a9d188700 1 -- start start 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a9d188700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:05.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a9d188700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9810d410 con 0x7f7a980fbac0 2024-02-20T07:57:05.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a96d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:05.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a96d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:33366/0 (socket says 172.21.15.194:33366) 2024-02-20T07:57:05.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.168+0000 7f7a96d9d700 1 -- 172.21.15.194:0/1343824540 learned_addr learned my addr 172.21.15.194:0/1343824540 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:05.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a96d9d700 1 -- 172.21.15.194:0/1343824540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c005040 con 0x7f7a980fbac0 2024-02-20T07:57:05.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a96d9d700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009680 tx=0x7f7a8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:05.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a8c00bed0 con 0x7f7a980fbac0 2024-02-20T07:57:05.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9810d610 con 0x7f7a980fbac0 2024-02-20T07:57:05.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9810e2b0 con 0x7f7a980fbac0 2024-02-20T07:57:05.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a8c00b5c0 con 0x7f7a980fbac0 2024-02-20T07:57:05.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.169+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a8c0255c0 con 0x7f7a980fbac0 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.170+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f7a8c01c3f0 con 0x7f7a980fbac0 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.170+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9805f5c0 con 0x7f7a980fbac0 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.170+0000 7f7a7f7fe700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 0x7f7a80038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.170+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7a8c049c50 con 0x7f7a980fbac0 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.171+0000 7f7a9659c700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 0x7f7a80038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:05.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.171+0000 7f7a9659c700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 0x7f7a80038d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009990 tx=0x7f7a88006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:05.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.175+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7a8c01a8e0 con 0x7f7a980fbac0 2024-02-20T07:57:05.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:04 smithi123 ceph-mon[29383]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:05.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.426+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7a9804bed0 con 0x7f7a980fbac0 2024-02-20T07:57:05.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.427+0000 7f7a7f7fe700 1 -- 172.21.15.194:0/1343824540 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7a8c01a2f0 con 0x7f7a980fbac0 2024-02-20T07:57:05.428 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:05.428 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:05.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 msgr2=0x7f7a80038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:05.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 0x7f7a80038d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009990 tx=0x7f7a88006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:05.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 msgr2=0x7f7a9810ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:05.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009680 tx=0x7f7a8c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 shutdown_connections 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f7a80036870 0x7f7a80038d20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 --2- 172.21.15.194:0/1343824540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a980fbac0 0x7f7a9810ced0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 >> 172.21.15.194:0/1343824540 conn(0x7f7a980f71a0 msgr2=0x7f7a98066410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 shutdown_connections 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:05.429+0000 7f7a9d188700 1 -- 172.21.15.194:0/1343824540 wait complete. 2024-02-20T07:57:05.431 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:05 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/1343824540' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:06.996 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:06.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:07.248 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:07.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:06 smithi123 ceph-mon[29383]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:07.295 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 -- 172.21.15.194:0/1438274584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 msgr2=0x7f98380fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 --2- 172.21.15.194:0/1438274584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f98380fcfd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f982c0048c0 tx=0x7f982c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 -- 172.21.15.194:0/1438274584 shutdown_connections 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 --2- 172.21.15.194:0/1438274584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f98380fcfd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 -- 172.21.15.194:0/1438274584 >> 172.21.15.194:0/1438274584 conn(0x7f98380f82a0 msgr2=0x7f98380fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 -- 172.21.15.194:0/1438274584 shutdown_connections 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.731+0000 7f983dd37700 1 -- 172.21.15.194:0/1438274584 wait complete. 2024-02-20T07:57:08.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f983dd37700 1 Processor -- start 2024-02-20T07:57:08.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f983dd37700 1 -- start start 2024-02-20T07:57:08.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f983dd37700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:08.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f983dd37700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98380702e0 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f98377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f98377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:33394/0 (socket says 172.21.15.194:33394) 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.732+0000 7f98377fe700 1 -- 172.21.15.194:0/4015306676 learned_addr learned my addr 172.21.15.194:0/4015306676 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f98377fe700 1 -- 172.21.15.194:0/4015306676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c005040 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f98377fe700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f982c009680 tx=0x7f982c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c00bed0 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98380704e0 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f982c00b5c0 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c01c5b0 con 0x7f98380fcbc0 2024-02-20T07:57:08.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.733+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98380709d0 con 0x7f98380fcbc0 2024-02-20T07:57:08.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.734+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9838106990 con 0x7f98380fcbc0 2024-02-20T07:57:08.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.734+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f982c013420 con 0x7f98380fcbc0 2024-02-20T07:57:08.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.734+0000 7f981ffff700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 0x7f9820038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:08.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.734+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f982c049ba0 con 0x7f98380fcbc0 2024-02-20T07:57:08.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.735+0000 7f9836ffd700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 0x7f9820038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:08.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.735+0000 7f9836ffd700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 0x7f9820038cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9828009990 tx=0x7f9828006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:08.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.739+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f982c025400 con 0x7f98380fcbc0 2024-02-20T07:57:08.912 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:08 smithi123 ceph-mon[29383]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:09.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.999+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f983804bed0 con 0x7f98380fcbc0 2024-02-20T07:57:09.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:08.999+0000 7f981ffff700 1 -- 172.21.15.194:0/4015306676 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f982c004d30 con 0x7f98380fcbc0 2024-02-20T07:57:09.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:09.001 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:09.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 msgr2=0x7f9820038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 0x7f9820038cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9828009990 tx=0x7f9828006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 msgr2=0x7f9838071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f982c009680 tx=0x7f982c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 shutdown_connections 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f9820036820 0x7f9820038cd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 --2- 172.21.15.194:0/4015306676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98380fcbc0 0x7f9838071e60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.001+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 >> 172.21.15.194:0/4015306676 conn(0x7f98380f82a0 msgr2=0x7f98380f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.002+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 shutdown_connections 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:09.002+0000 7f983dd37700 1 -- 172.21.15.194:0/4015306676 wait complete. 2024-02-20T07:57:09.003 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:09 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/4015306676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:10.587 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:10.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:10.836 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:10.882 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:10 smithi123 ceph-mon[29383]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 -- 172.21.15.194:0/2723974434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 msgr2=0x7fcae0070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 --2- 172.21.15.194:0/2723974434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae0070380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0048c0 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 -- 172.21.15.194:0/2723974434 shutdown_connections 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 --2- 172.21.15.194:0/2723974434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae0070380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 -- 172.21.15.194:0/2723974434 >> 172.21.15.194:0/2723974434 conn(0x7fcae00f82a0 msgr2=0x7fcae00fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:12.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 -- 172.21.15.194:0/2723974434 shutdown_connections 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 -- 172.21.15.194:0/2723974434 wait complete. 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.190+0000 7fcae845e700 1 Processor -- start 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae845e700 1 -- start start 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae845e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae845e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01139f0 con 0x7fcae0071f10 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae61fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae61fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:33410/0 (socket says 172.21.15.194:33410) 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae61fa700 1 -- 172.21.15.194:0/1260116149 learned_addr learned my addr 172.21.15.194:0/1260116149 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae61fa700 1 -- 172.21.15.194:0/1260116149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc005040 con 0x7fcae0071f10 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.191+0000 7fcae61fa700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009680 tx=0x7fcadc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcadc00b5c0 con 0x7fcae0071f10 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcadc004e60 con 0x7fcae0071f10 2024-02-20T07:57:12.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae0113bf0 con 0x7fcae0071f10 2024-02-20T07:57:12.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcadc01c590 con 0x7fcae0071f10 2024-02-20T07:57:12.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0114890 con 0x7fcae0071f10 2024-02-20T07:57:12.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7fcadc01c810 con 0x7fcae0071f10 2024-02-20T07:57:12.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.192+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae005f5c0 con 0x7fcae0071f10 2024-02-20T07:57:12.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.193+0000 7fcad6ffd700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 0x7fcacc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:12.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.193+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcadc049e50 con 0x7fcae0071f10 2024-02-20T07:57:12.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.193+0000 7fcae59f9700 1 -- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 msgr2=0x7fcacc038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/41210014 2024-02-20T07:57:12.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.193+0000 7fcae59f9700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 0x7fcacc038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:57:12.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.197+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcadc023300 con 0x7fcae0071f10 2024-02-20T07:57:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:11 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:11 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:11 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:11 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-20T07:57:12.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:11 smithi123 ceph-mon[29383]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:12.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.394+0000 7fcae59f9700 1 -- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 msgr2=0x7fcacc038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/41210014 2024-02-20T07:57:12.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.394+0000 7fcae59f9700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 0x7fcacc038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:57:12.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.455+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcae01153e0 con 0x7fcae0071f10 2024-02-20T07:57:12.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.455+0000 7fcad6ffd700 1 -- 172.21.15.194:0/1260116149 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fcadc011b60 con 0x7fcae0071f10 2024-02-20T07:57:12.457 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:12.457 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 msgr2=0x7fcacc038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 0x7fcacc038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 msgr2=0x7fcae01134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009680 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 shutdown_connections 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7fcacc0368c0 0x7fcacc038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:12.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 --2- 172.21.15.194:0/1260116149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae0071f10 0x7fcae01134b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:12.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.457+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 >> 172.21.15.194:0/1260116149 conn(0x7fcae00f82a0 msgr2=0x7fcae00f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:12.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.458+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 shutdown_connections 2024-02-20T07:57:12.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:12.458+0000 7fcae845e700 1 -- 172.21.15.194:0/1260116149 wait complete. 2024-02-20T07:57:12.460 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:13.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:12 smithi123 ceph-mon[29383]: from='mgr.14162 172.21.15.123:0/1397909768' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-20T07:57:13.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:12 smithi123 ceph-mon[29383]: mgrmap e14: smithi123.kwyrtl(active, since 78s) 2024-02-20T07:57:13.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:12 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/1260116149' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:14.050 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:14.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:14.311 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:14.357 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 -- 172.21.15.194:0/978215192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 msgr2=0x7f22800fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 --2- 172.21.15.194:0/978215192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f22800fcfe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f227c0048c0 tx=0x7f227c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 -- 172.21.15.194:0/978215192 shutdown_connections 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 --2- 172.21.15.194:0/978215192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f22800fcfe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 -- 172.21.15.194:0/978215192 >> 172.21.15.194:0/978215192 conn(0x7f22800f8290 msgr2=0x7f22800fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 -- 172.21.15.194:0/978215192 shutdown_connections 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.736+0000 7f22885d4700 1 -- 172.21.15.194:0/978215192 wait complete. 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f22885d4700 1 Processor -- start 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f22885d4700 1 -- start start 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f22885d4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:15.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f22885d4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228010d400 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2286370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2286370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47348/0 (socket says 172.21.15.194:47348) 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2286370700 1 -- 172.21.15.194:0/3851736037 learned_addr learned my addr 172.21.15.194:0/3851736037 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2286370700 1 -- 172.21.15.194:0/3851736037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c005040 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2286370700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f227c009680 tx=0x7f227c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f227c00bed0 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f227c00b5c0 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228010d600 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.737+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f227c01c5b0 con 0x7f22800fcbd0 2024-02-20T07:57:15.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.738+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228010e2a0 con 0x7f22800fcbd0 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.738+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f227c01c820 con 0x7f22800fcbd0 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.738+0000 7f2276ffd700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 0x7f226c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.738+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228005f5c0 con 0x7f22800fcbd0 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.738+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f227c049bf0 con 0x7f22800fcbd0 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.739+0000 7f2285b6f700 1 -- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 msgr2=0x7f226c038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/41210014 2024-02-20T07:57:15.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.739+0000 7f2285b6f700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 0x7f226c038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:57:15.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.743+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f227c025920 con 0x7f22800fcbd0 2024-02-20T07:57:15.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.940+0000 7f2285b6f700 1 -- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 msgr2=0x7f226c038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/41210014 2024-02-20T07:57:15.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:15.940+0000 7f2285b6f700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 0x7f226c038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-20T07:57:16.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.000+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f228010ee10 con 0x7f22800fcbd0 2024-02-20T07:57:16.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.000+0000 7f2276ffd700 1 -- 172.21.15.194:0/3851736037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f227c034090 con 0x7f22800fcbd0 2024-02-20T07:57:16.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:16.002 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 msgr2=0x7f226c038d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:57:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 0x7f226c038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 msgr2=0x7f228010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f227c009680 tx=0x7f227c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 shutdown_connections 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:6800/41210014,v1:172.21.15.123:6801/41210014] conn(0x7f226c036870 0x7f226c038d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 --2- 172.21.15.194:0/3851736037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22800fcbd0 0x7f228010cec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 >> 172.21.15.194:0/3851736037 conn(0x7f22800f8290 msgr2=0x7f22800f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 shutdown_connections 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:16.002+0000 7f22885d4700 1 -- 172.21.15.194:0/3851736037 wait complete. 2024-02-20T07:57:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:16 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3851736037' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:17.553 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:17.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:17.796 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:17.844 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:18.483 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: Active manager daemon smithi123.kwyrtl restarted 2024-02-20T07:57:18.617 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: Activating manager daemon smithi123.kwyrtl 2024-02-20T07:57:18.617 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: osdmap e5: 0 total, 0 up, 0 in 2024-02-20T07:57:18.617 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: mgrmap e15: smithi123.kwyrtl(active, starting, since 0.00296744s) 2024-02-20T07:57:18.617 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:57:18.617 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:57:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- 172.21.15.194:0/4045557494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 msgr2=0x7ff7380fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 --2- 172.21.15.194:0/4045557494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff7380fb2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0048c0 tx=0x7ff72c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- 172.21.15.194:0/4045557494 shutdown_connections 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 --2- 172.21.15.194:0/4045557494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff7380fb2b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- 172.21.15.194:0/4045557494 >> 172.21.15.194:0/4045557494 conn(0x7ff7380f6920 msgr2=0x7ff7380f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- 172.21.15.194:0/4045557494 shutdown_connections 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- 172.21.15.194:0/4045557494 wait complete. 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 Processor -- start 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.493+0000 7ff73cd06700 1 -- start start 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73cd06700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73cd06700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73810d450 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:47366/0 (socket says 172.21.15.194:47366) 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73659c700 1 -- 172.21.15.194:0/3453884836 learned_addr learned my addr 172.21.15.194:0/3453884836 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73659c700 1 -- 172.21.15.194:0/3453884836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c005040 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff73659c700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009b80 tx=0x7ff72c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.494+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff72c009620 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.495+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73810d650 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.495+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff72c009780 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.495+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff72c01c5b0 con 0x7ff7380faea0 2024-02-20T07:57:19.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.495+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73810e2f0 con 0x7ff7380faea0 2024-02-20T07:57:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.495+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 43289+0+0 (secure 0 0 0) 0x7ff72c013420 con 0x7ff7380faea0 2024-02-20T07:57:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.496+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73805f5c0 con 0x7ff7380faea0 2024-02-20T07:57:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.496+0000 7ff726ffd700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 0x7ff720038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.496+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff72c0498b0 con 0x7ff7380faea0 2024-02-20T07:57:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.496+0000 7ff735d9b700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 0x7ff720038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.496+0000 7ff735d9b700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 0x7ff720038bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff728009990 tx=0x7ff728006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.501+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff72c0139f0 con 0x7ff7380faea0 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:19 smithi123 ceph-mon[29383]: mgrmap e16: smithi123.kwyrtl(active, since 1.0049s) 2024-02-20T07:57:19.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.772+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff73810ee40 con 0x7ff7380faea0 2024-02-20T07:57:19.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.773+0000 7ff726ffd700 1 -- 172.21.15.194:0/3453884836 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff72c017200 con 0x7ff7380faea0 2024-02-20T07:57:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:19.773 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 msgr2=0x7ff720038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 0x7ff720038bb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff728009990 tx=0x7ff728006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 msgr2=0x7ff73810cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009b80 tx=0x7ff72c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 shutdown_connections 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff720036700 0x7ff720038bb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 --2- 172.21.15.194:0/3453884836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380faea0 0x7ff73810cf10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 >> 172.21.15.194:0/3453884836 conn(0x7ff7380f6920 msgr2=0x7ff7380f76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:19.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 shutdown_connections 2024-02-20T07:57:19.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:19.775+0000 7ff73cd06700 1 -- 172.21.15.194:0/3453884836 wait complete. 2024-02-20T07:57:19.776 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: [20/Feb/2024:07:57:19] ENGINE Bus STARTING 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: [20/Feb/2024:07:57:19] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: [20/Feb/2024:07:57:19] ENGINE Bus STARTED 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3453884836' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:20 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:21.388 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:21.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:21.641 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:22.127 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:22 smithi123 ceph-mon[29383]: mgrmap e17: smithi123.kwyrtl(active, since 2s) 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 -- 172.21.15.194:0/4137577218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 msgr2=0x7f07840fd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 --2- 172.21.15.194:0/4137577218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840fd4a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07740048c0 tx=0x7f0774009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 -- 172.21.15.194:0/4137577218 shutdown_connections 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 --2- 172.21.15.194:0/4137577218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840fd4a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 -- 172.21.15.194:0/4137577218 >> 172.21.15.194:0/4137577218 conn(0x7f07840f6920 msgr2=0x7f07840f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:24.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 -- 172.21.15.194:0/4137577218 shutdown_connections 2024-02-20T07:57:24.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.193+0000 7f078a9a0700 1 -- 172.21.15.194:0/4137577218 wait complete. 2024-02-20T07:57:24.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.194+0000 7f078a9a0700 1 Processor -- start 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.194+0000 7f078a9a0700 1 -- start start 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.194+0000 7f078a9a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.194+0000 7f078a9a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07840f6ec0 con 0x7f07840fd090 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0783fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0783fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:45902/0 (socket says 172.21.15.194:45902) 2024-02-20T07:57:24.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0783fff700 1 -- 172.21.15.194:0/1292915499 learned_addr learned my addr 172.21.15.194:0/1292915499 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0783fff700 1 -- 172.21.15.194:0/1292915499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774005040 con 0x7f07840fd090 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0783fff700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0774009680 tx=0x7f0774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f077400bed0 con 0x7f07840fd090 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07840f70c0 con 0x7f07840fd090 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f077400b5c0 con 0x7f07840fd090 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f077401c5b0 con 0x7f07840fd090 2024-02-20T07:57:24.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.195+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07840f75b0 con 0x7f07840fd090 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.196+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07841068a0 con 0x7f07840fd090 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.196+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f0774013420 con 0x7f07840fd090 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.197+0000 7f0780ff9700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 0x7f076c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.197+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0774049d60 con 0x7f07840fd090 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.197+0000 7f07837fe700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 0x7f076c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:24.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.197+0000 7f07837fe700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 0x7f076c038dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0778009990 tx=0x7f0778006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:24.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.202+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0774011550 con 0x7f07840fd090 2024-02-20T07:57:24.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.454+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f078404bed0 con 0x7f07840fd090 2024-02-20T07:57:24.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.455+0000 7f0780ff9700 1 -- 172.21.15.194:0/1292915499 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0774004d30 con 0x7f07840fd090 2024-02-20T07:57:24.456 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:24.456 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 msgr2=0x7f076c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 0x7f076c038dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0778009990 tx=0x7f0778006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 msgr2=0x7f07840f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0774009680 tx=0x7f0774009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 shutdown_connections 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f076c036910 0x7f076c038dc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 --2- 172.21.15.194:0/1292915499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07840fd090 0x7f07840f8a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 >> 172.21.15.194:0/1292915499 conn(0x7f07840f6920 msgr2=0x7f07840fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 shutdown_connections 2024-02-20T07:57:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:24.457+0000 7f078a9a0700 1 -- 172.21.15.194:0/1292915499 wait complete. 2024-02-20T07:57:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:57:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:24 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/1292915499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:26.051 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:26.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:26.299 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:27.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 -- 172.21.15.194:0/3723695457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 msgr2=0x7f46a80fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:27.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/3723695457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a80fbd10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f46980048c0 tx=0x7f4698009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:27.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 -- 172.21.15.194:0/3723695457 shutdown_connections 2024-02-20T07:57:27.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/3723695457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a80fbd10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:27.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 -- 172.21.15.194:0/3723695457 >> 172.21.15.194:0/3723695457 conn(0x7f46a80f6fc0 msgr2=0x7f46a80f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 -- 172.21.15.194:0/3723695457 shutdown_connections 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.821+0000 7f46aeb9f700 1 -- 172.21.15.194:0/3723695457 wait complete. 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46aeb9f700 1 Processor -- start 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46aeb9f700 1 -- start start 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46aeb9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46aeb9f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a810f420 con 0x7f46a80fb900 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46adb9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46adb9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:45906/0 (socket says 172.21.15.194:45906) 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.822+0000 7f46adb9d700 1 -- 172.21.15.194:0/447936457 learned_addr learned my addr 172.21.15.194:0/447936457 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f46adb9d700 1 -- 172.21.15.194:0/447936457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698005040 con 0x7f46a80fb900 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f46adb9d700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4698009680 tx=0x7f4698009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f469800bed0 con 0x7f46a80fb900 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f469800b5c0 con 0x7f46a80fb900 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a810f620 con 0x7f46a80fb900 2024-02-20T07:57:27.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f469801c5b0 con 0x7f46a80fb900 2024-02-20T07:57:27.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.823+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a81102c0 con 0x7f46a80fb900 2024-02-20T07:57:27.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.824+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f469801c820 con 0x7f46a80fb900 2024-02-20T07:57:27.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.824+0000 7f469e7fc700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 0x7f4694038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:27.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.824+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a805f5c0 con 0x7f46a80fb900 2024-02-20T07:57:27.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.824+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4698049fa0 con 0x7f46a80fb900 2024-02-20T07:57:27.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.824+0000 7f46ad39c700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 0x7f4694038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:27.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.825+0000 7f46ad39c700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 0x7f4694038dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009990 tx=0x7f46a4006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:27.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:27.830+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4698023300 con 0x7f46a80fb900 2024-02-20T07:57:28.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.083+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f46a8110e10 con 0x7f46a80fb900 2024-02-20T07:57:28.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.084+0000 7f469e7fc700 1 -- 172.21.15.194:0/447936457 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4698004d30 con 0x7f46a80fb900 2024-02-20T07:57:28.085 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:28.085 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:28.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 msgr2=0x7f4694038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:28.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 0x7f4694038dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009990 tx=0x7f46a4006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 msgr2=0x7f46a810eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4698009680 tx=0x7f4698009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 shutdown_connections 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4694036910 0x7f4694038dc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 --2- 172.21.15.194:0/447936457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a80fb900 0x7f46a810eee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 >> 172.21.15.194:0/447936457 conn(0x7f46a80f6fc0 msgr2=0x7f46a8066250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 shutdown_connections 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:28.086+0000 7f46aeb9f700 1 -- 172.21.15.194:0/447936457 wait complete. 2024-02-20T07:57:28.088 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:28.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:28 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/447936457' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:29.703 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:29.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:29.995 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:57:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-20T07:57:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:32.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 -- 172.21.15.194:0/2922561468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 msgr2=0x7f204c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:32.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 --2- 172.21.15.194:0/2922561468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c101f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f203c0048c0 tx=0x7f203c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:32.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 -- 172.21.15.194:0/2922561468 shutdown_connections 2024-02-20T07:57:32.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 --2- 172.21.15.194:0/2922561468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c101f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:32.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 -- 172.21.15.194:0/2922561468 >> 172.21.15.194:0/2922561468 conn(0x7f204c072850 msgr2=0x7f204c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 -- 172.21.15.194:0/2922561468 shutdown_connections 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.028+0000 7f205372f700 1 -- 172.21.15.194:0/2922561468 wait complete. 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f205372f700 1 Processor -- start 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f205372f700 1 -- start start 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f205372f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f205372f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c10e4b0 con 0x7f204c101b60 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f20514cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f20514cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:45930/0 (socket says 172.21.15.194:45930) 2024-02-20T07:57:32.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.029+0000 7f20514cb700 1 -- 172.21.15.194:0/2901831842 learned_addr learned my addr 172.21.15.194:0/2901831842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f20514cb700 1 -- 172.21.15.194:0/2901831842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c005040 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f20514cb700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f203c009300 tx=0x7f203c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f203c004e60 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f203c013420 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c10e6b0 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f203c01c590 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.030+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c10eb20 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.031+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f203c013590 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.031+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0ffd70 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.031+0000 7f2041ffb700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 0x7f2038038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.031+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f203c049c90 con 0x7f204c101b60 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.031+0000 7f2050cca700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 0x7f2038038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:32.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.032+0000 7f2050cca700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 0x7f2038038dc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2048009990 tx=0x7f2048006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:32.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.037+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f203c013a70 con 0x7f204c101b60 2024-02-20T07:57:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:31 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:31 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:31 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T07:57:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:31 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T07:57:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:31 smithi123 ceph-mon[29383]: Deploying daemon crash.smithi194 on smithi194 2024-02-20T07:57:32.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.303+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f204c065930 con 0x7f204c101b60 2024-02-20T07:57:32.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.304+0000 7f2041ffb700 1 -- 172.21.15.194:0/2901831842 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f203c011370 con 0x7f204c101b60 2024-02-20T07:57:32.305 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:32.305 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:32.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 msgr2=0x7f2038038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:32.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 0x7f2038038dc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2048009990 tx=0x7f2048006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:32.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 msgr2=0x7f204c10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:32.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f203c009300 tx=0x7f203c009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:32.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 shutdown_connections 2024-02-20T07:57:32.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2038036910 0x7f2038038dc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:32.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 --2- 172.21.15.194:0/2901831842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101b60 0x7f204c10df70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:32.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 >> 172.21.15.194:0/2901831842 conn(0x7f204c072850 msgr2=0x7f204c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:32.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 shutdown_connections 2024-02-20T07:57:32.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:32.306+0000 7f205372f700 1 -- 172.21.15.194:0/2901831842 wait complete. 2024-02-20T07:57:32.312 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:33.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:32 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2901831842' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:34.201 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:34.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:57:34.474 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:35.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:34 smithi123 ceph-mon[29383]: Deploying daemon node-exporter.smithi194 on smithi194 2024-02-20T07:57:35.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 -- 172.21.15.194:0/828527227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 msgr2=0x7fed04102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 --2- 172.21.15.194:0/828527227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed04102f80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf40048c0 tx=0x7fecf4009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 -- 172.21.15.194:0/828527227 shutdown_connections 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 --2- 172.21.15.194:0/828527227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed04102f80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 -- 172.21.15.194:0/828527227 >> 172.21.15.194:0/828527227 conn(0x7fed040720e0 msgr2=0x7fed040724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 -- 172.21.15.194:0/828527227 shutdown_connections 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 -- 172.21.15.194:0/828527227 wait complete. 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.887+0000 7fed09cc6700 1 Processor -- start 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed09cc6700 1 -- start start 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed09cc6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed09cc6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed041156e0 con 0x7fed04102bb0 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:59472/0 (socket says 172.21.15.194:59472) 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed037fe700 1 -- 172.21.15.194:0/3182191195 learned_addr learned my addr 172.21.15.194:0/3182191195 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:35.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed037fe700 1 -- 172.21.15.194:0/3182191195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4005040 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.888+0000 7fed037fe700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009300 tx=0x7fecf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.889+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecf4004e60 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.889+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed041158e0 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.889+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecf4013420 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.889+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecf401c5b0 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.889+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed04115d50 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fecf4013a90 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0405f5c0 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fecebfff700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 0x7fecec038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fecf4049be0 con 0x7fed04102bb0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fed02ffd700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 0x7fecec038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:35.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.890+0000 7fed02ffd700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 0x7fecec038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009990 tx=0x7fecf8006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:35.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:35.895+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fecf4011960 con 0x7fed04102bb0 2024-02-20T07:57:36.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.167+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fed04106ed0 con 0x7fed04102bb0 2024-02-20T07:57:36.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.168+0000 7fecebfff700 1 -- 172.21.15.194:0/3182191195 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fecf401b390 con 0x7fed04102bb0 2024-02-20T07:57:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:36.169 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:36.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 msgr2=0x7fecec038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:36.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 0x7fecec038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009990 tx=0x7fecf8006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:36.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 msgr2=0x7fed041151a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:36.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009300 tx=0x7fecf4009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 shutdown_connections 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fecec036970 0x7fecec038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 --2- 172.21.15.194:0/3182191195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed04102bb0 0x7fed041151a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 >> 172.21.15.194:0/3182191195 conn(0x7fed040720e0 msgr2=0x7fed041041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 shutdown_connections 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:36.170+0000 7fed09cc6700 1 -- 172.21.15.194:0/3182191195 wait complete. 2024-02-20T07:57:36.172 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:36.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:36 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3182191195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:38.274 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:38.274 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:38.787 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:57:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-20T07:57:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:57:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:39 smithi123 ceph-mon[29383]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 -- 172.21.15.194:0/3298782698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 msgr2=0x7f479c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 --2- 172.21.15.194:0/3298782698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c101f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47980048c0 tx=0x7f4798009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 -- 172.21.15.194:0/3298782698 shutdown_connections 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 --2- 172.21.15.194:0/3298782698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c101f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 -- 172.21.15.194:0/3298782698 >> 172.21.15.194:0/3298782698 conn(0x7f479c072850 msgr2=0x7f479c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 -- 172.21.15.194:0/3298782698 shutdown_connections 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.426+0000 7f47a4084700 1 -- 172.21.15.194:0/3298782698 wait complete. 2024-02-20T07:57:41.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a4084700 1 Processor -- start 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a4084700 1 -- start start 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a4084700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a4084700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c10e510 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a1e20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a1e20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:59486/0 (socket says 172.21.15.194:59486) 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a1e20700 1 -- 172.21.15.194:0/658047249 learned_addr learned my addr 172.21.15.194:0/658047249 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.427+0000 7f47a1e20700 1 -- 172.21.15.194:0/658047249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798005040 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47a1e20700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4798009300 tx=0x7f4798009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4798004e60 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c10e710 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4798013420 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f479801c590 con 0x7f479c101b60 2024-02-20T07:57:41.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.428+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c10eb80 con 0x7f479c101b60 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.429+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0ffd70 con 0x7f479c101b60 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.429+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f4798013590 con 0x7f479c101b60 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.429+0000 7f47927fc700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 0x7f4788038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.429+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4798049c70 con 0x7f479c101b60 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.429+0000 7f47a161f700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 0x7f4788038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.430+0000 7f47a161f700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 0x7f4788038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f478c009990 tx=0x7f478c006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:41.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.434+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4798011960 con 0x7f479c101b60 2024-02-20T07:57:41.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.705+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f479c0ffd70 con 0x7f479c101b60 2024-02-20T07:57:41.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.706+0000 7f47927fc700 1 -- 172.21.15.194:0/658047249 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4798023560 con 0x7f479c101b60 2024-02-20T07:57:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:41.708 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:41.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 msgr2=0x7f4788038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:41.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 0x7f4788038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f478c009990 tx=0x7f478c006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:41.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 msgr2=0x7f479c10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4798009300 tx=0x7f4798009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 shutdown_connections 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4788036910 0x7f4788038dc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 --2- 172.21.15.194:0/658047249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f479c101b60 0x7f479c10dfd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 >> 172.21.15.194:0/658047249 conn(0x7f479c072850 msgr2=0x7f479c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 shutdown_connections 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:41.708+0000 7f47a4084700 1 -- 172.21.15.194:0/658047249 wait complete. 2024-02-20T07:57:41.710 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:41 smithi123 ceph-mon[29383]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:41 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/658047249' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: Deploying daemon mon.smithi194 on smithi194 2024-02-20T07:57:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:43 smithi123 ceph-mon[29383]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:43.742 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:43.742 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:44.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:45.040 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T07:57:46.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:45 smithi123 ceph-mon[29383]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:46.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 -- 172.21.15.194:0/1263368286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 msgr2=0x7fbdd8101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:46.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 --2- 172.21.15.194:0/1263368286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8101fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80048c0 tx=0x7fbdc8009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:46.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 -- 172.21.15.194:0/1263368286 shutdown_connections 2024-02-20T07:57:46.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 --2- 172.21.15.194:0/1263368286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8101fa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 -- 172.21.15.194:0/1263368286 >> 172.21.15.194:0/1263368286 conn(0x7fbdd80f7760 msgr2=0x7fbdd80f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 -- 172.21.15.194:0/1263368286 shutdown_connections 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 -- 172.21.15.194:0/1263368286 wait complete. 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.864+0000 7fbdde696700 1 Processor -- start 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdde696700 1 -- start start 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdde696700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdde696700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8112500 con 0x7fbdd8101bd0 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdd7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdd7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.194:42618/0 (socket says 172.21.15.194:42618) 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.865+0000 7fbdd7fff700 1 -- 172.21.15.194:0/3231489664 learned_addr learned my addr 172.21.15.194:0/3231489664 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:46.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdd7fff700 1 -- 172.21.15.194:0/3231489664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8005040 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdd7fff700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009300 tx=0x7fbdc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdc8004e60 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdc8013420 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8112700 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdc801c5b0 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.866+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8112bf0 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.867+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fbdc801c7f0 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.867+0000 7fbdd4ff9700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 0x7fbdc0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.867+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fbdc8049be0 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.867+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd805f5c0 con 0x7fbdd8101bd0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.867+0000 7fbdd77fe700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 0x7fbdc0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:46.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.868+0000 7fbdd77fe700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 0x7fbdc0038e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009990 tx=0x7fbdcc006e40 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:46.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:46.872+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbdc8023300 con 0x7fbdd8101bd0 2024-02-20T07:57:47.063 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:46 smithi194 podman[37748]: 2024-02-20 07:57:46.878508969 +0000 UTC m=+0.251502320 image pull 10b0c032c913004d1f4f6c0f2496f5bfddfde4aeddb489f4129f49e49277ea3e quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b 2024-02-20T07:57:47.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.138+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbdd810d6e0 con 0x7fbdd8101bd0 2024-02-20T07:57:47.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.140+0000 7fbdd4ff9700 1 -- 172.21.15.194:0/3231489664 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbdc8011b60 con 0x7fbdd8101bd0 2024-02-20T07:57:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:47.142 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:54:45.859549Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 msgr2=0x7fbdc0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 0x7fbdc0038e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009990 tx=0x7fbdcc006e40 comp rx=0 tx=0).stop 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 msgr2=0x7fbdd8111fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009300 tx=0x7fbdc8009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 shutdown_connections 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbdc0036970 0x7fbdc0038e20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 --2- 172.21.15.194:0/3231489664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd8101bd0 0x7fbdd8111fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.143+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 >> 172.21.15.194:0/3231489664 conn(0x7fbdd80f7760 msgr2=0x7fbdd80f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.144+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 shutdown_connections 2024-02-20T07:57:47.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:47.144+0000 7fbdde696700 1 -- 172.21.15.194:0/3231489664 wait complete. 2024-02-20T07:57:47.146 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 podman[37748]: 2024-02-20 07:57:47.224626651 +0000 UTC m=+0.597620002 container init c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, CEPH_POINT_RELEASE=, RELEASE=quincy-c80e716, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 podman[37748]: 2024-02-20 07:57:47.228510917 +0000 UTC m=+0.601504268 container start c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c80e716, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: set uid:gid to 167:167 (ceph:ceph) 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable), process ceph-mon, pid 2 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: pidfile_write: ignore empty --pid-file 2024-02-20T07:57:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: load: jerasure load: lrc 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: RocksDB version: 6.15.5 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Compile date Feb 19 2024 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: DB SUMMARY 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: DB Session ID: YXQ576W3DCKL7TH1NJ4M 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: CURRENT file: CURRENT 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: IDENTITY file: IDENTITY 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi194/store.db dir, Total Num: 0, files: 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi194/store.db: 000004.log size: 511 ; 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.error_if_exists: 0 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.create_if_missing: 0 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.paranoid_checks: 1 2024-02-20T07:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.env: 0x558dfea30a80 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.fs: Posix File System 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.info_log: 0x558e00e2fcc0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_file_opening_threads: 16 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.statistics: (nil) 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.use_fsync: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_log_file_size: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.keep_log_file_num: 1000 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.recycle_log_file_num: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_fallocate: 1 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_mmap_reads: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_mmap_writes: 0 2024-02-20T07:57:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.use_direct_reads: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.create_missing_column_families: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.db_log_dir: 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi194/store.db 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.advise_random_on_open: 1 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.db_write_buffer_size: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.write_buffer_manager: 0x558e01ba4ae0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-20T07:57:47.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.rate_limiter: (nil) 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.wal_recovery_mode: 2 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.enable_thread_tracking: 0 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.enable_pipelined_write: 0 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.unordered_write: 0 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.row_cache: None 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.wal_filter: None 2024-02-20T07:57:47.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_ingest_behind: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.preserve_deletes: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.two_write_queues: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.manual_wal_flush: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.atomic_flush: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-20T07:57:47.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.log_readahead_size: 0 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.best_efforts_recovery: 0 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.allow_data_in_errors: 0 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.db_host_id: __hostname__ 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_background_jobs: 2 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_background_compactions: -1 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_subcompactions: 1 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-20T07:57:47.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_total_wal_size: 0 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_open_files: -1 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bytes_per_sync: 0 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-20T07:57:47.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_readahead_size: 0 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_background_flushes: -1 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Compression algorithms supported: 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kZSTD supported: 0 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kXpressCompression supported: 0 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kLZ4HCCompression supported: 1 2024-02-20T07:57:47.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kZlibCompression supported: 1 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kSnappyCompression supported: 1 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kLZ4Compression supported: 1 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: kBZip2Compression supported: 0 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000003 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.merge_operator: 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_filter: None 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_filter_factory: None 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.sst_partitioner_factory: None 2024-02-20T07:57:47.405 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558e00e84f58) 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_type: 0 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_index_type: 0 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_shortening: 1 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: hash_index_allow_collision: 1 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: checksum: 1 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: no_block_cache: 0 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache: 0x558e00eb7090 2024-02-20T07:57:47.406 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_options: 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: capacity : 536870912 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_shard_bits : 4 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: strict_capacity_limit : 0 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_compressed: (nil) 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: persistent_cache: (nil) 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size: 4096 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size_deviation: 10 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_restart_interval: 16 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_block_restart_interval: 1 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_block_size: 4096 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: partition_filters: 0 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: use_delta_encoding: 1 2024-02-20T07:57:47.407 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: whole_key_filtering: 1 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: verify_compression: 0 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: format_version: 4 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_index_compression: 1 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_align: 0 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.write_buffer_size: 33554432 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_write_buffer_number: 2 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression: NoCompression 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression: Disabled 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.prefix_extractor: nullptr 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.num_levels: 7 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-20T07:57:47.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.level: 32767 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.strategy: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-20T07:57:47.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compression_opts.enabled: false 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.target_file_size_base: 67108864 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-20T07:57:47.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.arena_block_size: 4194304 2024-02-20T07:57:47.411 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.disable_auto_compactions: 0 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-20T07:57:47.412 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.table_properties_collectors: 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.inplace_update_support: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.bloom_locality: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.max_successive_merges: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.paranoid_file_checks: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.force_consistency_checks: 1 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.report_bg_io_stats: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.ttl: 2592000 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.enable_blob_files: false 2024-02-20T07:57:47.413 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.min_blob_size: 0 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.blob_file_size: 268435456 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415867254550, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415867254854, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708415867, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "09e5f765-0027-48b4-a772-d8acc4e5cd39", "db_session_id": "YXQ576W3DCKL7TH1NJ4M"}} 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-02-20T07:57:47.414 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708415867255159, "job": 1, "event": "recovery_finished"} 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi194/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x558e00e4b180 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: DB pointer 0x558e00f20000 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** DB Stats ** 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.415 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.417 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T07:57:47.418 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194 does not exist in monmap, will attempt to join an existing cluster 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: starting mon.smithi194 rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi194 fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(???) e0 preinit fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).mds e1 new map 2024-02-20T07:57:47.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).mds e1 print_map 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: e1 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: legacy client fscid: -1 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: No filesystems configured 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-20T07:57:47.420 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Deploying daemon crash.smithi194 on smithi194 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/2901831842' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Deploying daemon node-exporter.smithi194 on smithi194 2024-02-20T07:57:47.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/3182191195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/658047249' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.422 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: Deploying daemon mon.smithi194 on smithi194 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:47.423 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 ceph-mon[37804]: mon.smithi194@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-20T07:57:47.868 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 bash[37748]: c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 2024-02-20T07:57:47.868 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:47 smithi194 systemd[1]: Started Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T07:57:48.937 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-20T07:57:48.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-20T07:57:49.186 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: mon.smithi123 calling monitor election 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:57:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: mon.smithi194 calling monitor election 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: fsmap 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: osdmap e5: 0 total, 0 up, 0 in 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: mgrmap e17: smithi123.kwyrtl(active, since 33s) 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj started 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T07:57:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: overall HEALTH_OK 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: mon.smithi123 calling monitor election 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T07:57:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: mon.smithi194 calling monitor election 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: fsmap 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: osdmap e5: 0 total, 0 up, 0 in 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: mgrmap e17: smithi123.kwyrtl(active, since 33s) 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj started 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T07:57:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: overall HEALTH_OK 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1343758198' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:53 smithi194 ceph-mon[37804]: mgrmap e18: smithi123.kwyrtl(active, since 33s), standbys: smithi194.pvhorj 2024-02-20T07:57:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:53 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T07:57:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:53 smithi194 ceph-mon[37804]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:53 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:57:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:53 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:53.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 -- 172.21.15.194:0/2939815762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd888003580 msgr2=0x7fd888005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:53.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 --2- 172.21.15.194:0/2939815762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd888003580 0x7fd888005a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00fcd10 tx=0x7fd89400b040 comp rx=0 tx=0).stop 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 -- 172.21.15.194:0/2939815762 shutdown_connections 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 --2- 172.21.15.194:0/2939815762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd888003580 0x7fd888005a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 -- 172.21.15.194:0/2939815762 >> 172.21.15.194:0/2939815762 conn(0x7fd8a00f8980 msgr2=0x7fd8a00fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 -- 172.21.15.194:0/2939815762 shutdown_connections 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.737+0000 7fd8a6869700 1 -- 172.21.15.194:0/2939815762 wait complete. 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 Processor -- start 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 -- start start 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 0x7fd8a010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0113d40 con 0x7fd8a0113730 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd8a6869700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0113eb0 con 0x7fd888003580 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33806/0 (socket says 172.21.15.194:33806) 2024-02-20T07:57:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 -- 172.21.15.194:0/1489964510 learned_addr learned my addr 172.21.15.194:0/1489964510 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89f7fe700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 0x7fd8a010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 -- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 msgr2=0x7fd8a01131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 -- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 msgr2=0x7fd8a01131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.738+0000 7fd89ffff700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89ffff700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89f7fe700 1 -- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 msgr2=0x7fd8a01131f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89f7fe700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89f7fe700 1 -- 172.21.15.194:0/1489964510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894005040 con 0x7fd8a0113730 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89f7fe700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 0x7fd8a010d0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd89000b790 tx=0x7fd8900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd890011810 con 0x7fd8a0113730 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd890011e40 con 0x7fd8a0113730 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a010d730 con 0x7fd8a0113730 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89000f2e0 con 0x7fd8a0113730 2024-02-20T07:57:53.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.739+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a010dc70 con 0x7fd8a0113730 2024-02-20T07:57:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.740+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a010def0 con 0x7fd8a0113730 2024-02-20T07:57:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.741+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fd890010380 con 0x7fd8a0113730 2024-02-20T07:57:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.741+0000 7fd89cff9700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 0x7fd88c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.741+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd890086400 con 0x7fd8a0113730 2024-02-20T07:57:53.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.741+0000 7fd89ffff700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 0x7fd88c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:53.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.742+0000 7fd89ffff700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 0x7fd88c06b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd894007c40 tx=0x7fd894018040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:53.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:53.746+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd8900536f0 con 0x7fd8a0113730 2024-02-20T07:57:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:53 smithi123 ceph-mon[29383]: mgrmap e18: smithi123.kwyrtl(active, since 33s), standbys: smithi194.pvhorj 2024-02-20T07:57:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:53 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T07:57:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:53 smithi123 ceph-mon[29383]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:53 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:57:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:53 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:57:54.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.011+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8a005f5c0 con 0x7fd8a0113730 2024-02-20T07:57:54.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.012+0000 7fd89cff9700 1 -- 172.21.15.194:0/1489964510 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7fd890015090 con 0x7fd8a0113730 2024-02-20T07:57:54.013 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-02-20T07:57:54.013 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","modified":"2024-02-20T07:57:47.280750Z","created":"2024-02-20T07:54:45.859549Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi194","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-20T07:57:54.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 msgr2=0x7fd88c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:54.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 0x7fd88c06b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd894007c40 tx=0x7fd894018040 comp rx=0 tx=0).stop 2024-02-20T07:57:54.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 msgr2=0x7fd8a010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 0x7fd8a010d0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd89000b790 tx=0x7fd8900091a0 comp rx=0 tx=0).stop 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 shutdown_connections 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd88c069360 0x7fd88c06b810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd888003580 0x7fd8a01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 --2- 172.21.15.194:0/1489964510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0113730 0x7fd8a010d0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 >> 172.21.15.194:0/1489964510 conn(0x7fd8a00f8980 msgr2=0x7fd8a00fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 shutdown_connections 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:57:54.014+0000 7fd8a6869700 1 -- 172.21.15.194:0/1489964510 wait complete. 2024-02-20T07:57:54.016 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-02-20T07:57:54.578 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:54 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:54.578 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:54 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/1489964510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:54.603 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-20T07:57:54.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph config generate-minimal-conf 2024-02-20T07:57:54.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:54 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:54.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:54 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/1489964510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-20T07:57:54.879 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:57:55.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:55.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:57:55.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T07:57:55.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:55.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T07:57:55.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:56 smithi194 ceph-mon[37804]: Reconfiguring mon.smithi123 (unknown last config time)... 2024-02-20T07:57:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:56 smithi194 ceph-mon[37804]: Reconfiguring daemon mon.smithi123 on smithi123 2024-02-20T07:57:56.977 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:56 smithi123 ceph-mon[29383]: Reconfiguring mon.smithi123 (unknown last config time)... 2024-02-20T07:57:56.977 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:56 smithi123 ceph-mon[29383]: Reconfiguring daemon mon.smithi123 on smithi123 2024-02-20T07:57:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 -- 172.21.15.123:0/3996845823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b80fb570 msgr2=0x7fa2b80fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/3996845823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fb9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4004940 tx=0x7fa2b4009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 -- 172.21.15.123:0/3996845823 shutdown_connections 2024-02-20T07:57:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/3996845823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fb9c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/3996845823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b8103140 0x7fa2b8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 -- 172.21.15.123:0/3996845823 >> 172.21.15.123:0/3996845823 conn(0x7fa2b8071560 msgr2=0x7fa2b8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 -- 172.21.15.123:0/3996845823 shutdown_connections 2024-02-20T07:57:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.437+0000 7fa2bf63d700 1 -- 172.21.15.123:0/3996845823 wait complete. 2024-02-20T07:57:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 Processor -- start 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 -- start start 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80fd320 con 0x7fa2b8103140 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bf63d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80fd490 con 0x7fa2b80fb570 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44622/0 (socket says 172.21.15.123:44622) 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 -- 172.21.15.123:0/1684752212 learned_addr learned my addr 172.21.15.123:0/1684752212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:57:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bd3d9700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 -- 172.21.15.123:0/1684752212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 msgr2=0x7fa2b80fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 -- 172.21.15.123:0/1684752212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b4005040 con 0x7fa2b8103140 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bd3d9700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.438+0000 7fa2bcbd8700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400b3b0 tx=0x7fa2b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.439+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b400e040 con 0x7fa2b8103140 2024-02-20T07:57:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.439+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2b400bbf0 con 0x7fa2b8103140 2024-02-20T07:57:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.439+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b8119de0 con 0x7fa2b8103140 2024-02-20T07:57:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.439+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b401c630 con 0x7fa2b8103140 2024-02-20T07:57:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.439+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b811a2a0 con 0x7fa2b8103140 2024-02-20T07:57:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.440+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b8105570 con 0x7fa2b8103140 2024-02-20T07:57:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.441+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fa2b400bd60 con 0x7fa2b8103140 2024-02-20T07:57:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.441+0000 7fa2adffb700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 0x7fa2a406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:57:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.441+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa2b4087440 con 0x7fa2b8103140 2024-02-20T07:57:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.441+0000 7fa2bd3d9700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 0x7fa2a406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:57:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.442+0000 7fa2bd3d9700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 0x7fa2a406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009b10 tx=0x7fa2a8008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:57:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.449+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa2b4054850 con 0x7fa2b8103140 2024-02-20T07:57:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.644+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa2b804bed0 con 0x7fa2b8103140 2024-02-20T07:57:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.645+0000 7fa2adffb700 1 -- 172.21.15.123:0/1684752212 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fa2b4086bf0 con 0x7fa2b8103140 2024-02-20T07:57:57.646 INFO:teuthology.orchestra.run.smithi123.stdout:# minimal ceph.conf for 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:57:57.646 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-02-20T07:57:57.646 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T07:57:57.646 INFO:teuthology.orchestra.run.smithi123.stdout: mon_host = [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 msgr2=0x7fa2a406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 0x7fa2a406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009b10 tx=0x7fa2a8008040 comp rx=0 tx=0).stop 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 msgr2=0x7fa2b80fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400b3b0 tx=0x7fa2b4009e30 comp rx=0 tx=0).stop 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 shutdown_connections 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa2a4069210 0x7fa2a406b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2b80fb570 0x7fa2b80fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 --2- 172.21.15.123:0/1684752212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2b8103140 0x7fa2b80fcc90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:57:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 >> 172.21.15.123:0/1684752212 conn(0x7fa2b8071560 msgr2=0x7fa2b80f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:57:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 shutdown_connections 2024-02-20T07:57:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:57:57.647+0000 7fa2bf63d700 1 -- 172.21.15.123:0/1684752212 wait complete. 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:57:57.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:57 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:57.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:57:57.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:57:57.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:57 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: Reconfiguring mgr.smithi123.kwyrtl (unknown last config time)... 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: Reconfiguring daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1684752212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:57:58.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: Reconfiguring mgr.smithi123.kwyrtl (unknown last config time)... 2024-02-20T07:57:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: Reconfiguring daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T07:57:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1684752212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:57:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:57:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:57:58.997 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-20T07:57:58.997 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:57:58.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-02-20T07:57:59.028 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:57:59.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:59.095 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:57:59.095 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-02-20T07:57:59.130 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:57:59.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-20T07:57:59.200 INFO:tasks.cephadm:Deploying OSDs... 2024-02-20T07:57:59.201 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T07:57:59.201 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-02-20T07:57:59.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-20T07:57:59.216 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-02-20 07:57:10.282185684 +0000 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-02-20 07:50:16.112587646 +0000 2024-02-20T07:57:59.271 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-02-20 07:50:16.112587646 +0000 2024-02-20T07:57:59.272 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-02-20 07:50:16.112587646 +0000 2024-02-20T07:57:59.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-20T07:57:59.338 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-02-20T07:57:59.338 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-02-20T07:57:59.339 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000206694 s, 2.5 MB/s 2024-02-20T07:57:59.339 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-20T07:57:59.394 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-02-20T07:57:59.449 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-20T07:57:59.449 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:57:59.449 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-20T07:57:59.449 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:57:59.450 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:57:59.450 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-02-20 07:57:10.282185684 +0000 2024-02-20T07:57:59.450 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-02-20 07:50:16.450579675 +0000 2024-02-20T07:57:59.450 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-02-20 07:50:16.450579675 +0000 2024-02-20T07:57:59.450 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-02-20 07:50:16.450579675 +0000 2024-02-20T07:57:59.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-20T07:57:59.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-02-20T07:57:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-02-20T07:57:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.00022671 s, 2.3 MB/s 2024-02-20T07:57:59.516 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-20T07:57:59.572 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-02-20T07:57:59.626 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-02-20 07:57:10.282185684 +0000 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-02-20 07:50:16.801571397 +0000 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-02-20 07:50:16.801571397 +0000 2024-02-20T07:57:59.627 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-02-20 07:50:16.801571397 +0000 2024-02-20T07:57:59.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-20T07:57:59.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-02-20T07:57:59.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-02-20T07:57:59.694 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000186872 s, 2.7 MB/s 2024-02-20T07:57:59.694 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-20T07:57:59.750 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-02-20T07:57:59.807 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-20T07:57:59.807 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:57:59.807 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-20T07:57:59.807 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:57:59.807 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:57:59.808 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-02-20 07:57:10.283185661 +0000 2024-02-20T07:57:59.808 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-02-20 07:50:17.134563544 +0000 2024-02-20T07:57:59.808 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-02-20 07:50:17.134563544 +0000 2024-02-20T07:57:59.808 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-02-20 07:50:17.134563544 +0000 2024-02-20T07:57:59.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-20T07:57:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-02-20T07:57:59.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-02-20T07:57:59.880 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000190923 s, 2.7 MB/s 2024-02-20T07:57:59.881 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-20T07:57:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:59 smithi194 ceph-mon[37804]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:57:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:59 smithi194 ceph-mon[37804]: Reconfiguring crash.smithi123 (monmap changed)... 2024-02-20T07:57:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:57:59 smithi194 ceph-mon[37804]: Reconfiguring daemon crash.smithi123 on smithi123 2024-02-20T07:57:59.937 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T07:57:59.937 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-02-20T07:57:59.958 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-20T07:57:59.958 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-02-20T07:58:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:59 smithi123 ceph-mon[29383]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:59 smithi123 ceph-mon[29383]: Reconfiguring crash.smithi123 (monmap changed)... 2024-02-20T07:58:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:57:59 smithi123 ceph-mon[29383]: Reconfiguring daemon crash.smithi123 on smithi123 2024-02-20T07:58:00.015 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-02-20 07:57:45.244488369 +0000 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-02-20 07:50:16.098525276 +0000 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-02-20 07:50:16.098525276 +0000 2024-02-20T07:58:00.016 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-02-20 07:50:16.098525276 +0000 2024-02-20T07:58:00.016 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-20T07:58:00.092 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-02-20T07:58:00.092 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-02-20T07:58:00.092 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000232557 s, 2.2 MB/s 2024-02-20T07:58:00.094 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-20T07:58:00.158 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-02-20T07:58:00.217 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-20T07:58:00.217 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:58:00.217 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-02-20 07:57:45.245488348 +0000 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-02-20 07:50:16.443518156 +0000 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-02-20 07:50:16.443518156 +0000 2024-02-20T07:58:00.218 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-02-20 07:50:16.443518156 +0000 2024-02-20T07:58:00.218 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-20T07:58:00.289 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-02-20T07:58:00.290 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-02-20T07:58:00.290 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000250436 s, 2.0 MB/s 2024-02-20T07:58:00.291 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-20T07:58:00.351 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-02-20T07:58:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-20T07:58:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-02-20 07:57:45.245488348 +0000 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-02-20 07:50:16.781511180 +0000 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-02-20 07:50:16.781511180 +0000 2024-02-20T07:58:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-02-20 07:50:16.781511180 +0000 2024-02-20T07:58:00.411 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-20T07:58:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-02-20T07:58:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-02-20T07:58:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000220851 s, 2.3 MB/s 2024-02-20T07:58:00.481 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-20T07:58:00.538 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-02-20T07:58:00.595 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-20T07:58:00.595 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-20T07:58:00.595 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-20T07:58:00.595 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T07:58:00.596 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-02-20T07:58:00.596 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-02-20 07:57:45.246488326 +0000 2024-02-20T07:58:00.596 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-02-20 07:50:17.112504349 +0000 2024-02-20T07:58:00.596 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-02-20 07:50:17.112504349 +0000 2024-02-20T07:58:00.596 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-02-20 07:50:17.112504349 +0000 2024-02-20T07:58:00.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-20T07:58:00.663 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-02-20T07:58:00.663 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-02-20T07:58:00.663 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000216001 s, 2.4 MB/s 2024-02-20T07:58:00.664 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-20T07:58:00.720 INFO:tasks.cephadm:Deploying osd.0 on smithi123 with /dev/vg_nvme/lv_4... 2024-02-20T07:58:00.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-20T07:58:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:01 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:01 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:01 smithi123 ceph-mon[29383]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-02-20T07:58:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:01 smithi123 ceph-mon[29383]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-02-20T07:58:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:01 smithi123 ceph-mon[29383]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:01 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:01 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:01 smithi194 ceph-mon[37804]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-02-20T07:58:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:01 smithi194 ceph-mon[37804]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-02-20T07:58:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:01 smithi194 ceph-mon[37804]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:02.370 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:58:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:03 smithi123 ceph-mon[29383]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:03 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:03.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:03 smithi194 ceph-mon[37804]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:03.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:03 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131826 s, 795 MB/s 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 2024-02-20T07:58:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-02-20T07:58:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:05 smithi194 ceph-mon[37804]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:06.154 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:05 smithi123 ceph-mon[29383]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:06.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-02-20T07:58:06.622 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:58:07.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:07 smithi123 ceph-mon[29383]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:07.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:07 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:07.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:07 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:07.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:07 smithi123 ceph-mon[29383]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-02-20T07:58:07.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:07 smithi123 ceph-mon[29383]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-02-20T07:58:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:07 smithi194 ceph-mon[37804]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:07 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:07.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:07 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:07.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:07 smithi194 ceph-mon[37804]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-02-20T07:58:07.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:07 smithi194 ceph-mon[37804]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 -- 172.21.15.123:0/598019952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fcef0 msgr2=0x7fad600fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 --2- 172.21.15.123:0/598019952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fcef0 0x7fad600fd320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad54004940 tx=0x7fad54009e30 comp rx=0 tx=0).stop 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 -- 172.21.15.123:0/598019952 shutdown_connections 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 --2- 172.21.15.123:0/598019952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fe0e0 0x7fad600fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 --2- 172.21.15.123:0/598019952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fcef0 0x7fad600fd320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 -- 172.21.15.123:0/598019952 >> 172.21.15.123:0/598019952 conn(0x7fad600f8620 msgr2=0x7fad600faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 -- 172.21.15.123:0/598019952 shutdown_connections 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.315+0000 7fad64e0a700 1 -- 172.21.15.123:0/598019952 wait complete. 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 Processor -- start 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 -- start start 2024-02-20T07:58:09.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 0x7fad6010d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6010e520 con 0x7fad600fe0e0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad64e0a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6010ed60 con 0x7fad600fcef0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39630/0 (socket says 172.21.15.123:39630) 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 -- 172.21.15.123:0/1620089549 learned_addr learned my addr 172.21.15.123:0/1620089549 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5e59c700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 0x7fad6010d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 -- 172.21.15.123:0/1620089549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 msgr2=0x7fad6010d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 0x7fad6010d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5dd9b700 1 -- 172.21.15.123:0/1620089549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54005040 con 0x7fad600fe0e0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.316+0000 7fad5e59c700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 0x7fad6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad5dd9b700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad5000b790 tx=0x7fad50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:58:09.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5000f770 con 0x7fad600fe0e0 2024-02-20T07:58:09.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad5000fda0 con 0x7fad600fe0e0 2024-02-20T07:58:09.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5000d310 con 0x7fad600fe0e0 2024-02-20T07:58:09.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6010f040 con 0x7fad600fe0e0 2024-02-20T07:58:09.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.317+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6010f580 con 0x7fad600fe0e0 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.318+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6004bed0 con 0x7fad600fe0e0 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.318+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fad50010420 con 0x7fad600fe0e0 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.318+0000 7fad4effd700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 0x7fad4806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.319+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fad500860a0 con 0x7fad600fe0e0 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.319+0000 7fad5e59c700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 0x7fad4806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:09.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.319+0000 7fad5e59c700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 0x7fad4806b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad5400b3b0 tx=0x7fad54009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:58:09.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.323+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fad50056f40 con 0x7fad600fe0e0 2024-02-20T07:58:09.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:09.520+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fad6010fae0 con 0x7fad48069210 2024-02-20T07:58:09.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:09 smithi123 ceph-mon[29383]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:09.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:09 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:58:09.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:09 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:58:09.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:09 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:09.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:09 smithi194 ceph-mon[37804]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:09.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:09 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:58:09.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:09 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:58:09.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:09 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:10 smithi194 ceph-mon[37804]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:58:11.175 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:10 smithi123 ceph-mon[29383]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:58:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:11 smithi194 ceph-mon[37804]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:12.246 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:11 smithi123 ceph-mon[29383]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:13 smithi123 ceph-mon[29383]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:13 smithi123 ceph-mon[29383]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T07:58:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:13 smithi123 ceph-mon[29383]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T07:58:13.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:13 smithi194 ceph-mon[37804]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:13.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:13.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:13.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:13 smithi194 ceph-mon[37804]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T07:58:13.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:13 smithi194 ceph-mon[37804]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T07:58:14.830 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2145223341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3cf13df-1d84-4a10-ab38-47332903619f"}]: dispatch 2024-02-20T07:58:14.831 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2145223341' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3cf13df-1d84-4a10-ab38-47332903619f"}]': finished 2024-02-20T07:58:14.831 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:14 smithi123 ceph-mon[29383]: osdmap e6: 1 total, 0 up, 1 in 2024-02-20T07:58:14.831 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:14.831 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/177289780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:58:14.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2145223341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3cf13df-1d84-4a10-ab38-47332903619f"}]: dispatch 2024-02-20T07:58:14.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2145223341' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3cf13df-1d84-4a10-ab38-47332903619f"}]': finished 2024-02-20T07:58:14.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:14 smithi194 ceph-mon[37804]: osdmap e6: 1 total, 0 up, 1 in 2024-02-20T07:58:14.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:14.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/177289780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:58:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:15 smithi194 ceph-mon[37804]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:15 smithi123 ceph-mon[29383]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:17 smithi194 ceph-mon[37804]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:18.184 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:17 smithi123 ceph-mon[29383]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:18 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:20.129 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:19 smithi123 ceph-mon[29383]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:19 smithi194 ceph-mon[37804]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:22.126 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:21 smithi123 ceph-mon[29383]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:21 smithi194 ceph-mon[37804]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:23.929 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:23 smithi194 ceph-mon[37804]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:23.930 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:23.930 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:23.930 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:58:23.930 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:23 smithi123 ceph-mon[29383]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:24.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:24.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:24.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T07:58:24.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: Reconfiguring crash.smithi194 (monmap changed)... 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: Reconfiguring daemon crash.smithi194 on smithi194 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:58:25.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: Reconfiguring crash.smithi194 (monmap changed)... 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: Reconfiguring daemon crash.smithi194 on smithi194 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T07:58:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T07:58:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:26.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:25 smithi123 ceph-mon[29383]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:26.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:25 smithi123 ceph-mon[29383]: Deploying daemon osd.0 on smithi123 2024-02-20T07:58:26.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:25 smithi123 ceph-mon[29383]: Reconfiguring mgr.smithi194.pvhorj (monmap changed)... 2024-02-20T07:58:26.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:25 smithi123 ceph-mon[29383]: Reconfiguring daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T07:58:26.129 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:25 smithi194 ceph-mon[37804]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:26.129 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:25 smithi194 ceph-mon[37804]: Deploying daemon osd.0 on smithi123 2024-02-20T07:58:26.130 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:25 smithi194 ceph-mon[37804]: Reconfiguring mgr.smithi194.pvhorj (monmap changed)... 2024-02-20T07:58:26.130 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:25 smithi194 ceph-mon[37804]: Reconfiguring daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T07:58:27.334 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: Reconfiguring mon.smithi194 (monmap changed)... 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: Reconfiguring daemon mon.smithi194 on smithi194 2024-02-20T07:58:27.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:27 smithi123 ceph-mon[29383]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:27.452 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:27.452 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:27.452 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: Reconfiguring mon.smithi194 (monmap changed)... 2024-02-20T07:58:27.452 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T07:58:27.452 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T07:58:27.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:27.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: Reconfiguring daemon mon.smithi194 on smithi194 2024-02-20T07:58:27.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:27 smithi194 ceph-mon[37804]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:28.666 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.666 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123.front.sepia.ceph.com:9093"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123.front.sepia.ceph.com:9093"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123.front.sepia.ceph.com:3000"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123.front.sepia.ceph.com:3000"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123.front.sepia.ceph.com:9095"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123.front.sepia.ceph.com:9095"}]: dispatch 2024-02-20T07:58:28.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.668 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:28.849 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.849 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.849 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123.front.sepia.ceph.com:9093"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123.front.sepia.ceph.com:9093"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123.front.sepia.ceph.com:3000"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123.front.sepia.ceph.com:3000"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123.front.sepia.ceph.com:9095"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123.front.sepia.ceph.com:9095"}]: dispatch 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:28.850 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:29.853 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:29 smithi123 ceph-mon[29383]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:29.853 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:29.853 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:29 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:29.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:29 smithi194 ceph-mon[37804]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:29.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:29 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:29.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:29 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:31 smithi123 ceph-mon[29383]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:32.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:32.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:31 smithi194 ceph-mon[37804]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:34.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:33 smithi194 ceph-mon[37804]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:34.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:34.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:34.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:34.126 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:33 smithi123 ceph-mon[29383]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:34.126 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:34.126 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:34.126 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:34 smithi123 ceph-mon[29383]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-20T07:58:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:34 smithi194 ceph-mon[37804]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-20T07:58:35.429 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 0 on host 'smithi123' 2024-02-20T07:58:35.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.428+0000 7fad4effd700 1 -- 172.21.15.123:0/1620089549 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad6010fae0 con 0x7fad48069210 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 msgr2=0x7fad4806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 0x7fad4806b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad5400b3b0 tx=0x7fad54009e30 comp rx=0 tx=0).stop 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 msgr2=0x7fad6010de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad5000b790 tx=0x7fad50009250 comp rx=0 tx=0).stop 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 shutdown_connections 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fad48069210 0x7fad4806b6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad600fcef0 0x7fad6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 --2- 172.21.15.123:0/1620089549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad600fe0e0 0x7fad6010de90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 >> 172.21.15.123:0/1620089549 conn(0x7fad600f8620 msgr2=0x7fad601013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:58:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 shutdown_connections 2024-02-20T07:58:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:35.430+0000 7fad64e0a700 1 -- 172.21.15.123:0/1620089549 wait complete. 2024-02-20T07:58:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: osdmap e7: 1 total, 0 up, 1 in 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: osdmap e7: 1 total, 0 up, 1 in 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:36.039 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:36.324 DEBUG:teuthology.orchestra.run.smithi123:osd.0> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.0.service 2024-02-20T07:58:36.327 INFO:tasks.cephadm:Deploying osd.1 on smithi123 with /dev/vg_nvme/lv_3... 2024-02-20T07:58:36.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-20T07:58:37.095 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:58:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:58:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: osdmap e8: 1 total, 0 up, 1 in 2024-02-20T07:58:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:36 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: from='osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:58:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: osdmap e8: 1 total, 0 up, 1 in 2024-02-20T07:58:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:36 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:38.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T07:58:38.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T07:58:38.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:38.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] boot 2024-02-20T07:58:38.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: osdmap e9: 1 total, 1 up, 1 in 2024-02-20T07:58:38.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T07:58:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T07:58:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-20T07:58:38.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: osd.0 [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] boot 2024-02-20T07:58:38.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: osdmap e9: 1 total, 1 up, 1 in 2024-02-20T07:58:38.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T07:58:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:39 smithi194 ceph-mon[37804]: osdmap e10: 1 total, 1 up, 1 in 2024-02-20T07:58:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:39 smithi194 ceph-mon[37804]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:39 smithi123 ceph-mon[29383]: osdmap e10: 1 total, 1 up, 1 in 2024-02-20T07:58:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:39 smithi123 ceph-mon[29383]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114749 s, 914 MB/s 2024-02-20T07:58:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-02-20T07:58:40.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-02-20T07:58:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:41 smithi194 ceph-mon[37804]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:41.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:41 smithi123 ceph-mon[29383]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:41.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:41.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:42.003 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:58:43.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:43 smithi194 ceph-mon[37804]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:43.916 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:43 smithi123 ceph-mon[29383]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 -- 172.21.15.123:0/2000462141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe00fda80 msgr2=0x7f5fe00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 --2- 172.21.15.123:0/2000462141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe00fda80 0x7f5fe00ffe60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0004940 tx=0x7f5fd0009e30 comp rx=0 tx=0).stop 2024-02-20T07:58:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 -- 172.21.15.123:0/2000462141 shutdown_connections 2024-02-20T07:58:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 --2- 172.21.15.123:0/2000462141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe01003a0 0x7f5fe0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 --2- 172.21.15.123:0/2000462141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe00fda80 0x7f5fe00ffe60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 -- 172.21.15.123:0/2000462141 >> 172.21.15.123:0/2000462141 conn(0x7f5fe00f7500 msgr2=0x7f5fe00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 -- 172.21.15.123:0/2000462141 shutdown_connections 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.365+0000 7f5fe796e700 1 -- 172.21.15.123:0/2000462141 wait complete. 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 Processor -- start 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 -- start start 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe00fda80 0x7f5fe00fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00fbf90 con 0x7f5fe01003a0 2024-02-20T07:58:44.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe796e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00fc100 con 0x7f5fe00fda80 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49976/0 (socket says 172.21.15.123:49976) 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 -- 172.21.15.123:0/3042328879 learned_addr learned my addr 172.21.15.123:0/3042328879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe570a700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe00fda80 0x7f5fe00fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 -- 172.21.15.123:0/3042328879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe00fda80 msgr2=0x7f5fe00fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe00fda80 0x7f5fe00fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 -- 172.21.15.123:0/3042328879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd0005040 con 0x7f5fe01003a0 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.366+0000 7f5fe4f09700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00eb40 tx=0x7f5fdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:58:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.367+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc007cc0 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.367+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00fc380 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.367+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fdc00f040 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.367+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc00ca10 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.367+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe01158c0 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.368+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0107a50 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.368+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f5fdc00cc80 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.368+0000 7f5fd5ffb700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 0x7f5fcc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.369+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f5fdc085f30 con 0x7f5fe01003a0 2024-02-20T07:58:44.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.369+0000 7f5fe570a700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 0x7f5fcc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:58:44.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.369+0000 7f5fe570a700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 0x7f5fcc06b6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0000c00 tx=0x7f5fd0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:58:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.373+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5fdc04dbd0 con 0x7f5fe01003a0 2024-02-20T07:58:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:58:44.589+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fe002b310 con 0x7f5fcc069210 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi123 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi123 to 12864M 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:45.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:58:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:58:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:44 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi123 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi123 to 12864M 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:58:45.347 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:44 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:46 smithi123 ceph-mon[29383]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:46.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:46 smithi123 ceph-mon[29383]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:58:46.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:46 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:46.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:46 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:46.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:46 smithi194 ceph-mon[37804]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:46.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:46 smithi194 ceph-mon[37804]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:58:46.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:46 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:46.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:46 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:47.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:47 smithi123 ceph-mon[29383]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:47.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:47 smithi194 ceph-mon[37804]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:48.314 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:48 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3348963954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "750e4ff7-40b2-405d-a9ee-f03102332544"}]: dispatch 2024-02-20T07:58:48.314 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:48 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3348963954' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "750e4ff7-40b2-405d-a9ee-f03102332544"}]': finished 2024-02-20T07:58:48.315 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:48 smithi123 ceph-mon[29383]: osdmap e11: 2 total, 1 up, 2 in 2024-02-20T07:58:48.315 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:48 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:58:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:48 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3348963954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "750e4ff7-40b2-405d-a9ee-f03102332544"}]: dispatch 2024-02-20T07:58:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:48 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3348963954' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "750e4ff7-40b2-405d-a9ee-f03102332544"}]': finished 2024-02-20T07:58:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:48 smithi194 ceph-mon[37804]: osdmap e11: 2 total, 1 up, 2 in 2024-02-20T07:58:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:48 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:58:49.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:49 smithi123 ceph-mon[29383]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:49.308 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:49 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:49.308 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:49 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1315035509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:58:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:49 smithi194 ceph-mon[37804]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:49 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:58:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:49 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1315035509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:58:50.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:50 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:50 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:50 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:50 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:50 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:51.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:50 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:50 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:50 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:50 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:58:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:50 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:58:52.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:51 smithi194 ceph-mon[37804]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:51 smithi123 ceph-mon[29383]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:54.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:53 smithi123 ceph-mon[29383]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:53 smithi194 ceph-mon[37804]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:56.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:55 smithi123 ceph-mon[29383]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:56.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T07:58:56.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:55 smithi194 ceph-mon[37804]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T07:58:56.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:58:56.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:56 smithi123 ceph-mon[29383]: Deploying daemon osd.1 on smithi123 2024-02-20T07:58:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:56 smithi194 ceph-mon[37804]: Deploying daemon osd.1 on smithi123 2024-02-20T07:58:57.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:57 smithi123 ceph-mon[29383]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:58:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:57 smithi194 ceph-mon[37804]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:58:59 smithi123 ceph-mon[29383]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:58:59 smithi194 ceph-mon[37804]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:01.813 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:01 smithi123 ceph-mon[29383]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:01.813 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:01 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:01.814 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:01 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:01.814 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:01 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:01.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:01 smithi194 ceph-mon[37804]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:01.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:01 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:01.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:01 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:01.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:01 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:03.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:03 smithi123 ceph-mon[29383]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:03.883 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:03 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:03.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:03 smithi194 ceph-mon[37804]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:03.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:03 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:03.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.944+0000 7f5fd5ffb700 1 -- 172.21.15.123:0/3042328879 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5fe002b310 con 0x7f5fcc069210 2024-02-20T07:59:03.945 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 1 on host 'smithi123' 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 msgr2=0x7f5fcc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 0x7f5fcc06b6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0000c00 tx=0x7f5fd0009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 msgr2=0x7f5fe00fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00eb40 tx=0x7f5fdc00b040 comp rx=0 tx=0).stop 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 shutdown_connections 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5fcc069210 0x7f5fcc06b6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fe00fda80 0x7f5fe00fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 --2- 172.21.15.123:0/3042328879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe01003a0 0x7f5fe00fb990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 >> 172.21.15.123:0/3042328879 conn(0x7f5fe00f7500 msgr2=0x7f5fe00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:59:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 shutdown_connections 2024-02-20T07:59:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:03.946+0000 7f5fe796e700 1 -- 172.21.15.123:0/3042328879 wait complete. 2024-02-20T07:59:04.644 DEBUG:teuthology.orchestra.run.smithi123:osd.1> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.1.service 2024-02-20T07:59:04.648 INFO:tasks.cephadm:Deploying osd.2 on smithi123 with /dev/vg_nvme/lv_2... 2024-02-20T07:59:04.648 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-20T07:59:05.080 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:59:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:04 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:05.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:04 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:05.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:04 smithi123 ceph-mon[29383]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-20T07:59:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:04 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:04 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:04 smithi194 ceph-mon[37804]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-20T07:59:06.153 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-mon[29383]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:06.153 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-mon[29383]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-20T07:59:06.154 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-mon[29383]: osdmap e12: 2 total, 1 up, 2 in 2024-02-20T07:59:06.154 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:06.154 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-mon[29383]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:59:06.154 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[55722]: 2024-02-20T07:59:05.924+0000 7f1bb4158700 -1 osd.1 0 waiting for initial osdmap 2024-02-20T07:59:06.154 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:05 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[55722]: 2024-02-20T07:59:05.927+0000 7f1baf754700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T07:59:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:05 smithi194 ceph-mon[37804]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:05 smithi194 ceph-mon[37804]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-20T07:59:06.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:05 smithi194 ceph-mon[37804]: osdmap e12: 2 total, 1 up, 2 in 2024-02-20T07:59:06.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:05 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:06.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:05 smithi194 ceph-mon[37804]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:59:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:06 smithi123 ceph-mon[29383]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:59:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:06 smithi123 ceph-mon[29383]: osdmap e13: 2 total, 1 up, 2 in 2024-02-20T07:59:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:06 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:06 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:07.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:06 smithi194 ceph-mon[37804]: from='osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:59:07.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:06 smithi194 ceph-mon[37804]: osdmap e13: 2 total, 1 up, 2 in 2024-02-20T07:59:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:06 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:06 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] boot 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: osdmap e14: 2 total, 2 up, 2 in 2024-02-20T07:59:08.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:07 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T07:59:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T07:59:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-20T07:59:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: osd.1 [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] boot 2024-02-20T07:59:08.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: osdmap e14: 2 total, 2 up, 2 in 2024-02-20T07:59:08.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:07 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T07:59:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-20T07:59:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-20T07:59:08.912 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-02-20T07:59:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-02-20T07:59:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119455 s, 878 MB/s 2024-02-20T07:59:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-02-20T07:59:09.238 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:08 smithi123 ceph-mon[29383]: osdmap e15: 2 total, 2 up, 2 in 2024-02-20T07:59:09.238 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:08 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:09.238 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:08 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:08 smithi194 ceph-mon[37804]: osdmap e15: 2 total, 2 up, 2 in 2024-02-20T07:59:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:08 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:08 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:09.547 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-02-20T07:59:10.211 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:09 smithi123 ceph-mon[29383]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:09 smithi194 ceph-mon[37804]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T07:59:12.180 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:11 smithi123 ceph-mon[29383]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:11 smithi194 ceph-mon[37804]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 -- 172.21.15.123:0/3793994135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c01000c0 msgr2=0x7f08c0102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 --2- 172.21.15.123:0/3793994135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c01000c0 0x7f08c0102520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08a8004940 tx=0x7f08a8009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 -- 172.21.15.123:0/3793994135 shutdown_connections 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 --2- 172.21.15.123:0/3793994135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c01000c0 0x7f08c0102520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 --2- 172.21.15.123:0/3793994135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c00663e0 0x7f08c00ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 -- 172.21.15.123:0/3793994135 >> 172.21.15.123:0/3793994135 conn(0x7f08c00f74e0 msgr2=0x7f08c00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 -- 172.21.15.123:0/3793994135 shutdown_connections 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 -- 172.21.15.123:0/3793994135 wait complete. 2024-02-20T07:59:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.119+0000 7f08c572e700 1 Processor -- start 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08c572e700 1 -- start start 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08c572e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08c572e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c01000c0 0x7f08c010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08c572e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c010e570 con 0x7f08c00663e0 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08c572e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c010edb0 con 0x7f08c01000c0 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36004/0 (socket says 172.21.15.123:36004) 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 -- 172.21.15.123:0/3207275721 learned_addr learned my addr 172.21.15.123:0/3207275721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08b67fc700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c01000c0 0x7f08c010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 -- 172.21.15.123:0/3207275721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c01000c0 msgr2=0x7f08c010dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c01000c0 0x7f08c010dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 -- 172.21.15.123:0/3207275721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8005040 con 0x7f08c00663e0 2024-02-20T07:59:13.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.120+0000 7f08beffd700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08b000b790 tx=0x7f08b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:59:13.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.121+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08b000f6f0 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.121+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08b000fd20 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.121+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c010f090 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.121+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08b00103a0 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.121+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c010f5d0 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.122+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c004bed0 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.122+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f08b000f850 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.123+0000 7f08b7fff700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 0x7f08ac06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.123+0000 7f08b67fc700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 0x7f08ac06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.123+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f08b0086270 con 0x7f08c00663e0 2024-02-20T07:59:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.123+0000 7f08b67fc700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 0x7f08ac06b6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08a8004890 tx=0x7f08a8009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:59:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.127+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f08b0056d00 con 0x7f08c00663e0 2024-02-20T07:59:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:13.332+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f08c0100d60 con 0x7f08ac069210 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi123 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi123 to 6432M 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:13 smithi123 ceph-mon[29383]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi123 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi123 to 6432M 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:13 smithi194 ceph-mon[37804]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:14.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:14 smithi194 ceph-mon[37804]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:59:14.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:59:14.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:59:14.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:14.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:14 smithi123 ceph-mon[29383]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:59:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:59:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:59:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:15 smithi123 ceph-mon[29383]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:15 smithi194 ceph-mon[37804]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:16 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/4175825355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7d20260-3e6a-47f3-a055-f6bd8b0ecf22"}]: dispatch 2024-02-20T07:59:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:16 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/4175825355' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7d20260-3e6a-47f3-a055-f6bd8b0ecf22"}]': finished 2024-02-20T07:59:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:16 smithi194 ceph-mon[37804]: osdmap e16: 3 total, 2 up, 3 in 2024-02-20T07:59:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:17.190 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:16 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/4175825355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7d20260-3e6a-47f3-a055-f6bd8b0ecf22"}]: dispatch 2024-02-20T07:59:17.190 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:16 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/4175825355' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7d20260-3e6a-47f3-a055-f6bd8b0ecf22"}]': finished 2024-02-20T07:59:17.190 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:16 smithi123 ceph-mon[29383]: osdmap e16: 3 total, 2 up, 3 in 2024-02-20T07:59:17.191 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:18.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:17 smithi123 ceph-mon[29383]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:18.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:17 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/4052933382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:59:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:17 smithi194 ceph-mon[37804]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:17 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/4052933382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:19.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:21.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:21 smithi123 ceph-mon[29383]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:21 smithi194 ceph-mon[37804]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:24.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:23 smithi123 ceph-mon[29383]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:24.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T07:59:24.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:23 smithi194 ceph-mon[37804]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:24.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T07:59:24.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:24 smithi123 ceph-mon[29383]: Deploying daemon osd.2 on smithi123 2024-02-20T07:59:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:24 smithi194 ceph-mon[37804]: Deploying daemon osd.2 on smithi123 2024-02-20T07:59:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:25 smithi194 ceph-mon[37804]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:26.248 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:25 smithi123 ceph-mon[29383]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:27 smithi194 ceph-mon[37804]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:28.147 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:27 smithi123 ceph-mon[29383]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:29 smithi123 ceph-mon[29383]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:29 smithi194 ceph-mon[37804]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:31 smithi123 ceph-mon[29383]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:31 smithi194 ceph-mon[37804]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:33.139 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:32 smithi123 ceph-mon[29383]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-20T07:59:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:32 smithi194 ceph-mon[37804]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-20T07:59:33.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.197+0000 7f08b7fff700 1 -- 172.21.15.123:0/3207275721 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f08c0100d60 con 0x7f08ac069210 2024-02-20T07:59:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 2 on host 'smithi123' 2024-02-20T07:59:33.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 msgr2=0x7f08ac06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:33.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 0x7f08ac06b6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08a8004890 tx=0x7f08a8009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:33.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 msgr2=0x7f08c010d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:33.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08b000b790 tx=0x7f08b0009250 comp rx=0 tx=0).stop 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 shutdown_connections 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f08ac069210 0x7f08ac06b6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08c00663e0 0x7f08c010d9a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 --2- 172.21.15.123:0/3207275721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08c01000c0 0x7f08c010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 >> 172.21.15.123:0/3207275721 conn(0x7f08c00f74e0 msgr2=0x7f08c00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 shutdown_connections 2024-02-20T07:59:33.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T07:59:33.200+0000 7f08c572e700 1 -- 172.21.15.123:0/3207275721 wait complete. 2024-02-20T07:59:34.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:34.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-20T07:59:34.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: osdmap e17: 3 total, 2 up, 3 in 2024-02-20T07:59:34.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:34.138 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:59:34.139 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:34.139 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:34.139 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-20T07:59:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: osdmap e17: 3 total, 2 up, 3 in 2024-02-20T07:59:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T07:59:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:34.421 DEBUG:teuthology.orchestra.run.smithi123:osd.2> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.2.service 2024-02-20T07:59:34.423 INFO:tasks.cephadm:Deploying osd.3 on smithi194 with /dev/vg_nvme/lv_4... 2024-02-20T07:59:34.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-20T07:59:34.695 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T07:59:34.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:34 smithi123 ceph-mon[29383]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:59:34.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:34 smithi123 ceph-mon[29383]: osdmap e18: 3 total, 2 up, 3 in 2024-02-20T07:59:34.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:34.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:34 smithi194 ceph-mon[37804]: from='osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-02-20T07:59:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:34 smithi194 ceph-mon[37804]: osdmap e18: 3 total, 2 up, 3 in 2024-02-20T07:59:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] boot 2024-02-20T07:59:36.037 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: osdmap e19: 3 total, 3 up, 3 in 2024-02-20T07:59:36.038 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:36.038 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:36.038 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:35 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: osd.2 [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] boot 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: osdmap e19: 3 total, 3 up, 3 in 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:36.174 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:35 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114397 s, 917 MB/s 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 2024-02-20T07:59:36.606 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-02-20T07:59:37.236 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-02-20T07:59:37.497 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T07:59:37.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:37 smithi194 ceph-mon[37804]: osdmap e20: 3 total, 3 up, 3 in 2024-02-20T07:59:37.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:37 smithi194 ceph-mon[37804]: pgmap v77: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:37.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-20T07:59:37.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:37 smithi123 ceph-mon[29383]: osdmap e20: 3 total, 3 up, 3 in 2024-02-20T07:59:37.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:37 smithi123 ceph-mon[29383]: pgmap v77: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:37.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-20T07:59:38.439 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:38 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-20T07:59:38.439 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:38 smithi123 ceph-mon[29383]: osdmap e21: 3 total, 3 up, 3 in 2024-02-20T07:59:38.439 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:38 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-20T07:59:38.573 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:38 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-20T07:59:38.573 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:38 smithi194 ceph-mon[37804]: osdmap e21: 3 total, 3 up, 3 in 2024-02-20T07:59:38.573 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:38 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-20T07:59:39.134 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:38 smithi123 sudo[67862]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-20T07:59:39.134 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:38 smithi123 sudo[67862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:39.134 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:38 smithi123 sudo[67862]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:39.135 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:38 smithi123 sudo[67862]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:39.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 -- 172.21.15.194:0/1821456097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 msgr2=0x7f1d700fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:39.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1821456097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d700fc1e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1d64004880 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:39.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 -- 172.21.15.194:0/1821456097 shutdown_connections 2024-02-20T07:59:39.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1821456097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d700fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:39.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1821456097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d700fc1e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:39.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 -- 172.21.15.194:0/1821456097 >> 172.21.15.194:0/1821456097 conn(0x7f1d700f7490 msgr2=0x7f1d700f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:59:39.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 -- 172.21.15.194:0/1821456097 shutdown_connections 2024-02-20T07:59:39.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.167+0000 7f1d751e7700 1 -- 172.21.15.194:0/1821456097 wait complete. 2024-02-20T07:59:39.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 Processor -- start 2024-02-20T07:59:39.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 -- start start 2024-02-20T07:59:39.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d7010c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d7010ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7010d2d0 con 0x7f1d700fcfe0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d751e7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7010db70 con 0x7f1d700fbdd0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d6ed9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d7010c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d6ed9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d7010c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49160/0 (socket says 172.21.15.194:49160) 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d6ed9d700 1 -- 172.21.15.194:0/1438038169 learned_addr learned my addr 172.21.15.194:0/1438038169 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.168+0000 7f1d6e59c700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d7010ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d6e59c700 1 -- 172.21.15.194:0/1438038169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 msgr2=0x7f1d7010c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d6e59c700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d7010c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d6e59c700 1 -- 172.21.15.194:0/1438038169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60005040 con 0x7f1d700fcfe0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d6e59c700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d7010ccd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d600096d0 tx=0x7f1d60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d60017070 con 0x7f1d700fcfe0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d6000f040 con 0x7f1d700fcfe0 2024-02-20T07:59:39.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d60013b70 con 0x7f1d700fcfe0 2024-02-20T07:59:39.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d64005040 con 0x7f1d700fcfe0 2024-02-20T07:59:39.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.169+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7010e1c0 con 0x7f1d700fcfe0 2024-02-20T07:59:39.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.170+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7004bed0 con 0x7f1d700fcfe0 2024-02-20T07:59:39.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.171+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f1d6000e840 con 0x7f1d700fcfe0 2024-02-20T07:59:39.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.171+0000 7f1d577fe700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 0x7f1d5806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T07:59:39.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.171+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f1d600864a0 con 0x7f1d700fcfe0 2024-02-20T07:59:39.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.171+0000 7f1d6ed9d700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 0x7f1d5806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T07:59:39.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.171+0000 7f1d6ed9d700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 0x7f1d5806b6c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009fd0 tx=0x7f1d64009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T07:59:39.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.176+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1d60056b60 con 0x7f1d700fcfe0 2024-02-20T07:59:39.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:39.374+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d7010e7e0 con 0x7f1d58069210 2024-02-20T07:59:39.416 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67865]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-20T07:59:39.416 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:39.416 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67865]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:39.417 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67865]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: osdmap e22: 3 total, 3 up, 3 in 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi123 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi123 to 4288M 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.417 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:39.418 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:39.418 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.418 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:39.418 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:39 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: osdmap e22: 3 total, 3 up, 3 in 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi123 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi123 to 4288M 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:39 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:39.670 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67900]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-20T07:59:39.671 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67900]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:39.671 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67900]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:39.671 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67900]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67903]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67903]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67903]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67906]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-20T07:59:39.929 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67906]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:39.930 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67906]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:39.930 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:39 smithi123 sudo[67906]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:40.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:40.166+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1d600534a0 con 0x7f1d700fcfe0 2024-02-20T07:59:40.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67909]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-20T07:59:40.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67909]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:40.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67909]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:40.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67909]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:40.667 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67912]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-20T07:59:40.668 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67912]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:40.668 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67912]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:40.668 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67912]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67915]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67915]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67915]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 sudo[67915]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: osdmap e23: 3 total, 3 up, 3 in 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='client.14318 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:59:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:59:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:59:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: mgrmap e19: smithi123.kwyrtl(active, since 2m), standbys: smithi194.pvhorj 2024-02-20T07:59:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:40 smithi123 ceph-mon[29383]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-20T07:59:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:40 smithi194 sudo[41288]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-20T07:59:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:40 smithi194 sudo[41288]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:40 smithi194 sudo[41288]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:40 smithi194 sudo[41288]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 sudo[41299]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 sudo[41299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 sudo[41299]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 sudo[41299]: pam_unix(sudo:session): session closed for user root 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: osdmap e23: 3 total, 3 up, 3 in 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='client.14318 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T07:59:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: mgrmap e19: smithi123.kwyrtl(active, since 2m), standbys: smithi194.pvhorj 2024-02-20T07:59:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-20T07:59:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-20T07:59:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/3838088490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]: dispatch 2024-02-20T07:59:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]: dispatch 2024-02-20T07:59:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]': finished 2024-02-20T07:59:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: osdmap e24: 4 total, 3 up, 4 in 2024-02-20T07:59:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T07:59:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:42 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/885295350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:59:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3838088490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]: dispatch 2024-02-20T07:59:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]: dispatch 2024-02-20T07:59:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5455da3-b3a2-4204-94ec-1d4a73d3f673"}]': finished 2024-02-20T07:59:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: osdmap e24: 4 total, 3 up, 4 in 2024-02-20T07:59:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T07:59:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:42 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/885295350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T07:59:44.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:43 smithi123 ceph-mon[29383]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:44.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:43 smithi194 ceph-mon[37804]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:46.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:45 smithi194 ceph-mon[37804]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:46.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:45 smithi123 ceph-mon[29383]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:48.080 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:47 smithi194 ceph-mon[37804]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:47 smithi123 ceph-mon[29383]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:49.109 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:48 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:49.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:48 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T07:59:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:49 smithi194 ceph-mon[37804]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:49 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T07:59:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:49 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:50.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:49 smithi123 ceph-mon[29383]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:50.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:49 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T07:59:50.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:49 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T07:59:51.026 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:50 smithi194 ceph-mon[37804]: Deploying daemon osd.3 on smithi194 2024-02-20T07:59:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:50 smithi123 ceph-mon[29383]: Deploying daemon osd.3 on smithi194 2024-02-20T07:59:52.131 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:51 smithi194 ceph-mon[37804]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:52.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:51 smithi123 ceph-mon[29383]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:54.142 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:53 smithi194 ceph-mon[37804]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:54.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:53 smithi123 ceph-mon[29383]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:55.638 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:55.638 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:55.638 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:55.638 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:55 smithi194 ceph-mon[37804]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T07:59:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:55 smithi123 ceph-mon[29383]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:57.892 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:57 smithi194 ceph-mon[37804]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:57 smithi123 ceph-mon[29383]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:58.238 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 3 on host 'smithi194' 2024-02-20T07:59:58.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.237+0000 7f1d577fe700 1 -- 172.21.15.194:0/1438038169 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1d7010e7e0 con 0x7f1d58069210 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 msgr2=0x7f1d5806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 0x7f1d5806b6c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009fd0 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 msgr2=0x7f1d7010ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d7010ccd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d600096d0 tx=0x7f1d60009e30 comp rx=0 tx=0).stop 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 shutdown_connections 2024-02-20T07:59:58.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1d58069210 0x7f1d5806b6c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:58.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d700fbdd0 0x7f1d7010c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:58.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 --2- 172.21.15.194:0/1438038169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d700fcfe0 0x7f1d7010ccd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T07:59:58.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 >> 172.21.15.194:0/1438038169 conn(0x7f1d700f7490 msgr2=0x7f1d70100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T07:59:58.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 shutdown_connections 2024-02-20T07:59:58.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T07:59:58.239+0000 7f1d751e7700 1 -- 172.21.15.194:0/1438038169 wait complete. 2024-02-20T07:59:58.835 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T07:59:58.836 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T07:59:58.836 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:58.836 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:58.836 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:58.836 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:58 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:58.859 DEBUG:teuthology.orchestra.run.smithi194:osd.3> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.3.service 2024-02-20T07:59:58.861 INFO:tasks.cephadm:Deploying osd.4 on smithi194 with /dev/vg_nvme/lv_3... 2024-02-20T07:59:58.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-20T07:59:59.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T07:59:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T07:59:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:58 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T07:59:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T07:59:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T07:59:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-20T07:59:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: osdmap e25: 4 total, 3 up, 4 in 2024-02-20T07:59:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T07:59:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: from='osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T07:59:59.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-mon[37804]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T07:59:59.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[43395]: 2024-02-20T07:59:59.526+0000 7fac7bb82700 -1 osd.3 0 waiting for initial osdmap 2024-02-20T07:59:59.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 07:59:59 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[43395]: 2024-02-20T07:59:59.533+0000 7fac7617c700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:00:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T08:00:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-20T08:00:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: osdmap e25: 4 total, 3 up, 4 in 2024-02-20T08:00:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: from='osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 07:59:59 smithi123 ceph-mon[29383]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: osdmap e26: 4 total, 3 up, 4 in 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] boot 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: osdmap e27: 4 total, 4 up, 4 in 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:00.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:00 smithi194 ceph-mon[37804]: overall HEALTH_OK 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: osdmap e26: 4 total, 3 up, 4 in 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: osd.3 [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] boot 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: osdmap e27: 4 total, 4 up, 4 in 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:00:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:00 smithi123 ceph-mon[29383]: overall HEALTH_OK 2024-02-20T08:00:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:01 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T08:00:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:01 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T08:00:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:01 smithi194 ceph-mon[37804]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T08:00:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:01 smithi194 ceph-mon[37804]: osdmap e28: 4 total, 4 up, 4 in 2024-02-20T08:00:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:01 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T08:00:02.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:01 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T08:00:02.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:01 smithi123 ceph-mon[29383]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-20T08:00:02.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:01 smithi123 ceph-mon[29383]: osdmap e28: 4 total, 4 up, 4 in 2024-02-20T08:00:02.935 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-20T08:00:02.936 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-20T08:00:02.936 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-02-20T08:00:02.936 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-02-20T08:00:02.936 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132072 s, 794 MB/s 2024-02-20T08:00:02.936 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-02-20T08:00:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: osdmap e29: 4 total, 4 up, 4 in 2024-02-20T08:00:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:02 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: osdmap e29: 4 total, 4 up, 4 in 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:03.160 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:03.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:03.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:03.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:03.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:02 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:03.569 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-02-20T08:00:03.822 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T08:00:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:03 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi194 2024-02-20T08:00:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:03 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi194 to 15936M 2024-02-20T08:00:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:03 smithi194 ceph-mon[37804]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:03 smithi194 ceph-mon[37804]: osdmap e30: 4 total, 4 up, 4 in 2024-02-20T08:00:04.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:03 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:03 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi194 2024-02-20T08:00:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:03 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi194 to 15936M 2024-02-20T08:00:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:03 smithi123 ceph-mon[29383]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:03 smithi123 ceph-mon[29383]: osdmap e30: 4 total, 4 up, 4 in 2024-02-20T08:00:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:03 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:05.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:04 smithi194 ceph-mon[37804]: osdmap e31: 4 total, 4 up, 4 in 2024-02-20T08:00:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:04 smithi123 ceph-mon[29383]: osdmap e31: 4 total, 4 up, 4 in 2024-02-20T08:00:05.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 -- 172.21.15.194:0/2764682734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fcef0 msgr2=0x7f58900fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 --2- 172.21.15.194:0/2764682734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fcef0 0x7f58900fd320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f588c004970 tx=0x7f588c009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 -- 172.21.15.194:0/2764682734 shutdown_connections 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 --2- 172.21.15.194:0/2764682734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fe0e0 0x7f58900fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 --2- 172.21.15.194:0/2764682734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fcef0 0x7f58900fd320 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 -- 172.21.15.194:0/2764682734 >> 172.21.15.194:0/2764682734 conn(0x7f58900f8620 msgr2=0x7f58900faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 -- 172.21.15.194:0/2764682734 shutdown_connections 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.570+0000 7f5897ff8700 1 -- 172.21.15.194:0/2764682734 wait complete. 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 Processor -- start 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 -- start start 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fcef0 0x7f5890071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:05.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900708e0 con 0x7f58900fcef0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5897ff8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5890070a50 con 0x7f58900fe0e0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39524/0 (socket says 172.21.15.194:39524) 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 -- 172.21.15.194:0/1404161121 learned_addr learned my addr 172.21.15.194:0/1404161121 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895d94700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fcef0 0x7f5890071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 -- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fcef0 msgr2=0x7f5890071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fcef0 0x7f5890071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 -- 172.21.15.194:0/1404161121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c005040 con 0x7f58900fe0e0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.571+0000 7f5895593700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f588000c830 tx=0x7f5880004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.572+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588000a760 con 0x7f58900fe0e0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.572+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f588000ad90 con 0x7f58900fe0e0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.572+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5890070d30 con 0x7f58900fe0e0 2024-02-20T08:00:05.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.572+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58800113a0 con 0x7f58900fe0e0 2024-02-20T08:00:05.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.572+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5890115920 con 0x7f58900fe0e0 2024-02-20T08:00:05.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.573+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589004bed0 con 0x7f58900fe0e0 2024-02-20T08:00:05.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.573+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f588000a8c0 con 0x7f58900fe0e0 2024-02-20T08:00:05.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.573+0000 7f58867fc700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 0x7f587c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:05.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.574+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f5880086a70 con 0x7f58900fe0e0 2024-02-20T08:00:05.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.574+0000 7f5895d94700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 0x7f587c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:05.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.574+0000 7f5895d94700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 0x7f587c06b760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f588c009fd0 tx=0x7f588c009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:05.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.578+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5880056f70 con 0x7f58900fe0e0 2024-02-20T08:00:05.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:05.767+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5890102ac0 con 0x7f587c0692b0 2024-02-20T08:00:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:05 smithi194 ceph-mon[37804]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-20T08:00:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:05 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T08:00:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:05 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T08:00:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:05 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:05 smithi123 ceph-mon[29383]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-20T08:00:06.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:05 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T08:00:06.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:05 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T08:00:06.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:05 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:06 smithi194 ceph-mon[37804]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:00:07.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:06 smithi123 ceph-mon[29383]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:00:08.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:07 smithi194 ceph-mon[37804]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-20T08:00:08.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:07 smithi123 ceph-mon[29383]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-20T08:00:08.917 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:08 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/2642661342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]: dispatch 2024-02-20T08:00:08.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:08 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]: dispatch 2024-02-20T08:00:08.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:08 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]': finished 2024-02-20T08:00:08.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:08 smithi194 ceph-mon[37804]: osdmap e32: 5 total, 4 up, 5 in 2024-02-20T08:00:08.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:08 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:08 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2642661342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]: dispatch 2024-02-20T08:00:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:08 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]: dispatch 2024-02-20T08:00:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:08 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82e0e899-c58d-4be5-9ad8-2612862c87a6"}]': finished 2024-02-20T08:00:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:08 smithi123 ceph-mon[29383]: osdmap e32: 5 total, 4 up, 5 in 2024-02-20T08:00:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:08 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:09 smithi123 ceph-mon[29383]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-20T08:00:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:09 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/3495146448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T08:00:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:09 smithi194 ceph-mon[37804]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-20T08:00:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:09 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/3495146448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T08:00:12.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:11 smithi194 ceph-mon[37804]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-02-20T08:00:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:11 smithi123 ceph-mon[29383]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-02-20T08:00:14.183 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:13 smithi194 ceph-mon[37804]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:13 smithi123 ceph-mon[29383]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:16.226 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:15 smithi194 ceph-mon[37804]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:16.226 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:00:16.226 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:16.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:15 smithi123 ceph-mon[29383]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:16.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:00:16.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:17.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:16 smithi123 ceph-mon[29383]: Deploying daemon osd.4 on smithi194 2024-02-20T08:00:17.259 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:16 smithi194 ceph-mon[37804]: Deploying daemon osd.4 on smithi194 2024-02-20T08:00:18.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:17 smithi194 ceph-mon[37804]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:18.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:17 smithi123 ceph-mon[29383]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:18 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:20.100 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:19 smithi194 ceph-mon[37804]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:19 smithi123 ceph-mon[29383]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:21 smithi123 ceph-mon[29383]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:21 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:21 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:21 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:22.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:21 smithi194 ceph-mon[37804]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:22.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:21 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:22.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:21 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:22.084 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:21 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:23.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.576+0000 7f58867fc700 1 -- 172.21.15.194:0/1404161121 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5890102ac0 con 0x7f587c0692b0 2024-02-20T08:00:23.578 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 4 on host 'smithi194' 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 msgr2=0x7f587c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 0x7f587c06b760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f588c009fd0 tx=0x7f588c009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 msgr2=0x7f58900702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f588000c830 tx=0x7f5880004470 comp rx=0 tx=0).stop 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 shutdown_connections 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f587c0692b0 0x7f587c06b760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58900fcef0 0x7f5890071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 --2- 172.21.15.194:0/1404161121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58900fe0e0 0x7f58900702e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 >> 172.21.15.194:0/1404161121 conn(0x7f58900f8620 msgr2=0x7f58901013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 shutdown_connections 2024-02-20T08:00:23.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:23.579+0000 7f5897ff8700 1 -- 172.21.15.194:0/1404161121 wait complete. 2024-02-20T08:00:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:23 smithi194 ceph-mon[37804]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:23 smithi123 ceph-mon[29383]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:24.539 DEBUG:teuthology.orchestra.run.smithi194:osd.4> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.4.service 2024-02-20T08:00:24.542 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_2... 2024-02-20T08:00:24.542 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-20T08:00:24.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:24 smithi194 ceph-mon[37804]: from='osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:00:24.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:24 smithi194 ceph-mon[37804]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:00:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:24 smithi123 ceph-mon[29383]: from='osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:00:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:24 smithi123 ceph-mon[29383]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:00:25.276 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: osdmap e33: 5 total, 4 up, 5 in 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:26.006 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:26.006 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[50255]: 2024-02-20T08:00:25.710+0000 7f541fa10700 -1 osd.4 0 waiting for initial osdmap 2024-02-20T08:00:26.007 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:00:25 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[50255]: 2024-02-20T08:00:25.717+0000 7f5419809700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:00:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: osdmap e33: 5 total, 4 up, 5 in 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:25 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:26 smithi194 ceph-mon[37804]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:26 smithi194 ceph-mon[37804]: osdmap e34: 5 total, 4 up, 5 in 2024-02-20T08:00:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:26 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:26 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:26 smithi123 ceph-mon[29383]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:26 smithi123 ceph-mon[29383]: osdmap e34: 5 total, 4 up, 5 in 2024-02-20T08:00:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:26 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:26 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:27.170 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-20T08:00:27.170 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-20T08:00:27.170 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-02-20T08:00:27.170 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-02-20T08:00:27.171 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130342 s, 804 MB/s 2024-02-20T08:00:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-02-20T08:00:27.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T08:00:27.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T08:00:27.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:27.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] boot 2024-02-20T08:00:27.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: osdmap e35: 5 total, 5 up, 5 in 2024-02-20T08:00:27.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:27 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:28.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T08:00:28.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T08:00:28.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-20T08:00:28.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: osd.4 [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] boot 2024-02-20T08:00:28.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: osdmap e35: 5 total, 5 up, 5 in 2024-02-20T08:00:28.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:27 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:00:28.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-02-20T08:00:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:28 smithi123 ceph-mon[29383]: osdmap e36: 5 total, 5 up, 5 in 2024-02-20T08:00:29.027 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:28 smithi194 ceph-mon[37804]: osdmap e36: 5 total, 5 up, 5 in 2024-02-20T08:00:29.211 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T08:00:29.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:29 smithi194 ceph-mon[37804]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:29 smithi123 ceph-mon[29383]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 -- 172.21.15.194:0/1123029873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098071eb0 msgr2=0x7fa098070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 --2- 172.21.15.194:0/1123029873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098071eb0 0x7fa098070320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa088004940 tx=0x7fa088009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 -- 172.21.15.194:0/1123029873 shutdown_connections 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 --2- 172.21.15.194:0/1123029873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098070860 0x7fa098070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 --2- 172.21.15.194:0/1123029873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098071eb0 0x7fa098070320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:31.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 -- 172.21.15.194:0/1123029873 >> 172.21.15.194:0/1123029873 conn(0x7fa0980f8620 msgr2=0x7fa0980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 -- 172.21.15.194:0/1123029873 shutdown_connections 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 -- 172.21.15.194:0/1123029873 wait complete. 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.474+0000 7fa09e699700 1 Processor -- start 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa09e699700 1 -- start start 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa09e699700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa09e699700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098071eb0 0x7fa0981100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa09e699700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098110750 con 0x7fa098071eb0 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa09e699700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098110f90 con 0x7fa098070860 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:45720/0 (socket says 172.21.15.194:45720) 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 -- 172.21.15.194:0/3149841026 learned_addr learned my addr 172.21.15.194:0/3149841026 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa0977fe700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098071eb0 0x7fa0981100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 -- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098071eb0 msgr2=0x7fa0981100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:31.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098071eb0 0x7fa0981100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 -- 172.21.15.194:0/3149841026 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088005040 con 0x7fa098070860 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.475+0000 7fa097fff700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa088009fd0 tx=0x7fa088009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.476+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08800e040 con 0x7fa098070860 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.476+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa08800bcc0 con 0x7fa098070860 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.476+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa098111210 con 0x7fa098070860 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.476+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08801c630 con 0x7fa098070860 2024-02-20T08:00:31.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.476+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa098111750 con 0x7fa098070860 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.477+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09804bed0 con 0x7fa098070860 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.477+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa088013980 con 0x7fa098070860 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.477+0000 7fa094ff9700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 0x7fa08006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.478+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fa088088160 con 0x7fa098070860 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.478+0000 7fa0977fe700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 0x7fa08006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:31.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.478+0000 7fa0977fe700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 0x7fa08006b760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa08c006fd0 tx=0x7fa08c008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:31.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.482+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa088058410 con 0x7fa098070860 2024-02-20T08:00:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi194 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi194 to 7968M 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:31 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:31.670+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa098104550 con 0x7fa0800692b0 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi194 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi194 to 7968M 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:31 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:32 smithi194 ceph-mon[37804]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:00:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:32 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T08:00:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:32 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T08:00:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:32 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:32 smithi123 ceph-mon[29383]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:00:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:32 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-20T08:00:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:32 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-20T08:00:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:32 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:33.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:33 smithi194 ceph-mon[37804]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:33.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:33 smithi123 ceph-mon[29383]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:34.585 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:34 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/960530250' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]: dispatch 2024-02-20T08:00:34.585 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:34 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]: dispatch 2024-02-20T08:00:34.585 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:34 smithi194 ceph-mon[37804]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]': finished 2024-02-20T08:00:34.585 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:34 smithi194 ceph-mon[37804]: osdmap e37: 6 total, 5 up, 6 in 2024-02-20T08:00:34.585 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:34 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/960530250' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]: dispatch 2024-02-20T08:00:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:34 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]: dispatch 2024-02-20T08:00:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:34 smithi123 ceph-mon[29383]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19386ed7-00c6-4412-92da-95b40c4acb32"}]': finished 2024-02-20T08:00:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:34 smithi123 ceph-mon[29383]: osdmap e37: 6 total, 5 up, 6 in 2024-02-20T08:00:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:35 smithi194 ceph-mon[37804]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:35 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/2175809119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T08:00:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:35 smithi123 ceph-mon[29383]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:36.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:35 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/2175809119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-20T08:00:37.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:37 smithi194 ceph-mon[37804]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:37 smithi123 ceph-mon[29383]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:39 smithi194 ceph-mon[37804]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:39 smithi123 ceph-mon[29383]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:42.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:41 smithi194 ceph-mon[37804]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:42.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:00:42.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:41 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:41 smithi123 ceph-mon[29383]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:00:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:41 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:42.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:42 smithi194 ceph-mon[37804]: Deploying daemon osd.5 on smithi194 2024-02-20T08:00:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:42 smithi123 ceph-mon[29383]: Deploying daemon osd.5 on smithi194 2024-02-20T08:00:43.972 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:43 smithi194 ceph-mon[37804]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:44.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:43 smithi123 ceph-mon[29383]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:46.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:45 smithi194 ceph-mon[37804]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:45 smithi123 ceph-mon[29383]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:47 smithi123 ceph-mon[29383]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:48.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:47 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:48.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:47 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:48.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:47 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:48.051 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:47 smithi194 ceph-mon[37804]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:48.051 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:48.051 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:48.051 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:47 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:48.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:48 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:48 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:00:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:49 smithi123 ceph-mon[29383]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:49 smithi194 ceph-mon[37804]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:50.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.885+0000 7fa094ff9700 1 -- 172.21.15.194:0/3149841026 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa098104550 con 0x7fa0800692b0 2024-02-20T08:00:50.887 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-02-20T08:00:50.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 msgr2=0x7fa08006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:50.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 0x7fa08006b760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa08c006fd0 tx=0x7fa08c008040 comp rx=0 tx=0).stop 2024-02-20T08:00:50.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 msgr2=0x7fa09810fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:50.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa088009fd0 tx=0x7fa088009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 shutdown_connections 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa0800692b0 0x7fa08006b760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa098070860 0x7fa09810fb80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 --2- 172.21.15.194:0/3149841026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa098071eb0 0x7fa0981100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 >> 172.21.15.194:0/3149841026 conn(0x7fa0980f8620 msgr2=0x7fa098102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 shutdown_connections 2024-02-20T08:00:50.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:00:50.887+0000 7fa09e699700 1 -- 172.21.15.194:0/3149841026 wait complete. 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:51.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:51.442 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.442 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.442 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.442 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:00:51.663 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.5.service 2024-02-20T08:00:51.665 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-20T08:00:51.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-20T08:00:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:00:52.336 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:52 smithi123 ceph-mon[29383]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-20T08:00:52.336 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:52 smithi123 ceph-mon[29383]: osdmap e38: 6 total, 5 up, 6 in 2024-02-20T08:00:52.337 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:52 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:52.337 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:52 smithi123 ceph-mon[29383]: from='osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:52.337 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:52 smithi123 ceph-mon[29383]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:52.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-mon[37804]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-20T08:00:52.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-mon[37804]: osdmap e38: 6 total, 5 up, 6 in 2024-02-20T08:00:52.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:52.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-mon[37804]: from='osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:52.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-mon[37804]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:00:52.536 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[57175]: 2024-02-20T08:00:52.170+0000 7fc3e779d700 -1 osd.5 0 waiting for initial osdmap 2024-02-20T08:00:52.537 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:00:52 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[57175]: 2024-02-20T08:00:52.179+0000 7fc3ded91700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:00:53.365 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:53 smithi123 ceph-mon[29383]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:53.365 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:53 smithi123 ceph-mon[29383]: osdmap e39: 6 total, 5 up, 6 in 2024-02-20T08:00:53.365 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:53 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:53.366 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:53 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:53.366 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:53 smithi123 ceph-mon[29383]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:53 smithi194 ceph-mon[37804]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-02-20T08:00:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:53 smithi194 ceph-mon[37804]: osdmap e39: 6 total, 5 up, 6 in 2024-02-20T08:00:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:53 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:53 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:53 smithi194 ceph-mon[37804]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-20T08:00:53.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 -- 172.21.15.123:0/3570362665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fcfb0 msgr2=0x7ff6340fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 --2- 172.21.15.123:0/3570362665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fcfb0 0x7ff6340fd420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff628004940 tx=0x7ff628009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 -- 172.21.15.123:0/3570362665 shutdown_connections 2024-02-20T08:00:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 --2- 172.21.15.123:0/3570362665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fcfb0 0x7ff6340fd420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 --2- 172.21.15.123:0/3570362665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fbe40 0x7ff6340fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 -- 172.21.15.123:0/3570362665 >> 172.21.15.123:0/3570362665 conn(0x7ff6340f74e0 msgr2=0x7ff6340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 -- 172.21.15.123:0/3570362665 shutdown_connections 2024-02-20T08:00:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.706+0000 7ff63995a700 1 -- 172.21.15.123:0/3570362665 wait complete. 2024-02-20T08:00:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 Processor -- start 2024-02-20T08:00:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 -- start start 2024-02-20T08:00:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:53.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fcfb0 0x7ff63410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:53.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63410e400 con 0x7ff6340fbe40 2024-02-20T08:00:53.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff63995a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63410eca0 con 0x7ff6340fcfb0 2024-02-20T08:00:53.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:53.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45290/0 (socket says 172.21.15.123:45290) 2024-02-20T08:00:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 -- 172.21.15.123:0/3975010995 learned_addr learned my addr 172.21.15.123:0/3975010995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:00:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff6327fc700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fcfb0 0x7ff63410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 -- 172.21.15.123:0/3975010995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fcfb0 msgr2=0x7ff63410de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fcfb0 0x7ff63410de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.707+0000 7ff632ffd700 1 -- 172.21.15.123:0/3975010995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628005040 con 0x7ff6340fbe40 2024-02-20T08:00:53.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff632ffd700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff624002a80 tx=0x7ff6240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:53.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff624007cc0 con 0x7ff6340fbe40 2024-02-20T08:00:53.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff62400f040 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63410ef80 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62400dac0 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.708+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63410f4c0 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.709+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404bed0 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.709+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff62400dc20 con 0x7ff6340fbe40 2024-02-20T08:00:53.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.710+0000 7ff61b7fe700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 0x7ff61c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:53.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.710+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff624086a90 con 0x7ff6340fbe40 2024-02-20T08:00:53.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.710+0000 7ff6327fc700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 0x7ff61c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:53.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.710+0000 7ff6327fc700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 0x7ff61c06b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b7a0 tx=0x7ff628009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:53.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.714+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff624056b10 con 0x7ff6340fbe40 2024-02-20T08:00:53.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.899+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff634104930 con 0x7ff6340fbe40 2024-02-20T08:00:53.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.899+0000 7ff61b7fe700 1 -- 172.21.15.123:0/3975010995 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff6240566a0 con 0x7ff6340fbe40 2024-02-20T08:00:53.901 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:00:53.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 msgr2=0x7ff61c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:53.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 0x7ff61c06b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b7a0 tx=0x7ff628009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 msgr2=0x7ff63410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff624002a80 tx=0x7ff6240046b0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 shutdown_connections 2024-02-20T08:00:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff61c0692b0 0x7ff61c06b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6340fbe40 0x7ff63410d8c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 --2- 172.21.15.123:0/3975010995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6340fcfb0 0x7ff63410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 >> 172.21.15.123:0/3975010995 conn(0x7ff6340f74e0 msgr2=0x7ff6340656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 shutdown_connections 2024-02-20T08:00:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:53.901+0000 7ff63995a700 1 -- 172.21.15.123:0/3975010995 wait complete. 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: purged_snaps scrub starts 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: purged_snaps scrub ok 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] boot 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: osdmap e40: 6 total, 6 up, 6 in 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:54.268 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:54 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3975010995' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-20T08:00:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: purged_snaps scrub starts 2024-02-20T08:00:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: purged_snaps scrub ok 2024-02-20T08:00:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: osd.5 [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] boot 2024-02-20T08:00:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: osdmap e40: 6 total, 6 up, 6 in 2024-02-20T08:00:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:00:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:54 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3975010995' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-20T08:00:54.691 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1708416053,"num_in_osds":6,"osd_in_since":1708416034,"num_remapped_pgs":0} 2024-02-20T08:00:54.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-20T08:00:54.947 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: osdmap e41: 6 total, 6 up, 6 in 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: Detected new or changed devices on smithi194 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.384 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi194 to 5312M 2024-02-20T08:00:55.385 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.385 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:55.385 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:55.385 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:55 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: osdmap e41: 6 total, 6 up, 6 in 2024-02-20T08:00:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:00:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi194 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi194 to 5312M 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:00:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:55 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:00:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 -- 172.21.15.123:0/2859601210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 msgr2=0x7f609c0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 --2- 172.21.15.123:0/2859601210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c0fe320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f608c004940 tx=0x7f608c009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 -- 172.21.15.123:0/2859601210 shutdown_connections 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 --2- 172.21.15.123:0/2859601210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 0x7f609c106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 --2- 172.21.15.123:0/2859601210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c0fe320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.696+0000 7f60a11f3700 1 -- 172.21.15.123:0/2859601210 >> 172.21.15.123:0/2859601210 conn(0x7f609c0f7a10 msgr2=0x7f609c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 -- 172.21.15.123:0/2859601210 shutdown_connections 2024-02-20T08:00:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 -- 172.21.15.123:0/2859601210 wait complete. 2024-02-20T08:00:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 Processor -- start 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 -- start start 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 0x7f609c113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c114620 con 0x7f609c0fdf50 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.697+0000 7f60a11f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c10d950 con 0x7f609c0fe8f0 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45316/0 (socket says 172.21.15.123:45316) 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 -- 172.21.15.123:0/161713369 learned_addr learned my addr 172.21.15.123:0/161713369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609a59c700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 0x7f609c113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 -- 172.21.15.123:0/161713369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 msgr2=0x7f609c113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 0x7f609c113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 -- 172.21.15.123:0/161713369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c005040 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f609ad9d700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f608c004890 tx=0x7f608c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608c00e040 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c10dbd0 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f608c004290 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608c01c3f0 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.698+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c10e110 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.699+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c104620 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.699+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f608c01c670 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.700+0000 7f60837fe700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 0x7f608406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.700+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f608c088150 con 0x7f609c0fdf50 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.700+0000 7f609a59c700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 0x7f608406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.700+0000 7f609a59c700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 0x7f608406b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f609c10f2c0 tx=0x7f609000b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:56.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.704+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f608c058260 con 0x7f609c0fdf50 2024-02-20T08:00:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.891+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f609c10a040 con 0x7f609c0fdf50 2024-02-20T08:00:56.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.891+0000 7f60837fe700 1 -- 172.21.15.123:0/161713369 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11107 (secure 0 0 0) 0x7f608c086e60 con 0x7f609c0fdf50 2024-02-20T08:00:56.893 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:00:56.893 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:00:54.173913+0000","last_up_change":"2024-02-20T08:00:53.168926+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6803","nonce":2184643212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6805","nonce":2184643212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6809","nonce":2184643212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6807","nonce":2184643212}]},"public_addr":"172.21.15.123:6803/2184643212","cluster_addr":"172.21.15.123:6805/2184643212","heartbeat_back_addr":"172.21.15.123:6809/2184643212","heartbeat_front_addr":"172.21.15.123:6807/2184643212","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6811","nonce":1885285772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6813","nonce":1885285772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6817","nonce":1885285772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6815","nonce":1885285772}]},"public_addr":"172.21.15.123:6811/1885285772","cluster_addr":"172.21.15.123:6813/1885285772","heartbeat_back_addr":"172.21.15.123:6817/1885285772","heartbeat_front_addr":"172.21.15.123:6815/1885285772","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6819","nonce":3176150982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6821","nonce":3176150982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6825","nonce":3176150982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6823","nonce":3176150982}]},"public_addr":"172.21.15.123:6819/3176150982","cluster_addr":"172.21.15.123:6821/3176150982","heartbeat_back_addr":"172.21.15.123:6825/3176150982","heartbeat_front_addr":"172.21.15.123:6823/3176150982","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6801","nonce":2660990269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6803","nonce":2660990269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6807","nonce":2660990269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6805","nonce":2660990269}]},"public_addr":"172.21.15.194:6801/2660990269","cluster_addr":"172.21.15.194:6803/2660990269","heartbeat_back_addr":"172.21.15.194:6807/2660990269","heartbeat_front_addr":"172.21.15.194:6805/2660990269","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6809","nonce":15880204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6811","nonce":15880204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6815","nonce":15880204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6813","nonce":15880204}]},"public_addr":"172.21.15.194:6809/15880204","cluster_addr":"172.21.15.194:6811/15880204","heartbeat_back_addr":"172.21.15.194:6815/15880204","heartbeat_front_addr":"172.21.15.194:6813/15880204","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6817","nonce":692328778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6819","nonce":692328778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6823","nonce":692328778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6821","nonce":692328778}]},"public_addr":"172.21.15.194:6817/692328778","cluster_addr":"172.21.15.194:6819/692328778","heartbeat_back_addr":"172.21.15.194:6823/692328778","heartbeat_front_addr":"172.21.15.194:6821/692328778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 msgr2=0x7f608406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 0x7f608406b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f609c10f2c0 tx=0x7f609000b040 comp rx=0 tx=0).stop 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 msgr2=0x7f609c113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f608c004890 tx=0x7f608c009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 shutdown_connections 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f60840692a0 0x7f608406b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f609c0fdf50 0x7f609c113a90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 --2- 172.21.15.123:0/161713369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f609c0fe8f0 0x7f609c113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.893+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 >> 172.21.15.123:0/161713369 conn(0x7f609c0f7a10 msgr2=0x7f609c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.894+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 shutdown_connections 2024-02-20T08:00:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:56.894+0000 7f60a11f3700 1 -- 172.21.15.123:0/161713369 wait complete. 2024-02-20T08:00:57.611 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-20T07:59:36.763546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-20T08:00:57.611 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-20T08:00:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:00:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:57 smithi194 ceph-mon[37804]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:00:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:57 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/161713369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:00:57.987 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:57 smithi123 ceph-mon[29383]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:00:57.987 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:57 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/161713369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:00:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- 172.21.15.123:0/3025689726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fe8f0 msgr2=0x7efecc107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 --2- 172.21.15.123:0/3025689726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fe8f0 0x7efecc107050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efeb4004970 tx=0x7efeb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- 172.21.15.123:0/3025689726 shutdown_connections 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 --2- 172.21.15.123:0/3025689726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fe8f0 0x7efecc107050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 --2- 172.21.15.123:0/3025689726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fdfe0 0x7efecc0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- 172.21.15.123:0/3025689726 >> 172.21.15.123:0/3025689726 conn(0x7efecc071d90 msgr2=0x7efecc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- 172.21.15.123:0/3025689726 shutdown_connections 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- 172.21.15.123:0/3025689726 wait complete. 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 Processor -- start 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.396+0000 7efed2189700 1 -- start start 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 0x7efecc113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc114690 con 0x7efecc0fdfe0 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc10d930 con 0x7efecc0fe8f0 2024-02-20T08:00:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57174/0 (socket says 172.21.15.123:57174) 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 -- 172.21.15.123:0/557767790 learned_addr learned my addr 172.21.15.123:0/557767790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efec2ffd700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 0x7efecc113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 -- 172.21.15.123:0/557767790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 msgr2=0x7efecc113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 0x7efecc113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 -- 172.21.15.123:0/557767790 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4005040 con 0x7efecc0fdfe0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efec2ffd700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 0x7efecc113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efecb7fe700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b790 tx=0x7efebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc00f770 con 0x7efecc0fdfe0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc10dc10 con 0x7efecc0fdfe0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efebc00fda0 con 0x7efecc0fdfe0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc00d310 con 0x7efecc0fdfe0 2024-02-20T08:00:59.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.397+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc10e120 con 0x7efecc0fdfe0 2024-02-20T08:00:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.398+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc1046c0 con 0x7efecc0fdfe0 2024-02-20T08:00:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.399+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7efebc010420 con 0x7efecc0fdfe0 2024-02-20T08:00:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.399+0000 7efec8ff9700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 0x7efeb806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:00:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.399+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efebc086e70 con 0x7efecc0fdfe0 2024-02-20T08:00:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.399+0000 7efec2ffd700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 0x7efeb806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:00:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.400+0000 7efec2ffd700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 0x7efeb806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efecc10ec60 tx=0x7efeb4009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:00:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.404+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efebc056f70 con 0x7efecc0fdfe0 2024-02-20T08:00:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.588+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efecc0738b0 con 0x7efecc0fdfe0 2024-02-20T08:00:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.588+0000 7efec8ff9700 1 -- 172.21.15.123:0/557767790 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7efebc056b00 con 0x7efecc0fdfe0 2024-02-20T08:00:59.589 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 msgr2=0x7efeb806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 0x7efeb806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efecc10ec60 tx=0x7efeb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 msgr2=0x7efecc113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b790 tx=0x7efebc009250 comp rx=0 tx=0).stop 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 shutdown_connections 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7efeb80692a0 0x7efeb806b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efecc0fdfe0 0x7efecc113a70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 --2- 172.21.15.123:0/557767790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efecc0fe8f0 0x7efecc113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:00:59.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 >> 172.21.15.123:0/557767790 conn(0x7efecc071d90 msgr2=0x7efecc101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:00:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 shutdown_connections 2024-02-20T08:00:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:00:59.590+0000 7efed2189700 1 -- 172.21.15.123:0/557767790 wait complete. 2024-02-20T08:00:59.892 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:00:59 smithi123 ceph-mon[29383]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:00:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:00:59 smithi194 ceph-mon[37804]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:00.335 INFO:tasks.cephadm:Setting up client nodes... 2024-02-20T08:01:00.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-20T08:01:00.590 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:00.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:00 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/557767790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:01:00.712 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:00 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/557767790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:01:02.001 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:01 smithi123 ceph-mon[29383]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:01 smithi194 ceph-mon[37804]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 -- 172.21.15.123:0/60312392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 msgr2=0x7ff8680fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 --2- 172.21.15.123:0/60312392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff8680fc250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff864004940 tx=0x7ff864009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 -- 172.21.15.123:0/60312392 shutdown_connections 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 --2- 172.21.15.123:0/60312392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 0x7ff8680fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 --2- 172.21.15.123:0/60312392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff8680fc250 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.332+0000 7ff8701d1700 1 -- 172.21.15.123:0/60312392 >> 172.21.15.123:0/60312392 conn(0x7ff8680f7520 msgr2=0x7ff8680f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:02.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 -- 172.21.15.123:0/60312392 shutdown_connections 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 -- 172.21.15.123:0/60312392 wait complete. 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 Processor -- start 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 -- start start 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 0x7ff868112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868066cf0 con 0x7ff8680fbe40 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff8701d1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868066e30 con 0x7ff8680fcfb0 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff86df6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff86df6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57184/0 (socket says 172.21.15.123:57184) 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.333+0000 7ff86df6d700 1 -- 172.21.15.123:0/1216858635 learned_addr learned my addr 172.21.15.123:0/1216858635 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff86d76c700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 0x7ff868112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff86df6d700 1 -- 172.21.15.123:0/1216858635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 msgr2=0x7ff868112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff86df6d700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 0x7ff868112ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff86df6d700 1 -- 172.21.15.123:0/1216858635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864005040 con 0x7ff8680fbe40 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff86df6d700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8640093b0 tx=0x7ff864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86400e040 con 0x7ff8680fbe40 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681131a0 con 0x7ff8680fbe40 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff86400bcc0 con 0x7ff8680fbe40 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86401c630 con 0x7ff8680fbe40 2024-02-20T08:01:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.334+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681136e0 con 0x7ff8680fbe40 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.335+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86804bed0 con 0x7ff8680fbe40 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.336+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff864013980 con 0x7ff8680fbe40 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.336+0000 7ff85e7fc700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 0x7ff85406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.336+0000 7ff86d76c700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 0x7ff85406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.336+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff864088200 con 0x7ff8680fbe40 2024-02-20T08:01:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.337+0000 7ff86d76c700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 0x7ff85406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8580041d0 tx=0x7ff8580043c0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.341+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff864054870 con 0x7ff8680fbe40 2024-02-20T08:01:02.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.595+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff868104930 con 0x7ff8680fbe40 2024-02-20T08:01:02.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.599+0000 7ff85e7fc700 1 -- 172.21.15.123:0/1216858635 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff864057e90 con 0x7ff8680fbe40 2024-02-20T08:01:02.599 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-02-20T08:01:02.600 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+XNRl/VaTIxAAuLdEUYSFctwnYkXuh15h2A== 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 msgr2=0x7ff85406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 0x7ff85406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8580041d0 tx=0x7ff8580043c0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 msgr2=0x7ff868110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8640093b0 tx=0x7ff864009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 shutdown_connections 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff8540692a0 0x7ff85406b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8680fbe40 0x7ff868110650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 --2- 172.21.15.123:0/1216858635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8680fcfb0 0x7ff868112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 >> 172.21.15.123:0/1216858635 conn(0x7ff8680f7520 msgr2=0x7ff868100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 shutdown_connections 2024-02-20T08:01:02.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:02.601+0000 7ff8701d1700 1 -- 172.21.15.123:0/1216858635 wait complete. 2024-02-20T08:01:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:02 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1216858635' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-20T08:01:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:02 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1216858635' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-20T08:01:03.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:02 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1216858635' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-20T08:01:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:02 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1216858635' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-20T08:01:03.321 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T08:01:03.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-20T08:01:03.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-20T08:01:03.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-20T08:01:03.658 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi194/config 2024-02-20T08:01:03.931 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:03 smithi194 ceph-mon[37804]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:03.931 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:03 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:03 smithi123 ceph-mon[29383]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:03 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 -- 172.21.15.194:0/42237103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fcef0 msgr2=0x7f96cc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 --2- 172.21.15.194:0/42237103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fcef0 0x7f96cc0fd320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96c0004970 tx=0x7f96c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 -- 172.21.15.194:0/42237103 shutdown_connections 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 --2- 172.21.15.194:0/42237103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 --2- 172.21.15.194:0/42237103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fcef0 0x7f96cc0fd320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 -- 172.21.15.194:0/42237103 >> 172.21.15.194:0/42237103 conn(0x7f96cc0f8620 msgr2=0x7f96cc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 -- 172.21.15.194:0/42237103 shutdown_connections 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.288+0000 7f96d2e28700 1 -- 172.21.15.194:0/42237103 wait complete. 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 Processor -- start 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 -- start start 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 0x7f96cc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc10e430 con 0x7f96cc0fcef0 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.289+0000 7f96d2e28700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc10ecd0 con 0x7f96cc0fe0e0 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96cbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:05.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96cbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46214/0 (socket says 172.21.15.194:46214) 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96cbfff700 1 -- 172.21.15.194:0/92069484 learned_addr learned my addr 172.21.15.194:0/92069484 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d0bc4700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 0x7f96cc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d0bc4700 1 -- 172.21.15.194:0/92069484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 msgr2=0x7f96cc10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d0bc4700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d0bc4700 1 -- 172.21.15.194:0/92069484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c0005040 con 0x7f96cc0fcef0 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96cbfff700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d0bc4700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 0x7f96cc10d8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f96c000b370 tx=0x7f96c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c000e040 con 0x7f96cc0fcef0 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc10ef50 con 0x7f96cc0fcef0 2024-02-20T08:01:05.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96c000be20 con 0x7f96cc0fcef0 2024-02-20T08:01:05.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c00138c0 con 0x7f96cc0fcef0 2024-02-20T08:01:05.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.290+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc10f490 con 0x7f96cc0fcef0 2024-02-20T08:01:05.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.291+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc04bed0 con 0x7f96cc0fcef0 2024-02-20T08:01:05.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.292+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f96c001acd0 con 0x7f96cc0fcef0 2024-02-20T08:01:05.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.292+0000 7f96c97fa700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 0x7f96bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:05.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.292+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96c008bf90 con 0x7f96cc0fcef0 2024-02-20T08:01:05.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.292+0000 7f96cbfff700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 0x7f96bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:05.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.293+0000 7f96cbfff700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 0x7f96bc06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f96b800e5e0 tx=0x7f96b800b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:05.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.301+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f96c005bff0 con 0x7f96cc0fcef0 2024-02-20T08:01:05.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.555+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f96cc105a30 con 0x7f96cc0fcef0 2024-02-20T08:01:05.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.559+0000 7f96c97fa700 1 -- 172.21.15.194:0/92069484 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f96c005bb80 con 0x7f96cc0fcef0 2024-02-20T08:01:05.560 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-02-20T08:01:05.560 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBBXNRlrbc0IRAAOxoEnWAwbaEV0XJ2ngRnuw== 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 msgr2=0x7f96bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 0x7f96bc06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f96b800e5e0 tx=0x7f96b800b040 comp rx=0 tx=0).stop 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 msgr2=0x7f96cc10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 0x7f96cc10d8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f96c000b370 tx=0x7f96c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 shutdown_connections 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96bc0692a0 0x7f96bc06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96cc0fcef0 0x7f96cc10d8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 --2- 172.21.15.194:0/92069484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96cc0fe0e0 0x7f96cc10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 >> 172.21.15.194:0/92069484 conn(0x7f96cc0f8620 msgr2=0x7f96cc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:05.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 shutdown_connections 2024-02-20T08:01:05.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:01:05.561+0000 7f96d2e28700 1 -- 172.21.15.194:0/92069484 wait complete. 2024-02-20T08:01:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:05 smithi194 ceph-mon[37804]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:05 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/92069484' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-20T08:01:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:05 smithi194 ceph-mon[37804]: from='client.? 172.21.15.194:0/92069484' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-20T08:01:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:05 smithi123 ceph-mon[29383]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:06.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:05 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/92069484' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-20T08:01:06.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:05 smithi123 ceph-mon[29383]: from='client.? 172.21.15.194:0/92069484' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-20T08:01:06.261 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T08:01:06.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-20T08:01:06.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-20T08:01:06.304 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-20T08:01:06.304 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-20T08:01:06.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph mgr dump --format=json 2024-02-20T08:01:06.573 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:08.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:07 smithi123 ceph-mon[29383]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:08.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:07 smithi194 ceph-mon[37804]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:08.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 -- 172.21.15.123:0/148707054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 msgr2=0x7f8450102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:08.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 --2- 172.21.15.123:0/148707054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f8450102210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8440004940 tx=0x7f8440009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:08.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 -- 172.21.15.123:0/148707054 shutdown_connections 2024-02-20T08:01:08.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 --2- 172.21.15.123:0/148707054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 0x7f84500fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 --2- 172.21.15.123:0/148707054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f8450102210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 -- 172.21.15.123:0/148707054 >> 172.21.15.123:0/148707054 conn(0x7f8450071d90 msgr2=0x7f8450072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 -- 172.21.15.123:0/148707054 shutdown_connections 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 -- 172.21.15.123:0/148707054 wait complete. 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.196+0000 7f8455b75700 1 Processor -- start 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8455b75700 1 -- start start 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8455b75700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8455b75700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 0x7f845010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8455b75700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845010f670 con 0x7f8450101e40 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8455b75700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845010f7b0 con 0x7f84501027e0 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57198/0 (socket says 172.21.15.123:57198) 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 -- 172.21.15.123:0/2453893100 learned_addr learned my addr 172.21.15.123:0/2453893100 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844effd700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 0x7f845010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 -- 172.21.15.123:0/2453893100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 msgr2=0x7f845010f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 0x7f845010f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 -- 172.21.15.123:0/2453893100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440005040 con 0x7f8450101e40 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f844f7fe700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8440009040 tx=0x7f8440009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.197+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844000e040 con 0x7f8450101e40 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.198+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f844000bbf0 con 0x7f8450101e40 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.198+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8450117a80 con 0x7f8450101e40 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.198+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844001c630 con 0x7f8450101e40 2024-02-20T08:01:08.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.198+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8450117fc0 con 0x7f8450101e40 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.199+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84500738b0 con 0x7f8450101e40 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.199+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8440013420 con 0x7f8450101e40 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.199+0000 7f8437fff700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.199+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84400881a0 con 0x7f8450101e40 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.199+0000 7f844effd700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:08.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.200+0000 7f844effd700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:08.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.204+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8440054810 con 0x7f8450101e40 2024-02-20T08:01:08.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.439+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8450065ec0 con 0x7f8450101e40 2024-02-20T08:01:08.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.442+0000 7f8437fff700 1 -- 172.21.15.123:0/2453893100 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167177 (secure 0 0 0) 0x7f8440057e30 con 0x7f8450101e40 2024-02-20T08:01:08.445 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 msgr2=0x7f843806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444008040 comp rx=0 tx=0).stop 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 msgr2=0x7f845010eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8440009040 tx=0x7f8440009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 shutdown_connections 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8450101e40 0x7f845010eb10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 --2- 172.21.15.123:0/2453893100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501027e0 0x7f845010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:08.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 >> 172.21.15.123:0/2453893100 conn(0x7f8450071d90 msgr2=0x7f84500fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:08.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 shutdown_connections 2024-02-20T08:01:08.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:08.445+0000 7f8455b75700 1 -- 172.21.15.123:0/2453893100 wait complete. 2024-02-20T08:01:09.094 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:08 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2453893100' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-20T08:01:09.118 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"active_gid":14222,"active_name":"smithi123.kwyrtl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":946040318},{"type":"v1","addr":"172.21.15.123:6801","nonce":946040318}]},"active_addr":"172.21.15.123:6801/946040318","active_change":"2024-02-20T07:57:18.430136+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14246,"name":"smithi194.pvhorj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.123:8443/","prometheus":"http://172.21.15.123:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1920252283}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1567949854}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2566943054}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2980357718}]}]} 2024-02-20T08:01:09.123 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-20T08:01:09.123 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-20T08:01:09.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-20T08:01:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:08 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2453893100' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-20T08:01:09.374 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:10.143 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:09 smithi123 ceph-mon[29383]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:09 smithi194 ceph-mon[37804]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 -- 172.21.15.123:0/1258762115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 msgr2=0x7f5430103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 --2- 172.21.15.123:0/1258762115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430103320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5420004940 tx=0x7f5420009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 -- 172.21.15.123:0/1258762115 shutdown_connections 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 --2- 172.21.15.123:0/1258762115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 0x7f54300fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 --2- 172.21.15.123:0/1258762115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430103320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 -- 172.21.15.123:0/1258762115 >> 172.21.15.123:0/1258762115 conn(0x7f54300f8ae0 msgr2=0x7f54300faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 -- 172.21.15.123:0/1258762115 shutdown_connections 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.060+0000 7f5438543700 1 -- 172.21.15.123:0/1258762115 wait complete. 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 Processor -- start 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 -- start start 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 0x7f5430113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301145f0 con 0x7f5430102f50 2024-02-20T08:01:11.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f5438543700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543010d920 con 0x7f54301038f0 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.061+0000 7f54362df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33698/0 (socket says 172.21.15.123:33698) 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 -- 172.21.15.123:0/2014005812 learned_addr learned my addr 172.21.15.123:0/2014005812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5435ade700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 0x7f5430113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 -- 172.21.15.123:0/2014005812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 msgr2=0x7f5430113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 0x7f5430113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 -- 172.21.15.123:0/2014005812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420005040 con 0x7f5430102f50 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f54362df700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f542000b3b0 tx=0x7f5420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f542000e040 con 0x7f5430102f50 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f542000bbf0 con 0x7f5430102f50 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543010dba0 con 0x7f5430102f50 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f542001c3f0 con 0x7f5430102f50 2024-02-20T08:01:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.062+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543010e0e0 con 0x7f5430102f50 2024-02-20T08:01:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.063+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430100260 con 0x7f5430102f50 2024-02-20T08:01:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.064+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f542000bd60 con 0x7f5430102f50 2024-02-20T08:01:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.064+0000 7f5426ffd700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.064+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f54200881b0 con 0x7f5430102f50 2024-02-20T08:01:11.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.064+0000 7f5435ade700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:11.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.064+0000 7f5435ade700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 0x7f541c06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f543010f290 tx=0x7f542c00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:11.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.068+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f54200582b0 con 0x7f5430102f50 2024-02-20T08:01:11.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.250+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f543004bed0 con 0x7f5430102f50 2024-02-20T08:01:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.251+0000 7f5426ffd700 1 -- 172.21.15.123:0/2014005812 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11107 (secure 0 0 0) 0x7f5420057e40 con 0x7f5430102f50 2024-02-20T08:01:11.252 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:11.252 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:00:54.173913+0000","last_up_change":"2024-02-20T08:00:53.168926+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6803","nonce":2184643212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6805","nonce":2184643212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6809","nonce":2184643212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6807","nonce":2184643212}]},"public_addr":"172.21.15.123:6803/2184643212","cluster_addr":"172.21.15.123:6805/2184643212","heartbeat_back_addr":"172.21.15.123:6809/2184643212","heartbeat_front_addr":"172.21.15.123:6807/2184643212","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6811","nonce":1885285772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6813","nonce":1885285772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6817","nonce":1885285772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6815","nonce":1885285772}]},"public_addr":"172.21.15.123:6811/1885285772","cluster_addr":"172.21.15.123:6813/1885285772","heartbeat_back_addr":"172.21.15.123:6817/1885285772","heartbeat_front_addr":"172.21.15.123:6815/1885285772","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6819","nonce":3176150982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6821","nonce":3176150982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6825","nonce":3176150982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6823","nonce":3176150982}]},"public_addr":"172.21.15.123:6819/3176150982","cluster_addr":"172.21.15.123:6821/3176150982","heartbeat_back_addr":"172.21.15.123:6825/3176150982","heartbeat_front_addr":"172.21.15.123:6823/3176150982","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6801","nonce":2660990269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6803","nonce":2660990269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6807","nonce":2660990269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6805","nonce":2660990269}]},"public_addr":"172.21.15.194:6801/2660990269","cluster_addr":"172.21.15.194:6803/2660990269","heartbeat_back_addr":"172.21.15.194:6807/2660990269","heartbeat_front_addr":"172.21.15.194:6805/2660990269","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6809","nonce":15880204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6811","nonce":15880204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6815","nonce":15880204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6813","nonce":15880204}]},"public_addr":"172.21.15.194:6809/15880204","cluster_addr":"172.21.15.194:6811/15880204","heartbeat_back_addr":"172.21.15.194:6815/15880204","heartbeat_front_addr":"172.21.15.194:6813/15880204","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6817","nonce":692328778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6819","nonce":692328778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6823","nonce":692328778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6821","nonce":692328778}]},"public_addr":"172.21.15.194:6817/692328778","cluster_addr":"172.21.15.194:6819/692328778","heartbeat_back_addr":"172.21.15.194:6823/692328778","heartbeat_front_addr":"172.21.15.194:6821/692328778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 msgr2=0x7f541c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 0x7f541c06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f543010f290 tx=0x7f542c00b040 comp rx=0 tx=0).stop 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 msgr2=0x7f5430113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f542000b3b0 tx=0x7f5420009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 shutdown_connections 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5430102f50 0x7f5430113a60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 --2- 172.21.15.123:0/2014005812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54301038f0 0x7f5430113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 >> 172.21.15.123:0/2014005812 conn(0x7f54300f8ae0 msgr2=0x7f54300fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 shutdown_connections 2024-02-20T08:01:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:11.253+0000 7f5438543700 1 -- 172.21.15.123:0/2014005812 wait complete. 2024-02-20T08:01:11.895 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-20T08:01:11.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-20T08:01:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:11 smithi194 ceph-mon[37804]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:11 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2014005812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:01:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:11 smithi123 ceph-mon[29383]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:11 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2014005812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 -- 172.21.15.123:0/2346569578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fdfe0 msgr2=0x7ff0300fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 --2- 172.21.15.123:0/2346569578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fe3b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff028009d10 tx=0x7ff028004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 -- 172.21.15.123:0/2346569578 shutdown_connections 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 --2- 172.21.15.123:0/2346569578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fe8f0 0x7ff030107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 --2- 172.21.15.123:0/2346569578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fe3b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 -- 172.21.15.123:0/2346569578 >> 172.21.15.123:0/2346569578 conn(0x7ff030071d90 msgr2=0x7ff030072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 -- 172.21.15.123:0/2346569578 shutdown_connections 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.873+0000 7ff03771a700 1 -- 172.21.15.123:0/2346569578 wait complete. 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 Processor -- start 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 -- start start 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300fc9e0 con 0x7ff0300fe8f0 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff03771a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300fcb50 con 0x7ff0300fdfe0 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33708/0 (socket says 172.21.15.123:33708) 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 -- 172.21.15.123:0/3658610606 learned_addr learned my addr 172.21.15.123:0/3658610606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff0354b6700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:13.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 -- 172.21.15.123:0/3658610606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fdfe0 msgr2=0x7ff0300fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 -- 172.21.15.123:0/3658610606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028009940 con 0x7ff0300fe8f0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.874+0000 7ff034cb5700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff020002a50 tx=0x7ff0200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.875+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff020007cc0 con 0x7ff0300fe8f0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.875+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff02000f040 con 0x7ff0300fe8f0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.875+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff030119ed0 con 0x7ff0300fe8f0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.875+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff02000da30 con 0x7ff0300fe8f0 2024-02-20T08:01:13.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.875+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03011a380 con 0x7ff0300fe8f0 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.876+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0301046c0 con 0x7ff0300fe8f0 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.876+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff02000db90 con 0x7ff0300fe8f0 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.876+0000 7ff025ffb700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 0x7ff01c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.876+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff020086c00 con 0x7ff0300fe8f0 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.876+0000 7ff0354b6700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 0x7ff01c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.877+0000 7ff0354b6700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 0x7ff01c06b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff028003400 tx=0x7ff028004d10 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:13.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:13.881+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff02008c020 con 0x7ff0300fe8f0 2024-02-20T08:01:14.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:13 smithi123 ceph-mon[29383]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:14.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.065+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0300738b0 con 0x7ff0300fe8f0 2024-02-20T08:01:14.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.065+0000 7ff025ffb700 1 -- 172.21.15.123:0/3658610606 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11107 (secure 0 0 0) 0x7ff020056c80 con 0x7ff0300fe8f0 2024-02-20T08:01:14.066 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:14.067 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:00:54.173913+0000","last_up_change":"2024-02-20T08:00:53.168926+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6803","nonce":2184643212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6805","nonce":2184643212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6809","nonce":2184643212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6807","nonce":2184643212}]},"public_addr":"172.21.15.123:6803/2184643212","cluster_addr":"172.21.15.123:6805/2184643212","heartbeat_back_addr":"172.21.15.123:6809/2184643212","heartbeat_front_addr":"172.21.15.123:6807/2184643212","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6811","nonce":1885285772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6813","nonce":1885285772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6817","nonce":1885285772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6815","nonce":1885285772}]},"public_addr":"172.21.15.123:6811/1885285772","cluster_addr":"172.21.15.123:6813/1885285772","heartbeat_back_addr":"172.21.15.123:6817/1885285772","heartbeat_front_addr":"172.21.15.123:6815/1885285772","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6819","nonce":3176150982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6821","nonce":3176150982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6825","nonce":3176150982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6823","nonce":3176150982}]},"public_addr":"172.21.15.123:6819/3176150982","cluster_addr":"172.21.15.123:6821/3176150982","heartbeat_back_addr":"172.21.15.123:6825/3176150982","heartbeat_front_addr":"172.21.15.123:6823/3176150982","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6801","nonce":2660990269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6803","nonce":2660990269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6807","nonce":2660990269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6805","nonce":2660990269}]},"public_addr":"172.21.15.194:6801/2660990269","cluster_addr":"172.21.15.194:6803/2660990269","heartbeat_back_addr":"172.21.15.194:6807/2660990269","heartbeat_front_addr":"172.21.15.194:6805/2660990269","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6809","nonce":15880204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6811","nonce":15880204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6815","nonce":15880204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6813","nonce":15880204}]},"public_addr":"172.21.15.194:6809/15880204","cluster_addr":"172.21.15.194:6811/15880204","heartbeat_back_addr":"172.21.15.194:6815/15880204","heartbeat_front_addr":"172.21.15.194:6813/15880204","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6817","nonce":692328778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6819","nonce":692328778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6823","nonce":692328778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6821","nonce":692328778}]},"public_addr":"172.21.15.194:6817/692328778","cluster_addr":"172.21.15.194:6819/692328778","heartbeat_back_addr":"172.21.15.194:6823/692328778","heartbeat_front_addr":"172.21.15.194:6821/692328778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:01:14.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 msgr2=0x7ff01c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:14.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 0x7ff01c06b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff028003400 tx=0x7ff028004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:14.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 msgr2=0x7ff0300fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:14.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff020002a50 tx=0x7ff0200046b0 comp rx=0 tx=0).stop 2024-02-20T08:01:14.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 shutdown_connections 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff01c0692b0 0x7ff01c06b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0300fdfe0 0x7ff0300fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.067+0000 7ff03771a700 1 --2- 172.21.15.123:0/3658610606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0300fe8f0 0x7ff0300fc3e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.068+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 >> 172.21.15.123:0/3658610606 conn(0x7ff030071d90 msgr2=0x7ff030101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.068+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 shutdown_connections 2024-02-20T08:01:14.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:14.068+0000 7ff03771a700 1 -- 172.21.15.123:0/3658610606 wait complete. 2024-02-20T08:01:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:13 smithi194 ceph-mon[37804]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:14.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-20T08:01:14.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-20T08:01:14.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-20T08:01:14.731 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-20T08:01:14.731 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-20T08:01:14.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-20T08:01:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3658610606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:01:15.070 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3658610606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:01:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:15 smithi194 ceph-mon[37804]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:15 smithi123 ceph-mon[29383]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:16.567 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:17.947 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:17 smithi123 ceph-mon[29383]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:17 smithi194 ceph-mon[37804]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:18.521 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 -- 172.21.15.123:0/3558731095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 msgr2=0x7fbe3c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 --2- 172.21.15.123:0/3558731095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c103510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009ce0 tx=0x7fbe2c004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 -- 172.21.15.123:0/3558731095 shutdown_connections 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 --2- 172.21.15.123:0/3558731095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 0x7fbe3c0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 --2- 172.21.15.123:0/3558731095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c103510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 -- 172.21.15.123:0/3558731095 >> 172.21.15.123:0/3558731095 conn(0x7fbe3c071560 msgr2=0x7fbe3c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 -- 172.21.15.123:0/3558731095 shutdown_connections 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.848+0000 7fbe419d8700 1 -- 172.21.15.123:0/3558731095 wait complete. 2024-02-20T08:01:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 Processor -- start 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 -- start start 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 0x7fbe3c113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1146c0 con 0x7fbe3c103140 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe419d8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c10d9f0 con 0x7fbe3c0fb570 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43194/0 (socket says 172.21.15.123:43194) 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 -- 172.21.15.123:0/2334111110 learned_addr learned my addr 172.21.15.123:0/2334111110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3affd700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 0x7fbe3c113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 -- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 msgr2=0x7fbe3c113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 0x7fbe3c113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c009940 con 0x7fbe3c103140 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe3a7fc700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400eb40 tx=0x7fbe2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.849+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24007cc0 con 0x7fbe3c103140 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.850+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c10dc70 con 0x7fbe3c103140 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.850+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe2400f040 con 0x7fbe3c103140 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.850+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe2400ca10 con 0x7fbe3c103140 2024-02-20T08:01:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.850+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c10e1b0 con 0x7fbe3c103140 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.850+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe3c10e710 con 0x7fbe3c103140 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbe2400cc80 con 0x7fbe3c103140 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 0x7fbe2806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbe24086a80 con 0x7fbe3c103140 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe3affd700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 0x7fbe2806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 0x7fbe28071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe28071a40 con 0x7fbe2806ef80 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.851+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe2408b220 con 0x7fbe3c103140 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.852+0000 7fbe3affd700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 0x7fbe2806b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b460 tx=0x7fbe2c004d10 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.852+0000 7fbe3b7fe700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 0x7fbe28071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.852+0000 7fbe3b7fe700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 0x7fbe28071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.853+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== osd.3 v2:172.21.15.194:6800/2660990269 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbe28071a40 con 0x7fbe2806ef80 2024-02-20T08:01:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.867+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 --> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe3c05e610 con 0x7fbe2806ef80 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe337fe700 1 -- 172.21.15.123:0/2334111110 <== osd.3 v2:172.21.15.194:6800/2660990269 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe3c05e610 con 0x7fbe2806ef80 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 msgr2=0x7fbe28071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 0x7fbe28071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 msgr2=0x7fbe2806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 0x7fbe2806b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b460 tx=0x7fbe2c004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 msgr2=0x7fbe3c114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400eb40 tx=0x7fbe2400b040 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 shutdown_connections 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:6800/2660990269,v1:172.21.15.194:6801/2660990269] conn(0x7fbe2806ef80 0x7fbe28071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fbe280692b0 0x7fbe2806b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3c0fb570 0x7fbe3c113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 --2- 172.21.15.123:0/2334111110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe3c103140 0x7fbe3c114070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 >> 172.21.15.123:0/2334111110 conn(0x7fbe3c071560 msgr2=0x7fbe3c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 shutdown_connections 2024-02-20T08:01:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.868+0000 7fbe419d8700 1 -- 172.21.15.123:0/2334111110 wait complete. 2024-02-20T08:01:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:18 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:19.575 INFO:teuthology.orchestra.run.smithi123.stdout:115964117009 2024-02-20T08:01:19.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 -- 172.21.15.123:0/2388369689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 msgr2=0x7f369c102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/2388369689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c102220 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f368c004940 tx=0x7f368c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 -- 172.21.15.123:0/2388369689 shutdown_connections 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/2388369689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c0fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/2388369689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c102220 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.724+0000 7f36a0ffe700 1 -- 172.21.15.123:0/2388369689 >> 172.21.15.123:0/2388369689 conn(0x7f369c0f79c0 msgr2=0x7f369c0f9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:19.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 -- 172.21.15.123:0/2388369689 shutdown_connections 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 -- 172.21.15.123:0/2388369689 wait complete. 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 Processor -- start 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 -- start start 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c114650 con 0x7f369c101e50 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.725+0000 7f36a0ffe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c10d8f0 con 0x7f369c1027f0 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43176/0 (socket says 172.21.15.123:43176) 2024-02-20T08:01:19.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 -- 172.21.15.123:0/1860763800 learned_addr learned my addr 172.21.15.123:0/1860763800 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 -- 172.21.15.123:0/1860763800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 msgr2=0x7f369c113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f3699d9b700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c005040 con 0x7f369c101e50 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f3699d9b700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f369a59c700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3b0 tx=0x7f368c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:19.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368c00e040 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f368c00bbf0 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c10db70 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368c01c630 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.726+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c10e0b0 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.727+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f369c10f010 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.727+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f368c00bd60 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f368affd700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 0x7f368406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f368c088c00 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f3699d9b700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 0x7f368406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f368affd700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 0x7f3684071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3684071a30 con 0x7f368406ef70 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c089000 con 0x7f369c101e50 2024-02-20T08:01:19.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f369ad9d700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 0x7f3684071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f3699d9b700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 0x7f368406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3690006fd0 tx=0x7f3690008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.728+0000 7f369ad9d700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 0x7f3684071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.729+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== osd.2 v2:172.21.15.123:6818/3176150982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3684071a30 con 0x7f368406ef70 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.751+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 --> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f369c10e560 con 0x7f368406ef70 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.751+0000 7f368affd700 1 -- 172.21.15.123:0/1860763800 <== osd.2 v2:172.21.15.123:6818/3176150982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f369c10e560 con 0x7f368406ef70 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 msgr2=0x7f3684071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 0x7f3684071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 msgr2=0x7f368406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 0x7f368406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3690006fd0 tx=0x7f3690008040 comp rx=0 tx=0).stop 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 msgr2=0x7f369c113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3b0 tx=0x7f368c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 shutdown_connections 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6818/3176150982,v1:172.21.15.123:6819/3176150982] conn(0x7f368406ef70 0x7f3684071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f36840692a0 0x7f368406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f369c101e50 0x7f369c113a30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 --2- 172.21.15.123:0/1860763800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c1027f0 0x7f369c113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:19.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 >> 172.21.15.123:0/1860763800 conn(0x7f369c0f79c0 msgr2=0x7f369c0f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:19.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 shutdown_connections 2024-02-20T08:01:19.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:18.752+0000 7f36a0ffe700 1 -- 172.21.15.123:0/1860763800 wait complete. 2024-02-20T08:01:20.093 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:19 smithi123 ceph-mon[29383]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:20.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:19 smithi194 ceph-mon[37804]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:21.354 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:21.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:21 smithi123 ceph-mon[29383]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:21 smithi194 ceph-mon[37804]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 -- 172.21.15.123:0/3715028240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 msgr2=0x7fc5880fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 --2- 172.21.15.123:0/3715028240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc5880fbe50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc578004940 tx=0x7fc578009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 -- 172.21.15.123:0/3715028240 shutdown_connections 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 --2- 172.21.15.123:0/3715028240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc5880fbe50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 --2- 172.21.15.123:0/3715028240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 0x7fc588102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 -- 172.21.15.123:0/3715028240 >> 172.21.15.123:0/3715028240 conn(0x7fc5880f79d0 msgr2=0x7fc5880f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 -- 172.21.15.123:0/3715028240 shutdown_connections 2024-02-20T08:01:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 -- 172.21.15.123:0/3715028240 wait complete. 2024-02-20T08:01:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.414+0000 7fc58d353700 1 Processor -- start 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc58d353700 1 -- start start 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc58d353700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 0x7fc588113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc58d353700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc58d353700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881145f0 con 0x7fc5881027e0 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc58d353700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58810d920 con 0x7fc588101e40 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43210/0 (socket says 172.21.15.123:43210) 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 -- 172.21.15.123:0/574363190 learned_addr learned my addr 172.21.15.123:0/574363190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc586ffd700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 0x7fc588113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 -- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 msgr2=0x7fc588113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 0x7fc588113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578005040 con 0x7fc5881027e0 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc5867fc700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc578009150 tx=0x7fc578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.415+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57800e040 con 0x7fc5881027e0 2024-02-20T08:01:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.416+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc57800bbf0 con 0x7fc5881027e0 2024-02-20T08:01:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.416+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58810dba0 con 0x7fc5881027e0 2024-02-20T08:01:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.416+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57801c3f0 con 0x7fc5881027e0 2024-02-20T08:01:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.416+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58810e0e0 con 0x7fc5881027e0 2024-02-20T08:01:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.416+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc58810e610 con 0x7fc5881027e0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.417+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc57800bd60 con 0x7fc5881027e0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.417+0000 7fc56f7fe700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc578088bf0 con 0x7fc5881027e0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc586ffd700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc56f7fe700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 0x7fc570071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc570071a30 con 0x7fc57006ef70 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc578088ff0 con 0x7fc5881027e0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc586ffd700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 0x7fc57006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fd0 tx=0x7fc57c00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc5877fe700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 0x7fc570071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.418+0000 7fc5877fe700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 0x7fc570071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.419+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== osd.4 v2:172.21.15.194:6808/15880204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc570071a30 con 0x7fc57006ef70 2024-02-20T08:01:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.434+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 --> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc588066970 con 0x7fc57006ef70 2024-02-20T08:01:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.434+0000 7fc56f7fe700 1 -- 172.21.15.123:0/574363190 <== osd.4 v2:172.21.15.194:6808/15880204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc588066970 con 0x7fc57006ef70 2024-02-20T08:01:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 msgr2=0x7fc570071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 0x7fc570071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 msgr2=0x7fc57006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 0x7fc57006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fd0 tx=0x7fc57c00b040 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 msgr2=0x7fc588113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc578009150 tx=0x7fc578009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 shutdown_connections 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:6808/15880204,v1:172.21.15.194:6809/15880204] conn(0x7fc57006ef70 0x7fc570071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc588101e40 0x7fc588113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 --2- 172.21.15.123:0/574363190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5881027e0 0x7fc588113fa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 >> 172.21.15.123:0/574363190 conn(0x7fc5880f79d0 msgr2=0x7fc588065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 shutdown_connections 2024-02-20T08:01:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.435+0000 7fc58d353700 1 -- 172.21.15.123:0/574363190 wait complete. 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 -- 172.21.15.123:0/631369626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110101e60 msgr2=0x7fe110102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 --2- 172.21.15.123:0/631369626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110101e60 0x7fe110102230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe104004940 tx=0x7fe104009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 -- 172.21.15.123:0/631369626 shutdown_connections 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 --2- 172.21.15.123:0/631369626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110102800 0x7fe1100fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 --2- 172.21.15.123:0/631369626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110101e60 0x7fe110102230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 -- 172.21.15.123:0/631369626 >> 172.21.15.123:0/631369626 conn(0x7fe1100f7a10 msgr2=0x7fe1100f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 -- 172.21.15.123:0/631369626 shutdown_connections 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 -- 172.21.15.123:0/631369626 wait complete. 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.630+0000 7fe116e1c700 1 Processor -- start 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe116e1c700 1 -- start start 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe116e1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 0x7fe1101030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe116e1c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe116e1c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110103c80 con 0x7fe110102800 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe116e1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110103df0 con 0x7fe110101e60 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43230/0 (socket says 172.21.15.123:43230) 2024-02-20T08:01:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 -- 172.21.15.123:0/4079920473 learned_addr learned my addr 172.21.15.123:0/4079920473 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe114bb8700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 0x7fe1101030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 -- 172.21.15.123:0/4079920473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 msgr2=0x7fe1101030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 0x7fe1101030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104005040 con 0x7fe110102800 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe114bb8700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 0x7fe1101030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10ffff700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc002a50 tx=0x7fe0fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.631+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0fc007cc0 con 0x7fe110102800 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.632+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe110119d30 con 0x7fe110102800 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.632+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0fc00f040 con 0x7fe110102800 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.632+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0fc00da40 con 0x7fe110102800 2024-02-20T08:01:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.632+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11011a270 con 0x7fe110102800 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.632+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe110066190 con 0x7fe110102800 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.633+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe0fc0097c0 con 0x7fe110102800 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.633+0000 7fe10d7fa700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 0x7fe10006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.633+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe0fc086c60 con 0x7fe110102800 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.633+0000 7fe114bb8700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 0x7fe10006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe10d7fa700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 0x7fe100071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe100071a30 con 0x7fe10006ef70 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0fc08c2c0 con 0x7fe110102800 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe1153b9700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 0x7fe100071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe114bb8700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 0x7fe10006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe104004f90 tx=0x7fe104009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.634+0000 7fe1153b9700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 0x7fe100071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.635+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== osd.1 v2:172.21.15.123:6810/1885285772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe100071a30 con 0x7fe10006ef70 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.649+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 --> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe110066590 con 0x7fe10006ef70 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.649+0000 7fe10d7fa700 1 -- 172.21.15.123:0/4079920473 <== osd.1 v2:172.21.15.123:6810/1885285772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe110066590 con 0x7fe10006ef70 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 msgr2=0x7fe100071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 0x7fe100071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 msgr2=0x7fe10006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 0x7fe10006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe104004f90 tx=0x7fe104009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 msgr2=0x7fe110103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc002a50 tx=0x7fe0fc004600 comp rx=0 tx=0).stop 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 shutdown_connections 2024-02-20T08:01:22.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6810/1885285772,v1:172.21.15.123:6811/1885285772] conn(0x7fe10006ef70 0x7fe100071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe1000692a0 0x7fe10006b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe110101e60 0x7fe1101030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 --2- 172.21.15.123:0/4079920473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe110102800 0x7fe110103630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 >> 172.21.15.123:0/4079920473 conn(0x7fe1100f7a10 msgr2=0x7fe110105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 shutdown_connections 2024-02-20T08:01:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:22.650+0000 7fe116e1c700 1 -- 172.21.15.123:0/4079920473 wait complete. 2024-02-20T08:01:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:23 smithi123 ceph-mon[29383]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:24.331 INFO:teuthology.orchestra.run.smithi123.stdout:60129542174 2024-02-20T08:01:24.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-20T08:01:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:23 smithi194 ceph-mon[37804]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:24.751 INFO:teuthology.orchestra.run.smithi123.stdout:81604378648 2024-02-20T08:01:24.751 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-20T08:01:25.825 INFO:teuthology.orchestra.run.smithi123.stdout:150323855373 2024-02-20T08:01:25.825 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-20T08:01:26.072 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:25 smithi123 ceph-mon[29383]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:26.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 -- 172.21.15.123:0/144394992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 msgr2=0x7f79d80fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/144394992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d80fbe60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f79cc004940 tx=0x7f79cc009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 -- 172.21.15.123:0/144394992 shutdown_connections 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/144394992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d80fbe60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/144394992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 0x7f79d8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 -- 172.21.15.123:0/144394992 >> 172.21.15.123:0/144394992 conn(0x7f79d80f79e0 msgr2=0x7f79d80f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 -- 172.21.15.123:0/144394992 shutdown_connections 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.311+0000 7f79ddc6f700 1 -- 172.21.15.123:0/144394992 wait complete. 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 Processor -- start 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 -- start start 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 0x7f79d810ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d810f5a0 con 0x7f79d81027f0 2024-02-20T08:01:26.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79ddc6f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d810f710 con 0x7f79d8101e50 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43258/0 (socket says 172.21.15.123:43258) 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79d6ffd700 1 -- 172.21.15.123:0/1975421492 learned_addr learned my addr 172.21.15.123:0/1975421492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.312+0000 7f79d77fe700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 0x7f79d810ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79d6ffd700 1 -- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 msgr2=0x7f79d810ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79d6ffd700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 0x7f79d810ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79d6ffd700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc005040 con 0x7f79d81027f0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79d6ffd700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0090d0 tx=0x7f79cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc00e040 con 0x7f79d81027f0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d8117a40 con 0x7f79d81027f0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79cc009430 con 0x7f79d81027f0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc01c3f0 con 0x7f79d81027f0 2024-02-20T08:01:26.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.313+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8117f30 con 0x7f79d81027f0 2024-02-20T08:01:26.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.314+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79d805e690 con 0x7f79d81027f0 2024-02-20T08:01:26.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.315+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f79cc00bbf0 con 0x7f79d81027f0 2024-02-20T08:01:26.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79bffff700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 0x7f79c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f79cc088a80 con 0x7f79d81027f0 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79d77fe700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 0x7f79c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79bffff700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 0x7f79c0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79c0071a30 con 0x7f79c006ef70 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79cc088e80 con 0x7f79d81027f0 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79d7fff700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 0x7f79c0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.316+0000 7f79d77fe700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 0x7f79c006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79c8004eb0 tx=0x7f79c800b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.317+0000 7f79d7fff700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 0x7f79c0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:26.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.317+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== osd.5 v2:172.21.15.194:6816/692328778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f79c0071a30 con 0x7f79c006ef70 2024-02-20T08:01:26.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.332+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 --> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79d805eb10 con 0x7f79c006ef70 2024-02-20T08:01:26.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.333+0000 7f79bffff700 1 -- 172.21.15.123:0/1975421492 <== osd.5 v2:172.21.15.194:6816/692328778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f79d805eb10 con 0x7f79c006ef70 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.333+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 msgr2=0x7f79c0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 0x7f79c0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 msgr2=0x7f79c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 0x7f79c006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79c8004eb0 tx=0x7f79c800b040 comp rx=0 tx=0).stop 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 msgr2=0x7f79d810f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0090d0 tx=0x7f79cc009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 shutdown_connections 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:6816/692328778,v1:172.21.15.194:6817/692328778] conn(0x7f79c006ef70 0x7f79c0071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f79c00692a0 0x7f79c006b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d8101e50 0x7f79d810ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 --2- 172.21.15.123:0/1975421492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79d81027f0 0x7f79d810f010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 >> 172.21.15.123:0/1975421492 conn(0x7f79d80f79e0 msgr2=0x7f79d80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 shutdown_connections 2024-02-20T08:01:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:26.334+0000 7f79ddc6f700 1 -- 172.21.15.123:0/1975421492 wait complete. 2024-02-20T08:01:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:25 smithi194 ceph-mon[37804]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:26.957 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:26.957 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:26.958 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:28.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:27 smithi123 ceph-mon[29383]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:28.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:27 smithi194 ceph-mon[37804]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:29.739 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:29.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.750+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1551520824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fdf90 msgr2=0x7fe3a00fe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:29.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.750+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1551520824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fdf90 0x7fe3a00fe360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe39c004970 tx=0x7fe39c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:29.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1551520824 shutdown_connections 2024-02-20T08:01:29.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1551520824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3a00fe930 0x7fe3a0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1551520824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fdf90 0x7fe3a00fe360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1551520824 >> 172.21.15.123:0/1551520824 conn(0x7fe3a00f79e0 msgr2=0x7fe3a00f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:29.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1551520824 shutdown_connections 2024-02-20T08:01:29.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1551520824 wait complete. 2024-02-20T08:01:29.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 Processor -- start 2024-02-20T08:01:29.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.751+0000 7fe3a87e9700 1 -- start start 2024-02-20T08:01:29.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a87e9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3a00fdf90 0x7fe3a0115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a87e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a87e9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0116780 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a87e9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a010fab0 con 0x7fe3a00fdf90 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48798/0 (socket says 172.21.15.123:48798) 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 -- 172.21.15.123:0/1287658687 learned_addr learned my addr 172.21.15.123:0/1287658687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 -- 172.21.15.123:0/1287658687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3a00fdf90 msgr2=0x7fe3a0115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3a00fdf90 0x7fe3a0115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c005040 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a5d84700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe390002a50 tx=0x7fe3900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe390007cc0 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.752+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a010fd90 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.753+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe39000f040 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.753+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe390009640 con 0x7fe3a00fe930 2024-02-20T08:01:29.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.753+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a01102d0 con 0x7fe3a00fe930 2024-02-20T08:01:29.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.753+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3a0110830 con 0x7fe3a00fe930 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.754+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe3900097c0 con 0x7fe3a00fe930 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.754+0000 7fe396ffd700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 0x7fe38c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.754+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe390086cb0 con 0x7fe3a00fe930 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.754+0000 7fe3a6585700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 0x7fe38c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe396ffd700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 0x7fe38c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe38c071a40 con 0x7fe38c06ef80 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe39008c310 con 0x7fe3a00fe930 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe3a6d86700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 0x7fe38c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe3a6585700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 0x7fe38c06b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00b370 tx=0x7fe39c009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:29.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.755+0000 7fe3a6d86700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 0x7fe38c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:29.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.756+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== osd.0 v2:172.21.15.123:6802/2184643212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe38c071a40 con 0x7fe38c06ef80 2024-02-20T08:01:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.772+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 --> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3a005e690 con 0x7fe38c06ef80 2024-02-20T08:01:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.772+0000 7fe396ffd700 1 -- 172.21.15.123:0/1287658687 <== osd.0 v2:172.21.15.123:6802/2184643212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3a005e690 con 0x7fe38c06ef80 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 msgr2=0x7fe38c071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 0x7fe38c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 msgr2=0x7fe38c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 0x7fe38c06b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00b370 tx=0x7fe39c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 msgr2=0x7fe3a0116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe390002a50 tx=0x7fe3900046b0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 shutdown_connections 2024-02-20T08:01:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6802/2184643212,v1:172.21.15.123:6803/2184643212] conn(0x7fe38c06ef80 0x7fe38c071390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe38c0692b0 0x7fe38c06b760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3a00fdf90 0x7fe3a0115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 --2- 172.21.15.123:0/1287658687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a00fe930 0x7fe3a0116130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 >> 172.21.15.123:0/1287658687 conn(0x7fe3a00f79e0 msgr2=0x7fe3a00fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 shutdown_connections 2024-02-20T08:01:29.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:29.773+0000 7fe3a87e9700 1 -- 172.21.15.123:0/1287658687 wait complete. 2024-02-20T08:01:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:29 smithi123 ceph-mon[29383]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:30.063 INFO:teuthology.orchestra.run.smithi123.stdout:171798691850 2024-02-20T08:01:30.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-20T08:01:30.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:29 smithi194 ceph-mon[37804]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 -- 172.21.15.123:0/1159517277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 msgr2=0x7f7750102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 --2- 172.21.15.123:0/1159517277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750102230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7748009ce0 tx=0x7f7748004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 -- 172.21.15.123:0/1159517277 shutdown_connections 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 --2- 172.21.15.123:0/1159517277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 0x7f77500fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 --2- 172.21.15.123:0/1159517277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750102230 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 -- 172.21.15.123:0/1159517277 >> 172.21.15.123:0/1159517277 conn(0x7f77500f7a10 msgr2=0x7f77500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 -- 172.21.15.123:0/1159517277 shutdown_connections 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.996+0000 7f7755104700 1 -- 172.21.15.123:0/1159517277 wait complete. 2024-02-20T08:01:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 Processor -- start 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 -- start start 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 0x7f77501140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501147d0 con 0x7f7750101e60 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f7755104700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775010dae0 con 0x7f7750102800 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48804/0 (socket says 172.21.15.123:48804) 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 -- 172.21.15.123:0/3022502541 learned_addr learned my addr 172.21.15.123:0/3022502541 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774e59c700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 0x7f77501140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 -- 172.21.15.123:0/3022502541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 msgr2=0x7f77501140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 0x7f77501140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 -- 172.21.15.123:0/3022502541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748009940 con 0x7f7750101e60 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.997+0000 7f774ed9d700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f774800bf60 tx=0x7f7748004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.998+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774800e040 con 0x7f7750101e60 2024-02-20T08:01:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.998+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775010dd60 con 0x7f7750101e60 2024-02-20T08:01:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.998+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7748008ea0 con 0x7f7750101e60 2024-02-20T08:01:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.998+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774801c7e0 con 0x7f7750101e60 2024-02-20T08:01:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.998+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775010e2a0 con 0x7f7750101e60 2024-02-20T08:01:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.999+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500fb610 con 0x7f7750101e60 2024-02-20T08:01:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.999+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f774801caa0 con 0x7f7750101e60 2024-02-20T08:01:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:30.999+0000 7f77377fe700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 0x7f773806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.000+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7748088ac0 con 0x7f7750101e60 2024-02-20T08:01:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.000+0000 7f774e59c700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 0x7f773806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.000+0000 7f774e59c700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 0x7f773806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f775010ecf0 tx=0x7f77440091a0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.004+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7748058710 con 0x7f7750101e60 2024-02-20T08:01:31.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.190+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f775004bed0 con 0x7f7750101e60 2024-02-20T08:01:31.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.190+0000 7f77377fe700 1 -- 172.21.15.123:0/3022502541 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7748004e10 con 0x7f7750101e60 2024-02-20T08:01:31.192 INFO:teuthology.orchestra.run.smithi123.stdout:115964117011 2024-02-20T08:01:31.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 msgr2=0x7f773806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:31.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 0x7f773806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f775010ecf0 tx=0x7f77440091a0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 msgr2=0x7f7750113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f774800bf60 tx=0x7f7748004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 shutdown_connections 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f77380692a0 0x7f773806b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7750101e60 0x7f7750113bb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 --2- 172.21.15.123:0/3022502541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7750102800 0x7f77501140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 >> 172.21.15.123:0/3022502541 conn(0x7f77500f7a10 msgr2=0x7f7750065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 shutdown_connections 2024-02-20T08:01:31.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:31.192+0000 7f7755104700 1 -- 172.21.15.123:0/3022502541 wait complete. 2024-02-20T08:01:31.607 INFO:teuthology.orchestra.run.smithi123.stdout:38654705701 2024-02-20T08:01:31.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-20T08:01:32.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:31 smithi123 ceph-mon[29383]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:32.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:31 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3022502541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 -- 172.21.15.123:0/3920834396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc1027e0 msgr2=0x7fa6fc0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3920834396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc0fbea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0004940 tx=0x7fa6f0009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 -- 172.21.15.123:0/3920834396 shutdown_connections 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3920834396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc0fbea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3920834396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc101e40 0x7fa6fc102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 -- 172.21.15.123:0/3920834396 >> 172.21.15.123:0/3920834396 conn(0x7fa6fc071d90 msgr2=0x7fa6fc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 -- 172.21.15.123:0/3920834396 shutdown_connections 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 -- 172.21.15.123:0/3920834396 wait complete. 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.207+0000 7fa7024a5700 1 Processor -- start 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 -- start start 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc10f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc10f600 con 0x7fa6fc101e40 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc10f770 con 0x7fa6fc1027e0 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48822/0 (socket says 172.21.15.123:48822) 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 -- 172.21.15.123:0/3809015902 learned_addr learned my addr 172.21.15.123:0/3809015902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fb7fe700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc10f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 -- 172.21.15.123:0/3809015902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 msgr2=0x7fa6fc10f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc10f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 -- 172.21.15.123:0/3809015902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0005040 con 0x7fa6fc101e40 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fb7fe700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc10f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6fbfff700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c8c0 tx=0x7fa6ec0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec00a980 con 0x7fa6fc101e40 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc117ae0 con 0x7fa6fc101e40 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6ec00ce60 con 0x7fa6fc101e40 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.208+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec0115e0 con 0x7fa6fc101e40 2024-02-20T08:01:32.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.209+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc117ff0 con 0x7fa6fc101e40 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.209+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc104310 con 0x7fa6fc101e40 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.210+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa6ec012400 con 0x7fa6fc101e40 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.210+0000 7fa6f8ff9700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 0x7fa6e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.210+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa6ec086f50 con 0x7fa6fc101e40 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.210+0000 7fa6fb7fe700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 0x7fa6e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.211+0000 7fa6fb7fe700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 0x7fa6e406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009fd0 tx=0x7fa6f0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:32.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.214+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa6ec0535c0 con 0x7fa6fc101e40 2024-02-20T08:01:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:31 smithi194 ceph-mon[37804]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:31 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3022502541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-20T08:01:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.405+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6fc04bed0 con 0x7fa6fc101e40 2024-02-20T08:01:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.405+0000 7fa6f8ff9700 1 -- 172.21.15.123:0/3809015902 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6ec0126b0 con 0x7fa6fc101e40 2024-02-20T08:01:32.407 INFO:teuthology.orchestra.run.smithi123.stdout:60129542176 2024-02-20T08:01:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.407+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 msgr2=0x7fa6e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.407+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 0x7fa6e406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009fd0 tx=0x7fa6f0009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.407+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 msgr2=0x7fa6fc10eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.407+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c8c0 tx=0x7fa6ec0044c0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 shutdown_connections 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fa6e40692a0 0x7fa6e406b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6fc101e40 0x7fa6fc10eb10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 --2- 172.21.15.123:0/3809015902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6fc1027e0 0x7fa6fc10f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 >> 172.21.15.123:0/3809015902 conn(0x7fa6fc071d90 msgr2=0x7fa6fc0fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 shutdown_connections 2024-02-20T08:01:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:32.408+0000 7fa7024a5700 1 -- 172.21.15.123:0/3809015902 wait complete. 2024-02-20T08:01:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:32 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3809015902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-20T08:01:33.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-02-20T08:01:33.060 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:33.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:32 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3809015902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-20T08:01:34.232 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:33 smithi123 ceph-mon[29383]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:34.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:33 smithi194 ceph-mon[37804]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:34.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117009 got 115964117011 for osd.3 2024-02-20T08:01:34.577 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/4220588424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 msgr2=0x7fd7e0103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/4220588424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0103310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009ce0 tx=0x7fd7d8004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/4220588424 shutdown_connections 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/4220588424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 0x7fd7e00fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/4220588424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0103310 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/4220588424 >> 172.21.15.123:0/4220588424 conn(0x7fd7e00f8af0 msgr2=0x7fd7e00faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/4220588424 shutdown_connections 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.231+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/4220588424 wait complete. 2024-02-20T08:01:34.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 Processor -- start 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 -- start start 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stdout:81604378651 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 0x7fd7e0113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01145e0 con 0x7fd7e0102f40 2024-02-20T08:01:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e7ec0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e010d910 con 0x7fd7e01038e0 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e5c5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e5c5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48842/0 (socket says 172.21.15.123:48842) 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e5c5c700 1 -- 172.21.15.123:0/1411946813 learned_addr learned my addr 172.21.15.123:0/1411946813 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.232+0000 7fd7e545b700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 0x7fd7e0113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e5c5c700 1 -- 172.21.15.123:0/1411946813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 msgr2=0x7fd7e0113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e5c5c700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 0x7fd7e0113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e5c5c700 1 -- 172.21.15.123:0/1411946813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009940 con 0x7fd7e0102f40 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e5c5c700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800ba50 tx=0x7fd7d8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d800e040 con 0x7fd7e0102f40 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7d8004610 con 0x7fd7e0102f40 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d8012bd0 con 0x7fd7e0102f40 2024-02-20T08:01:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e010db90 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.233+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e010e080 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.234+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e0100250 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.235+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd7d801c830 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.235+0000 7fd7d67fc700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 0x7fd7cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.235+0000 7fd7e545b700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 0x7fd7cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.235+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd7d80892b0 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.236+0000 7fd7e545b700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 0x7fd7cc06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0004600 tx=0x7fd7d000b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.240+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd7d8059330 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.425+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd7e004bed0 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.426+0000 7fd7d67fc700 1 -- 172.21.15.123:0/1411946813 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7d8055020 con 0x7fd7e0102f40 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.427+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 msgr2=0x7fd7cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.427+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 0x7fd7cc06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0004600 tx=0x7fd7d000b040 comp rx=0 tx=0).stop 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.427+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 msgr2=0x7fd7e0113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.427+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800ba50 tx=0x7fd7d8004d10 comp rx=0 tx=0).stop 2024-02-20T08:01:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 shutdown_connections 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fd7cc0692a0 0x7fd7cc06b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7e0102f40 0x7fd7e0113a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 --2- 172.21.15.123:0/1411946813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7e01038e0 0x7fd7e0113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 >> 172.21.15.123:0/1411946813 conn(0x7fd7e00f8af0 msgr2=0x7fd7e00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 shutdown_connections 2024-02-20T08:01:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:34.428+0000 7fd7e7ec0700 1 -- 172.21.15.123:0/1411946813 wait complete. 2024-02-20T08:01:35.198 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:34 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1411946813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-20T08:01:35.221 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-02-20T08:01:35.222 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:35.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:34 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1411946813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-20T08:01:35.732 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:35.733 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- 172.21.15.123:0/3302729885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a701038e0 msgr2=0x7f9a700fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 --2- 172.21.15.123:0/3302729885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a701038e0 0x7f9a700fcf50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a58004940 tx=0x7f9a58009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- 172.21.15.123:0/3302729885 shutdown_connections 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 --2- 172.21.15.123:0/3302729885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a701038e0 0x7f9a700fcf50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 --2- 172.21.15.123:0/3302729885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102f40 0x7f9a70103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- 172.21.15.123:0/3302729885 >> 172.21.15.123:0/3302729885 conn(0x7f9a700f8af0 msgr2=0x7f9a700faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- 172.21.15.123:0/3302729885 shutdown_connections 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- 172.21.15.123:0/3302729885 wait complete. 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 Processor -- start 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.157+0000 7f9a77198700 1 -- start start 2024-02-20T08:01:36.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 0x7f9a70114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70114730 con 0x7f9a70102f40 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7010d9d0 con 0x7f9a701038e0 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48856/0 (socket says 172.21.15.123:48856) 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 -- 172.21.15.123:0/2473384984 learned_addr learned my addr 172.21.15.123:0/2473384984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a6ffff700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 0x7f9a70114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 -- 172.21.15.123:0/2473384984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 msgr2=0x7f9a70114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 0x7f9a70114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 -- 172.21.15.123:0/2473384984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58005040 con 0x7f9a70102f40 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a6ffff700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 0x7f9a70114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a74f34700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000bbb0 tx=0x7f9a60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a600092e0 con 0x7f9a70102f40 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a6000cbd0 con 0x7f9a70102f40 2024-02-20T08:01:36.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7010dcb0 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a60007400 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.158+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7010e1f0 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.159+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a700fc6f0 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.160+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9a60012070 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.160+0000 7f9a6d7fa700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 0x7f9a5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.160+0000 7f9a6ffff700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 0x7f9a5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.160+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9a60086c50 con 0x7f9a70102f40 2024-02-20T08:01:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.161+0000 7f9a6ffff700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 0x7f9a5c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800b3b0 tx=0x7f9a58009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:36.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.165+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9a60056cd0 con 0x7f9a70102f40 2024-02-20T08:01:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:35 smithi123 ceph-mon[29383]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:36.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.352+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9a7010f0f0 con 0x7f9a70102f40 2024-02-20T08:01:36.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.352+0000 7f9a6d7fa700 1 -- 172.21.15.123:0/2473384984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a60056860 con 0x7f9a70102f40 2024-02-20T08:01:36.354 INFO:teuthology.orchestra.run.smithi123.stdout:150323855376 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 msgr2=0x7f9a5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 0x7f9a5c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800b3b0 tx=0x7f9a58009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 msgr2=0x7f9a70113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000bbb0 tx=0x7f9a60009840 comp rx=0 tx=0).stop 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 shutdown_connections 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9a5c0692a0 0x7f9a5c06b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a70102f40 0x7f9a70113b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 --2- 172.21.15.123:0/2473384984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a701038e0 0x7f9a70114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:36.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 >> 172.21.15.123:0/2473384984 conn(0x7f9a700f8af0 msgr2=0x7f9a700fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:36.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 shutdown_connections 2024-02-20T08:01:36.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:36.354+0000 7f9a77198700 1 -- 172.21.15.123:0/2473384984 wait complete. 2024-02-20T08:01:36.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:35 smithi194 ceph-mon[37804]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:37.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:36 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2473384984' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-20T08:01:37.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855376 for osd.4 2024-02-20T08:01:37.194 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:36 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2473384984' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-20T08:01:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:37 smithi123 ceph-mon[29383]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:37 smithi194 ceph-mon[37804]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 -- 172.21.15.123:0/65643681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b74101e40 msgr2=0x7f5b74102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 --2- 172.21.15.123:0/65643681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b74101e40 0x7f5b74102210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b64004940 tx=0x7f5b64009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 -- 172.21.15.123:0/65643681 shutdown_connections 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 --2- 172.21.15.123:0/65643681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b741027e0 0x7f5b740fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 --2- 172.21.15.123:0/65643681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b74101e40 0x7f5b74102210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 -- 172.21.15.123:0/65643681 >> 172.21.15.123:0/65643681 conn(0x7f5b74071d90 msgr2=0x7f5b74072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 -- 172.21.15.123:0/65643681 shutdown_connections 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.588+0000 7f5b79db0700 1 -- 172.21.15.123:0/65643681 wait complete. 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 Processor -- start 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 -- start start 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b74101e40 0x7f5b741139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74114550 con 0x7f5b741027e0 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b79db0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7410d880 con 0x7f5b74101e40 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45970/0 (socket says 172.21.15.123:45970) 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.589+0000 7f5b6bfff700 1 -- 172.21.15.123:0/2096948344 learned_addr learned my addr 172.21.15.123:0/2096948344 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b6bfff700 1 -- 172.21.15.123:0/2096948344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b74101e40 msgr2=0x7f5b741139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b6bfff700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b74101e40 0x7f5b741139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b6bfff700 1 -- 172.21.15.123:0/2096948344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b64005040 con 0x7f5b741027e0 2024-02-20T08:01:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b6bfff700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00eb40 tx=0x7f5b5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c007cc0 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7410db00 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b5c00f040 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c0095e0 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.590+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7410e040 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.591+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b740738b0 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.591+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5b5c009740 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.592+0000 7f5b70ff9700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 0x7f5b6006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.592+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5b5c086910 con 0x7f5b741027e0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.592+0000 7f5b737fe700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 0x7f5b6006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.592+0000 7f5b737fe700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 0x7f5b6006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000c00 tx=0x7f5b64009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:39.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.596+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5b5c04dbd0 con 0x7f5b741027e0 2024-02-20T08:01:39.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.788+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5b7404bed0 con 0x7f5b741027e0 2024-02-20T08:01:39.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.788+0000 7f5b70ff9700 1 -- 172.21.15.123:0/2096948344 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b5c056a40 con 0x7f5b741027e0 2024-02-20T08:01:39.790 INFO:teuthology.orchestra.run.smithi123.stdout:171798691852 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 msgr2=0x7f5b6006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 0x7f5b6006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000c00 tx=0x7f5b64009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 msgr2=0x7f5b74113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00eb40 tx=0x7f5b5c00b040 comp rx=0 tx=0).stop 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 shutdown_connections 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5b600692a0 0x7f5b6006b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b74101e40 0x7f5b741139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 --2- 172.21.15.123:0/2096948344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b741027e0 0x7f5b74113f00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 >> 172.21.15.123:0/2096948344 conn(0x7f5b74071d90 msgr2=0x7f5b740656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:39.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.790+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 shutdown_connections 2024-02-20T08:01:39.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.791+0000 7f5b79db0700 1 -- 172.21.15.123:0/2096948344 wait complete. 2024-02-20T08:01:39.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- 172.21.15.123:0/780639045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 msgr2=0x7f5ae810d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 --2- 172.21.15.123:0/780639045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae810d4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8004940 tx=0x7f5ad8009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- 172.21.15.123:0/780639045 shutdown_connections 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 --2- 172.21.15.123:0/780639045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae810d4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 --2- 172.21.15.123:0/780639045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae80fbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- 172.21.15.123:0/780639045 >> 172.21.15.123:0/780639045 conn(0x7f5ae8071560 msgr2=0x7f5ae8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- 172.21.15.123:0/780639045 shutdown_connections 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- 172.21.15.123:0/780639045 wait complete. 2024-02-20T08:01:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 Processor -- start 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.836+0000 7f5aef987700 1 -- start start 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aef987700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae811a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aef987700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aef987700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae811acd0 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aef987700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8113fe0 con 0x7f5ae80fb7c0 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45984/0 (socket says 172.21.15.123:45984) 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 -- 172.21.15.123:0/2775362460 learned_addr learned my addr 172.21.15.123:0/2775362460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aed723700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae811a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 -- 172.21.15.123:0/2775362460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 msgr2=0x7f5ae811a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae811a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 -- 172.21.15.123:0/2775362460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8005040 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aed723700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae811a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.837+0000 7f5aecf22700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80090d0 tx=0x7f5ad8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.838+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ad800e040 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.838+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ad800bcc0 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.838+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae8114260 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.838+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ad801c630 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.838+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae81147a0 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.839+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae80fe0e0 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.839+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5ad8013420 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.840+0000 7f5addffb700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 0x7f5ad406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.840+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5ad80881f0 con 0x7f5ae80fc0d0 2024-02-20T08:01:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.840+0000 7f5aed723700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 0x7f5ad406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.840+0000 7f5aed723700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 0x7f5ad406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4004f60 tx=0x7f5ae400b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:39.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:39.844+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5ad80582f0 con 0x7f5ae80fc0d0 2024-02-20T08:01:40.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.032+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ae8073080 con 0x7f5ae80fc0d0 2024-02-20T08:01:40.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.032+0000 7f5addffb700 1 -- 172.21.15.123:0/2775362460 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ad8057e80 con 0x7f5ae80fc0d0 2024-02-20T08:01:40.034 INFO:teuthology.orchestra.run.smithi123.stdout:38654705703 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 msgr2=0x7f5ad406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 0x7f5ad406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4004f60 tx=0x7f5ae400b040 comp rx=0 tx=0).stop 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 msgr2=0x7f5ae811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80090d0 tx=0x7f5ad8009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 shutdown_connections 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f5ad40692a0 0x7f5ad406b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ae80fb7c0 0x7f5ae811a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 --2- 172.21.15.123:0/2775362460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80fc0d0 0x7f5ae811a680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 >> 172.21.15.123:0/2775362460 conn(0x7f5ae8071560 msgr2=0x7f5ae810bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 shutdown_connections 2024-02-20T08:01:40.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:40.035+0000 7f5aef987700 1 -- 172.21.15.123:0/2775362460 wait complete. 2024-02-20T08:01:40.046 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:39 smithi123 ceph-mon[29383]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:40.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:39 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2096948344' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-20T08:01:40.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:39 smithi194 ceph-mon[37804]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:40.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:39 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2096948344' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-20T08:01:40.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691852 for osd.5 2024-02-20T08:01:40.649 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:41.152 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705701 got 38654705703 for osd.0 2024-02-20T08:01:41.152 DEBUG:teuthology.parallel:result is None 2024-02-20T08:01:41.153 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-20T08:01:41.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-20T08:01:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2775362460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-20T08:01:41.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:40 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2775362460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-20T08:01:41.410 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:42.172 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:41 smithi123 ceph-mon[29383]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:42.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:41 smithi194 ceph-mon[37804]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:42.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 -- 172.21.15.123:0/1917099642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 msgr2=0x7f46c0106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:42.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 --2- 172.21.15.123:0/1917099642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c0106fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46b4004940 tx=0x7f46b4009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 -- 172.21.15.123:0/1917099642 shutdown_connections 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 --2- 172.21.15.123:0/1917099642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c0106fa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 --2- 172.21.15.123:0/1917099642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 0x7f46c00fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 -- 172.21.15.123:0/1917099642 >> 172.21.15.123:0/1917099642 conn(0x7f46c00f7a10 msgr2=0x7f46c00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 -- 172.21.15.123:0/1917099642 shutdown_connections 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 -- 172.21.15.123:0/1917099642 wait complete. 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.927+0000 7f46c4973700 1 Processor -- start 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 -- start start 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 0x7f46c00fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00fc930 con 0x7f46c00fe960 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00fcaa0 con 0x7f46c00fdfc0 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46002/0 (socket says 172.21.15.123:46002) 2024-02-20T08:01:42.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 -- 172.21.15.123:0/348283652 learned_addr learned my addr 172.21.15.123:0/348283652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46be59c700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 0x7f46c00fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 -- 172.21.15.123:0/348283652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 msgr2=0x7f46c00fbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 0x7f46c00fbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 -- 172.21.15.123:0/348283652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4005040 con 0x7f46c00fe960 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46bdd9b700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46b4004890 tx=0x7f46b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b400e040 con 0x7f46c00fe960 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0119d40 con 0x7f46c00fe960 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46b4004290 con 0x7f46c00fe960 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.928+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b401c630 con 0x7f46c00fe960 2024-02-20T08:01:42.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.929+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c011a220 con 0x7f46c00fe960 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.929+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c01045b0 con 0x7f46c00fe960 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.930+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f46b400bbf0 con 0x7f46c00fe960 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.930+0000 7f46aeffd700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 0x7f46a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.930+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f46b40882b0 con 0x7f46c00fe960 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.930+0000 7f46be59c700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 0x7f46a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.931+0000 7f46be59c700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 0x7f46a806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46b0007fd0 tx=0x7f46b0009040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:42.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:42.935+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f46b4054920 con 0x7f46c00fe960 2024-02-20T08:01:43.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.114+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46c010a020 con 0x7f46a80692a0 2024-02-20T08:01:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.115+0000 7f46aeffd700 1 -- 172.21.15.123:0/348283652 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28079 (secure 0 0 0) 0x7f46b0004db0 con 0x7f46a80692a0 2024-02-20T08:01:43.116 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 msgr2=0x7f46a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 0x7f46a806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46b0007fd0 tx=0x7f46b0009040 comp rx=0 tx=0).stop 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 msgr2=0x7f46c00fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46b4004890 tx=0x7f46b4009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 shutdown_connections 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46a80692a0 0x7f46a806b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00fdfc0 0x7f46c00fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 --2- 172.21.15.123:0/348283652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c00fe960 0x7f46c00fc330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 >> 172.21.15.123:0/348283652 conn(0x7f46c00f7a10 msgr2=0x7f46c0101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 shutdown_connections 2024-02-20T08:01:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:43.117+0000 7f46c4973700 1 -- 172.21.15.123:0/348283652 wait complete. 2024-02-20T08:01:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-02-20T08:01:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-02-20T08:01:42.477828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002294"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-20T08:00:53.172147+0000","last_change":"2024-02-20T08:00:26.715182+0000","last_active":"2024-02-20T08:00:53.172147+0000","last_peered":"2024-02-20T08:00:53.172147+0000","last_clean":"2024-02-20T08:00:53.172147+0000","last_became_active":"2024-02-20T08:00:26.714814+0000","last_became_peered":"2024-02-20T08:00:26.714814+0000","last_unstale":"2024-02-20T08:00:53.172147+0000","last_undegraded":"2024-02-20T08:00:53.172147+0000","last_fullsized":"2024-02-20T08:00:53.172147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-20T07:59:37.316338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-20T07:59:37.316338+0000","last_clean_scrub_stamp":"2024-02-20T07:59:37.316338+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-21T15:32:10.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.44500000000000001}]},{"osd":1,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.499},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.38},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Feb 20 08:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.315},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38}]},{"osd":1,"last update":"Tue Feb 20 08:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.373,"15min":0.373},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Feb 20 08:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 20 08:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.248,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.25}]},{"osd":2,"last update":"Tue Feb 20 08:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.378,"15min":0.38600000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44700000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28899999999999998}]},{"osd":3,"last update":"Tue Feb 20 08:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Feb 20 08:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35299999999999998,"15min":0.34899999999999998},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.441},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Tue Feb 20 08:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.42299999999999999}]},{"osd":3,"last update":"Tue Feb 20 08:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Feb 20 08:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-20T08:01:43.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-20T08:01:43.974 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:44.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:43 smithi123 ceph-mon[29383]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:44.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:43 smithi194 ceph-mon[37804]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:45.253 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:44 smithi123 ceph-mon[29383]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-20T08:01:45.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:44 smithi194 ceph-mon[37804]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-20T08:01:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/2995298120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 msgr2=0x7fcfdc0fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/2995298120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc0fbe60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8004940 tx=0x7fcfc8009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/2995298120 shutdown_connections 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/2995298120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc0fbe60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/2995298120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 0x7fcfdc102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/2995298120 >> 172.21.15.123:0/2995298120 conn(0x7fcfdc0f79e0 msgr2=0x7fcfdc0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/2995298120 shutdown_connections 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/2995298120 wait complete. 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.595+0000 7fcfe2fd4700 1 Processor -- start 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 -- start start 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 0x7fcfdc1129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc113540 con 0x7fcfdc1027f0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc10c870 con 0x7fcfdc101e50 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46030/0 (socket says 172.21.15.123:46030) 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 -- 172.21.15.123:0/1644889444 learned_addr learned my addr 172.21.15.123:0/1644889444 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe0d70700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 0x7fcfdc1129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 -- 172.21.15.123:0/1644889444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 msgr2=0x7fcfdc1129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 0x7fcfdc1129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 -- 172.21.15.123:0/1644889444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8005040 con 0x7fcfdc1027f0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfdbfff700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80090d0 tx=0x7fcfc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc800e040 con 0x7fcfdc1027f0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.596+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc10caf0 con 0x7fcfdc1027f0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.597+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc10d030 con 0x7fcfdc1027f0 2024-02-20T08:01:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.597+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfc8009430 con 0x7fcfdc1027f0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.597+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc8013e20 con 0x7fcfdc1027f0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.598+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc00052e0 con 0x7fcfdc1027f0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.598+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcfc800bbf0 con 0x7fcfdc1027f0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.598+0000 7fcfd97fa700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 0x7fcfcc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.599+0000 7fcfe0d70700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 0x7fcfcc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.599+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcfc8087ff0 con 0x7fcfdc1027f0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.599+0000 7fcfe0d70700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 0x7fcfcc06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0004ed0 tx=0x7fcfd000b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.603+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcfc80580f0 con 0x7fcfdc1027f0 2024-02-20T08:01:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.783+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfc0000bf0 con 0x7fcfcc0692a0 2024-02-20T08:01:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.784+0000 7fcfd97fa700 1 -- 172.21.15.123:0/1644889444 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28050 (secure 0 0 0) 0x7fcfc0000bf0 con 0x7fcfcc0692a0 2024-02-20T08:01:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 msgr2=0x7fcfcc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 0x7fcfcc06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0004ed0 tx=0x7fcfd000b040 comp rx=0 tx=0).stop 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 msgr2=0x7fcfdc112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80090d0 tx=0x7fcfc8009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 shutdown_connections 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcfcc0692a0 0x7fcfcc06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfdc101e50 0x7fcfdc1129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 --2- 172.21.15.123:0/1644889444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfdc1027f0 0x7fcfdc112ef0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 >> 172.21.15.123:0/1644889444 conn(0x7fcfdc0f79e0 msgr2=0x7fcfdc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 shutdown_connections 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:45.786+0000 7fcfe2fd4700 1 -- 172.21.15.123:0/1644889444 wait complete. 2024-02-20T08:01:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-02-20T08:01:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:45 smithi123 ceph-mon[29383]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:46.350 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-02-20T08:01:44.478206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002342"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-20T08:00:53.172147+0000","last_change":"2024-02-20T08:00:26.715182+0000","last_active":"2024-02-20T08:00:53.172147+0000","last_peered":"2024-02-20T08:00:53.172147+0000","last_clean":"2024-02-20T08:00:53.172147+0000","last_became_active":"2024-02-20T08:00:26.714814+0000","last_became_peered":"2024-02-20T08:00:26.714814+0000","last_unstale":"2024-02-20T08:00:53.172147+0000","last_undegraded":"2024-02-20T08:00:53.172147+0000","last_fullsized":"2024-02-20T08:00:53.172147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-20T07:59:37.316338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-20T07:59:37.316338+0000","last_clean_scrub_stamp":"2024-02-20T07:59:37.316338+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-21T15:32:10.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.497},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Feb 20 08:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Feb 20 08:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.315},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38}]},{"osd":1,"last update":"Tue Feb 20 08:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.373,"15min":0.373},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Feb 20 08:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Feb 20 08:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 20 08:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.308},{"interface":"front","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.248,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.37}]},{"osd":2,"last update":"Tue Feb 20 08:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.378,"15min":0.38600000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44700000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Tue Feb 20 08:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.497},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48199999999999998}]},{"osd":4,"last update":"Tue Feb 20 08:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 20 08:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35299999999999998,"15min":0.34899999999999998},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54500000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Tue Feb 20 08:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39400000000000002,"15min":0.40400000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.41599999999999998,"15min":0.42799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.46000000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.311}]},{"osd":3,"last update":"Tue Feb 20 08:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.73599999999999999}]},{"osd":4,"last update":"Tue Feb 20 08:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-20T08:01:46.351 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-20T08:01:46.351 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-20T08:01:46.351 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-20T08:01:46.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph health --format=json 2024-02-20T08:01:46.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:45 smithi194 ceph-mon[37804]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:46.605 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:46 smithi123 ceph-mon[29383]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-20T08:01:47.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:46 smithi194 ceph-mon[37804]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 -- 172.21.15.123:0/395254114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 msgr2=0x7f89800fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 --2- 172.21.15.123:0/395254114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fb9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8970004940 tx=0x7f8970009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 -- 172.21.15.123:0/395254114 shutdown_connections 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 --2- 172.21.15.123:0/395254114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fb9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 --2- 172.21.15.123:0/395254114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89801033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 -- 172.21.15.123:0/395254114 >> 172.21.15.123:0/395254114 conn(0x7f8980071500 msgr2=0x7f8980071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 -- 172.21.15.123:0/395254114 shutdown_connections 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.164+0000 7f898748f700 1 -- 172.21.15.123:0/395254114 wait complete. 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 Processor -- start 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 -- start start 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89800fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:48.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800fd2f0 con 0x7f89800fb560 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800fd460 con 0x7f8980102fe0 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46052/0 (socket says 172.21.15.123:46052) 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 -- 172.21.15.123:0/3391752615 learned_addr learned my addr 172.21.15.123:0/3391752615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f8984a2a700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89800fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 -- 172.21.15.123:0/3391752615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 msgr2=0x7f89800fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89800fcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 -- 172.21.15.123:0/3391752615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970005040 con 0x7f89800fb560 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f8984a2a700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89800fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898522b700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f897c00c8b0 tx=0x7f897c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c00a760 con 0x7f89800fb560 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f897c00ad90 con 0x7f89800fb560 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8980119ce0 con 0x7f89800fb560 2024-02-20T08:01:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.165+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c0113a0 con 0x7f89800fb560 2024-02-20T08:01:48.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.166+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898011a220 con 0x7f89800fb560 2024-02-20T08:01:48.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.167+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89801053c0 con 0x7f89800fb560 2024-02-20T08:01:48.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.167+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f897c012400 con 0x7f89800fb560 2024-02-20T08:01:48.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.167+0000 7f8975ffb700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 0x7f896c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.167+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f897c086e10 con 0x7f89800fb560 2024-02-20T08:01:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.167+0000 7f8984a2a700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 0x7f896c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.168+0000 7f8984a2a700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 0x7f896c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f8970009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:48.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.171+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f897c0534a0 con 0x7f89800fb560 2024-02-20T08:01:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:47 smithi123 ceph-mon[29383]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:47 smithi194 ceph-mon[37804]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:48.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.396+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f898004bf00 con 0x7f89800fb560 2024-02-20T08:01:48.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.396+0000 7f8975ffb700 1 -- 172.21.15.123:0/3391752615 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f897c056ac0 con 0x7f89800fb560 2024-02-20T08:01:48.397 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:01:48.397 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-20T08:01:48.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 msgr2=0x7f896c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:48.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 0x7f896c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f8970009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:48.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 msgr2=0x7f89800fc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:48.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f897c00c8b0 tx=0x7f897c004470 comp rx=0 tx=0).stop 2024-02-20T08:01:48.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 shutdown_connections 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f896c0692a0 0x7f896c06b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89800fb560 0x7f89800fc740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 --2- 172.21.15.123:0/3391752615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8980102fe0 0x7f89800fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.398+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 >> 172.21.15.123:0/3391752615 conn(0x7f8980071500 msgr2=0x7f89800fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.399+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 shutdown_connections 2024-02-20T08:01:48.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:48.399+0000 7f898748f700 1 -- 172.21.15.123:0/3391752615 wait complete. 2024-02-20T08:01:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:48 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3391752615' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-20T08:01:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:48 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:49.046 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-20T08:01:49.046 INFO:tasks.cephadm:Setup complete, yielding 2024-02-20T08:01:49.047 INFO:teuthology.run_tasks:Running task print... 2024-02-20T08:01:49.056 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-20T08:01:49.056 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:01:49.064 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:01:49.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-20T08:01:49.318 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:48 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3391752615' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-20T08:01:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:48 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:01:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:49 smithi123 ceph-mon[29383]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:50.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:49 smithi194 ceph-mon[37804]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:50.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 -- 172.21.15.123:0/3842039461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fcfb0 msgr2=0x7f3d180fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/3842039461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fcfb0 0x7f3d180fd420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004940 tx=0x7f3d0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 -- 172.21.15.123:0/3842039461 shutdown_connections 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/3842039461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fcfb0 0x7f3d180fd420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/3842039461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fbe40 0x7f3d180fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 -- 172.21.15.123:0/3842039461 >> 172.21.15.123:0/3842039461 conn(0x7f3d180f74e0 msgr2=0x7f3d180f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 -- 172.21.15.123:0/3842039461 shutdown_connections 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.906+0000 7f3d1d53e700 1 -- 172.21.15.123:0/3842039461 wait complete. 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 Processor -- start 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 -- start start 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:50.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 0x7f3d18112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18066460 con 0x7f3d180fbe40 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d1d53e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180665a0 con 0x7f3d180fcfb0 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d16ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d16ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42084/0 (socket says 172.21.15.123:42084) 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d16ffd700 1 -- 172.21.15.123:0/1032632482 learned_addr learned my addr 172.21.15.123:0/1032632482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.907+0000 7f3d167fc700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 0x7f3d18112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d16ffd700 1 -- 172.21.15.123:0/1032632482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 msgr2=0x7f3d18112be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d16ffd700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 0x7f3d18112be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d16ffd700 1 -- 172.21.15.123:0/1032632482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c005040 con 0x7f3d180fbe40 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d167fc700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 0x7f3d18112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d16ffd700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c8c0 tx=0x7f3d080044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0800a980 con 0x7f3d180fbe40 2024-02-20T08:01:50.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d181131e0 con 0x7f3d180fbe40 2024-02-20T08:01:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d0800ce60 con 0x7f3d180fbe40 2024-02-20T08:01:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d080115e0 con 0x7f3d180fbe40 2024-02-20T08:01:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.908+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18113720 con 0x7f3d180fbe40 2024-02-20T08:01:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.909+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1804bed0 con 0x7f3d180fbe40 2024-02-20T08:01:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.909+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3d08012400 con 0x7f3d180fbe40 2024-02-20T08:01:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.910+0000 7f3cff7fe700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.910+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d08086f80 con 0x7f3d180fbe40 2024-02-20T08:01:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.910+0000 7f3d167fc700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.910+0000 7f3d167fc700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 0x7f3d0006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004f90 tx=0x7f3d0c009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:50.914+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3d080535f0 con 0x7f3d180fbe40 2024-02-20T08:01:51.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.098+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f3d18104930 con 0x7f3d180fbe40 2024-02-20T08:01:51.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.103+0000 7f3cff7fe700 1 -- 172.21.15.123:0/1032632482 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3d18104930 con 0x7f3d180fbe40 2024-02-20T08:01:51.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 msgr2=0x7f3d0006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 0x7f3d0006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004f90 tx=0x7f3d0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 msgr2=0x7f3d18110690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c8c0 tx=0x7f3d080044c0 comp rx=0 tx=0).stop 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 shutdown_connections 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d180fbe40 0x7f3d18110690 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 --2- 172.21.15.123:0/1032632482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180fcfb0 0x7f3d18112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 >> 172.21.15.123:0/1032632482 conn(0x7f3d180f74e0 msgr2=0x7f3d18100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 shutdown_connections 2024-02-20T08:01:51.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:51.105+0000 7f3d1d53e700 1 -- 172.21.15.123:0/1032632482 wait complete. 2024-02-20T08:01:51.841 INFO:teuthology.run_tasks:Running task print... 2024-02-20T08:01:51.850 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-20T08:01:51.850 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:01:51.870 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:01:51.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph orch status' 2024-02-20T08:01:52.123 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1032632482' entity='client.admin' 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:01:52.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:51 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:01:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1032632482' entity='client.admin' 2024-02-20T08:01:52.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:01:52.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:01:52.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:01:52.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:51 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- 172.21.15.123:0/1817545087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400fe580 msgr2=0x7fc8400fe990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1817545087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400fe580 0x7fc8400fe990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc83c004940 tx=0x7fc83c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- 172.21.15.123:0/1817545087 shutdown_connections 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1817545087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400feed0 0x7fc8400fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1817545087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400fe580 0x7fc8400fe990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- 172.21.15.123:0/1817545087 >> 172.21.15.123:0/1817545087 conn(0x7fc8400f6d20 msgr2=0x7fc8400f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- 172.21.15.123:0/1817545087 shutdown_connections 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- 172.21.15.123:0/1817545087 wait complete. 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 Processor -- start 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- start start 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400fe580 0x7fc8400fddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400fc840 con 0x7fc8400feed0 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.952+0000 7fc8472fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400fc9b0 con 0x7fc8400fe580 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42108/0 (socket says 172.21.15.123:42108) 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 -- 172.21.15.123:0/1096465372 learned_addr learned my addr 172.21.15.123:0/1096465372 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc84509a700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400fe580 0x7fc8400fddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 -- 172.21.15.123:0/1096465372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400fe580 msgr2=0x7fc8400fddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400fe580 0x7fc8400fddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 -- 172.21.15.123:0/1096465372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c005040 con 0x7fc8400feed0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc844899700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc830002a50 tx=0x7fc8300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc830007cc0 con 0x7fc8400feed0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc83000f040 con 0x7fc8400feed0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400fcc90 con 0x7fc8400feed0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc83000da30 con 0x7fc8400feed0 2024-02-20T08:01:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.953+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc840115cb0 con 0x7fc8400feed0 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.954+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840107a70 con 0x7fc8400feed0 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.955+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc83000db90 con 0x7fc8400feed0 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.955+0000 7fc835ffb700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 0x7fc82c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.955+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc830086c00 con 0x7fc8400feed0 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.955+0000 7fc84509a700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 0x7fc82c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:53.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.955+0000 7fc84509a700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 0x7fc82c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc83c004890 tx=0x7fc83c009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:53.959+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc83008c020 con 0x7fc8400feed0 2024-02-20T08:01:54.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.159+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc840105aa0 con 0x7fc82c0692a0 2024-02-20T08:01:54.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.160+0000 7fc835ffb700 1 -- 172.21.15.123:0/1096465372 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc840105aa0 con 0x7fc82c0692a0 2024-02-20T08:01:54.160 INFO:teuthology.orchestra.run.smithi123.stdout:Backend: cephadm 2024-02-20T08:01:54.160 INFO:teuthology.orchestra.run.smithi123.stdout:Available: Yes 2024-02-20T08:01:54.160 INFO:teuthology.orchestra.run.smithi123.stdout:Paused: No 2024-02-20T08:01:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 msgr2=0x7fc82c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 0x7fc82c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc83c004890 tx=0x7fc83c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 msgr2=0x7fc8400fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc830002a50 tx=0x7fc8300046b0 comp rx=0 tx=0).stop 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 shutdown_connections 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fc82c0692a0 0x7fc82c06b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8400fe580 0x7fc8400fddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 --2- 172.21.15.123:0/1096465372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8400feed0 0x7fc8400fc240 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 >> 172.21.15.123:0/1096465372 conn(0x7fc8400f6d20 msgr2=0x7fc840101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 shutdown_connections 2024-02-20T08:01:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:54.162+0000 7fc8472fe700 1 -- 172.21.15.123:0/1096465372 wait complete. 2024-02-20T08:01:54.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:53 smithi123 ceph-mon[29383]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:53 smithi194 ceph-mon[37804]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:54.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-20T08:01:55.069 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:56.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:55 smithi123 ceph-mon[29383]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:01:56.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:55 smithi123 ceph-mon[29383]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:55 smithi194 ceph-mon[37804]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:01:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:55 smithi194 ceph-mon[37804]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 -- 172.21.15.123:0/3712914036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fcd80 msgr2=0x7ff0600fd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 --2- 172.21.15.123:0/3712914036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fcd80 0x7ff0600fd1f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff04c004940 tx=0x7ff04c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 -- 172.21.15.123:0/3712914036 shutdown_connections 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 --2- 172.21.15.123:0/3712914036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fcd80 0x7ff0600fd1f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 --2- 172.21.15.123:0/3712914036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fc430 0x7ff0600fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 -- 172.21.15.123:0/3712914036 >> 172.21.15.123:0/3712914036 conn(0x7ff0600f6d20 msgr2=0x7ff0600f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 -- 172.21.15.123:0/3712914036 shutdown_connections 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.671+0000 7ff0670cc700 1 -- 172.21.15.123:0/3712914036 wait complete. 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 Processor -- start 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 -- start start 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 0x7ff06010e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06010e880 con 0x7ff0600fc430 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff0670cc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06010f010 con 0x7ff0600fcd80 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff064e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff064e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42118/0 (socket says 172.21.15.123:42118) 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff064e68700 1 -- 172.21.15.123:0/2384320403 learned_addr learned my addr 172.21.15.123:0/2384320403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.672+0000 7ff05ffff700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 0x7ff06010e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff064e68700 1 -- 172.21.15.123:0/2384320403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 msgr2=0x7ff06010e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff064e68700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 0x7ff06010e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff064e68700 1 -- 172.21.15.123:0/2384320403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c005040 con 0x7ff0600fc430 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff05ffff700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 0x7ff06010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff064e68700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff054002a80 tx=0x7ff054004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff054007cc0 con 0x7ff0600fc430 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06010f2f0 con 0x7ff0600fc430 2024-02-20T08:01:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff05400f040 con 0x7ff0600fc430 2024-02-20T08:01:56.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05400dad0 con 0x7ff0600fc430 2024-02-20T08:01:56.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.673+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06010f830 con 0x7ff0600fc430 2024-02-20T08:01:56.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.674+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06004bed0 con 0x7ff0600fc430 2024-02-20T08:01:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.674+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff05400dc30 con 0x7ff0600fc430 2024-02-20T08:01:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.675+0000 7ff05d7fa700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 0x7ff05006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.675+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff054086bf0 con 0x7ff0600fc430 2024-02-20T08:01:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.675+0000 7ff05ffff700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 0x7ff05006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.675+0000 7ff05ffff700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 0x7ff05006b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff04c004560 tx=0x7ff04c009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:56.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.679+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff054056c70 con 0x7ff0600fc430 2024-02-20T08:01:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.875+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff06010fac0 con 0x7ff0500692a0 2024-02-20T08:01:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.883+0000 7ff05d7fa700 1 -- 172.21.15.123:0/2384320403 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7ff06010fac0 con 0x7ff0500692a0 2024-02-20T08:01:56.884 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:01:56.884 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (3m) 2m ago 5m 26.3M - 0.25.0 c8568f914cd2 a0302c7e0fd3 2024-02-20T08:01:56.884 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (5m) 2m ago 5m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:01:56.884 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (4m) 66s ago 4m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (3m) 2m ago 5m 82.5M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (4m) 66s ago 4m 431M - 17.2.7-521-gc80e7168 10b0c032c913 3a7cc19eb152 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (6m) 2m ago 7m 41.7M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (4m) 66s ago 4m 41.2M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (5m) 2m ago 5m 15.7M - 1.5.0 0da6a335fe13 c635ab46d42a 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 66s ago 4m 16.7M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (3m) 2m ago 3m 36.4M 4288M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (2m) 2m ago 2m 36.7M 4288M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (2m) 2m ago 2m 11.0M 4288M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (2m) 66s ago 2m 42.3M 5312M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:01:56.885 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (96s) 66s ago 96s 36.2M 5312M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:01:56.886 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (70s) 66s ago 70s 12.7M 5312M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:01:56.886 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (3m) 2m ago 4m 35.7M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:01:56.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 msgr2=0x7ff05006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:56.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 0x7ff05006b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff04c004560 tx=0x7ff04c009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 msgr2=0x7ff06010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff054002a80 tx=0x7ff054004600 comp rx=0 tx=0).stop 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 shutdown_connections 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff0500692a0 0x7ff05006b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0600fc430 0x7ff06010dd40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 --2- 172.21.15.123:0/2384320403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0600fcd80 0x7ff06010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 >> 172.21.15.123:0/2384320403 conn(0x7ff0600f6d20 msgr2=0x7ff0600fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 shutdown_connections 2024-02-20T08:01:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:56.885+0000 7ff0670cc700 1 -- 172.21.15.123:0/2384320403 wait complete. 2024-02-20T08:01:57.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-20T08:01:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:01:58.140 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:57 smithi123 ceph-mon[29383]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:58.140 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:57 smithi123 ceph-mon[29383]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:01:58.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:57 smithi194 ceph-mon[37804]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:01:58.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:57 smithi194 ceph-mon[37804]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:01:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 -- 172.21.15.123:0/588444112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80fbcc0 msgr2=0x7f15e8102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 --2- 172.21.15.123:0/588444112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80fbcc0 0x7f15e8102560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15dc004940 tx=0x7f15dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 -- 172.21.15.123:0/588444112 shutdown_connections 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 --2- 172.21.15.123:0/588444112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e80fbcc0 0x7f15e8102560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 --2- 172.21.15.123:0/588444112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 0x7f15e80fb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 -- 172.21.15.123:0/588444112 >> 172.21.15.123:0/588444112 conn(0x7f15e80f6ca0 msgr2=0x7f15e80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 -- 172.21.15.123:0/588444112 shutdown_connections 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.278+0000 7f15ef2de700 1 -- 172.21.15.123:0/588444112 wait complete. 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 Processor -- start 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 -- start start 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 0x7f15e810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e810e4c0 con 0x7f15e810df70 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ef2de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e810e600 con 0x7f15e80fb2e0 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36658/0 (socket says 172.21.15.123:36658) 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 -- 172.21.15.123:0/2760540831 learned_addr learned my addr 172.21.15.123:0/2760540831 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ed07a700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 0x7f15e810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 -- 172.21.15.123:0/2760540831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 msgr2=0x7f15e810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 0x7f15e810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 -- 172.21.15.123:0/2760540831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc005040 con 0x7f15e810df70 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.279+0000 7f15ec879700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009150 tx=0x7f15dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.280+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15dc00e040 con 0x7f15e810df70 2024-02-20T08:01:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.280+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e810f490 con 0x7f15e810df70 2024-02-20T08:01:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.280+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15dc009af0 con 0x7f15e810df70 2024-02-20T08:01:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.280+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15dc01c630 con 0x7f15e810df70 2024-02-20T08:01:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.280+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e810f9d0 con 0x7f15e810df70 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.281+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e80fa940 con 0x7f15e810df70 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.281+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f15dc00bbf0 con 0x7f15e810df70 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.282+0000 7f15e5ffb700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 0x7f15d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.282+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f15dc088050 con 0x7f15e810df70 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.282+0000 7f15ed07a700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 0x7f15d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:01:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.282+0000 7f15ed07a700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 0x7f15d006b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15e0007580 tx=0x7f15e0009780 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:01:59.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.286+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f15dc0581f0 con 0x7f15e810df70 2024-02-20T08:01:59.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.476+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f15e80fbd60 con 0x7f15d00692a0 2024-02-20T08:01:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.480+0000 7f15e5ffb700 1 -- 172.21.15.123:0/2760540831 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f15e80fbd60 con 0x7f15d00692a0 2024-02-20T08:01:59.480 INFO:teuthology.orchestra.run.smithi123.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-20T08:01:59.480 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-20T08:01:59.480 INFO:teuthology.orchestra.run.smithi123.stdout:crash 2/2 2m ago 6m * 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:mgr 2/2 2m ago 6m count:2 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:mon 2/2 2m ago 5m smithi123:172.21.15.123=smithi123;smithi194:172.21.15.194=smithi194;count:2 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:osd 6 2m ago - 2024-02-20T08:01:59.481 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 msgr2=0x7f15d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 0x7f15d006b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15e0007580 tx=0x7f15e0009780 comp rx=0 tx=0).stop 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 msgr2=0x7f15e810ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009150 tx=0x7f15dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 shutdown_connections 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f15d00692a0 0x7f15d006b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15e80fb2e0 0x7f15e810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 --2- 172.21.15.123:0/2760540831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e810df70 0x7f15e810ee10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 >> 172.21.15.123:0/2760540831 conn(0x7f15e80f6ca0 msgr2=0x7f15e80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 shutdown_connections 2024-02-20T08:01:59.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:01:59.482+0000 7f15ef2de700 1 -- 172.21.15.123:0/2760540831 wait complete. 2024-02-20T08:02:00.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-20T08:02:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:01:59 smithi123 ceph-mon[29383]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:00.315 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:00.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:01:59 smithi194 ceph-mon[37804]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:01.134 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:00 smithi123 ceph-mon[29383]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:00 smithi194 ceph-mon[37804]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- 172.21.15.123:0/2676647618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 msgr2=0x7f16f40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 --2- 172.21.15.123:0/2676647618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f40fd320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f16f0004940 tx=0x7f16f0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- 172.21.15.123:0/2676647618 shutdown_connections 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 --2- 172.21.15.123:0/2676647618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f40fe0e0 0x7f16f40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 --2- 172.21.15.123:0/2676647618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f40fd320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- 172.21.15.123:0/2676647618 >> 172.21.15.123:0/2676647618 conn(0x7f16f40f8620 msgr2=0x7f16f40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- 172.21.15.123:0/2676647618 shutdown_connections 2024-02-20T08:02:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- 172.21.15.123:0/2676647618 wait complete. 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 Processor -- start 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.916+0000 7f16fb455700 1 -- start start 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f40fe0e0 0x7f16f410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f410e470 con 0x7f16f40fcef0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f410ed10 con 0x7f16f40fe0e0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36672/0 (socket says 172.21.15.123:36672) 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 -- 172.21.15.123:0/2770785574 learned_addr learned my addr 172.21.15.123:0/2770785574 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 -- 172.21.15.123:0/2770785574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f40fe0e0 msgr2=0x7f16f410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f40fe0e0 0x7f16f410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 -- 172.21.15.123:0/2770785574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0005040 con 0x7f16f40fcef0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16f91f1700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009040 tx=0x7f16f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f000e070 con 0x7f16f40fcef0 2024-02-20T08:02:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16f001c400 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f410ef90 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f000b650 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.917+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f410f470 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.918+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f404bed0 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.919+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f16f0013af0 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.919+0000 7f16e9ffb700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 0x7f16e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.919+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f16f0088490 con 0x7f16f40fcef0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.919+0000 7f16f89f0700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 0x7f16e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.920+0000 7f16f89f0700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 0x7f16e006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009fd0 tx=0x7f16e400b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:01.923+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f16f0058630 con 0x7f16f40fcef0 2024-02-20T08:02:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.116+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f16f410fb30 con 0x7f16e00692b0 2024-02-20T08:02:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.117+0000 7f16e9ffb700 1 -- 172.21.15.123:0/2770785574 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f16f410fb30 con 0x7f16e00692b0 2024-02-20T08:02:02.118 INFO:teuthology.orchestra.run.smithi123.stdout:HOST ADDR LABELS STATUS 2024-02-20T08:02:02.118 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 172.21.15.123 2024-02-20T08:02:02.118 INFO:teuthology.orchestra.run.smithi123.stdout:smithi194 172.21.15.194 2024-02-20T08:02:02.118 INFO:teuthology.orchestra.run.smithi123.stdout:2 hosts in cluster 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 msgr2=0x7f16e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 0x7f16e006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009fd0 tx=0x7f16e400b040 comp rx=0 tx=0).stop 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 msgr2=0x7f16f410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009040 tx=0x7f16f0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 shutdown_connections 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f16e00692b0 0x7f16e006b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f40fcef0 0x7f16f410d930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 --2- 172.21.15.123:0/2770785574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f40fe0e0 0x7f16f410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 >> 172.21.15.123:0/2770785574 conn(0x7f16f40f8620 msgr2=0x7f16f41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 shutdown_connections 2024-02-20T08:02:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:02.119+0000 7f16fb455700 1 -- 172.21.15.123:0/2770785574 wait complete. 2024-02-20T08:02:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:01 smithi123 ceph-mon[29383]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:02.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:01 smithi194 ceph-mon[37804]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:02.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-20T08:02:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:04 smithi123 ceph-mon[29383]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:04 smithi123 ceph-mon[29383]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:04 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:04.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:04 smithi194 ceph-mon[37804]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:04.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:04 smithi194 ceph-mon[37804]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:04.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:04 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 -- 172.21.15.123:0/2631790937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fcfb0 msgr2=0x7f99900fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 --2- 172.21.15.123:0/2631790937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fcfb0 0x7f99900fd420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9978004940 tx=0x7f9978009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 -- 172.21.15.123:0/2631790937 shutdown_connections 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 --2- 172.21.15.123:0/2631790937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fcfb0 0x7f99900fd420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 --2- 172.21.15.123:0/2631790937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fbe40 0x7f99900fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 -- 172.21.15.123:0/2631790937 >> 172.21.15.123:0/2631790937 conn(0x7f99900f74e0 msgr2=0x7f99900f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 -- 172.21.15.123:0/2631790937 shutdown_connections 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.638+0000 7f9996300700 1 -- 172.21.15.123:0/2631790937 wait complete. 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 Processor -- start 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 -- start start 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fcfb0 0x7f9990112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9990066550 con 0x7f99900fbe40 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9996300700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9990066690 con 0x7f99900fcfb0 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36684/0 (socket says 172.21.15.123:36684) 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 -- 172.21.15.123:0/3366768091 learned_addr learned my addr 172.21.15.123:0/3366768091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f9987fff700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fcfb0 0x7f9990112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 -- 172.21.15.123:0/3366768091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fcfb0 msgr2=0x7f9990112b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fcfb0 0x7f9990112b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 -- 172.21.15.123:0/3366768091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978005040 con 0x7f99900fbe40 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.639+0000 7f998ffff700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f998000b790 tx=0x7f9980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.640+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998000f6f0 con 0x7f99900fbe40 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.640+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f998000fd20 con 0x7f99900fbe40 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.640+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9990113240 con 0x7f99900fbe40 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.640+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99800103a0 con 0x7f99900fbe40 2024-02-20T08:02:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.640+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9990113780 con 0x7f99900fbe40 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.641+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999004bed0 con 0x7f99900fbe40 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.641+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9980011400 con 0x7f99900fbe40 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.641+0000 7f998d7fa700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 0x7f997c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.641+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9980086c20 con 0x7f99900fbe40 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.642+0000 7f9987fff700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 0x7f997c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.642+0000 7f9987fff700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 0x7f997c06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9978004f90 tx=0x7f9978009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.646+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9980053290 con 0x7f99900fbe40 2024-02-20T08:02:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.837+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9990101990 con 0x7f997c0692a0 2024-02-20T08:02:04.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.839+0000 7f998d7fa700 1 -- 172.21.15.123:0/3366768091 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f9990101990 con 0x7f997c0692a0 2024-02-20T08:02:04.840 INFO:teuthology.orchestra.run.smithi123.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-20T08:02:04.840 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-02-20T08:02:04.840 INFO:teuthology.orchestra.run.smithi123.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 msgr2=0x7f997c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 0x7f997c06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9978004f90 tx=0x7f9978009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 msgr2=0x7f9990110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f998000b790 tx=0x7f9980009250 comp rx=0 tx=0).stop 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 shutdown_connections 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f997c0692a0 0x7f997c06b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99900fbe40 0x7f9990110610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 --2- 172.21.15.123:0/3366768091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99900fcfb0 0x7f9990112b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 >> 172.21.15.123:0/3366768091 conn(0x7f99900f74e0 msgr2=0x7f9990100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 shutdown_connections 2024-02-20T08:02:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:04.841+0000 7f9996300700 1 -- 172.21.15.123:0/3366768091 wait complete. 2024-02-20T08:02:05.493 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-02-20T08:02:05.504 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:02:05.513 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:05.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-20T08:02:05.768 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:06.187 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:06 smithi123 ceph-mon[29383]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:06.187 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:06 smithi123 ceph-mon[29383]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:06 smithi194 ceph-mon[37804]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:06 smithi194 ceph-mon[37804]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- 172.21.15.123:0/1759424049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 msgr2=0x7f6d10102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1759424049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d10102520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d00004940 tx=0x7f6d00009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- 172.21.15.123:0/1759424049 shutdown_connections 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1759424049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d10102520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1759424049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 0x7f6d100ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- 172.21.15.123:0/1759424049 >> 172.21.15.123:0/1759424049 conn(0x7f6d100f74e0 msgr2=0x7f6d100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- 172.21.15.123:0/1759424049 shutdown_connections 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- 172.21.15.123:0/1759424049 wait complete. 2024-02-20T08:02:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 Processor -- start 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 -- start start 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.401+0000 7f6d1811f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 0x7f6d1010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d1811f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d1811f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1010e4b0 con 0x7f6d101000c0 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d1811f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1010ed50 con 0x7f6d100663e0 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36688/0 (socket says 172.21.15.123:36688) 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 -- 172.21.15.123:0/1812176461 learned_addr learned my addr 172.21.15.123:0/1812176461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d15ebb700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 0x7f6d1010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 -- 172.21.15.123:0/1812176461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 msgr2=0x7f6d1010d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 0x7f6d1010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 -- 172.21.15.123:0/1812176461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00005040 con 0x7f6d101000c0 2024-02-20T08:02:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d156ba700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000b3b0 tx=0x7f6d00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0000e040 con 0x7f6d101000c0 2024-02-20T08:02:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d0000bcc0 con 0x7f6d101000c0 2024-02-20T08:02:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1010efd0 con 0x7f6d101000c0 2024-02-20T08:02:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0001c630 con 0x7f6d101000c0 2024-02-20T08:02:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.402+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1010f510 con 0x7f6d101000c0 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.403+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1004bed0 con 0x7f6d101000c0 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.404+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6d000139f0 con 0x7f6d101000c0 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.404+0000 7f6d067fc700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 0x7f6cfc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.404+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6d000882c0 con 0x7f6d101000c0 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.404+0000 7f6d15ebb700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 0x7f6cfc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.405+0000 7f6d15ebb700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 0x7f6cfc06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c004d60 tx=0x7f6d0c00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:07.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.408+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6d000583c0 con 0x7f6d101000c0 2024-02-20T08:02:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:07.620+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d1010f960 con 0x7f6cfc0692a0 2024-02-20T08:02:08.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:08 smithi123 ceph-mon[29383]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:08.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:08 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-20T08:02:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:08 smithi194 ceph-mon[37804]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:08 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-20T08:02:09.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.041+0000 7f6d067fc700 1 -- 172.21.15.123:0/1812176461 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6d1010f960 con 0x7f6cfc0692a0 2024-02-20T08:02:09.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.045+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 msgr2=0x7f6cfc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:09.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.045+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 0x7f6cfc06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c004d60 tx=0x7f6d0c00b040 comp rx=0 tx=0).stop 2024-02-20T08:02:09.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.045+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 msgr2=0x7f6d1010deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:09.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.045+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000b3b0 tx=0x7f6d00009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 shutdown_connections 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6cfc0692a0 0x7f6cfc06b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d100663e0 0x7f6d1010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 --2- 172.21.15.123:0/1812176461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d101000c0 0x7f6d1010deb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 >> 172.21.15.123:0/1812176461 conn(0x7f6d100f74e0 msgr2=0x7f6d100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 shutdown_connections 2024-02-20T08:02:09.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:09.046+0000 7f6d1811f700 1 -- 172.21.15.123:0/1812176461 wait complete. 2024-02-20T08:02:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:09 smithi194 ceph-mon[37804]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:09 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-20T08:02:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:09 smithi194 ceph-mon[37804]: osdmap e42: 6 total, 6 up, 6 in 2024-02-20T08:02:09.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:09 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-20T08:02:09.430 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:09 smithi123 ceph-mon[29383]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:02:09.430 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:09 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-20T08:02:09.431 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:09 smithi123 ceph-mon[29383]: osdmap e42: 6 total, 6 up, 6 in 2024-02-20T08:02:09.431 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:09 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-20T08:02:09.431 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:09 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[29379]: 2024-02-20T08:02:09.022+0000 7f109ced0700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:02:09.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-20T08:02:10.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: pgmap v175: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:10.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-20T08:02:10.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-20T08:02:10.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: osdmap e43: 6 total, 6 up, 6 in 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: osdmap e44: 6 total, 6 up, 6 in 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: fsmap cephfs:0 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: Saving service mds.cephfs spec with placement count:4 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:10.122 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:10.123 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:10.123 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:10 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:10.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: pgmap v175: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: osdmap e43: 6 total, 6 up, 6 in 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: osdmap e44: 6 total, 6 up, 6 in 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: fsmap cephfs:0 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: Saving service mds.cephfs spec with placement count:4 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:10.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:10 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:11.205 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:11 smithi123 ceph-mon[29383]: Deploying daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:02:11.205 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:11 smithi123 ceph-mon[29383]: osdmap e45: 6 total, 6 up, 6 in 2024-02-20T08:02:11.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:11 smithi194 ceph-mon[37804]: Deploying daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:02:11.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:11 smithi194 ceph-mon[37804]: osdmap e45: 6 total, 6 up, 6 in 2024-02-20T08:02:12.336 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:12 smithi123 ceph-mon[29383]: pgmap v179: 65 pgs: 11 creating+peering, 6 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:12.337 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:12 smithi123 ceph-mon[29383]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-20T08:02:12.337 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:12 smithi123 ceph-mon[29383]: osdmap e46: 6 total, 6 up, 6 in 2024-02-20T08:02:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:12 smithi194 ceph-mon[37804]: pgmap v179: 65 pgs: 11 creating+peering, 6 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:12 smithi194 ceph-mon[37804]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-20T08:02:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:12 smithi194 ceph-mon[37804]: osdmap e46: 6 total, 6 up, 6 in 2024-02-20T08:02:13.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 -- 172.21.15.123:0/1293992076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fcef0 msgr2=0x7f4a200fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 --2- 172.21.15.123:0/1293992076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fcef0 0x7f4a200fd320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009ce0 tx=0x7f4a18004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 -- 172.21.15.123:0/1293992076 shutdown_connections 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 --2- 172.21.15.123:0/1293992076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fe0e0 0x7f4a200fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 --2- 172.21.15.123:0/1293992076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fcef0 0x7f4a200fd320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 -- 172.21.15.123:0/1293992076 >> 172.21.15.123:0/1293992076 conn(0x7f4a200f8620 msgr2=0x7f4a200faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 -- 172.21.15.123:0/1293992076 shutdown_connections 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.207+0000 7f4a2702f700 1 -- 172.21.15.123:0/1293992076 wait complete. 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 Processor -- start 2024-02-20T08:02:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 -- start start 2024-02-20T08:02:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fcef0 0x7f4a2010dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2010e620 con 0x7f4a200fe0e0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.208+0000 7f4a2702f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2010eec0 con 0x7f4a200fcef0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39842/0 (socket says 172.21.15.123:39842) 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a24dcb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fcef0 0x7f4a2010dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 -- 172.21.15.123:0/2131569253 learned_addr learned my addr 172.21.15.123:0/2131569253 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 -- 172.21.15.123:0/2131569253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fcef0 msgr2=0x7f4a2010dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fcef0 0x7f4a2010dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 -- 172.21.15.123:0/2131569253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009940 con 0x7f4a200fe0e0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1ffff700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a10002a50 tx=0x7f4a100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:13.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a10007cc0 con 0x7f4a200fe0e0 2024-02-20T08:02:13.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2010f1a0 con 0x7f4a200fe0e0 2024-02-20T08:02:13.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a1000f040 con 0x7f4a200fe0e0 2024-02-20T08:02:13.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1000da30 con 0x7f4a200fe0e0 2024-02-20T08:02:13.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.209+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2010f6e0 con 0x7f4a200fe0e0 2024-02-20T08:02:13.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.211+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2004bed0 con 0x7f4a200fe0e0 2024-02-20T08:02:13.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.211+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4a1000db90 con 0x7f4a200fe0e0 2024-02-20T08:02:13.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.211+0000 7f4a1d7fa700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 0x7f4a0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:13.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.211+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4a10086f40 con 0x7f4a200fe0e0 2024-02-20T08:02:13.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.212+0000 7f4a24dcb700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 0x7f4a0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:13.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.212+0000 7f4a24dcb700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 0x7f4a0c06b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009cb0 tx=0x7f4a18004d10 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:13.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.216+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4a10056c80 con 0x7f4a200fe0e0 2024-02-20T08:02:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.444+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a20105a30 con 0x7f4a200fe0e0 2024-02-20T08:02:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.445+0000 7f4a1d7fa700 1 -- 172.21.15.123:0/2131569253 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1249 (secure 0 0 0) 0x7f4a10056810 con 0x7f4a200fe0e0 2024-02-20T08:02:13.446 INFO:teuthology.orchestra.run.smithi123.stdout:e4 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 4 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:13.043902+0000 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:02:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 0 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14468} 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data disabled 2024-02-20T08:02:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:02:13.449 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 0 2024-02-20T08:02:13.449 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{0:14468} state up:creating seq 1 addr [v2:172.21.15.123:6826/1747553083,v1:172.21.15.123:6827/1747553083] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:02:13.449 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:13.449 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 msgr2=0x7f4a0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 0x7f4a0c06b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009cb0 tx=0x7f4a18004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 msgr2=0x7f4a2010e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a10002a50 tx=0x7f4a100046b0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 shutdown_connections 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4a0c0692a0 0x7f4a0c06b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a200fcef0 0x7f4a2010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 --2- 172.21.15.123:0/2131569253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a200fe0e0 0x7f4a2010e020 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 >> 172.21.15.123:0/2131569253 conn(0x7f4a200f8620 msgr2=0x7f4a201013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 shutdown_connections 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:13.447+0000 7f4a2702f700 1 -- 172.21.15.123:0/2131569253 wait complete. 2024-02-20T08:02:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 4 2024-02-20T08:02:14.046 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: pgmap v181: 65 pgs: 11 creating+peering, 30 active+clean, 24 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:14.046 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.046 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.046 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6826/1747553083,v1:172.21.15.123:6827/1747553083] up:boot 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: daemon mds.cephfs.smithi123.gglmsl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: Cluster is now healthy 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: fsmap cephfs:0 1 up:standby 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:creating} 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:14.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:14.048 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:14.048 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: daemon mds.cephfs.smithi123.gglmsl is now active in filesystem cephfs as rank 0 2024-02-20T08:02:14.048 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2131569253' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:02:14.072 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:02:14.083 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:14.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-02-20T08:02:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: pgmap v181: 65 pgs: 11 creating+peering, 30 active+clean, 24 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6826/1747553083,v1:172.21.15.123:6827/1747553083] up:boot 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: daemon mds.cephfs.smithi123.gglmsl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: Cluster is now healthy 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: fsmap cephfs:0 1 up:standby 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:creating} 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:14.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:14.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:14.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: daemon mds.cephfs.smithi123.gglmsl is now active in filesystem cephfs as rank 0 2024-02-20T08:02:14.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2131569253' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:02:14.337 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:15 smithi123 ceph-mon[29383]: Deploying daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:02:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:15 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6826/1747553083,v1:172.21.15.123:6827/1747553083] up:active 2024-02-20T08:02:15.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:15 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 2024-02-20T08:02:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:15 smithi194 ceph-mon[37804]: Deploying daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:02:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:15 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6826/1747553083,v1:172.21.15.123:6827/1747553083] up:active 2024-02-20T08:02:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:15 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 -- 172.21.15.123:0/3664091632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e01000e0 msgr2=0x7fe9e0102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/3664091632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e01000e0 0x7fe9e0102520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004940 tx=0x7fe9d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 -- 172.21.15.123:0/3664091632 shutdown_connections 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/3664091632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e01000e0 0x7fe9e0102520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/3664091632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0066c50 0x7fe9e00ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 -- 172.21.15.123:0/3664091632 >> 172.21.15.123:0/3664091632 conn(0x7fe9e00f7500 msgr2=0x7fe9e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 -- 172.21.15.123:0/3664091632 shutdown_connections 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.916+0000 7fe9e5c35700 1 -- 172.21.15.123:0/3664091632 wait complete. 2024-02-20T08:02:15.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 Processor -- start 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 -- start start 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e01000e0 0x7fe9e010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e010e4b0 con 0x7fe9e0066c50 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9e5c35700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e010ed50 con 0x7fe9e01000e0 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39870/0 (socket says 172.21.15.123:39870) 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 -- 172.21.15.123:0/1925178054 learned_addr learned my addr 172.21.15.123:0/1925178054 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9deffd700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e01000e0 0x7fe9e010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 -- 172.21.15.123:0/1925178054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e01000e0 msgr2=0x7fe9e010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e01000e0 0x7fe9e010deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.917+0000 7fe9df7fe700 1 -- 172.21.15.123:0/1925178054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0005040 con 0x7fe9e0066c50 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9df7fe700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4002a50 tx=0x7fe9d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d4007cc0 con 0x7fe9e0066c50 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9d400f040 con 0x7fe9e0066c50 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e010f030 con 0x7fe9e0066c50 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d400da70 con 0x7fe9e0066c50 2024-02-20T08:02:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.918+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e010f570 con 0x7fe9e0066c50 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.919+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e004bed0 con 0x7fe9e0066c50 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.919+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe9d400dcb0 con 0x7fe9e0066c50 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.920+0000 7fe9c7fff700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 0x7fe9c806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.920+0000 7fe9deffd700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 0x7fe9c806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.920+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe9d4086800 con 0x7fe9e0066c50 2024-02-20T08:02:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.920+0000 7fe9deffd700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 0x7fe9c806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000b3b0 tx=0x7fe9d0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:15.927+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe9d4056540 con 0x7fe9e0066c50 2024-02-20T08:02:16.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:16.179+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe9e010f9d0 con 0x7fe9e0066c50 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:16.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:16 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:02:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:16.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:16.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:16.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:16 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:17.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.071+0000 7fe9c7fff700 1 -- 172.21.15.123:0/1925178054 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe9d40560d0 con 0x7fe9e0066c50 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 msgr2=0x7fe9c806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 0x7fe9c806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000b3b0 tx=0x7fe9d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 msgr2=0x7fe9e010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4002a50 tx=0x7fe9d40046b0 comp rx=0 tx=0).stop 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 shutdown_connections 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe9c80692b0 0x7fe9c806b760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9e0066c50 0x7fe9e010d970 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 --2- 172.21.15.123:0/1925178054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e01000e0 0x7fe9e010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 >> 172.21.15.123:0/1925178054 conn(0x7fe9e00f7500 msgr2=0x7fe9e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 shutdown_connections 2024-02-20T08:02:17.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:17.073+0000 7fe9e5c35700 1 -- 172.21.15.123:0/1925178054 wait complete. 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: Deploying daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:boot 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:17.137 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:17 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1925178054' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-20T08:02:17.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: Deploying daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:02:17.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:boot 2024-02-20T08:02:17.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:02:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:17 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1925178054' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-20T08:02:17.920 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:02:17.930 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:17.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-20T08:02:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:18 smithi194 ceph-mon[37804]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 410 B/s wr, 3 op/s 2024-02-20T08:02:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:18 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1925178054' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-20T08:02:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:18 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:18.239 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:18 smithi123 ceph-mon[29383]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 410 B/s wr, 3 op/s 2024-02-20T08:02:18.239 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:18 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1925178054' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-20T08:02:18.239 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:18 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 1 up:standby 2024-02-20T08:02:18.560 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:19.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:19.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:19.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:02:19.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-20T08:02:19.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:20.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- 172.21.15.123:0/3704195769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 msgr2=0x7f10d40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:20.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 --2- 172.21.15.123:0/3704195769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d40fd320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009ce0 tx=0x7f10cc004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:20.273 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:20 smithi123 ceph-mon[29383]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-02-20T08:02:20.273 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:20 smithi123 ceph-mon[29383]: Deploying daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:02:20.273 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:20 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:boot 2024-02-20T08:02:20.273 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:20 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 2 up:standby 2024-02-20T08:02:20.274 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:20 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- 172.21.15.123:0/3704195769 shutdown_connections 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 --2- 172.21.15.123:0/3704195769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 0x7f10d40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 --2- 172.21.15.123:0/3704195769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d40fd320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- 172.21.15.123:0/3704195769 >> 172.21.15.123:0/3704195769 conn(0x7f10d40f8620 msgr2=0x7f10d40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- 172.21.15.123:0/3704195769 shutdown_connections 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- 172.21.15.123:0/3704195769 wait complete. 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 Processor -- start 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.271+0000 7f10da0da700 1 -- start start 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10da0da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10da0da700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 0x7f10d410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10da0da700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d410e620 con 0x7f10d40fcef0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10da0da700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d410eec0 con 0x7f10d40fe0e0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38516/0 (socket says 172.21.15.123:38516) 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 -- 172.21.15.123:0/2331467226 learned_addr learned my addr 172.21.15.123:0/2331467226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d2ffd700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 0x7f10d410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 -- 172.21.15.123:0/2331467226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 msgr2=0x7f10d410e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 0x7f10d410e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 -- 172.21.15.123:0/2331467226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009940 con 0x7f10d40fcef0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10d37fe700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000f80 tx=0x7f10cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10cc00e040 con 0x7f10d40fcef0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d410f140 con 0x7f10d40fcef0 2024-02-20T08:02:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10cc0128e0 con 0x7f10d40fcef0 2024-02-20T08:02:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.272+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10cc01c940 con 0x7f10d40fcef0 2024-02-20T08:02:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.273+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d410f680 con 0x7f10d40fcef0 2024-02-20T08:02:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.274+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d404bed0 con 0x7f10d40fcef0 2024-02-20T08:02:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.274+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f10cc012a50 con 0x7f10d40fcef0 2024-02-20T08:02:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.274+0000 7f10bbfff700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 0x7f10bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.274+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f10cc088f00 con 0x7f10d40fcef0 2024-02-20T08:02:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.275+0000 7f10d2ffd700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 0x7f10bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.275+0000 7f10d2ffd700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 0x7f10bc06b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10c80041d0 tx=0x7f10c80043c0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.279+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f10cc058c40 con 0x7f10d40fcef0 2024-02-20T08:02:20.321 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:20 smithi194 ceph-mon[37804]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-02-20T08:02:20.321 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:20 smithi194 ceph-mon[37804]: Deploying daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:02:20.321 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:20 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:boot 2024-02-20T08:02:20.321 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:20 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 2 up:standby 2024-02-20T08:02:20.321 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:20 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:02:20.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:20.505+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f10d410fa60 con 0x7f10d40fcef0 2024-02-20T08:02:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.020+0000 7f10bbfff700 1 -- 172.21.15.123:0/2331467226 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10cc004e10 con 0x7f10d40fcef0 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 msgr2=0x7f10bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 0x7f10bc06b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10c80041d0 tx=0x7f10c80043c0 comp rx=0 tx=0).stop 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 msgr2=0x7f10d410dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000f80 tx=0x7f10cc004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 shutdown_connections 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f10bc0692a0 0x7f10bc06b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10d40fcef0 0x7f10d410dae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 --2- 172.21.15.123:0/2331467226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10d40fe0e0 0x7f10d410e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 >> 172.21.15.123:0/2331467226 conn(0x7f10d40f8620 msgr2=0x7f10d41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 shutdown_connections 2024-02-20T08:02:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:21.022+0000 7f10da0da700 1 -- 172.21.15.123:0/2331467226 wait complete. 2024-02-20T08:02:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:21 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2331467226' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-20T08:02:21.408 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:21 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2331467226' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-20T08:02:21.690 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:02:21.700 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:21.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-02-20T08:02:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-20T08:02:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2331467226' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:boot 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:22 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2331467226' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:boot 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:22.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:22 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:22.608 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-20T08:02:24.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:standby 2024-02-20T08:02:24.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: Dropping low affinity active daemon mds.cephfs.smithi123.gglmsl in favor of higher affinity standby. 2024-02-20T08:02:24.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: Replacing daemon mds.cephfs.smithi123.gglmsl as rank 0 with standby daemon mds.cephfs.smithi123.uffypv 2024-02-20T08:02:24.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:02:24.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:02:24.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: osdmap e47: 6 total, 6 up, 6 in 2024-02-20T08:02:24.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:replay} 2 up:standby 2024-02-20T08:02:24.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:24.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:24.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:24 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:24.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:standby 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: Dropping low affinity active daemon mds.cephfs.smithi123.gglmsl in favor of higher affinity standby. 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: Replacing daemon mds.cephfs.smithi123.gglmsl as rank 0 with standby daemon mds.cephfs.smithi123.uffypv 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: osdmap e47: 6 total, 6 up, 6 in 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:replay} 2 up:standby 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:24 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:25.132 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:25 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:reconnect 2024-02-20T08:02:25.132 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:25 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] up:boot 2024-02-20T08:02:25.132 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:25 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:standby 2024-02-20T08:02:25.132 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:25 smithi123 ceph-mon[29383]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:reconnect} 3 up:standby 2024-02-20T08:02:25.132 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:25 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:02:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:25 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:reconnect 2024-02-20T08:02:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:25 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] up:boot 2024-02-20T08:02:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:25 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:standby 2024-02-20T08:02:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:25 smithi194 ceph-mon[37804]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:reconnect} 3 up:standby 2024-02-20T08:02:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:25 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:02:25.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- 172.21.15.123:0/79082675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 msgr2=0x7f9db00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:25.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 --2- 172.21.15.123:0/79082675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db00fc250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009ce0 tx=0x7f9da8004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:25.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- 172.21.15.123:0/79082675 shutdown_connections 2024-02-20T08:02:25.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 --2- 172.21.15.123:0/79082675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 --2- 172.21.15.123:0/79082675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db00fc250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- 172.21.15.123:0/79082675 >> 172.21.15.123:0/79082675 conn(0x7f9db00f74e0 msgr2=0x7f9db00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- 172.21.15.123:0/79082675 shutdown_connections 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- 172.21.15.123:0/79082675 wait complete. 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 Processor -- start 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.670+0000 7f9db4a42700 1 -- start start 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db0112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0066510 con 0x7f9db00fbe40 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0066650 con 0x7f9db00fcfb0 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:25.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38548/0 (socket says 172.21.15.123:38548) 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 -- 172.21.15.123:0/475409813 learned_addr learned my addr 172.21.15.123:0/475409813 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dadd9b700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db0112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 -- 172.21.15.123:0/475409813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 msgr2=0x7f9db0112d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db0112d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 -- 172.21.15.123:0/475409813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009940 con 0x7f9db00fbe40 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dadd9b700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db0112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9dae59c700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009900 tx=0x7f9da8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da800e040 con 0x7f9db00fbe40 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db0113360 con 0x7f9db00fbe40 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9da80128e0 con 0x7f9db00fbe40 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da801c940 con 0x7f9db00fbe40 2024-02-20T08:02:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.671+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db01138a0 con 0x7f9db00fbe40 2024-02-20T08:02:25.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.673+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db004bed0 con 0x7f9db00fbe40 2024-02-20T08:02:25.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.673+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9da8012410 con 0x7f9db00fbe40 2024-02-20T08:02:25.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.673+0000 7f9d9effd700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 0x7f9d9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:25.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.674+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9da8088ec0 con 0x7f9db00fbe40 2024-02-20T08:02:25.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.674+0000 7f9dadd9b700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 0x7f9d9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:25.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.674+0000 7f9dadd9b700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 0x7f9d9806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006fd0 tx=0x7f9da4008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:25.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.678+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9da80551a0 con 0x7f9db00fbe40 2024-02-20T08:02:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:25.914+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9db01049b0 con 0x7f9db00fbe40 2024-02-20T08:02:26.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.039+0000 7f9d9effd700 1 -- 172.21.15.123:0/475409813 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v15) v1 ==== 168+0+0 (secure 0 0 0) 0x7f9da80587c0 con 0x7f9db00fbe40 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 msgr2=0x7f9d9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 0x7f9d9806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006fd0 tx=0x7f9da4008040 comp rx=0 tx=0).stop 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 msgr2=0x7f9db01107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009900 tx=0x7f9da8004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 shutdown_connections 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9d980692a0 0x7f9d9806b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9db00fbe40 0x7f9db01107c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 --2- 172.21.15.123:0/475409813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9db00fcfb0 0x7f9db0112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 >> 172.21.15.123:0/475409813 conn(0x7f9db00f74e0 msgr2=0x7f9db0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 shutdown_connections 2024-02-20T08:02:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:26.043+0000 7f9db4a42700 1 -- 172.21.15.123:0/475409813 wait complete. 2024-02-20T08:02:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:inline data enabled 2024-02-20T08:02:26.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-02-20T08:02:26.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:rejoin 2024-02-20T08:02:26.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:standby 2024-02-20T08:02:26.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:rejoin} 3 up:standby 2024-02-20T08:02:26.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: daemon mds.cephfs.smithi123.uffypv is now active in filesystem cephfs as rank 0 2024-02-20T08:02:26.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:26 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/475409813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-20T08:02:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-02-20T08:02:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:rejoin 2024-02-20T08:02:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:standby 2024-02-20T08:02:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: fsmap cephfs:1/1 {0=cephfs.smithi123.uffypv=up:rejoin} 3 up:standby 2024-02-20T08:02:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: daemon mds.cephfs.smithi123.uffypv is now active in filesystem cephfs as rank 0 2024-02-20T08:02:26.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:26 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/475409813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-20T08:02:27.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-20T08:02:27.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:02:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:active 2024-02-20T08:02:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/475409813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-20T08:02:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:02:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:27 smithi123 ceph-mon[29383]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1023 B/s wr, 2 op/s 2024-02-20T08:02:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-20T08:02:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:02:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: mds.? [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] up:active 2024-02-20T08:02:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/475409813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-20T08:02:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:02:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:27 smithi194 ceph-mon[37804]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1023 B/s wr, 2 op/s 2024-02-20T08:02:27.476 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:02:27.486 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:27.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-20T08:02:27.853 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/741018997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fcf30 msgr2=0x7fdbb80fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/741018997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fcf30 0x7fdbb80fd340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004940 tx=0x7fdbb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/741018997 shutdown_connections 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/741018997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb80fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/741018997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fcf30 0x7fdbb80fd340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/741018997 >> 172.21.15.123:0/741018997 conn(0x7fdbb80f86b0 msgr2=0x7fdbb80faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/741018997 shutdown_connections 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/741018997 wait complete. 2024-02-20T08:02:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 Processor -- start 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.471+0000 7fdbbf9d4700 1 -- start start 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fcf30 0x7fdbb810d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb810e3d0 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb810ec70 con 0x7fdbb80fcf30 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49562/0 (socket says 172.21.15.123:49562) 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 -- 172.21.15.123:0/792119264 learned_addr learned my addr 172.21.15.123:0/792119264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbd770700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fcf30 0x7fdbb810d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 -- 172.21.15.123:0/792119264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fcf30 msgr2=0x7fdbb810d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fcf30 0x7fdbb810d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 -- 172.21.15.123:0/792119264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4005040 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbcf6f700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdba8002a80 tx=0x7fdba80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba8007cc0 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba800f040 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb810ef50 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba800dac0 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.472+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb810f490 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.473+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb804bed0 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.474+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdba800dc20 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.474+0000 7fdbadffb700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 0x7fdba406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.474+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdba8086e20 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.474+0000 7fdbbd770700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 0x7fdba406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.475+0000 7fdbbd770700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 0x7fdba406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004f90 tx=0x7fdbb4009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.483+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdba8056b10 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.725+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbb8105a20 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.726+0000 7fdbadffb700 1 -- 172.21.15.123:0/792119264 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1813 (secure 0 0 0) 0x7fdba80566a0 con 0x7fdbb80fe1e0 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:02:29.727 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:02:29.728 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:02:29.729 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:02:29.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 msgr2=0x7fdba406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:29.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 0x7fdba406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004f90 tx=0x7fdbb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:29.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 msgr2=0x7fdbb810ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:29.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdba8002a80 tx=0x7fdba80046b0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 shutdown_connections 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fdba40692a0 0x7fdba406b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb80fcf30 0x7fdbb810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 --2- 172.21.15.123:0/792119264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb80fe1e0 0x7fdbb810ddd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 >> 172.21.15.123:0/792119264 conn(0x7fdbb80f86b0 msgr2=0x7fdbb8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 shutdown_connections 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:29.729+0000 7fdbbf9d4700 1 -- 172.21.15.123:0/792119264 wait complete. 2024-02-20T08:02:29.731 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.124 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:30.125 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:30 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/792119264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:30.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:30.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:02:30.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:30 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/792119264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:02:30.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-20T08:02:31.748 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:32 smithi123 ceph-mon[29383]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-02-20T08:02:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:32 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:32 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:32 smithi194 ceph-mon[37804]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-02-20T08:02:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:32 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:32 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:34 smithi123 ceph-mon[29383]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-02-20T08:02:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:34 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:34 smithi194 ceph-mon[37804]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-02-20T08:02:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:34 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.644+0000 7f6c03469700 1 -- 172.21.15.123:0/2509555216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 msgr2=0x7f6bfc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.644+0000 7f6c03469700 1 --2- 172.21.15.123:0/2509555216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc0fd320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8004940 tx=0x7f6bf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- 172.21.15.123:0/2509555216 shutdown_connections 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 --2- 172.21.15.123:0/2509555216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 --2- 172.21.15.123:0/2509555216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc0fd320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- 172.21.15.123:0/2509555216 >> 172.21.15.123:0/2509555216 conn(0x7f6bfc0f8620 msgr2=0x7f6bfc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- 172.21.15.123:0/2509555216 shutdown_connections 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- 172.21.15.123:0/2509555216 wait complete. 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 Processor -- start 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- start start 2024-02-20T08:02:34.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0708e0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c03469700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc070a50 con 0x7f6bfc0fe0e0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c01205700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c01205700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49588/0 (socket says 172.21.15.123:49588) 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.645+0000 7f6c01205700 1 -- 172.21.15.123:0/87393056 learned_addr learned my addr 172.21.15.123:0/87393056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c00a04700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c01205700 1 -- 172.21.15.123:0/87393056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 msgr2=0x7f6bfc0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c01205700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c01205700 1 -- 172.21.15.123:0/87393056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8005040 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c00a04700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c01205700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b3b0 tx=0x7f6bf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf800e040 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bf800bcc0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc070cd0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf801c630 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.646+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc1159a0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.648+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc04bed0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.648+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6bf80139f0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.649+0000 7f6bf1ffb700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 0x7f6be806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.649+0000 7f6c00a04700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 0x7f6be806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.649+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6bf8088650 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.649+0000 7f6c00a04700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 0x7f6be806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009fd0 tx=0x7f6bec00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:34.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.657+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6bf80583c0 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.890+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bfc105a30 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.891+0000 7f6bf1ffb700 1 -- 172.21.15.123:0/87393056 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f6bf8057f50 con 0x7f6bfc0fcef0 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 msgr2=0x7f6be806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 0x7f6be806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009fd0 tx=0x7f6bec00b040 comp rx=0 tx=0).stop 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 msgr2=0x7f6bfc071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b3b0 tx=0x7f6bf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 shutdown_connections 2024-02-20T08:02:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f6be80692a0 0x7f6be806b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bfc0fcef0 0x7f6bfc071e60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 --2- 172.21.15.123:0/87393056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bfc0fe0e0 0x7f6bfc0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.893+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 >> 172.21.15.123:0/87393056 conn(0x7f6bfc0f8620 msgr2=0x7f6bfc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.894+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 shutdown_connections 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:34.894+0000 7f6c03469700 1 -- 172.21.15.123:0/87393056 wait complete. 2024-02-20T08:02:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:02:34.905 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:02:35.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-20T08:02:36.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:35 smithi194 ceph-mon[37804]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-20T08:02:36.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:35 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/87393056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:02:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:35 smithi123 ceph-mon[29383]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-20T08:02:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:35 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/87393056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:37 smithi123 ceph-mon[29383]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-20T08:02:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:02:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:02:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:02:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:37 smithi194 ceph-mon[37804]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-20T08:02:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 -- 172.21.15.123:0/2282988778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fcfb0 msgr2=0x7feea80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/2282988778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fcfb0 0x7feea80fd420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee94004940 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 -- 172.21.15.123:0/2282988778 shutdown_connections 2024-02-20T08:02:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/2282988778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fcfb0 0x7feea80fd420 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/2282988778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fbe40 0x7feea80fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 -- 172.21.15.123:0/2282988778 >> 172.21.15.123:0/2282988778 conn(0x7feea80f74e0 msgr2=0x7feea80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 -- 172.21.15.123:0/2282988778 shutdown_connections 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.729+0000 7feeaf1b7700 1 -- 172.21.15.123:0/2282988778 wait complete. 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 Processor -- start 2024-02-20T08:02:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 -- start start 2024-02-20T08:02:37.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:37.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 0x7feea810cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:37.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea810d3b0 con 0x7feea80fbe40 2024-02-20T08:02:37.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeaf1b7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea810dc50 con 0x7feea80fcfb0 2024-02-20T08:02:37.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeacf53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeacf53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49608/0 (socket says 172.21.15.123:49608) 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feeacf53700 1 -- 172.21.15.123:0/1791549736 learned_addr learned my addr 172.21.15.123:0/1791549736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.730+0000 7feea7fff700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 0x7feea810cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeacf53700 1 -- 172.21.15.123:0/1791549736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 msgr2=0x7feea810cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeacf53700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 0x7feea810cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeacf53700 1 -- 172.21.15.123:0/1791549736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94005040 con 0x7feea80fbe40 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feea7fff700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 0x7feea810cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeacf53700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee9c002a50 tx=0x7fee9c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee9c007cc0 con 0x7feea80fbe40 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee9c00f040 con 0x7feea80fbe40 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea810df30 con 0x7feea80fbe40 2024-02-20T08:02:37.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee9c009640 con 0x7feea80fbe40 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.731+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea810e470 con 0x7feea80fbe40 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.732+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea804bed0 con 0x7feea80fbe40 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.732+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fee9c0097c0 con 0x7feea80fbe40 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.733+0000 7feea57fa700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 0x7fee9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.733+0000 7feea7fff700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 0x7fee9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.733+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fee9c086ef0 con 0x7feea80fbe40 2024-02-20T08:02:37.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.733+0000 7feea7fff700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 0x7fee9806b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee94004560 tx=0x7fee94009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:37.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.737+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fee9c056c60 con 0x7feea80fbe40 2024-02-20T08:02:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.996+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7feea8104930 con 0x7feea80fbe40 2024-02-20T08:02:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.996+0000 7feea57fa700 1 -- 172.21.15.123:0/1791549736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7fee9c0567f0 con 0x7feea80fbe40 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 msgr2=0x7fee9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 0x7fee9806b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee94004560 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 msgr2=0x7feea810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee9c002a50 tx=0x7fee9c0046b0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 shutdown_connections 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fee980692a0 0x7fee9806b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feea80fbe40 0x7feea810c870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 --2- 172.21.15.123:0/1791549736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea80fcfb0 0x7feea810cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 >> 172.21.15.123:0/1791549736 conn(0x7feea80f74e0 msgr2=0x7feea8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 shutdown_connections 2024-02-20T08:02:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:37.998+0000 7feeaf1b7700 1 -- 172.21.15.123:0/1791549736 wait complete. 2024-02-20T08:02:38.009 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:02:38.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:38 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1791549736' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-20T08:02:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:38 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1791549736' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-20T08:02:38.649 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-20T08:02:38.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-20T08:02:38.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 -- 172.21.15.123:0/238651077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fc270 msgr2=0x7f287c0fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:38.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 --2- 172.21.15.123:0/238651077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fc270 0x7f287c0fc680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f286c0048d0 tx=0x7f286c009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 -- 172.21.15.123:0/238651077 shutdown_connections 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 --2- 172.21.15.123:0/238651077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fd540 0x7f287c0fd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 --2- 172.21.15.123:0/238651077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fc270 0x7f287c0fc680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 -- 172.21.15.123:0/238651077 >> 172.21.15.123:0/238651077 conn(0x7f287c0f7a30 msgr2=0x7f287c0f9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 -- 172.21.15.123:0/238651077 shutdown_connections 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.784+0000 7f28842ae640 1 -- 172.21.15.123:0/238651077 wait complete. 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 Processor -- start 2024-02-20T08:02:38.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 -- start start 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fc270 0x7f287c10cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c10d6e0 con 0x7f287c0fd540 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c112130 con 0x7f287c0fc270 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41844/0 (socket says 172.21.15.123:41844) 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 -- 172.21.15.123:0/275583978 learned_addr learned my addr 172.21.15.123:0/275583978 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f288204a640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fc270 0x7f287c10cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 -- 172.21.15.123:0/275583978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fc270 msgr2=0x7f287c10cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fc270 0x7f287c10cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 -- 172.21.15.123:0/275583978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c005040 con 0x7f287c0fd540 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2881849640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2878002a50 tx=0x7f2878004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2878007c30 con 0x7f287c0fd540 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c1122d0 con 0x7f287c0fd540 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f287800f040 con 0x7f287c0fd540 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f287800db50 con 0x7f287c0fd540 2024-02-20T08:02:38.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.785+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1127c0 con 0x7f287c0fd540 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.786+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c104de0 con 0x7f287c0fd540 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.787+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f287801c400 con 0x7f287c0fd540 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.787+0000 7f2872ffd640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 0x7f286806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.787+0000 7f288204a640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 0x7f286806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.787+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2878086ad0 con 0x7f287c0fd540 2024-02-20T08:02:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.788+0000 7f288204a640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 0x7f286806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f286c000c00 tx=0x7f286c009da0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:38.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.791+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f287804cbd0 con 0x7f287c0fd540 2024-02-20T08:02:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.957+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c112b20 con 0x7f287c0fd540 2024-02-20T08:02:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.957+0000 7f2872ffd640 1 -- 172.21.15.123:0/275583978 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14424 (secure 0 0 0) 0x7f2878052d30 con 0x7f287c0fd540 2024-02-20T08:02:38.958 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:38.958 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":47,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:02:23.026539+0000","last_up_change":"2024-02-20T08:00:53.168926+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-20T08:02:07.859118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-20T08:02:08.249143+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6803","nonce":2184643212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6805","nonce":2184643212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6809","nonce":2184643212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2184643212},{"type":"v1","addr":"172.21.15.123:6807","nonce":2184643212}]},"public_addr":"172.21.15.123:6803/2184643212","cluster_addr":"172.21.15.123:6805/2184643212","heartbeat_back_addr":"172.21.15.123:6809/2184643212","heartbeat_front_addr":"172.21.15.123:6807/2184643212","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6811","nonce":1885285772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6813","nonce":1885285772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6817","nonce":1885285772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1885285772},{"type":"v1","addr":"172.21.15.123:6815","nonce":1885285772}]},"public_addr":"172.21.15.123:6811/1885285772","cluster_addr":"172.21.15.123:6813/1885285772","heartbeat_back_addr":"172.21.15.123:6817/1885285772","heartbeat_front_addr":"172.21.15.123:6815/1885285772","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6819","nonce":3176150982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6821","nonce":3176150982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6825","nonce":3176150982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3176150982},{"type":"v1","addr":"172.21.15.123:6823","nonce":3176150982}]},"public_addr":"172.21.15.123:6819/3176150982","cluster_addr":"172.21.15.123:6821/3176150982","heartbeat_back_addr":"172.21.15.123:6825/3176150982","heartbeat_front_addr":"172.21.15.123:6823/3176150982","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6801","nonce":2660990269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6803","nonce":2660990269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6807","nonce":2660990269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2660990269},{"type":"v1","addr":"172.21.15.194:6805","nonce":2660990269}]},"public_addr":"172.21.15.194:6801/2660990269","cluster_addr":"172.21.15.194:6803/2660990269","heartbeat_back_addr":"172.21.15.194:6807/2660990269","heartbeat_front_addr":"172.21.15.194:6805/2660990269","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6809","nonce":15880204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6811","nonce":15880204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6815","nonce":15880204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":15880204},{"type":"v1","addr":"172.21.15.194:6813","nonce":15880204}]},"public_addr":"172.21.15.194:6809/15880204","cluster_addr":"172.21.15.194:6811/15880204","heartbeat_back_addr":"172.21.15.194:6815/15880204","heartbeat_front_addr":"172.21.15.194:6813/15880204","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6817","nonce":692328778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6819","nonce":692328778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6823","nonce":692328778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":692328778},{"type":"v1","addr":"172.21.15.194:6821","nonce":692328778}]},"public_addr":"172.21.15.194:6817/692328778","cluster_addr":"172.21.15.194:6819/692328778","heartbeat_back_addr":"172.21.15.194:6823/692328778","heartbeat_front_addr":"172.21.15.194:6821/692328778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6827/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6826/1747553083":"2024-02-21T08:02:23.026518+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:02:38.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 msgr2=0x7f286806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:38.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 0x7f286806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f286c000c00 tx=0x7f286c009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 msgr2=0x7f287c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:38.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2878002a50 tx=0x7f2878004600 comp rx=0 tx=0).stop 2024-02-20T08:02:38.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 shutdown_connections 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f2868069210 0x7f286806b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0fd540 0x7f287c10d090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 --2- 172.21.15.123:0/275583978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f287c0fc270 0x7f287c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 >> 172.21.15.123:0/275583978 conn(0x7f287c0f7a30 msgr2=0x7f287c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 shutdown_connections 2024-02-20T08:02:38.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:38.959+0000 7f28842ae640 1 -- 172.21.15.123:0/275583978 wait complete. 2024-02-20T08:02:38.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-20T07:59:36.763546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-20T08:02:07.859118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-20T08:02:08.249143+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-20T08:02:38.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- 172.21.15.123:0/2991221692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fd5e0 msgr2=0x7fb9680fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 --2- 172.21.15.123:0/2991221692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fd5e0 0x7fb9680fda50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb9640048d0 tx=0x7fb964009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- 172.21.15.123:0/2991221692 shutdown_connections 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 --2- 172.21.15.123:0/2991221692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fd5e0 0x7fb9680fda50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 --2- 172.21.15.123:0/2991221692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9680fa5d0 0x7fb9680fa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- 172.21.15.123:0/2991221692 >> 172.21.15.123:0/2991221692 conn(0x7fb9680f5ff0 msgr2=0x7fb9680f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- 172.21.15.123:0/2991221692 shutdown_connections 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- 172.21.15.123:0/2991221692 wait complete. 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 Processor -- start 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.072+0000 7fb96feae640 1 -- start start 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9680fd5e0 0x7fb96810d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96810d7c0 con 0x7fb9680fa5d0 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681121d0 con 0x7fb9680fd5e0 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41860/0 (socket says 172.21.15.123:41860) 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 -- 172.21.15.123:0/61791480 learned_addr learned my addr 172.21.15.123:0/61791480 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 -- 172.21.15.123:0/61791480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9680fd5e0 msgr2=0x7fb96810d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9680fd5e0 0x7fb96810d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 -- 172.21.15.123:0/61791480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964005040 con 0x7fb9680fa5d0 2024-02-20T08:02:39.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96dc4a640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb95800eb70 tx=0x7fb95800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb958007c30 con 0x7fb9680fa5d0 2024-02-20T08:02:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb95800f040 con 0x7fb9680fa5d0 2024-02-20T08:02:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb968112370 con 0x7fb9680fa5d0 2024-02-20T08:02:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb95800cc30 con 0x7fb9680fa5d0 2024-02-20T08:02:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.073+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb968112840 con 0x7fb9680fa5d0 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.074+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb968104e70 con 0x7fb9680fa5d0 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.075+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb958009110 con 0x7fb9680fa5d0 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.075+0000 7fb95e7fc640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 0x7fb95406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.075+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb958087550 con 0x7fb9680fa5d0 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.075+0000 7fb96d449640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 0x7fb95406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.075+0000 7fb96d449640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 0x7fb95406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb964034040 tx=0x7fb964009da0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.079+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb9580537b0 con 0x7fb9680fa5d0 2024-02-20T08:02:39.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.244+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb968112ac0 con 0x7fb9680fa5d0 2024-02-20T08:02:39.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.244+0000 7fb95e7fc640 1 -- 172.21.15.123:0/61791480 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb958056dd0 con 0x7fb9680fa5d0 2024-02-20T08:02:39.245 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-02-20T08:02:39.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 msgr2=0x7fb95406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 0x7fb95406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb964034040 tx=0x7fb964009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 msgr2=0x7fb96810cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb95800eb70 tx=0x7fb95800b040 comp rx=0 tx=0).stop 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 shutdown_connections 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9680fd5e0 0x7fb96810d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb954069210 0x7fb95406b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 --2- 172.21.15.123:0/61791480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9680fa5d0 0x7fb96810cc30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 >> 172.21.15.123:0/61791480 conn(0x7fb9680f5ff0 msgr2=0x7fb968100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 shutdown_connections 2024-02-20T08:02:39.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.246+0000 7fb96feae640 1 -- 172.21.15.123:0/61791480 wait complete. 2024-02-20T08:02:39.256 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:39 smithi123 ceph-mon[29383]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-20T08:02:39.256 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:39 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/275583978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:02:39.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-20T08:02:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 -- 172.21.15.123:0/3831086911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fc450 msgr2=0x7effc40fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 --2- 172.21.15.123:0/3831086911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fc450 0x7effc40fc8c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7effb80048d0 tx=0x7effb8009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 -- 172.21.15.123:0/3831086911 shutdown_connections 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 --2- 172.21.15.123:0/3831086911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fc450 0x7effc40fc8c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 --2- 172.21.15.123:0/3831086911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fb180 0x7effc40fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 -- 172.21.15.123:0/3831086911 >> 172.21.15.123:0/3831086911 conn(0x7effc40f6960 msgr2=0x7effc40f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 -- 172.21.15.123:0/3831086911 shutdown_connections 2024-02-20T08:02:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.356+0000 7effc966e640 1 -- 172.21.15.123:0/3831086911 wait complete. 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 Processor -- start 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 -- start start 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 0x7effc4111960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4111ea0 con 0x7effc40fb180 2024-02-20T08:02:39.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc966e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4111fe0 con 0x7effc40fc450 2024-02-20T08:02:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41878/0 (socket says 172.21.15.123:41878) 2024-02-20T08:02:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 -- 172.21.15.123:0/2426700227 learned_addr learned my addr 172.21.15.123:0/2426700227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc27fc640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 0x7effc4111960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 -- 172.21.15.123:0/2426700227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 msgr2=0x7effc4111960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 0x7effc4111960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 -- 172.21.15.123:0/2426700227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8005040 con 0x7effc40fb180 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc27fc640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 0x7effc4111960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.357+0000 7effc2ffd640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7effb400c810 tx=0x7effb40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.358+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb400a820 con 0x7effc40fb180 2024-02-20T08:02:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.358+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4112270 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.358+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effb400ae50 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.358+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb40115c0 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.358+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc4112790 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.359+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc4103cd0 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.359+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7effb400a980 con 0x7effc40fb180 2024-02-20T08:02:39.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.359+0000 7effab7fe640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 0x7effac06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.359+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7effb40877a0 con 0x7effc40fb180 2024-02-20T08:02:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.359+0000 7effc27fc640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 0x7effac06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.360+0000 7effc27fc640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 0x7effac06b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7effb802bda0 tx=0x7effb8009da0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.364+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7effb4053a00 con 0x7effc40fb180 2024-02-20T08:02:39.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.527+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7effc4112f30 con 0x7effc40fb180 2024-02-20T08:02:39.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.527+0000 7effab7fe640 1 -- 172.21.15.123:0/2426700227 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7effb4016020 con 0x7effc40fb180 2024-02-20T08:02:39.528 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 msgr2=0x7effac06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 0x7effac06b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7effb802bda0 tx=0x7effb8009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 msgr2=0x7effc40661a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7effb400c810 tx=0x7effb40043c0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 shutdown_connections 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc40fc450 0x7effc4111960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7effac069210 0x7effac06b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 --2- 172.21.15.123:0/2426700227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effc40fb180 0x7effc40661a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 >> 172.21.15.123:0/2426700227 conn(0x7effc40f6960 msgr2=0x7effc40ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 shutdown_connections 2024-02-20T08:02:39.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.529+0000 7effc966e640 1 -- 172.21.15.123:0/2426700227 wait complete. 2024-02-20T08:02:39.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-20T08:02:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 -- 172.21.15.123:0/2806727196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180ff750 msgr2=0x7f4718101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 --2- 172.21.15.123:0/2806727196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180ff750 0x7f4718101b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47000048d0 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 -- 172.21.15.123:0/2806727196 shutdown_connections 2024-02-20T08:02:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 --2- 172.21.15.123:0/2806727196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180ff750 0x7f4718101b30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 --2- 172.21.15.123:0/2806727196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180fce30 0x7f47180ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 -- 172.21.15.123:0/2806727196 >> 172.21.15.123:0/2806727196 conn(0x7f47180f68d0 msgr2=0x7f47180f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 -- 172.21.15.123:0/2806727196 shutdown_connections 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.639+0000 7f471d35d640 1 -- 172.21.15.123:0/2806727196 wait complete. 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 Processor -- start 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 -- start start 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180ff750 0x7f471810d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471810d770 con 0x7f47180fce30 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f471d35d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4718112180 con 0x7f47180ff750 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41898/0 (socket says 172.21.15.123:41898) 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 -- 172.21.15.123:0/2406010864 learned_addr learned my addr 172.21.15.123:0/2406010864 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f47167fc640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180ff750 0x7f471810d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 -- 172.21.15.123:0/2406010864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180ff750 msgr2=0x7f471810d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180ff750 0x7f471810d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.640+0000 7f4716ffd640 1 -- 172.21.15.123:0/2406010864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700005040 con 0x7f47180fce30 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f4716ffd640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f470800db00 tx=0x7f4708004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4708017070 con 0x7f47180fce30 2024-02-20T08:02:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f470800f040 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4718112320 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4708003ae0 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.641+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47181127f0 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.642+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4718106de0 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.642+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4708003c40 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.643+0000 7f470f7fe640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 0x7f470406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.643+0000 7f47167fc640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 0x7f470406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.643+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f47080872c0 con 0x7f47180fce30 2024-02-20T08:02:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.643+0000 7f47167fc640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 0x7f470406b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4700000c00 tx=0x7f4700009da0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:39 smithi194 ceph-mon[37804]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-20T08:02:39.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:39 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/275583978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:02:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.647+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f47080535e0 con 0x7f47180fce30 2024-02-20T08:02:39.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.810+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4718104e30 con 0x7f47180fce30 2024-02-20T08:02:39.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.810+0000 7f470f7fe640 1 -- 172.21.15.123:0/2406010864 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4708056c00 con 0x7f47180fce30 2024-02-20T08:02:39.811 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 msgr2=0x7f470406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 0x7f470406b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4700000c00 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 msgr2=0x7f471810cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f470800db00 tx=0x7f4708004e60 comp rx=0 tx=0).stop 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 shutdown_connections 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47180ff750 0x7f471810d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4704069210 0x7f470406b6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 --2- 172.21.15.123:0/2406010864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180fce30 0x7f471810cbe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 >> 172.21.15.123:0/2406010864 conn(0x7f47180f68d0 msgr2=0x7f47180f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 shutdown_connections 2024-02-20T08:02:39.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.812+0000 7f471d35d640 1 -- 172.21.15.123:0/2406010864 wait complete. 2024-02-20T08:02:39.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 -- 172.21.15.123:0/2398440721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fb180 msgr2=0x7fe8a80fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/2398440721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fb180 0x7fe8a80fb590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009c50 tx=0x7fe8a4004d10 comp rx=0 tx=0).stop 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 -- 172.21.15.123:0/2398440721 shutdown_connections 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/2398440721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a80fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/2398440721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fb180 0x7fe8a80fb590 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 -- 172.21.15.123:0/2398440721 >> 172.21.15.123:0/2398440721 conn(0x7fe8a80f6860 msgr2=0x7fe8a80f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 -- 172.21.15.123:0/2398440721 shutdown_connections 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.924+0000 7fe8afb9d640 1 -- 172.21.15.123:0/2398440721 wait complete. 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 Processor -- start 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 -- start start 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fb180 0x7fe8a810cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a810d830 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8afb9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81121b0 con 0x7fe8a80fb180 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41912/0 (socket says 172.21.15.123:41912) 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 -- 172.21.15.123:0/3103616937 learned_addr learned my addr 172.21.15.123:0/3103616937 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad939640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fb180 0x7fe8a810cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 -- 172.21.15.123:0/3103616937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fb180 msgr2=0x7fe8a810cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fb180 0x7fe8a810cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.925+0000 7fe8ad138640 1 -- 172.21.15.123:0/3103616937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40098b0 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe8ad138640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe89800b790 tx=0x7fe8980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89800c700 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a81123b0 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe89800cd30 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe898013370 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.926+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a81128d0 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.927+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a8103d50 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.927+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe898012070 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.927+0000 7fe89e7fc640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 0x7fe89406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.927+0000 7fe8ad939640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 0x7fe89406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.927+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe898086e70 con 0x7fe8a80fc3b0 2024-02-20T08:02:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.928+0000 7fe8ad939640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 0x7fe89406b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8a810e120 tx=0x7fe8a402e040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:39.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:39.932+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe8980530d0 con 0x7fe8a80fc3b0 2024-02-20T08:02:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.131+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8a8112d50 con 0x7fe8a80fc3b0 2024-02-20T08:02:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.132+0000 7fe89e7fc640 1 -- 172.21.15.123:0/3103616937 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7fe8980566f0 con 0x7fe8a80fc3b0 2024-02-20T08:02:40.132 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:02:40.132 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3033221132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3033221132},{"type":"v1","addr":"172.21.15.123:6827","nonce":3033221132}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:02:26.035784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi123.uffypv","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6829/3850080893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3850080893},{"type":"v1","addr":"172.21.15.123:6829","nonce":3850080893}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-20T08:02:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 msgr2=0x7fe89406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 0x7fe89406b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8a810e120 tx=0x7fe8a402e040 comp rx=0 tx=0).stop 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 msgr2=0x7fe8a810d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe89800b790 tx=0x7fe8980091d0 comp rx=0 tx=0).stop 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 shutdown_connections 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fe894069210 0x7fe89406b6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a80fc3b0 0x7fe8a810d150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 --2- 172.21.15.123:0/3103616937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a80fb180 0x7fe8a810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 >> 172.21.15.123:0/3103616937 conn(0x7fe8a80f6860 msgr2=0x7fe8a8064480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 shutdown_connections 2024-02-20T08:02:40.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:40.134+0000 7fe8afb9d640 1 -- 172.21.15.123:0/3103616937 wait complete. 2024-02-20T08:02:40.145 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-02-20T08:02:40.145 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-20T08:02:40.170 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-20T08:02:40.171 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-20T08:02:40.171 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-20T08:02:40.171 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-20T08:02:40.171 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:40.171 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-20T08:02:40.171 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-20T08:02:40.171 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:40.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:40.171 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-02-20T08:02:40.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:40.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-02-20T08:02:40.256 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-02-20T08:02:40.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T08:02:40.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:40.258 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-02-20T08:02:40.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:40.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-02-20T08:02:40.355 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-02-20T08:02:40.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T08:02:40.357 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-20T08:02:40.357 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-20T08:02:40.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/61791480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2426700227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2406010864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:40 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3103616937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:02:40.612 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:40 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/61791480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:40 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2426700227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:40 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2406010864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:02:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:40 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3103616937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:02:41.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:41 smithi123 ceph-mon[29383]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-20T08:02:41.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:41 smithi194 ceph-mon[37804]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-20T08:02:42.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2167716510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 msgr2=0x7f9cd0106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:42.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2167716510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd0106f40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4004940 tx=0x7f9cc4009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:42.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2167716510 shutdown_connections 2024-02-20T08:02:42.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2167716510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd0106f40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2167716510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2167716510 >> 172.21.15.123:0/2167716510 conn(0x7f9cd00f7a10 msgr2=0x7f9cd00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2167716510 shutdown_connections 2024-02-20T08:02:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.192+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2167716510 wait complete. 2024-02-20T08:02:42.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 Processor -- start 2024-02-20T08:02:42.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 -- start start 2024-02-20T08:02:42.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:42.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00fc960 con 0x7f9cd00fe900 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cd59d2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00fcad0 con 0x7f9cd00fdf60 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.193+0000 7f9cce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41926/0 (socket says 172.21.15.123:41926) 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 -- 172.21.15.123:0/2572205497 learned_addr learned my addr 172.21.15.123:0/2572205497 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cceffd700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 -- 172.21.15.123:0/2572205497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 msgr2=0x7f9cd00fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 -- 172.21.15.123:0/2572205497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4005040 con 0x7f9cd00fe900 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cceffd700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cce7fc700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4004890 tx=0x7f9cc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc400e040 con 0x7f9cd00fe900 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd0119d50 con 0x7f9cd00fe900 2024-02-20T08:02:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd011a240 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cc4004290 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.194+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc401c630 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.195+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0104550 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.196+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9cc400bbf0 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.196+0000 7f9cb77fe700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 0x7f9cb806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.196+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9cc4088660 con 0x7f9cd00fe900 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.196+0000 7f9cceffd700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 0x7f9cb806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:42.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.196+0000 7f9cceffd700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 0x7f9cb806b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009b10 tx=0x7f9cc0008040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:42.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.200+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9cc4054940 con 0x7f9cd00fe900 2024-02-20T08:02:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.423+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9cd00fb610 con 0x7f9cd00fe900 2024-02-20T08:02:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.423+0000 7f9cb77fe700 1 -- 172.21.15.123:0/2572205497 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f9cc4057f60 con 0x7f9cd00fe900 2024-02-20T08:02:42.424 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 msgr2=0x7f9cb806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 0x7f9cb806b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009b10 tx=0x7f9cc0008040 comp rx=0 tx=0).stop 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 msgr2=0x7f9cd00fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4004890 tx=0x7f9cc4009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 shutdown_connections 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f9cb80692a0 0x7f9cb806b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd00fdf60 0x7f9cd00fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 --2- 172.21.15.123:0/2572205497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd00fe900 0x7f9cd00fc2d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:42.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 >> 172.21.15.123:0/2572205497 conn(0x7f9cd00f7a10 msgr2=0x7f9cd01016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:42.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 shutdown_connections 2024-02-20T08:02:42.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:42.425+0000 7f9cd59d2700 1 -- 172.21.15.123:0/2572205497 wait complete. 2024-02-20T08:02:42.745 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:42 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2572205497' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-20T08:02:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:42 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2572205497' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-20T08:02:43.064 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-20T08:02:43.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.065 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-02-20T08:02:43.080 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-20T08:02:43.080 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-20T08:02:43.080 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-02-20T08:02:43.080 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42212sec preferred_lft 42212sec 2024-02-20T08:02:43.081 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-02-20T08:02:43.082 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:43.082 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-20T08:02:43.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.082 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-02-20T08:02:43.082 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-02-20T08:02:43.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-02-20T08:02:43.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-02-20T08:02:43.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-02-20T08:02:43.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-20T08:02:43.083 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-02-20T08:02:43.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.242 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-20T08:02:43.268 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-02-20T08:02:43.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.270 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-02-20T08:02:43.339 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-02-20T08:02:43.339 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-20T08:02:43.339 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-20T08:02:43.339 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-20T08:02:43.339 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-20T08:02:43.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-20T08:02:43.340 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-02-20T08:02:43.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.631 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-02-20T08:02:43.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.647 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-02-20T08:02:43.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.702 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-02-20T08:02:43.702 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-02-20T08:02:43.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-20T08:02:43.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-20T08:02:43.702 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-02-20T08:02:43.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:43 smithi123 ceph-mon[29383]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-20T08:02:43.784 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-20T08:02:43.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-20T08:02:43.785 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-02-20T08:02:43.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:43 smithi194 ceph-mon[37804]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-20T08:02:43.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:43.930 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-02-20T08:02:43.930 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-02-20T08:02:43.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-02-20T08:02:43.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-02-20T08:02:43.930 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-02-20T08:02:43.972 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-20T08:02:43.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-20T08:02:43.972 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:44.025 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-20T08:02:44.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-20T08:02:44.025 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:44.080 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-02-20T08:02:44.148 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-02-20T08:02:44.203 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:44.204 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/c14f62b16cd68de36f51ac3a5f756376c268fe0b24061477d5cc383d8120e563/merged 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/4020f628d913d018a18d937488c8e2d29f5dd2eb170a825a4c011cb7892d4db4/merged 2024-02-20T08:02:44.205 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/0 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/a8bf8bd0a253ba73448df5d17459e7dc9ec410321d6a3ee99d563f4bd18726f1/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/590cecab379437696cc72e319a18c67e98473a4224346335cc29b7023d2c82d6/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/4ba7044b087ad461c7751e7a726ca1af778ad14381d476562d90cdbee424aeed/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6e287e67d693eba70f1fdb3e415e8c44a02996ad658b50c2355e607ced14c5a3/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/1782e205097c5e9d81cfb97dd3b1bd4b962b3153a5189bccdc215cfe82e403e4/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/660dacca139ac881b14be4fedfad4b8f5c6cf5a98125f6759487909b4b94c94d/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/48eb85d5cf0ee1901b7f16f5a1ca246a71eaccb75b3fe49c2f98523623327411/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/eeb48ea6c70e9f114bd1a58a9e7b10db26ea23fbdbed4466a380b94e83faabee/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/3e185f158eac6694e4395523a4930b4a3f244af4a109450a4441040528469505/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6e140ea91cc4c3ca0080ac1842645e6351543079c33ff02ed35bf2a3b6dc5cb6/merged 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-20T08:02:44.206 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-20T08:02:44.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:44.207 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-02-20T08:02:44.259 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-20T08:02:44.259 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-20T08:02:44.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-02-20T08:02:44.327 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-02-20T08:02:44.383 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-02-20T08:02:44.384 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/c14f62b16cd68de36f51ac3a5f756376c268fe0b24061477d5cc383d8120e563/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/4020f628d913d018a18d937488c8e2d29f5dd2eb170a825a4c011cb7892d4db4/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/0 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/a8bf8bd0a253ba73448df5d17459e7dc9ec410321d6a3ee99d563f4bd18726f1/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/590cecab379437696cc72e319a18c67e98473a4224346335cc29b7023d2c82d6/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/4ba7044b087ad461c7751e7a726ca1af778ad14381d476562d90cdbee424aeed/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6e287e67d693eba70f1fdb3e415e8c44a02996ad658b50c2355e607ced14c5a3/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/1782e205097c5e9d81cfb97dd3b1bd4b962b3153a5189bccdc215cfe82e403e4/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/660dacca139ac881b14be4fedfad4b8f5c6cf5a98125f6759487909b4b94c94d/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/48eb85d5cf0ee1901b7f16f5a1ca246a71eaccb75b3fe49c2f98523623327411/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/eeb48ea6c70e9f114bd1a58a9e7b10db26ea23fbdbed4466a380b94e83faabee/merged 2024-02-20T08:02:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/3e185f158eac6694e4395523a4930b4a3f244af4a109450a4441040528469505/merged 2024-02-20T08:02:44.386 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6e140ea91cc4c3ca0080ac1842645e6351543079c33ff02ed35bf2a3b6dc5cb6/merged 2024-02-20T08:02:44.386 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-02-20T08:02:44.386 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-20T08:02:44.386 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-20T08:02:44.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:44.386 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-02-20T08:02:44.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-02-20T08:02:44.395+0000 7f6781e6a300 -1 init, newargv = 0x5604e36e7040 newargc=15 2024-02-20T08:02:44.396 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[76854]: starting ceph client 2024-02-20T08:02:44.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[76854]: starting fuse 2024-02-20T08:02:44.410 INFO:teuthology.orchestra.run.smithi123.stdout:148 2024-02-20T08:02:44.411 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [148] 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> sudo stdin-killer -- python3 -c ' 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-20T08:02:44.411 DEBUG:teuthology.orchestra.run.smithi123:> 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-02-20T08:02:44.412 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-02-20T08:02:44.536 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.76854.asok 2024-02-20T08:02:44.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-20T08:02:44.547 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76854.asok 2024-02-20T08:02:44.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:44.547 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76854.asok status 2024-02-20T08:02:44.679 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "c80e7168938c48b49e5ce2e002f48bf150b5f4a4", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "76854", 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 14538, 2024-02-20T08:02:44.680 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 14538 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3934461339 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3934461339 2024-02-20T08:02:44.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.14538 192.168.0.1:0/3934461339", 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/3934461339", 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 15, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 47, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-02-20T08:02:44.682 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:02:44.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-20T08:02:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:45 smithi194 ceph-mon[37804]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-20T08:02:46.199 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:45 smithi123 ceph-mon[29383]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-20T08:02:46.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/780087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb81027e0 msgr2=0x7f1fb80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:46.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/780087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb81027e0 0x7f1fb80fbea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8004940 tx=0x7f1fa8009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:46.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/780087790 shutdown_connections 2024-02-20T08:02:46.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/780087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb81027e0 0x7f1fb80fbea0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/780087790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb8101e40 0x7f1fb8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/780087790 >> 172.21.15.123:0/780087790 conn(0x7f1fb8071d90 msgr2=0x7f1fb8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/780087790 shutdown_connections 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.607+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/780087790 wait complete. 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 Processor -- start 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 -- start start 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb81027e0 0x7f1fb810f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb810f6c0 con 0x7f1fb8101e40 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbf7c3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb810f830 con 0x7f1fb81027e0 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41948/0 (socket says 172.21.15.123:41948) 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 -- 172.21.15.123:0/3418155910 learned_addr learned my addr 172.21.15.123:0/3418155910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:46.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbcd5e700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb81027e0 0x7f1fb810f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 -- 172.21.15.123:0/3418155910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb81027e0 msgr2=0x7f1fb810f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb81027e0 0x7f1fb810f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 -- 172.21.15.123:0/3418155910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8005040 con 0x7f1fb8101e40 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.608+0000 7f1fbd55f700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000bbe0 tx=0x7f1fb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.609+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb00092e0 con 0x7f1fb8101e40 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.609+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fb000cbd0 con 0x7f1fb8101e40 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.609+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8117b80 con 0x7f1fb8101e40 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.609+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb0015e60 con 0x7f1fb8101e40 2024-02-20T08:02:46.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.609+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb81180c0 con 0x7f1fb8101e40 2024-02-20T08:02:46.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.610+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb80ff150 con 0x7f1fb8101e40 2024-02-20T08:02:46.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.610+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1fb0012070 con 0x7f1fb8101e40 2024-02-20T08:02:46.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.611+0000 7f1fadffb700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 0x7f1fa406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:46.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.611+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1fb0086e50 con 0x7f1fb8101e40 2024-02-20T08:02:46.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.611+0000 7f1fbcd5e700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 0x7f1fa406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:46.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.611+0000 7f1fbcd5e700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 0x7f1fa406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80661e0 tx=0x7f1fa8009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:46.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.615+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1fb0056b40 con 0x7f1fb8101e40 2024-02-20T08:02:46.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.840+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fb8065f20 con 0x7f1fb8101e40 2024-02-20T08:02:46.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.840+0000 7f1fadffb700 1 -- 172.21.15.123:0/3418155910 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1fb00566d0 con 0x7f1fb8101e40 2024-02-20T08:02:46.841 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 msgr2=0x7f1fa406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 0x7f1fa406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80661e0 tx=0x7f1fa8009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 msgr2=0x7f1fb810eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000bbe0 tx=0x7f1fb0009840 comp rx=0 tx=0).stop 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 shutdown_connections 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1fa40692a0 0x7f1fa406b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fb8101e40 0x7f1fb810eb60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 --2- 172.21.15.123:0/3418155910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fb81027e0 0x7f1fb810f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:46.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 >> 172.21.15.123:0/3418155910 conn(0x7f1fb8071d90 msgr2=0x7f1fb80fadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:46.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 shutdown_connections 2024-02-20T08:02:46.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:46.842+0000 7f1fbf7c3700 1 -- 172.21.15.123:0/3418155910 wait complete. 2024-02-20T08:02:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:46 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3418155910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-20T08:02:47.164 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:46 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3418155910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:47.522 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-20T08:02:47.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-20T08:02:47.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-20T08:02:47.523 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-20T08:02:47.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:47.523 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:47.542 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-02-20T08:02:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-02-20T08:02:47.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-20T08:02:47.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-20T08:02:47.544 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-02-20T08:02:47.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:47.715 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-20T08:02:47.741 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-02-20T08:02:47.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:47.743 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-02-20T08:02:47.807 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-02-20T08:02:47.807 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-20T08:02:47.807 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-20T08:02:47.808 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-20T08:02:47.808 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-20T08:02:47.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-20T08:02:47.808 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-02-20T08:02:48.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.103 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-02-20T08:02:48.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.118 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-02-20T08:02:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:47 smithi194 ceph-mon[37804]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:48.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.159 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-02-20T08:02:48.159 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-02-20T08:02:48.159 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-20T08:02:48.159 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-20T08:02:48.159 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-02-20T08:02:48.243 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-20T08:02:48.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.243 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-02-20T08:02:48.243 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-02-20T08:02:48.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-20T08:02:48.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-20T08:02:48.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-20T08:02:48.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-20T08:02:48.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-20T08:02:48.244 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-02-20T08:02:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:47 smithi123 ceph-mon[29383]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:48.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.355 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-02-20T08:02:48.355 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-02-20T08:02:48.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-02-20T08:02:48.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-02-20T08:02:48.355 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-02-20T08:02:48.397 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-20T08:02:48.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-20T08:02:48.397 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:48.455 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-20T08:02:48.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-20T08:02:48.455 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:48.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2024-02-20T08:02:48.578 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2024-02-20T08:02:48.634 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2024-02-20T08:02:48.635 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/0 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/9ad3399e94707ab659b3ecc14d5b144eb8bf9ce5698d47c6b5c6a9d1bbbd9005/merged 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/38c2803145142835ad16f582249a918da1d753cb1d7e80cffa9f3e830df57878/merged 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/e88c6f9d8ba4e42c1b1fd2401a7d25f5bc1341af1268e6fcc0bcc62445fcf7e2/merged 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/1cb145c0dc95d476eb58d64944d6a5c4e94fb3ab5c151cee0e833879891b8fcb/merged 2024-02-20T08:02:48.636 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/565849c42d95f5fbd3705bd2cfc979809d4a1ef7d8a9d9725f72625bddd0dd55/merged 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/60edcff30ac63c4bec870923efa3a4f2b6837be32f958fdaf914c78efe9a2c2b/merged 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/65723a975c842bf1585f537e8b229ae312424b4ffd6e8b43155b9a171f7d2f9d/merged 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/c4c660db36ee99db3ccf366e514f4f367ae4f9c2e754ef01e6a818e6c86f5e96/merged 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/6a0baf392ab17cb81149075c10cd6ffa78d2f98d0e1958cfee1ca7c889bd982c/merged 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-20T08:02:48.637 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-20T08:02:48.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.638 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2024-02-20T08:02:48.689 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-20T08:02:48.689 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-20T08:02:48.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2024-02-20T08:02:48.759 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2024-02-20T08:02:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2024-02-20T08:02:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2024-02-20T08:02:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2024-02-20T08:02:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2024-02-20T08:02:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2024-02-20T08:02:48.817 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/0 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/9ad3399e94707ab659b3ecc14d5b144eb8bf9ce5698d47c6b5c6a9d1bbbd9005/merged 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/38c2803145142835ad16f582249a918da1d753cb1d7e80cffa9f3e830df57878/merged 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/e88c6f9d8ba4e42c1b1fd2401a7d25f5bc1341af1268e6fcc0bcc62445fcf7e2/merged 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/1cb145c0dc95d476eb58d64944d6a5c4e94fb3ab5c151cee0e833879891b8fcb/merged 2024-02-20T08:02:48.818 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/565849c42d95f5fbd3705bd2cfc979809d4a1ef7d8a9d9725f72625bddd0dd55/merged 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/60edcff30ac63c4bec870923efa3a4f2b6837be32f958fdaf914c78efe9a2c2b/merged 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/65723a975c842bf1585f537e8b229ae312424b4ffd6e8b43155b9a171f7d2f9d/merged 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/c4c660db36ee99db3ccf366e514f4f367ae4f9c2e754ef01e6a818e6c86f5e96/merged 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/containers/storage/overlay/6a0baf392ab17cb81149075c10cd6ffa78d2f98d0e1958cfee1ca7c889bd982c/merged 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-20T08:02:48.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.819 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2024-02-20T08:02:48.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:2024-02-20T08:02:48.840+0000 7f3d17329300 -1 init, newargv = 0x55906974a1f0 newargc=15 2024-02-20T08:02:48.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[63736]: starting ceph client 2024-02-20T08:02:48.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[63736]: starting fuse 2024-02-20T08:02:48.856 INFO:teuthology.orchestra.run.smithi194.stdout:115 2024-02-20T08:02:48.857 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo stdin-killer -- python3 -c ' 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> import glob 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> import re 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> import os 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> import subprocess 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> def _find_admin_socket(client_name): 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> files = glob.glob(asok_path) 2024-02-20T08:02:48.857 DEBUG:teuthology.orchestra.run.smithi194:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> # Given a non-glob path, it better be there 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> if "*" not in asok_path: 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> assert(len(files) == 1) 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> return files[0] 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> for f in files: 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> contents = proc_f.read() 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> if mountpoint in contents: 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> return f 2024-02-20T08:02:48.858 DEBUG:teuthology.orchestra.run.smithi194:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-20T08:02:48.859 DEBUG:teuthology.orchestra.run.smithi194:> 2024-02-20T08:02:48.859 DEBUG:teuthology.orchestra.run.smithi194:> print(_find_admin_socket("client.1")) 2024-02-20T08:02:48.859 DEBUG:teuthology.orchestra.run.smithi194:> ' 2024-02-20T08:02:48.977 INFO:teuthology.orchestra.run.smithi194.stdout:/var/run/ceph/ceph-client.1.63736.asok 2024-02-20T08:02:48.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-02-20T08:02:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-20T08:02:48.987 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.63736.asok 2024-02-20T08:02:48.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:48.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.63736.asok status 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "metadata": { 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_sha1": "c80e7168938c48b49e5ce2e002f48bf150b5f4a4", 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)", 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "entity_id": "1", 2024-02-20T08:02:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "hostname": "smithi194", 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "pid": "63736", 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "root": "/" 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_count": 0, 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_pinned_count": 0, 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 24327, 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "inst": { 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "name": { 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "client", 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "num": 24327 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2024-02-20T08:02:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2934764264 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2934764264 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "inst_str": "client.24327 192.168.0.1:0/2934764264", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "addr_str": "192.168.0.1:0/2934764264", 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "inode_count": 1, 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_epoch": 15, 2024-02-20T08:02:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch": 47, 2024-02-20T08:02:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch_barrier": 0, 2024-02-20T08:02:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "blocklisted": false, 2024-02-20T08:02:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "cephfs" 2024-02-20T08:02:49.125 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-02-20T08:02:49.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:49.131 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-02-20T08:02:49.131 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.151 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-02-20T08:02:49.151 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:49.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.220 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:48 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:49.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:49.227 DEBUG:teuthology.orchestra.run.smithi194:> stat --file-system '--printf=%T 2024-02-20T08:02:49.227 DEBUG:teuthology.orchestra.run.smithi194:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.242 INFO:teuthology.orchestra.run.smithi194.stdout:fuseblk 2024-02-20T08:02:49.242 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:02:49.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.306 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:48 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:02:49.312 INFO:teuthology.run_tasks:Running task print... 2024-02-20T08:02:49.322 INFO:teuthology.task.print:**** done client 2024-02-20T08:02:49.322 INFO:teuthology.run_tasks:Running task parallel... 2024-02-20T08:02:49.333 INFO:teuthology.task.parallel:starting parallel... 2024-02-20T08:02:49.333 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-20T08:02:49.334 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-20T08:02:49.334 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:02:49.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-20T08:02:49.335 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-20T08:02:49.335 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-20T08:02:49.339 INFO:tasks.workunit:Pulling workunits from ref 3d72bcfd7affbb4a923c191d212814b4934cfeaa 2024-02-20T08:02:49.339 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-20T08:02:49.339 INFO:tasks.workunit:timeout=3h 2024-02-20T08:02:49.339 INFO:tasks.workunit:cleanup=True 2024-02-20T08:02:49.340 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.358 INFO:teuthology.orchestra.run.smithi123.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.358 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-20T08:02:49.358 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-02-20 08:02:13.048915303 +0000 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-02-20 08:02:49.224734689 +0000 2024-02-20T08:02:49.359 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-02-20T08:02:49.359 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-20T08:02:49.359 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-20T08:02:49.432 DEBUG:teuthology.orchestra.run.smithi194:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.447 INFO:teuthology.orchestra.run.smithi194.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-02-20 08:02:49.426967857 +0000 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-02-20 08:02:49.426967857 +0000 2024-02-20T08:02:49.448 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-02-20T08:02:49.448 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-20T08:02:49.448 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-20T08:02:49.519 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3d72bcfd7affbb4a923c191d212814b4934cfeaa 2024-02-20T08:02:49.519 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3d72bcfd7affbb4a923c191d212814b4934cfeaa 2024-02-20T08:02:49.535 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-20T08:02:49.574 INFO:tasks.workunit.client.1.smithi194.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-20T08:02:49.611 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:49 smithi123 ceph-mon[29383]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:50.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:49 smithi194 ceph-mon[37804]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 -- 172.21.15.123:0/3184598195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624100120 msgr2=0x7f9624102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3184598195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624100120 0x7f9624102520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9614004940 tx=0x7f9614009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 -- 172.21.15.123:0/3184598195 shutdown_connections 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3184598195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624100120 0x7f9624102520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3184598195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624066380 0x7f96240ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 -- 172.21.15.123:0/3184598195 >> 172.21.15.123:0/3184598195 conn(0x7f96240f74e0 msgr2=0x7f96240f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 -- 172.21.15.123:0/3184598195 shutdown_connections 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.514+0000 7f962b8f5700 1 -- 172.21.15.123:0/3184598195 wait complete. 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 Processor -- start 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 -- start start 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624100120 0x7f962410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962410e510 con 0x7f9624066380 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f962b8f5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962410ed50 con 0x7f9624100120 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59290/0 (socket says 172.21.15.123:59290) 2024-02-20T08:02:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 -- 172.21.15.123:0/3470809777 learned_addr learned my addr 172.21.15.123:0/3470809777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9628e90700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624100120 0x7f962410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 -- 172.21.15.123:0/3470809777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624100120 msgr2=0x7f962410de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624100120 0x7f962410de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.515+0000 7f9629691700 1 -- 172.21.15.123:0/3470809777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614005040 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f9629691700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f962000b790 tx=0x7f9620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962000f770 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f962000fda0 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962410f030 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962000d310 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.516+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962410f570 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.517+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624107ad0 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.518+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9620010420 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.518+0000 7f9619ffb700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 0x7f961006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.518+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9620087200 con 0x7f9624066380 2024-02-20T08:02:51.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.518+0000 7f9628e90700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 0x7f961006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:51.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.519+0000 7f9628e90700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 0x7f961006b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f961400b3b0 tx=0x7f9614009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:51.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.523+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9620056f70 con 0x7f9624066380 2024-02-20T08:02:51.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.717+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f962404bed0 con 0x7f9624066380 2024-02-20T08:02:51.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.717+0000 7f9619ffb700 1 -- 172.21.15.123:0/3470809777 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9620056b00 con 0x7f9624066380 2024-02-20T08:02:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.719+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 msgr2=0x7f961006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.719+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 0x7f961006b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f961400b3b0 tx=0x7f9614009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.719+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 msgr2=0x7f962410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.719+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f962000b790 tx=0x7f9620009250 comp rx=0 tx=0).stop 2024-02-20T08:02:51.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 shutdown_connections 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f96100692b0 0x7f961006b760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9624066380 0x7f962410d940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 --2- 172.21.15.123:0/3470809777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9624100120 0x7f962410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 >> 172.21.15.123:0/3470809777 conn(0x7f96240f74e0 msgr2=0x7f96240f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 shutdown_connections 2024-02-20T08:02:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:51.720+0000 7f962b8f5700 1 -- 172.21.15.123:0/3470809777 wait complete. 2024-02-20T08:02:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:51 smithi123 ceph-mon[29383]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:51 smithi194 ceph-mon[37804]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-20T08:02:52.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-20T08:02:52.738 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:54.239 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:53 smithi123 ceph-mon[29383]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:53 smithi194 ceph-mon[37804]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:54.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 -- 172.21.15.123:0/982090385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 msgr2=0x7f46680fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 --2- 172.21.15.123:0/982090385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f46680fc260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4658004940 tx=0x7f4658009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 -- 172.21.15.123:0/982090385 shutdown_connections 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 --2- 172.21.15.123:0/982090385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f46680fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 --2- 172.21.15.123:0/982090385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f46680fc260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 -- 172.21.15.123:0/982090385 >> 172.21.15.123:0/982090385 conn(0x7f46680f7510 msgr2=0x7f46680f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 -- 172.21.15.123:0/982090385 shutdown_connections 2024-02-20T08:02:54.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.498+0000 7f466cd7b700 1 -- 172.21.15.123:0/982090385 wait complete. 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 Processor -- start 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 -- start start 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f466810cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466810d390 con 0x7f46680fbe50 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466cd7b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466810dc30 con 0x7f46680fcfc0 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59318/0 (socket says 172.21.15.123:59318) 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.499+0000 7f466659c700 1 -- 172.21.15.123:0/57904546 learned_addr learned my addr 172.21.15.123:0/57904546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f4665d9b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f466810cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:54.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f466659c700 1 -- 172.21.15.123:0/57904546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 msgr2=0x7f466810cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f466659c700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f466810cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f466659c700 1 -- 172.21.15.123:0/57904546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658005040 con 0x7f46680fbe50 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f4665d9b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f466810cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f466659c700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f46580093b0 tx=0x7f4658009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465800e040 con 0x7f46680fbe50 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466810deb0 con 0x7f46680fbe50 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f465800bcc0 con 0x7f46680fbe50 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.500+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465801c630 con 0x7f46680fbe50 2024-02-20T08:02:54.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.501+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466810e3f0 con 0x7f46680fbe50 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.501+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f46580139f0 con 0x7f46680fbe50 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.502+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466804bed0 con 0x7f46680fbe50 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.502+0000 7f4656ffd700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 0x7f465006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.502+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f46580885e0 con 0x7f46680fbe50 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.502+0000 7f4665d9b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 0x7f465006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:54.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.502+0000 7f4665d9b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 0x7f465006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f465c007fd0 tx=0x7f465c009040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:54.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.507+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4658058350 con 0x7f46680fbe50 2024-02-20T08:02:54.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.712+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f4668104940 con 0x7f46680fbe50 2024-02-20T08:02:54.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.712+0000 7f4656ffd700 1 -- 172.21.15.123:0/57904546 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4658057ee0 con 0x7f46680fbe50 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 msgr2=0x7f465006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 0x7f465006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f465c007fd0 tx=0x7f465c009040 comp rx=0 tx=0).stop 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 msgr2=0x7f466810c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f46580093b0 tx=0x7f4658009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 shutdown_connections 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f46500692a0 0x7f465006b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46680fbe50 0x7f466810c850 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 --2- 172.21.15.123:0/57904546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46680fcfc0 0x7f466810cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 >> 172.21.15.123:0/57904546 conn(0x7f46680f7510 msgr2=0x7f4668100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 shutdown_connections 2024-02-20T08:02:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:54.714+0000 7f466cd7b700 1 -- 172.21.15.123:0/57904546 wait complete. 2024-02-20T08:02:55.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-20T08:02:55.969 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:02:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:55 smithi123 ceph-mon[29383]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:55 smithi194 ceph-mon[37804]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- 172.21.15.123:0/2622712771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fcd80 msgr2=0x7f4aec0fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2622712771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fcd80 0x7f4aec0fd190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0004940 tx=0x7f4ae0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- 172.21.15.123:0/2622712771 shutdown_connections 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2622712771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fdf90 0x7f4aec0fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2622712771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fcd80 0x7f4aec0fd190 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- 172.21.15.123:0/2622712771 >> 172.21.15.123:0/2622712771 conn(0x7f4aec0f8440 msgr2=0x7f4aec0fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- 172.21.15.123:0/2622712771 shutdown_connections 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- 172.21.15.123:0/2622712771 wait complete. 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 Processor -- start 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.725+0000 7f4af09fe700 1 -- start start 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4af09fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fcd80 0x7f4aec10d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4af09fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4af09fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec10e210 con 0x7f4aec0fdf90 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4af09fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec10eab0 con 0x7f4aec0fcd80 2024-02-20T08:02:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59336/0 (socket says 172.21.15.123:59336) 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 -- 172.21.15.123:0/2243744290 learned_addr learned my addr 172.21.15.123:0/2243744290 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aead9d700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fcd80 0x7f4aec10d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 -- 172.21.15.123:0/2243744290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fcd80 msgr2=0x7f4aec10d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fcd80 0x7f4aec10d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 -- 172.21.15.123:0/2243744290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0005040 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.726+0000 7f4aea59c700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00eb40 tx=0x7f4adc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.727+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4adc007cc0 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.727+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec10ed30 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.727+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4adc00f040 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.727+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4adc00ca10 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.727+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec10f270 con 0x7f4aec0fdf90 2024-02-20T08:02:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.728+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec04bed0 con 0x7f4aec0fdf90 2024-02-20T08:02:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.729+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4adc00cc80 con 0x7f4aec0fdf90 2024-02-20T08:02:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.729+0000 7f4ad37fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 0x7f4ad406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:02:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.729+0000 7f4aead9d700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 0x7f4ad406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:02:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.729+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4adc086df0 con 0x7f4aec0fdf90 2024-02-20T08:02:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.729+0000 7f4aead9d700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 0x7f4ad406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:02:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.734+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4adc04dbd0 con 0x7f4aec0fdf90 2024-02-20T08:02:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.936+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f4aec105860 con 0x7f4aec0fdf90 2024-02-20T08:02:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.937+0000 7f4ad37fe700 1 -- 172.21.15.123:0/2243744290 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4adc056b90 con 0x7f4aec0fdf90 2024-02-20T08:02:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 msgr2=0x7f4ad406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 0x7f4ad406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae0009e30 comp rx=0 tx=0).stop 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 msgr2=0x7f4aec10dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00eb40 tx=0x7f4adc00b040 comp rx=0 tx=0).stop 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 shutdown_connections 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f4ad40692a0 0x7f4ad406b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0fcd80 0x7f4aec10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 --2- 172.21.15.123:0/2243744290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0fdf90 0x7f4aec10dc10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 >> 172.21.15.123:0/2243744290 conn(0x7f4aec0f8440 msgr2=0x7f4aec1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 shutdown_connections 2024-02-20T08:02:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:02:57.939+0000 7f4af09fe700 1 -- 172.21.15.123:0/2243744290 wait complete. 2024-02-20T08:02:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:57 smithi123 ceph-mon[29383]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:57 smithi194 ceph-mon[37804]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-20T08:02:58.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-20T08:02:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:03:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:02:59 smithi123 ceph-mon[29383]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-20T08:03:00.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:02:59 smithi194 ceph-mon[37804]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-20T08:03:00.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 -- 172.21.15.123:0/1656784678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 msgr2=0x7ff6b00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/1656784678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b00ffe60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0004940 tx=0x7ff6a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 -- 172.21.15.123:0/1656784678 shutdown_connections 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/1656784678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/1656784678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b00ffe60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 -- 172.21.15.123:0/1656784678 >> 172.21.15.123:0/1656784678 conn(0x7ff6b00f7520 msgr2=0x7ff6b00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 -- 172.21.15.123:0/1656784678 shutdown_connections 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 -- 172.21.15.123:0/1656784678 wait complete. 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.854+0000 7ff6b63f5700 1 Processor -- start 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6b63f5700 1 -- start start 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6b63f5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6b63f5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b010dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6b63f5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b010e3a0 con 0x7ff6b00fda80 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6b63f5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b010ec40 con 0x7ff6b01003a0 2024-02-20T08:03:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6af7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b010dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46274/0 (socket says 172.21.15.123:46274) 2024-02-20T08:03:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6affff700 1 -- 172.21.15.123:0/2397291477 learned_addr learned my addr 172.21.15.123:0/2397291477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6af7fe700 1 -- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 msgr2=0x7ff6b010d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6af7fe700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6af7fe700 1 -- 172.21.15.123:0/2397291477 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0005040 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.855+0000 7ff6affff700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6af7fe700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b010dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009fd0 tx=0x7ff6a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a4004e90 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b010eec0 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6a400f040 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a400ca50 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.856+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b010f400 con 0x7ff6b01003a0 2024-02-20T08:03:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.857+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0107a50 con 0x7ff6b01003a0 2024-02-20T08:03:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.857+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff6a4007cc0 con 0x7ff6b01003a0 2024-02-20T08:03:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.858+0000 7ff6acff9700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 0x7ff69806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.858+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff6a4086ca0 con 0x7ff6b01003a0 2024-02-20T08:03:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.858+0000 7ff6affff700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 0x7ff69806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:00.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.858+0000 7ff6affff700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 0x7ff69806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b0d0 tx=0x7ff6a0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:00.862+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff6a404dbd0 con 0x7ff6b01003a0 2024-02-20T08:03:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:01.073+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6b002b3c0 con 0x7ff6980692a0 2024-02-20T08:03:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:01 smithi123 ceph-mon[29383]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-20T08:03:02.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:01 smithi194 ceph-mon[37804]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-20T08:03:03.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:02 smithi123 ceph-mon[29383]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:03.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:02 smithi194 ceph-mon[37804]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:03 smithi123 ceph-mon[29383]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-20T08:03:04.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:03 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:04.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:03 smithi194 ceph-mon[37804]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-20T08:03:04.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:03 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:05 smithi123 ceph-mon[29383]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:05 smithi194 ceph-mon[37804]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:08.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:07 smithi123 ceph-mon[29383]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:08.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:07 smithi194 ceph-mon[37804]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:09 smithi123 ceph-mon[29383]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:10.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:09 smithi194 ceph-mon[37804]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:03:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:11 smithi123 ceph-mon[29383]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-20T08:03:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:11 smithi194 ceph-mon[37804]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-20T08:03:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:13 smithi123 ceph-mon[29383]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-20T08:03:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:13 smithi194 ceph-mon[37804]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-20T08:03:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:15 smithi123 ceph-mon[29383]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-20T08:03:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:15 smithi194 ceph-mon[37804]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-20T08:03:18.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:17 smithi123 ceph-mon[29383]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:17 smithi194 ceph-mon[37804]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:18 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:19 smithi123 ceph-mon[29383]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:20.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:19 smithi194 ceph-mon[37804]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:21 smithi123 ceph-mon[29383]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:21 smithi194 ceph-mon[37804]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:23 smithi123 ceph-mon[29383]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:23 smithi194 ceph-mon[37804]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:25 smithi123 ceph-mon[29383]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:25 smithi194 ceph-mon[37804]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:27.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.982+0000 7ff6acff9700 1 -- 172.21.15.123:0/2397291477 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff6b002b3c0 con 0x7ff6980692a0 2024-02-20T08:03:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 msgr2=0x7ff69806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 0x7ff69806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b0d0 tx=0x7ff6a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 msgr2=0x7ff6b010dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b010dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009fd0 tx=0x7ff6a400b040 comp rx=0 tx=0).stop 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 shutdown_connections 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff6980692a0 0x7ff69806b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b00fda80 0x7ff6b010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 --2- 172.21.15.123:0/2397291477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b01003a0 0x7ff6b010dda0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:27.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.984+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 >> 172.21.15.123:0/2397291477 conn(0x7ff6b00f7520 msgr2=0x7ff6b00f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:27.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.985+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 shutdown_connections 2024-02-20T08:03:27.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:27.985+0000 7ff6b63f5700 1 -- 172.21.15.123:0/2397291477 wait complete. 2024-02-20T08:03:28.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:27 smithi123 ceph-mon[29383]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:28.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:27 smithi194 ceph-mon[37804]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:28.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-20T08:03:29.075 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:03:29.196 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:03:29.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:29.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:03:29.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:03:29.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:03:29.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:03:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:29 smithi123 ceph-mon[29383]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:29 smithi123 ceph-mon[29383]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:03:30.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:29 smithi194 ceph-mon[37804]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:30.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:29 smithi194 ceph-mon[37804]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:03:32.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:31 smithi123 ceph-mon[29383]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:31 smithi194 ceph-mon[37804]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:32.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- 172.21.15.123:0/1411994690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 msgr2=0x7f1c1c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 --2- 172.21.15.123:0/1411994690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fb6f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c004940 tx=0x7f1c0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- 172.21.15.123:0/1411994690 shutdown_connections 2024-02-20T08:03:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 --2- 172.21.15.123:0/1411994690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fbcc0 0x7f1c1c102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 --2- 172.21.15.123:0/1411994690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fb6f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- 172.21.15.123:0/1411994690 >> 172.21.15.123:0/1411994690 conn(0x7f1c1c0f6ca0 msgr2=0x7f1c1c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- 172.21.15.123:0/1411994690 shutdown_connections 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- 172.21.15.123:0/1411994690 wait complete. 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 Processor -- start 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.146+0000 7f1c2289f700 1 -- start start 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fc2c0 0x7f1c1c0fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0fccc0 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0fce00 con 0x7f1c1c0fc2c0 2024-02-20T08:03:32.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53830/0 (socket says 172.21.15.123:53830) 2024-02-20T08:03:32.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 -- 172.21.15.123:0/2499489326 learned_addr learned my addr 172.21.15.123:0/2499489326 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1b7fe700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fc2c0 0x7f1c1c0fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 -- 172.21.15.123:0/2499489326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fc2c0 msgr2=0x7f1c1c0fc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fc2c0 0x7f1c1c0fc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 -- 172.21.15.123:0/2499489326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c005040 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c1bfff700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009b30 tx=0x7f1c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c021070 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0fd080 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c0c01c400 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c00e070 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.147+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c115cc0 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.566 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.148+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c107ab0 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.149+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1c0c01ca00 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.149+0000 7f1c18ff9700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.150+0000 7f1c1b7fe700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.150+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1c0c088380 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.150+0000 7f1c1b7fe700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 0x7f1c0406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009b80 tx=0x7f1c1000b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.154+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1c0c0580f0 con 0x7f1c1c0fb2e0 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.386+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c1c0fbdd0 con 0x7f1c040692a0 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.387+0000 7f1c18ff9700 1 -- 172.21.15.123:0/2499489326 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f1c1c0fbdd0 con 0x7f1c040692a0 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 msgr2=0x7f1c0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 0x7f1c0406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009b80 tx=0x7f1c1000b040 comp rx=0 tx=0).stop 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 msgr2=0x7f1c1c0fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009b30 tx=0x7f1c0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 shutdown_connections 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c1c0fb2e0 0x7f1c1c0fde40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 --2- 172.21.15.123:0/2499489326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c0fc2c0 0x7f1c1c0fc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 >> 172.21.15.123:0/2499489326 conn(0x7f1c1c0f6ca0 msgr2=0x7f1c1c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 shutdown_connections 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.390+0000 7f1c2289f700 1 -- 172.21.15.123:0/2499489326 wait complete. 2024-02-20T08:03:32.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- 172.21.15.123:0/3740110228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fcef0 msgr2=0x7fba680fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/3740110228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fcef0 0x7fba680fd320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba60009ce0 tx=0x7fba60004d10 comp rx=0 tx=0).stop 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- 172.21.15.123:0/3740110228 shutdown_connections 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/3740110228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fe0e0 0x7fba680fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/3740110228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fcef0 0x7fba680fd320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- 172.21.15.123:0/3740110228 >> 172.21.15.123:0/3740110228 conn(0x7fba680f8620 msgr2=0x7fba680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- 172.21.15.123:0/3740110228 shutdown_connections 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- 172.21.15.123:0/3740110228 wait complete. 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 Processor -- start 2024-02-20T08:03:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.494+0000 7fba6d9e7700 1 -- start start 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fcef0 0x7fba6810d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6810e500 con 0x7fba680fe0e0 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6810eda0 con 0x7fba680fcef0 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53850/0 (socket says 172.21.15.123:53850) 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 -- 172.21.15.123:0/2876011582 learned_addr learned my addr 172.21.15.123:0/2876011582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba66ffd700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fcef0 0x7fba6810d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 -- 172.21.15.123:0/2876011582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fcef0 msgr2=0x7fba6810d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fcef0 0x7fba6810d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 -- 172.21.15.123:0/2876011582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009940 con 0x7fba680fe0e0 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba667fc700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00eb40 tx=0x7fba5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c007cc0 con 0x7fba680fe0e0 2024-02-20T08:03:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba5c00f040 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c00ca10 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6810f020 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.495+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6810f560 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.496+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6804bed0 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.497+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fba5c00cb70 con 0x7fba680fe0e0 2024-02-20T08:03:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.497+0000 7fba4f7fe700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 0x7fba5006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.497+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fba5c086d20 con 0x7fba680fe0e0 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.497+0000 7fba66ffd700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 0x7fba5006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.498+0000 7fba66ffd700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 0x7fba5006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba60009460 tx=0x7fba60004d10 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.501+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fba5c04dbd0 con 0x7fba680fe0e0 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.709+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba6810fa00 con 0x7fba500692b0 2024-02-20T08:03:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.710+0000 7fba4f7fe700 1 -- 172.21.15.123:0/2876011582 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fba6810fa00 con 0x7fba500692b0 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 msgr2=0x7fba5006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 0x7fba5006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba60009460 tx=0x7fba60004d10 comp rx=0 tx=0).stop 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 msgr2=0x7fba6810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00eb40 tx=0x7fba5c00b040 comp rx=0 tx=0).stop 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 shutdown_connections 2024-02-20T08:03:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fba500692b0 0x7fba5006b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba680fcef0 0x7fba6810d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 --2- 172.21.15.123:0/2876011582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba680fe0e0 0x7fba6810df00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 >> 172.21.15.123:0/2876011582 conn(0x7fba680f8620 msgr2=0x7fba681013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 shutdown_connections 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.713+0000 7fba6d9e7700 1 -- 172.21.15.123:0/2876011582 wait complete. 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- 172.21.15.123:0/3449048805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 msgr2=0x7f33440ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 --2- 172.21.15.123:0/3449048805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f33440ffb10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3334004940 tx=0x7f3334009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- 172.21.15.123:0/3449048805 shutdown_connections 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 --2- 172.21.15.123:0/3449048805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33441000e0 0x7f3344102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 --2- 172.21.15.123:0/3449048805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f33440ffb10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- 172.21.15.123:0/3449048805 >> 172.21.15.123:0/3449048805 conn(0x7f33440f74e0 msgr2=0x7f33440f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- 172.21.15.123:0/3449048805 shutdown_connections 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- 172.21.15.123:0/3449048805 wait complete. 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 Processor -- start 2024-02-20T08:03:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.815+0000 7f3348eac700 1 -- start start 2024-02-20T08:03:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33441000e0 0x7f334410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334410e490 con 0x7f33440663c0 2024-02-20T08:03:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334410ed30 con 0x7f33441000e0 2024-02-20T08:03:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (5m) 55s ago 7m 25.4M - 0.25.0 c8568f914cd2 a0302c7e0fd3 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (7m) 55s ago 7m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (5m) 60s ago 5m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (5m) 55s ago 6m 83.6M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:03:32.579 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (79s) 55s ago 79s 10.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (74s) 55s ago 73s 13.3M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (76s) 60s ago 76s 13.5M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (71s) 60s ago 70s 11.1M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (8m) 55s ago 8m 481M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (5m) 60s ago 5m 431M - 17.2.7-521-gc80e7168 10b0c032c913 3a7cc19eb152 2024-02-20T08:03:32.580 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (8m) 55s ago 8m 48.1M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (5m) 60s ago 5m 35.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (7m) 55s ago 7m 15.4M - 1.5.0 0da6a335fe13 c635ab46d42a 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 60s ago 5m 17.0M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (5m) 55s ago 5m 46.1M 4288M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (4m) 55s ago 4m 45.9M 4288M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (4m) 55s ago 4m 45.0M 4288M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:03:32.581 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (3m) 60s ago 3m 46.9M 5312M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:03:32.582 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (3m) 60s ago 3m 41.3M 5312M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:03:32.582 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (2m) 60s ago 2m 41.5M 5312M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:03:32.582 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (5m) 55s ago 6m 55.8M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:03:32.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53856/0 (socket says 172.21.15.123:53856) 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 -- 172.21.15.123:0/503240237 learned_addr learned my addr 172.21.15.123:0/503240237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 -- 172.21.15.123:0/503240237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33441000e0 msgr2=0x7f334410de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33441000e0 0x7f334410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 -- 172.21.15.123:0/503240237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334005040 con 0x7f33440663c0 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f334259c700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f333400b3b0 tx=0x7f3334009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f333400e040 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f333400bd90 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334410efb0 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f333401c630 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.816+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334410f4f0 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.817+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344107a70 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.818+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f33340139f0 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.818+0000 7f333affd700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 0x7f333006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.818+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3334088660 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.818+0000 7f333bfff700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 0x7f333006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.819+0000 7f333bfff700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 0x7f333006b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3344066100 tx=0x7f332c007cc0 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:31.822+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3334058520 con 0x7f33440663c0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.021+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f334410f8d0 con 0x7f33300692b0 2024-02-20T08:03:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.031+0000 7f333affd700 1 -- 172.21.15.123:0/503240237 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f334410f8d0 con 0x7f33300692b0 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 msgr2=0x7f333006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 0x7f333006b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3344066100 tx=0x7f332c007cc0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 msgr2=0x7f334410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f333400b3b0 tx=0x7f3334009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 shutdown_connections 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f33300692b0 0x7f333006b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33440663c0 0x7f334410d950 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 --2- 172.21.15.123:0/503240237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33441000e0 0x7f334410de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.032+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 >> 172.21.15.123:0/503240237 conn(0x7f33440f74e0 msgr2=0x7f33440f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.033+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 shutdown_connections 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.033+0000 7f3348eac700 1 -- 172.21.15.123:0/503240237 wait complete. 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/1330329782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 msgr2=0x7fcc94070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/1330329782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc94070cd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc84004940 tx=0x7fcc84009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/1330329782 shutdown_connections 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/1330329782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc94070cd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/1330329782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/1330329782 >> 172.21.15.123:0/1330329782 conn(0x7fcc940f8620 msgr2=0x7fcc940faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/1330329782 shutdown_connections 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.133+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/1330329782 wait complete. 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 Processor -- start 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 -- start start 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94110680 con 0x7fcc94070860 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9c7a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94110f20 con 0x7fcc94071eb0 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53876/0 (socket says 172.21.15.123:53876) 2024-02-20T08:03:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 -- 172.21.15.123:0/471755953 learned_addr learned my addr 172.21.15.123:0/471755953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc99d3e700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 -- 172.21.15.123:0/471755953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 msgr2=0x7fcc94110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.134+0000 7fcc9a53f700 1 -- 172.21.15.123:0/471755953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84005040 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc99d3e700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc9a53f700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc90002a50 tx=0x7fcc900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc90007cc0 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc9000f040 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94111200 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc90009640 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.135+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc94111740 con 0x7fcc94070860 2024-02-20T08:03:32.587 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:03:32.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 14 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.136+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9404bed0 con 0x7fcc94070860 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.136+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcc900097a0 con 0x7fcc94070860 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.137+0000 7fcc8affd700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 0x7fcc8006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.137+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcc90087010 con 0x7fcc94070860 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.137+0000 7fcc99d3e700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 0x7fcc8006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.137+0000 7fcc99d3e700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 0x7fcc8006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc84004560 tx=0x7fcc84009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.141+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcc90056d00 con 0x7fcc94070860 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.407+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc94116160 con 0x7fcc94070860 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.408+0000 7fcc8affd700 1 -- 172.21.15.123:0/471755953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fcc90056890 con 0x7fcc94070860 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 msgr2=0x7fcc8006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 0x7fcc8006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc84004560 tx=0x7fcc84009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 msgr2=0x7fcc9410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc90002a50 tx=0x7fcc900046b0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 shutdown_connections 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fcc800692a0 0x7fcc8006b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc94070860 0x7fcc9410fb40 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc90002a50 tx=0x7fcc900046b0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 --2- 172.21.15.123:0/471755953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc94071eb0 0x7fcc94110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 >> 172.21.15.123:0/471755953 conn(0x7fcc940f8620 msgr2=0x7fcc94102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 shutdown_connections 2024-02-20T08:03:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.410+0000 7fcc9c7a3700 1 -- 172.21.15.123:0/471755953 wait complete. 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 -- 172.21.15.123:0/835581843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 msgr2=0x7fb01c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 --2- 172.21.15.123:0/835581843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c0fd420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb010004940 tx=0x7fb010009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 -- 172.21.15.123:0/835581843 shutdown_connections 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 --2- 172.21.15.123:0/835581843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c0fd420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 --2- 172.21.15.123:0/835581843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 0x7fb01c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.514+0000 7fb0222e6700 1 -- 172.21.15.123:0/835581843 >> 172.21.15.123:0/835581843 conn(0x7fb01c0f74e0 msgr2=0x7fb01c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 -- 172.21.15.123:0/835581843 shutdown_connections 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 -- 172.21.15.123:0/835581843 wait complete. 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 Processor -- start 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 -- start start 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 0x7fb01c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c10d310 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb0222e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c10dbb0 con 0x7fb01c0fbe40 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53904/0 (socket says 172.21.15.123:53904) 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.515+0000 7fb01b7fe700 1 -- 172.21.15.123:0/4145235050 learned_addr learned my addr 172.21.15.123:0/4145235050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb01bfff700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 0x7fb01c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb01b7fe700 1 -- 172.21.15.123:0/4145235050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 msgr2=0x7fb01c10c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb01b7fe700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 0x7fb01c10c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb01b7fe700 1 -- 172.21.15.123:0/4145235050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010005040 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb01b7fe700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb010009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb010021070 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb01001c400 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c10de30 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01000e070 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.516+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c10e310 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.517+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c04bed0 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.518+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb01001ca50 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.518+0000 7fb018ff9700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 0x7fb00406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:03:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.518+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb0100883e0 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.518+0000 7fb01bfff700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 0x7fb00406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:03:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.519+0000 7fb01bfff700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 0x7fb00406b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009b80 tx=0x7fb00c00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:03:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.522+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb010058150 con 0x7fb01c0fcfb0 2024-02-20T08:03:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.732+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb01c10e720 con 0x7fb0040692a0 2024-02-20T08:03:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.733+0000 7fb018ff9700 1 -- 172.21.15.123:0/4145235050 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fb01c10e720 con 0x7fb0040692a0 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "", 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c image", 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:03:32.734 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 msgr2=0x7fb00406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 0x7fb00406b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009b80 tx=0x7fb00c00b040 comp rx=0 tx=0).stop 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 msgr2=0x7fb01c10cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb010009e30 comp rx=0 tx=0).stop 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 shutdown_connections 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7fb0040692a0 0x7fb00406b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb01c0fbe40 0x7fb01c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 --2- 172.21.15.123:0/4145235050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb01c0fcfb0 0x7fb01c10cd10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 >> 172.21.15.123:0/4145235050 conn(0x7fb01c0f74e0 msgr2=0x7fb01c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:03:32.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 shutdown_connections 2024-02-20T08:03:32.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:03:32.735+0000 7fb0222e6700 1 -- 172.21.15.123:0/4145235050 wait complete. 2024-02-20T08:03:33.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:32 smithi123 ceph-mon[29383]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:32 smithi123 ceph-mon[29383]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:32 smithi123 ceph-mon[29383]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:32 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/471755953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:03:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:32 smithi194 ceph-mon[37804]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:32 smithi194 ceph-mon[37804]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:32 smithi194 ceph-mon[37804]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:32 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/471755953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:03:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:33 smithi123 ceph-mon[29383]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:33 smithi123 ceph-mon[29383]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:33 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:34.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:33 smithi194 ceph-mon[37804]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:34.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:33 smithi194 ceph-mon[37804]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:03:34.295 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:33 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:36 smithi123 ceph-mon[29383]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:36.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:36 smithi194 ceph-mon[37804]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:38 smithi123 ceph-mon[29383]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:38 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:38 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:03:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:38 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:38 smithi194 ceph-mon[37804]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:38 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:38 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:03:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:38 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:03:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:39 smithi194 ceph-mon[37804]: Upgrade: Target is version 19.0.0-1587-g91ff50e9 (unknown) 2024-02-20T08:03:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:39 smithi194 ceph-mon[37804]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024'] 2024-02-20T08:03:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:39 smithi194 ceph-mon[37804]: Upgrade: Need to upgrade myself (mgr.smithi123.kwyrtl) 2024-02-20T08:03:39.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:39 smithi194 ceph-mon[37804]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 on smithi194 2024-02-20T08:03:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:39 smithi123 ceph-mon[29383]: Upgrade: Target is version 19.0.0-1587-g91ff50e9 (unknown) 2024-02-20T08:03:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:39 smithi123 ceph-mon[29383]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024'] 2024-02-20T08:03:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:39 smithi123 ceph-mon[29383]: Upgrade: Need to upgrade myself (mgr.smithi123.kwyrtl) 2024-02-20T08:03:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:39 smithi123 ceph-mon[29383]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 on smithi194 2024-02-20T08:03:40.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:40 smithi194 ceph-mon[37804]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:40.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:40 smithi123 ceph-mon[29383]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:42.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:42 smithi194 ceph-mon[37804]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:42.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:42 smithi123 ceph-mon[29383]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:44.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:44 smithi194 ceph-mon[37804]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:44.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:44 smithi123 ceph-mon[29383]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:46.343 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:46 smithi123 ceph-mon[29383]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:46.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:46 smithi194 ceph-mon[37804]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:48 smithi194 ceph-mon[37804]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:48.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:48 smithi123 ceph-mon[29383]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:49.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:49 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:49.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:49 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:03:50.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:50 smithi194 ceph-mon[37804]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:50.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:50 smithi123 ceph-mon[29383]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:52 smithi194 ceph-mon[37804]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:52.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:52 smithi123 ceph-mon[29383]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:54 smithi194 ceph-mon[37804]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:54 smithi123 ceph-mon[29383]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:56.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:56 smithi123 ceph-mon[29383]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:56 smithi194 ceph-mon[37804]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:58.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:03:58 smithi194 ceph-mon[37804]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:03:58.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:03:58 smithi123 ceph-mon[29383]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:00.392 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:00 smithi194 ceph-mon[37804]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:00.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:00 smithi123 ceph-mon[29383]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:02.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:02 smithi194 ceph-mon[37804]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:02.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:02 smithi123 ceph-mon[29383]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.846+0000 7f25333df700 1 -- 172.21.15.123:0/3817102731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 msgr2=0x7f252c0fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.846+0000 7f25333df700 1 --2- 172.21.15.123:0/3817102731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c0fc290 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2528004940 tx=0x7f2528009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 -- 172.21.15.123:0/3817102731 shutdown_connections 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 --2- 172.21.15.123:0/3817102731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 0x7f252c0fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 --2- 172.21.15.123:0/3817102731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c0fc290 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 -- 172.21.15.123:0/3817102731 >> 172.21.15.123:0/3817102731 conn(0x7f252c0f7590 msgr2=0x7f252c0f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 -- 172.21.15.123:0/3817102731 shutdown_connections 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.847+0000 7f25333df700 1 -- 172.21.15.123:0/3817102731 wait complete. 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 Processor -- start 2024-02-20T08:04:02.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 -- start start 2024-02-20T08:04:02.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:02.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 0x7f252c109f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:02.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c10a560 con 0x7f252c0fbe80 2024-02-20T08:04:02.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.848+0000 7f25333df700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c10ae00 con 0x7f252c0fd080 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57552/0 (socket says 172.21.15.123:57552) 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 -- 172.21.15.123:0/1234194104 learned_addr learned my addr 172.21.15.123:0/1234194104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253097a700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 0x7f252c109f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 -- 172.21.15.123:0/1234194104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 msgr2=0x7f252c109f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 0x7f252c109f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 -- 172.21.15.123:0/1234194104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528005040 con 0x7f252c0fbe80 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f253117b700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2528009fd0 tx=0x7f2528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252800e040 con 0x7f252c0fbe80 2024-02-20T08:04:02.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c10b080 con 0x7f252c0fbe80 2024-02-20T08:04:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2528009320 con 0x7f252c0fbe80 2024-02-20T08:04:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.849+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252800bcb0 con 0x7f252c0fbe80 2024-02-20T08:04:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.850+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c10b5c0 con 0x7f252c0fbe80 2024-02-20T08:04:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.851+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c04bed0 con 0x7f252c0fbe80 2024-02-20T08:04:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.852+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2528013b10 con 0x7f252c0fbe80 2024-02-20T08:04:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.853+0000 7f2521ffb700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.853+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2528088520 con 0x7f252c0fbe80 2024-02-20T08:04:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.853+0000 7f253097a700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.854+0000 7f253097a700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 0x7f251806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f251c004f40 tx=0x7f251c00b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:02.861+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f25280548a0 con 0x7f252c0fbe80 2024-02-20T08:04:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.092+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f252c066680 con 0x7f25180692a0 2024-02-20T08:04:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.094+0000 7f2521ffb700 1 -- 172.21.15.123:0/1234194104 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f252c066680 con 0x7f25180692a0 2024-02-20T08:04:03.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.095+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 msgr2=0x7f251806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 0x7f251806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f251c004f40 tx=0x7f251c00b040 comp rx=0 tx=0).stop 2024-02-20T08:04:03.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 msgr2=0x7f252c1099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2528009fd0 tx=0x7f2528009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 shutdown_connections 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f252c0fbe80 0x7f252c1099d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 --2- 172.21.15.123:0/1234194104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c0fd080 0x7f252c109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 >> 172.21.15.123:0/1234194104 conn(0x7f252c0f7590 msgr2=0x7f252c065f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 shutdown_connections 2024-02-20T08:04:03.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.096+0000 7f25333df700 1 -- 172.21.15.123:0/1234194104 wait complete. 2024-02-20T08:04:03.108 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:04:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.208+0000 7f836522f700 1 -- 172.21.15.123:0/1014487416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 msgr2=0x7f8360102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.208+0000 7f836522f700 1 --2- 172.21.15.123:0/1014487416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f8360102780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8354004940 tx=0x7f8354009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 -- 172.21.15.123:0/1014487416 shutdown_connections 2024-02-20T08:04:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 --2- 172.21.15.123:0/1014487416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f8360102780 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 --2- 172.21.15.123:0/1014487416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 0x7f83600ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 -- 172.21.15.123:0/1014487416 >> 172.21.15.123:0/1014487416 conn(0x7f83600f7500 msgr2=0x7f83600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 -- 172.21.15.123:0/1014487416 shutdown_connections 2024-02-20T08:04:03.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.209+0000 7f836522f700 1 -- 172.21.15.123:0/1014487416 wait complete. 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 Processor -- start 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 -- start start 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 0x7f83600fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601113c0 con 0x7f83601003a0 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f836522f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360111530 con 0x7f83600fda80 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57570/0 (socket says 172.21.15.123:57570) 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 -- 172.21.15.123:0/1028564872 learned_addr learned my addr 172.21.15.123:0/1028564872 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835ed9d700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 0x7f83600fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 -- 172.21.15.123:0/1028564872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 msgr2=0x7f83600fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 0x7f83600fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.210+0000 7f835e59c700 1 -- 172.21.15.123:0/1028564872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354005040 con 0x7f83601003a0 2024-02-20T08:04:03.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f835e59c700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f835400b3b0 tx=0x7f8354009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f835400e040 con 0x7f83601003a0 2024-02-20T08:04:03.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8354009af0 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83600fbf90 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83600fc4d0 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.211+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f835401c7d0 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.212+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c0052e0 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.212+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f835401ca90 con 0x7f83601003a0 2024-02-20T08:04:03.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.213+0000 7f83477fe700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 0x7f834806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.213+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8354088790 con 0x7f83601003a0 2024-02-20T08:04:03.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.213+0000 7f835ed9d700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 0x7f834806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.214+0000 7f835ed9d700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 0x7f834806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8350009fd0 tx=0x7f8350009f60 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.217+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8354058650 con 0x7f83601003a0 2024-02-20T08:04:03.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:03 smithi194 ceph-mon[37804]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.425+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f834c000bf0 con 0x7f83480692a0 2024-02-20T08:04:03.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:03 smithi123 ceph-mon[29383]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.426+0000 7f83477fe700 1 -- 172.21.15.123:0/1028564872 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f834c000bf0 con 0x7f83480692a0 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 msgr2=0x7f834806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 0x7f834806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8350009fd0 tx=0x7f8350009f60 comp rx=0 tx=0).stop 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 msgr2=0x7f83600fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f835400b3b0 tx=0x7f8354009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 shutdown_connections 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f83480692a0 0x7f834806b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83600fda80 0x7f83600fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 --2- 172.21.15.123:0/1028564872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83601003a0 0x7f83600fb990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 >> 172.21.15.123:0/1028564872 conn(0x7f83600f7500 msgr2=0x7f83600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 shutdown_connections 2024-02-20T08:04:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.429+0000 7f836522f700 1 -- 172.21.15.123:0/1028564872 wait complete. 2024-02-20T08:04:03.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 -- 172.21.15.123:0/56439508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec1003a0 msgr2=0x7f1cec102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 --2- 172.21.15.123:0/56439508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec1003a0 0x7f1cec102780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0004940 tx=0x7f1ce0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 -- 172.21.15.123:0/56439508 shutdown_connections 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 --2- 172.21.15.123:0/56439508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec1003a0 0x7f1cec102780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 --2- 172.21.15.123:0/56439508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec0fda80 0x7f1cec0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 -- 172.21.15.123:0/56439508 >> 172.21.15.123:0/56439508 conn(0x7f1cec0f7520 msgr2=0x7f1cec0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.543+0000 7f1cf27c1700 1 -- 172.21.15.123:0/56439508 shutdown_connections 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.544+0000 7f1cf27c1700 1 -- 172.21.15.123:0/56439508 wait complete. 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.544+0000 7f1cf27c1700 1 Processor -- start 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.544+0000 7f1cf27c1700 1 -- start start 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cf27c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cf27c1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec1003a0 0x7f1cec10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cf27c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec10e420 con 0x7f1cec0fda80 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cf27c1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec10ecc0 con 0x7f1cec1003a0 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57588/0 (socket says 172.21.15.123:57588) 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 -- 172.21.15.123:0/2349832101 learned_addr learned my addr 172.21.15.123:0/2349832101 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1ceb7fe700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec1003a0 0x7f1cec10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 -- 172.21.15.123:0/2349832101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec1003a0 msgr2=0x7f1cec10de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec1003a0 0x7f1cec10de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 -- 172.21.15.123:0/2349832101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0005040 con 0x7f1cec0fda80 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.545+0000 7f1cebfff700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc002a80 tx=0x7f1cdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.546+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc007cc0 con 0x7f1cec0fda80 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.546+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cdc00f040 con 0x7f1cec0fda80 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.546+0000 7f1cf27c1700 1 -- 172.21.15.123:0/2349832101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec10efa0 con 0x7f1cec0fda80 2024-02-20T08:04:03.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.546+0000 7f1cf27c1700 1 -- 172.21.15.123:0/2349832101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec10f4e0 con 0x7f1cec0fda80 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.546+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc00dac0 con 0x7f1cec0fda80 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.547+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc0052b0 con 0x7f1cec0fda80 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.548+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1cdc00dc20 con 0x7f1cec0fda80 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.549+0000 7f1ce8ff9700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 0x7f1cd406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.549+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1cdc0874a0 con 0x7f1cec0fda80 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.549+0000 7f1ceb7fe700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 0x7f1cd406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.550+0000 7f1ceb7fe700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 0x7f1cd406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00043d0 tx=0x7f1ce0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.556+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1cdc0571f0 con 0x7f1cec0fda80 2024-02-20T08:04:03.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.754+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ccc000bc0 con 0x7f1cd40692b0 2024-02-20T08:04:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.765+0000 7f1ce8ff9700 1 -- 172.21.15.123:0/2349832101 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1ccc000bc0 con 0x7f1cd40692b0 2024-02-20T08:04:03.765 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:04:03.765 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (5m) 87s ago 7m 25.4M - 0.25.0 c8568f914cd2 a0302c7e0fd3 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (7m) 87s ago 7m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (6m) 92s ago 6m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (5m) 87s ago 7m 83.6M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (111s) 87s ago 110s 10.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (105s) 87s ago 105s 13.3M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (108s) 92s ago 108s 13.5M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (103s) 92s ago 102s 11.1M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (9m) 87s ago 8m 481M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (6m) 92s ago 6m 431M - 17.2.7-521-gc80e7168 10b0c032c913 3a7cc19eb152 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (9m) 87s ago 9m 48.1M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (6m) 92s ago 6m 35.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (7m) 87s ago 7m 15.4M - 1.5.0 0da6a335fe13 c635ab46d42a 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 92s ago 6m 17.0M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:04:03.766 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (5m) 87s ago 5m 46.1M 4288M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (5m) 87s ago 5m 45.9M 4288M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (4m) 87s ago 4m 45.0M 4288M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (4m) 92s ago 4m 46.9M 5312M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (3m) 92s ago 3m 41.3M 5312M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (3m) 92s ago 3m 41.5M 5312M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:04:03.767 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (5m) 87s ago 6m 55.8M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 msgr2=0x7f1cd406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 0x7f1cd406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00043d0 tx=0x7f1ce0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 msgr2=0x7f1cec10d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc002a80 tx=0x7f1cdc0046b0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 shutdown_connections 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f1cd40692b0 0x7f1cd406b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0fda80 0x7f1cec10d8e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 --2- 172.21.15.123:0/2349832101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cec1003a0 0x7f1cec10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 >> 172.21.15.123:0/2349832101 conn(0x7f1cec0f7520 msgr2=0x7f1cec0f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 shutdown_connections 2024-02-20T08:04:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.767+0000 7f1cd27fc700 1 -- 172.21.15.123:0/2349832101 wait complete. 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2618571924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 msgr2=0x7f8acc0ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2618571924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0ffe60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0004940 tx=0x7f8ac0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2618571924 shutdown_connections 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2618571924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2618571924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0ffe60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2618571924 >> 172.21.15.123:0/2618571924 conn(0x7f8acc0f74e0 msgr2=0x7f8acc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2618571924 shutdown_connections 2024-02-20T08:04:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.869+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2618571924 wait complete. 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 Processor -- start 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 -- start start 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1115a0 con 0x7f8acc0fda80 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8ad31b9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc111710 con 0x7f8acc1003a0 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8acbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.870+0000 7f8acbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:48758/0 (socket says 172.21.15.123:48758) 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8acbfff700 1 -- 172.21.15.123:0/2700727395 learned_addr learned my addr 172.21.15.123:0/2700727395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8ad0f55700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8acbfff700 1 -- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 msgr2=0x7f8acc0fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8acbfff700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8acbfff700 1 -- 172.21.15.123:0/2700727395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0005040 con 0x7f8acc1003a0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8acbfff700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800eb40 tx=0x7f8ab800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab8007cc0 con 0x7f8acc1003a0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ab800f040 con 0x7f8acc1003a0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.871+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab800ca10 con 0x7f8acc1003a0 2024-02-20T08:04:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.872+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc0fbf90 con 0x7f8acc1003a0 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.872+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc0fc480 con 0x7f8acc1003a0 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.873+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc107a50 con 0x7f8acc1003a0 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.873+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8ab800cc80 con 0x7f8acc1003a0 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.873+0000 7f8ac97fa700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 0x7f8abc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.874+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ab8086dd0 con 0x7f8acc1003a0 2024-02-20T08:04:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.874+0000 7f8ad0f55700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 0x7f8abc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.874+0000 7f8ad0f55700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 0x7f8abc06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000c00 tx=0x7f8ac0009e30 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:03.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:03.878+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8ab804dbd0 con 0x7f8acc1003a0 2024-02-20T08:04:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.257+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8acc04bed0 con 0x7f8acc1003a0 2024-02-20T08:04:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.258+0000 7f8ac97fa700 1 -- 172.21.15.123:0/2700727395 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f8ab8056b70 con 0x7f8acc1003a0 2024-02-20T08:04:04.258 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:04:04.258 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:04:04.258 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 14 2024-02-20T08:04:04.259 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:04:04.260 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 msgr2=0x7f8abc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 0x7f8abc06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000c00 tx=0x7f8ac0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 msgr2=0x7f8acc0fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800eb40 tx=0x7f8ab800b040 comp rx=0 tx=0).stop 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 shutdown_connections 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7f8abc0692a0 0x7f8abc06b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8acc0fda80 0x7f8acc0fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 --2- 172.21.15.123:0/2700727395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc1003a0 0x7f8acc0fb990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.260+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 >> 172.21.15.123:0/2700727395 conn(0x7f8acc0f74e0 msgr2=0x7f8acc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:04.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.261+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 shutdown_connections 2024-02-20T08:04:04.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.261+0000 7f8ad31b9700 1 -- 172.21.15.123:0/2700727395 wait complete. 2024-02-20T08:04:04.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:04 smithi194 ceph-mon[37804]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:04 smithi194 ceph-mon[37804]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:04 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:04.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:04 smithi194 ceph-mon[37804]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 -- 172.21.15.123:0/2866045291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fcfb0 msgr2=0x7ff1d40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/2866045291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d40fd420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc004940 tx=0x7ff1bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:04.416 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:04 smithi123 ceph-mon[29383]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.416 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:04 smithi123 ceph-mon[29383]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.416 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:04 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:04.416 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:04 smithi123 ceph-mon[29383]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:04.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 -- 172.21.15.123:0/2866045291 shutdown_connections 2024-02-20T08:04:04.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/2866045291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d40fd420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/2866045291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fbe40 0x7ff1d40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.414+0000 7ff1d97d0700 1 -- 172.21.15.123:0/2866045291 >> 172.21.15.123:0/2866045291 conn(0x7ff1d40f7500 msgr2=0x7ff1d40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:04.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.415+0000 7ff1d97d0700 1 -- 172.21.15.123:0/2866045291 shutdown_connections 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.415+0000 7ff1d97d0700 1 -- 172.21.15.123:0/2866045291 wait complete. 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d97d0700 1 Processor -- start 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d97d0700 1 -- start start 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d97d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 0x7ff1d410c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 0x7ff1d410c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 0x7ff1d410c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57610/0 (socket says 172.21.15.123:57610) 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d2ffd700 1 -- 172.21.15.123:0/3240964021 learned_addr learned my addr 172.21.15.123:0/3240964021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.416+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d410cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d410d2e0 con 0x7ff1d40fbe40 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d410db80 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1cbfff700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d410cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1cbfff700 1 -- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 msgr2=0x7ff1d410c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1cbfff700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 0x7ff1d410c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1cbfff700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc005040 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.417+0000 7ff1cbfff700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d410cce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc004940 tx=0x7ff1bc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.418+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1bc00e070 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.418+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1bc013de0 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.418+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1bc00b410 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.418+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d410de00 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.418+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d410e280 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.419+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d404bed0 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.420+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff1bc022030 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.420+0000 7ff1cb7fe700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 0x7ff1c006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.420+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff1bc08a3d0 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.421+0000 7ff1d2ffd700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 0x7ff1c006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.421+0000 7ff1d2ffd700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 0x7ff1c006b820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4008fd0 tx=0x7ff1c400b040 comp rx=0 tx=0).ready entity=mgr.14222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.425+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff1bc05a120 con 0x7ff1d40fcfb0 2024-02-20T08:04:04.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.709+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 --> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1d410e810 con 0x7ff1c0069370 2024-02-20T08:04:04.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.711+0000 7ff1cb7fe700 1 -- 172.21.15.123:0/3240964021 <== mgr.14222 v2:172.21.15.123:6800/946040318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff1d410e810 con 0x7ff1c0069370 2024-02-20T08:04:04.711 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:04:04.711 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:04:04.711 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "0/2 daemons upgraded", 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 image on host smithi194", 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:04:04.712 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:04:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.713+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 msgr2=0x7ff1c006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.713+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 0x7ff1c006b820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4008fd0 tx=0x7ff1c400b040 comp rx=0 tx=0).stop 2024-02-20T08:04:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.713+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 msgr2=0x7ff1d410cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.713+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d410cce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc004940 tx=0x7ff1bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 shutdown_connections 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:6800/946040318,v1:172.21.15.123:6801/946040318] conn(0x7ff1c0069370 0x7ff1c006b820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1d40fbe40 0x7ff1d410c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 --2- 172.21.15.123:0/3240964021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40fcfb0 0x7ff1d410cce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 >> 172.21.15.123:0/3240964021 conn(0x7ff1d40f7500 msgr2=0x7ff1d4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 shutdown_connections 2024-02-20T08:04:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:04.714+0000 7ff1d97d0700 1 -- 172.21.15.123:0/3240964021 wait complete. 2024-02-20T08:04:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:05 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2700727395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:04:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:05 smithi194 ceph-mon[37804]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:05.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:05 smithi194 ceph-mon[37804]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:05.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:05 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2700727395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:04:05.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:05 smithi123 ceph-mon[29383]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:05.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:05 smithi123 ceph-mon[29383]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:07 smithi194 ceph-mon[37804]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:08.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:07 smithi123 ceph-mon[29383]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:09.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:09 smithi194 ceph-mon[37804]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:09 smithi123 ceph-mon[29383]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:11 smithi123 ceph-mon[29383]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:12.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:11 smithi194 ceph-mon[37804]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:13 smithi123 ceph-mon[29383]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:13 smithi194 ceph-mon[37804]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:15 smithi123 ceph-mon[29383]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:04:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:04:16.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:15 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:15 smithi194 ceph-mon[37804]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:04:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:04:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:15 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:16.951 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:16 smithi194 ceph-mon[37804]: Upgrade: Updating mgr.smithi194.pvhorj 2024-02-20T08:04:16.951 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:16 smithi194 ceph-mon[37804]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:04:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:16 smithi123 ceph-mon[29383]: Upgrade: Updating mgr.smithi194.pvhorj 2024-02-20T08:04:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:16 smithi123 ceph-mon[29383]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:04:18.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:17 smithi194 ceph-mon[37804]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:18.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:17 smithi123 ceph-mon[29383]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to '3d72bcfd7affbb4a923c191d212814b4934cfeaa'. 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-02-20T08:04:19.216 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-02-20T08:04:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at 3d72bcfd7af test 2024-02-20T08:04:19.221 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-20T08:04:19.246 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-20T08:04:19.248 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-20T08:04:19.248 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-20T08:04:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:18 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:19.308 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:18 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:20.012 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-20T08:04:20.075 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-20T08:04:20.115 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-20T08:04:20.117 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-20T08:04:20.117 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-20T08:04:20.156 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-20T08:04:20.159 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T08:04:20.159 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-20T08:04:20.194 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:19 smithi194 ceph-mon[37804]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:20.194 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:20.194 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:20.194 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:19 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:20.215 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-20T08:04:20.216 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-20T08:04:20.216 DEBUG:teuthology.orchestra.run.smithi123:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d72bcfd7affbb4a923c191d212814b4934cfeaa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-20T08:04:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:19 smithi123 ceph-mon[29383]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:19 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:20.280 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p fsstress 2024-02-20T08:04:20.282 INFO:tasks.workunit.client.0.smithi123.stderr:+ pushd fsstress 2024-02-20T08:04:20.284 INFO:tasks.workunit.client.0.smithi123.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-20T08:04:20.284 INFO:tasks.workunit.client.0.smithi123.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-20T08:04:22.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:21 smithi194 ceph-mon[37804]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:21 smithi123 ceph-mon[29383]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:23.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:23 smithi194 ceph-mon[37804]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:23.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:23.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:23.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:23.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:23 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:23 smithi123 ceph-mon[29383]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:23 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:24.912 INFO:tasks.workunit.client.0.smithi123.stderr:+ tar xzf ltp-full.tgz 2024-02-20T08:04:26.234 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:25 smithi194 ceph-mon[37804]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:25 smithi123 ceph-mon[29383]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: pgmap v249: 65 pgs: 65 active+clean; 3.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 221 KiB/s wr, 3 op/s 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:04:28.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr fail", "who": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: osdmap e48: 6 total, 6 up, 6 in 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "mgr fail", "who": "smithi123.kwyrtl"}]': finished 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: mgrmap e20: smithi194.pvhorj(active, starting, since 0.00808611s) 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:04:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: Manager daemon smithi194.pvhorj is now available 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:28.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:04:28.262 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:04:28.262 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/trash_purge_schedule"}]: dispatch 2024-02-20T08:04:28.262 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:28 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/trash_purge_schedule"}]: dispatch 2024-02-20T08:04:28.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: pgmap v249: 65 pgs: 65 active+clean; 3.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 221 KiB/s wr, 3 op/s 2024-02-20T08:04:28.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr fail", "who": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: osdmap e48: 6 total, 6 up, 6 in 2024-02-20T08:04:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.14222 172.21.15.123:0/2235419372' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "mgr fail", "who": "smithi123.kwyrtl"}]': finished 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: mgrmap e20: smithi194.pvhorj(active, starting, since 0.00808611s) 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:04:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: Manager daemon smithi194.pvhorj is now available 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/trash_purge_schedule"}]: dispatch 2024-02-20T08:04:28.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:28 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.pvhorj/trash_purge_schedule"}]: dispatch 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: Deploying cephadm binary to smithi194 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: Deploying cephadm binary to smithi123 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: mgrmap e21: smithi194.pvhorj(active, since 1.00843s) 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: pgmap v3: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:29.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:29 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: Deploying cephadm binary to smithi194 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: Deploying cephadm binary to smithi123 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: mgrmap e21: smithi194.pvhorj(active, since 1.00843s) 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: pgmap v3: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:29 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:30.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:30 smithi123 ceph-mon[29383]: pgmap v4: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:30.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:30 smithi123 ceph-mon[29383]: [20/Feb/2024:08:04:29] ENGINE Bus STARTING 2024-02-20T08:04:30.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:30 smithi123 ceph-mon[29383]: [20/Feb/2024:08:04:29] ENGINE Serving on http://172.21.15.194:8765 2024-02-20T08:04:30.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:30 smithi123 ceph-mon[29383]: mgrmap e22: smithi194.pvhorj(active, since 2s) 2024-02-20T08:04:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:30 smithi194 ceph-mon[37804]: pgmap v4: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:30 smithi194 ceph-mon[37804]: [20/Feb/2024:08:04:29] ENGINE Bus STARTING 2024-02-20T08:04:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:30 smithi194 ceph-mon[37804]: [20/Feb/2024:08:04:29] ENGINE Serving on http://172.21.15.194:8765 2024-02-20T08:04:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:30 smithi194 ceph-mon[37804]: mgrmap e22: smithi194.pvhorj(active, since 2s) 2024-02-20T08:04:31.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:31 smithi123 ceph-mon[29383]: [20/Feb/2024:08:04:29] ENGINE Serving on https://172.21.15.194:7150 2024-02-20T08:04:31.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:31 smithi123 ceph-mon[29383]: [20/Feb/2024:08:04:29] ENGINE Bus STARTED 2024-02-20T08:04:31.538 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:31 smithi194 ceph-mon[37804]: [20/Feb/2024:08:04:29] ENGINE Serving on https://172.21.15.194:7150 2024-02-20T08:04:31.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:31 smithi194 ceph-mon[37804]: [20/Feb/2024:08:04:29] ENGINE Bus STARTED 2024-02-20T08:04:32.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:32 smithi123 ceph-mon[29383]: pgmap v5: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:32.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:32 smithi123 ceph-mon[29383]: mgrmap e23: smithi194.pvhorj(active, since 4s) 2024-02-20T08:04:32.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:32 smithi194 ceph-mon[37804]: pgmap v5: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:32.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:32 smithi194 ceph-mon[37804]: mgrmap e23: smithi194.pvhorj(active, since 4s) 2024-02-20T08:04:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:34 smithi194 ceph-mon[37804]: pgmap v6: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:34.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:34 smithi123 ceph-mon[29383]: pgmap v6: 65 pgs: 65 active+clean; 15 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 -- 172.21.15.123:0/1562617109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 msgr2=0x7f23e00fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 --2- 172.21.15.123:0/1562617109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e00fbc80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23d0004940 tx=0x7f23d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 -- 172.21.15.123:0/1562617109 shutdown_connections 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 --2- 172.21.15.123:0/1562617109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 0x7f23e00fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 --2- 172.21.15.123:0/1562617109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e00fbc80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 -- 172.21.15.123:0/1562617109 >> 172.21.15.123:0/1562617109 conn(0x7f23e00f74e0 msgr2=0x7f23e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 -- 172.21.15.123:0/1562617109 shutdown_connections 2024-02-20T08:04:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.839+0000 7f23e661d700 1 -- 172.21.15.123:0/1562617109 wait complete. 2024-02-20T08:04:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.840+0000 7f23e661d700 1 Processor -- start 2024-02-20T08:04:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.840+0000 7f23e661d700 1 -- start start 2024-02-20T08:04:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.840+0000 7f23e661d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.840+0000 7f23e661d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 0x7f23e010fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.840+0000 7f23e661d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e01105f0 con 0x7f23e00fb870 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23e661d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0110e90 con 0x7f23e00fc1c0 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58882/0 (socket says 172.21.15.123:58882) 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 -- 172.21.15.123:0/4224633203 learned_addr learned my addr 172.21.15.123:0/4224633203 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23df7fe700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 0x7f23e010fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 -- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 msgr2=0x7f23e010fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 0x7f23e010fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 -- 172.21.15.123:0/4224633203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0005040 con 0x7f23e00fb870 2024-02-20T08:04:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dffff700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23d0000c00 tx=0x7f23d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:34.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.841+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d0021070 con 0x7f23e00fb870 2024-02-20T08:04:34.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.842+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23d001c400 con 0x7f23e00fb870 2024-02-20T08:04:34.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.842+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e0111110 con 0x7f23e00fb870 2024-02-20T08:04:34.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.842+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d0021070 con 0x7f23e00fb870 2024-02-20T08:04:34.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.842+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e01115f0 con 0x7f23e00fb870 2024-02-20T08:04:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.843+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e004bed0 con 0x7f23e00fb870 2024-02-20T08:04:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.843+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 23) v1 ==== 45934+0+0 (secure 0 0 0) 0x7f23d001ca70 con 0x7f23e00fb870 2024-02-20T08:04:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.844+0000 7f23dcff9700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 0x7f23c803afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.844+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f23d004d5f0 con 0x7f23e00fb870 2024-02-20T08:04:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.844+0000 7f23df7fe700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 0x7f23c803afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.845+0000 7f23df7fe700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 0x7f23c803afd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009b80 tx=0x7f23d400b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:34.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:34.850+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f23d0013af0 con 0x7f23e00fb870 2024-02-20T08:04:35.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.125+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23e0111d20 con 0x7f23c8038b20 2024-02-20T08:04:35.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.127+0000 7f23dcff9700 1 -- 172.21.15.123:0/4224633203 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f23d400f040 con 0x7f23c8038b20 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 msgr2=0x7f23c803afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 0x7f23c803afd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009b80 tx=0x7f23d400b040 comp rx=0 tx=0).stop 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 msgr2=0x7f23e010fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23d0000c00 tx=0x7f23d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 shutdown_connections 2024-02-20T08:04:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f23c8038b20 0x7f23c803afd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23e00fb870 0x7f23e010fab0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 --2- 172.21.15.123:0/4224633203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e00fc1c0 0x7f23e010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 >> 172.21.15.123:0/4224633203 conn(0x7f23e00f74e0 msgr2=0x7f23e0103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 shutdown_connections 2024-02-20T08:04:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.129+0000 7f23e661d700 1 -- 172.21.15.123:0/4224633203 wait complete. 2024-02-20T08:04:35.141 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 -- 172.21.15.123:0/1742336332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fcfc0 msgr2=0x7fb1540fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 --2- 172.21.15.123:0/1742336332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fcfc0 0x7fb1540fd430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb148004940 tx=0x7fb148009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 -- 172.21.15.123:0/1742336332 shutdown_connections 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 --2- 172.21.15.123:0/1742336332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fcfc0 0x7fb1540fd430 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb148004940 tx=0x7fb148009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 --2- 172.21.15.123:0/1742336332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fbe50 0x7fb1540fc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 -- 172.21.15.123:0/1742336332 >> 172.21.15.123:0/1742336332 conn(0x7fb1540f7510 msgr2=0x7fb1540f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 -- 172.21.15.123:0/1742336332 shutdown_connections 2024-02-20T08:04:35.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.268+0000 7fb159faa700 1 -- 172.21.15.123:0/1742336332 wait complete. 2024-02-20T08:04:35.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 Processor -- start 2024-02-20T08:04:35.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 -- start start 2024-02-20T08:04:35.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 0x7fb1540fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 0x7fb1540fe800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540fee20 con 0x7fb1540fbe50 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb159faa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540fef60 con 0x7fb1540fe390 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.269+0000 7fb1537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 0x7fb1540fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb1537fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 0x7fb1540fff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58902/0 (socket says 172.21.15.123:58902) 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb1537fe700 1 -- 172.21.15.123:0/3108669325 learned_addr learned my addr 172.21.15.123:0/3108669325 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb152ffd700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 0x7fb1540fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb152ffd700 1 -- 172.21.15.123:0/3108669325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 msgr2=0x7fb1540fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb152ffd700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 0x7fb1540fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb152ffd700 1 -- 172.21.15.123:0/3108669325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148005040 con 0x7fb1540fe390 2024-02-20T08:04:35.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb152ffd700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 0x7fb1540fe800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb148008000 tx=0x7fb148009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:35.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14800e070 con 0x7fb1540fe390 2024-02-20T08:04:35.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb14800bbf0 con 0x7fb1540fe390 2024-02-20T08:04:35.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14801c400 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1540ff1e0 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.270+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb154115e30 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.272+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 23) v1 ==== 45934+0+0 (secure 0 0 0) 0x7fb14801c560 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.272+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1400052e0 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.272+0000 7fb13bfff700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 0x7fb13c03af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.272+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb14804ef40 con 0x7fb1540fe390 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.272+0000 7fb1537fe700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 0x7fb13c03af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.273+0000 7fb1537fe700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 0x7fb13c03af70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1540ffca0 tx=0x7fb144008040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:35.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.281+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb148025400 con 0x7fb1540fe390 2024-02-20T08:04:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.570+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb140000bf0 con 0x7fb13c038ac0 2024-02-20T08:04:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.572+0000 7fb13bfff700 1 -- 172.21.15.123:0/3108669325 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb140000bf0 con 0x7fb13c038ac0 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 msgr2=0x7fb13c03af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 0x7fb13c03af70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1540ffca0 tx=0x7fb144008040 comp rx=0 tx=0).stop 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 msgr2=0x7fb1540fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 0x7fb1540fe800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb148008000 tx=0x7fb148009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 shutdown_connections 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb13c038ac0 0x7fb13c03af70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1540fbe50 0x7fb1540fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 --2- 172.21.15.123:0/3108669325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1540fe390 0x7fb1540fe800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.575+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 >> 172.21.15.123:0/3108669325 conn(0x7fb1540f7510 msgr2=0x7fb154065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:35.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.576+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 shutdown_connections 2024-02-20T08:04:35.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.576+0000 7fb159faa700 1 -- 172.21.15.123:0/3108669325 wait complete. 2024-02-20T08:04:35.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- 172.21.15.123:0/2738350715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fd460 msgr2=0x7f1d540fd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 --2- 172.21.15.123:0/2738350715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fd460 0x7f1d540fd870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1d44004940 tx=0x7f1d44009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- 172.21.15.123:0/2738350715 shutdown_connections 2024-02-20T08:04:35.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 --2- 172.21.15.123:0/2738350715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fc1c0 0x7f1d540fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 --2- 172.21.15.123:0/2738350715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fd460 0x7f1d540fd870 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- 172.21.15.123:0/2738350715 >> 172.21.15.123:0/2738350715 conn(0x7f1d540f6ca0 msgr2=0x7f1d540f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- 172.21.15.123:0/2738350715 shutdown_connections 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- 172.21.15.123:0/2738350715 wait complete. 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 Processor -- start 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.694+0000 7f1d596cf700 1 -- start start 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d596cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d596cf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fd460 0x7f1d540fe510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d596cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540feb10 con 0x7f1d540fc1c0 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d596cf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540fec80 con 0x7f1d540fd460 2024-02-20T08:04:35.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58922/0 (socket says 172.21.15.123:58922) 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 -- 172.21.15.123:0/3821155019 learned_addr learned my addr 172.21.15.123:0/3821155019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d527fc700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fd460 0x7f1d540fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 -- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fd460 msgr2=0x7f1d540fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fd460 0x7f1d540fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 -- 172.21.15.123:0/3821155019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44005040 con 0x7f1d540fc1c0 2024-02-20T08:04:35.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d52ffd700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b3b0 tx=0x7f1d44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4400e040 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.695+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d44004290 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.696+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4401c3f0 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.696+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540fef00 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.696+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d54115ac0 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 23) v1 ==== 45934+0+0 (secure 0 0 0) 0x7f1d44013420 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d3b7fe700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 0x7f1d3c03af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1d4404d800 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5404bed0 con 0x7f1d540fc1c0 2024-02-20T08:04:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d527fc700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 0x7f1d3c03af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:35.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.697+0000 7f1d527fc700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 0x7f1d3c03af10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d48004f40 tx=0x7f1d4800b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:35.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.702+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1d44013770 con 0x7f1d540fc1c0 2024-02-20T08:04:35.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.914+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f1d44025400 con 0x7f1d540fc1c0 2024-02-20T08:04:35.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.946+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d540fb7c0 con 0x7f1d3c038a60 2024-02-20T08:04:35.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.964+0000 7f1d3b7fe700 1 -- 172.21.15.123:0/3821155019 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1d540fb7c0 con 0x7f1d3c038a60 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (6m) 119s ago 8m 25.4M - 0.25.0 c8568f914cd2 a0302c7e0fd3 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (8m) 119s ago 8m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (7m) 13s ago 7m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (6m) 119s ago 7m 83.6M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (2m) 119s ago 2m 10.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:04:35.965 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (2m) 119s ago 2m 13.3M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (2m) 13s ago 2m 14.0M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (2m) 13s ago 2m 11.7M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (9m) 119s ago 9m 481M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (17s) 13s ago 6m 51.9M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 915e6082ff57 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (9m) 119s ago 9m 48.1M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (6m) 13s ago 6m 37.9M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:04:35.966 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (8m) 119s ago 8m 15.4M - 1.5.0 0da6a335fe13 c635ab46d42a 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 13s ago 6m 17.0M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (6m) 119s ago 6m 46.1M 4288M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (5m) 119s ago 5m 45.9M 4288M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (5m) 119s ago 5m 45.0M 4288M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (4m) 13s ago 4m 47.9M 5312M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (4m) 13s ago 4m 42.7M 5312M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:04:35.967 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (3m) 13s ago 3m 43.0M 5312M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:04:35.968 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (6m) 119s ago 7m 55.8M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 msgr2=0x7f1d3c03af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 0x7f1d3c03af10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d48004f40 tx=0x7f1d4800b040 comp rx=0 tx=0).stop 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 msgr2=0x7f1d54100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b3b0 tx=0x7f1d44009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 shutdown_connections 2024-02-20T08:04:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f1d3c038a60 0x7f1d3c03af10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d540fc1c0 0x7f1d54100090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 --2- 172.21.15.123:0/3821155019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d540fd460 0x7f1d540fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:35.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 >> 172.21.15.123:0/3821155019 conn(0x7f1d540f6ca0 msgr2=0x7f1d540fb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:35.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.966+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 shutdown_connections 2024-02-20T08:04:35.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:35.967+0000 7f1d596cf700 1 -- 172.21.15.123:0/3821155019 wait complete. 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 -- 172.21.15.123:0/3747212485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fcfb0 msgr2=0x7f159c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 --2- 172.21.15.123:0/3747212485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fcfb0 0x7f159c0fd420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1590004940 tx=0x7f1590009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 -- 172.21.15.123:0/3747212485 shutdown_connections 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 --2- 172.21.15.123:0/3747212485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fcfb0 0x7f159c0fd420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 --2- 172.21.15.123:0/3747212485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fbe40 0x7f159c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 -- 172.21.15.123:0/3747212485 >> 172.21.15.123:0/3747212485 conn(0x7f159c0f7500 msgr2=0x7f159c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:36.081 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: pgmap v7: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: Standby manager daemon smithi123.kwyrtl started 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/crt"}]: dispatch 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/key"}]: dispatch 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:04:36.082 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:35 smithi123 ceph-mon[29383]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 -- 172.21.15.123:0/3747212485 shutdown_connections 2024-02-20T08:04:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.080+0000 7f15a0baf700 1 -- 172.21.15.123:0/3747212485 wait complete. 2024-02-20T08:04:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 Processor -- start 2024-02-20T08:04:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 -- start start 2024-02-20T08:04:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fcfb0 0x7f159c112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c066d10 con 0x7f159c0fbe40 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f15a0baf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c066e50 con 0x7f159c0fcfb0 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58948/0 (socket says 172.21.15.123:58948) 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 -- 172.21.15.123:0/1037667542 learned_addr learned my addr 172.21.15.123:0/1037667542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f1599d9b700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fcfb0 0x7f159c112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 -- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fcfb0 msgr2=0x7f159c112af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fcfb0 0x7f159c112af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.081+0000 7f159a59c700 1 -- 172.21.15.123:0/1037667542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590005040 con 0x7f159c0fbe40 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f159a59c700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f158c00eb40 tx=0x7f158c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c007cc0 con 0x7f159c0fbe40 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c1130f0 con 0x7f159c0fbe40 2024-02-20T08:04:36.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f158c00f040 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c00ca10 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.082+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c1135e0 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.083+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c04bed0 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.083+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f158c00cc80 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.084+0000 7f158affd700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 0x7f158406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.084+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f158c089a00 con 0x7f159c0fbe40 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.084+0000 7f1599d9b700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 0x7f158406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.085+0000 7f1599d9b700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 0x7f158406d790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1590009b30 tx=0x7f1590009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:36.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.090+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f158c04f620 con 0x7f159c0fbe40 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: pgmap v7: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: Standby manager daemon smithi123.kwyrtl started 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/crt"}]: dispatch 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:04:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/key"}]: dispatch 2024-02-20T08:04:36.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/10762064' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:04:36.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:35 smithi194 ceph-mon[37804]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:36.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.460+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f159c113800 con 0x7f159c0fbe40 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.461+0000 7f158affd700 1 -- 172.21.15.123:0/1037667542 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f159c113800 con 0x7f159c0fbe40 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:36.461 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 13, 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:04:36.462 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:04:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 msgr2=0x7f158406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 0x7f158406d790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1590009b30 tx=0x7f1590009e30 comp rx=0 tx=0).stop 2024-02-20T08:04:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 msgr2=0x7f159c1105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f158c00eb40 tx=0x7f158c00b040 comp rx=0 tx=0).stop 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 shutdown_connections 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f158406b2e0 0x7f158406d790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f159c0fbe40 0x7f159c1105a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 --2- 172.21.15.123:0/1037667542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c0fcfb0 0x7f159c112af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 >> 172.21.15.123:0/1037667542 conn(0x7f159c0f7500 msgr2=0x7f159c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 shutdown_connections 2024-02-20T08:04:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.463+0000 7f15a0baf700 1 -- 172.21.15.123:0/1037667542 wait complete. 2024-02-20T08:04:36.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- 172.21.15.123:0/1118622317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 msgr2=0x7f2cf00fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/1118622317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf00fe9b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009ce0 tx=0x7f2ce8004d10 comp rx=0 tx=0).stop 2024-02-20T08:04:36.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- 172.21.15.123:0/1118622317 shutdown_connections 2024-02-20T08:04:36.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/1118622317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf00fef80 0x7f2cf00fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/1118622317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf00fe9b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- 172.21.15.123:0/1118622317 >> 172.21.15.123:0/1118622317 conn(0x7f2cf00f6ca0 msgr2=0x7f2cf00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:36.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- 172.21.15.123:0/1118622317 shutdown_connections 2024-02-20T08:04:36.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- 172.21.15.123:0/1118622317 wait complete. 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 Processor -- start 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.595+0000 7f2cf56cb700 1 -- start start 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cf56cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cf56cb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf010e0f0 0x7f2cf010ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cf56cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf010e5b0 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cf56cb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf010e6f0 con 0x7f2cf010e0f0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58978/0 (socket says 172.21.15.123:58978) 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 -- 172.21.15.123:0/4165433348 learned_addr learned my addr 172.21.15.123:0/4165433348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cee7fc700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf010e0f0 0x7f2cf010ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 -- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf010e0f0 msgr2=0x7f2cf010ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf010e0f0 0x7f2cf010ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 -- 172.21.15.123:0/4165433348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009940 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2ceeffd700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800bea0 tx=0x7f2ce8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.596+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce800e040 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.597+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf010f590 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.597+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ce8008e20 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.597+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf010faa0 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.597+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce801c600 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.597+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc0052e0 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.598+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f2ce8012410 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.598+0000 7f2cd77fe700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 0x7f2cd806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:04:36.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.599+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2ce808b9f0 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.599+0000 7f2cee7fc700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 0x7f2cd806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:04:36.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.599+0000 7f2cee7fc700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 0x7f2cd806d7e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00655f0 tx=0x7f2ce400b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:04:36.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.607+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2ce8059430 con 0x7f2cf00fe5a0 2024-02-20T08:04:36.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.852+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cdc000bf0 con 0x7f2cd806b330 2024-02-20T08:04:36.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.854+0000 7f2cd77fe700 1 -- 172.21.15.123:0/4165433348 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2cdc000bf0 con 0x7f2cd806b330 2024-02-20T08:04:36.854 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "1/2 daemons upgraded", 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:04:36.855 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 msgr2=0x7f2cd806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 0x7f2cd806d7e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00655f0 tx=0x7f2ce400b040 comp rx=0 tx=0).stop 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 msgr2=0x7f2cf010dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800bea0 tx=0x7f2ce8004d10 comp rx=0 tx=0).stop 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 shutdown_connections 2024-02-20T08:04:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f2cd806b330 0x7f2cd806d7e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cf00fe5a0 0x7f2cf010dbb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 --2- 172.21.15.123:0/4165433348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf010e0f0 0x7f2cf010ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:04:36.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 >> 172.21.15.123:0/4165433348 conn(0x7f2cf00f6ca0 msgr2=0x7f2cf00f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:04:36.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 shutdown_connections 2024-02-20T08:04:36.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:04:36.856+0000 7f2cf56cb700 1 -- 172.21.15.123:0/4165433348 wait complete. 2024-02-20T08:04:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: mgrmap e24: smithi194.pvhorj(active, since 8s), standbys: smithi123.kwyrtl 2024-02-20T08:04:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:04:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:36 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1037667542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:04:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: mgrmap e24: smithi194.pvhorj(active, since 8s), standbys: smithi123.kwyrtl 2024-02-20T08:04:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:04:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:37.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:36 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1037667542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:04:38.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:37 smithi123 ceph-mon[29383]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:37 smithi123 ceph-mon[29383]: pgmap v8: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-02-20T08:04:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:37 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:38.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:37 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:37 smithi194 ceph-mon[37804]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:04:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:37 smithi194 ceph-mon[37804]: pgmap v8: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2024-02-20T08:04:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:37 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:37 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:40 smithi194 ceph-mon[37804]: pgmap v9: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2024-02-20T08:04:40.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:40 smithi123 ceph-mon[29383]: pgmap v9: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2024-02-20T08:04:42.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:42 smithi123 ceph-mon[29383]: pgmap v10: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-20T08:04:42.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:42 smithi194 ceph-mon[37804]: pgmap v10: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-20T08:04:43.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:43 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:43 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:44.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:44 smithi194 ceph-mon[37804]: pgmap v11: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-20T08:04:44.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:44 smithi123 ceph-mon[29383]: pgmap v11: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-20T08:04:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:46 smithi194 ceph-mon[37804]: pgmap v12: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2024-02-20T08:04:46.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:46 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:46.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:46 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:46 smithi123 ceph-mon[29383]: pgmap v12: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2024-02-20T08:04:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:46 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:46 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi123 to 1557M 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:47 smithi194 ceph-mon[37804]: pgmap v13: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 103 op/s 2024-02-20T08:04:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi123 to 1557M 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:48.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:47 smithi123 ceph-mon[29383]: pgmap v13: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 103 op/s 2024-02-20T08:04:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: Adjusting osd_memory_target on smithi194 to 2581M 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:04:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:49 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:04:49.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: Adjusting osd_memory_target on smithi194 to 2581M 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:04:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:49 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:04:50.494 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:04:50.494 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: pgmap v14: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 156 op/s 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Reconfiguring node-exporter.smithi123 (dependencies changed)... 2024-02-20T08:04:50.495 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:50 smithi123 ceph-mon[29383]: Reconfiguring daemon node-exporter.smithi123 on smithi123 2024-02-20T08:04:50.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: pgmap v14: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 156 op/s 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Reconfiguring node-exporter.smithi123 (dependencies changed)... 2024-02-20T08:04:50.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:50 smithi194 ceph-mon[37804]: Reconfiguring daemon node-exporter.smithi123 on smithi123 2024-02-20T08:04:52.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:52 smithi194 ceph-mon[37804]: pgmap v15: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 95 op/s 2024-02-20T08:04:52.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:52 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:52.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:52 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:52 smithi123 ceph-mon[29383]: pgmap v15: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 95 op/s 2024-02-20T08:04:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:52 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:52 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:04:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:53 smithi123 ceph-mon[29383]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-02-20T08:04:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:53 smithi123 ceph-mon[29383]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-02-20T08:04:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:53 smithi194 ceph-mon[37804]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-02-20T08:04:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:53 smithi194 ceph-mon[37804]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-02-20T08:04:54.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:54 smithi194 ceph-mon[37804]: pgmap v16: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 95 op/s 2024-02-20T08:04:54.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:54 smithi123 ceph-mon[29383]: pgmap v16: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 95 op/s 2024-02-20T08:04:56.207 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:55 smithi123 ceph-mon[29383]: pgmap v17: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 173 op/s 2024-02-20T08:04:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:55 smithi194 ceph-mon[37804]: pgmap v17: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 173 op/s 2024-02-20T08:04:58.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:58 smithi194 ceph-mon[37804]: pgmap v18: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 131 op/s 2024-02-20T08:04:58.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:04:58 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:04:58.692 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:58 smithi123 ceph-mon[29383]: pgmap v18: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 131 op/s 2024-02-20T08:04:58.692 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:04:58 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:00.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:00 smithi194 ceph-mon[37804]: pgmap v19: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 266 op/s 2024-02-20T08:05:00.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:00 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:00.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:00 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:00.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:00 smithi194 ceph-mon[37804]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-02-20T08:05:00.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:00 smithi194 ceph-mon[37804]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-02-20T08:05:01.006 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:00 smithi123 ceph-mon[29383]: pgmap v19: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 266 op/s 2024-02-20T08:05:01.006 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:00 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:01.006 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:00 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:01.006 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:00 smithi123 ceph-mon[29383]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-02-20T08:05:01.006 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:00 smithi123 ceph-mon[29383]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-02-20T08:05:01.843 INFO:tasks.workunit.client.1.smithi194.stderr:Note: switching to '3d72bcfd7affbb4a923c191d212814b4934cfeaa'. 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:state without impacting any branches by switching back to a branch. 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: git switch -c 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr:Or undo this operation with: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: git switch - 2024-02-20T08:05:01.844 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.845 INFO:tasks.workunit.client.1.smithi194.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-20T08:05:01.845 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-02-20T08:05:01.845 INFO:tasks.workunit.client.1.smithi194.stderr:HEAD is now at 3d72bcfd7af test 2024-02-20T08:05:01.848 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-20T08:05:01.911 INFO:tasks.workunit.client.1.smithi194.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-20T08:05:01.913 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-20T08:05:01.913 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-20T08:05:02.017 INFO:tasks.workunit.client.0.smithi123.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-20T08:05:02.021 INFO:tasks.workunit.client.0.smithi123.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-20T08:05:02.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ make 2024-02-20T08:05:02.336 INFO:tasks.workunit.client.0.smithi123.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-20T08:05:02.709 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-20T08:05:02.743 INFO:tasks.workunit.client.0.smithi123.stderr:++ readlink -f fsstress 2024-02-20T08:05:02.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-20T08:05:02.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ popd 2024-02-20T08:05:02.745 INFO:tasks.workunit.client.0.smithi123.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-20T08:05:02.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ popd 2024-02-20T08:05:02.746 INFO:tasks.workunit.client.0.smithi123.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-20T08:05:02.746 INFO:tasks.workunit.client.0.smithi123.stderr:++ mktemp -d -p . 2024-02-20T08:05:02.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ T=./tmp.VtSYbyQ1AP 2024-02-20T08:05:02.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.VtSYbyQ1AP -l 1 -n 1000 -p 10 -v 2024-02-20T08:05:02.752 INFO:tasks.workunit.client.0.smithi123.stdout:seed = 1709121625 2024-02-20T08:05:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:0/0: dwrite - no filename 2024-02-20T08:05:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:0/1: fdatasync - no filename 2024-02-20T08:05:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:0/2: rmdir - no directory 2024-02-20T08:05:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:0/3: readlink - no filename 2024-02-20T08:05:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:0/4: dread - no filename 2024-02-20T08:05:02.756 INFO:tasks.workunit.client.0.smithi123.stdout:1/0: truncate - no filename 2024-02-20T08:05:02.756 INFO:tasks.workunit.client.0.smithi123.stdout:1/1: write - no filename 2024-02-20T08:05:02.756 INFO:tasks.workunit.client.0.smithi123.stdout:1/2: readlink - no filename 2024-02-20T08:05:02.757 INFO:tasks.workunit.client.0.smithi123.stdout:0/5: symlink l0 0 2024-02-20T08:05:02.757 INFO:tasks.workunit.client.0.smithi123.stdout:0/6: write - no filename 2024-02-20T08:05:02.757 INFO:tasks.workunit.client.0.smithi123.stdout:0/7: dread - no filename 2024-02-20T08:05:02.758 INFO:tasks.workunit.client.0.smithi123.stdout:2/0: unlink - no file 2024-02-20T08:05:02.759 INFO:tasks.workunit.client.0.smithi123.stdout:0/8: creat f1 x:0 0 0 2024-02-20T08:05:02.759 INFO:tasks.workunit.client.0.smithi123.stdout:0/9: rmdir - no directory 2024-02-20T08:05:02.760 INFO:tasks.workunit.client.0.smithi123.stdout:1/3: mknod c0 0 2024-02-20T08:05:02.760 INFO:tasks.workunit.client.0.smithi123.stdout:1/4: readlink - no filename 2024-02-20T08:05:02.761 INFO:tasks.workunit.client.0.smithi123.stdout:3/0: chown . 0 1 2024-02-20T08:05:02.762 INFO:tasks.workunit.client.0.smithi123.stdout:0/10: mkdir d2 0 2024-02-20T08:05:02.762 INFO:tasks.workunit.client.0.smithi123.stdout:0/11: chown d2 75842308 1 2024-02-20T08:05:02.762 INFO:tasks.workunit.client.0.smithi123.stdout:1/5: symlink l1 0 2024-02-20T08:05:02.763 INFO:tasks.workunit.client.0.smithi123.stdout:1/6: fdatasync - no filename 2024-02-20T08:05:02.763 INFO:tasks.workunit.client.0.smithi123.stdout:0/12: stat d2 0 2024-02-20T08:05:02.763 INFO:tasks.workunit.client.0.smithi123.stdout:2/1: mknod c0 0 2024-02-20T08:05:02.763 INFO:tasks.workunit.client.0.smithi123.stdout:2/2: dwrite - no filename 2024-02-20T08:05:02.765 INFO:tasks.workunit.client.0.smithi123.stdout:1/7: mknod c2 0 2024-02-20T08:05:02.765 INFO:tasks.workunit.client.0.smithi123.stdout:1/8: dwrite - no filename 2024-02-20T08:05:02.766 INFO:tasks.workunit.client.0.smithi123.stdout:3/1: mkdir d0 0 2024-02-20T08:05:02.766 INFO:tasks.workunit.client.0.smithi123.stdout:3/2: write - no filename 2024-02-20T08:05:02.766 INFO:tasks.workunit.client.0.smithi123.stdout:3/3: rename d0 to d0/d1 22 2024-02-20T08:05:02.766 INFO:tasks.workunit.client.0.smithi123.stdout:3/4: readlink - no filename 2024-02-20T08:05:02.767 INFO:tasks.workunit.client.0.smithi123.stdout:5/0: rmdir - no directory 2024-02-20T08:05:02.767 INFO:tasks.workunit.client.0.smithi123.stdout:5/1: dwrite - no filename 2024-02-20T08:05:02.767 INFO:tasks.workunit.client.0.smithi123.stdout:0/13: mkdir d2/d3 0 2024-02-20T08:05:02.768 INFO:tasks.workunit.client.0.smithi123.stdout:0/14: dread - f1 zero size 2024-02-20T08:05:02.768 INFO:tasks.workunit.client.0.smithi123.stdout:1/9: mkdir d3 0 2024-02-20T08:05:02.768 INFO:tasks.workunit.client.0.smithi123.stdout:1/10: dwrite - no filename 2024-02-20T08:05:02.768 INFO:tasks.workunit.client.0.smithi123.stdout:1/11: truncate - no filename 2024-02-20T08:05:02.769 INFO:tasks.workunit.client.0.smithi123.stdout:4/0: mknod c0 0 2024-02-20T08:05:02.769 INFO:tasks.workunit.client.0.smithi123.stdout:4/1: truncate - no filename 2024-02-20T08:05:02.770 INFO:tasks.workunit.client.0.smithi123.stdout:6/0: stat - no entries 2024-02-20T08:05:02.772 INFO:tasks.workunit.client.0.smithi123.stdout:4/2: rename c0 to c1 0 2024-02-20T08:05:02.772 INFO:tasks.workunit.client.0.smithi123.stdout:4/3: dread - no filename 2024-02-20T08:05:02.772 INFO:tasks.workunit.client.0.smithi123.stdout:5/2: mkdir d0 0 2024-02-20T08:05:02.772 INFO:tasks.workunit.client.0.smithi123.stdout:5/3: unlink - no file 2024-02-20T08:05:02.772 INFO:tasks.workunit.client.0.smithi123.stdout:5/4: dwrite - no filename 2024-02-20T08:05:02.773 INFO:tasks.workunit.client.0.smithi123.stdout:5/5: rename d0 to d0/d1 22 2024-02-20T08:05:02.773 INFO:tasks.workunit.client.0.smithi123.stdout:0/15: creat d2/d3/f4 x:0 0 0 2024-02-20T08:05:02.773 INFO:tasks.workunit.client.0.smithi123.stdout:5/6: chown d0 0 1 2024-02-20T08:05:02.774 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-20T08:05:02.774 INFO:tasks.workunit.client.0.smithi123.stdout:1/12: mknod d3/c4 0 2024-02-20T08:05:02.774 INFO:tasks.workunit.client.0.smithi123.stdout:1/13: dwrite - no filename 2024-02-20T08:05:02.775 INFO:tasks.workunit.client.0.smithi123.stdout:0/16: truncate d2/d3/f4 816506 0 2024-02-20T08:05:02.775 INFO:tasks.workunit.client.0.smithi123.stdout:7/0: dread - no filename 2024-02-20T08:05:02.776 INFO:tasks.workunit.client.0.smithi123.stdout:6/1: mkdir d0 0 2024-02-20T08:05:02.776 INFO:tasks.workunit.client.0.smithi123.stdout:6/2: readlink - no filename 2024-02-20T08:05:02.776 INFO:tasks.workunit.client.0.smithi123.stdout:0/17: write f1 [124453,125537] 0 2024-02-20T08:05:02.777 INFO:tasks.workunit.client.0.smithi123.stdout:1/14: creat d3/f5 x:0 0 0 2024-02-20T08:05:02.778 INFO:tasks.workunit.client.0.smithi123.stdout:1/15: rename d3 to d3/d6 22 2024-02-20T08:05:02.780 INFO:tasks.workunit.client.0.smithi123.stdout:5/7: symlink d0/l2 0 2024-02-20T08:05:02.782 INFO:tasks.workunit.client.0.smithi123.stdout:7/1: getdents . 0 2024-02-20T08:05:02.782 INFO:tasks.workunit.client.0.smithi123.stdout:7/2: readlink - no filename 2024-02-20T08:05:02.784 INFO:tasks.workunit.client.0.smithi123.stdout:1/16: unlink d3/c4 0 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:0/18: dwrite f1 [0,4194304] 0 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/0: link - no file 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/1: write - no filename 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/2: truncate - no filename 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/3: dwrite - no filename 2024-02-20T08:05:02.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/4: dwrite - no filename 2024-02-20T08:05:02.788 INFO:tasks.workunit.client.0.smithi123.stdout:6/3: mkdir d0/d1 0 2024-02-20T08:05:02.789 INFO:tasks.workunit.client.0.smithi123.stdout:1/17: symlink d3/l7 0 2024-02-20T08:05:02.789 INFO:tasks.workunit.client.0.smithi123.stdout:6/4: chown d0 247748115 1 2024-02-20T08:05:02.789 INFO:tasks.workunit.client.0.smithi123.stdout:8/0: creat f0 x:0 0 0 2024-02-20T08:05:02.790 INFO:tasks.workunit.client.0.smithi123.stdout:1/18: fdatasync d3/f5 0 2024-02-20T08:05:02.792 INFO:tasks.workunit.client.0.smithi123.stdout:8/1: write f0 [370848,23324] 0 2024-02-20T08:05:02.794 INFO:tasks.workunit.client.0.smithi123.stdout:7/3: mkdir d0 0 2024-02-20T08:05:02.794 INFO:tasks.workunit.client.0.smithi123.stdout:7/4: rename d0 to d0/d1 22 2024-02-20T08:05:02.794 INFO:tasks.workunit.client.0.smithi123.stdout:7/5: rename d0 to d0/d2 22 2024-02-20T08:05:02.794 INFO:tasks.workunit.client.0.smithi123.stdout:7/6: dread - no filename 2024-02-20T08:05:02.797 INFO:tasks.workunit.client.0.smithi123.stdout:9/5: mknod c0 0 2024-02-20T08:05:02.797 INFO:tasks.workunit.client.0.smithi123.stdout:9/6: dread - no filename 2024-02-20T08:05:02.798 INFO:tasks.workunit.client.0.smithi123.stdout:1/19: mknod d3/c8 0 2024-02-20T08:05:02.799 INFO:tasks.workunit.client.0.smithi123.stdout:1/20: rename d3 to d3/d9 22 2024-02-20T08:05:02.799 INFO:tasks.workunit.client.0.smithi123.stdout:1/21: dread - d3/f5 zero size 2024-02-20T08:05:02.800 INFO:tasks.workunit.client.0.smithi123.stdout:1/22: read - d3/f5 zero size 2024-02-20T08:05:02.803 INFO:tasks.workunit.client.0.smithi123.stdout:6/5: creat d0/d1/f2 x:0 0 0 2024-02-20T08:05:02.804 INFO:tasks.workunit.client.0.smithi123.stdout:6/6: write d0/d1/f2 [118533,8481] 0 2024-02-20T08:05:02.805 INFO:tasks.workunit.client.0.smithi123.stdout:1/23: creat d3/fa x:0 0 0 2024-02-20T08:05:02.805 INFO:tasks.workunit.client.0.smithi123.stdout:6/7: truncate d0/d1/f2 421768 0 2024-02-20T08:05:02.806 INFO:tasks.workunit.client.0.smithi123.stdout:7/7: getdents d0 0 2024-02-20T08:05:02.806 INFO:tasks.workunit.client.0.smithi123.stdout:7/8: fdatasync - no filename 2024-02-20T08:05:02.806 INFO:tasks.workunit.client.0.smithi123.stdout:1/24: chown d3/fa 543634848 1 2024-02-20T08:05:02.806 INFO:tasks.workunit.client.0.smithi123.stdout:7/9: chown d0 13512 1 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/10: dwrite - no filename 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/11: dwrite - no filename 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/12: chown d0 110751 1 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/13: write - no filename 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/14: read - no filename 2024-02-20T08:05:02.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/15: stat d0 0 2024-02-20T08:05:02.808 INFO:tasks.workunit.client.0.smithi123.stdout:7/16: chown d0 35 1 2024-02-20T08:05:02.808 INFO:tasks.workunit.client.0.smithi123.stdout:6/8: unlink d0/d1/f2 0 2024-02-20T08:05:02.809 INFO:tasks.workunit.client.0.smithi123.stdout:1/25: mkdir d3/db 0 2024-02-20T08:05:02.818 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-20T08:05:02.820 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-20T08:05:02.820 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-20T08:05:02.858 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-20T08:05:02.861 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-02-20T08:05:02.861 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-20T08:05:02.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:02 smithi194 ceph-mon[37804]: pgmap v20: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 212 op/s 2024-02-20T08:05:02.896 INFO:tasks.workunit.client.0.smithi123.stdout:4/4: getdents . 0 2024-02-20T08:05:02.898 INFO:tasks.workunit.client.0.smithi123.stdout:4/5: stat c1 0 2024-02-20T08:05:02.899 INFO:tasks.workunit.client.0.smithi123.stdout:4/6: mknod c2 0 2024-02-20T08:05:02.901 INFO:tasks.workunit.client.0.smithi123.stdout:4/7: mkdir d3 0 2024-02-20T08:05:02.901 INFO:tasks.workunit.client.0.smithi123.stdout:4/8: dwrite - no filename 2024-02-20T08:05:02.903 INFO:tasks.workunit.client.0.smithi123.stdout:5/8: getdents d0 0 2024-02-20T08:05:02.903 INFO:tasks.workunit.client.0.smithi123.stdout:5/9: truncate - no filename 2024-02-20T08:05:02.903 INFO:tasks.workunit.client.0.smithi123.stdout:5/10: dwrite - no filename 2024-02-20T08:05:02.903 INFO:tasks.workunit.client.0.smithi123.stdout:5/11: dwrite - no filename 2024-02-20T08:05:02.903 INFO:tasks.workunit.client.0.smithi123.stdout:5/12: write - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/9: symlink d3/l4 0 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/10: truncate - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/11: write - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/12: truncate - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/13: dwrite - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/14: dread - no filename 2024-02-20T08:05:02.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/15: dread - no filename 2024-02-20T08:05:02.907 INFO:tasks.workunit.client.0.smithi123.stdout:4/16: rename c1 to d3/c5 0 2024-02-20T08:05:02.909 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-20T08:05:02.910 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-20T08:05:02.910 DEBUG:teuthology.orchestra.run.smithi194:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d72bcfd7affbb4a923c191d212814b4934cfeaa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-20T08:05:02.911 INFO:tasks.workunit.client.0.smithi123.stdout:4/17: creat d3/f6 x:0 0 0 2024-02-20T08:05:02.911 INFO:tasks.workunit.client.0.smithi123.stdout:5/13: link d0/l2 d0/l3 0 2024-02-20T08:05:02.911 INFO:tasks.workunit.client.0.smithi123.stdout:4/18: write d3/f6 [239485,49608] 0 2024-02-20T08:05:02.912 INFO:tasks.workunit.client.0.smithi123.stdout:8/2: getdents . 0 2024-02-20T08:05:02.913 INFO:tasks.workunit.client.0.smithi123.stdout:8/3: write f0 [65340,102758] 0 2024-02-20T08:05:02.916 INFO:tasks.workunit.client.0.smithi123.stdout:0/19: truncate d2/d3/f4 499412 0 2024-02-20T08:05:02.917 INFO:tasks.workunit.client.0.smithi123.stdout:8/4: getdents . 0 2024-02-20T08:05:02.921 INFO:tasks.workunit.client.0.smithi123.stdout:8/5: creat f1 x:0 0 0 2024-02-20T08:05:02.921 INFO:tasks.workunit.client.0.smithi123.stdout:4/19: dwrite d3/f6 [0,4194304] 0 2024-02-20T08:05:02.921 INFO:tasks.workunit.client.0.smithi123.stdout:8/6: dread - f1 zero size 2024-02-20T08:05:02.922 INFO:tasks.workunit.client.0.smithi123.stdout:0/20: mknod d2/d3/c5 0 2024-02-20T08:05:02.922 INFO:tasks.workunit.client.0.smithi123.stdout:8/7: truncate f0 1348130 0 2024-02-20T08:05:02.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/8: truncate f1 339302 0 2024-02-20T08:05:02.924 INFO:tasks.workunit.client.0.smithi123.stdout:8/9: fdatasync f1 0 2024-02-20T08:05:02.925 INFO:tasks.workunit.client.0.smithi123.stdout:0/21: creat d2/f6 x:0 0 0 2024-02-20T08:05:02.927 INFO:tasks.workunit.client.0.smithi123.stdout:6/9: rmdir d0/d1 0 2024-02-20T08:05:02.927 INFO:tasks.workunit.client.0.smithi123.stdout:6/10: read - no filename 2024-02-20T08:05:02.927 INFO:tasks.workunit.client.0.smithi123.stdout:6/11: dread - no filename 2024-02-20T08:05:02.929 INFO:tasks.workunit.client.0.smithi123.stdout:8/10: creat f2 x:0 0 0 2024-02-20T08:05:02.929 INFO:tasks.workunit.client.0.smithi123.stdout:8/11: fdatasync f2 0 2024-02-20T08:05:02.935 INFO:tasks.workunit.client.0.smithi123.stdout:6/12: creat d0/f3 x:0 0 0 2024-02-20T08:05:02.936 INFO:tasks.workunit.client.0.smithi123.stdout:8/12: symlink l3 0 2024-02-20T08:05:02.940 INFO:tasks.workunit.client.0.smithi123.stdout:0/22: rename d2/d3/f4 to d2/d3/f7 0 2024-02-20T08:05:02.942 INFO:tasks.workunit.client.0.smithi123.stdout:8/13: rename f1 to f4 0 2024-02-20T08:05:02.942 INFO:tasks.workunit.client.0.smithi123.stdout:8/14: read f4 [7510,11866] 0 2024-02-20T08:05:02.943 INFO:tasks.workunit.client.0.smithi123.stdout:8/15: write f2 [882113,110282] 0 2024-02-20T08:05:02.944 INFO:tasks.workunit.client.0.smithi123.stdout:6/13: link d0/f3 d0/f4 0 2024-02-20T08:05:02.946 INFO:tasks.workunit.client.0.smithi123.stdout:0/23: creat d2/f8 x:0 0 0 2024-02-20T08:05:02.947 INFO:tasks.workunit.client.0.smithi123.stdout:0/24: read f1 [2300108,85151] 0 2024-02-20T08:05:02.947 INFO:tasks.workunit.client.0.smithi123.stdout:8/16: mknod c5 0 2024-02-20T08:05:02.950 INFO:tasks.workunit.client.0.smithi123.stdout:6/14: write d0/f4 [158783,25326] 0 2024-02-20T08:05:02.953 INFO:tasks.workunit.client.0.smithi123.stdout:0/25: creat d2/d3/f9 x:0 0 0 2024-02-20T08:05:02.954 INFO:tasks.workunit.client.0.smithi123.stdout:4/20: truncate d3/f6 1852522 0 2024-02-20T08:05:02.956 INFO:tasks.workunit.client.0.smithi123.stdout:8/17: write f4 [1082774,37255] 0 2024-02-20T08:05:02.959 INFO:tasks.workunit.client.0.smithi123.stdout:0/26: symlink d2/d3/la 0 2024-02-20T08:05:02.960 INFO:tasks.workunit.client.0.smithi123.stdout:6/15: dwrite d0/f3 [0,4194304] 0 2024-02-20T08:05:02.961 INFO:tasks.workunit.client.0.smithi123.stdout:4/21: symlink d3/l7 0 2024-02-20T08:05:02.962 INFO:tasks.workunit.client.0.smithi123.stdout:6/16: chown d0/f4 2 1 2024-02-20T08:05:02.965 INFO:tasks.workunit.client.0.smithi123.stdout:8/18: mkdir d6 0 2024-02-20T08:05:02.965 INFO:tasks.workunit.client.0.smithi123.stdout:8/19: fdatasync f0 0 2024-02-20T08:05:02.966 INFO:tasks.workunit.client.0.smithi123.stdout:0/27: creat d2/fb x:0 0 0 2024-02-20T08:05:02.973 INFO:tasks.workunit.client.0.smithi123.stdout:8/20: dread f0 [0,4194304] 0 2024-02-20T08:05:02.977 INFO:tasks.workunit.client.0.smithi123.stdout:6/17: rename d0/f3 to d0/f5 0 2024-02-20T08:05:02.978 INFO:tasks.workunit.client.0.smithi123.stdout:0/28: dwrite d2/f8 [0,4194304] 0 2024-02-20T08:05:02.980 INFO:tasks.workunit.client.0.smithi123.stdout:8/21: rename f4 to d6/f7 0 2024-02-20T08:05:02.981 INFO:tasks.workunit.client.1.smithi194.stderr:+ mkdir -p fsstress 2024-02-20T08:05:02.982 INFO:tasks.workunit.client.0.smithi123.stdout:8/22: fdatasync f2 0 2024-02-20T08:05:02.985 INFO:tasks.workunit.client.0.smithi123.stdout:6/18: unlink d0/f4 0 2024-02-20T08:05:02.985 INFO:tasks.workunit.client.0.smithi123.stdout:6/19: readlink - no filename 2024-02-20T08:05:02.986 INFO:tasks.workunit.client.0.smithi123.stdout:4/22: dwrite d3/f6 [0,4194304] 0 2024-02-20T08:05:02.988 INFO:tasks.workunit.client.0.smithi123.stdout:8/23: creat d6/f8 x:0 0 0 2024-02-20T08:05:02.989 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd fsstress 2024-02-20T08:05:02.990 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-20T08:05:02.991 INFO:tasks.workunit.client.1.smithi194.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-20T08:05:02.992 INFO:tasks.workunit.client.0.smithi123.stdout:0/29: dwrite d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:02.993 INFO:tasks.workunit.client.0.smithi123.stdout:8/24: symlink d6/l9 0 2024-02-20T08:05:03.000 INFO:tasks.workunit.client.0.smithi123.stdout:0/30: getdents d2/d3 0 2024-02-20T08:05:03.002 INFO:tasks.workunit.client.0.smithi123.stdout:0/31: fsync f1 0 2024-02-20T08:05:03.006 INFO:tasks.workunit.client.0.smithi123.stdout:0/32: dread d2/f8 [0,4194304] 0 2024-02-20T08:05:03.007 INFO:tasks.workunit.client.0.smithi123.stdout:0/33: chown f1 3024 1 2024-02-20T08:05:03.007 INFO:tasks.workunit.client.0.smithi123.stdout:0/34: chown d2/d3/la 618522 1 2024-02-20T08:05:03.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:02 smithi123 ceph-mon[29383]: pgmap v20: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 212 op/s 2024-02-20T08:05:03.013 INFO:tasks.workunit.client.0.smithi123.stdout:0/35: dwrite d2/f8 [0,4194304] 0 2024-02-20T08:05:03.016 INFO:tasks.workunit.client.0.smithi123.stdout:0/36: creat d2/fc x:0 0 0 2024-02-20T08:05:03.016 INFO:tasks.workunit.client.0.smithi123.stdout:6/20: getdents d0 0 2024-02-20T08:05:03.020 INFO:tasks.workunit.client.0.smithi123.stdout:0/37: mkdir d2/dd 0 2024-02-20T08:05:03.020 INFO:tasks.workunit.client.0.smithi123.stdout:0/38: read - d2/fb zero size 2024-02-20T08:05:03.022 INFO:tasks.workunit.client.0.smithi123.stdout:6/21: fsync d0/f5 0 2024-02-20T08:05:03.023 INFO:tasks.workunit.client.0.smithi123.stdout:8/25: rmdir d6 39 2024-02-20T08:05:03.024 INFO:tasks.workunit.client.0.smithi123.stdout:0/39: mkdir d2/de 0 2024-02-20T08:05:03.025 INFO:tasks.workunit.client.0.smithi123.stdout:0/40: truncate d2/fb 443769 0 2024-02-20T08:05:03.026 INFO:tasks.workunit.client.0.smithi123.stdout:6/22: unlink d0/f5 0 2024-02-20T08:05:03.026 INFO:tasks.workunit.client.0.smithi123.stdout:0/41: write d2/fb [94334,94511] 0 2024-02-20T08:05:03.028 INFO:tasks.workunit.client.0.smithi123.stdout:6/23: rename d0 to d0/d6 22 2024-02-20T08:05:03.028 INFO:tasks.workunit.client.0.smithi123.stdout:6/24: dwrite - no filename 2024-02-20T08:05:03.030 INFO:tasks.workunit.client.0.smithi123.stdout:0/42: creat d2/d3/ff x:0 0 0 2024-02-20T08:05:03.031 INFO:tasks.workunit.client.0.smithi123.stdout:8/26: creat d6/fa x:0 0 0 2024-02-20T08:05:03.032 INFO:tasks.workunit.client.0.smithi123.stdout:6/25: creat d0/f7 x:0 0 0 2024-02-20T08:05:03.033 INFO:tasks.workunit.client.0.smithi123.stdout:0/43: creat d2/d3/f10 x:0 0 0 2024-02-20T08:05:03.034 INFO:tasks.workunit.client.0.smithi123.stdout:6/26: symlink d0/l8 0 2024-02-20T08:05:03.036 INFO:tasks.workunit.client.0.smithi123.stdout:6/27: unlink d0/f7 0 2024-02-20T08:05:03.038 INFO:tasks.workunit.client.0.smithi123.stdout:6/28: chown d0/l8 6225 1 2024-02-20T08:05:03.038 INFO:tasks.workunit.client.0.smithi123.stdout:6/29: dwrite - no filename 2024-02-20T08:05:03.038 INFO:tasks.workunit.client.0.smithi123.stdout:8/27: dwrite f2 [0,4194304] 0 2024-02-20T08:05:03.039 INFO:tasks.workunit.client.0.smithi123.stdout:8/28: fdatasync d6/f8 0 2024-02-20T08:05:03.040 INFO:tasks.workunit.client.0.smithi123.stdout:8/29: read f0 [625823,115480] 0 2024-02-20T08:05:03.041 INFO:tasks.workunit.client.0.smithi123.stdout:8/30: chown l3 2066 1 2024-02-20T08:05:03.041 INFO:tasks.workunit.client.0.smithi123.stdout:6/30: mknod d0/c9 0 2024-02-20T08:05:03.043 INFO:tasks.workunit.client.0.smithi123.stdout:0/44: fsync d2/d3/f10 0 2024-02-20T08:05:03.043 INFO:tasks.workunit.client.0.smithi123.stdout:8/31: dread f0 [0,4194304] 0 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/31: chown d0/l8 9136 1 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/32: dread - no filename 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/33: read - no filename 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/34: write - no filename 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/35: truncate - no filename 2024-02-20T08:05:03.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/36: dread - no filename 2024-02-20T08:05:03.047 INFO:tasks.workunit.client.0.smithi123.stdout:0/45: rename l0 to d2/d3/l11 0 2024-02-20T08:05:03.048 INFO:tasks.workunit.client.0.smithi123.stdout:8/32: dread f2 [0,4194304] 0 2024-02-20T08:05:03.048 INFO:tasks.workunit.client.0.smithi123.stdout:0/46: chown d2/d3/ff 401428732 1 2024-02-20T08:05:03.049 INFO:tasks.workunit.client.0.smithi123.stdout:8/33: truncate d6/f7 1565511 0 2024-02-20T08:05:03.050 INFO:tasks.workunit.client.0.smithi123.stdout:8/34: read f2 [948500,82706] 0 2024-02-20T08:05:03.051 INFO:tasks.workunit.client.0.smithi123.stdout:6/37: rename d0/c9 to d0/ca 0 2024-02-20T08:05:03.054 INFO:tasks.workunit.client.0.smithi123.stdout:8/35: unlink f2 0 2024-02-20T08:05:03.058 INFO:tasks.workunit.client.0.smithi123.stdout:6/38: symlink d0/lb 0 2024-02-20T08:05:03.059 INFO:tasks.workunit.client.0.smithi123.stdout:0/47: dwrite d2/fc [0,4194304] 0 2024-02-20T08:05:03.062 INFO:tasks.workunit.client.0.smithi123.stdout:8/36: dread d6/f7 [0,4194304] 0 2024-02-20T08:05:03.062 INFO:tasks.workunit.client.0.smithi123.stdout:6/39: creat d0/fc x:0 0 0 2024-02-20T08:05:03.063 INFO:tasks.workunit.client.0.smithi123.stdout:0/48: creat d2/f12 x:0 0 0 2024-02-20T08:05:03.063 INFO:tasks.workunit.client.0.smithi123.stdout:6/40: write d0/fc [711319,103150] 0 2024-02-20T08:05:03.065 INFO:tasks.workunit.client.0.smithi123.stdout:6/41: read d0/fc [767877,112739] 0 2024-02-20T08:05:03.065 INFO:tasks.workunit.client.0.smithi123.stdout:8/37: truncate f0 1473590 0 2024-02-20T08:05:03.067 INFO:tasks.workunit.client.0.smithi123.stdout:8/38: creat d6/fb x:0 0 0 2024-02-20T08:05:03.069 INFO:tasks.workunit.client.0.smithi123.stdout:8/39: dread - d6/f8 zero size 2024-02-20T08:05:03.069 INFO:tasks.workunit.client.0.smithi123.stdout:6/42: write d0/fc [659991,127477] 0 2024-02-20T08:05:03.069 INFO:tasks.workunit.client.0.smithi123.stdout:0/49: symlink d2/dd/l13 0 2024-02-20T08:05:03.070 INFO:tasks.workunit.client.0.smithi123.stdout:6/43: truncate d0/fc 1320441 0 2024-02-20T08:05:03.071 INFO:tasks.workunit.client.0.smithi123.stdout:8/40: dread d6/f7 [0,4194304] 0 2024-02-20T08:05:03.071 INFO:tasks.workunit.client.0.smithi123.stdout:0/50: getdents d2/de 0 2024-02-20T08:05:03.074 INFO:tasks.workunit.client.0.smithi123.stdout:0/51: mknod d2/c14 0 2024-02-20T08:05:03.076 INFO:tasks.workunit.client.0.smithi123.stdout:0/52: read - d2/d3/ff zero size 2024-02-20T08:05:03.081 INFO:tasks.workunit.client.0.smithi123.stdout:6/44: dwrite d0/fc [0,4194304] 0 2024-02-20T08:05:03.083 INFO:tasks.workunit.client.0.smithi123.stdout:8/41: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:03.094 INFO:tasks.workunit.client.0.smithi123.stdout:6/45: dwrite d0/fc [4194304,4194304] 0 2024-02-20T08:05:03.094 INFO:tasks.workunit.client.0.smithi123.stdout:6/46: chown d0/fc 0 1 2024-02-20T08:05:03.095 INFO:tasks.workunit.client.0.smithi123.stdout:6/47: rename d0 to d0/dd 22 2024-02-20T08:05:03.099 INFO:tasks.workunit.client.0.smithi123.stdout:6/48: write d0/fc [6082325,130384] 0 2024-02-20T08:05:03.099 INFO:tasks.workunit.client.0.smithi123.stdout:6/49: write d0/fc [9408841,71539] 0 2024-02-20T08:05:03.101 INFO:tasks.workunit.client.0.smithi123.stdout:6/50: unlink d0/ca 0 2024-02-20T08:05:03.103 INFO:tasks.workunit.client.0.smithi123.stdout:6/51: unlink d0/l8 0 2024-02-20T08:05:03.105 INFO:tasks.workunit.client.0.smithi123.stdout:6/52: creat d0/fe x:0 0 0 2024-02-20T08:05:03.114 INFO:tasks.workunit.client.0.smithi123.stdout:6/53: rmdir d0 39 2024-02-20T08:05:03.116 INFO:tasks.workunit.client.0.smithi123.stdout:6/54: symlink d0/lf 0 2024-02-20T08:05:03.116 INFO:tasks.workunit.client.0.smithi123.stdout:6/55: write d0/fc [1880783,98028] 0 2024-02-20T08:05:03.118 INFO:tasks.workunit.client.0.smithi123.stdout:6/56: mknod d0/c10 0 2024-02-20T08:05:03.124 INFO:tasks.workunit.client.0.smithi123.stdout:6/57: dwrite d0/fc [4194304,4194304] 0 2024-02-20T08:05:03.127 INFO:tasks.workunit.client.0.smithi123.stdout:6/58: rename d0/fc to d0/f11 0 2024-02-20T08:05:03.133 INFO:tasks.workunit.client.0.smithi123.stdout:6/59: dwrite d0/f11 [0,4194304] 0 2024-02-20T08:05:03.136 INFO:tasks.workunit.client.0.smithi123.stdout:6/60: symlink d0/l12 0 2024-02-20T08:05:03.136 INFO:tasks.workunit.client.0.smithi123.stdout:6/61: fdatasync d0/fe 0 2024-02-20T08:05:03.138 INFO:tasks.workunit.client.0.smithi123.stdout:6/62: rmdir d0 39 2024-02-20T08:05:03.145 INFO:tasks.workunit.client.0.smithi123.stdout:6/63: dwrite d0/f11 [4194304,4194304] 0 2024-02-20T08:05:03.163 INFO:tasks.workunit.client.0.smithi123.stdout:6/64: fsync d0/f11 0 2024-02-20T08:05:03.167 INFO:tasks.workunit.client.0.smithi123.stdout:6/65: truncate d0/f11 8414972 0 2024-02-20T08:05:03.169 INFO:tasks.workunit.client.0.smithi123.stdout:6/66: creat d0/f13 x:0 0 0 2024-02-20T08:05:03.177 INFO:tasks.workunit.client.0.smithi123.stdout:6/67: dwrite d0/f11 [8388608,4194304] 0 2024-02-20T08:05:03.181 INFO:tasks.workunit.client.0.smithi123.stdout:6/68: link d0/f13 d0/f14 0 2024-02-20T08:05:03.202 INFO:tasks.workunit.client.0.smithi123.stdout:6/69: dwrite d0/f13 [0,4194304] 0 2024-02-20T08:05:03.265 INFO:tasks.workunit.client.0.smithi123.stdout:6/70: creat d0/f15 x:0 0 0 2024-02-20T08:05:03.266 INFO:tasks.workunit.client.0.smithi123.stdout:6/71: readlink d0/lf 0 2024-02-20T08:05:03.271 INFO:tasks.workunit.client.0.smithi123.stdout:6/72: dwrite d0/f15 [0,4194304] 0 2024-02-20T08:05:03.274 INFO:tasks.workunit.client.0.smithi123.stdout:6/73: creat d0/f16 x:0 0 0 2024-02-20T08:05:03.276 INFO:tasks.workunit.client.0.smithi123.stdout:6/74: creat d0/f17 x:0 0 0 2024-02-20T08:05:03.277 INFO:tasks.workunit.client.0.smithi123.stdout:6/75: truncate d0/f15 4743506 0 2024-02-20T08:05:03.277 INFO:tasks.workunit.client.0.smithi123.stdout:6/76: chown d0/lf 14109532 1 2024-02-20T08:05:03.278 INFO:tasks.workunit.client.0.smithi123.stdout:6/77: dread - d0/f17 zero size 2024-02-20T08:05:03.279 INFO:tasks.workunit.client.0.smithi123.stdout:6/78: creat d0/f18 x:0 0 0 2024-02-20T08:05:03.280 INFO:tasks.workunit.client.0.smithi123.stdout:6/79: dread - d0/f17 zero size 2024-02-20T08:05:03.281 INFO:tasks.workunit.client.0.smithi123.stdout:6/80: creat d0/f19 x:0 0 0 2024-02-20T08:05:03.285 INFO:tasks.workunit.client.0.smithi123.stdout:6/81: dread d0/f11 [0,4194304] 0 2024-02-20T08:05:03.288 INFO:tasks.workunit.client.0.smithi123.stdout:6/82: rename d0/lf to d0/l1a 0 2024-02-20T08:05:03.288 INFO:tasks.workunit.client.0.smithi123.stdout:6/83: fdatasync d0/f17 0 2024-02-20T08:05:03.289 INFO:tasks.workunit.client.0.smithi123.stdout:6/84: write d0/fe [107922,37117] 0 2024-02-20T08:05:03.290 INFO:tasks.workunit.client.0.smithi123.stdout:6/85: dread - d0/f16 zero size 2024-02-20T08:05:03.294 INFO:tasks.workunit.client.0.smithi123.stdout:6/86: dread d0/f11 [8388608,4194304] 0 2024-02-20T08:05:03.301 INFO:tasks.workunit.client.0.smithi123.stdout:6/87: dwrite d0/f11 [4194304,4194304] 0 2024-02-20T08:05:03.303 INFO:tasks.workunit.client.0.smithi123.stdout:6/88: mknod d0/c1b 0 2024-02-20T08:05:03.305 INFO:tasks.workunit.client.0.smithi123.stdout:6/89: creat d0/f1c x:0 0 0 2024-02-20T08:05:03.314 INFO:tasks.workunit.client.0.smithi123.stdout:6/90: dwrite d0/f17 [0,4194304] 0 2024-02-20T08:05:03.318 INFO:tasks.workunit.client.0.smithi123.stdout:6/91: unlink d0/c1b 0 2024-02-20T08:05:03.321 INFO:tasks.workunit.client.0.smithi123.stdout:6/92: rename d0/f11 to d0/f1d 0 2024-02-20T08:05:03.321 INFO:tasks.workunit.client.0.smithi123.stdout:6/93: read - d0/f19 zero size 2024-02-20T08:05:03.326 INFO:tasks.workunit.client.0.smithi123.stdout:6/94: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:03.334 INFO:tasks.workunit.client.0.smithi123.stdout:6/95: dwrite d0/f1d [8388608,4194304] 0 2024-02-20T08:05:03.335 INFO:tasks.workunit.client.0.smithi123.stdout:6/96: truncate d0/fe 412262 0 2024-02-20T08:05:03.336 INFO:tasks.workunit.client.0.smithi123.stdout:6/97: write d0/f1d [1130967,107277] 0 2024-02-20T08:05:03.337 INFO:tasks.workunit.client.0.smithi123.stdout:6/98: write d0/f14 [3939695,92234] 0 2024-02-20T08:05:04.894 INFO:tasks.workunit.client.1.smithi194.stderr:+ tar xzf ltp-full.tgz 2024-02-20T08:05:04.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:04 smithi194 ceph-mon[37804]: pgmap v21: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 88 KiB/s rd, 3.6 MiB/s wr, 234 op/s 2024-02-20T08:05:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:04 smithi123 ceph-mon[29383]: pgmap v21: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 88 KiB/s rd, 3.6 MiB/s wr, 234 op/s 2024-02-20T08:05:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:05 smithi123 ceph-mon[29383]: pgmap v22: 65 pgs: 65 active+clean; 159 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 9.7 MiB/s wr, 297 op/s 2024-02-20T08:05:06.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:05 smithi194 ceph-mon[37804]: pgmap v22: 65 pgs: 65 active+clean; 159 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 9.7 MiB/s wr, 297 op/s 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 -- 172.21.15.123:0/941039911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 msgr2=0x7fa54c102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 --2- 172.21.15.123:0/941039911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c102520 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa53c004940 tx=0x7fa53c009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 -- 172.21.15.123:0/941039911 shutdown_connections 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 --2- 172.21.15.123:0/941039911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c102520 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 --2- 172.21.15.123:0/941039911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c0ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 -- 172.21.15.123:0/941039911 >> 172.21.15.123:0/941039911 conn(0x7fa54c0f74e0 msgr2=0x7fa54c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 -- 172.21.15.123:0/941039911 shutdown_connections 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.969+0000 7fa55332c700 1 -- 172.21.15.123:0/941039911 wait complete. 2024-02-20T08:05:06.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 Processor -- start 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 -- start start 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c10e410 con 0x7fa54c1000c0 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa55332c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c10ecb0 con 0x7fa54c0663e0 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa5508c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa5508c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59534/0 (socket says 172.21.15.123:59534) 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa5508c7700 1 -- 172.21.15.123:0/1895636272 learned_addr learned my addr 172.21.15.123:0/1895636272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:06.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.970+0000 7fa5510c8700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa5508c7700 1 -- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 msgr2=0x7fa54c10d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa5508c7700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c10d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa5508c7700 1 -- 172.21.15.123:0/1895636272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c005040 con 0x7fa54c1000c0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa5510c8700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa5508c7700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa53c000c00 tx=0x7fa53c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53c021070 con 0x7fa54c1000c0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c10ef30 con 0x7fa54c1000c0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa53c009430 con 0x7fa54c1000c0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53c00e070 con 0x7fa54c1000c0 2024-02-20T08:05:06.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.971+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c10f470 con 0x7fa54c1000c0 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.972+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c04bed0 con 0x7fa54c1000c0 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.973+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fa53c01c400 con 0x7fa54c1000c0 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.973+0000 7fa541ffb700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 0x7fa53806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.973+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa53c08b0a0 con 0x7fa54c1000c0 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.973+0000 7fa5510c8700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 0x7fa53806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.974+0000 7fa5510c8700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 0x7fa53806d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa548009b80 tx=0x7fa54800b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:06.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:06.978+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa53c058be0 con 0x7fa54c1000c0 2024-02-20T08:05:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.191+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54c10f8c0 con 0x7fa53806b2e0 2024-02-20T08:05:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.193+0000 7fa541ffb700 1 -- 172.21.15.123:0/1895636272 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa54c10f8c0 con 0x7fa53806b2e0 2024-02-20T08:05:07.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 msgr2=0x7fa53806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 0x7fa53806d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa548009b80 tx=0x7fa54800b040 comp rx=0 tx=0).stop 2024-02-20T08:05:07.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 msgr2=0x7fa54c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa53c000c00 tx=0x7fa53c009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 shutdown_connections 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa53806b2e0 0x7fa53806d790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa54c0663e0 0x7fa54c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 --2- 172.21.15.123:0/1895636272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54c1000c0 0x7fa54c10de10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 >> 172.21.15.123:0/1895636272 conn(0x7fa54c0f74e0 msgr2=0x7fa54c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 shutdown_connections 2024-02-20T08:05:07.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.195+0000 7fa55332c700 1 -- 172.21.15.123:0/1895636272 wait complete. 2024-02-20T08:05:07.206 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:05:07.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.319+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1913529392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fbcc0 msgr2=0x7fcef4102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.319+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1913529392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fbcc0 0x7fcef4102560 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcee0004940 tx=0x7fcee0009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1913529392 shutdown_connections 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1913529392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fbcc0 0x7fcef4102560 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1913529392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef40fb2e0 0x7fcef40fb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1913529392 >> 172.21.15.123:0/1913529392 conn(0x7fcef40f6ca0 msgr2=0x7fcef40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1913529392 shutdown_connections 2024-02-20T08:05:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1913529392 wait complete. 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 Processor -- start 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- start start 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 0x7fcef410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.320+0000 7fcefaeb0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef410e3b0 con 0x7fcef40fb2e0 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcefaeb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef410e4f0 con 0x7fcef410def0 2024-02-20T08:05:07.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:33048/0 (socket says 172.21.15.123:33048) 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef3fff700 1 -- 172.21.15.123:0/1036351522 learned_addr learned my addr 172.21.15.123:0/1036351522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef8c4c700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 0x7fcef410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef8c4c700 1 -- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 msgr2=0x7fcef410ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef8c4c700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef8c4c700 1 -- 172.21.15.123:0/1036351522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0005040 con 0x7fcef40fb2e0 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef3fff700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:05:07.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef8c4c700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 0x7fcef410d9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009fd0 tx=0x7fcee800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:07.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee8004e90 con 0x7fcef40fb2e0 2024-02-20T08:05:07.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.321+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef410f390 con 0x7fcef40fb2e0 2024-02-20T08:05:07.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.322+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcee800f040 con 0x7fcef40fb2e0 2024-02-20T08:05:07.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.322+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee800ca50 con 0x7fcef40fb2e0 2024-02-20T08:05:07.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.322+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef410f8a0 con 0x7fcef40fb2e0 2024-02-20T08:05:07.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.323+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef404bed0 con 0x7fcef40fb2e0 2024-02-20T08:05:07.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.323+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fcee8007cc0 con 0x7fcef40fb2e0 2024-02-20T08:05:07.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.324+0000 7fcef17fa700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 0x7fcee406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.324+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcee80897a0 con 0x7fcef40fb2e0 2024-02-20T08:05:07.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.324+0000 7fcef3fff700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 0x7fcee406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.325+0000 7fcef3fff700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 0x7fcee406d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009b30 tx=0x7fcee0009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:07.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.329+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcee804f620 con 0x7fcef40fb2e0 2024-02-20T08:05:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.621+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcef40fbd30 con 0x7fcee406b2e0 2024-02-20T08:05:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.622+0000 7fcef17fa700 1 -- 172.21.15.123:0/1036351522 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcef40fbd30 con 0x7fcee406b2e0 2024-02-20T08:05:07.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 msgr2=0x7fcee406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 0x7fcee406d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009b30 tx=0x7fcee0009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 msgr2=0x7fcef410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 0x7fcef410d9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009fd0 tx=0x7fcee800b040 comp rx=0 tx=0).stop 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 shutdown_connections 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fcee406b2e0 0x7fcee406d790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef40fb2e0 0x7fcef410d9b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 --2- 172.21.15.123:0/1036351522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef410def0 0x7fcef410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 >> 172.21.15.123:0/1036351522 conn(0x7fcef40f6ca0 msgr2=0x7fcef40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 shutdown_connections 2024-02-20T08:05:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.626+0000 7fcefaeb0700 1 -- 172.21.15.123:0/1036351522 wait complete. 2024-02-20T08:05:07.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 -- 172.21.15.123:0/2082869239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29580fef80 msgr2=0x7f29580fb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 --2- 172.21.15.123:0/2082869239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29580fef80 0x7f29580fb030 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2948004940 tx=0x7f2948009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 -- 172.21.15.123:0/2082869239 shutdown_connections 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 --2- 172.21.15.123:0/2082869239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29580fef80 0x7f29580fb030 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 --2- 172.21.15.123:0/2082869239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f29580fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 -- 172.21.15.123:0/2082869239 >> 172.21.15.123:0/2082869239 conn(0x7f29580f6ca0 msgr2=0x7f29580f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 -- 172.21.15.123:0/2082869239 shutdown_connections 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.740+0000 7f29605ba700 1 -- 172.21.15.123:0/2082869239 wait complete. 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 Processor -- start 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 -- start start 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f295810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295810e3b0 con 0x7f295810def0 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f29605ba700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295810e4f0 con 0x7f29580fe5a0 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f295db55700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f295db55700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59556/0 (socket says 172.21.15.123:59556) 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f295db55700 1 -- 172.21.15.123:0/2486577130 learned_addr learned my addr 172.21.15.123:0/2486577130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.741+0000 7f295e356700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f295810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f295db55700 1 -- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 msgr2=0x7f295810d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f295db55700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f295810d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f295db55700 1 -- 172.21.15.123:0/2486577130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948005040 con 0x7f295810def0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f295e356700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f295810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f295db55700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2948000c00 tx=0x7f2948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2948021070 con 0x7f295810def0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295810f390 con 0x7f295810def0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2948009430 con 0x7f295810def0 2024-02-20T08:05:07.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295810f840 con 0x7f295810def0 2024-02-20T08:05:07.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.742+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f294800e070 con 0x7f295810def0 2024-02-20T08:05:07.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.743+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295804bed0 con 0x7f295810def0 2024-02-20T08:05:07.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.744+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f294801c790 con 0x7f295810def0 2024-02-20T08:05:07.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.744+0000 7f294effd700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 0x7f294406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:07.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.744+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f294808ae50 con 0x7f295810def0 2024-02-20T08:05:07.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.744+0000 7f295e356700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 0x7f294406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:07.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.745+0000 7f295e356700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 0x7f294406d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2954009b80 tx=0x7f295400b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:07.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.753+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2948058a50 con 0x7f295810def0 2024-02-20T08:05:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:07.991+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29580ff040 con 0x7f294406b2e0 2024-02-20T08:05:08.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.002+0000 7f294effd700 1 -- 172.21.15.123:0/2486577130 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f29580ff040 con 0x7f294406b2e0 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 starting - - - - 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (8m) 22s ago 8m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (7m) 31s ago 7m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (6m) 22s ago 8m 85.0M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (2m) 22s ago 2m 11.3M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (2m) 22s ago 2m 71.5M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (2m) 31s ago 2m 14.3M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (2m) 31s ago 2m 12.0M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (10m) 22s ago 10m 338M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (49s) 31s ago 7m 488M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 915e6082ff57 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (10m) 22s ago 10m 50.2M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (7m) 31s ago 7m 39.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:05:08.004 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 starting - - - - 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 31s ago 7m 17.1M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (6m) 22s ago 6m 52.7M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (6m) 22s ago 6m 53.8M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (5m) 22s ago 5m 50.6M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (5m) 31s ago 5m 55.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (4m) 31s ago 4m 51.0M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (4m) 31s ago 4m 49.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:05:08.005 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (6m) 22s ago 7m 60.1M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:05:08.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 msgr2=0x7f294406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 0x7f294406d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2954009b80 tx=0x7f295400b040 comp rx=0 tx=0).stop 2024-02-20T08:05:08.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 msgr2=0x7f295810ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2948000c00 tx=0x7f2948009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 shutdown_connections 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f294406b2e0 0x7f294406d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29580fe5a0 0x7f295810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 --2- 172.21.15.123:0/2486577130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f295810def0 0x7f295810ed90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 >> 172.21.15.123:0/2486577130 conn(0x7f29580f6ca0 msgr2=0x7f2958101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 shutdown_connections 2024-02-20T08:05:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.005+0000 7f29605ba700 1 -- 172.21.15.123:0/2486577130 wait complete. 2024-02-20T08:05:08.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 -- 172.21.15.123:0/3409189548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 msgr2=0x7f41f8102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 --2- 172.21.15.123:0/3409189548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f8102520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f41ec004940 tx=0x7f41ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 -- 172.21.15.123:0/3409189548 shutdown_connections 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 --2- 172.21.15.123:0/3409189548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f8102520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 --2- 172.21.15.123:0/3409189548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f80ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 -- 172.21.15.123:0/3409189548 >> 172.21.15.123:0/3409189548 conn(0x7f41f80f74e0 msgr2=0x7f41f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.109+0000 7f41fc80e700 1 -- 172.21.15.123:0/3409189548 shutdown_connections 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 -- 172.21.15.123:0/3409189548 wait complete. 2024-02-20T08:05:08.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 Processor -- start 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 -- start start 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f810e4b0 con 0x7f41f8100120 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41fc80e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f810ed50 con 0x7f41f8066380 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59570/0 (socket says 172.21.15.123:59570) 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41f5d9b700 1 -- 172.21.15.123:0/658950562 learned_addr learned my addr 172.21.15.123:0/658950562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.110+0000 7f41f659c700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41f5d9b700 1 -- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 msgr2=0x7f41f810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41f5d9b700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41f5d9b700 1 -- 172.21.15.123:0/658950562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec005040 con 0x7f41f8100120 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41f659c700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:05:08.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41f5d9b700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00b3b0 tx=0x7f41ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ec00e040 con 0x7f41f8100120 2024-02-20T08:05:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f810efd0 con 0x7f41f8100120 2024-02-20T08:05:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41ec00bcc0 con 0x7f41f8100120 2024-02-20T08:05:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ec01c630 con 0x7f41f8100120 2024-02-20T08:05:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.111+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f810f510 con 0x7f41f8100120 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.112+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f804bed0 con 0x7f41f8100120 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.112+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f41ec0139f0 con 0x7f41f8100120 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.113+0000 7f41e6ffd700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 0x7f41e006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.113+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f41ec08b280 con 0x7f41f8100120 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.113+0000 7f41f659c700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 0x7f41e006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.113+0000 7f41f659c700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 0x7f41e006d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41e80041d0 tx=0x7f41e8009040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:08.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.117+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f41ec058dc0 con 0x7f41f8100120 2024-02-20T08:05:08.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.445+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41f8105a10 con 0x7f41f8100120 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.446+0000 7f41e6ffd700 1 -- 172.21.15.123:0/658950562 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f41ec058950 con 0x7f41f8100120 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:08.447 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 13, 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:05:08.448 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 msgr2=0x7f41e006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 0x7f41e006d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41e80041d0 tx=0x7f41e8009040 comp rx=0 tx=0).stop 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 msgr2=0x7f41f810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00b3b0 tx=0x7f41ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 shutdown_connections 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f41e006b2e0 0x7f41e006d790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41f8066380 0x7f41f810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 --2- 172.21.15.123:0/658950562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41f8100120 0x7f41f810deb0 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00b3b0 tx=0x7f41ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.449+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 >> 172.21.15.123:0/658950562 conn(0x7f41f80f74e0 msgr2=0x7f41f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:08.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.450+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 shutdown_connections 2024-02-20T08:05:08.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.450+0000 7f41fc80e700 1 -- 172.21.15.123:0/658950562 wait complete. 2024-02-20T08:05:08.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 -- 172.21.15.123:0/1706389846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 msgr2=0x7f63a4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 --2- 172.21.15.123:0/1706389846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a4101ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f63a0004940 tx=0x7f63a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 -- 172.21.15.123:0/1706389846 shutdown_connections 2024-02-20T08:05:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 --2- 172.21.15.123:0/1706389846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a41047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 --2- 172.21.15.123:0/1706389846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a4101ed0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 -- 172.21.15.123:0/1706389846 >> 172.21.15.123:0/1706389846 conn(0x7f63a40f7520 msgr2=0x7f63a40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:08.611 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:08 smithi123 ceph-mon[29383]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:08.611 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:08 smithi123 ceph-mon[29383]: pgmap v23: 65 pgs: 65 active+clean; 159 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 8.4 MiB/s wr, 219 op/s 2024-02-20T08:05:08.611 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:08 smithi123 ceph-mon[29383]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:08.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 -- 172.21.15.123:0/1706389846 shutdown_connections 2024-02-20T08:05:08.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.609+0000 7f63abf43700 1 -- 172.21.15.123:0/1706389846 wait complete. 2024-02-20T08:05:08.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 Processor -- start 2024-02-20T08:05:08.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 -- start start 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a4110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4110600 con 0x7f63a4066c90 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63abf43700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4110ea0 con 0x7f63a4102410 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63a9cdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63a9cdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a410fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35574/0 (socket says 172.21.15.123:35574) 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63a9cdf700 1 -- 172.21.15.123:0/3958953102 learned_addr learned my addr 172.21.15.123:0/3958953102 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.610+0000 7f63a94de700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a4110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.611+0000 7f63a94de700 1 -- 172.21.15.123:0/3958953102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 msgr2=0x7f63a410fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.611+0000 7f63a94de700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a410fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.611+0000 7f63a94de700 1 -- 172.21.15.123:0/3958953102 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0005040 con 0x7f63a4102410 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.611+0000 7f63a94de700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a4110000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6394009fd0 tx=0x7f639400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.612+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6394004e90 con 0x7f63a4102410 2024-02-20T08:05:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.612+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f639400f040 con 0x7f63a4102410 2024-02-20T08:05:08.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.612+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f639400ca50 con 0x7f63a4102410 2024-02-20T08:05:08.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.612+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a4111120 con 0x7f63a4102410 2024-02-20T08:05:08.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.612+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a4111660 con 0x7f63a4102410 2024-02-20T08:05:08.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.613+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a4109c50 con 0x7f63a4102410 2024-02-20T08:05:08.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.614+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f6394007cc0 con 0x7f63a4102410 2024-02-20T08:05:08.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.615+0000 7f639a7fc700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 0x7f639006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:08.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.615+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f63940899d0 con 0x7f63a4102410 2024-02-20T08:05:08.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.615+0000 7f63a9cdf700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 0x7f639006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:08.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.616+0000 7f63a9cdf700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 0x7f639006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b0d0 tx=0x7f63a0009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:08.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.619+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6394057600 con 0x7f63a4102410 2024-02-20T08:05:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:08 smithi194 ceph-mon[37804]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:08 smithi194 ceph-mon[37804]: pgmap v23: 65 pgs: 65 active+clean; 159 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 8.4 MiB/s wr, 219 op/s 2024-02-20T08:05:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:08 smithi194 ceph-mon[37804]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:08.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.982+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63a41119b0 con 0x7f639006b2e0 2024-02-20T08:05:08.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.983+0000 7f639a7fc700 1 -- 172.21.15.123:0/3958953102 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f63a41119b0 con 0x7f639006b2e0 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "1/2 daemons upgraded", 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:05:08.985 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:05:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 msgr2=0x7f639006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 0x7f639006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b0d0 tx=0x7f63a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 msgr2=0x7f63a4110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a4110000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6394009fd0 tx=0x7f639400b040 comp rx=0 tx=0).stop 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 shutdown_connections 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f639006b2e0 0x7f639006d790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a4066c90 0x7f63a410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 --2- 172.21.15.123:0/3958953102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a4102410 0x7f63a4110000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 >> 172.21.15.123:0/3958953102 conn(0x7f63a40f7520 msgr2=0x7f63a40f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 shutdown_connections 2024-02-20T08:05:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:08.986+0000 7f63abf43700 1 -- 172.21.15.123:0/3958953102 wait complete. 2024-02-20T08:05:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:09 smithi194 ceph-mon[37804]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:09 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/658950562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:05:09.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:09 smithi123 ceph-mon[29383]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:09.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:09 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/658950562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:05:10.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:10 smithi194 ceph-mon[37804]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:10.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:10 smithi194 ceph-mon[37804]: pgmap v24: 65 pgs: 65 active+clean; 177 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 11 MiB/s wr, 262 op/s 2024-02-20T08:05:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:10 smithi123 ceph-mon[29383]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:10 smithi123 ceph-mon[29383]: pgmap v24: 65 pgs: 65 active+clean; 177 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 11 MiB/s wr, 262 op/s 2024-02-20T08:05:11.398 INFO:tasks.workunit.client.0.smithi123.stdout:2/3: sync 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/4: mknod c1 0 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/5: dread - no filename 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/6: dwrite - no filename 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/7: rmdir - no directory 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/8: write - no filename 2024-02-20T08:05:11.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/9: write - no filename 2024-02-20T08:05:11.401 INFO:tasks.workunit.client.0.smithi123.stdout:2/10: chown c1 6335 1 2024-02-20T08:05:11.401 INFO:tasks.workunit.client.0.smithi123.stdout:2/11: write - no filename 2024-02-20T08:05:11.403 INFO:tasks.workunit.client.0.smithi123.stdout:2/12: creat f2 x:0 0 0 2024-02-20T08:05:11.405 INFO:tasks.workunit.client.0.smithi123.stdout:2/13: mknod c3 0 2024-02-20T08:05:11.405 INFO:tasks.workunit.client.0.smithi123.stdout:2/14: chown c3 451413214 1 2024-02-20T08:05:11.405 INFO:tasks.workunit.client.0.smithi123.stdout:2/15: stat f2 0 2024-02-20T08:05:11.406 INFO:tasks.workunit.client.0.smithi123.stdout:2/16: truncate f2 213912 0 2024-02-20T08:05:11.407 INFO:tasks.workunit.client.0.smithi123.stdout:2/17: write f2 [317922,83566] 0 2024-02-20T08:05:11.408 INFO:tasks.workunit.client.0.smithi123.stdout:2/18: write f2 [186864,97973] 0 2024-02-20T08:05:11.609 INFO:tasks.workunit.client.0.smithi123.stdout:2/19: fsync f2 0 2024-02-20T08:05:11.616 INFO:tasks.workunit.client.0.smithi123.stdout:2/20: dwrite f2 [0,4194304] 0 2024-02-20T08:05:11.668 INFO:tasks.workunit.client.0.smithi123.stdout:2/21: dwrite f2 [4194304,4194304] 0 2024-02-20T08:05:11.670 INFO:tasks.workunit.client.0.smithi123.stdout:2/22: write f2 [5855014,111014] 0 2024-02-20T08:05:11.674 INFO:tasks.workunit.client.0.smithi123.stdout:2/23: dread f2 [4194304,4194304] 0 2024-02-20T08:05:11.675 INFO:tasks.workunit.client.0.smithi123.stdout:2/24: read f2 [5514363,7978] 0 2024-02-20T08:05:11.676 INFO:tasks.workunit.client.0.smithi123.stdout:2/25: chown f2 153 1 2024-02-20T08:05:11.678 INFO:tasks.workunit.client.0.smithi123.stdout:2/26: symlink l4 0 2024-02-20T08:05:11.686 INFO:tasks.workunit.client.0.smithi123.stdout:2/27: fsync f2 0 2024-02-20T08:05:11.687 INFO:tasks.workunit.client.0.smithi123.stdout:2/28: creat f5 x:0 0 0 2024-02-20T08:05:11.690 INFO:tasks.workunit.client.0.smithi123.stdout:2/29: mknod c6 0 2024-02-20T08:05:11.690 INFO:tasks.workunit.client.0.smithi123.stdout:2/30: rmdir - no directory 2024-02-20T08:05:11.690 INFO:tasks.workunit.client.0.smithi123.stdout:2/31: chown c0 38375303 1 2024-02-20T08:05:11.690 INFO:tasks.workunit.client.0.smithi123.stdout:2/32: rmdir - no directory 2024-02-20T08:05:11.693 INFO:tasks.workunit.client.0.smithi123.stdout:2/33: rename f2 to f7 0 2024-02-20T08:05:11.693 INFO:tasks.workunit.client.0.smithi123.stdout:2/34: chown f7 1576 1 2024-02-20T08:05:11.703 INFO:tasks.workunit.client.0.smithi123.stdout:2/35: rename f7 to f8 0 2024-02-20T08:05:11.703 INFO:tasks.workunit.client.0.smithi123.stdout:2/36: rmdir - no directory 2024-02-20T08:05:11.704 INFO:tasks.workunit.client.0.smithi123.stdout:3/5: sync 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:2/37: rename c3 to c9 0 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/6: rename d0 to d0/d2 22 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/7: write - no filename 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/8: write - no filename 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/9: dread - no filename 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/10: write - no filename 2024-02-20T08:05:11.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/11: write - no filename 2024-02-20T08:05:11.706 INFO:tasks.workunit.client.0.smithi123.stdout:2/38: write f5 [682356,105948] 0 2024-02-20T08:05:11.707 INFO:tasks.workunit.client.0.smithi123.stdout:3/12: mknod d0/c3 0 2024-02-20T08:05:11.707 INFO:tasks.workunit.client.0.smithi123.stdout:3/13: dwrite - no filename 2024-02-20T08:05:11.707 INFO:tasks.workunit.client.0.smithi123.stdout:3/14: truncate - no filename 2024-02-20T08:05:11.709 INFO:tasks.workunit.client.0.smithi123.stdout:3/15: symlink d0/l4 0 2024-02-20T08:05:11.714 INFO:tasks.workunit.client.0.smithi123.stdout:2/39: dwrite f8 [0,4194304] 0 2024-02-20T08:05:11.714 INFO:tasks.workunit.client.0.smithi123.stdout:3/16: link d0/c3 d0/c5 0 2024-02-20T08:05:11.714 INFO:tasks.workunit.client.0.smithi123.stdout:2/40: stat f5 0 2024-02-20T08:05:11.715 INFO:tasks.workunit.client.0.smithi123.stdout:2/41: truncate f5 852940 0 2024-02-20T08:05:11.717 INFO:tasks.workunit.client.0.smithi123.stdout:3/17: mkdir d0/d6 0 2024-02-20T08:05:11.718 INFO:tasks.workunit.client.0.smithi123.stdout:2/42: mknod ca 0 2024-02-20T08:05:11.721 INFO:tasks.workunit.client.0.smithi123.stdout:3/18: mkdir d0/d6/d7 0 2024-02-20T08:05:11.721 INFO:tasks.workunit.client.0.smithi123.stdout:3/19: dwrite - no filename 2024-02-20T08:05:11.725 INFO:tasks.workunit.client.0.smithi123.stdout:3/20: creat d0/d6/d7/f8 x:0 0 0 2024-02-20T08:05:11.727 INFO:tasks.workunit.client.0.smithi123.stdout:2/43: dwrite f8 [4194304,4194304] 0 2024-02-20T08:05:11.729 INFO:tasks.workunit.client.0.smithi123.stdout:3/21: write d0/d6/d7/f8 [1042615,113960] 0 2024-02-20T08:05:11.732 INFO:tasks.workunit.client.0.smithi123.stdout:3/22: write d0/d6/d7/f8 [1436669,104792] 0 2024-02-20T08:05:11.735 INFO:tasks.workunit.client.0.smithi123.stdout:3/23: creat d0/d6/f9 x:0 0 0 2024-02-20T08:05:11.742 INFO:tasks.workunit.client.0.smithi123.stdout:2/44: rename f8 to fb 0 2024-02-20T08:05:11.750 INFO:tasks.workunit.client.0.smithi123.stdout:2/45: dwrite fb [0,4194304] 0 2024-02-20T08:05:11.768 INFO:tasks.workunit.client.0.smithi123.stdout:2/46: getdents . 0 2024-02-20T08:05:11.769 INFO:tasks.workunit.client.0.smithi123.stdout:2/47: write f5 [1706260,85768] 0 2024-02-20T08:05:11.774 INFO:tasks.workunit.client.0.smithi123.stdout:2/48: fsync fb 0 2024-02-20T08:05:11.777 INFO:tasks.workunit.client.0.smithi123.stdout:2/49: creat fc x:0 0 0 2024-02-20T08:05:11.780 INFO:tasks.workunit.client.0.smithi123.stdout:2/50: rename c9 to cd 0 2024-02-20T08:05:11.792 INFO:tasks.workunit.client.0.smithi123.stdout:2/51: getdents . 0 2024-02-20T08:05:11.800 INFO:tasks.workunit.client.0.smithi123.stdout:2/52: dwrite fc [0,4194304] 0 2024-02-20T08:05:12.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:12 smithi194 ceph-mon[37804]: pgmap v25: 65 pgs: 65 active+clean; 177 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 10 MiB/s wr, 127 op/s 2024-02-20T08:05:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:12 smithi123 ceph-mon[29383]: pgmap v25: 65 pgs: 65 active+clean; 177 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 10 MiB/s wr, 127 op/s 2024-02-20T08:05:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:13 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:13.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:13 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:14.472 INFO:tasks.workunit.client.0.smithi123.stdout:9/7: sync 2024-02-20T08:05:14.472 INFO:tasks.workunit.client.0.smithi123.stdout:9/8: fsync - no filename 2024-02-20T08:05:14.473 INFO:tasks.workunit.client.0.smithi123.stdout:9/9: dread - no filename 2024-02-20T08:05:14.474 INFO:tasks.workunit.client.0.smithi123.stdout:9/10: creat f1 x:0 0 0 2024-02-20T08:05:14.481 INFO:tasks.workunit.client.0.smithi123.stdout:9/11: dwrite f1 [0,4194304] 0 2024-02-20T08:05:14.483 INFO:tasks.workunit.client.0.smithi123.stdout:9/12: creat f2 x:0 0 0 2024-02-20T08:05:14.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:14 smithi194 ceph-mon[37804]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 13 MiB/s wr, 176 op/s 2024-02-20T08:05:14.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:14 smithi123 ceph-mon[29383]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 110 KiB/s rd, 13 MiB/s wr, 176 op/s 2024-02-20T08:05:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:15 smithi123 ceph-mon[29383]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 154 op/s 2024-02-20T08:05:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:15 smithi194 ceph-mon[37804]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 154 op/s 2024-02-20T08:05:18.231 INFO:tasks.workunit.client.0.smithi123.stdout:7/17: sync 2024-02-20T08:05:18.233 INFO:tasks.workunit.client.0.smithi123.stdout:7/18: creat d0/f3 x:0 0 0 2024-02-20T08:05:18.234 INFO:tasks.workunit.client.0.smithi123.stdout:7/19: dread - d0/f3 zero size 2024-02-20T08:05:18.235 INFO:tasks.workunit.client.0.smithi123.stdout:7/20: write d0/f3 [767529,78163] 0 2024-02-20T08:05:18.236 INFO:tasks.workunit.client.0.smithi123.stdout:7/21: creat d0/f4 x:0 0 0 2024-02-20T08:05:18.238 INFO:tasks.workunit.client.0.smithi123.stdout:7/22: creat d0/f5 x:0 0 0 2024-02-20T08:05:18.238 INFO:tasks.workunit.client.0.smithi123.stdout:7/23: readlink - no filename 2024-02-20T08:05:18.620 INFO:tasks.workunit.client.0.smithi123.stdout:1/26: sync 2024-02-20T08:05:18.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:18 smithi194 ceph-mon[37804]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.8 MiB/s wr, 91 op/s 2024-02-20T08:05:18.668 INFO:tasks.workunit.client.0.smithi123.stdout:0/53: sync 2024-02-20T08:05:18.668 INFO:tasks.workunit.client.0.smithi123.stdout:9/13: sync 2024-02-20T08:05:18.668 INFO:tasks.workunit.client.0.smithi123.stdout:6/99: sync 2024-02-20T08:05:18.668 INFO:tasks.workunit.client.0.smithi123.stdout:5/14: sync 2024-02-20T08:05:18.668 INFO:tasks.workunit.client.0.smithi123.stdout:5/15: truncate - no filename 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:5/16: write - no filename 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:5/17: dread - no filename 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:4/23: sync 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:2/53: sync 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:8/42: sync 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:3/24: sync 2024-02-20T08:05:18.669 INFO:tasks.workunit.client.0.smithi123.stdout:6/100: chown d0/f17 7016669 1 2024-02-20T08:05:18.670 INFO:tasks.workunit.client.0.smithi123.stdout:2/54: creat fe x:0 0 0 2024-02-20T08:05:18.672 INFO:tasks.workunit.client.0.smithi123.stdout:8/43: creat d6/fc x:0 0 0 2024-02-20T08:05:18.673 INFO:tasks.workunit.client.0.smithi123.stdout:4/24: fsync d3/f6 0 2024-02-20T08:05:18.703 INFO:tasks.workunit.client.0.smithi123.stdout:3/25: truncate d0/d6/d7/f8 1161535 0 2024-02-20T08:05:18.704 INFO:tasks.workunit.client.0.smithi123.stdout:4/25: rename d3/f6 to d3/f8 0 2024-02-20T08:05:18.707 INFO:tasks.workunit.client.0.smithi123.stdout:5/18: link d0/l2 d0/l4 0 2024-02-20T08:05:18.707 INFO:tasks.workunit.client.0.smithi123.stdout:5/19: dread - no filename 2024-02-20T08:05:18.707 INFO:tasks.workunit.client.0.smithi123.stdout:5/20: write - no filename 2024-02-20T08:05:18.711 INFO:tasks.workunit.client.0.smithi123.stdout:5/21: chown d0/l3 0 1 2024-02-20T08:05:18.712 INFO:tasks.workunit.client.0.smithi123.stdout:4/26: link d3/c5 d3/c9 0 2024-02-20T08:05:18.713 INFO:tasks.workunit.client.0.smithi123.stdout:3/26: getdents d0/d6 0 2024-02-20T08:05:18.750 INFO:tasks.workunit.client.0.smithi123.stdout:7/24: fsync d0/f5 0 2024-02-20T08:05:18.750 INFO:tasks.workunit.client.0.smithi123.stdout:7/25: chown d0/f4 38944178 1 2024-02-20T08:05:18.751 INFO:tasks.workunit.client.0.smithi123.stdout:7/26: rmdir d0 39 2024-02-20T08:05:18.753 INFO:tasks.workunit.client.0.smithi123.stdout:7/27: mkdir d0/d6 0 2024-02-20T08:05:18.755 INFO:tasks.workunit.client.0.smithi123.stdout:7/28: mkdir d0/d6/d7 0 2024-02-20T08:05:18.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:18 smithi123 ceph-mon[29383]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 5.8 MiB/s wr, 91 op/s 2024-02-20T08:05:18.927 INFO:tasks.workunit.client.0.smithi123.stdout:1/27: write d3/fa [706204,77090] 0 2024-02-20T08:05:18.930 INFO:tasks.workunit.client.0.smithi123.stdout:0/54: write d2/fc [2355075,11606] 0 2024-02-20T08:05:18.931 INFO:tasks.workunit.client.0.smithi123.stdout:2/55: write f5 [78648,110846] 0 2024-02-20T08:05:18.932 INFO:tasks.workunit.client.0.smithi123.stdout:3/27: truncate d0/d6/d7/f8 1441536 0 2024-02-20T08:05:18.936 INFO:tasks.workunit.client.0.smithi123.stdout:2/56: truncate f5 1902090 0 2024-02-20T08:05:18.936 INFO:tasks.workunit.client.0.smithi123.stdout:0/55: unlink d2/d3/c5 0 2024-02-20T08:05:18.940 INFO:tasks.workunit.client.0.smithi123.stdout:2/57: write f5 [1898431,59201] 0 2024-02-20T08:05:18.942 INFO:tasks.workunit.client.0.smithi123.stdout:0/56: fsync f1 0 2024-02-20T08:05:18.945 INFO:tasks.workunit.client.0.smithi123.stdout:1/28: dwrite d3/fa [0,4194304] 0 2024-02-20T08:05:18.948 INFO:tasks.workunit.client.0.smithi123.stdout:6/101: dwrite d0/f1c [0,4194304] 0 2024-02-20T08:05:18.949 INFO:tasks.workunit.client.0.smithi123.stdout:8/44: dwrite d6/fa [0,4194304] 0 2024-02-20T08:05:18.951 INFO:tasks.workunit.client.0.smithi123.stdout:2/58: symlink lf 0 2024-02-20T08:05:18.954 INFO:tasks.workunit.client.0.smithi123.stdout:4/27: getdents d3 0 2024-02-20T08:05:18.956 INFO:tasks.workunit.client.0.smithi123.stdout:0/57: rename d2/d3/f7 to d2/f15 0 2024-02-20T08:05:18.956 INFO:tasks.workunit.client.0.smithi123.stdout:4/28: rename d3 to d3/da 22 2024-02-20T08:05:18.957 INFO:tasks.workunit.client.0.smithi123.stdout:1/29: truncate d3/f5 471268 0 2024-02-20T08:05:18.960 INFO:tasks.workunit.client.0.smithi123.stdout:6/102: fsync d0/f17 0 2024-02-20T08:05:18.962 INFO:tasks.workunit.client.0.smithi123.stdout:8/45: creat d6/fd x:0 0 0 2024-02-20T08:05:18.963 INFO:tasks.workunit.client.0.smithi123.stdout:7/29: getdents d0 0 2024-02-20T08:05:18.963 INFO:tasks.workunit.client.0.smithi123.stdout:7/30: stat d0/f3 0 2024-02-20T08:05:18.964 INFO:tasks.workunit.client.0.smithi123.stdout:8/46: truncate d6/fc 9949 0 2024-02-20T08:05:18.972 INFO:tasks.workunit.client.0.smithi123.stdout:6/103: rename d0/f1c to d0/f1e 0 2024-02-20T08:05:18.974 INFO:tasks.workunit.client.0.smithi123.stdout:8/47: mknod d6/ce 0 2024-02-20T08:05:18.975 INFO:tasks.workunit.client.0.smithi123.stdout:7/31: symlink d0/d6/l8 0 2024-02-20T08:05:18.976 INFO:tasks.workunit.client.0.smithi123.stdout:7/32: chown d0/d6/l8 1 1 2024-02-20T08:05:18.977 INFO:tasks.workunit.client.0.smithi123.stdout:7/33: truncate d0/f4 115333 0 2024-02-20T08:05:18.980 INFO:tasks.workunit.client.0.smithi123.stdout:6/104: fsync d0/f18 0 2024-02-20T08:05:18.983 INFO:tasks.workunit.client.0.smithi123.stdout:7/34: mknod d0/d6/c9 0 2024-02-20T08:05:18.987 INFO:tasks.workunit.client.0.smithi123.stdout:3/28: dread d0/d6/d7/f8 [0,4194304] 0 2024-02-20T08:05:18.987 INFO:tasks.workunit.client.0.smithi123.stdout:6/105: symlink d0/l1f 0 2024-02-20T08:05:18.988 INFO:tasks.workunit.client.0.smithi123.stdout:0/58: write f1 [1679757,105288] 0 2024-02-20T08:05:18.990 INFO:tasks.workunit.client.0.smithi123.stdout:5/22: sync 2024-02-20T08:05:18.990 INFO:tasks.workunit.client.0.smithi123.stdout:5/23: write - no filename 2024-02-20T08:05:18.990 INFO:tasks.workunit.client.0.smithi123.stdout:9/14: sync 2024-02-20T08:05:18.990 INFO:tasks.workunit.client.0.smithi123.stdout:5/24: dwrite - no filename 2024-02-20T08:05:18.991 INFO:tasks.workunit.client.0.smithi123.stdout:7/35: symlink d0/la 0 2024-02-20T08:05:18.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/36: fsync d0/f3 0 2024-02-20T08:05:18.992 INFO:tasks.workunit.client.0.smithi123.stdout:6/106: fsync d0/f13 0 2024-02-20T08:05:18.994 INFO:tasks.workunit.client.0.smithi123.stdout:8/48: link c5 d6/cf 0 2024-02-20T08:05:18.996 INFO:tasks.workunit.client.0.smithi123.stdout:8/49: read d6/fc [3883,104486] 0 2024-02-20T08:05:18.998 INFO:tasks.workunit.client.0.smithi123.stdout:9/15: dwrite f1 [4194304,4194304] 0 2024-02-20T08:05:18.998 INFO:tasks.workunit.client.0.smithi123.stdout:8/50: chown d6/fa 286 1 2024-02-20T08:05:18.999 INFO:tasks.workunit.client.0.smithi123.stdout:2/59: getdents . 0 2024-02-20T08:05:19.000 INFO:tasks.workunit.client.0.smithi123.stdout:2/60: chown fb 0 1 2024-02-20T08:05:19.000 INFO:tasks.workunit.client.0.smithi123.stdout:9/16: write f1 [6641735,96543] 0 2024-02-20T08:05:19.000 INFO:tasks.workunit.client.0.smithi123.stdout:5/25: symlink d0/l5 0 2024-02-20T08:05:19.000 INFO:tasks.workunit.client.0.smithi123.stdout:5/26: dread - no filename 2024-02-20T08:05:19.006 INFO:tasks.workunit.client.0.smithi123.stdout:7/37: mkdir d0/db 0 2024-02-20T08:05:19.009 INFO:tasks.workunit.client.0.smithi123.stdout:6/107: symlink d0/l20 0 2024-02-20T08:05:19.015 INFO:tasks.workunit.client.0.smithi123.stdout:7/38: dwrite d0/f3 [0,4194304] 0 2024-02-20T08:05:19.018 INFO:tasks.workunit.client.0.smithi123.stdout:7/39: write d0/f5 [958638,83229] 0 2024-02-20T08:05:19.019 INFO:tasks.workunit.client.0.smithi123.stdout:7/40: chown d0/d6/c9 164697094 1 2024-02-20T08:05:19.021 INFO:tasks.workunit.client.0.smithi123.stdout:2/61: creat f10 x:0 0 0 2024-02-20T08:05:19.024 INFO:tasks.workunit.client.0.smithi123.stdout:4/29: dwrite d3/f8 [0,4194304] 0 2024-02-20T08:05:19.024 INFO:tasks.workunit.client.0.smithi123.stdout:9/17: mkdir d3 0 2024-02-20T08:05:19.024 INFO:tasks.workunit.client.0.smithi123.stdout:2/62: read f5 [1077788,75830] 0 2024-02-20T08:05:19.026 INFO:tasks.workunit.client.0.smithi123.stdout:5/27: mknod d0/c6 0 2024-02-20T08:05:19.030 INFO:tasks.workunit.client.0.smithi123.stdout:6/108: rename d0/f19 to d0/f21 0 2024-02-20T08:05:19.040 INFO:tasks.workunit.client.0.smithi123.stdout:4/30: mknod d3/cb 0 2024-02-20T08:05:19.040 INFO:tasks.workunit.client.0.smithi123.stdout:0/59: write d2/d3/f9 [2135420,68559] 0 2024-02-20T08:05:19.046 INFO:tasks.workunit.client.0.smithi123.stdout:6/109: creat d0/f22 x:0 0 0 2024-02-20T08:05:19.048 INFO:tasks.workunit.client.0.smithi123.stdout:7/41: symlink d0/db/lc 0 2024-02-20T08:05:19.049 INFO:tasks.workunit.client.0.smithi123.stdout:3/29: truncate d0/d6/d7/f8 263945 0 2024-02-20T08:05:19.052 INFO:tasks.workunit.client.0.smithi123.stdout:1/30: dwrite d3/f5 [0,4194304] 0 2024-02-20T08:05:19.058 INFO:tasks.workunit.client.0.smithi123.stdout:4/31: chown d3/c9 588 1 2024-02-20T08:05:19.060 INFO:tasks.workunit.client.0.smithi123.stdout:1/31: dwrite d3/fa [0,4194304] 0 2024-02-20T08:05:19.063 INFO:tasks.workunit.client.0.smithi123.stdout:6/110: creat d0/f23 x:0 0 0 2024-02-20T08:05:19.065 INFO:tasks.workunit.client.0.smithi123.stdout:7/42: mkdir d0/d6/dd 0 2024-02-20T08:05:19.066 INFO:tasks.workunit.client.0.smithi123.stdout:3/30: mkdir d0/d6/da 0 2024-02-20T08:05:19.067 INFO:tasks.workunit.client.0.smithi123.stdout:4/32: dwrite d3/f8 [0,4194304] 0 2024-02-20T08:05:19.067 INFO:tasks.workunit.client.0.smithi123.stdout:3/31: chown d0/l4 238134526 1 2024-02-20T08:05:19.072 INFO:tasks.workunit.client.0.smithi123.stdout:9/18: rmdir d3 0 2024-02-20T08:05:19.072 INFO:tasks.workunit.client.0.smithi123.stdout:9/19: rmdir - no directory 2024-02-20T08:05:19.072 INFO:tasks.workunit.client.0.smithi123.stdout:4/33: dread d3/f8 [0,4194304] 0 2024-02-20T08:05:19.076 INFO:tasks.workunit.client.0.smithi123.stdout:2/63: link fc f11 0 2024-02-20T08:05:19.078 INFO:tasks.workunit.client.0.smithi123.stdout:5/28: link d0/c6 d0/c7 0 2024-02-20T08:05:19.080 INFO:tasks.workunit.client.0.smithi123.stdout:1/32: creat d3/fc x:0 0 0 2024-02-20T08:05:19.081 INFO:tasks.workunit.client.0.smithi123.stdout:1/33: write d3/fa [1427470,84696] 0 2024-02-20T08:05:19.085 INFO:tasks.workunit.client.0.smithi123.stdout:7/43: unlink d0/f3 0 2024-02-20T08:05:19.086 INFO:tasks.workunit.client.0.smithi123.stdout:7/44: fsync d0/f5 0 2024-02-20T08:05:19.088 INFO:tasks.workunit.client.0.smithi123.stdout:1/34: dwrite d3/f5 [0,4194304] 0 2024-02-20T08:05:19.094 INFO:tasks.workunit.client.0.smithi123.stdout:4/34: symlink d3/lc 0 2024-02-20T08:05:19.095 INFO:tasks.workunit.client.0.smithi123.stdout:7/45: dwrite d0/f4 [0,4194304] 0 2024-02-20T08:05:19.096 INFO:tasks.workunit.client.0.smithi123.stdout:7/46: readlink d0/db/lc 0 2024-02-20T08:05:19.099 INFO:tasks.workunit.client.0.smithi123.stdout:5/29: creat d0/f8 x:0 0 0 2024-02-20T08:05:19.105 INFO:tasks.workunit.client.0.smithi123.stdout:7/47: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:19.106 INFO:tasks.workunit.client.0.smithi123.stdout:7/48: rename d0/d6 to d0/d6/de 22 2024-02-20T08:05:19.112 INFO:tasks.workunit.client.0.smithi123.stdout:1/35: symlink d3/ld 0 2024-02-20T08:05:19.113 INFO:tasks.workunit.client.0.smithi123.stdout:1/36: write d3/fc [481779,3099] 0 2024-02-20T08:05:19.119 INFO:tasks.workunit.client.0.smithi123.stdout:4/35: creat d3/fd x:0 0 0 2024-02-20T08:05:19.119 INFO:tasks.workunit.client.0.smithi123.stdout:1/37: dwrite d3/f5 [0,4194304] 0 2024-02-20T08:05:19.123 INFO:tasks.workunit.client.0.smithi123.stdout:5/30: readlink d0/l2 0 2024-02-20T08:05:19.130 INFO:tasks.workunit.client.0.smithi123.stdout:4/36: symlink d3/le 0 2024-02-20T08:05:19.131 INFO:tasks.workunit.client.0.smithi123.stdout:6/111: dwrite d0/f1d [8388608,4194304] 0 2024-02-20T08:05:19.132 INFO:tasks.workunit.client.0.smithi123.stdout:4/37: dread - d3/fd zero size 2024-02-20T08:05:19.133 INFO:tasks.workunit.client.0.smithi123.stdout:5/31: dwrite d0/f8 [0,4194304] 0 2024-02-20T08:05:19.133 INFO:tasks.workunit.client.0.smithi123.stdout:5/32: readlink d0/l3 0 2024-02-20T08:05:19.134 INFO:tasks.workunit.client.0.smithi123.stdout:5/33: read d0/f8 [1707477,102374] 0 2024-02-20T08:05:19.135 INFO:tasks.workunit.client.0.smithi123.stdout:2/64: link lf l12 0 2024-02-20T08:05:19.136 INFO:tasks.workunit.client.0.smithi123.stdout:7/49: mknod d0/d6/dd/cf 0 2024-02-20T08:05:19.139 INFO:tasks.workunit.client.0.smithi123.stdout:3/32: dread d0/d6/d7/f8 [0,4194304] 0 2024-02-20T08:05:19.143 INFO:tasks.workunit.client.0.smithi123.stdout:1/38: getdents d3/db 0 2024-02-20T08:05:19.143 INFO:tasks.workunit.client.0.smithi123.stdout:5/34: dwrite d0/f8 [0,4194304] 0 2024-02-20T08:05:19.145 INFO:tasks.workunit.client.0.smithi123.stdout:6/112: truncate d0/f18 330352 0 2024-02-20T08:05:19.156 INFO:tasks.workunit.client.0.smithi123.stdout:3/33: rename d0/d6/da to d0/db 0 2024-02-20T08:05:19.159 INFO:tasks.workunit.client.0.smithi123.stdout:1/39: unlink c0 0 2024-02-20T08:05:19.161 INFO:tasks.workunit.client.0.smithi123.stdout:1/40: dread d3/fc [0,4194304] 0 2024-02-20T08:05:19.162 INFO:tasks.workunit.client.0.smithi123.stdout:5/35: rmdir d0 39 2024-02-20T08:05:19.168 INFO:tasks.workunit.client.0.smithi123.stdout:7/50: mkdir d0/d6/d7/d10 0 2024-02-20T08:05:19.169 INFO:tasks.workunit.client.0.smithi123.stdout:7/51: chown d0/f5 88619 1 2024-02-20T08:05:19.169 INFO:tasks.workunit.client.0.smithi123.stdout:7/52: readlink d0/la 0 2024-02-20T08:05:19.170 INFO:tasks.workunit.client.0.smithi123.stdout:7/53: chown d0/db/lc 0 1 2024-02-20T08:05:19.181 INFO:tasks.workunit.client.0.smithi123.stdout:6/113: fsync d0/f21 0 2024-02-20T08:05:19.181 INFO:tasks.workunit.client.0.smithi123.stdout:6/114: chown d0/f21 16693 1 2024-02-20T08:05:19.182 INFO:tasks.workunit.client.0.smithi123.stdout:4/38: link d3/f8 d3/ff 0 2024-02-20T08:05:19.183 INFO:tasks.workunit.client.0.smithi123.stdout:4/39: stat d3/l4 0 2024-02-20T08:05:19.185 INFO:tasks.workunit.client.0.smithi123.stdout:7/54: symlink d0/l11 0 2024-02-20T08:05:19.190 INFO:tasks.workunit.client.0.smithi123.stdout:2/65: dwrite fb [0,4194304] 0 2024-02-20T08:05:19.190 INFO:tasks.workunit.client.0.smithi123.stdout:2/66: chown l4 1258 1 2024-02-20T08:05:19.202 INFO:tasks.workunit.client.0.smithi123.stdout:7/55: rename d0/d6/dd/cf to d0/d6/d7/c12 0 2024-02-20T08:05:19.203 INFO:tasks.workunit.client.0.smithi123.stdout:3/34: write d0/d6/f9 [582033,102002] 0 2024-02-20T08:05:19.203 INFO:tasks.workunit.client.0.smithi123.stdout:7/56: chown d0/d6 16187632 1 2024-02-20T08:05:19.203 INFO:tasks.workunit.client.0.smithi123.stdout:3/35: chown d0 23512 1 2024-02-20T08:05:19.204 INFO:tasks.workunit.client.0.smithi123.stdout:3/36: write d0/d6/f9 [652979,19071] 0 2024-02-20T08:05:19.208 INFO:tasks.workunit.client.0.smithi123.stdout:5/36: rename d0/c7 to d0/c9 0 2024-02-20T08:05:19.214 INFO:tasks.workunit.client.0.smithi123.stdout:7/57: symlink d0/l13 0 2024-02-20T08:05:19.214 INFO:tasks.workunit.client.0.smithi123.stdout:7/58: write d0/f4 [852867,72935] 0 2024-02-20T08:05:19.220 INFO:tasks.workunit.client.0.smithi123.stdout:5/37: write d0/f8 [4411883,54861] 0 2024-02-20T08:05:19.221 INFO:tasks.workunit.client.0.smithi123.stdout:1/41: getdents d3 0 2024-02-20T08:05:19.222 INFO:tasks.workunit.client.0.smithi123.stdout:1/42: write d3/f5 [3835760,44032] 0 2024-02-20T08:05:19.223 INFO:tasks.workunit.client.0.smithi123.stdout:6/115: link d0/l1f d0/l24 0 2024-02-20T08:05:19.224 INFO:tasks.workunit.client.0.smithi123.stdout:6/116: fdatasync d0/f22 0 2024-02-20T08:05:19.230 INFO:tasks.workunit.client.0.smithi123.stdout:7/59: symlink d0/d6/d7/l14 0 2024-02-20T08:05:19.238 INFO:tasks.workunit.client.0.smithi123.stdout:1/43: mkdir d3/de 0 2024-02-20T08:05:19.240 INFO:tasks.workunit.client.0.smithi123.stdout:4/40: link d3/f8 d3/f10 0 2024-02-20T08:05:19.242 INFO:tasks.workunit.client.0.smithi123.stdout:7/60: mkdir d0/d6/dd/d15 0 2024-02-20T08:05:19.243 INFO:tasks.workunit.client.0.smithi123.stdout:2/67: link lf l13 0 2024-02-20T08:05:19.243 INFO:tasks.workunit.client.0.smithi123.stdout:7/61: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:19.246 INFO:tasks.workunit.client.0.smithi123.stdout:5/38: rename d0/c9 to d0/ca 0 2024-02-20T08:05:19.246 INFO:tasks.workunit.client.0.smithi123.stdout:5/39: chown d0/l3 72 1 2024-02-20T08:05:19.247 INFO:tasks.workunit.client.0.smithi123.stdout:1/44: mkdir d3/df 0 2024-02-20T08:05:19.249 INFO:tasks.workunit.client.0.smithi123.stdout:4/41: symlink d3/l11 0 2024-02-20T08:05:19.249 INFO:tasks.workunit.client.0.smithi123.stdout:5/40: dread d0/f8 [0,4194304] 0 2024-02-20T08:05:19.252 INFO:tasks.workunit.client.0.smithi123.stdout:7/62: creat d0/d6/d7/f16 x:0 0 0 2024-02-20T08:05:19.253 INFO:tasks.workunit.client.0.smithi123.stdout:3/37: getdents d0 0 2024-02-20T08:05:19.253 INFO:tasks.workunit.client.0.smithi123.stdout:7/63: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:19.254 INFO:tasks.workunit.client.0.smithi123.stdout:7/64: fdatasync d0/f4 0 2024-02-20T08:05:19.257 INFO:tasks.workunit.client.0.smithi123.stdout:1/45: creat d3/f10 x:0 0 0 2024-02-20T08:05:19.260 INFO:tasks.workunit.client.0.smithi123.stdout:4/42: creat d3/f12 x:0 0 0 2024-02-20T08:05:19.261 INFO:tasks.workunit.client.0.smithi123.stdout:5/41: rmdir d0 39 2024-02-20T08:05:19.264 INFO:tasks.workunit.client.0.smithi123.stdout:3/38: fsync d0/d6/d7/f8 0 2024-02-20T08:05:19.269 INFO:tasks.workunit.client.0.smithi123.stdout:7/65: chown d0/d6/d7/c12 1 1 2024-02-20T08:05:19.274 INFO:tasks.workunit.client.0.smithi123.stdout:6/117: getdents d0 0 2024-02-20T08:05:19.286 INFO:tasks.workunit.client.0.smithi123.stdout:7/66: rename d0/la to d0/d6/dd/d15/l17 0 2024-02-20T08:05:19.287 INFO:tasks.workunit.client.0.smithi123.stdout:1/46: creat d3/df/f11 x:0 0 0 2024-02-20T08:05:19.288 INFO:tasks.workunit.client.0.smithi123.stdout:1/47: chown d3/df/f11 183 1 2024-02-20T08:05:19.289 INFO:tasks.workunit.client.0.smithi123.stdout:6/118: mkdir d0/d25 0 2024-02-20T08:05:19.293 INFO:tasks.workunit.client.0.smithi123.stdout:5/42: read d0/f8 [4117352,10917] 0 2024-02-20T08:05:19.293 INFO:tasks.workunit.client.0.smithi123.stdout:2/68: write f11 [3932809,89286] 0 2024-02-20T08:05:19.295 INFO:tasks.workunit.client.0.smithi123.stdout:1/48: dwrite d3/f5 [4194304,4194304] 0 2024-02-20T08:05:19.296 INFO:tasks.workunit.client.0.smithi123.stdout:2/69: fdatasync f11 0 2024-02-20T08:05:19.297 INFO:tasks.workunit.client.0.smithi123.stdout:7/67: mknod d0/d6/dd/c18 0 2024-02-20T08:05:19.298 INFO:tasks.workunit.client.0.smithi123.stdout:7/68: write d0/f5 [265589,28753] 0 2024-02-20T08:05:19.301 INFO:tasks.workunit.client.0.smithi123.stdout:6/119: symlink d0/l26 0 2024-02-20T08:05:19.302 INFO:tasks.workunit.client.0.smithi123.stdout:7/69: dread d0/f4 [0,4194304] 0 2024-02-20T08:05:19.306 INFO:tasks.workunit.client.0.smithi123.stdout:3/39: truncate d0/d6/d7/f8 1060343 0 2024-02-20T08:05:19.308 INFO:tasks.workunit.client.0.smithi123.stdout:3/40: write d0/d6/f9 [1059286,52523] 0 2024-02-20T08:05:19.312 INFO:tasks.workunit.client.0.smithi123.stdout:1/49: symlink d3/df/l12 0 2024-02-20T08:05:19.315 INFO:tasks.workunit.client.0.smithi123.stdout:6/120: readlink d0/l1f 0 2024-02-20T08:05:19.320 INFO:tasks.workunit.client.0.smithi123.stdout:4/43: dwrite d3/ff [0,4194304] 0 2024-02-20T08:05:19.321 INFO:tasks.workunit.client.0.smithi123.stdout:4/44: dread - d3/f12 zero size 2024-02-20T08:05:19.321 INFO:tasks.workunit.client.0.smithi123.stdout:3/41: symlink d0/lc 0 2024-02-20T08:05:19.323 INFO:tasks.workunit.client.0.smithi123.stdout:9/20: sync 2024-02-20T08:05:19.323 INFO:tasks.workunit.client.0.smithi123.stdout:0/60: sync 2024-02-20T08:05:19.324 INFO:tasks.workunit.client.0.smithi123.stdout:8/51: sync 2024-02-20T08:05:19.324 INFO:tasks.workunit.client.0.smithi123.stdout:9/21: fsync f1 0 2024-02-20T08:05:19.324 INFO:tasks.workunit.client.0.smithi123.stdout:0/61: stat d2/c14 0 2024-02-20T08:05:19.325 INFO:tasks.workunit.client.0.smithi123.stdout:0/62: chown f1 1980 1 2024-02-20T08:05:19.326 INFO:tasks.workunit.client.0.smithi123.stdout:4/45: dread d3/f10 [0,4194304] 0 2024-02-20T08:05:19.326 INFO:tasks.workunit.client.0.smithi123.stdout:4/46: chown d3/l11 1349 1 2024-02-20T08:05:19.326 INFO:tasks.workunit.client.0.smithi123.stdout:4/47: chown d3/fd 13924443 1 2024-02-20T08:05:19.329 INFO:tasks.workunit.client.0.smithi123.stdout:6/121: fsync d0/f1e 0 2024-02-20T08:05:19.333 INFO:tasks.workunit.client.0.smithi123.stdout:4/48: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:19.335 INFO:tasks.workunit.client.0.smithi123.stdout:5/43: link d0/l2 d0/lb 0 2024-02-20T08:05:19.339 INFO:tasks.workunit.client.0.smithi123.stdout:8/52: symlink d6/l10 0 2024-02-20T08:05:19.341 INFO:tasks.workunit.client.0.smithi123.stdout:1/50: creat d3/de/f13 x:0 0 0 2024-02-20T08:05:19.342 INFO:tasks.workunit.client.0.smithi123.stdout:1/51: dread - d3/df/f11 zero size 2024-02-20T08:05:19.342 INFO:tasks.workunit.client.0.smithi123.stdout:1/52: fdatasync d3/f10 0 2024-02-20T08:05:19.346 INFO:tasks.workunit.client.0.smithi123.stdout:2/70: link l4 l14 0 2024-02-20T08:05:19.347 INFO:tasks.workunit.client.0.smithi123.stdout:2/71: write f11 [4136277,6437] 0 2024-02-20T08:05:19.355 INFO:tasks.workunit.client.0.smithi123.stdout:7/70: truncate d0/f5 172619 0 2024-02-20T08:05:19.360 INFO:tasks.workunit.client.0.smithi123.stdout:4/49: dwrite d3/f8 [4194304,4194304] 0 2024-02-20T08:05:19.361 INFO:tasks.workunit.client.0.smithi123.stdout:8/53: mknod d6/c11 0 2024-02-20T08:05:19.367 INFO:tasks.workunit.client.0.smithi123.stdout:9/22: truncate f1 3512482 0 2024-02-20T08:05:19.368 INFO:tasks.workunit.client.0.smithi123.stdout:4/50: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:19.371 INFO:tasks.workunit.client.0.smithi123.stdout:0/63: write d2/d3/ff [751015,90271] 0 2024-02-20T08:05:19.373 INFO:tasks.workunit.client.0.smithi123.stdout:2/72: creat f15 x:0 0 0 2024-02-20T08:05:19.374 INFO:tasks.workunit.client.0.smithi123.stdout:4/51: write d3/fd [4911017,98905] 0 2024-02-20T08:05:19.386 INFO:tasks.workunit.client.0.smithi123.stdout:3/42: dwrite d0/d6/d7/f8 [0,4194304] 0 2024-02-20T08:05:19.393 INFO:tasks.workunit.client.0.smithi123.stdout:9/23: rename f2 to f4 0 2024-02-20T08:05:19.397 INFO:tasks.workunit.client.0.smithi123.stdout:1/53: dwrite d3/fc [0,4194304] 0 2024-02-20T08:05:19.399 INFO:tasks.workunit.client.0.smithi123.stdout:1/54: write d3/de/f13 [935536,35749] 0 2024-02-20T08:05:19.401 INFO:tasks.workunit.client.0.smithi123.stdout:1/55: write d3/df/f11 [579577,99279] 0 2024-02-20T08:05:19.403 INFO:tasks.workunit.client.0.smithi123.stdout:2/73: symlink l16 0 2024-02-20T08:05:19.405 INFO:tasks.workunit.client.0.smithi123.stdout:5/44: truncate d0/f8 13105 0 2024-02-20T08:05:19.406 INFO:tasks.workunit.client.0.smithi123.stdout:4/52: symlink d3/l13 0 2024-02-20T08:05:19.407 INFO:tasks.workunit.client.0.smithi123.stdout:6/122: rmdir d0/d25 0 2024-02-20T08:05:19.410 INFO:tasks.workunit.client.0.smithi123.stdout:7/71: getdents d0/d6/d7/d10 0 2024-02-20T08:05:19.414 INFO:tasks.workunit.client.0.smithi123.stdout:3/43: rename d0/d6/d7 to d0/dd 0 2024-02-20T08:05:19.415 INFO:tasks.workunit.client.0.smithi123.stdout:7/72: dwrite d0/f4 [0,4194304] 0 2024-02-20T08:05:19.417 INFO:tasks.workunit.client.0.smithi123.stdout:8/54: link d6/fa d6/f12 0 2024-02-20T08:05:19.420 INFO:tasks.workunit.client.0.smithi123.stdout:9/24: creat f5 x:0 0 0 2024-02-20T08:05:19.421 INFO:tasks.workunit.client.0.smithi123.stdout:9/25: chown c0 793352599 1 2024-02-20T08:05:19.421 INFO:tasks.workunit.client.0.smithi123.stdout:9/26: fdatasync f5 0 2024-02-20T08:05:19.424 INFO:tasks.workunit.client.0.smithi123.stdout:0/64: getdents d2/de 0 2024-02-20T08:05:19.427 INFO:tasks.workunit.client.0.smithi123.stdout:0/65: dread f1 [0,4194304] 0 2024-02-20T08:05:19.428 INFO:tasks.workunit.client.0.smithi123.stdout:1/56: rmdir d3/de 39 2024-02-20T08:05:19.428 INFO:tasks.workunit.client.0.smithi123.stdout:0/66: readlink d2/dd/l13 0 2024-02-20T08:05:19.433 INFO:tasks.workunit.client.0.smithi123.stdout:2/74: truncate f5 2252181 0 2024-02-20T08:05:19.433 INFO:tasks.workunit.client.0.smithi123.stdout:2/75: fsync f10 0 2024-02-20T08:05:19.437 INFO:tasks.workunit.client.0.smithi123.stdout:4/53: symlink d3/l14 0 2024-02-20T08:05:19.439 INFO:tasks.workunit.client.0.smithi123.stdout:6/123: truncate d0/f21 762379 0 2024-02-20T08:05:19.442 INFO:tasks.workunit.client.0.smithi123.stdout:3/44: mkdir d0/dd/de 0 2024-02-20T08:05:19.444 INFO:tasks.workunit.client.0.smithi123.stdout:6/124: dwrite d0/f1e [0,4194304] 0 2024-02-20T08:05:19.447 INFO:tasks.workunit.client.0.smithi123.stdout:8/55: mknod d6/c13 0 2024-02-20T08:05:19.449 INFO:tasks.workunit.client.0.smithi123.stdout:9/27: mkdir d6 0 2024-02-20T08:05:19.452 INFO:tasks.workunit.client.0.smithi123.stdout:1/57: unlink l1 0 2024-02-20T08:05:19.460 INFO:tasks.workunit.client.0.smithi123.stdout:1/58: dwrite d3/f5 [8388608,4194304] 0 2024-02-20T08:05:19.460 INFO:tasks.workunit.client.0.smithi123.stdout:4/54: rename d3/l14 to d3/l15 0 2024-02-20T08:05:19.460 INFO:tasks.workunit.client.0.smithi123.stdout:1/59: dread - d3/f10 zero size 2024-02-20T08:05:19.464 INFO:tasks.workunit.client.0.smithi123.stdout:3/45: creat d0/d6/ff x:0 0 0 2024-02-20T08:05:19.466 INFO:tasks.workunit.client.0.smithi123.stdout:3/46: fdatasync d0/dd/f8 0 2024-02-20T08:05:19.467 INFO:tasks.workunit.client.0.smithi123.stdout:6/125: mknod d0/c27 0 2024-02-20T08:05:19.467 INFO:tasks.workunit.client.0.smithi123.stdout:3/47: chown d0/lc 12 1 2024-02-20T08:05:19.469 INFO:tasks.workunit.client.0.smithi123.stdout:8/56: symlink d6/l14 0 2024-02-20T08:05:19.469 INFO:tasks.workunit.client.0.smithi123.stdout:4/55: dwrite d3/ff [8388608,4194304] 0 2024-02-20T08:05:19.476 INFO:tasks.workunit.client.0.smithi123.stdout:0/67: mknod d2/de/c16 0 2024-02-20T08:05:19.478 INFO:tasks.workunit.client.0.smithi123.stdout:7/73: fsync d0/f5 0 2024-02-20T08:05:19.479 INFO:tasks.workunit.client.0.smithi123.stdout:7/74: write d0/d6/d7/f16 [699647,5564] 0 2024-02-20T08:05:19.494 INFO:tasks.workunit.client.0.smithi123.stdout:3/48: mkdir d0/dd/d10 0 2024-02-20T08:05:19.497 INFO:tasks.workunit.client.0.smithi123.stdout:4/56: symlink d3/l16 0 2024-02-20T08:05:19.504 INFO:tasks.workunit.client.0.smithi123.stdout:7/75: mknod d0/d6/dd/c19 0 2024-02-20T08:05:19.507 INFO:tasks.workunit.client.0.smithi123.stdout:1/60: mkdir d3/de/d14 0 2024-02-20T08:05:19.510 INFO:tasks.workunit.client.0.smithi123.stdout:3/49: mknod d0/c11 0 2024-02-20T08:05:19.511 INFO:tasks.workunit.client.0.smithi123.stdout:3/50: dread - d0/d6/ff zero size 2024-02-20T08:05:19.514 INFO:tasks.workunit.client.0.smithi123.stdout:4/57: symlink d3/l17 0 2024-02-20T08:05:19.516 INFO:tasks.workunit.client.0.smithi123.stdout:4/58: write d3/fd [26131,53587] 0 2024-02-20T08:05:19.520 INFO:tasks.workunit.client.0.smithi123.stdout:8/57: dwrite d6/fa [0,4194304] 0 2024-02-20T08:05:19.522 INFO:tasks.workunit.client.0.smithi123.stdout:5/45: truncate d0/f8 938375 0 2024-02-20T08:05:19.524 INFO:tasks.workunit.client.0.smithi123.stdout:9/28: dwrite f1 [0,4194304] 0 2024-02-20T08:05:19.525 INFO:tasks.workunit.client.0.smithi123.stdout:2/76: truncate f5 2847424 0 2024-02-20T08:05:19.526 INFO:tasks.workunit.client.0.smithi123.stdout:2/77: write fe [812072,125260] 0 2024-02-20T08:05:19.532 INFO:tasks.workunit.client.0.smithi123.stdout:3/51: creat d0/db/f12 x:0 0 0 2024-02-20T08:05:19.537 INFO:tasks.workunit.client.0.smithi123.stdout:4/59: mkdir d3/d18 0 2024-02-20T08:05:19.538 INFO:tasks.workunit.client.0.smithi123.stdout:0/68: write d2/f15 [830556,67698] 0 2024-02-20T08:05:19.540 INFO:tasks.workunit.client.0.smithi123.stdout:8/58: creat d6/f15 x:0 0 0 2024-02-20T08:05:19.542 INFO:tasks.workunit.client.0.smithi123.stdout:9/29: unlink f4 0 2024-02-20T08:05:19.544 INFO:tasks.workunit.client.0.smithi123.stdout:1/61: mkdir d3/de/d14/d15 0 2024-02-20T08:05:19.545 INFO:tasks.workunit.client.0.smithi123.stdout:6/126: getdents d0 0 2024-02-20T08:05:19.549 INFO:tasks.workunit.client.0.smithi123.stdout:6/127: dread d0/f17 [0,4194304] 0 2024-02-20T08:05:19.550 INFO:tasks.workunit.client.0.smithi123.stdout:0/69: rename f1 to d2/de/f17 0 2024-02-20T08:05:19.551 INFO:tasks.workunit.client.0.smithi123.stdout:8/59: symlink d6/l16 0 2024-02-20T08:05:19.554 INFO:tasks.workunit.client.0.smithi123.stdout:1/62: symlink d3/de/d14/l16 0 2024-02-20T08:05:19.559 INFO:tasks.workunit.client.0.smithi123.stdout:4/60: creat d3/d18/f19 x:0 0 0 2024-02-20T08:05:19.559 INFO:tasks.workunit.client.0.smithi123.stdout:4/61: write d3/f12 [654203,68660] 0 2024-02-20T08:05:19.560 INFO:tasks.workunit.client.0.smithi123.stdout:4/62: chown d3/lc 6858531 1 2024-02-20T08:05:19.560 INFO:tasks.workunit.client.0.smithi123.stdout:4/63: fdatasync d3/fd 0 2024-02-20T08:05:19.561 INFO:tasks.workunit.client.0.smithi123.stdout:6/128: creat d0/f28 x:0 0 0 2024-02-20T08:05:19.567 INFO:tasks.workunit.client.0.smithi123.stdout:9/30: mknod d6/c7 0 2024-02-20T08:05:19.567 INFO:tasks.workunit.client.0.smithi123.stdout:9/31: dread - f5 zero size 2024-02-20T08:05:19.572 INFO:tasks.workunit.client.0.smithi123.stdout:3/52: rmdir d0/dd/d10 0 2024-02-20T08:05:19.572 INFO:tasks.workunit.client.0.smithi123.stdout:3/53: readlink d0/lc 0 2024-02-20T08:05:19.576 INFO:tasks.workunit.client.0.smithi123.stdout:4/64: symlink d3/l1a 0 2024-02-20T08:05:19.577 INFO:tasks.workunit.client.0.smithi123.stdout:4/65: write d3/fd [1874722,56283] 0 2024-02-20T08:05:19.578 INFO:tasks.workunit.client.0.smithi123.stdout:6/129: creat d0/f29 x:0 0 0 2024-02-20T08:05:19.578 INFO:tasks.workunit.client.0.smithi123.stdout:6/130: dread - d0/f22 zero size 2024-02-20T08:05:19.579 INFO:tasks.workunit.client.0.smithi123.stdout:4/66: fdatasync d3/fd 0 2024-02-20T08:05:19.580 INFO:tasks.workunit.client.0.smithi123.stdout:4/67: chown d3/l13 346 1 2024-02-20T08:05:19.582 INFO:tasks.workunit.client.0.smithi123.stdout:6/131: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:19.584 INFO:tasks.workunit.client.0.smithi123.stdout:5/46: write d0/f8 [1732345,125914] 0 2024-02-20T08:05:19.585 INFO:tasks.workunit.client.0.smithi123.stdout:5/47: truncate d0/f8 2106754 0 2024-02-20T08:05:19.587 INFO:tasks.workunit.client.0.smithi123.stdout:5/48: fsync d0/f8 0 2024-02-20T08:05:19.587 INFO:tasks.workunit.client.0.smithi123.stdout:3/54: mknod d0/d6/c13 0 2024-02-20T08:05:19.592 INFO:tasks.workunit.client.0.smithi123.stdout:6/132: creat d0/f2a x:0 0 0 2024-02-20T08:05:19.594 INFO:tasks.workunit.client.0.smithi123.stdout:0/70: dwrite d2/f8 [4194304,4194304] 0 2024-02-20T08:05:19.598 INFO:tasks.workunit.client.0.smithi123.stdout:1/63: creat d3/f17 x:0 0 0 2024-02-20T08:05:19.599 INFO:tasks.workunit.client.0.smithi123.stdout:1/64: read d3/fc [329722,79313] 0 2024-02-20T08:05:19.603 INFO:tasks.workunit.client.0.smithi123.stdout:5/49: creat d0/fc x:0 0 0 2024-02-20T08:05:19.603 INFO:tasks.workunit.client.0.smithi123.stdout:5/50: chown d0/f8 200 1 2024-02-20T08:05:19.604 INFO:tasks.workunit.client.0.smithi123.stdout:3/55: creat d0/d6/f14 x:0 0 0 2024-02-20T08:05:19.605 INFO:tasks.workunit.client.0.smithi123.stdout:5/51: write d0/fc [947608,104114] 0 2024-02-20T08:05:19.607 INFO:tasks.workunit.client.0.smithi123.stdout:8/60: getdents d6 0 2024-02-20T08:05:19.610 INFO:tasks.workunit.client.0.smithi123.stdout:8/61: write d6/f12 [3086416,117347] 0 2024-02-20T08:05:19.611 INFO:tasks.workunit.client.0.smithi123.stdout:8/62: chown d6/l10 1 1 2024-02-20T08:05:19.612 INFO:tasks.workunit.client.0.smithi123.stdout:1/65: creat d3/df/f18 x:0 0 0 2024-02-20T08:05:19.613 INFO:tasks.workunit.client.0.smithi123.stdout:3/56: dwrite d0/d6/ff [0,4194304] 0 2024-02-20T08:05:19.614 INFO:tasks.workunit.client.0.smithi123.stdout:8/63: write d6/fa [4201282,87654] 0 2024-02-20T08:05:19.614 INFO:tasks.workunit.client.0.smithi123.stdout:1/66: write d3/f5 [13473969,75408] 0 2024-02-20T08:05:19.616 INFO:tasks.workunit.client.0.smithi123.stdout:1/67: chown d3/df/l12 9493906 1 2024-02-20T08:05:19.620 INFO:tasks.workunit.client.0.smithi123.stdout:4/68: getdents d3 0 2024-02-20T08:05:19.623 INFO:tasks.workunit.client.0.smithi123.stdout:4/69: dread d3/f10 [8388608,4194304] 0 2024-02-20T08:05:19.623 INFO:tasks.workunit.client.0.smithi123.stdout:9/32: truncate f1 2804854 0 2024-02-20T08:05:19.624 INFO:tasks.workunit.client.0.smithi123.stdout:3/57: creat d0/db/f15 x:0 0 0 2024-02-20T08:05:19.626 INFO:tasks.workunit.client.0.smithi123.stdout:8/64: rename d6/l14 to d6/l17 0 2024-02-20T08:05:19.627 INFO:tasks.workunit.client.0.smithi123.stdout:8/65: chown d6/f12 18278742 1 2024-02-20T08:05:19.640 INFO:tasks.workunit.client.0.smithi123.stdout:4/70: creat d3/f1b x:0 0 0 2024-02-20T08:05:19.641 INFO:tasks.workunit.client.0.smithi123.stdout:1/68: link d3/fa d3/db/f19 0 2024-02-20T08:05:19.642 INFO:tasks.workunit.client.0.smithi123.stdout:8/66: write d6/fa [4178557,61198] 0 2024-02-20T08:05:19.644 INFO:tasks.workunit.client.0.smithi123.stdout:9/33: dwrite f5 [0,4194304] 0 2024-02-20T08:05:19.645 INFO:tasks.workunit.client.0.smithi123.stdout:1/69: chown d3/de/d14/l16 1286 1 2024-02-20T08:05:19.647 INFO:tasks.workunit.client.0.smithi123.stdout:3/58: dwrite d0/dd/f8 [0,4194304] 0 2024-02-20T08:05:19.647 INFO:tasks.workunit.client.0.smithi123.stdout:8/67: chown d6/l10 1379985 1 2024-02-20T08:05:19.649 INFO:tasks.workunit.client.0.smithi123.stdout:9/34: mknod d6/c8 0 2024-02-20T08:05:19.650 INFO:tasks.workunit.client.0.smithi123.stdout:4/71: dread d3/f12 [0,4194304] 0 2024-02-20T08:05:19.653 INFO:tasks.workunit.client.0.smithi123.stdout:3/59: dread d0/d6/ff [0,4194304] 0 2024-02-20T08:05:19.661 INFO:tasks.workunit.client.0.smithi123.stdout:8/68: symlink d6/l18 0 2024-02-20T08:05:19.662 INFO:tasks.workunit.client.0.smithi123.stdout:8/69: chown d6/fa 4829379 1 2024-02-20T08:05:19.663 INFO:tasks.workunit.client.0.smithi123.stdout:8/70: stat d6/f7 0 2024-02-20T08:05:19.664 INFO:tasks.workunit.client.0.smithi123.stdout:9/35: unlink c0 0 2024-02-20T08:05:19.666 INFO:tasks.workunit.client.0.smithi123.stdout:4/72: creat d3/d18/f1c x:0 0 0 2024-02-20T08:05:19.668 INFO:tasks.workunit.client.0.smithi123.stdout:3/60: creat d0/dd/f16 x:0 0 0 2024-02-20T08:05:19.670 INFO:tasks.workunit.client.0.smithi123.stdout:9/36: dwrite f5 [0,4194304] 0 2024-02-20T08:05:19.672 INFO:tasks.workunit.client.0.smithi123.stdout:8/71: fsync d6/f7 0 2024-02-20T08:05:19.672 INFO:tasks.workunit.client.0.smithi123.stdout:8/72: dread - d6/f15 zero size 2024-02-20T08:05:19.675 INFO:tasks.workunit.client.0.smithi123.stdout:1/70: write d3/db/f19 [3408006,50083] 0 2024-02-20T08:05:19.676 INFO:tasks.workunit.client.0.smithi123.stdout:1/71: dread - d3/df/f18 zero size 2024-02-20T08:05:19.677 INFO:tasks.workunit.client.0.smithi123.stdout:1/72: stat d3/de/d14/l16 0 2024-02-20T08:05:19.678 INFO:tasks.workunit.client.0.smithi123.stdout:1/73: fsync d3/de/f13 0 2024-02-20T08:05:19.678 INFO:tasks.workunit.client.0.smithi123.stdout:8/73: dread d6/fa [0,4194304] 0 2024-02-20T08:05:19.679 INFO:tasks.workunit.client.0.smithi123.stdout:4/73: rename d3/f12 to d3/d18/f1d 0 2024-02-20T08:05:19.680 INFO:tasks.workunit.client.0.smithi123.stdout:8/74: read d6/f12 [1839419,63747] 0 2024-02-20T08:05:19.681 INFO:tasks.workunit.client.0.smithi123.stdout:8/75: stat d6/fb 0 2024-02-20T08:05:19.686 INFO:tasks.workunit.client.0.smithi123.stdout:1/74: dwrite d3/df/f11 [0,4194304] 0 2024-02-20T08:05:19.690 INFO:tasks.workunit.client.0.smithi123.stdout:3/61: creat d0/dd/de/f17 x:0 0 0 2024-02-20T08:05:19.691 INFO:tasks.workunit.client.0.smithi123.stdout:1/75: dread d3/df/f11 [0,4194304] 0 2024-02-20T08:05:19.691 INFO:tasks.workunit.client.0.smithi123.stdout:3/62: rename d0/db to d0/db/d18 22 2024-02-20T08:05:19.692 INFO:tasks.workunit.client.0.smithi123.stdout:3/63: chown d0/d6/f14 966 1 2024-02-20T08:05:19.693 INFO:tasks.workunit.client.0.smithi123.stdout:3/64: dread - d0/db/f12 zero size 2024-02-20T08:05:19.693 INFO:tasks.workunit.client.0.smithi123.stdout:4/74: mkdir d3/d1e 0 2024-02-20T08:05:19.694 INFO:tasks.workunit.client.0.smithi123.stdout:8/76: symlink d6/l19 0 2024-02-20T08:05:19.698 INFO:tasks.workunit.client.0.smithi123.stdout:1/76: creat d3/df/f1a x:0 0 0 2024-02-20T08:05:19.699 INFO:tasks.workunit.client.0.smithi123.stdout:3/65: creat d0/dd/f19 x:0 0 0 2024-02-20T08:05:19.700 INFO:tasks.workunit.client.0.smithi123.stdout:4/75: mkdir d3/d1f 0 2024-02-20T08:05:19.700 INFO:tasks.workunit.client.0.smithi123.stdout:3/66: read d0/d6/ff [2197938,10565] 0 2024-02-20T08:05:19.700 INFO:tasks.workunit.client.0.smithi123.stdout:4/76: chown d3/d1e 587 1 2024-02-20T08:05:19.701 INFO:tasks.workunit.client.0.smithi123.stdout:4/77: fdatasync d3/f1b 0 2024-02-20T08:05:19.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/67: rename d0/db to d0/d6/d1a 0 2024-02-20T08:05:19.707 INFO:tasks.workunit.client.0.smithi123.stdout:1/77: creat d3/de/d14/d15/f1b x:0 0 0 2024-02-20T08:05:19.707 INFO:tasks.workunit.client.0.smithi123.stdout:8/77: link f0 d6/f1a 0 2024-02-20T08:05:19.708 INFO:tasks.workunit.client.0.smithi123.stdout:8/78: dread - d6/f15 zero size 2024-02-20T08:05:19.710 INFO:tasks.workunit.client.0.smithi123.stdout:1/78: write d3/de/d14/d15/f1b [968523,97807] 0 2024-02-20T08:05:19.712 INFO:tasks.workunit.client.0.smithi123.stdout:8/79: creat d6/f1b x:0 0 0 2024-02-20T08:05:19.713 INFO:tasks.workunit.client.0.smithi123.stdout:3/68: dwrite d0/dd/f16 [0,4194304] 0 2024-02-20T08:05:19.714 INFO:tasks.workunit.client.0.smithi123.stdout:3/69: read - d0/dd/f19 zero size 2024-02-20T08:05:19.716 INFO:tasks.workunit.client.0.smithi123.stdout:8/80: fsync d6/fc 0 2024-02-20T08:05:19.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/37: write f1 [1291648,112573] 0 2024-02-20T08:05:19.717 INFO:tasks.workunit.client.0.smithi123.stdout:8/81: truncate d6/fd 542755 0 2024-02-20T08:05:19.719 INFO:tasks.workunit.client.0.smithi123.stdout:3/70: mkdir d0/d6/d1a/d1b 0 2024-02-20T08:05:19.720 INFO:tasks.workunit.client.0.smithi123.stdout:1/79: mknod d3/c1c 0 2024-02-20T08:05:19.724 INFO:tasks.workunit.client.0.smithi123.stdout:8/82: mkdir d6/d1c 0 2024-02-20T08:05:19.727 INFO:tasks.workunit.client.0.smithi123.stdout:1/80: write d3/df/f11 [3696584,114489] 0 2024-02-20T08:05:19.729 INFO:tasks.workunit.client.0.smithi123.stdout:3/71: mkdir d0/d6/d1a/d1b/d1c 0 2024-02-20T08:05:19.733 INFO:tasks.workunit.client.0.smithi123.stdout:1/81: unlink d3/de/d14/l16 0 2024-02-20T08:05:19.734 INFO:tasks.workunit.client.0.smithi123.stdout:8/83: dread d6/f12 [0,4194304] 0 2024-02-20T08:05:19.734 INFO:tasks.workunit.client.0.smithi123.stdout:3/72: symlink d0/d6/l1d 0 2024-02-20T08:05:19.737 INFO:tasks.workunit.client.0.smithi123.stdout:3/73: dread d0/dd/f16 [0,4194304] 0 2024-02-20T08:05:19.737 INFO:tasks.workunit.client.0.smithi123.stdout:3/74: chown d0 944188674 1 2024-02-20T08:05:19.749 INFO:tasks.workunit.client.0.smithi123.stdout:8/84: chown c5 9 1 2024-02-20T08:05:19.749 INFO:tasks.workunit.client.0.smithi123.stdout:9/38: truncate f5 3789203 0 2024-02-20T08:05:19.754 INFO:tasks.workunit.client.0.smithi123.stdout:9/39: rename d6/c8 to d6/c9 0 2024-02-20T08:05:19.754 INFO:tasks.workunit.client.0.smithi123.stdout:3/75: rmdir d0/d6 39 2024-02-20T08:05:19.757 INFO:tasks.workunit.client.0.smithi123.stdout:1/82: creat d3/f1d x:0 0 0 2024-02-20T08:05:19.758 INFO:tasks.workunit.client.0.smithi123.stdout:8/85: symlink d6/d1c/l1d 0 2024-02-20T08:05:19.759 INFO:tasks.workunit.client.0.smithi123.stdout:1/83: chown d3/de/d14/d15/f1b 881463 1 2024-02-20T08:05:19.759 INFO:tasks.workunit.client.0.smithi123.stdout:9/40: rmdir d6 39 2024-02-20T08:05:19.762 INFO:tasks.workunit.client.0.smithi123.stdout:8/86: creat d6/d1c/f1e x:0 0 0 2024-02-20T08:05:19.763 INFO:tasks.workunit.client.0.smithi123.stdout:1/84: creat d3/df/f1e x:0 0 0 2024-02-20T08:05:19.764 INFO:tasks.workunit.client.0.smithi123.stdout:1/85: stat d3/db/f19 0 2024-02-20T08:05:19.767 INFO:tasks.workunit.client.0.smithi123.stdout:1/86: dread d3/fa [0,4194304] 0 2024-02-20T08:05:19.768 INFO:tasks.workunit.client.0.smithi123.stdout:3/76: rename d0/dd/de to d0/d6/d1a/d1e 0 2024-02-20T08:05:19.773 INFO:tasks.workunit.client.0.smithi123.stdout:9/41: creat d6/fa x:0 0 0 2024-02-20T08:05:19.775 INFO:tasks.workunit.client.0.smithi123.stdout:3/77: dwrite d0/d6/d1a/d1e/f17 [0,4194304] 0 2024-02-20T08:05:19.777 INFO:tasks.workunit.client.0.smithi123.stdout:1/87: creat d3/de/f1f x:0 0 0 2024-02-20T08:05:19.779 INFO:tasks.workunit.client.0.smithi123.stdout:9/42: dread f1 [0,4194304] 0 2024-02-20T08:05:19.780 INFO:tasks.workunit.client.0.smithi123.stdout:1/88: write d3/f1d [145845,42080] 0 2024-02-20T08:05:19.785 INFO:tasks.workunit.client.0.smithi123.stdout:8/87: getdents d6/d1c 0 2024-02-20T08:05:19.785 INFO:tasks.workunit.client.0.smithi123.stdout:3/78: dwrite d0/dd/f19 [0,4194304] 0 2024-02-20T08:05:19.787 INFO:tasks.workunit.client.0.smithi123.stdout:1/89: mknod d3/db/c20 0 2024-02-20T08:05:19.787 INFO:tasks.workunit.client.0.smithi123.stdout:3/79: truncate d0/d6/d1a/f12 80001 0 2024-02-20T08:05:19.788 INFO:tasks.workunit.client.0.smithi123.stdout:8/88: mknod d6/d1c/c1f 0 2024-02-20T08:05:19.789 INFO:tasks.workunit.client.0.smithi123.stdout:8/89: readlink d6/l9 0 2024-02-20T08:05:19.791 INFO:tasks.workunit.client.0.smithi123.stdout:1/90: creat d3/db/f21 x:0 0 0 2024-02-20T08:05:19.792 INFO:tasks.workunit.client.0.smithi123.stdout:3/80: creat d0/d6/f1f x:0 0 0 2024-02-20T08:05:19.797 INFO:tasks.workunit.client.0.smithi123.stdout:1/91: fsync d3/fa 0 2024-02-20T08:05:19.798 INFO:tasks.workunit.client.0.smithi123.stdout:1/92: chown d3/f17 2 1 2024-02-20T08:05:19.798 INFO:tasks.workunit.client.0.smithi123.stdout:9/43: rmdir d6 39 2024-02-20T08:05:19.800 INFO:tasks.workunit.client.0.smithi123.stdout:3/81: dwrite d0/dd/f8 [0,4194304] 0 2024-02-20T08:05:19.805 INFO:tasks.workunit.client.0.smithi123.stdout:9/44: creat d6/fb x:0 0 0 2024-02-20T08:05:19.806 INFO:tasks.workunit.client.0.smithi123.stdout:9/45: fsync d6/fa 0 2024-02-20T08:05:19.806 INFO:tasks.workunit.client.0.smithi123.stdout:3/82: mkdir d0/d6/d1a/d1b/d1c/d20 0 2024-02-20T08:05:19.808 INFO:tasks.workunit.client.0.smithi123.stdout:1/93: dwrite d3/df/f18 [0,4194304] 0 2024-02-20T08:05:19.810 INFO:tasks.workunit.client.0.smithi123.stdout:1/94: fsync d3/de/f13 0 2024-02-20T08:05:19.811 INFO:tasks.workunit.client.0.smithi123.stdout:3/83: mkdir d0/d6/d1a/d1b/d1c/d21 0 2024-02-20T08:05:19.814 INFO:tasks.workunit.client.0.smithi123.stdout:9/46: truncate f5 224542 0 2024-02-20T08:05:19.815 INFO:tasks.workunit.client.0.smithi123.stdout:9/47: chown f1 83833 1 2024-02-20T08:05:19.816 INFO:tasks.workunit.client.0.smithi123.stdout:3/84: creat d0/d6/d1a/d1b/f22 x:0 0 0 2024-02-20T08:05:19.820 INFO:tasks.workunit.client.0.smithi123.stdout:1/95: dwrite d3/df/f1a [0,4194304] 0 2024-02-20T08:05:19.822 INFO:tasks.workunit.client.0.smithi123.stdout:3/85: creat d0/d6/d1a/f23 x:0 0 0 2024-02-20T08:05:19.823 INFO:tasks.workunit.client.0.smithi123.stdout:1/96: symlink d3/de/d14/d15/l22 0 2024-02-20T08:05:19.826 INFO:tasks.workunit.client.0.smithi123.stdout:1/97: creat d3/db/f23 x:0 0 0 2024-02-20T08:05:19.826 INFO:tasks.workunit.client.0.smithi123.stdout:8/90: dwrite d6/f8 [0,4194304] 0 2024-02-20T08:05:19.828 INFO:tasks.workunit.client.0.smithi123.stdout:1/98: write d3/df/f11 [2932533,52682] 0 2024-02-20T08:05:19.833 INFO:tasks.workunit.client.0.smithi123.stdout:8/91: creat d6/f20 x:0 0 0 2024-02-20T08:05:19.835 INFO:tasks.workunit.client.0.smithi123.stdout:9/48: rmdir d6 39 2024-02-20T08:05:19.837 INFO:tasks.workunit.client.0.smithi123.stdout:3/86: link d0/d6/f14 d0/f24 0 2024-02-20T08:05:19.841 INFO:tasks.workunit.client.0.smithi123.stdout:8/92: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:19.842 INFO:tasks.workunit.client.0.smithi123.stdout:8/93: dread - d6/d1c/f1e zero size 2024-02-20T08:05:19.847 INFO:tasks.workunit.client.0.smithi123.stdout:3/87: rename d0/dd/f16 to d0/d6/d1a/d1b/d1c/f25 0 2024-02-20T08:05:19.849 INFO:tasks.workunit.client.0.smithi123.stdout:9/49: mkdir d6/dc 0 2024-02-20T08:05:19.850 INFO:tasks.workunit.client.0.smithi123.stdout:9/50: dread - d6/fb zero size 2024-02-20T08:05:19.851 INFO:tasks.workunit.client.0.smithi123.stdout:1/99: link d3/de/d14/d15/l22 d3/l24 0 2024-02-20T08:05:19.855 INFO:tasks.workunit.client.0.smithi123.stdout:9/51: creat d6/fd x:0 0 0 2024-02-20T08:05:19.856 INFO:tasks.workunit.client.0.smithi123.stdout:8/94: link d6/f8 d6/d1c/f21 0 2024-02-20T08:05:19.858 INFO:tasks.workunit.client.0.smithi123.stdout:1/100: unlink d3/ld 0 2024-02-20T08:05:19.861 INFO:tasks.workunit.client.0.smithi123.stdout:3/88: rename d0/c3 to d0/d6/d1a/d1b/d1c/c26 0 2024-02-20T08:05:19.863 INFO:tasks.workunit.client.0.smithi123.stdout:9/52: mknod d6/ce 0 2024-02-20T08:05:19.863 INFO:tasks.workunit.client.0.smithi123.stdout:1/101: dread d3/df/f11 [0,4194304] 0 2024-02-20T08:05:19.864 INFO:tasks.workunit.client.0.smithi123.stdout:1/102: chown d3/db/f23 8 1 2024-02-20T08:05:19.865 INFO:tasks.workunit.client.0.smithi123.stdout:1/103: read d3/df/f1a [2782404,114843] 0 2024-02-20T08:05:19.866 INFO:tasks.workunit.client.0.smithi123.stdout:8/95: mkdir d6/d1c/d22 0 2024-02-20T08:05:19.871 INFO:tasks.workunit.client.0.smithi123.stdout:9/53: creat d6/ff x:0 0 0 2024-02-20T08:05:19.874 INFO:tasks.workunit.client.0.smithi123.stdout:1/104: symlink d3/df/l25 0 2024-02-20T08:05:19.875 INFO:tasks.workunit.client.0.smithi123.stdout:1/105: stat c2 0 2024-02-20T08:05:19.875 INFO:tasks.workunit.client.0.smithi123.stdout:1/106: write d3/f10 [154613,88724] 0 2024-02-20T08:05:19.880 INFO:tasks.workunit.client.0.smithi123.stdout:1/107: read - d3/db/f23 zero size 2024-02-20T08:05:19.880 INFO:tasks.workunit.client.0.smithi123.stdout:1/108: chown d3/df/f18 243 1 2024-02-20T08:05:19.884 INFO:tasks.workunit.client.0.smithi123.stdout:1/109: dwrite d3/f1d [0,4194304] 0 2024-02-20T08:05:19.886 INFO:tasks.workunit.client.0.smithi123.stdout:8/96: getdents d6 0 2024-02-20T08:05:19.889 INFO:tasks.workunit.client.0.smithi123.stdout:8/97: unlink d6/f8 0 2024-02-20T08:05:19.890 INFO:tasks.workunit.client.0.smithi123.stdout:1/110: mkdir d3/de/d14/d26 0 2024-02-20T08:05:19.893 INFO:tasks.workunit.client.0.smithi123.stdout:3/89: dwrite d0/f24 [0,4194304] 0 2024-02-20T08:05:19.898 INFO:tasks.workunit.client.0.smithi123.stdout:3/90: dread d0/dd/f19 [0,4194304] 0 2024-02-20T08:05:19.899 INFO:tasks.workunit.client.0.smithi123.stdout:3/91: write d0/f24 [3658882,38291] 0 2024-02-20T08:05:19.919 INFO:tasks.workunit.client.0.smithi123.stdout:1/111: symlink d3/db/l27 0 2024-02-20T08:05:19.920 INFO:tasks.workunit.client.0.smithi123.stdout:8/98: creat d6/d1c/d22/f23 x:0 0 0 2024-02-20T08:05:19.921 INFO:tasks.workunit.client.0.smithi123.stdout:8/99: stat d6/f7 0 2024-02-20T08:05:19.924 INFO:tasks.workunit.client.0.smithi123.stdout:3/92: rmdir d0/d6/d1a 39 2024-02-20T08:05:19.926 INFO:tasks.workunit.client.0.smithi123.stdout:1/112: dwrite d3/db/f19 [0,4194304] 0 2024-02-20T08:05:19.928 INFO:tasks.workunit.client.0.smithi123.stdout:8/100: dread f0 [0,4194304] 0 2024-02-20T08:05:20.008 INFO:tasks.workunit.client.0.smithi123.stdout:1/113: mknod d3/db/c28 0 2024-02-20T08:05:20.008 INFO:tasks.workunit.client.0.smithi123.stdout:3/93: mknod d0/d6/d1a/d1b/c27 0 2024-02-20T08:05:20.012 INFO:tasks.workunit.client.0.smithi123.stdout:1/114: rename d3/db/l27 to d3/de/d14/l29 0 2024-02-20T08:05:20.014 INFO:tasks.workunit.client.0.smithi123.stdout:8/101: dwrite d6/f1a [0,4194304] 0 2024-02-20T08:05:20.076 INFO:tasks.workunit.client.0.smithi123.stdout:3/94: creat d0/f28 x:0 0 0 2024-02-20T08:05:20.077 INFO:tasks.workunit.client.0.smithi123.stdout:1/115: readlink d3/de/d14/l29 0 2024-02-20T08:05:20.079 INFO:tasks.workunit.client.0.smithi123.stdout:1/116: fsync d3/df/f1a 0 2024-02-20T08:05:20.082 INFO:tasks.workunit.client.0.smithi123.stdout:8/102: truncate d6/d1c/d22/f23 138895 0 2024-02-20T08:05:20.088 INFO:tasks.workunit.client.0.smithi123.stdout:3/95: creat d0/d6/d1a/d1b/d1c/d21/f29 x:0 0 0 2024-02-20T08:05:20.089 INFO:tasks.workunit.client.0.smithi123.stdout:1/117: dread d3/df/f11 [0,4194304] 0 2024-02-20T08:05:20.090 INFO:tasks.workunit.client.0.smithi123.stdout:8/103: symlink d6/d1c/d22/l24 0 2024-02-20T08:05:20.090 INFO:tasks.workunit.client.0.smithi123.stdout:1/118: write d3/db/f23 [276743,79533] 0 2024-02-20T08:05:20.092 INFO:tasks.workunit.client.0.smithi123.stdout:3/96: dread d0/d6/d1a/d1e/f17 [0,4194304] 0 2024-02-20T08:05:20.095 INFO:tasks.workunit.client.0.smithi123.stdout:8/104: symlink d6/d1c/d22/l25 0 2024-02-20T08:05:20.097 INFO:tasks.workunit.client.0.smithi123.stdout:8/105: truncate d6/f15 300191 0 2024-02-20T08:05:20.097 INFO:tasks.workunit.client.0.smithi123.stdout:1/119: mknod d3/de/d14/c2a 0 2024-02-20T08:05:20.100 INFO:tasks.workunit.client.0.smithi123.stdout:3/97: dwrite d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:20.104 INFO:tasks.workunit.client.0.smithi123.stdout:1/120: creat d3/de/d14/d15/f2b x:0 0 0 2024-02-20T08:05:20.104 INFO:tasks.workunit.client.0.smithi123.stdout:1/121: stat d3/df/f11 0 2024-02-20T08:05:20.105 INFO:tasks.workunit.client.0.smithi123.stdout:8/106: truncate d6/f7 860995 0 2024-02-20T08:05:20.108 INFO:tasks.workunit.client.0.smithi123.stdout:3/98: unlink d0/d6/f9 0 2024-02-20T08:05:20.109 INFO:tasks.workunit.client.0.smithi123.stdout:1/122: dread d3/df/f1a [0,4194304] 0 2024-02-20T08:05:20.111 INFO:tasks.workunit.client.0.smithi123.stdout:8/107: truncate d6/fa 4700824 0 2024-02-20T08:05:20.111 INFO:tasks.workunit.client.0.smithi123.stdout:8/108: chown l3 7 1 2024-02-20T08:05:20.111 INFO:tasks.workunit.client.0.smithi123.stdout:8/109: chown d6/d1c/d22/l24 14 1 2024-02-20T08:05:20.112 INFO:tasks.workunit.client.0.smithi123.stdout:8/110: chown d6/d1c/d22/f23 20881 1 2024-02-20T08:05:20.116 INFO:tasks.workunit.client.0.smithi123.stdout:1/123: mkdir d3/de/d14/d2c 0 2024-02-20T08:05:20.119 INFO:tasks.workunit.client.0.smithi123.stdout:8/111: rename l3 to d6/l26 0 2024-02-20T08:05:20.122 INFO:tasks.workunit.client.0.smithi123.stdout:1/124: creat d3/db/f2d x:0 0 0 2024-02-20T08:05:20.124 INFO:tasks.workunit.client.0.smithi123.stdout:1/125: write d3/db/f23 [1274003,40599] 0 2024-02-20T08:05:20.125 INFO:tasks.workunit.client.0.smithi123.stdout:8/112: dwrite f0 [0,4194304] 0 2024-02-20T08:05:20.125 INFO:tasks.workunit.client.0.smithi123.stdout:1/126: stat d3/df/l25 0 2024-02-20T08:05:20.129 INFO:tasks.workunit.client.0.smithi123.stdout:8/113: symlink d6/d1c/d22/l27 0 2024-02-20T08:05:20.132 INFO:tasks.workunit.client.0.smithi123.stdout:1/127: readlink d3/de/d14/d15/l22 0 2024-02-20T08:05:20.136 INFO:tasks.workunit.client.0.smithi123.stdout:8/114: dwrite d6/f20 [0,4194304] 0 2024-02-20T08:05:20.143 INFO:tasks.workunit.client.0.smithi123.stdout:8/115: mknod d6/d1c/c28 0 2024-02-20T08:05:20.150 INFO:tasks.workunit.client.0.smithi123.stdout:8/116: fdatasync d6/fa 0 2024-02-20T08:05:20.155 INFO:tasks.workunit.client.0.smithi123.stdout:8/117: mkdir d6/d1c/d29 0 2024-02-20T08:05:20.156 INFO:tasks.workunit.client.0.smithi123.stdout:8/118: dread - d6/f1b zero size 2024-02-20T08:05:20.159 INFO:tasks.workunit.client.0.smithi123.stdout:8/119: symlink d6/d1c/d22/l2a 0 2024-02-20T08:05:20.161 INFO:tasks.workunit.client.0.smithi123.stdout:8/120: mknod d6/c2b 0 2024-02-20T08:05:20.163 INFO:tasks.workunit.client.0.smithi123.stdout:8/121: unlink d6/l10 0 2024-02-20T08:05:20.164 INFO:tasks.workunit.client.0.smithi123.stdout:8/122: chown d6/l18 333286864 1 2024-02-20T08:05:20.168 INFO:tasks.workunit.client.0.smithi123.stdout:8/123: mkdir d6/d1c/d2c 0 2024-02-20T08:05:20.169 INFO:tasks.workunit.client.0.smithi123.stdout:8/124: chown d6/d1c/d22/f23 806869 1 2024-02-20T08:05:20.171 INFO:tasks.workunit.client.0.smithi123.stdout:8/125: mknod d6/d1c/d22/c2d 0 2024-02-20T08:05:20.172 INFO:tasks.workunit.client.0.smithi123.stdout:8/126: chown d6/l16 2 1 2024-02-20T08:05:20.174 INFO:tasks.workunit.client.0.smithi123.stdout:8/127: truncate d6/d1c/f1e 13965 0 2024-02-20T08:05:20.178 INFO:tasks.workunit.client.0.smithi123.stdout:8/128: creat d6/d1c/d29/f2e x:0 0 0 2024-02-20T08:05:20.182 INFO:tasks.workunit.client.0.smithi123.stdout:8/129: creat d6/f2f x:0 0 0 2024-02-20T08:05:20.211 INFO:tasks.workunit.client.0.smithi123.stdout:6/133: sync 2024-02-20T08:05:20.211 INFO:tasks.workunit.client.0.smithi123.stdout:7/76: sync 2024-02-20T08:05:20.211 INFO:tasks.workunit.client.0.smithi123.stdout:2/78: sync 2024-02-20T08:05:20.212 INFO:tasks.workunit.client.0.smithi123.stdout:6/134: write d0/f22 [348774,49019] 0 2024-02-20T08:05:20.213 INFO:tasks.workunit.client.0.smithi123.stdout:7/77: rmdir d0/db 39 2024-02-20T08:05:20.213 INFO:tasks.workunit.client.0.smithi123.stdout:6/135: truncate d0/f2a 884341 0 2024-02-20T08:05:20.218 INFO:tasks.workunit.client.0.smithi123.stdout:3/99: dwrite d0/dd/f19 [0,4194304] 0 2024-02-20T08:05:20.222 INFO:tasks.workunit.client.0.smithi123.stdout:1/128: rmdir d3 39 2024-02-20T08:05:20.227 INFO:tasks.workunit.client.0.smithi123.stdout:3/100: fsync d0/d6/d1a/d1e/f17 0 2024-02-20T08:05:20.231 INFO:tasks.workunit.client.0.smithi123.stdout:1/129: write d3/fa [2695240,105168] 0 2024-02-20T08:05:20.243 INFO:tasks.workunit.client.0.smithi123.stdout:7/78: rename d0/db/lc to d0/l1a 0 2024-02-20T08:05:20.243 INFO:tasks.workunit.client.0.smithi123.stdout:7/79: readlink d0/l13 0 2024-02-20T08:05:20.243 INFO:tasks.workunit.client.0.smithi123.stdout:0/71: sync 2024-02-20T08:05:20.244 INFO:tasks.workunit.client.0.smithi123.stdout:0/72: readlink d2/d3/la 0 2024-02-20T08:05:20.247 INFO:tasks.workunit.client.0.smithi123.stdout:6/136: getdents d0 0 2024-02-20T08:05:20.251 INFO:tasks.workunit.client.0.smithi123.stdout:7/80: mknod d0/db/c1b 0 2024-02-20T08:05:20.252 INFO:tasks.workunit.client.0.smithi123.stdout:7/81: stat d0/d6/dd/c19 0 2024-02-20T08:05:20.256 INFO:tasks.workunit.client.0.smithi123.stdout:6/137: symlink d0/l2b 0 2024-02-20T08:05:20.257 INFO:tasks.workunit.client.0.smithi123.stdout:6/138: chown d0/lb 2378 1 2024-02-20T08:05:20.261 INFO:tasks.workunit.client.0.smithi123.stdout:0/73: link d2/fc d2/f18 0 2024-02-20T08:05:20.264 INFO:tasks.workunit.client.0.smithi123.stdout:6/139: creat d0/f2c x:0 0 0 2024-02-20T08:05:20.264 INFO:tasks.workunit.client.0.smithi123.stdout:6/140: stat d0/f15 0 2024-02-20T08:05:20.265 INFO:tasks.workunit.client.0.smithi123.stdout:1/130: getdents d3/de/d14/d15 0 2024-02-20T08:05:20.269 INFO:tasks.workunit.client.0.smithi123.stdout:0/74: write d2/fc [3260985,93802] 0 2024-02-20T08:05:20.271 INFO:tasks.workunit.client.0.smithi123.stdout:0/75: write d2/f8 [8975995,115869] 0 2024-02-20T08:05:20.273 INFO:tasks.workunit.client.0.smithi123.stdout:7/82: link d0/d6/d7/c12 d0/d6/d7/d10/c1c 0 2024-02-20T08:05:20.278 INFO:tasks.workunit.client.0.smithi123.stdout:0/76: mkdir d2/de/d19 0 2024-02-20T08:05:20.282 INFO:tasks.workunit.client.0.smithi123.stdout:8/130: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:20.288 INFO:tasks.workunit.client.0.smithi123.stdout:7/83: mkdir d0/d6/d7/d10/d1d 0 2024-02-20T08:05:20.290 INFO:tasks.workunit.client.0.smithi123.stdout:0/77: fsync d2/de/f17 0 2024-02-20T08:05:20.291 INFO:tasks.workunit.client.0.smithi123.stdout:7/84: dread d0/f4 [0,4194304] 0 2024-02-20T08:05:20.292 INFO:tasks.workunit.client.0.smithi123.stdout:7/85: chown d0/d6/d7/f16 9022 1 2024-02-20T08:05:20.295 INFO:tasks.workunit.client.0.smithi123.stdout:0/78: creat d2/f1a x:0 0 0 2024-02-20T08:05:20.299 INFO:tasks.workunit.client.0.smithi123.stdout:7/86: write d0/f4 [1624099,31733] 0 2024-02-20T08:05:20.301 INFO:tasks.workunit.client.0.smithi123.stdout:0/79: creat d2/f1b x:0 0 0 2024-02-20T08:05:20.302 INFO:tasks.workunit.client.0.smithi123.stdout:7/87: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:20.304 INFO:tasks.workunit.client.0.smithi123.stdout:0/80: dread d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:20.310 INFO:tasks.workunit.client.0.smithi123.stdout:0/81: dwrite d2/f15 [0,4194304] 0 2024-02-20T08:05:20.315 INFO:tasks.workunit.client.0.smithi123.stdout:2/79: truncate fe 786913 0 2024-02-20T08:05:20.317 INFO:tasks.workunit.client.0.smithi123.stdout:2/80: write f15 [787292,39457] 0 2024-02-20T08:05:20.318 INFO:tasks.workunit.client.0.smithi123.stdout:2/81: chown c1 2291999 1 2024-02-20T08:05:20.319 INFO:tasks.workunit.client.0.smithi123.stdout:0/82: dwrite d2/f1a [0,4194304] 0 2024-02-20T08:05:20.320 INFO:tasks.workunit.client.0.smithi123.stdout:0/83: write d2/fc [117077,14277] 0 2024-02-20T08:05:20.327 INFO:tasks.workunit.client.0.smithi123.stdout:0/84: dread d2/fb [0,4194304] 0 2024-02-20T08:05:20.333 INFO:tasks.workunit.client.0.smithi123.stdout:3/101: write d0/d6/d1a/d1b/d1c/f25 [420869,87387] 0 2024-02-20T08:05:20.335 INFO:tasks.workunit.client.0.smithi123.stdout:2/82: getdents . 0 2024-02-20T08:05:20.338 INFO:tasks.workunit.client.0.smithi123.stdout:2/83: creat f17 x:0 0 0 2024-02-20T08:05:20.341 INFO:tasks.workunit.client.0.smithi123.stdout:3/102: dwrite d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:20.342 INFO:tasks.workunit.client.0.smithi123.stdout:3/103: fsync d0/d6/d1a/f23 0 2024-02-20T08:05:20.345 INFO:tasks.workunit.client.0.smithi123.stdout:2/84: mknod c18 0 2024-02-20T08:05:20.346 INFO:tasks.workunit.client.0.smithi123.stdout:2/85: read f11 [1610427,32873] 0 2024-02-20T08:05:20.348 INFO:tasks.workunit.client.0.smithi123.stdout:3/104: mkdir d0/d6/d1a/d1b/d2a 0 2024-02-20T08:05:20.353 INFO:tasks.workunit.client.0.smithi123.stdout:3/105: unlink d0/d6/d1a/d1b/c27 0 2024-02-20T08:05:20.361 INFO:tasks.workunit.client.0.smithi123.stdout:6/141: dwrite d0/f17 [0,4194304] 0 2024-02-20T08:05:20.361 INFO:tasks.workunit.client.0.smithi123.stdout:6/142: chown d0/f18 2765 1 2024-02-20T08:05:20.363 INFO:tasks.workunit.client.0.smithi123.stdout:3/106: creat d0/d6/d1a/d1b/d2a/f2b x:0 0 0 2024-02-20T08:05:20.365 INFO:tasks.workunit.client.0.smithi123.stdout:6/143: mknod d0/c2d 0 2024-02-20T08:05:20.366 INFO:tasks.workunit.client.0.smithi123.stdout:6/144: dread d0/f21 [0,4194304] 0 2024-02-20T08:05:20.369 INFO:tasks.workunit.client.0.smithi123.stdout:3/107: unlink d0/d6/d1a/d1b/d2a/f2b 0 2024-02-20T08:05:20.372 INFO:tasks.workunit.client.0.smithi123.stdout:6/145: mknod d0/c2e 0 2024-02-20T08:05:20.373 INFO:tasks.workunit.client.0.smithi123.stdout:6/146: dread - d0/f29 zero size 2024-02-20T08:05:20.374 INFO:tasks.workunit.client.0.smithi123.stdout:6/147: chown d0/f17 155707 1 2024-02-20T08:05:20.380 INFO:tasks.workunit.client.0.smithi123.stdout:6/148: truncate d0/f16 925072 0 2024-02-20T08:05:20.382 INFO:tasks.workunit.client.0.smithi123.stdout:6/149: write d0/f1e [3812867,42624] 0 2024-02-20T08:05:20.383 INFO:tasks.workunit.client.0.smithi123.stdout:3/108: dwrite d0/d6/ff [4194304,4194304] 0 2024-02-20T08:05:20.391 INFO:tasks.workunit.client.0.smithi123.stdout:3/109: dwrite d0/d6/d1a/d1b/f22 [4194304,4194304] 0 2024-02-20T08:05:20.392 INFO:tasks.workunit.client.0.smithi123.stdout:3/110: fsync d0/d6/d1a/f23 0 2024-02-20T08:05:20.392 INFO:tasks.workunit.client.0.smithi123.stdout:7/88: write d0/f5 [323178,45442] 0 2024-02-20T08:05:20.393 INFO:tasks.workunit.client.0.smithi123.stdout:3/111: readlink d0/lc 0 2024-02-20T08:05:20.393 INFO:tasks.workunit.client.0.smithi123.stdout:3/112: chown d0/f24 7929587 1 2024-02-20T08:05:20.395 INFO:tasks.workunit.client.0.smithi123.stdout:3/113: truncate d0/dd/f8 4846143 0 2024-02-20T08:05:20.395 INFO:tasks.workunit.client.0.smithi123.stdout:3/114: chown d0/d6/d1a 441513224 1 2024-02-20T08:05:20.397 INFO:tasks.workunit.client.0.smithi123.stdout:7/89: creat d0/d6/d7/f1e x:0 0 0 2024-02-20T08:05:20.399 INFO:tasks.workunit.client.0.smithi123.stdout:6/150: link d0/c27 d0/c2f 0 2024-02-20T08:05:20.402 INFO:tasks.workunit.client.0.smithi123.stdout:3/115: mknod d0/d6/d1a/d1b/d2a/c2c 0 2024-02-20T08:05:20.405 INFO:tasks.workunit.client.0.smithi123.stdout:3/116: read d0/d6/d1a/d1e/f17 [1447164,92612] 0 2024-02-20T08:05:20.406 INFO:tasks.workunit.client.0.smithi123.stdout:3/117: fsync d0/d6/d1a/f15 0 2024-02-20T08:05:20.406 INFO:tasks.workunit.client.0.smithi123.stdout:7/90: dwrite d0/d6/d7/f1e [0,4194304] 0 2024-02-20T08:05:20.407 INFO:tasks.workunit.client.0.smithi123.stdout:7/91: chown d0/f5 22 1 2024-02-20T08:05:20.412 INFO:tasks.workunit.client.0.smithi123.stdout:7/92: dread d0/d6/d7/f16 [0,4194304] 0 2024-02-20T08:05:20.414 INFO:tasks.workunit.client.0.smithi123.stdout:3/118: mknod d0/d6/d1a/c2d 0 2024-02-20T08:05:20.415 INFO:tasks.workunit.client.0.smithi123.stdout:3/119: read d0/d6/d1a/d1b/d1c/f25 [160437,39223] 0 2024-02-20T08:05:20.416 INFO:tasks.workunit.client.0.smithi123.stdout:3/120: write d0/d6/d1a/f12 [379421,13828] 0 2024-02-20T08:05:20.417 INFO:tasks.workunit.client.0.smithi123.stdout:0/85: dwrite d2/de/f17 [0,4194304] 0 2024-02-20T08:05:20.418 INFO:tasks.workunit.client.0.smithi123.stdout:6/151: link d0/f14 d0/f30 0 2024-02-20T08:05:20.419 INFO:tasks.workunit.client.0.smithi123.stdout:6/152: chown d0/l1a 18 1 2024-02-20T08:05:20.421 INFO:tasks.workunit.client.0.smithi123.stdout:7/93: creat d0/d6/dd/d15/f1f x:0 0 0 2024-02-20T08:05:20.429 INFO:tasks.workunit.client.0.smithi123.stdout:2/86: getdents . 0 2024-02-20T08:05:20.429 INFO:tasks.workunit.client.0.smithi123.stdout:2/87: dread - f10 zero size 2024-02-20T08:05:20.431 INFO:tasks.workunit.client.0.smithi123.stdout:0/86: creat d2/f1c x:0 0 0 2024-02-20T08:05:20.433 INFO:tasks.workunit.client.0.smithi123.stdout:6/153: creat d0/f31 x:0 0 0 2024-02-20T08:05:20.434 INFO:tasks.workunit.client.0.smithi123.stdout:7/94: readlink d0/d6/dd/d15/l17 0 2024-02-20T08:05:20.436 INFO:tasks.workunit.client.0.smithi123.stdout:7/95: write d0/d6/d7/f1e [2386997,77242] 0 2024-02-20T08:05:20.446 INFO:tasks.workunit.client.0.smithi123.stdout:7/96: creat d0/d6/d7/f20 x:0 0 0 2024-02-20T08:05:20.448 INFO:tasks.workunit.client.0.smithi123.stdout:3/121: creat d0/d6/f2e x:0 0 0 2024-02-20T08:05:20.450 INFO:tasks.workunit.client.0.smithi123.stdout:2/88: rename l14 to l19 0 2024-02-20T08:05:20.455 INFO:tasks.workunit.client.0.smithi123.stdout:3/122: creat d0/d6/d1a/f2f x:0 0 0 2024-02-20T08:05:20.456 INFO:tasks.workunit.client.0.smithi123.stdout:3/123: write d0/d6/d1a/f23 [820980,124980] 0 2024-02-20T08:05:20.457 INFO:tasks.workunit.client.0.smithi123.stdout:2/89: mkdir d1a 0 2024-02-20T08:05:20.507 INFO:tasks.workunit.client.0.smithi123.stdout:3/124: dwrite d0/d6/d1a/f23 [0,4194304] 0 2024-02-20T08:05:20.508 INFO:tasks.workunit.client.0.smithi123.stdout:4/78: sync 2024-02-20T08:05:20.508 INFO:tasks.workunit.client.0.smithi123.stdout:9/54: sync 2024-02-20T08:05:20.508 INFO:tasks.workunit.client.0.smithi123.stdout:5/52: sync 2024-02-20T08:05:20.508 INFO:tasks.workunit.client.0.smithi123.stdout:4/79: stat d3/d1e 0 2024-02-20T08:05:20.508 INFO:tasks.workunit.client.0.smithi123.stdout:9/55: chown d6/fb 74904 1 2024-02-20T08:05:20.510 INFO:tasks.workunit.client.0.smithi123.stdout:9/56: truncate d6/fb 196218 0 2024-02-20T08:05:20.512 INFO:tasks.workunit.client.0.smithi123.stdout:4/80: creat d3/f20 x:0 0 0 2024-02-20T08:05:20.516 INFO:tasks.workunit.client.0.smithi123.stdout:5/53: dread d0/f8 [0,4194304] 0 2024-02-20T08:05:20.518 INFO:tasks.workunit.client.0.smithi123.stdout:3/125: rename d0/d6/ff to d0/d6/d1a/d1b/f30 0 2024-02-20T08:05:20.519 INFO:tasks.workunit.client.0.smithi123.stdout:9/57: mknod d6/c10 0 2024-02-20T08:05:20.522 INFO:tasks.workunit.client.0.smithi123.stdout:5/54: readlink d0/l3 0 2024-02-20T08:05:20.522 INFO:tasks.workunit.client.0.smithi123.stdout:5/55: truncate d0/fc 1689682 0 2024-02-20T08:05:20.525 INFO:tasks.workunit.client.0.smithi123.stdout:9/58: creat d6/f11 x:0 0 0 2024-02-20T08:05:20.526 INFO:tasks.workunit.client.0.smithi123.stdout:9/59: write d6/f11 [869653,18980] 0 2024-02-20T08:05:20.528 INFO:tasks.workunit.client.0.smithi123.stdout:3/126: creat d0/d6/d1a/d1b/d1c/d20/f31 x:0 0 0 2024-02-20T08:05:20.529 INFO:tasks.workunit.client.0.smithi123.stdout:5/56: dwrite d0/f8 [0,4194304] 0 2024-02-20T08:05:20.529 INFO:tasks.workunit.client.0.smithi123.stdout:0/87: write d2/d3/f10 [164862,99318] 0 2024-02-20T08:05:20.530 INFO:tasks.workunit.client.0.smithi123.stdout:3/127: chown d0/d6/d1a/d1b/d2a 4710 1 2024-02-20T08:05:20.530 INFO:tasks.workunit.client.0.smithi123.stdout:0/88: chown d2 2497588 1 2024-02-20T08:05:20.531 INFO:tasks.workunit.client.0.smithi123.stdout:9/60: creat d6/f12 x:0 0 0 2024-02-20T08:05:20.532 INFO:tasks.workunit.client.0.smithi123.stdout:0/89: chown d2/dd/l13 376708345 1 2024-02-20T08:05:20.532 INFO:tasks.workunit.client.0.smithi123.stdout:9/61: fdatasync d6/fd 0 2024-02-20T08:05:20.533 INFO:tasks.workunit.client.0.smithi123.stdout:0/90: chown d2/de/f17 680730420 1 2024-02-20T08:05:20.535 INFO:tasks.workunit.client.0.smithi123.stdout:4/81: getdents d3/d18 0 2024-02-20T08:05:20.536 INFO:tasks.workunit.client.0.smithi123.stdout:5/57: dwrite d0/fc [0,4194304] 0 2024-02-20T08:05:20.540 INFO:tasks.workunit.client.0.smithi123.stdout:9/62: dread f5 [0,4194304] 0 2024-02-20T08:05:20.540 INFO:tasks.workunit.client.0.smithi123.stdout:9/63: readlink - no filename 2024-02-20T08:05:20.541 INFO:tasks.workunit.client.0.smithi123.stdout:0/91: write d2/d3/f9 [3651355,86874] 0 2024-02-20T08:05:20.542 INFO:tasks.workunit.client.0.smithi123.stdout:3/128: mkdir d0/d6/d32 0 2024-02-20T08:05:20.545 INFO:tasks.workunit.client.0.smithi123.stdout:5/58: symlink d0/ld 0 2024-02-20T08:05:20.546 INFO:tasks.workunit.client.0.smithi123.stdout:4/82: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:20.549 INFO:tasks.workunit.client.0.smithi123.stdout:6/154: write d0/f13 [320602,77795] 0 2024-02-20T08:05:20.550 INFO:tasks.workunit.client.0.smithi123.stdout:6/155: readlink d0/l26 0 2024-02-20T08:05:20.553 INFO:tasks.workunit.client.0.smithi123.stdout:9/64: dwrite d6/f11 [0,4194304] 0 2024-02-20T08:05:20.555 INFO:tasks.workunit.client.0.smithi123.stdout:3/129: dread d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:20.557 INFO:tasks.workunit.client.0.smithi123.stdout:5/59: rename d0/c6 to d0/ce 0 2024-02-20T08:05:20.558 INFO:tasks.workunit.client.0.smithi123.stdout:4/83: dread d3/ff [8388608,4194304] 0 2024-02-20T08:05:20.559 INFO:tasks.workunit.client.0.smithi123.stdout:6/156: rename d0/l26 to d0/l32 0 2024-02-20T08:05:20.562 INFO:tasks.workunit.client.0.smithi123.stdout:5/60: symlink d0/lf 0 2024-02-20T08:05:20.563 INFO:tasks.workunit.client.0.smithi123.stdout:3/130: truncate d0/d6/d1a/d1e/f17 26041 0 2024-02-20T08:05:20.568 INFO:tasks.workunit.client.0.smithi123.stdout:5/61: rename d0/lb to d0/l10 0 2024-02-20T08:05:20.568 INFO:tasks.workunit.client.0.smithi123.stdout:3/131: dwrite d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:20.570 INFO:tasks.workunit.client.0.smithi123.stdout:4/84: mkdir d3/d1f/d21 0 2024-02-20T08:05:20.572 INFO:tasks.workunit.client.0.smithi123.stdout:5/62: dread d0/f8 [0,4194304] 0 2024-02-20T08:05:20.575 INFO:tasks.workunit.client.0.smithi123.stdout:6/157: link d0/f14 d0/f33 0 2024-02-20T08:05:20.577 INFO:tasks.workunit.client.0.smithi123.stdout:4/85: dwrite d3/fd [4194304,4194304] 0 2024-02-20T08:05:20.579 INFO:tasks.workunit.client.0.smithi123.stdout:4/86: dread d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:20.583 INFO:tasks.workunit.client.0.smithi123.stdout:5/63: creat d0/f11 x:0 0 0 2024-02-20T08:05:20.586 INFO:tasks.workunit.client.0.smithi123.stdout:6/158: unlink d0/l2b 0 2024-02-20T08:05:20.589 INFO:tasks.workunit.client.0.smithi123.stdout:3/132: creat d0/d6/d32/f33 x:0 0 0 2024-02-20T08:05:20.593 INFO:tasks.workunit.client.0.smithi123.stdout:6/159: dwrite d0/f28 [0,4194304] 0 2024-02-20T08:05:20.593 INFO:tasks.workunit.client.0.smithi123.stdout:4/87: symlink d3/d1f/d21/l22 0 2024-02-20T08:05:20.594 INFO:tasks.workunit.client.0.smithi123.stdout:4/88: dread - d3/f1b zero size 2024-02-20T08:05:20.595 INFO:tasks.workunit.client.0.smithi123.stdout:4/89: fsync d3/f20 0 2024-02-20T08:05:20.596 INFO:tasks.workunit.client.0.smithi123.stdout:4/90: write d3/d18/f19 [1007105,125006] 0 2024-02-20T08:05:20.599 INFO:tasks.workunit.client.0.smithi123.stdout:6/160: creat d0/f34 x:0 0 0 2024-02-20T08:05:20.599 INFO:tasks.workunit.client.0.smithi123.stdout:4/91: rmdir d3/d1f/d21 39 2024-02-20T08:05:20.604 INFO:tasks.workunit.client.0.smithi123.stdout:0/92: dwrite d2/fb [0,4194304] 0 2024-02-20T08:05:20.604 INFO:tasks.workunit.client.0.smithi123.stdout:0/93: chown d2/de 456561 1 2024-02-20T08:05:20.606 INFO:tasks.workunit.client.0.smithi123.stdout:6/161: symlink d0/l35 0 2024-02-20T08:05:20.606 INFO:tasks.workunit.client.0.smithi123.stdout:9/65: write f1 [3144219,1454] 0 2024-02-20T08:05:20.607 INFO:tasks.workunit.client.0.smithi123.stdout:9/66: chown d6/fa 809937 1 2024-02-20T08:05:20.608 INFO:tasks.workunit.client.0.smithi123.stdout:9/67: chown d6/c10 133 1 2024-02-20T08:05:20.609 INFO:tasks.workunit.client.0.smithi123.stdout:9/68: chown d6/fb 4330995 1 2024-02-20T08:05:20.610 INFO:tasks.workunit.client.0.smithi123.stdout:9/69: write d6/f12 [140373,389] 0 2024-02-20T08:05:20.613 INFO:tasks.workunit.client.0.smithi123.stdout:0/94: fsync d2/f6 0 2024-02-20T08:05:20.614 INFO:tasks.workunit.client.0.smithi123.stdout:0/95: read d2/d3/f10 [195011,80913] 0 2024-02-20T08:05:20.616 INFO:tasks.workunit.client.0.smithi123.stdout:6/162: symlink d0/l36 0 2024-02-20T08:05:20.616 INFO:tasks.workunit.client.0.smithi123.stdout:6/163: stat d0/c2d 0 2024-02-20T08:05:20.617 INFO:tasks.workunit.client.0.smithi123.stdout:9/70: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:20.624 INFO:tasks.workunit.client.0.smithi123.stdout:2/90: dwrite fe [0,4194304] 0 2024-02-20T08:05:20.624 INFO:tasks.workunit.client.0.smithi123.stdout:4/92: link d3/d18/f19 d3/d18/f23 0 2024-02-20T08:05:20.627 INFO:tasks.workunit.client.0.smithi123.stdout:5/64: rmdir d0 39 2024-02-20T08:05:20.633 INFO:tasks.workunit.client.0.smithi123.stdout:9/71: mknod d6/c13 0 2024-02-20T08:05:20.636 INFO:tasks.workunit.client.0.smithi123.stdout:4/93: mknod d3/c24 0 2024-02-20T08:05:20.637 INFO:tasks.workunit.client.0.smithi123.stdout:2/91: readlink l19 0 2024-02-20T08:05:20.638 INFO:tasks.workunit.client.0.smithi123.stdout:2/92: write fe [1069042,107812] 0 2024-02-20T08:05:20.639 INFO:tasks.workunit.client.0.smithi123.stdout:2/93: dread - f10 zero size 2024-02-20T08:05:20.641 INFO:tasks.workunit.client.0.smithi123.stdout:4/94: dread d3/d18/f23 [0,4194304] 0 2024-02-20T08:05:20.643 INFO:tasks.workunit.client.0.smithi123.stdout:2/94: dread fb [0,4194304] 0 2024-02-20T08:05:20.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:20 smithi194 ceph-mon[37804]: pgmap v29: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 7.5 MiB/s wr, 153 op/s 2024-02-20T08:05:20.650 INFO:tasks.workunit.client.0.smithi123.stdout:3/133: dwrite d0/d6/d1a/d1e/f17 [0,4194304] 0 2024-02-20T08:05:20.650 INFO:tasks.workunit.client.0.smithi123.stdout:2/95: dread fe [0,4194304] 0 2024-02-20T08:05:20.656 INFO:tasks.workunit.client.0.smithi123.stdout:4/95: mknod d3/d18/c25 0 2024-02-20T08:05:20.656 INFO:tasks.workunit.client.0.smithi123.stdout:6/164: link d0/lb d0/l37 0 2024-02-20T08:05:20.660 INFO:tasks.workunit.client.0.smithi123.stdout:9/72: link d6/ff d6/f14 0 2024-02-20T08:05:20.661 INFO:tasks.workunit.client.0.smithi123.stdout:9/73: chown d6/ff 21 1 2024-02-20T08:05:20.662 INFO:tasks.workunit.client.0.smithi123.stdout:9/74: dread d6/f12 [0,4194304] 0 2024-02-20T08:05:20.663 INFO:tasks.workunit.client.0.smithi123.stdout:9/75: dread d6/f12 [0,4194304] 0 2024-02-20T08:05:20.664 INFO:tasks.workunit.client.0.smithi123.stdout:9/76: stat d6/c10 0 2024-02-20T08:05:20.664 INFO:tasks.workunit.client.0.smithi123.stdout:1/131: sync 2024-02-20T08:05:20.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:20 smithi123 ceph-mon[29383]: pgmap v29: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 7.5 MiB/s wr, 153 op/s 2024-02-20T08:05:20.665 INFO:tasks.workunit.client.0.smithi123.stdout:0/96: getdents d2/dd 0 2024-02-20T08:05:20.666 INFO:tasks.workunit.client.0.smithi123.stdout:0/97: stat d2/f1c 0 2024-02-20T08:05:20.671 INFO:tasks.workunit.client.0.smithi123.stdout:3/134: mkdir d0/d6/d34 0 2024-02-20T08:05:20.671 INFO:tasks.workunit.client.0.smithi123.stdout:5/65: write d0/f8 [2831875,45796] 0 2024-02-20T08:05:20.672 INFO:tasks.workunit.client.0.smithi123.stdout:2/96: symlink d1a/l1b 0 2024-02-20T08:05:20.673 INFO:tasks.workunit.client.0.smithi123.stdout:5/66: write d0/f11 [959394,117942] 0 2024-02-20T08:05:20.674 INFO:tasks.workunit.client.0.smithi123.stdout:9/77: chown d6/c9 82016540 1 2024-02-20T08:05:20.675 INFO:tasks.workunit.client.0.smithi123.stdout:9/78: stat d6/fa 0 2024-02-20T08:05:20.677 INFO:tasks.workunit.client.0.smithi123.stdout:4/96: mkdir d3/d1f/d26 0 2024-02-20T08:05:20.678 INFO:tasks.workunit.client.0.smithi123.stdout:3/135: dwrite d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:20.679 INFO:tasks.workunit.client.0.smithi123.stdout:3/136: readlink d0/l4 0 2024-02-20T08:05:20.681 INFO:tasks.workunit.client.0.smithi123.stdout:2/97: mknod d1a/c1c 0 2024-02-20T08:05:20.682 INFO:tasks.workunit.client.0.smithi123.stdout:2/98: dread - f10 zero size 2024-02-20T08:05:20.683 INFO:tasks.workunit.client.0.smithi123.stdout:5/67: symlink d0/l12 0 2024-02-20T08:05:20.684 INFO:tasks.workunit.client.0.smithi123.stdout:1/132: mkdir d3/de/d14/d26/d2e 0 2024-02-20T08:05:20.687 INFO:tasks.workunit.client.0.smithi123.stdout:4/97: dwrite d3/f20 [0,4194304] 0 2024-02-20T08:05:20.688 INFO:tasks.workunit.client.0.smithi123.stdout:4/98: dread d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:20.689 INFO:tasks.workunit.client.0.smithi123.stdout:3/137: rename d0/d6/c13 to d0/dd/c35 0 2024-02-20T08:05:20.689 INFO:tasks.workunit.client.0.smithi123.stdout:4/99: chown d3/d1e 1047 1 2024-02-20T08:05:20.689 INFO:tasks.workunit.client.0.smithi123.stdout:5/68: dread d0/fc [0,4194304] 0 2024-02-20T08:05:20.690 INFO:tasks.workunit.client.0.smithi123.stdout:4/100: write d3/f20 [206597,49302] 0 2024-02-20T08:05:20.691 INFO:tasks.workunit.client.0.smithi123.stdout:3/138: write d0/d6/d1a/d1b/f22 [6482135,43049] 0 2024-02-20T08:05:20.692 INFO:tasks.workunit.client.0.smithi123.stdout:3/139: rename d0/d6/d1a/d1b to d0/d6/d1a/d1b/d1c/d20/d36 22 2024-02-20T08:05:20.693 INFO:tasks.workunit.client.0.smithi123.stdout:9/79: mkdir d6/dc/d15 0 2024-02-20T08:05:20.694 INFO:tasks.workunit.client.0.smithi123.stdout:3/140: read d0/f24 [3697038,125068] 0 2024-02-20T08:05:20.694 INFO:tasks.workunit.client.0.smithi123.stdout:1/133: symlink d3/de/l2f 0 2024-02-20T08:05:20.695 INFO:tasks.workunit.client.0.smithi123.stdout:0/98: link d2/d3/la d2/dd/l1d 0 2024-02-20T08:05:20.698 INFO:tasks.workunit.client.0.smithi123.stdout:4/101: fsync d3/f10 0 2024-02-20T08:05:20.700 INFO:tasks.workunit.client.0.smithi123.stdout:2/99: link fb d1a/f1d 0 2024-02-20T08:05:20.700 INFO:tasks.workunit.client.0.smithi123.stdout:3/141: dwrite d0/d6/f2e [0,4194304] 0 2024-02-20T08:05:20.703 INFO:tasks.workunit.client.0.smithi123.stdout:9/80: dread d6/f12 [0,4194304] 0 2024-02-20T08:05:20.704 INFO:tasks.workunit.client.0.smithi123.stdout:1/134: truncate d3/df/f1a 5009969 0 2024-02-20T08:05:20.705 INFO:tasks.workunit.client.0.smithi123.stdout:0/99: mkdir d2/de/d1e 0 2024-02-20T08:05:20.716 INFO:tasks.workunit.client.0.smithi123.stdout:4/102: dwrite d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:20.718 INFO:tasks.workunit.client.0.smithi123.stdout:9/81: unlink d6/c10 0 2024-02-20T08:05:20.724 INFO:tasks.workunit.client.0.smithi123.stdout:2/100: link d1a/f1d d1a/f1e 0 2024-02-20T08:05:20.725 INFO:tasks.workunit.client.0.smithi123.stdout:3/142: mkdir d0/d6/d34/d37 0 2024-02-20T08:05:20.728 INFO:tasks.workunit.client.0.smithi123.stdout:4/103: unlink d3/f10 0 2024-02-20T08:05:20.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/82: symlink d6/dc/l16 0 2024-02-20T08:05:20.731 INFO:tasks.workunit.client.0.smithi123.stdout:1/135: mknod d3/c30 0 2024-02-20T08:05:20.734 INFO:tasks.workunit.client.0.smithi123.stdout:5/69: getdents d0 0 2024-02-20T08:05:20.734 INFO:tasks.workunit.client.0.smithi123.stdout:5/70: stat d0/f8 0 2024-02-20T08:05:20.735 INFO:tasks.workunit.client.0.smithi123.stdout:2/101: creat d1a/f1f x:0 0 0 2024-02-20T08:05:20.735 INFO:tasks.workunit.client.0.smithi123.stdout:2/102: chown l16 24758 1 2024-02-20T08:05:20.736 INFO:tasks.workunit.client.0.smithi123.stdout:3/143: unlink d0/f28 0 2024-02-20T08:05:20.737 INFO:tasks.workunit.client.0.smithi123.stdout:3/144: write d0/d6/d1a/d1e/f17 [4555215,86445] 0 2024-02-20T08:05:20.739 INFO:tasks.workunit.client.0.smithi123.stdout:4/104: mknod d3/d18/c27 0 2024-02-20T08:05:20.739 INFO:tasks.workunit.client.0.smithi123.stdout:4/105: chown d3/cb 20408 1 2024-02-20T08:05:20.743 INFO:tasks.workunit.client.0.smithi123.stdout:1/136: creat d3/db/f31 x:0 0 0 2024-02-20T08:05:20.743 INFO:tasks.workunit.client.0.smithi123.stdout:4/106: dread d3/fd [4194304,4194304] 0 2024-02-20T08:05:20.744 INFO:tasks.workunit.client.0.smithi123.stdout:0/100: write d2/f6 [627198,129630] 0 2024-02-20T08:05:20.745 INFO:tasks.workunit.client.0.smithi123.stdout:5/71: mkdir d0/d13 0 2024-02-20T08:05:20.746 INFO:tasks.workunit.client.0.smithi123.stdout:5/72: write d0/f8 [4021110,84906] 0 2024-02-20T08:05:20.756 INFO:tasks.workunit.client.0.smithi123.stdout:5/73: creat d0/f14 x:0 0 0 2024-02-20T08:05:20.758 INFO:tasks.workunit.client.0.smithi123.stdout:5/74: read - d0/f14 zero size 2024-02-20T08:05:20.759 INFO:tasks.workunit.client.0.smithi123.stdout:5/75: chown d0/lf 3223 1 2024-02-20T08:05:20.759 INFO:tasks.workunit.client.0.smithi123.stdout:3/145: link d0/d6/d1a/d1b/d1c/d21/f29 d0/dd/f38 0 2024-02-20T08:05:20.760 INFO:tasks.workunit.client.0.smithi123.stdout:5/76: write d0/f11 [2047105,15408] 0 2024-02-20T08:05:20.761 INFO:tasks.workunit.client.0.smithi123.stdout:5/77: stat d0/f8 0 2024-02-20T08:05:20.761 INFO:tasks.workunit.client.0.smithi123.stdout:3/146: fsync d0/d6/d32/f33 0 2024-02-20T08:05:20.762 INFO:tasks.workunit.client.0.smithi123.stdout:9/83: dwrite d6/f11 [4194304,4194304] 0 2024-02-20T08:05:20.766 INFO:tasks.workunit.client.0.smithi123.stdout:1/137: creat d3/de/d14/d2c/f32 x:0 0 0 2024-02-20T08:05:20.767 INFO:tasks.workunit.client.0.smithi123.stdout:0/101: mkdir d2/de/d1e/d1f 0 2024-02-20T08:05:20.769 INFO:tasks.workunit.client.0.smithi123.stdout:1/138: rename d3/de/d14 to d3/de/d14/d33 22 2024-02-20T08:05:20.771 INFO:tasks.workunit.client.0.smithi123.stdout:2/103: dwrite f5 [0,4194304] 0 2024-02-20T08:05:20.773 INFO:tasks.workunit.client.0.smithi123.stdout:1/139: write d3/db/f19 [3843381,24794] 0 2024-02-20T08:05:20.773 INFO:tasks.workunit.client.0.smithi123.stdout:5/78: dwrite d0/f11 [0,4194304] 0 2024-02-20T08:05:20.774 INFO:tasks.workunit.client.0.smithi123.stdout:3/147: creat d0/d6/d1a/f39 x:0 0 0 2024-02-20T08:05:20.779 INFO:tasks.workunit.client.0.smithi123.stdout:2/104: rename c18 to d1a/c20 0 2024-02-20T08:05:20.782 INFO:tasks.workunit.client.0.smithi123.stdout:4/107: dwrite d3/f8 [4194304,4194304] 0 2024-02-20T08:05:20.782 INFO:tasks.workunit.client.0.smithi123.stdout:5/79: unlink d0/l12 0 2024-02-20T08:05:20.783 INFO:tasks.workunit.client.0.smithi123.stdout:4/108: write d3/f8 [11450222,45263] 0 2024-02-20T08:05:20.790 INFO:tasks.workunit.client.0.smithi123.stdout:4/109: dread d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:20.791 INFO:tasks.workunit.client.0.smithi123.stdout:0/102: creat d2/de/d1e/d1f/f20 x:0 0 0 2024-02-20T08:05:20.794 INFO:tasks.workunit.client.0.smithi123.stdout:1/140: rename d3/de/d14/d15 to d3/db/d34 0 2024-02-20T08:05:20.798 INFO:tasks.workunit.client.0.smithi123.stdout:0/103: read - d2/f12 zero size 2024-02-20T08:05:20.799 INFO:tasks.workunit.client.0.smithi123.stdout:1/141: mknod d3/de/d14/d2c/c35 0 2024-02-20T08:05:20.800 INFO:tasks.workunit.client.0.smithi123.stdout:9/84: getdents d6/dc 0 2024-02-20T08:05:20.800 INFO:tasks.workunit.client.0.smithi123.stdout:4/110: dread d3/fd [4194304,4194304] 0 2024-02-20T08:05:20.801 INFO:tasks.workunit.client.0.smithi123.stdout:9/85: fsync d6/fb 0 2024-02-20T08:05:20.803 INFO:tasks.workunit.client.0.smithi123.stdout:4/111: unlink d3/l17 0 2024-02-20T08:05:20.804 INFO:tasks.workunit.client.0.smithi123.stdout:9/86: dread d6/f11 [4194304,4194304] 0 2024-02-20T08:05:20.805 INFO:tasks.workunit.client.0.smithi123.stdout:4/112: dread d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:20.805 INFO:tasks.workunit.client.0.smithi123.stdout:9/87: write f1 [1952319,62135] 0 2024-02-20T08:05:20.816 INFO:tasks.workunit.client.0.smithi123.stdout:7/97: sync 2024-02-20T08:05:20.816 INFO:tasks.workunit.client.0.smithi123.stdout:8/131: sync 2024-02-20T08:05:20.837 INFO:tasks.workunit.client.0.smithi123.stdout:3/148: fsync d0/d6/d1a/f39 0 2024-02-20T08:05:20.838 INFO:tasks.workunit.client.0.smithi123.stdout:4/113: dread - d3/f1b zero size 2024-02-20T08:05:20.839 INFO:tasks.workunit.client.0.smithi123.stdout:5/80: write d0/f11 [4381286,27041] 0 2024-02-20T08:05:20.839 INFO:tasks.workunit.client.0.smithi123.stdout:8/132: read d6/fb [4179912,18692] 0 2024-02-20T08:05:20.840 INFO:tasks.workunit.client.0.smithi123.stdout:9/88: write d6/fb [3809579,18993] 0 2024-02-20T08:05:20.841 INFO:tasks.workunit.client.0.smithi123.stdout:1/142: write d3/df/f1a [4585077,114560] 0 2024-02-20T08:05:20.843 INFO:tasks.workunit.client.0.smithi123.stdout:3/149: creat d0/d6/d1a/d1b/d2a/f3a x:0 0 0 2024-02-20T08:05:20.843 INFO:tasks.workunit.client.0.smithi123.stdout:4/114: dread - d3/d18/f1c zero size 2024-02-20T08:05:20.846 INFO:tasks.workunit.client.0.smithi123.stdout:5/81: creat d0/f15 x:0 0 0 2024-02-20T08:05:20.846 INFO:tasks.workunit.client.0.smithi123.stdout:4/115: readlink d3/l11 0 2024-02-20T08:05:20.848 INFO:tasks.workunit.client.0.smithi123.stdout:1/143: unlink d3/c1c 0 2024-02-20T08:05:20.849 INFO:tasks.workunit.client.0.smithi123.stdout:9/89: creat d6/dc/f17 x:0 0 0 2024-02-20T08:05:20.850 INFO:tasks.workunit.client.0.smithi123.stdout:5/82: chown d0/f14 10622071 1 2024-02-20T08:05:20.853 INFO:tasks.workunit.client.0.smithi123.stdout:2/105: dwrite fc [4194304,4194304] 0 2024-02-20T08:05:20.854 INFO:tasks.workunit.client.0.smithi123.stdout:4/116: write d3/d18/f1d [1427407,12593] 0 2024-02-20T08:05:20.854 INFO:tasks.workunit.client.0.smithi123.stdout:7/98: dwrite d0/f5 [0,4194304] 0 2024-02-20T08:05:20.859 INFO:tasks.workunit.client.0.smithi123.stdout:5/83: creat d0/f16 x:0 0 0 2024-02-20T08:05:20.860 INFO:tasks.workunit.client.0.smithi123.stdout:7/99: mkdir d0/db/d21 0 2024-02-20T08:05:20.860 INFO:tasks.workunit.client.0.smithi123.stdout:8/133: dwrite d6/f2f [0,4194304] 0 2024-02-20T08:05:20.861 INFO:tasks.workunit.client.0.smithi123.stdout:8/134: fsync d6/f15 0 2024-02-20T08:05:20.865 INFO:tasks.workunit.client.0.smithi123.stdout:2/106: symlink d1a/l21 0 2024-02-20T08:05:20.867 INFO:tasks.workunit.client.0.smithi123.stdout:2/107: truncate d1a/f1d 9142980 0 2024-02-20T08:05:20.868 INFO:tasks.workunit.client.0.smithi123.stdout:4/117: creat d3/f28 x:0 0 0 2024-02-20T08:05:20.869 INFO:tasks.workunit.client.0.smithi123.stdout:5/84: dwrite d0/f8 [4194304,4194304] 0 2024-02-20T08:05:20.869 INFO:tasks.workunit.client.0.smithi123.stdout:2/108: dread - d1a/f1f zero size 2024-02-20T08:05:20.870 INFO:tasks.workunit.client.0.smithi123.stdout:5/85: dread - d0/f15 zero size 2024-02-20T08:05:20.871 INFO:tasks.workunit.client.0.smithi123.stdout:5/86: dread - d0/f16 zero size 2024-02-20T08:05:20.871 INFO:tasks.workunit.client.0.smithi123.stdout:9/90: mknod d6/dc/d15/c18 0 2024-02-20T08:05:20.877 INFO:tasks.workunit.client.0.smithi123.stdout:5/87: mkdir d0/d17 0 2024-02-20T08:05:20.878 INFO:tasks.workunit.client.0.smithi123.stdout:4/118: dwrite d3/f1b [0,4194304] 0 2024-02-20T08:05:20.881 INFO:tasks.workunit.client.0.smithi123.stdout:8/135: rename d6/d1c/c1f to d6/d1c/d29/c30 0 2024-02-20T08:05:20.881 INFO:tasks.workunit.client.0.smithi123.stdout:8/136: chown d6/l18 1491676387 1 2024-02-20T08:05:20.890 INFO:tasks.workunit.client.0.smithi123.stdout:4/119: creat d3/d1f/d26/f29 x:0 0 0 2024-02-20T08:05:20.892 INFO:tasks.workunit.client.0.smithi123.stdout:5/88: rename d0/l4 to d0/d17/l18 0 2024-02-20T08:05:20.893 INFO:tasks.workunit.client.0.smithi123.stdout:5/89: readlink d0/l5 0 2024-02-20T08:05:20.893 INFO:tasks.workunit.client.0.smithi123.stdout:5/90: chown d0 241518 1 2024-02-20T08:05:20.895 INFO:tasks.workunit.client.0.smithi123.stdout:1/144: write d3/fc [4549793,67569] 0 2024-02-20T08:05:20.897 INFO:tasks.workunit.client.0.smithi123.stdout:4/120: creat d3/f2a x:0 0 0 2024-02-20T08:05:20.897 INFO:tasks.workunit.client.0.smithi123.stdout:1/145: truncate d3/db/f31 188470 0 2024-02-20T08:05:20.899 INFO:tasks.workunit.client.0.smithi123.stdout:3/150: dwrite d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:20.900 INFO:tasks.workunit.client.0.smithi123.stdout:3/151: write d0/d6/d1a/f15 [860555,5787] 0 2024-02-20T08:05:20.902 INFO:tasks.workunit.client.0.smithi123.stdout:8/137: link d6/cf d6/d1c/d29/c31 0 2024-02-20T08:05:20.908 INFO:tasks.workunit.client.0.smithi123.stdout:9/91: getdents d6/dc/d15 0 2024-02-20T08:05:20.908 INFO:tasks.workunit.client.0.smithi123.stdout:8/138: dwrite d6/f1a [4194304,4194304] 0 2024-02-20T08:05:20.910 INFO:tasks.workunit.client.0.smithi123.stdout:3/152: mkdir d0/d6/d1a/d1b/d1c/d3b 0 2024-02-20T08:05:20.915 INFO:tasks.workunit.client.0.smithi123.stdout:4/121: creat d3/d1e/f2b x:0 0 0 2024-02-20T08:05:20.916 INFO:tasks.workunit.client.0.smithi123.stdout:5/91: link d0/fc d0/f19 0 2024-02-20T08:05:20.918 INFO:tasks.workunit.client.0.smithi123.stdout:8/139: mkdir d6/d32 0 2024-02-20T08:05:20.920 INFO:tasks.workunit.client.0.smithi123.stdout:8/140: chown d6/f12 20641 1 2024-02-20T08:05:20.920 INFO:tasks.workunit.client.0.smithi123.stdout:7/100: dwrite d0/d6/d7/f16 [0,4194304] 0 2024-02-20T08:05:20.920 INFO:tasks.workunit.client.0.smithi123.stdout:9/92: dwrite d6/dc/f17 [0,4194304] 0 2024-02-20T08:05:20.922 INFO:tasks.workunit.client.0.smithi123.stdout:9/93: fdatasync d6/fb 0 2024-02-20T08:05:20.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/141: stat d6/d1c/d22/c2d 0 2024-02-20T08:05:20.924 INFO:tasks.workunit.client.0.smithi123.stdout:7/101: write d0/d6/d7/f20 [377873,52956] 0 2024-02-20T08:05:20.927 INFO:tasks.workunit.client.0.smithi123.stdout:5/92: readlink d0/l3 0 2024-02-20T08:05:20.929 INFO:tasks.workunit.client.0.smithi123.stdout:3/153: dwrite d0/d6/d1a/d1b/f30 [4194304,4194304] 0 2024-02-20T08:05:20.932 INFO:tasks.workunit.client.0.smithi123.stdout:3/154: write d0/d6/f2e [169453,70926] 0 2024-02-20T08:05:20.933 INFO:tasks.workunit.client.0.smithi123.stdout:9/94: unlink d6/c9 0 2024-02-20T08:05:20.934 INFO:tasks.workunit.client.0.smithi123.stdout:3/155: write d0/d6/f1f [546422,109423] 0 2024-02-20T08:05:20.935 INFO:tasks.workunit.client.0.smithi123.stdout:3/156: chown d0/dd/f8 5835767 1 2024-02-20T08:05:20.939 INFO:tasks.workunit.client.0.smithi123.stdout:7/102: mkdir d0/d6/d7/d22 0 2024-02-20T08:05:20.945 INFO:tasks.workunit.client.0.smithi123.stdout:9/95: mkdir d6/d19 0 2024-02-20T08:05:20.950 INFO:tasks.workunit.client.0.smithi123.stdout:5/93: fsync d0/f19 0 2024-02-20T08:05:20.951 INFO:tasks.workunit.client.0.smithi123.stdout:4/122: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:20.951 INFO:tasks.workunit.client.0.smithi123.stdout:5/94: chown d0/f15 331071 1 2024-02-20T08:05:20.953 INFO:tasks.workunit.client.0.smithi123.stdout:5/95: write d0/f15 [889401,34049] 0 2024-02-20T08:05:20.954 INFO:tasks.workunit.client.0.smithi123.stdout:9/96: write d6/f12 [657856,16071] 0 2024-02-20T08:05:20.955 INFO:tasks.workunit.client.0.smithi123.stdout:7/103: mkdir d0/d23 0 2024-02-20T08:05:20.956 INFO:tasks.workunit.client.0.smithi123.stdout:7/104: fdatasync d0/d6/d7/f1e 0 2024-02-20T08:05:20.959 INFO:tasks.workunit.client.0.smithi123.stdout:3/157: rmdir d0/d6/d34/d37 0 2024-02-20T08:05:20.961 INFO:tasks.workunit.client.0.smithi123.stdout:3/158: truncate d0/d6/d1a/d1b/d2a/f3a 566030 0 2024-02-20T08:05:20.961 INFO:tasks.workunit.client.0.smithi123.stdout:5/96: creat d0/d17/f1a x:0 0 0 2024-02-20T08:05:20.962 INFO:tasks.workunit.client.0.smithi123.stdout:3/159: chown d0/d6/d1a/d1e 25 1 2024-02-20T08:05:20.964 INFO:tasks.workunit.client.0.smithi123.stdout:3/160: write d0/d6/f2e [901866,38158] 0 2024-02-20T08:05:20.967 INFO:tasks.workunit.client.0.smithi123.stdout:8/142: link d6/d1c/d29/c30 d6/d1c/c33 0 2024-02-20T08:05:20.968 INFO:tasks.workunit.client.0.smithi123.stdout:5/97: dwrite d0/f15 [0,4194304] 0 2024-02-20T08:05:20.972 INFO:tasks.workunit.client.0.smithi123.stdout:9/97: mkdir d6/d19/d1a 0 2024-02-20T08:05:20.974 INFO:tasks.workunit.client.0.smithi123.stdout:3/161: creat d0/d6/d1a/d1b/d1c/f3c x:0 0 0 2024-02-20T08:05:20.976 INFO:tasks.workunit.client.0.smithi123.stdout:8/143: dwrite d6/f2f [0,4194304] 0 2024-02-20T08:05:20.976 INFO:tasks.workunit.client.0.smithi123.stdout:7/105: symlink d0/d6/d7/d22/l24 0 2024-02-20T08:05:20.983 INFO:tasks.workunit.client.0.smithi123.stdout:7/106: chown d0/d6/d7/d10/c1c 35 1 2024-02-20T08:05:20.983 INFO:tasks.workunit.client.0.smithi123.stdout:3/162: dwrite d0/d6/d1a/d1b/d2a/f3a [0,4194304] 0 2024-02-20T08:05:20.985 INFO:tasks.workunit.client.0.smithi123.stdout:7/107: chown d0/db/c1b 88 1 2024-02-20T08:05:20.985 INFO:tasks.workunit.client.0.smithi123.stdout:8/144: dwrite f0 [4194304,4194304] 0 2024-02-20T08:05:20.986 INFO:tasks.workunit.client.0.smithi123.stdout:3/163: dread - d0/d6/d1a/d1b/d1c/d20/f31 zero size 2024-02-20T08:05:20.991 INFO:tasks.workunit.client.0.smithi123.stdout:5/98: rmdir d0/d17 39 2024-02-20T08:05:20.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/108: dread d0/d6/d7/f16 [0,4194304] 0 2024-02-20T08:05:20.995 INFO:tasks.workunit.client.0.smithi123.stdout:8/145: truncate d6/fb 3290826 0 2024-02-20T08:05:20.996 INFO:tasks.workunit.client.0.smithi123.stdout:3/164: dread d0/d6/f1f [0,4194304] 0 2024-02-20T08:05:20.996 INFO:tasks.workunit.client.0.smithi123.stdout:3/165: chown d0/d6/f14 8874 1 2024-02-20T08:05:20.998 INFO:tasks.workunit.client.0.smithi123.stdout:7/109: readlink d0/l1a 0 2024-02-20T08:05:21.002 INFO:tasks.workunit.client.0.smithi123.stdout:8/146: mknod d6/c34 0 2024-02-20T08:05:21.003 INFO:tasks.workunit.client.0.smithi123.stdout:8/147: stat d6/f20 0 2024-02-20T08:05:21.004 INFO:tasks.workunit.client.0.smithi123.stdout:9/98: write f5 [759592,32410] 0 2024-02-20T08:05:21.005 INFO:tasks.workunit.client.0.smithi123.stdout:5/99: creat d0/d13/f1b x:0 0 0 2024-02-20T08:05:21.006 INFO:tasks.workunit.client.0.smithi123.stdout:7/110: dwrite d0/d6/dd/d15/f1f [0,4194304] 0 2024-02-20T08:05:21.010 INFO:tasks.workunit.client.0.smithi123.stdout:3/166: creat d0/d6/d1a/f3d x:0 0 0 2024-02-20T08:05:21.010 INFO:tasks.workunit.client.0.smithi123.stdout:7/111: write d0/d6/d7/f20 [140995,103780] 0 2024-02-20T08:05:21.014 INFO:tasks.workunit.client.0.smithi123.stdout:8/148: dwrite d6/f1a [4194304,4194304] 0 2024-02-20T08:05:21.016 INFO:tasks.workunit.client.0.smithi123.stdout:9/99: rmdir d6/dc 39 2024-02-20T08:05:21.020 INFO:tasks.workunit.client.0.smithi123.stdout:5/100: mknod d0/d13/c1c 0 2024-02-20T08:05:21.020 INFO:tasks.workunit.client.0.smithi123.stdout:3/167: dread d0/d6/f2e [0,4194304] 0 2024-02-20T08:05:21.023 INFO:tasks.workunit.client.0.smithi123.stdout:3/168: write d0/dd/f38 [4768654,13158] 0 2024-02-20T08:05:21.025 INFO:tasks.workunit.client.0.smithi123.stdout:3/169: chown d0/c11 343 1 2024-02-20T08:05:21.025 INFO:tasks.workunit.client.0.smithi123.stdout:9/100: dwrite d6/fa [0,4194304] 0 2024-02-20T08:05:21.026 INFO:tasks.workunit.client.0.smithi123.stdout:7/112: creat d0/d6/d7/f25 x:0 0 0 2024-02-20T08:05:21.026 INFO:tasks.workunit.client.0.smithi123.stdout:3/170: dread - d0/d6/d1a/f3d zero size 2024-02-20T08:05:21.027 INFO:tasks.workunit.client.0.smithi123.stdout:7/113: read - d0/d6/d7/f25 zero size 2024-02-20T08:05:21.031 INFO:tasks.workunit.client.0.smithi123.stdout:8/149: unlink f0 0 2024-02-20T08:05:21.035 INFO:tasks.workunit.client.0.smithi123.stdout:3/171: dwrite d0/d6/d32/f33 [0,4194304] 0 2024-02-20T08:05:21.037 INFO:tasks.workunit.client.0.smithi123.stdout:3/172: chown d0/d6/d1a/d1e/f17 130284434 1 2024-02-20T08:05:21.040 INFO:tasks.workunit.client.0.smithi123.stdout:8/150: mkdir d6/d1c/d29/d35 0 2024-02-20T08:05:21.041 INFO:tasks.workunit.client.0.smithi123.stdout:3/173: creat d0/d6/d1a/d1b/d1c/d21/f3e x:0 0 0 2024-02-20T08:05:21.042 INFO:tasks.workunit.client.0.smithi123.stdout:3/174: chown d0/d6/d1a/d1b/f30 454673 1 2024-02-20T08:05:21.044 INFO:tasks.workunit.client.0.smithi123.stdout:5/101: creat d0/f1d x:0 0 0 2024-02-20T08:05:21.046 INFO:tasks.workunit.client.0.smithi123.stdout:8/151: rename d6/d1c/d22/l2a to d6/d32/l36 0 2024-02-20T08:05:21.048 INFO:tasks.workunit.client.0.smithi123.stdout:5/102: dread d0/fc [0,4194304] 0 2024-02-20T08:05:21.048 INFO:tasks.workunit.client.0.smithi123.stdout:9/101: getdents d6 0 2024-02-20T08:05:21.050 INFO:tasks.workunit.client.0.smithi123.stdout:8/152: stat d6/f7 0 2024-02-20T08:05:21.052 INFO:tasks.workunit.client.0.smithi123.stdout:9/102: dread d6/fb [0,4194304] 0 2024-02-20T08:05:21.053 INFO:tasks.workunit.client.0.smithi123.stdout:5/103: rename d0/f1d to d0/d13/f1e 0 2024-02-20T08:05:21.060 INFO:tasks.workunit.client.0.smithi123.stdout:9/103: rename d6/dc/d15 to d6/d19/d1b 0 2024-02-20T08:05:21.062 INFO:tasks.workunit.client.0.smithi123.stdout:8/153: symlink d6/d1c/d29/d35/l37 0 2024-02-20T08:05:21.077 INFO:tasks.workunit.client.0.smithi123.stdout:7/114: truncate d0/d6/d7/f16 3116707 0 2024-02-20T08:05:21.078 INFO:tasks.workunit.client.0.smithi123.stdout:9/104: dread f1 [0,4194304] 0 2024-02-20T08:05:21.078 INFO:tasks.workunit.client.0.smithi123.stdout:9/105: stat d6/fd 0 2024-02-20T08:05:21.079 INFO:tasks.workunit.client.0.smithi123.stdout:9/106: truncate f5 1295257 0 2024-02-20T08:05:21.079 INFO:tasks.workunit.client.0.smithi123.stdout:8/154: getdents d6/d32 0 2024-02-20T08:05:21.083 INFO:tasks.workunit.client.0.smithi123.stdout:9/107: mknod d6/d19/d1b/c1c 0 2024-02-20T08:05:21.084 INFO:tasks.workunit.client.0.smithi123.stdout:9/108: write d6/fb [3464777,20738] 0 2024-02-20T08:05:21.092 INFO:tasks.workunit.client.0.smithi123.stdout:5/104: dwrite d0/fc [0,4194304] 0 2024-02-20T08:05:21.094 INFO:tasks.workunit.client.0.smithi123.stdout:5/105: write d0/f11 [1223919,82131] 0 2024-02-20T08:05:21.098 INFO:tasks.workunit.client.0.smithi123.stdout:5/106: rmdir d0/d13 39 2024-02-20T08:05:21.102 INFO:tasks.workunit.client.0.smithi123.stdout:5/107: stat d0/d13 0 2024-02-20T08:05:21.103 INFO:tasks.workunit.client.0.smithi123.stdout:5/108: fsync d0/d13/f1b 0 2024-02-20T08:05:21.104 INFO:tasks.workunit.client.0.smithi123.stdout:5/109: write d0/f11 [312505,47452] 0 2024-02-20T08:05:21.108 INFO:tasks.workunit.client.0.smithi123.stdout:8/155: dread d6/f2f [0,4194304] 0 2024-02-20T08:05:21.112 INFO:tasks.workunit.client.0.smithi123.stdout:7/115: truncate d0/f5 626617 0 2024-02-20T08:05:21.115 INFO:tasks.workunit.client.0.smithi123.stdout:9/109: write d6/ff [1036311,41247] 0 2024-02-20T08:05:21.116 INFO:tasks.workunit.client.0.smithi123.stdout:9/110: stat d6/fd 0 2024-02-20T08:05:21.117 INFO:tasks.workunit.client.0.smithi123.stdout:9/111: read d6/f12 [412915,16969] 0 2024-02-20T08:05:21.118 INFO:tasks.workunit.client.0.smithi123.stdout:5/110: rename d0/d17 to d0/d13/d1f 0 2024-02-20T08:05:21.120 INFO:tasks.workunit.client.0.smithi123.stdout:7/116: rmdir d0/d6/d7/d10 39 2024-02-20T08:05:21.122 INFO:tasks.workunit.client.0.smithi123.stdout:7/117: dread - d0/d6/d7/f25 zero size 2024-02-20T08:05:21.123 INFO:tasks.workunit.client.0.smithi123.stdout:5/111: dwrite d0/f8 [4194304,4194304] 0 2024-02-20T08:05:21.124 INFO:tasks.workunit.client.0.smithi123.stdout:5/112: stat d0/lf 0 2024-02-20T08:05:21.130 INFO:tasks.workunit.client.0.smithi123.stdout:7/118: mkdir d0/d6/d7/d22/d26 0 2024-02-20T08:05:21.134 INFO:tasks.workunit.client.0.smithi123.stdout:9/112: dwrite f1 [0,4194304] 0 2024-02-20T08:05:21.142 INFO:tasks.workunit.client.0.smithi123.stdout:9/113: dwrite d6/ff [0,4194304] 0 2024-02-20T08:05:21.143 INFO:tasks.workunit.client.0.smithi123.stdout:9/114: read f1 [3333051,99159] 0 2024-02-20T08:05:21.145 INFO:tasks.workunit.client.0.smithi123.stdout:7/119: creat d0/db/f27 x:0 0 0 2024-02-20T08:05:21.147 INFO:tasks.workunit.client.0.smithi123.stdout:8/156: getdents d6/d32 0 2024-02-20T08:05:21.154 INFO:tasks.workunit.client.0.smithi123.stdout:9/115: unlink d6/c7 0 2024-02-20T08:05:21.156 INFO:tasks.workunit.client.0.smithi123.stdout:7/120: rename d0/d6/dd/c18 to d0/d6/d7/d22/d26/c28 0 2024-02-20T08:05:21.158 INFO:tasks.workunit.client.0.smithi123.stdout:8/157: fsync d6/fa 0 2024-02-20T08:05:21.159 INFO:tasks.workunit.client.0.smithi123.stdout:5/113: getdents d0/d13/d1f 0 2024-02-20T08:05:21.165 INFO:tasks.workunit.client.0.smithi123.stdout:7/121: mkdir d0/d6/d29 0 2024-02-20T08:05:21.165 INFO:tasks.workunit.client.0.smithi123.stdout:7/122: fsync d0/d6/d7/f20 0 2024-02-20T08:05:21.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/114: mknod d0/c20 0 2024-02-20T08:05:21.176 INFO:tasks.workunit.client.0.smithi123.stdout:9/116: chown d6/d19/d1b/c1c 108289 1 2024-02-20T08:05:21.178 INFO:tasks.workunit.client.0.smithi123.stdout:8/158: rename d6/f12 to d6/d1c/d29/f38 0 2024-02-20T08:05:21.178 INFO:tasks.workunit.client.0.smithi123.stdout:9/117: fdatasync f1 0 2024-02-20T08:05:21.182 INFO:tasks.workunit.client.0.smithi123.stdout:8/159: write d6/f15 [423712,60207] 0 2024-02-20T08:05:21.185 INFO:tasks.workunit.client.0.smithi123.stdout:7/123: getdents d0 0 2024-02-20T08:05:21.185 INFO:tasks.workunit.client.0.smithi123.stdout:7/124: readlink d0/d6/l8 0 2024-02-20T08:05:21.187 INFO:tasks.workunit.client.0.smithi123.stdout:8/160: chown d6/fd 7021618 1 2024-02-20T08:05:21.189 INFO:tasks.workunit.client.0.smithi123.stdout:9/118: dwrite d6/fb [4194304,4194304] 0 2024-02-20T08:05:21.193 INFO:tasks.workunit.client.0.smithi123.stdout:9/119: readlink d6/dc/l16 0 2024-02-20T08:05:21.195 INFO:tasks.workunit.client.0.smithi123.stdout:7/125: truncate d0/d6/d7/f16 1061325 0 2024-02-20T08:05:21.201 INFO:tasks.workunit.client.0.smithi123.stdout:7/126: mkdir d0/d6/d7/d10/d1d/d2a 0 2024-02-20T08:05:21.205 INFO:tasks.workunit.client.0.smithi123.stdout:7/127: creat d0/d6/d7/d10/d1d/d2a/f2b x:0 0 0 2024-02-20T08:05:21.207 INFO:tasks.workunit.client.0.smithi123.stdout:7/128: rename d0/d6/d7 to d0/d6/d7/d22/d2c 22 2024-02-20T08:05:21.207 INFO:tasks.workunit.client.0.smithi123.stdout:7/129: fsync d0/d6/d7/f25 0 2024-02-20T08:05:21.208 INFO:tasks.workunit.client.0.smithi123.stdout:7/130: chown d0/d6/d7 56 1 2024-02-20T08:05:21.213 INFO:tasks.workunit.client.0.smithi123.stdout:7/131: dwrite d0/d6/dd/d15/f1f [0,4194304] 0 2024-02-20T08:05:21.216 INFO:tasks.workunit.client.0.smithi123.stdout:8/161: truncate d6/d1c/d29/f38 1139160 0 2024-02-20T08:05:21.223 INFO:tasks.workunit.client.0.smithi123.stdout:7/132: creat d0/d23/f2d x:0 0 0 2024-02-20T08:05:21.225 INFO:tasks.workunit.client.0.smithi123.stdout:8/162: symlink d6/l39 0 2024-02-20T08:05:21.228 INFO:tasks.workunit.client.0.smithi123.stdout:7/133: creat d0/d6/d7/d22/d26/f2e x:0 0 0 2024-02-20T08:05:21.232 INFO:tasks.workunit.client.0.smithi123.stdout:7/134: creat d0/f2f x:0 0 0 2024-02-20T08:05:21.240 INFO:tasks.workunit.client.0.smithi123.stdout:6/165: sync 2024-02-20T08:05:21.243 INFO:tasks.workunit.client.0.smithi123.stdout:6/166: mkdir d0/d38 0 2024-02-20T08:05:21.245 INFO:tasks.workunit.client.0.smithi123.stdout:6/167: symlink d0/l39 0 2024-02-20T08:05:21.248 INFO:tasks.workunit.client.0.smithi123.stdout:6/168: rename d0/f2a to d0/d38/f3a 0 2024-02-20T08:05:21.249 INFO:tasks.workunit.client.0.smithi123.stdout:6/169: write d0/f17 [860783,88274] 0 2024-02-20T08:05:21.253 INFO:tasks.workunit.client.0.smithi123.stdout:6/170: fsync d0/fe 0 2024-02-20T08:05:21.255 INFO:tasks.workunit.client.0.smithi123.stdout:8/163: write d6/fc [62169,3757] 0 2024-02-20T08:05:21.257 INFO:tasks.workunit.client.0.smithi123.stdout:7/135: readlink d0/l1a 0 2024-02-20T08:05:21.258 INFO:tasks.workunit.client.0.smithi123.stdout:6/171: rename d0/f1d to d0/d38/f3b 0 2024-02-20T08:05:21.327 INFO:tasks.workunit.client.0.smithi123.stdout:7/136: creat d0/f30 x:0 0 0 2024-02-20T08:05:21.333 INFO:tasks.workunit.client.0.smithi123.stdout:8/164: dread d6/f20 [0,4194304] 0 2024-02-20T08:05:21.335 INFO:tasks.workunit.client.0.smithi123.stdout:7/137: creat d0/d6/f31 x:0 0 0 2024-02-20T08:05:21.340 INFO:tasks.workunit.client.0.smithi123.stdout:7/138: readlink d0/l1a 0 2024-02-20T08:05:21.340 INFO:tasks.workunit.client.0.smithi123.stdout:7/139: readlink d0/d6/l8 0 2024-02-20T08:05:21.344 INFO:tasks.workunit.client.0.smithi123.stdout:6/172: getdents d0 0 2024-02-20T08:05:21.345 INFO:tasks.workunit.client.0.smithi123.stdout:8/165: dwrite d6/f1b [0,4194304] 0 2024-02-20T08:05:21.346 INFO:tasks.workunit.client.0.smithi123.stdout:8/166: fsync d6/d1c/d29/f2e 0 2024-02-20T08:05:21.352 INFO:tasks.workunit.client.0.smithi123.stdout:6/173: symlink d0/l3c 0 2024-02-20T08:05:21.356 INFO:tasks.workunit.client.0.smithi123.stdout:6/174: fsync d0/f21 0 2024-02-20T08:05:21.363 INFO:tasks.workunit.client.0.smithi123.stdout:6/175: rename d0/c10 to d0/d38/c3d 0 2024-02-20T08:05:21.376 INFO:tasks.workunit.client.0.smithi123.stdout:6/176: dread d0/f30 [0,4194304] 0 2024-02-20T08:05:21.381 INFO:tasks.workunit.client.0.smithi123.stdout:6/177: mkdir d0/d3e 0 2024-02-20T08:05:21.387 INFO:tasks.workunit.client.0.smithi123.stdout:6/178: dwrite d0/f29 [0,4194304] 0 2024-02-20T08:05:21.391 INFO:tasks.workunit.client.0.smithi123.stdout:6/179: mknod d0/d3e/c3f 0 2024-02-20T08:05:21.393 INFO:tasks.workunit.client.0.smithi123.stdout:6/180: mkdir d0/d3e/d40 0 2024-02-20T08:05:21.394 INFO:tasks.workunit.client.0.smithi123.stdout:6/181: mkdir d0/d3e/d41 0 2024-02-20T08:05:21.396 INFO:tasks.workunit.client.0.smithi123.stdout:6/182: write d0/d38/f3a [1577582,51716] 0 2024-02-20T08:05:21.491 INFO:tasks.workunit.client.0.smithi123.stdout:0/104: sync 2024-02-20T08:05:21.492 INFO:tasks.workunit.client.0.smithi123.stdout:6/183: fdatasync d0/f17 0 2024-02-20T08:05:21.492 INFO:tasks.workunit.client.0.smithi123.stdout:7/140: write d0/f5 [866700,130795] 0 2024-02-20T08:05:21.493 INFO:tasks.workunit.client.0.smithi123.stdout:8/167: write d6/d1c/f21 [3442464,88593] 0 2024-02-20T08:05:21.493 INFO:tasks.workunit.client.0.smithi123.stdout:0/105: symlink d2/l21 0 2024-02-20T08:05:21.494 INFO:tasks.workunit.client.0.smithi123.stdout:6/184: read - d0/f31 zero size 2024-02-20T08:05:21.496 INFO:tasks.workunit.client.0.smithi123.stdout:8/168: unlink d6/d1c/d29/d35/l37 0 2024-02-20T08:05:21.497 INFO:tasks.workunit.client.0.smithi123.stdout:0/106: creat d2/de/d1e/f22 x:0 0 0 2024-02-20T08:05:21.499 INFO:tasks.workunit.client.0.smithi123.stdout:8/169: creat d6/d1c/d29/f3a x:0 0 0 2024-02-20T08:05:21.506 INFO:tasks.workunit.client.0.smithi123.stdout:7/141: getdents d0/d6/d7/d22/d26 0 2024-02-20T08:05:21.508 INFO:tasks.workunit.client.0.smithi123.stdout:8/170: dread d6/fa [0,4194304] 0 2024-02-20T08:05:21.511 INFO:tasks.workunit.client.0.smithi123.stdout:0/107: dread d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:21.516 INFO:tasks.workunit.client.0.smithi123.stdout:8/171: creat d6/f3b x:0 0 0 2024-02-20T08:05:21.516 INFO:tasks.workunit.client.0.smithi123.stdout:8/172: fdatasync d6/f3b 0 2024-02-20T08:05:21.518 INFO:tasks.workunit.client.0.smithi123.stdout:0/108: link d2/dd/l13 d2/de/d1e/l23 0 2024-02-20T08:05:21.521 INFO:tasks.workunit.client.0.smithi123.stdout:0/109: rename d2/d3/f10 to d2/d3/f24 0 2024-02-20T08:05:21.524 INFO:tasks.workunit.client.0.smithi123.stdout:0/110: creat d2/de/d1e/d1f/f25 x:0 0 0 2024-02-20T08:05:21.525 INFO:tasks.workunit.client.0.smithi123.stdout:8/173: link d6/l19 d6/d32/l3c 0 2024-02-20T08:05:21.527 INFO:tasks.workunit.client.0.smithi123.stdout:0/111: symlink d2/de/d1e/d1f/l26 0 2024-02-20T08:05:21.532 INFO:tasks.workunit.client.0.smithi123.stdout:8/174: dwrite d6/f3b [0,4194304] 0 2024-02-20T08:05:21.535 INFO:tasks.workunit.client.0.smithi123.stdout:0/112: dwrite d2/f1c [0,4194304] 0 2024-02-20T08:05:21.541 INFO:tasks.workunit.client.0.smithi123.stdout:0/113: rmdir d2/dd 39 2024-02-20T08:05:21.541 INFO:tasks.workunit.client.0.smithi123.stdout:0/114: chown d2/d3/ff 194 1 2024-02-20T08:05:21.554 INFO:tasks.workunit.client.0.smithi123.stdout:6/185: write d0/f13 [2970589,51334] 0 2024-02-20T08:05:21.555 INFO:tasks.workunit.client.0.smithi123.stdout:8/175: rmdir d6/d1c/d29/d35 0 2024-02-20T08:05:21.557 INFO:tasks.workunit.client.0.smithi123.stdout:6/186: mknod d0/c42 0 2024-02-20T08:05:21.561 INFO:tasks.workunit.client.0.smithi123.stdout:8/176: rename d6/c34 to d6/d1c/d22/c3d 0 2024-02-20T08:05:21.562 INFO:tasks.workunit.client.0.smithi123.stdout:8/177: readlink d6/d1c/d22/l25 0 2024-02-20T08:05:21.562 INFO:tasks.workunit.client.0.smithi123.stdout:6/187: symlink d0/d3e/d41/l43 0 2024-02-20T08:05:21.564 INFO:tasks.workunit.client.0.smithi123.stdout:0/115: dread d2/f8 [4194304,4194304] 0 2024-02-20T08:05:21.564 INFO:tasks.workunit.client.0.smithi123.stdout:0/116: dread - d2/f1b zero size 2024-02-20T08:05:21.568 INFO:tasks.workunit.client.0.smithi123.stdout:6/188: dwrite d0/f33 [0,4194304] 0 2024-02-20T08:05:21.570 INFO:tasks.workunit.client.0.smithi123.stdout:8/178: rename d6/c11 to d6/d1c/d22/c3e 0 2024-02-20T08:05:21.571 INFO:tasks.workunit.client.0.smithi123.stdout:0/117: symlink d2/de/d1e/l27 0 2024-02-20T08:05:21.574 INFO:tasks.workunit.client.0.smithi123.stdout:6/189: symlink d0/d38/l44 0 2024-02-20T08:05:21.578 INFO:tasks.workunit.client.0.smithi123.stdout:6/190: dread d0/f22 [0,4194304] 0 2024-02-20T08:05:21.581 INFO:tasks.workunit.client.0.smithi123.stdout:0/118: mkdir d2/de/d19/d28 0 2024-02-20T08:05:21.583 INFO:tasks.workunit.client.0.smithi123.stdout:8/179: dread d6/d1c/f21 [0,4194304] 0 2024-02-20T08:05:21.583 INFO:tasks.workunit.client.0.smithi123.stdout:6/191: mknod d0/d3e/d40/c45 0 2024-02-20T08:05:21.584 INFO:tasks.workunit.client.0.smithi123.stdout:0/119: creat d2/de/d1e/d1f/f29 x:0 0 0 2024-02-20T08:05:21.584 INFO:tasks.workunit.client.0.smithi123.stdout:8/180: write d6/d1c/d22/f23 [1038798,110309] 0 2024-02-20T08:05:21.590 INFO:tasks.workunit.client.0.smithi123.stdout:6/192: dwrite d0/f1e [0,4194304] 0 2024-02-20T08:05:21.591 INFO:tasks.workunit.client.0.smithi123.stdout:8/181: dread d6/f20 [0,4194304] 0 2024-02-20T08:05:21.591 INFO:tasks.workunit.client.0.smithi123.stdout:0/120: rename d2/de/d1e/l23 to d2/dd/l2a 0 2024-02-20T08:05:21.591 INFO:tasks.workunit.client.0.smithi123.stdout:6/193: fdatasync d0/f29 0 2024-02-20T08:05:21.592 INFO:tasks.workunit.client.0.smithi123.stdout:0/121: fsync d2/f1c 0 2024-02-20T08:05:21.593 INFO:tasks.workunit.client.0.smithi123.stdout:0/122: stat d2/de 0 2024-02-20T08:05:21.594 INFO:tasks.workunit.client.0.smithi123.stdout:8/182: mkdir d6/d1c/d29/d3f 0 2024-02-20T08:05:21.595 INFO:tasks.workunit.client.0.smithi123.stdout:6/194: symlink d0/d38/l46 0 2024-02-20T08:05:21.598 INFO:tasks.workunit.client.0.smithi123.stdout:6/195: symlink d0/d3e/d41/l47 0 2024-02-20T08:05:21.602 INFO:tasks.workunit.client.0.smithi123.stdout:6/196: mkdir d0/d3e/d40/d48 0 2024-02-20T08:05:21.610 INFO:tasks.workunit.client.0.smithi123.stdout:8/183: getdents d6 0 2024-02-20T08:05:21.610 INFO:tasks.workunit.client.0.smithi123.stdout:8/184: chown d6/d1c/d22/c2d 1570 1 2024-02-20T08:05:21.611 INFO:tasks.workunit.client.0.smithi123.stdout:8/185: readlink d6/l9 0 2024-02-20T08:05:21.699 INFO:tasks.workunit.client.0.smithi123.stdout:2/109: sync 2024-02-20T08:05:21.700 INFO:tasks.workunit.client.0.smithi123.stdout:2/110: readlink lf 0 2024-02-20T08:05:21.701 INFO:tasks.workunit.client.0.smithi123.stdout:2/111: write f17 [903564,118031] 0 2024-02-20T08:05:21.739 INFO:tasks.workunit.client.0.smithi123.stdout:2/112: rmdir d1a 39 2024-02-20T08:05:21.740 INFO:tasks.workunit.client.0.smithi123.stdout:2/113: stat d1a/f1d 0 2024-02-20T08:05:21.741 INFO:tasks.workunit.client.0.smithi123.stdout:0/123: rmdir d2/de/d1e 39 2024-02-20T08:05:21.741 INFO:tasks.workunit.client.0.smithi123.stdout:2/114: write f11 [6815716,75596] 0 2024-02-20T08:05:21.742 INFO:tasks.workunit.client.0.smithi123.stdout:0/124: fsync d2/f18 0 2024-02-20T08:05:21.750 INFO:tasks.workunit.client.0.smithi123.stdout:6/197: truncate d0/f1e 145073 0 2024-02-20T08:05:21.755 INFO:tasks.workunit.client.0.smithi123.stdout:6/198: dread d0/f28 [0,4194304] 0 2024-02-20T08:05:21.755 INFO:tasks.workunit.client.0.smithi123.stdout:8/186: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:21.756 INFO:tasks.workunit.client.0.smithi123.stdout:2/115: write d1a/f1d [5095913,63052] 0 2024-02-20T08:05:21.757 INFO:tasks.workunit.client.0.smithi123.stdout:6/199: chown d0/f23 3363980 1 2024-02-20T08:05:21.757 INFO:tasks.workunit.client.0.smithi123.stdout:2/116: chown d1a/c1c 63991555 1 2024-02-20T08:05:21.762 INFO:tasks.workunit.client.0.smithi123.stdout:6/200: creat d0/d38/f49 x:0 0 0 2024-02-20T08:05:21.764 INFO:tasks.workunit.client.0.smithi123.stdout:8/187: symlink d6/d1c/d29/d3f/l40 0 2024-02-20T08:05:21.764 INFO:tasks.workunit.client.0.smithi123.stdout:6/201: write d0/f31 [583567,100364] 0 2024-02-20T08:05:21.767 INFO:tasks.workunit.client.0.smithi123.stdout:2/117: dwrite d1a/f1f [0,4194304] 0 2024-02-20T08:05:21.767 INFO:tasks.workunit.client.0.smithi123.stdout:2/118: stat l13 0 2024-02-20T08:05:21.774 INFO:tasks.workunit.client.0.smithi123.stdout:8/188: dwrite d6/f20 [0,4194304] 0 2024-02-20T08:05:21.774 INFO:tasks.workunit.client.0.smithi123.stdout:6/202: rmdir d0/d38 39 2024-02-20T08:05:21.775 INFO:tasks.workunit.client.0.smithi123.stdout:2/119: dwrite d1a/f1f [0,4194304] 0 2024-02-20T08:05:21.776 INFO:tasks.workunit.client.0.smithi123.stdout:6/203: dread d0/f18 [0,4194304] 0 2024-02-20T08:05:21.778 INFO:tasks.workunit.client.0.smithi123.stdout:8/189: symlink d6/d1c/d29/l41 0 2024-02-20T08:05:21.780 INFO:tasks.workunit.client.0.smithi123.stdout:2/120: dread d1a/f1f [0,4194304] 0 2024-02-20T08:05:21.781 INFO:tasks.workunit.client.0.smithi123.stdout:6/204: write d0/f1e [1184251,35659] 0 2024-02-20T08:05:21.781 INFO:tasks.workunit.client.0.smithi123.stdout:2/121: rename d1a to d1a/d22 22 2024-02-20T08:05:21.781 INFO:tasks.workunit.client.0.smithi123.stdout:6/205: chown d0/l1a 251 1 2024-02-20T08:05:21.783 INFO:tasks.workunit.client.0.smithi123.stdout:8/190: rename d6/d1c/d22/l25 to d6/d1c/d22/l42 0 2024-02-20T08:05:21.783 INFO:tasks.workunit.client.0.smithi123.stdout:8/191: chown d6/c13 26721 1 2024-02-20T08:05:21.784 INFO:tasks.workunit.client.0.smithi123.stdout:2/122: creat d1a/f23 x:0 0 0 2024-02-20T08:05:21.789 INFO:tasks.workunit.client.0.smithi123.stdout:6/206: getdents d0 0 2024-02-20T08:05:21.789 INFO:tasks.workunit.client.0.smithi123.stdout:2/123: dread fe [0,4194304] 0 2024-02-20T08:05:21.790 INFO:tasks.workunit.client.0.smithi123.stdout:8/192: link d6/c13 d6/d1c/d29/d3f/c43 0 2024-02-20T08:05:21.794 INFO:tasks.workunit.client.0.smithi123.stdout:2/124: dread d1a/f1d [4194304,4194304] 0 2024-02-20T08:05:21.795 INFO:tasks.workunit.client.0.smithi123.stdout:8/193: link d6/f2f d6/d1c/d2c/f44 0 2024-02-20T08:05:21.798 INFO:tasks.workunit.client.0.smithi123.stdout:8/194: creat d6/d1c/d29/d3f/f45 x:0 0 0 2024-02-20T08:05:21.800 INFO:tasks.workunit.client.0.smithi123.stdout:2/125: dwrite d1a/f23 [0,4194304] 0 2024-02-20T08:05:21.802 INFO:tasks.workunit.client.0.smithi123.stdout:8/195: symlink d6/d1c/d29/l46 0 2024-02-20T08:05:21.805 INFO:tasks.workunit.client.0.smithi123.stdout:2/126: link l16 d1a/l24 0 2024-02-20T08:05:21.806 INFO:tasks.workunit.client.0.smithi123.stdout:2/127: fsync d1a/f1d 0 2024-02-20T08:05:21.807 INFO:tasks.workunit.client.0.smithi123.stdout:8/196: dread d6/d1c/d2c/f44 [0,4194304] 0 2024-02-20T08:05:21.807 INFO:tasks.workunit.client.0.smithi123.stdout:2/128: write d1a/f1d [1029861,2653] 0 2024-02-20T08:05:21.809 INFO:tasks.workunit.client.0.smithi123.stdout:2/129: mknod d1a/c25 0 2024-02-20T08:05:21.810 INFO:tasks.workunit.client.0.smithi123.stdout:2/130: fsync fb 0 2024-02-20T08:05:21.814 INFO:tasks.workunit.client.0.smithi123.stdout:8/197: dwrite d6/d1c/d29/f2e [0,4194304] 0 2024-02-20T08:05:21.816 INFO:tasks.workunit.client.0.smithi123.stdout:8/198: write d6/d1c/d29/f2e [1698139,19330] 0 2024-02-20T08:05:21.820 INFO:tasks.workunit.client.0.smithi123.stdout:8/199: mkdir d6/d1c/d47 0 2024-02-20T08:05:21.820 INFO:tasks.workunit.client.0.smithi123.stdout:6/207: write d0/f15 [697804,112468] 0 2024-02-20T08:05:21.825 INFO:tasks.workunit.client.0.smithi123.stdout:6/208: mkdir d0/d3e/d40/d48/d4a 0 2024-02-20T08:05:21.827 INFO:tasks.workunit.client.0.smithi123.stdout:8/200: dwrite d6/f1b [0,4194304] 0 2024-02-20T08:05:21.829 INFO:tasks.workunit.client.0.smithi123.stdout:8/201: write d6/d1c/d29/d3f/f45 [228447,23079] 0 2024-02-20T08:05:21.830 INFO:tasks.workunit.client.0.smithi123.stdout:8/202: write d6/fc [627937,114512] 0 2024-02-20T08:05:21.847 INFO:tasks.workunit.client.0.smithi123.stdout:6/209: dwrite d0/f22 [0,4194304] 0 2024-02-20T08:05:21.848 INFO:tasks.workunit.client.0.smithi123.stdout:6/210: write d0/f34 [888155,45036] 0 2024-02-20T08:05:21.851 INFO:tasks.workunit.client.0.smithi123.stdout:8/203: dread d6/fd [0,4194304] 0 2024-02-20T08:05:21.855 INFO:tasks.workunit.client.0.smithi123.stdout:8/204: write d6/fd [1148612,115424] 0 2024-02-20T08:05:21.856 INFO:tasks.workunit.client.0.smithi123.stdout:6/211: dwrite d0/f17 [0,4194304] 0 2024-02-20T08:05:21.858 INFO:tasks.workunit.client.0.smithi123.stdout:8/205: creat d6/d1c/d22/f48 x:0 0 0 2024-02-20T08:05:21.861 INFO:tasks.workunit.client.0.smithi123.stdout:8/206: fdatasync d6/f1a 0 2024-02-20T08:05:21.862 INFO:tasks.workunit.client.0.smithi123.stdout:8/207: chown d6/d1c/d29/f2e 0 1 2024-02-20T08:05:21.863 INFO:tasks.workunit.client.0.smithi123.stdout:6/212: dwrite d0/f13 [0,4194304] 0 2024-02-20T08:05:21.869 INFO:tasks.workunit.client.0.smithi123.stdout:8/208: dread d6/fb [0,4194304] 0 2024-02-20T08:05:21.872 INFO:tasks.workunit.client.0.smithi123.stdout:6/213: dwrite d0/f23 [0,4194304] 0 2024-02-20T08:05:21.876 INFO:tasks.workunit.client.0.smithi123.stdout:6/214: symlink d0/d3e/l4b 0 2024-02-20T08:05:21.877 INFO:tasks.workunit.client.0.smithi123.stdout:6/215: chown d0/d3e 31 1 2024-02-20T08:05:21.880 INFO:tasks.workunit.client.0.smithi123.stdout:8/209: rename d6/d1c/f1e to d6/d1c/f49 0 2024-02-20T08:05:21.881 INFO:tasks.workunit.client.0.smithi123.stdout:6/216: dread d0/f23 [0,4194304] 0 2024-02-20T08:05:21.886 INFO:tasks.workunit.client.0.smithi123.stdout:6/217: symlink d0/d3e/d40/d48/d4a/l4c 0 2024-02-20T08:05:21.887 INFO:tasks.workunit.client.0.smithi123.stdout:6/218: chown d0/f22 25331 1 2024-02-20T08:05:21.900 INFO:tasks.workunit.client.0.smithi123.stdout:8/210: dwrite d6/d1c/d29/f38 [0,4194304] 0 2024-02-20T08:05:21.906 INFO:tasks.workunit.client.0.smithi123.stdout:8/211: rename d6/d1c/d29/d3f/f45 to d6/d32/f4a 0 2024-02-20T08:05:21.909 INFO:tasks.workunit.client.0.smithi123.stdout:6/219: dread d0/d38/f3b [4194304,4194304] 0 2024-02-20T08:05:21.910 INFO:tasks.workunit.client.0.smithi123.stdout:6/220: stat d0/fe 0 2024-02-20T08:05:21.912 INFO:tasks.workunit.client.0.smithi123.stdout:8/212: dwrite d6/d1c/d29/f38 [0,4194304] 0 2024-02-20T08:05:21.915 INFO:tasks.workunit.client.0.smithi123.stdout:8/213: chown d6/fb 7894241 1 2024-02-20T08:05:21.919 INFO:tasks.workunit.client.0.smithi123.stdout:6/221: dwrite d0/f14 [4194304,4194304] 0 2024-02-20T08:05:21.920 INFO:tasks.workunit.client.0.smithi123.stdout:8/214: creat d6/d1c/d22/f4b x:0 0 0 2024-02-20T08:05:21.921 INFO:tasks.workunit.client.0.smithi123.stdout:6/222: chown d0/l35 0 1 2024-02-20T08:05:21.922 INFO:tasks.workunit.client.0.smithi123.stdout:6/223: write d0/f14 [2076053,17722] 0 2024-02-20T08:05:21.922 INFO:tasks.workunit.client.0.smithi123.stdout:6/224: stat d0/c42 0 2024-02-20T08:05:21.931 INFO:tasks.workunit.client.0.smithi123.stdout:6/225: getdents d0/d3e/d40 0 2024-02-20T08:05:21.932 INFO:tasks.workunit.client.0.smithi123.stdout:8/215: dwrite d6/d32/f4a [0,4194304] 0 2024-02-20T08:05:21.934 INFO:tasks.workunit.client.0.smithi123.stdout:6/226: rmdir d0/d3e/d40/d48 39 2024-02-20T08:05:21.935 INFO:tasks.workunit.client.0.smithi123.stdout:6/227: dread - d0/f2c zero size 2024-02-20T08:05:21.936 INFO:tasks.workunit.client.0.smithi123.stdout:6/228: chown d0/f15 7727 1 2024-02-20T08:05:21.939 INFO:tasks.workunit.client.0.smithi123.stdout:8/216: rename d6/d1c/d29/d3f/c43 to d6/d1c/d29/c4c 0 2024-02-20T08:05:21.953 INFO:tasks.workunit.client.0.smithi123.stdout:6/229: truncate d0/d38/f3b 2306791 0 2024-02-20T08:05:21.954 INFO:tasks.workunit.client.0.smithi123.stdout:8/217: truncate d6/d1c/f21 1236787 0 2024-02-20T08:05:21.955 INFO:tasks.workunit.client.0.smithi123.stdout:6/230: mknod d0/c4d 0 2024-02-20T08:05:21.955 INFO:tasks.workunit.client.0.smithi123.stdout:8/218: rmdir d6/d32 39 2024-02-20T08:05:21.961 INFO:tasks.workunit.client.0.smithi123.stdout:8/219: dread d6/f1b [0,4194304] 0 2024-02-20T08:05:21.969 INFO:tasks.workunit.client.0.smithi123.stdout:8/220: chown d6/d1c/c33 11 1 2024-02-20T08:05:21.970 INFO:tasks.workunit.client.0.smithi123.stdout:8/221: truncate d6/d1c/d29/f3a 251453 0 2024-02-20T08:05:21.972 INFO:tasks.workunit.client.0.smithi123.stdout:6/231: symlink d0/d3e/d40/d48/d4a/l4e 0 2024-02-20T08:05:21.978 INFO:tasks.workunit.client.0.smithi123.stdout:8/222: getdents d6 0 2024-02-20T08:05:21.982 INFO:tasks.workunit.client.0.smithi123.stdout:6/232: write d0/f16 [367736,68142] 0 2024-02-20T08:05:21.983 INFO:tasks.workunit.client.0.smithi123.stdout:8/223: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:21.989 INFO:tasks.workunit.client.0.smithi123.stdout:6/233: dwrite d0/f16 [0,4194304] 0 2024-02-20T08:05:21.995 INFO:tasks.workunit.client.0.smithi123.stdout:8/224: write d6/d1c/d2c/f44 [3958278,49677] 0 2024-02-20T08:05:21.997 INFO:tasks.workunit.client.0.smithi123.stdout:6/234: getdents d0/d3e/d41 0 2024-02-20T08:05:21.999 INFO:tasks.workunit.client.0.smithi123.stdout:8/225: mknod d6/d1c/d47/c4d 0 2024-02-20T08:05:21.999 INFO:tasks.workunit.client.0.smithi123.stdout:8/226: write d6/f15 [1222114,104862] 0 2024-02-20T08:05:22.000 INFO:tasks.workunit.client.0.smithi123.stdout:6/235: creat d0/d38/f4f x:0 0 0 2024-02-20T08:05:22.003 INFO:tasks.workunit.client.0.smithi123.stdout:8/227: dread d6/d1c/d29/f2e [0,4194304] 0 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:5/115: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:4/123: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:1/146: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:3/175: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:7/142: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:9/120: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:0/125: sync 2024-02-20T08:05:22.007 INFO:tasks.workunit.client.0.smithi123.stdout:2/131: sync 2024-02-20T08:05:22.009 INFO:tasks.workunit.client.0.smithi123.stdout:2/132: chown d1a/f1d 1423103 1 2024-02-20T08:05:22.009 INFO:tasks.workunit.client.0.smithi123.stdout:6/236: dwrite d0/f14 [8388608,4194304] 0 2024-02-20T08:05:22.010 INFO:tasks.workunit.client.0.smithi123.stdout:3/176: stat d0/d6/d1a/d1b/d1c/d21/f3e 0 2024-02-20T08:05:22.011 INFO:tasks.workunit.client.0.smithi123.stdout:7/143: chown d0/d6/d7/f1e 90 1 2024-02-20T08:05:22.011 INFO:tasks.workunit.client.0.smithi123.stdout:1/147: write d3/db/f21 [200167,124996] 0 2024-02-20T08:05:22.011 INFO:tasks.workunit.client.0.smithi123.stdout:2/133: fdatasync f5 0 2024-02-20T08:05:22.012 INFO:tasks.workunit.client.0.smithi123.stdout:4/124: mkdir d3/d2c 0 2024-02-20T08:05:22.012 INFO:tasks.workunit.client.0.smithi123.stdout:9/121: mknod d6/dc/c1d 0 2024-02-20T08:05:22.012 INFO:tasks.workunit.client.0.smithi123.stdout:1/148: chown d3/db/c20 28 1 2024-02-20T08:05:22.013 INFO:tasks.workunit.client.0.smithi123.stdout:0/126: mknod d2/c2b 0 2024-02-20T08:05:22.014 INFO:tasks.workunit.client.0.smithi123.stdout:6/237: truncate d0/f15 5130423 0 2024-02-20T08:05:22.015 INFO:tasks.workunit.client.0.smithi123.stdout:6/238: chown d0/d3e/l4b 0 1 2024-02-20T08:05:22.017 INFO:tasks.workunit.client.0.smithi123.stdout:2/134: creat d1a/f26 x:0 0 0 2024-02-20T08:05:22.021 INFO:tasks.workunit.client.0.smithi123.stdout:1/149: rmdir d3/de/d14/d26 39 2024-02-20T08:05:22.022 INFO:tasks.workunit.client.0.smithi123.stdout:1/150: write d3/db/f31 [221990,124477] 0 2024-02-20T08:05:22.022 INFO:tasks.workunit.client.0.smithi123.stdout:0/127: chown d2/dd/l13 3239 1 2024-02-20T08:05:22.027 INFO:tasks.workunit.client.0.smithi123.stdout:7/144: mknod d0/d23/c32 0 2024-02-20T08:05:22.027 INFO:tasks.workunit.client.0.smithi123.stdout:6/239: dread d0/f23 [0,4194304] 0 2024-02-20T08:05:22.028 INFO:tasks.workunit.client.0.smithi123.stdout:7/145: write d0/f5 [530793,45984] 0 2024-02-20T08:05:22.029 INFO:tasks.workunit.client.0.smithi123.stdout:7/146: dread - d0/f2f zero size 2024-02-20T08:05:22.029 INFO:tasks.workunit.client.0.smithi123.stdout:2/135: chown d1a/l24 28874711 1 2024-02-20T08:05:22.031 INFO:tasks.workunit.client.0.smithi123.stdout:4/125: getdents d3/d2c 0 2024-02-20T08:05:22.034 INFO:tasks.workunit.client.0.smithi123.stdout:3/177: creat d0/f3f x:0 0 0 2024-02-20T08:05:22.037 INFO:tasks.workunit.client.0.smithi123.stdout:5/116: link d0/ld d0/d13/d1f/l21 0 2024-02-20T08:05:22.038 INFO:tasks.workunit.client.0.smithi123.stdout:5/117: write d0/f15 [1962124,52808] 0 2024-02-20T08:05:22.042 INFO:tasks.workunit.client.0.smithi123.stdout:6/240: fdatasync d0/f31 0 2024-02-20T08:05:22.043 INFO:tasks.workunit.client.0.smithi123.stdout:2/136: creat d1a/f27 x:0 0 0 2024-02-20T08:05:22.043 INFO:tasks.workunit.client.0.smithi123.stdout:9/122: write d6/f11 [1084481,118933] 0 2024-02-20T08:05:22.045 INFO:tasks.workunit.client.0.smithi123.stdout:4/126: rmdir d3/d1f/d26 39 2024-02-20T08:05:22.046 INFO:tasks.workunit.client.0.smithi123.stdout:1/151: mkdir d3/de/d14/d36 0 2024-02-20T08:05:22.048 INFO:tasks.workunit.client.0.smithi123.stdout:3/178: creat d0/d6/d1a/d1b/d1c/d20/f40 x:0 0 0 2024-02-20T08:05:22.051 INFO:tasks.workunit.client.0.smithi123.stdout:0/128: symlink d2/de/d1e/l2c 0 2024-02-20T08:05:22.056 INFO:tasks.workunit.client.0.smithi123.stdout:4/127: dwrite d3/f8 [0,4194304] 0 2024-02-20T08:05:22.057 INFO:tasks.workunit.client.0.smithi123.stdout:1/152: dwrite d3/df/f1a [4194304,4194304] 0 2024-02-20T08:05:22.058 INFO:tasks.workunit.client.0.smithi123.stdout:5/118: dread d0/f11 [0,4194304] 0 2024-02-20T08:05:22.058 INFO:tasks.workunit.client.0.smithi123.stdout:6/241: symlink d0/d3e/d41/l50 0 2024-02-20T08:05:22.059 INFO:tasks.workunit.client.0.smithi123.stdout:4/128: stat d3/f1b 0 2024-02-20T08:05:22.060 INFO:tasks.workunit.client.0.smithi123.stdout:5/119: dread - d0/d13/f1b zero size 2024-02-20T08:05:22.061 INFO:tasks.workunit.client.0.smithi123.stdout:2/137: creat d1a/f28 x:0 0 0 2024-02-20T08:05:22.064 INFO:tasks.workunit.client.0.smithi123.stdout:9/123: mknod d6/d19/c1e 0 2024-02-20T08:05:22.065 INFO:tasks.workunit.client.0.smithi123.stdout:9/124: fdatasync f1 0 2024-02-20T08:05:22.068 INFO:tasks.workunit.client.0.smithi123.stdout:2/138: dwrite f10 [0,4194304] 0 2024-02-20T08:05:22.068 INFO:tasks.workunit.client.0.smithi123.stdout:2/139: chown f5 198 1 2024-02-20T08:05:22.072 INFO:tasks.workunit.client.0.smithi123.stdout:0/129: symlink d2/d3/l2d 0 2024-02-20T08:05:22.075 INFO:tasks.workunit.client.0.smithi123.stdout:4/129: rmdir d3/d18 39 2024-02-20T08:05:22.076 INFO:tasks.workunit.client.0.smithi123.stdout:6/242: rmdir d0/d3e/d40 39 2024-02-20T08:05:22.083 INFO:tasks.workunit.client.0.smithi123.stdout:2/140: mkdir d1a/d29 0 2024-02-20T08:05:22.088 INFO:tasks.workunit.client.0.smithi123.stdout:6/243: chown d0/f28 74948550 1 2024-02-20T08:05:22.090 INFO:tasks.workunit.client.0.smithi123.stdout:1/153: rename d3/de/f1f to d3/de/d14/d26/d2e/f37 0 2024-02-20T08:05:22.091 INFO:tasks.workunit.client.0.smithi123.stdout:5/120: symlink d0/l22 0 2024-02-20T08:05:22.095 INFO:tasks.workunit.client.0.smithi123.stdout:2/141: mknod d1a/c2a 0 2024-02-20T08:05:22.096 INFO:tasks.workunit.client.0.smithi123.stdout:1/154: dwrite d3/df/f1e [0,4194304] 0 2024-02-20T08:05:22.106 INFO:tasks.workunit.client.0.smithi123.stdout:0/130: rmdir d2 39 2024-02-20T08:05:22.107 INFO:tasks.workunit.client.0.smithi123.stdout:6/244: dwrite d0/f33 [8388608,4194304] 0 2024-02-20T08:05:22.108 INFO:tasks.workunit.client.0.smithi123.stdout:5/121: creat d0/d13/d1f/f23 x:0 0 0 2024-02-20T08:05:22.115 INFO:tasks.workunit.client.0.smithi123.stdout:1/155: creat d3/db/f38 x:0 0 0 2024-02-20T08:05:22.117 INFO:tasks.workunit.client.0.smithi123.stdout:3/179: link d0/dd/c35 d0/d6/d1a/d1b/d2a/c41 0 2024-02-20T08:05:22.119 INFO:tasks.workunit.client.0.smithi123.stdout:4/130: dread d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:22.128 INFO:tasks.workunit.client.0.smithi123.stdout:0/131: dread d2/d3/ff [0,4194304] 0 2024-02-20T08:05:22.128 INFO:tasks.workunit.client.0.smithi123.stdout:9/125: link d6/c13 d6/d19/d1a/c1f 0 2024-02-20T08:05:22.128 INFO:tasks.workunit.client.0.smithi123.stdout:9/126: chown d6/d19/d1b 369622 1 2024-02-20T08:05:22.128 INFO:tasks.workunit.client.0.smithi123.stdout:2/142: mknod d1a/d29/c2b 0 2024-02-20T08:05:22.128 INFO:tasks.workunit.client.0.smithi123.stdout:2/143: fdatasync f17 0 2024-02-20T08:05:22.129 INFO:tasks.workunit.client.0.smithi123.stdout:2/144: write fc [8002233,26592] 0 2024-02-20T08:05:22.131 INFO:tasks.workunit.client.0.smithi123.stdout:1/156: rename d3/f5 to d3/de/d14/d26/f39 0 2024-02-20T08:05:22.135 INFO:tasks.workunit.client.0.smithi123.stdout:4/131: creat d3/d1e/f2d x:0 0 0 2024-02-20T08:05:22.139 INFO:tasks.workunit.client.0.smithi123.stdout:3/180: dwrite d0/d6/f1f [0,4194304] 0 2024-02-20T08:05:22.139 INFO:tasks.workunit.client.0.smithi123.stdout:5/122: mknod d0/c24 0 2024-02-20T08:05:22.140 INFO:tasks.workunit.client.0.smithi123.stdout:5/123: write d0/f16 [315483,120125] 0 2024-02-20T08:05:22.141 INFO:tasks.workunit.client.0.smithi123.stdout:5/124: stat d0/fc 0 2024-02-20T08:05:22.143 INFO:tasks.workunit.client.0.smithi123.stdout:5/125: write d0/fc [837649,52249] 0 2024-02-20T08:05:22.144 INFO:tasks.workunit.client.0.smithi123.stdout:5/126: chown d0/f16 479682 1 2024-02-20T08:05:22.144 INFO:tasks.workunit.client.0.smithi123.stdout:5/127: readlink d0/l22 0 2024-02-20T08:05:22.145 INFO:tasks.workunit.client.0.smithi123.stdout:5/128: chown d0/f14 138 1 2024-02-20T08:05:22.146 INFO:tasks.workunit.client.0.smithi123.stdout:9/127: mkdir d6/d19/d1b/d20 0 2024-02-20T08:05:22.155 INFO:tasks.workunit.client.0.smithi123.stdout:3/181: rename d0/dd/f19 to d0/d6/d1a/d1e/f42 0 2024-02-20T08:05:22.157 INFO:tasks.workunit.client.0.smithi123.stdout:6/245: creat d0/f51 x:0 0 0 2024-02-20T08:05:22.157 INFO:tasks.workunit.client.0.smithi123.stdout:6/246: stat d0/f51 0 2024-02-20T08:05:22.159 INFO:tasks.workunit.client.0.smithi123.stdout:0/132: creat d2/de/d19/d28/f2e x:0 0 0 2024-02-20T08:05:22.162 INFO:tasks.workunit.client.0.smithi123.stdout:1/157: getdents d3/db/d34 0 2024-02-20T08:05:22.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/129: dwrite d0/f11 [0,4194304] 0 2024-02-20T08:05:22.173 INFO:tasks.workunit.client.0.smithi123.stdout:0/133: creat d2/dd/f2f x:0 0 0 2024-02-20T08:05:22.175 INFO:tasks.workunit.client.0.smithi123.stdout:1/158: mkdir d3/db/d3a 0 2024-02-20T08:05:22.177 INFO:tasks.workunit.client.0.smithi123.stdout:6/247: dwrite d0/f15 [0,4194304] 0 2024-02-20T08:05:22.179 INFO:tasks.workunit.client.0.smithi123.stdout:5/130: rmdir d0/d13/d1f 39 2024-02-20T08:05:22.181 INFO:tasks.workunit.client.0.smithi123.stdout:6/248: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:22.182 INFO:tasks.workunit.client.0.smithi123.stdout:9/128: rename d6/c13 to d6/d19/c21 0 2024-02-20T08:05:22.183 INFO:tasks.workunit.client.0.smithi123.stdout:3/182: mkdir d0/d6/d1a/d1b/d1c/d3b/d43 0 2024-02-20T08:05:22.190 INFO:tasks.workunit.client.0.smithi123.stdout:0/134: dwrite d2/f8 [4194304,4194304] 0 2024-02-20T08:05:22.191 INFO:tasks.workunit.client.0.smithi123.stdout:6/249: stat d0/f16 0 2024-02-20T08:05:22.196 INFO:tasks.workunit.client.0.smithi123.stdout:3/183: mknod d0/d6/d1a/d1b/d1c/d21/c44 0 2024-02-20T08:05:22.197 INFO:tasks.workunit.client.0.smithi123.stdout:4/132: truncate d3/ff 12370093 0 2024-02-20T08:05:22.198 INFO:tasks.workunit.client.0.smithi123.stdout:1/159: symlink d3/db/d3a/l3b 0 2024-02-20T08:05:22.199 INFO:tasks.workunit.client.0.smithi123.stdout:1/160: chown d3/db/d34/f2b 8843832 1 2024-02-20T08:05:22.200 INFO:tasks.workunit.client.0.smithi123.stdout:3/184: dread d0/d6/d32/f33 [0,4194304] 0 2024-02-20T08:05:22.201 INFO:tasks.workunit.client.0.smithi123.stdout:0/135: creat d2/dd/f30 x:0 0 0 2024-02-20T08:05:22.205 INFO:tasks.workunit.client.0.smithi123.stdout:6/250: dread d0/f21 [0,4194304] 0 2024-02-20T08:05:22.206 INFO:tasks.workunit.client.0.smithi123.stdout:6/251: fdatasync d0/f16 0 2024-02-20T08:05:22.208 INFO:tasks.workunit.client.0.smithi123.stdout:1/161: symlink d3/de/l3c 0 2024-02-20T08:05:22.209 INFO:tasks.workunit.client.0.smithi123.stdout:0/136: dwrite d2/de/d1e/f22 [0,4194304] 0 2024-02-20T08:05:22.210 INFO:tasks.workunit.client.0.smithi123.stdout:3/185: mknod d0/d6/d32/c45 0 2024-02-20T08:05:22.212 INFO:tasks.workunit.client.0.smithi123.stdout:3/186: fdatasync d0/d6/d1a/d1b/d1c/f3c 0 2024-02-20T08:05:22.222 INFO:tasks.workunit.client.0.smithi123.stdout:4/133: fdatasync d3/f8 0 2024-02-20T08:05:22.228 INFO:tasks.workunit.client.0.smithi123.stdout:3/187: rmdir d0/d6/d1a/d1e 39 2024-02-20T08:05:22.234 INFO:tasks.workunit.client.0.smithi123.stdout:6/252: chown d0/d38/c3d 56 1 2024-02-20T08:05:22.239 INFO:tasks.workunit.client.0.smithi123.stdout:0/137: unlink d2/d3/la 0 2024-02-20T08:05:22.240 INFO:tasks.workunit.client.0.smithi123.stdout:0/138: write d2/f15 [4074080,18505] 0 2024-02-20T08:05:22.241 INFO:tasks.workunit.client.0.smithi123.stdout:1/162: creat d3/de/d14/d36/f3d x:0 0 0 2024-02-20T08:05:22.245 INFO:tasks.workunit.client.0.smithi123.stdout:3/188: dread d0/dd/f38 [0,4194304] 0 2024-02-20T08:05:22.246 INFO:tasks.workunit.client.0.smithi123.stdout:1/163: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:22.249 INFO:tasks.workunit.client.0.smithi123.stdout:6/253: read d0/f34 [454517,100982] 0 2024-02-20T08:05:22.251 INFO:tasks.workunit.client.0.smithi123.stdout:4/134: mkdir d3/d1f/d26/d2e 0 2024-02-20T08:05:22.251 INFO:tasks.workunit.client.0.smithi123.stdout:1/164: dwrite d3/db/d34/f1b [0,4194304] 0 2024-02-20T08:05:22.254 INFO:tasks.workunit.client.0.smithi123.stdout:0/139: creat d2/dd/f31 x:0 0 0 2024-02-20T08:05:22.257 INFO:tasks.workunit.client.0.smithi123.stdout:9/129: mkdir d6/d19/d1b/d20/d22 0 2024-02-20T08:05:22.258 INFO:tasks.workunit.client.0.smithi123.stdout:3/189: fsync d0/dd/f38 0 2024-02-20T08:05:22.264 INFO:tasks.workunit.client.0.smithi123.stdout:6/254: truncate d0/f17 5007643 0 2024-02-20T08:05:22.264 INFO:tasks.workunit.client.0.smithi123.stdout:3/190: dwrite d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:22.266 INFO:tasks.workunit.client.0.smithi123.stdout:4/135: symlink d3/d1f/d26/l2f 0 2024-02-20T08:05:22.266 INFO:tasks.workunit.client.0.smithi123.stdout:4/136: dread - d3/d1e/f2b zero size 2024-02-20T08:05:22.267 INFO:tasks.workunit.client.0.smithi123.stdout:4/137: write d3/d18/f1d [940721,25706] 0 2024-02-20T08:05:22.268 INFO:tasks.workunit.client.0.smithi123.stdout:0/140: mknod d2/d3/c32 0 2024-02-20T08:05:22.276 INFO:tasks.workunit.client.0.smithi123.stdout:3/191: mknod d0/d6/d1a/d1b/d1c/d20/c46 0 2024-02-20T08:05:22.280 INFO:tasks.workunit.client.0.smithi123.stdout:0/141: fsync d2/d3/f9 0 2024-02-20T08:05:22.282 INFO:tasks.workunit.client.0.smithi123.stdout:9/130: mknod d6/d19/d1a/c23 0 2024-02-20T08:05:22.289 INFO:tasks.workunit.client.0.smithi123.stdout:3/192: symlink d0/d6/d1a/d1b/d1c/d3b/l47 0 2024-02-20T08:05:22.290 INFO:tasks.workunit.client.0.smithi123.stdout:3/193: fsync d0/d6/d1a/d1b/d2a/f3a 0 2024-02-20T08:05:22.291 INFO:tasks.workunit.client.0.smithi123.stdout:1/165: creat d3/f3e x:0 0 0 2024-02-20T08:05:22.293 INFO:tasks.workunit.client.0.smithi123.stdout:4/138: link d3/d18/f1d d3/d18/f30 0 2024-02-20T08:05:22.294 INFO:tasks.workunit.client.0.smithi123.stdout:4/139: dread - d3/d1f/d26/f29 zero size 2024-02-20T08:05:22.297 INFO:tasks.workunit.client.0.smithi123.stdout:0/142: rename d2/fc to d2/de/d19/d28/f33 0 2024-02-20T08:05:22.299 INFO:tasks.workunit.client.0.smithi123.stdout:9/131: symlink d6/d19/d1b/l24 0 2024-02-20T08:05:22.301 INFO:tasks.workunit.client.0.smithi123.stdout:6/255: symlink d0/d3e/d40/d48/d4a/l52 0 2024-02-20T08:05:22.304 INFO:tasks.workunit.client.0.smithi123.stdout:3/194: mkdir d0/dd/d48 0 2024-02-20T08:05:22.307 INFO:tasks.workunit.client.0.smithi123.stdout:4/140: write d3/d18/f1d [2443505,11330] 0 2024-02-20T08:05:22.309 INFO:tasks.workunit.client.0.smithi123.stdout:1/166: rename d3/c30 to d3/db/d3a/c3f 0 2024-02-20T08:05:22.312 INFO:tasks.workunit.client.0.smithi123.stdout:0/143: dread d2/d3/ff [0,4194304] 0 2024-02-20T08:05:22.320 INFO:tasks.workunit.client.0.smithi123.stdout:4/141: rename d3/f20 to d3/d18/f31 0 2024-02-20T08:05:22.320 INFO:tasks.workunit.client.0.smithi123.stdout:4/142: dread - d3/d18/f1c zero size 2024-02-20T08:05:22.327 INFO:tasks.workunit.client.0.smithi123.stdout:9/132: creat d6/d19/d1b/d20/d22/f25 x:0 0 0 2024-02-20T08:05:22.429 INFO:tasks.workunit.client.0.smithi123.stdout:3/195: mkdir d0/d6/d1a/d1e/d49 0 2024-02-20T08:05:22.430 INFO:tasks.workunit.client.0.smithi123.stdout:0/144: readlink d2/dd/l13 0 2024-02-20T08:05:22.431 INFO:tasks.workunit.client.0.smithi123.stdout:1/167: truncate d3/df/f1a 3216819 0 2024-02-20T08:05:22.431 INFO:tasks.workunit.client.0.smithi123.stdout:3/196: chown d0/d6/f14 360941 1 2024-02-20T08:05:22.433 INFO:tasks.workunit.client.0.smithi123.stdout:6/256: link d0/d3e/d40/d48/d4a/l4e d0/d3e/d40/l53 0 2024-02-20T08:05:22.436 INFO:tasks.workunit.client.0.smithi123.stdout:0/145: symlink d2/d3/l34 0 2024-02-20T08:05:22.436 INFO:tasks.workunit.client.0.smithi123.stdout:4/143: dwrite d3/d18/f31 [0,4194304] 0 2024-02-20T08:05:22.438 INFO:tasks.workunit.client.0.smithi123.stdout:4/144: write d3/f2a [741235,15802] 0 2024-02-20T08:05:22.439 INFO:tasks.workunit.client.0.smithi123.stdout:4/145: read d3/d18/f31 [149935,94447] 0 2024-02-20T08:05:22.440 INFO:tasks.workunit.client.0.smithi123.stdout:4/146: chown d3/d1e 7094 1 2024-02-20T08:05:22.440 INFO:tasks.workunit.client.0.smithi123.stdout:4/147: dread - d3/f28 zero size 2024-02-20T08:05:22.441 INFO:tasks.workunit.client.0.smithi123.stdout:4/148: write d3/f2a [371298,32119] 0 2024-02-20T08:05:22.442 INFO:tasks.workunit.client.0.smithi123.stdout:4/149: chown d3/l11 39902847 1 2024-02-20T08:05:22.449 INFO:tasks.workunit.client.0.smithi123.stdout:6/257: dwrite d0/f22 [0,4194304] 0 2024-02-20T08:05:22.449 INFO:tasks.workunit.client.0.smithi123.stdout:6/258: read d0/f17 [997701,78442] 0 2024-02-20T08:05:22.450 INFO:tasks.workunit.client.0.smithi123.stdout:6/259: chown d0/d3e/d40 489094 1 2024-02-20T08:05:22.451 INFO:tasks.workunit.client.0.smithi123.stdout:3/197: mknod d0/d6/d1a/d1b/d1c/d3b/d43/c4a 0 2024-02-20T08:05:22.453 INFO:tasks.workunit.client.0.smithi123.stdout:1/168: dread d3/fa [0,4194304] 0 2024-02-20T08:05:22.455 INFO:tasks.workunit.client.0.smithi123.stdout:4/150: creat d3/d18/f32 x:0 0 0 2024-02-20T08:05:22.456 INFO:tasks.workunit.client.0.smithi123.stdout:4/151: fdatasync d3/ff 0 2024-02-20T08:05:22.460 INFO:tasks.workunit.client.0.smithi123.stdout:1/169: dwrite d3/f1d [0,4194304] 0 2024-02-20T08:05:22.461 INFO:tasks.workunit.client.0.smithi123.stdout:1/170: truncate d3/db/f31 540699 0 2024-02-20T08:05:22.463 INFO:tasks.workunit.client.0.smithi123.stdout:1/171: write d3/db/f21 [42625,98658] 0 2024-02-20T08:05:22.464 INFO:tasks.workunit.client.0.smithi123.stdout:6/260: rmdir d0/d3e/d40 39 2024-02-20T08:05:22.468 INFO:tasks.workunit.client.0.smithi123.stdout:4/152: write d3/d18/f31 [3818311,52129] 0 2024-02-20T08:05:22.471 INFO:tasks.workunit.client.0.smithi123.stdout:1/172: creat d3/de/d14/d26/d2e/f40 x:0 0 0 2024-02-20T08:05:22.472 INFO:tasks.workunit.client.0.smithi123.stdout:1/173: read d3/df/f1e [400937,7244] 0 2024-02-20T08:05:22.473 INFO:tasks.workunit.client.0.smithi123.stdout:1/174: chown d3/db/d34/f2b 63 1 2024-02-20T08:05:22.474 INFO:tasks.workunit.client.0.smithi123.stdout:3/198: mkdir d0/d6/d1a/d4b 0 2024-02-20T08:05:22.475 INFO:tasks.workunit.client.0.smithi123.stdout:3/199: read - d0/d6/d1a/d1b/d1c/d20/f31 zero size 2024-02-20T08:05:22.479 INFO:tasks.workunit.client.0.smithi123.stdout:1/175: mkdir d3/db/d41 0 2024-02-20T08:05:22.481 INFO:tasks.workunit.client.0.smithi123.stdout:3/200: dwrite d0/d6/d1a/f23 [0,4194304] 0 2024-02-20T08:05:22.483 INFO:tasks.workunit.client.0.smithi123.stdout:3/201: dread - d0/d6/d1a/d1b/d1c/d20/f40 zero size 2024-02-20T08:05:22.487 INFO:tasks.workunit.client.0.smithi123.stdout:6/261: rename d0/l35 to d0/d3e/l54 0 2024-02-20T08:05:22.489 INFO:tasks.workunit.client.0.smithi123.stdout:3/202: symlink d0/d6/d1a/d1e/l4c 0 2024-02-20T08:05:22.490 INFO:tasks.workunit.client.0.smithi123.stdout:3/203: chown d0/d6/d1a/f2f 3 1 2024-02-20T08:05:22.490 INFO:tasks.workunit.client.0.smithi123.stdout:3/204: readlink d0/l4 0 2024-02-20T08:05:22.491 INFO:tasks.workunit.client.0.smithi123.stdout:4/153: rename d3/d18/c25 to d3/d1f/d21/c33 0 2024-02-20T08:05:22.492 INFO:tasks.workunit.client.0.smithi123.stdout:1/176: creat d3/f42 x:0 0 0 2024-02-20T08:05:22.493 INFO:tasks.workunit.client.0.smithi123.stdout:6/262: creat d0/d38/f55 x:0 0 0 2024-02-20T08:05:22.494 INFO:tasks.workunit.client.0.smithi123.stdout:3/205: mknod d0/d6/d1a/d1b/d2a/c4d 0 2024-02-20T08:05:22.495 INFO:tasks.workunit.client.0.smithi123.stdout:3/206: chown d0/d6/d1a/d1b 12 1 2024-02-20T08:05:22.495 INFO:tasks.workunit.client.0.smithi123.stdout:1/177: rmdir d3/df 39 2024-02-20T08:05:22.497 INFO:tasks.workunit.client.0.smithi123.stdout:6/263: mkdir d0/d3e/d41/d56 0 2024-02-20T08:05:22.498 INFO:tasks.workunit.client.0.smithi123.stdout:4/154: mkdir d3/d1f/d34 0 2024-02-20T08:05:22.499 INFO:tasks.workunit.client.0.smithi123.stdout:4/155: write d3/f28 [366767,40112] 0 2024-02-20T08:05:22.502 INFO:tasks.workunit.client.0.smithi123.stdout:4/156: mknod d3/d18/c35 0 2024-02-20T08:05:22.503 INFO:tasks.workunit.client.0.smithi123.stdout:6/264: mkdir d0/d3e/d41/d56/d57 0 2024-02-20T08:05:22.507 INFO:tasks.workunit.client.0.smithi123.stdout:4/157: symlink d3/d1f/d34/l36 0 2024-02-20T08:05:22.507 INFO:tasks.workunit.client.0.smithi123.stdout:6/265: read d0/d38/f3b [2239846,63819] 0 2024-02-20T08:05:22.507 INFO:tasks.workunit.client.0.smithi123.stdout:6/266: chown d0/d3e 5 1 2024-02-20T08:05:22.508 INFO:tasks.workunit.client.0.smithi123.stdout:6/267: fsync d0/d38/f4f 0 2024-02-20T08:05:22.509 INFO:tasks.workunit.client.0.smithi123.stdout:4/158: creat d3/d1f/d34/f37 x:0 0 0 2024-02-20T08:05:22.511 INFO:tasks.workunit.client.0.smithi123.stdout:3/207: dread d0/d6/f14 [0,4194304] 0 2024-02-20T08:05:22.512 INFO:tasks.workunit.client.0.smithi123.stdout:4/159: mknod d3/d1e/c38 0 2024-02-20T08:05:22.513 INFO:tasks.workunit.client.0.smithi123.stdout:4/160: write d3/d1e/f2d [714578,39006] 0 2024-02-20T08:05:22.514 INFO:tasks.workunit.client.0.smithi123.stdout:6/268: rmdir d0/d3e/d40/d48 39 2024-02-20T08:05:22.518 INFO:tasks.workunit.client.0.smithi123.stdout:6/269: symlink d0/d38/l58 0 2024-02-20T08:05:22.522 INFO:tasks.workunit.client.0.smithi123.stdout:6/270: mknod d0/d3e/c59 0 2024-02-20T08:05:22.522 INFO:tasks.workunit.client.0.smithi123.stdout:6/271: chown d0/d38 45297479 1 2024-02-20T08:05:22.530 INFO:tasks.workunit.client.0.smithi123.stdout:4/161: dread d3/f1b [0,4194304] 0 2024-02-20T08:05:22.546 INFO:tasks.workunit.client.0.smithi123.stdout:4/162: truncate d3/d18/f19 2241367 0 2024-02-20T08:05:22.546 INFO:tasks.workunit.client.0.smithi123.stdout:4/163: readlink d3/d1f/d26/l2f 0 2024-02-20T08:05:22.571 INFO:tasks.workunit.client.0.smithi123.stdout:9/133: write d6/f12 [449444,62064] 0 2024-02-20T08:05:22.572 INFO:tasks.workunit.client.0.smithi123.stdout:9/134: chown d6/d19/d1b/d20 1 1 2024-02-20T08:05:22.574 INFO:tasks.workunit.client.0.smithi123.stdout:9/135: creat d6/d19/d1b/f26 x:0 0 0 2024-02-20T08:05:22.579 INFO:tasks.workunit.client.0.smithi123.stdout:9/136: mkdir d6/dc/d27 0 2024-02-20T08:05:22.584 INFO:tasks.workunit.client.0.smithi123.stdout:9/137: dwrite f1 [0,4194304] 0 2024-02-20T08:05:22.586 INFO:tasks.workunit.client.0.smithi123.stdout:0/146: truncate d2/de/f17 1271558 0 2024-02-20T08:05:22.587 INFO:tasks.workunit.client.0.smithi123.stdout:0/147: chown d2/de/d1e/d1f 126000 1 2024-02-20T08:05:22.589 INFO:tasks.workunit.client.0.smithi123.stdout:0/148: truncate d2/de/d19/d28/f33 4828053 0 2024-02-20T08:05:22.597 INFO:tasks.workunit.client.0.smithi123.stdout:0/149: link d2/d3/f24 d2/de/d1e/f35 0 2024-02-20T08:05:22.601 INFO:tasks.workunit.client.0.smithi123.stdout:0/150: read d2/de/d1e/f35 [164990,53888] 0 2024-02-20T08:05:22.603 INFO:tasks.workunit.client.0.smithi123.stdout:0/151: unlink d2/f1a 0 2024-02-20T08:05:22.608 INFO:tasks.workunit.client.0.smithi123.stdout:0/152: creat d2/f36 x:0 0 0 2024-02-20T08:05:22.611 INFO:tasks.workunit.client.0.smithi123.stdout:0/153: mkdir d2/d3/d37 0 2024-02-20T08:05:22.613 INFO:tasks.workunit.client.0.smithi123.stdout:0/154: write d2/dd/f30 [958562,25552] 0 2024-02-20T08:05:22.615 INFO:tasks.workunit.client.0.smithi123.stdout:0/155: write d2/dd/f31 [473851,80368] 0 2024-02-20T08:05:22.616 INFO:tasks.workunit.client.0.smithi123.stdout:0/156: write d2/dd/f30 [1361238,111921] 0 2024-02-20T08:05:22.621 INFO:tasks.workunit.client.0.smithi123.stdout:3/208: truncate d0/d6/d1a/d1e/f17 2992475 0 2024-02-20T08:05:22.623 INFO:tasks.workunit.client.0.smithi123.stdout:0/157: dwrite d2/f36 [0,4194304] 0 2024-02-20T08:05:22.625 INFO:tasks.workunit.client.0.smithi123.stdout:3/209: creat d0/d6/d32/f4e x:0 0 0 2024-02-20T08:05:22.625 INFO:tasks.workunit.client.0.smithi123.stdout:0/158: rmdir d2/dd 39 2024-02-20T08:05:22.629 INFO:tasks.workunit.client.0.smithi123.stdout:3/210: creat d0/d6/d1a/d1b/d1c/f4f x:0 0 0 2024-02-20T08:05:22.630 INFO:tasks.workunit.client.0.smithi123.stdout:0/159: fdatasync d2/d3/ff 0 2024-02-20T08:05:22.634 INFO:tasks.workunit.client.0.smithi123.stdout:6/272: dwrite d0/fe [0,4194304] 0 2024-02-20T08:05:22.635 INFO:tasks.workunit.client.0.smithi123.stdout:6/273: fdatasync d0/d38/f4f 0 2024-02-20T08:05:22.639 INFO:tasks.workunit.client.0.smithi123.stdout:0/160: mknod d2/c38 0 2024-02-20T08:05:22.640 INFO:tasks.workunit.client.0.smithi123.stdout:0/161: write d2/fb [4671629,68268] 0 2024-02-20T08:05:22.641 INFO:tasks.workunit.client.0.smithi123.stdout:6/274: creat d0/d3e/d41/d56/f5a x:0 0 0 2024-02-20T08:05:22.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:22 smithi194 ceph-mon[37804]: pgmap v30: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 111 op/s 2024-02-20T08:05:22.644 INFO:tasks.workunit.client.0.smithi123.stdout:0/162: mknod d2/de/d19/c39 0 2024-02-20T08:05:22.649 INFO:tasks.workunit.client.0.smithi123.stdout:0/163: symlink d2/de/d19/d28/l3a 0 2024-02-20T08:05:22.650 INFO:tasks.workunit.client.0.smithi123.stdout:6/275: rename d0/d3e/d41/l50 to d0/l5b 0 2024-02-20T08:05:22.652 INFO:tasks.workunit.client.0.smithi123.stdout:0/164: rmdir d2/de/d1e 39 2024-02-20T08:05:22.653 INFO:tasks.workunit.client.0.smithi123.stdout:0/165: write d2/fb [229095,38866] 0 2024-02-20T08:05:22.657 INFO:tasks.workunit.client.0.smithi123.stdout:9/138: write d6/ff [4937424,114748] 0 2024-02-20T08:05:22.660 INFO:tasks.workunit.client.0.smithi123.stdout:0/166: write d2/de/d1e/d1f/f20 [498907,75461] 0 2024-02-20T08:05:22.660 INFO:tasks.workunit.client.0.smithi123.stdout:6/276: rmdir d0/d3e/d40/d48/d4a 39 2024-02-20T08:05:22.661 INFO:tasks.workunit.client.0.smithi123.stdout:6/277: chown d0/d3e/l4b 62 1 2024-02-20T08:05:22.662 INFO:tasks.workunit.client.0.smithi123.stdout:6/278: dread - d0/f51 zero size 2024-02-20T08:05:22.664 INFO:tasks.workunit.client.0.smithi123.stdout:0/167: dread d2/de/d1e/d1f/f20 [0,4194304] 0 2024-02-20T08:05:22.669 INFO:tasks.workunit.client.0.smithi123.stdout:6/279: unlink d0/l24 0 2024-02-20T08:05:22.678 INFO:tasks.workunit.client.0.smithi123.stdout:9/139: dread d6/f11 [4194304,4194304] 0 2024-02-20T08:05:22.680 INFO:tasks.workunit.client.0.smithi123.stdout:9/140: mkdir d6/d19/d1b/d20/d28 0 2024-02-20T08:05:22.682 INFO:tasks.workunit.client.0.smithi123.stdout:9/141: write d6/f14 [5170675,92920] 0 2024-02-20T08:05:22.685 INFO:tasks.workunit.client.0.smithi123.stdout:3/211: dwrite d0/d6/f2e [0,4194304] 0 2024-02-20T08:05:22.690 INFO:tasks.workunit.client.0.smithi123.stdout:9/142: rename d6/d19/d1b/d20/d22 to d6/dc/d27/d29 0 2024-02-20T08:05:22.690 INFO:tasks.workunit.client.0.smithi123.stdout:9/143: fsync f1 0 2024-02-20T08:05:22.691 INFO:tasks.workunit.client.0.smithi123.stdout:9/144: chown d6/d19/d1b 252979369 1 2024-02-20T08:05:22.692 INFO:tasks.workunit.client.0.smithi123.stdout:3/212: dwrite d0/d6/d1a/f23 [4194304,4194304] 0 2024-02-20T08:05:22.693 INFO:tasks.workunit.client.0.smithi123.stdout:3/213: fdatasync d0/d6/d1a/d1b/d1c/d20/f40 0 2024-02-20T08:05:22.694 INFO:tasks.workunit.client.0.smithi123.stdout:3/214: chown d0/d6/d1a/d1b/d2a 280 1 2024-02-20T08:05:22.698 INFO:tasks.workunit.client.0.smithi123.stdout:3/215: chown d0/d6/d1a/d1b/f30 0 1 2024-02-20T08:05:22.699 INFO:tasks.workunit.client.0.smithi123.stdout:3/216: write d0/d6/d1a/d1b/d2a/f3a [3696285,98660] 0 2024-02-20T08:05:22.700 INFO:tasks.workunit.client.0.smithi123.stdout:3/217: chown d0/d6/d1a/d1e/d49 87625 1 2024-02-20T08:05:22.707 INFO:tasks.workunit.client.0.smithi123.stdout:7/147: sync 2024-02-20T08:05:22.707 INFO:tasks.workunit.client.0.smithi123.stdout:8/228: sync 2024-02-20T08:05:22.710 INFO:tasks.workunit.client.0.smithi123.stdout:7/148: chown d0/l11 33 1 2024-02-20T08:05:22.711 INFO:tasks.workunit.client.0.smithi123.stdout:8/229: mknod d6/d1c/d29/d3f/c4e 0 2024-02-20T08:05:22.713 INFO:tasks.workunit.client.0.smithi123.stdout:0/168: dread d2/de/f17 [0,4194304] 0 2024-02-20T08:05:22.715 INFO:tasks.workunit.client.0.smithi123.stdout:9/145: rename d6/dc to d6/d2a 0 2024-02-20T08:05:22.717 INFO:tasks.workunit.client.0.smithi123.stdout:7/149: dwrite d0/d6/d7/d22/d26/f2e [0,4194304] 0 2024-02-20T08:05:22.718 INFO:tasks.workunit.client.0.smithi123.stdout:7/150: write d0/d6/dd/d15/f1f [2508232,11630] 0 2024-02-20T08:05:22.718 INFO:tasks.workunit.client.0.smithi123.stdout:0/169: symlink d2/de/d1e/l3b 0 2024-02-20T08:05:22.728 INFO:tasks.workunit.client.0.smithi123.stdout:3/218: dwrite d0/f24 [0,4194304] 0 2024-02-20T08:05:22.734 INFO:tasks.workunit.client.0.smithi123.stdout:3/219: creat d0/d6/d1a/d1b/d1c/d3b/d43/f50 x:0 0 0 2024-02-20T08:05:22.739 INFO:tasks.workunit.client.0.smithi123.stdout:3/220: chown d0/d6/d1a/d1b/d1c/d20/f40 0 1 2024-02-20T08:05:22.739 INFO:tasks.workunit.client.0.smithi123.stdout:8/230: truncate d6/d1c/d2c/f44 2353538 0 2024-02-20T08:05:22.740 INFO:tasks.workunit.client.0.smithi123.stdout:0/170: link d2/de/d19/d28/l3a d2/de/l3c 0 2024-02-20T08:05:22.741 INFO:tasks.workunit.client.0.smithi123.stdout:0/171: write d2/f15 [4931714,71228] 0 2024-02-20T08:05:22.741 INFO:tasks.workunit.client.0.smithi123.stdout:3/221: mknod d0/d6/d1a/d1b/d1c/d3b/c51 0 2024-02-20T08:05:22.742 INFO:tasks.workunit.client.0.smithi123.stdout:3/222: dread - d0/d6/d1a/f2f zero size 2024-02-20T08:05:22.744 INFO:tasks.workunit.client.0.smithi123.stdout:9/146: rename d6/d19/d1b/d20 to d6/d19/d1a/d2b 0 2024-02-20T08:05:22.745 INFO:tasks.workunit.client.0.smithi123.stdout:8/231: mkdir d6/d1c/d22/d4f 0 2024-02-20T08:05:22.746 INFO:tasks.workunit.client.0.smithi123.stdout:7/151: getdents d0/db 0 2024-02-20T08:05:22.749 INFO:tasks.workunit.client.0.smithi123.stdout:8/232: dread d6/d1c/d22/f23 [0,4194304] 0 2024-02-20T08:05:22.752 INFO:tasks.workunit.client.0.smithi123.stdout:3/223: mknod d0/d6/d1a/d1b/d1c/c52 0 2024-02-20T08:05:22.753 INFO:tasks.workunit.client.0.smithi123.stdout:8/233: dread d6/fc [0,4194304] 0 2024-02-20T08:05:22.754 INFO:tasks.workunit.client.0.smithi123.stdout:8/234: chown d6/d1c/d29/f3a 130346 1 2024-02-20T08:05:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:22 smithi123 ceph-mon[29383]: pgmap v30: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 111 op/s 2024-02-20T08:05:22.761 INFO:tasks.workunit.client.0.smithi123.stdout:7/152: getdents d0/db/d21 0 2024-02-20T08:05:22.762 INFO:tasks.workunit.client.0.smithi123.stdout:7/153: dread - d0/d6/f31 zero size 2024-02-20T08:05:22.765 INFO:tasks.workunit.client.0.smithi123.stdout:0/172: getdents d2/d3 0 2024-02-20T08:05:22.766 INFO:tasks.workunit.client.0.smithi123.stdout:9/147: dwrite d6/f11 [0,4194304] 0 2024-02-20T08:05:22.766 INFO:tasks.workunit.client.0.smithi123.stdout:7/154: readlink d0/l13 0 2024-02-20T08:05:22.768 INFO:tasks.workunit.client.0.smithi123.stdout:3/224: creat d0/f53 x:0 0 0 2024-02-20T08:05:22.771 INFO:tasks.workunit.client.0.smithi123.stdout:0/173: rename d2/d3/c32 to d2/de/d1e/c3d 0 2024-02-20T08:05:22.774 INFO:tasks.workunit.client.0.smithi123.stdout:3/225: creat d0/d6/d1a/d1b/f54 x:0 0 0 2024-02-20T08:05:22.775 INFO:tasks.workunit.client.0.smithi123.stdout:7/155: dwrite d0/d23/f2d [0,4194304] 0 2024-02-20T08:05:22.777 INFO:tasks.workunit.client.0.smithi123.stdout:9/148: getdents d6/d19/d1a/d2b 0 2024-02-20T08:05:22.777 INFO:tasks.workunit.client.0.smithi123.stdout:3/226: stat d0/d6/d1a/d1e/d49 0 2024-02-20T08:05:22.779 INFO:tasks.workunit.client.0.smithi123.stdout:3/227: stat d0/d6/d1a/d1b/d1c 0 2024-02-20T08:05:22.779 INFO:tasks.workunit.client.0.smithi123.stdout:0/174: dwrite d2/f1b [0,4194304] 0 2024-02-20T08:05:22.780 INFO:tasks.workunit.client.0.smithi123.stdout:9/149: mknod d6/d19/d1a/c2c 0 2024-02-20T08:05:22.781 INFO:tasks.workunit.client.0.smithi123.stdout:9/150: chown d6/d19/d1a/c23 7 1 2024-02-20T08:05:22.784 INFO:tasks.workunit.client.0.smithi123.stdout:9/151: unlink f1 0 2024-02-20T08:05:22.786 INFO:tasks.workunit.client.0.smithi123.stdout:3/228: rename d0/dd/c35 to d0/dd/c55 0 2024-02-20T08:05:22.794 INFO:tasks.workunit.client.0.smithi123.stdout:3/229: creat d0/d6/d1a/d1e/d49/f56 x:0 0 0 2024-02-20T08:05:22.796 INFO:tasks.workunit.client.0.smithi123.stdout:9/152: dwrite d6/fa [4194304,4194304] 0 2024-02-20T08:05:22.798 INFO:tasks.workunit.client.0.smithi123.stdout:9/153: readlink d6/d19/d1b/l24 0 2024-02-20T08:05:22.802 INFO:tasks.workunit.client.0.smithi123.stdout:3/230: dwrite d0/f24 [4194304,4194304] 0 2024-02-20T08:05:22.806 INFO:tasks.workunit.client.0.smithi123.stdout:3/231: getdents d0/d6/d1a/d4b 0 2024-02-20T08:05:22.807 INFO:tasks.workunit.client.0.smithi123.stdout:9/154: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:22.808 INFO:tasks.workunit.client.0.smithi123.stdout:3/232: chown d0/d6/d1a/f2f 408494 1 2024-02-20T08:05:22.808 INFO:tasks.workunit.client.0.smithi123.stdout:0/175: write d2/de/d1e/f35 [943309,29604] 0 2024-02-20T08:05:22.811 INFO:tasks.workunit.client.0.smithi123.stdout:3/233: write d0/d6/d1a/d1b/f22 [3498886,47314] 0 2024-02-20T08:05:22.813 INFO:tasks.workunit.client.0.smithi123.stdout:9/155: symlink d6/d19/d1a/l2d 0 2024-02-20T08:05:22.814 INFO:tasks.workunit.client.0.smithi123.stdout:9/156: read d6/fa [7721810,85398] 0 2024-02-20T08:05:22.817 INFO:tasks.workunit.client.0.smithi123.stdout:3/234: mkdir d0/d6/d1a/d1b/d57 0 2024-02-20T08:05:22.818 INFO:tasks.workunit.client.0.smithi123.stdout:3/235: fsync d0/d6/d1a/d1b/d1c/d3b/d43/f50 0 2024-02-20T08:05:22.822 INFO:tasks.workunit.client.0.smithi123.stdout:9/157: rename d6/d2a/d27/d29/f25 to d6/d19/d1a/d2b/d28/f2e 0 2024-02-20T08:05:22.824 INFO:tasks.workunit.client.0.smithi123.stdout:9/158: write d6/d2a/f17 [2784068,65679] 0 2024-02-20T08:05:22.828 INFO:tasks.workunit.client.0.smithi123.stdout:0/176: dread d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:22.832 INFO:tasks.workunit.client.0.smithi123.stdout:0/177: unlink d2/dd/l13 0 2024-02-20T08:05:22.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/159: dwrite d6/d19/d1a/d2b/d28/f2e [0,4194304] 0 2024-02-20T08:05:22.837 INFO:tasks.workunit.client.0.smithi123.stdout:9/160: creat d6/d2a/d27/f2f x:0 0 0 2024-02-20T08:05:22.838 INFO:tasks.workunit.client.0.smithi123.stdout:0/178: mknod d2/d3/d37/c3e 0 2024-02-20T08:05:22.838 INFO:tasks.workunit.client.0.smithi123.stdout:9/161: read - d6/d19/d1b/f26 zero size 2024-02-20T08:05:22.841 INFO:tasks.workunit.client.0.smithi123.stdout:0/179: symlink d2/de/l3f 0 2024-02-20T08:05:22.848 INFO:tasks.workunit.client.0.smithi123.stdout:9/162: creat d6/f30 x:0 0 0 2024-02-20T08:05:22.852 INFO:tasks.workunit.client.0.smithi123.stdout:9/163: mkdir d6/d19/d1a/d31 0 2024-02-20T08:05:22.853 INFO:tasks.workunit.client.0.smithi123.stdout:9/164: chown d6/d19/d1a/l2d 113 1 2024-02-20T08:05:22.858 INFO:tasks.workunit.client.0.smithi123.stdout:9/165: rmdir d6/d2a 39 2024-02-20T08:05:22.859 INFO:tasks.workunit.client.0.smithi123.stdout:0/180: dread d2/f8 [0,4194304] 0 2024-02-20T08:05:22.862 INFO:tasks.workunit.client.0.smithi123.stdout:0/181: symlink d2/l40 0 2024-02-20T08:05:22.863 INFO:tasks.workunit.client.0.smithi123.stdout:9/166: dread d6/f11 [4194304,4194304] 0 2024-02-20T08:05:22.865 INFO:tasks.workunit.client.0.smithi123.stdout:9/167: fsync d6/fa 0 2024-02-20T08:05:22.873 INFO:tasks.workunit.client.0.smithi123.stdout:0/182: truncate d2/fb 1173676 0 2024-02-20T08:05:22.875 INFO:tasks.workunit.client.0.smithi123.stdout:0/183: unlink d2/f36 0 2024-02-20T08:05:22.876 INFO:tasks.workunit.client.0.smithi123.stdout:0/184: write d2/f6 [477586,37103] 0 2024-02-20T08:05:22.878 INFO:tasks.workunit.client.0.smithi123.stdout:0/185: fdatasync d2/fb 0 2024-02-20T08:05:22.885 INFO:tasks.workunit.client.0.smithi123.stdout:0/186: creat d2/dd/f41 x:0 0 0 2024-02-20T08:05:22.885 INFO:tasks.workunit.client.0.smithi123.stdout:0/187: fdatasync d2/f1b 0 2024-02-20T08:05:22.886 INFO:tasks.workunit.client.0.smithi123.stdout:0/188: truncate d2/d3/f24 1074260 0 2024-02-20T08:05:22.890 INFO:tasks.workunit.client.0.smithi123.stdout:0/189: dread d2/f8 [0,4194304] 0 2024-02-20T08:05:22.894 INFO:tasks.workunit.client.0.smithi123.stdout:0/190: creat d2/f42 x:0 0 0 2024-02-20T08:05:22.899 INFO:tasks.workunit.client.0.smithi123.stdout:0/191: dwrite d2/f15 [4194304,4194304] 0 2024-02-20T08:05:22.901 INFO:tasks.workunit.client.0.smithi123.stdout:0/192: chown d2/de/l3c 3954859 1 2024-02-20T08:05:22.903 INFO:tasks.workunit.client.0.smithi123.stdout:0/193: dread - d2/dd/f41 zero size 2024-02-20T08:05:22.914 INFO:tasks.workunit.client.0.smithi123.stdout:2/145: sync 2024-02-20T08:05:22.915 INFO:tasks.workunit.client.0.smithi123.stdout:2/146: symlink d1a/d29/l2c 0 2024-02-20T08:05:22.917 INFO:tasks.workunit.client.0.smithi123.stdout:2/147: read d1a/f1f [1362697,41413] 0 2024-02-20T08:05:22.949 INFO:tasks.workunit.client.0.smithi123.stdout:2/148: link f5 d1a/d29/f2d 0 2024-02-20T08:05:22.951 INFO:tasks.workunit.client.0.smithi123.stdout:2/149: creat d1a/f2e x:0 0 0 2024-02-20T08:05:22.951 INFO:tasks.workunit.client.0.smithi123.stdout:2/150: write f17 [830973,30594] 0 2024-02-20T08:05:22.959 INFO:tasks.workunit.client.0.smithi123.stdout:2/151: dwrite f5 [0,4194304] 0 2024-02-20T08:05:22.962 INFO:tasks.workunit.client.0.smithi123.stdout:2/152: rename fe to d1a/f2f 0 2024-02-20T08:05:22.982 INFO:tasks.workunit.client.0.smithi123.stdout:2/153: dread f11 [0,4194304] 0 2024-02-20T08:05:22.998 INFO:tasks.workunit.client.0.smithi123.stdout:2/154: dread d1a/f1e [4194304,4194304] 0 2024-02-20T08:05:23.109 INFO:tasks.workunit.client.0.smithi123.stdout:1/178: sync 2024-02-20T08:05:23.110 INFO:tasks.workunit.client.0.smithi123.stdout:5/131: sync 2024-02-20T08:05:23.113 INFO:tasks.workunit.client.0.smithi123.stdout:1/179: truncate d3/df/f11 2010001 0 2024-02-20T08:05:23.114 INFO:tasks.workunit.client.0.smithi123.stdout:5/132: mkdir d0/d13/d1f/d25 0 2024-02-20T08:05:23.115 INFO:tasks.workunit.client.0.smithi123.stdout:5/133: write d0/d13/f1b [445783,98235] 0 2024-02-20T08:05:23.119 INFO:tasks.workunit.client.0.smithi123.stdout:5/134: rename d0/c24 to d0/d13/d1f/d25/c26 0 2024-02-20T08:05:23.123 INFO:tasks.workunit.client.0.smithi123.stdout:5/135: dread d0/f11 [0,4194304] 0 2024-02-20T08:05:23.126 INFO:tasks.workunit.client.0.smithi123.stdout:5/136: dread d0/d13/f1b [0,4194304] 0 2024-02-20T08:05:23.127 INFO:tasks.workunit.client.0.smithi123.stdout:5/137: stat d0/f14 0 2024-02-20T08:05:23.128 INFO:tasks.workunit.client.0.smithi123.stdout:1/180: dread d3/df/f18 [0,4194304] 0 2024-02-20T08:05:23.129 INFO:tasks.workunit.client.0.smithi123.stdout:1/181: stat d3/de/d14/d2c 0 2024-02-20T08:05:23.132 INFO:tasks.workunit.client.0.smithi123.stdout:1/182: dread d3/db/f19 [0,4194304] 0 2024-02-20T08:05:23.133 INFO:tasks.workunit.client.0.smithi123.stdout:5/138: mkdir d0/d13/d27 0 2024-02-20T08:05:23.133 INFO:tasks.workunit.client.0.smithi123.stdout:1/183: write d3/db/f38 [10457,58074] 0 2024-02-20T08:05:23.134 INFO:tasks.workunit.client.0.smithi123.stdout:1/184: chown d3/f10 965062 1 2024-02-20T08:05:23.137 INFO:tasks.workunit.client.0.smithi123.stdout:5/139: rename d0/l3 to d0/d13/d27/l28 0 2024-02-20T08:05:23.141 INFO:tasks.workunit.client.0.smithi123.stdout:5/140: creat d0/d13/d1f/d25/f29 x:0 0 0 2024-02-20T08:05:23.142 INFO:tasks.workunit.client.0.smithi123.stdout:5/141: fsync d0/f14 0 2024-02-20T08:05:23.143 INFO:tasks.workunit.client.0.smithi123.stdout:1/185: mknod d3/db/d41/c43 0 2024-02-20T08:05:23.148 INFO:tasks.workunit.client.0.smithi123.stdout:1/186: creat d3/de/d14/d36/f44 x:0 0 0 2024-02-20T08:05:23.149 INFO:tasks.workunit.client.0.smithi123.stdout:1/187: fdatasync d3/db/f21 0 2024-02-20T08:05:23.149 INFO:tasks.workunit.client.0.smithi123.stdout:5/142: dwrite d0/d13/d1f/f23 [0,4194304] 0 2024-02-20T08:05:23.155 INFO:tasks.workunit.client.0.smithi123.stdout:5/143: creat d0/d13/d1f/d25/f2a x:0 0 0 2024-02-20T08:05:23.156 INFO:tasks.workunit.client.0.smithi123.stdout:5/144: write d0/f15 [2399488,73409] 0 2024-02-20T08:05:23.163 INFO:tasks.workunit.client.0.smithi123.stdout:5/145: dwrite d0/f16 [0,4194304] 0 2024-02-20T08:05:23.163 INFO:tasks.workunit.client.0.smithi123.stdout:5/146: chown d0/lf 7650 1 2024-02-20T08:05:23.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/147: write d0/f14 [840326,86353] 0 2024-02-20T08:05:23.165 INFO:tasks.workunit.client.0.smithi123.stdout:1/188: getdents d3 0 2024-02-20T08:05:23.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/148: chown d0/d13 2004189 1 2024-02-20T08:05:23.166 INFO:tasks.workunit.client.0.smithi123.stdout:1/189: dread - d3/de/d14/d26/d2e/f37 zero size 2024-02-20T08:05:23.167 INFO:tasks.workunit.client.0.smithi123.stdout:5/149: write d0/f16 [598108,104820] 0 2024-02-20T08:05:23.171 INFO:tasks.workunit.client.0.smithi123.stdout:1/190: mkdir d3/de/d14/d2c/d45 0 2024-02-20T08:05:23.173 INFO:tasks.workunit.client.0.smithi123.stdout:5/150: symlink d0/d13/d1f/d25/l2b 0 2024-02-20T08:05:23.177 INFO:tasks.workunit.client.0.smithi123.stdout:1/191: symlink d3/de/d14/l46 0 2024-02-20T08:05:23.178 INFO:tasks.workunit.client.0.smithi123.stdout:4/164: sync 2024-02-20T08:05:23.181 INFO:tasks.workunit.client.0.smithi123.stdout:1/192: mkdir d3/d47 0 2024-02-20T08:05:23.183 INFO:tasks.workunit.client.0.smithi123.stdout:4/165: dwrite d3/d1e/f2d [0,4194304] 0 2024-02-20T08:05:23.186 INFO:tasks.workunit.client.0.smithi123.stdout:5/151: link d0/f16 d0/d13/f2c 0 2024-02-20T08:05:23.187 INFO:tasks.workunit.client.0.smithi123.stdout:5/152: stat d0/d13/d1f/f1a 0 2024-02-20T08:05:23.190 INFO:tasks.workunit.client.0.smithi123.stdout:4/166: stat d3/d1f/d21/c33 0 2024-02-20T08:05:23.198 INFO:tasks.workunit.client.0.smithi123.stdout:5/153: chown d0/d13/d1f/l18 0 1 2024-02-20T08:05:23.203 INFO:tasks.workunit.client.0.smithi123.stdout:5/154: dread d0/f16 [0,4194304] 0 2024-02-20T08:05:23.207 INFO:tasks.workunit.client.0.smithi123.stdout:5/155: creat d0/d13/d1f/d25/f2d x:0 0 0 2024-02-20T08:05:23.214 INFO:tasks.workunit.client.0.smithi123.stdout:5/156: dwrite d0/f16 [0,4194304] 0 2024-02-20T08:05:23.228 INFO:tasks.workunit.client.0.smithi123.stdout:5/157: link d0/d13/d1f/d25/c26 d0/d13/d27/c2e 0 2024-02-20T08:05:23.230 INFO:tasks.workunit.client.0.smithi123.stdout:5/158: read d0/fc [1317141,91777] 0 2024-02-20T08:05:23.242 INFO:tasks.workunit.client.0.smithi123.stdout:5/159: rename d0/f14 to d0/d13/f2f 0 2024-02-20T08:05:23.243 INFO:tasks.workunit.client.0.smithi123.stdout:5/160: fdatasync d0/f16 0 2024-02-20T08:05:23.271 INFO:tasks.workunit.client.0.smithi123.stdout:1/193: unlink d3/de/d14/d36/f44 0 2024-02-20T08:05:23.275 INFO:tasks.workunit.client.0.smithi123.stdout:4/167: write d3/d1e/f2d [4772917,126553] 0 2024-02-20T08:05:23.280 INFO:tasks.workunit.client.0.smithi123.stdout:4/168: dwrite d3/f28 [0,4194304] 0 2024-02-20T08:05:23.280 INFO:tasks.workunit.client.0.smithi123.stdout:1/194: link d3/de/d14/d26/d2e/f40 d3/f48 0 2024-02-20T08:05:23.284 INFO:tasks.workunit.client.0.smithi123.stdout:1/195: fdatasync d3/f1d 0 2024-02-20T08:05:23.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/169: creat d3/d1f/d26/d2e/f39 x:0 0 0 2024-02-20T08:05:23.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/170: chown d3/c9 2195554 1 2024-02-20T08:05:23.294 INFO:tasks.workunit.client.0.smithi123.stdout:1/196: dwrite d3/fc [0,4194304] 0 2024-02-20T08:05:23.297 INFO:tasks.workunit.client.0.smithi123.stdout:4/171: creat d3/d1f/d34/f3a x:0 0 0 2024-02-20T08:05:23.298 INFO:tasks.workunit.client.0.smithi123.stdout:4/172: chown d3/d1f/d34/l36 853151 1 2024-02-20T08:05:23.305 INFO:tasks.workunit.client.0.smithi123.stdout:1/197: rename d3/l7 to d3/db/d41/l49 0 2024-02-20T08:05:23.312 INFO:tasks.workunit.client.0.smithi123.stdout:1/198: dread d3/df/f1e [0,4194304] 0 2024-02-20T08:05:23.317 INFO:tasks.workunit.client.0.smithi123.stdout:1/199: creat d3/de/d14/d2c/d45/f4a x:0 0 0 2024-02-20T08:05:23.320 INFO:tasks.workunit.client.0.smithi123.stdout:1/200: read d3/db/f19 [2281986,13554] 0 2024-02-20T08:05:23.320 INFO:tasks.workunit.client.0.smithi123.stdout:1/201: chown d3/de/d14/l46 9712875 1 2024-02-20T08:05:23.326 INFO:tasks.workunit.client.0.smithi123.stdout:1/202: dwrite d3/f1d [0,4194304] 0 2024-02-20T08:05:23.329 INFO:tasks.workunit.client.0.smithi123.stdout:1/203: creat d3/db/d41/f4b x:0 0 0 2024-02-20T08:05:23.379 INFO:tasks.workunit.client.0.smithi123.stdout:4/173: truncate d3/f28 1776601 0 2024-02-20T08:05:23.382 INFO:tasks.workunit.client.0.smithi123.stdout:4/174: creat d3/d1f/d34/f3b x:0 0 0 2024-02-20T08:05:23.383 INFO:tasks.workunit.client.0.smithi123.stdout:4/175: fsync d3/d18/f1c 0 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:7/156: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:3/236: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:0/194: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:2/155: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:6/280: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:9/168: sync 2024-02-20T08:05:23.385 INFO:tasks.workunit.client.0.smithi123.stdout:8/235: sync 2024-02-20T08:05:23.386 INFO:tasks.workunit.client.0.smithi123.stdout:4/176: mknod d3/d1e/c3c 0 2024-02-20T08:05:23.387 INFO:tasks.workunit.client.0.smithi123.stdout:7/157: write d0/f2f [944653,127602] 0 2024-02-20T08:05:23.388 INFO:tasks.workunit.client.0.smithi123.stdout:8/236: read d6/fd [1060071,73725] 0 2024-02-20T08:05:23.390 INFO:tasks.workunit.client.0.smithi123.stdout:9/169: read - d6/d2a/d27/f2f zero size 2024-02-20T08:05:23.391 INFO:tasks.workunit.client.0.smithi123.stdout:2/156: dread f11 [0,4194304] 0 2024-02-20T08:05:23.392 INFO:tasks.workunit.client.0.smithi123.stdout:0/195: unlink d2/fb 0 2024-02-20T08:05:23.394 INFO:tasks.workunit.client.0.smithi123.stdout:0/196: chown d2/de/d19/d28 244758715 1 2024-02-20T08:05:23.396 INFO:tasks.workunit.client.0.smithi123.stdout:8/237: dwrite d6/f15 [0,4194304] 0 2024-02-20T08:05:23.396 INFO:tasks.workunit.client.0.smithi123.stdout:1/204: fsync d3/de/d14/d2c/d45/f4a 0 2024-02-20T08:05:23.398 INFO:tasks.workunit.client.0.smithi123.stdout:2/157: dread f5 [0,4194304] 0 2024-02-20T08:05:23.401 INFO:tasks.workunit.client.0.smithi123.stdout:5/161: sync 2024-02-20T08:05:23.402 INFO:tasks.workunit.client.0.smithi123.stdout:4/177: rename d3/lc to d3/d1f/d34/l3d 0 2024-02-20T08:05:23.403 INFO:tasks.workunit.client.0.smithi123.stdout:0/197: dwrite d2/de/d1e/d1f/f29 [0,4194304] 0 2024-02-20T08:05:23.407 INFO:tasks.workunit.client.0.smithi123.stdout:7/158: creat d0/d6/d7/d22/f33 x:0 0 0 2024-02-20T08:05:23.408 INFO:tasks.workunit.client.0.smithi123.stdout:7/159: stat d0/d6/f31 0 2024-02-20T08:05:23.411 INFO:tasks.workunit.client.0.smithi123.stdout:9/170: mkdir d6/d2a/d27/d29/d32 0 2024-02-20T08:05:23.414 INFO:tasks.workunit.client.0.smithi123.stdout:6/281: mkdir d0/d5c 0 2024-02-20T08:05:23.436 INFO:tasks.workunit.client.0.smithi123.stdout:8/238: symlink d6/l50 0 2024-02-20T08:05:23.438 INFO:tasks.workunit.client.0.smithi123.stdout:3/237: mknod d0/d6/d1a/d1b/d57/c58 0 2024-02-20T08:05:23.439 INFO:tasks.workunit.client.0.smithi123.stdout:3/238: chown d0/d6/d1a/d1b/d1c/f25 4606 1 2024-02-20T08:05:23.440 INFO:tasks.workunit.client.0.smithi123.stdout:3/239: fdatasync d0/dd/f38 0 2024-02-20T08:05:23.441 INFO:tasks.workunit.client.0.smithi123.stdout:1/205: symlink d3/db/d41/l4c 0 2024-02-20T08:05:23.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/158: mknod d1a/c30 0 2024-02-20T08:05:23.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/159: truncate d1a/f2e 476792 0 2024-02-20T08:05:23.443 INFO:tasks.workunit.client.0.smithi123.stdout:2/160: fsync d1a/f26 0 2024-02-20T08:05:23.446 INFO:tasks.workunit.client.0.smithi123.stdout:0/198: symlink d2/de/d19/l43 0 2024-02-20T08:05:23.446 INFO:tasks.workunit.client.0.smithi123.stdout:0/199: stat d2/de/f17 0 2024-02-20T08:05:23.454 INFO:tasks.workunit.client.0.smithi123.stdout:1/206: fsync d3/df/f1e 0 2024-02-20T08:05:23.456 INFO:tasks.workunit.client.0.smithi123.stdout:1/207: write d3/db/d41/f4b [307931,4152] 0 2024-02-20T08:05:23.457 INFO:tasks.workunit.client.0.smithi123.stdout:2/161: mknod d1a/d29/c31 0 2024-02-20T08:05:23.459 INFO:tasks.workunit.client.0.smithi123.stdout:4/178: fsync d3/d18/f23 0 2024-02-20T08:05:23.462 INFO:tasks.workunit.client.0.smithi123.stdout:7/160: symlink d0/l34 0 2024-02-20T08:05:23.462 INFO:tasks.workunit.client.0.smithi123.stdout:1/208: dwrite d3/db/f21 [0,4194304] 0 2024-02-20T08:05:23.464 INFO:tasks.workunit.client.0.smithi123.stdout:4/179: dread d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:23.465 INFO:tasks.workunit.client.0.smithi123.stdout:9/171: rename d6/d19/c21 to d6/d2a/c33 0 2024-02-20T08:05:23.467 INFO:tasks.workunit.client.0.smithi123.stdout:3/240: symlink d0/dd/d48/l59 0 2024-02-20T08:05:23.469 INFO:tasks.workunit.client.0.smithi123.stdout:5/162: creat d0/f30 x:0 0 0 2024-02-20T08:05:23.469 INFO:tasks.workunit.client.0.smithi123.stdout:3/241: dread - d0/d6/d1a/f2f zero size 2024-02-20T08:05:23.471 INFO:tasks.workunit.client.0.smithi123.stdout:2/162: rmdir d1a/d29 39 2024-02-20T08:05:23.472 INFO:tasks.workunit.client.0.smithi123.stdout:9/172: dwrite f5 [0,4194304] 0 2024-02-20T08:05:23.477 INFO:tasks.workunit.client.0.smithi123.stdout:7/161: mkdir d0/d6/d7/d22/d35 0 2024-02-20T08:05:23.478 INFO:tasks.workunit.client.0.smithi123.stdout:1/209: creat d3/de/d14/d2c/d45/f4d x:0 0 0 2024-02-20T08:05:23.483 INFO:tasks.workunit.client.0.smithi123.stdout:4/180: rename d3/d1f/d21 to d3/d1f/d26/d3e 0 2024-02-20T08:05:23.484 INFO:tasks.workunit.client.0.smithi123.stdout:4/181: chown d3/d18/f19 23 1 2024-02-20T08:05:23.484 INFO:tasks.workunit.client.0.smithi123.stdout:3/242: mkdir d0/d6/d34/d5a 0 2024-02-20T08:05:23.485 INFO:tasks.workunit.client.0.smithi123.stdout:1/210: dwrite d3/db/d34/f2b [0,4194304] 0 2024-02-20T08:05:23.486 INFO:tasks.workunit.client.0.smithi123.stdout:3/243: write d0/d6/f2e [2286478,79651] 0 2024-02-20T08:05:23.486 INFO:tasks.workunit.client.0.smithi123.stdout:5/163: creat d0/d13/d1f/d25/f31 x:0 0 0 2024-02-20T08:05:23.493 INFO:tasks.workunit.client.0.smithi123.stdout:0/200: creat d2/dd/f44 x:0 0 0 2024-02-20T08:05:23.495 INFO:tasks.workunit.client.0.smithi123.stdout:3/244: dwrite d0/d6/d32/f4e [0,4194304] 0 2024-02-20T08:05:23.496 INFO:tasks.workunit.client.0.smithi123.stdout:3/245: read - d0/f53 zero size 2024-02-20T08:05:23.501 INFO:tasks.workunit.client.0.smithi123.stdout:1/211: truncate d3/f3e 174926 0 2024-02-20T08:05:23.502 INFO:tasks.workunit.client.0.smithi123.stdout:1/212: chown d3/de/d14/d26/d2e/f40 5057 1 2024-02-20T08:05:23.504 INFO:tasks.workunit.client.0.smithi123.stdout:5/164: dread d0/d13/f1b [0,4194304] 0 2024-02-20T08:05:23.506 INFO:tasks.workunit.client.0.smithi123.stdout:9/173: link d6/f30 d6/d19/f34 0 2024-02-20T08:05:23.509 INFO:tasks.workunit.client.0.smithi123.stdout:0/201: rmdir d2/de/d1e 39 2024-02-20T08:05:23.511 INFO:tasks.workunit.client.0.smithi123.stdout:3/246: mknod d0/d6/d1a/d1b/d1c/c5b 0 2024-02-20T08:05:23.512 INFO:tasks.workunit.client.0.smithi123.stdout:3/247: fsync d0/dd/f38 0 2024-02-20T08:05:23.513 INFO:tasks.workunit.client.0.smithi123.stdout:3/248: write d0/f53 [677216,76052] 0 2024-02-20T08:05:23.515 INFO:tasks.workunit.client.0.smithi123.stdout:2/163: creat d1a/f32 x:0 0 0 2024-02-20T08:05:23.518 INFO:tasks.workunit.client.0.smithi123.stdout:2/164: dread d1a/f1e [4194304,4194304] 0 2024-02-20T08:05:23.519 INFO:tasks.workunit.client.0.smithi123.stdout:0/202: read d2/de/d1e/d1f/f20 [106302,126616] 0 2024-02-20T08:05:23.520 INFO:tasks.workunit.client.0.smithi123.stdout:0/203: chown d2/l21 24 1 2024-02-20T08:05:23.521 INFO:tasks.workunit.client.0.smithi123.stdout:4/182: rename d3/d1f/d34/l36 to d3/d1f/l3f 0 2024-02-20T08:05:23.526 INFO:tasks.workunit.client.0.smithi123.stdout:5/165: mknod d0/c32 0 2024-02-20T08:05:23.527 INFO:tasks.workunit.client.0.smithi123.stdout:2/165: chown d1a/d29 10 1 2024-02-20T08:05:23.533 INFO:tasks.workunit.client.0.smithi123.stdout:1/213: dwrite d3/fa [0,4194304] 0 2024-02-20T08:05:23.534 INFO:tasks.workunit.client.0.smithi123.stdout:4/183: dwrite d3/d1f/d26/f29 [0,4194304] 0 2024-02-20T08:05:23.536 INFO:tasks.workunit.client.0.smithi123.stdout:9/174: dread d6/fa [0,4194304] 0 2024-02-20T08:05:23.541 INFO:tasks.workunit.client.0.smithi123.stdout:2/166: dwrite d1a/f28 [0,4194304] 0 2024-02-20T08:05:23.543 INFO:tasks.workunit.client.0.smithi123.stdout:9/175: dread f5 [0,4194304] 0 2024-02-20T08:05:23.545 INFO:tasks.workunit.client.0.smithi123.stdout:1/214: dread - d3/f42 zero size 2024-02-20T08:05:23.546 INFO:tasks.workunit.client.0.smithi123.stdout:1/215: truncate d3/de/d14/d36/f3d 805419 0 2024-02-20T08:05:23.548 INFO:tasks.workunit.client.0.smithi123.stdout:1/216: write d3/f3e [385573,17805] 0 2024-02-20T08:05:23.555 INFO:tasks.workunit.client.0.smithi123.stdout:5/166: creat d0/f33 x:0 0 0 2024-02-20T08:05:23.556 INFO:tasks.workunit.client.0.smithi123.stdout:5/167: chown d0/l5 914666 1 2024-02-20T08:05:23.557 INFO:tasks.workunit.client.0.smithi123.stdout:9/176: mknod d6/d19/d1a/d2b/d28/c35 0 2024-02-20T08:05:23.563 INFO:tasks.workunit.client.0.smithi123.stdout:0/204: getdents d2/de 0 2024-02-20T08:05:23.566 INFO:tasks.workunit.client.0.smithi123.stdout:2/167: symlink d1a/l33 0 2024-02-20T08:05:23.569 INFO:tasks.workunit.client.0.smithi123.stdout:1/217: getdents d3/d47 0 2024-02-20T08:05:23.570 INFO:tasks.workunit.client.0.smithi123.stdout:1/218: read d3/db/f21 [2696944,5399] 0 2024-02-20T08:05:23.572 INFO:tasks.workunit.client.0.smithi123.stdout:2/168: dwrite f10 [0,4194304] 0 2024-02-20T08:05:23.574 INFO:tasks.workunit.client.0.smithi123.stdout:5/168: mkdir d0/d34 0 2024-02-20T08:05:23.575 INFO:tasks.workunit.client.0.smithi123.stdout:2/169: fsync d1a/f1e 0 2024-02-20T08:05:23.579 INFO:tasks.workunit.client.0.smithi123.stdout:0/205: dwrite d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:23.580 INFO:tasks.workunit.client.0.smithi123.stdout:1/219: creat d3/db/f4e x:0 0 0 2024-02-20T08:05:23.582 INFO:tasks.workunit.client.0.smithi123.stdout:1/220: truncate d3/db/d41/f4b 935087 0 2024-02-20T08:05:23.588 INFO:tasks.workunit.client.0.smithi123.stdout:2/170: dwrite f11 [8388608,4194304] 0 2024-02-20T08:05:23.589 INFO:tasks.workunit.client.0.smithi123.stdout:1/221: mkdir d3/de/d14/d2c/d4f 0 2024-02-20T08:05:23.596 INFO:tasks.workunit.client.0.smithi123.stdout:2/171: dread f10 [0,4194304] 0 2024-02-20T08:05:23.597 INFO:tasks.workunit.client.0.smithi123.stdout:3/249: truncate d0/dd/f38 2042561 0 2024-02-20T08:05:23.602 INFO:tasks.workunit.client.0.smithi123.stdout:1/222: dwrite d3/db/d34/f2b [0,4194304] 0 2024-02-20T08:05:23.602 INFO:tasks.workunit.client.0.smithi123.stdout:2/172: symlink d1a/d29/l34 0 2024-02-20T08:05:23.603 INFO:tasks.workunit.client.0.smithi123.stdout:6/282: dwrite d0/f34 [0,4194304] 0 2024-02-20T08:05:23.604 INFO:tasks.workunit.client.0.smithi123.stdout:8/239: dread d6/f1b [0,4194304] 0 2024-02-20T08:05:23.608 INFO:tasks.workunit.client.0.smithi123.stdout:2/173: dread f11 [0,4194304] 0 2024-02-20T08:05:23.609 INFO:tasks.workunit.client.0.smithi123.stdout:3/250: mkdir d0/d6/d1a/d1b/d5c 0 2024-02-20T08:05:23.616 INFO:tasks.workunit.client.0.smithi123.stdout:9/177: rename d6/d2a/c33 to d6/d19/d1a/d31/c36 0 2024-02-20T08:05:23.621 INFO:tasks.workunit.client.0.smithi123.stdout:2/174: dwrite f17 [0,4194304] 0 2024-02-20T08:05:23.622 INFO:tasks.workunit.client.0.smithi123.stdout:3/251: dwrite d0/d6/d1a/f23 [0,4194304] 0 2024-02-20T08:05:23.622 INFO:tasks.workunit.client.0.smithi123.stdout:2/175: readlink d1a/l21 0 2024-02-20T08:05:23.623 INFO:tasks.workunit.client.0.smithi123.stdout:3/252: fsync d0/f3f 0 2024-02-20T08:05:23.626 INFO:tasks.workunit.client.0.smithi123.stdout:8/240: dread d6/f15 [0,4194304] 0 2024-02-20T08:05:23.634 INFO:tasks.workunit.client.0.smithi123.stdout:2/176: creat d1a/d29/f35 x:0 0 0 2024-02-20T08:05:23.637 INFO:tasks.workunit.client.0.smithi123.stdout:9/178: truncate d6/fa 324307 0 2024-02-20T08:05:23.638 INFO:tasks.workunit.client.0.smithi123.stdout:8/241: fsync d6/f2f 0 2024-02-20T08:05:23.639 INFO:tasks.workunit.client.0.smithi123.stdout:1/223: dread d3/df/f11 [0,4194304] 0 2024-02-20T08:05:23.640 INFO:tasks.workunit.client.0.smithi123.stdout:1/224: truncate d3/de/d14/d26/d2e/f40 1025417 0 2024-02-20T08:05:23.642 INFO:tasks.workunit.client.0.smithi123.stdout:9/179: write f5 [1384863,58190] 0 2024-02-20T08:05:23.643 INFO:tasks.workunit.client.0.smithi123.stdout:9/180: chown d6/d19/d1a/d2b/d28 0 1 2024-02-20T08:05:23.646 INFO:tasks.workunit.client.0.smithi123.stdout:7/162: write d0/d6/d7/f16 [804246,85549] 0 2024-02-20T08:05:23.647 INFO:tasks.workunit.client.0.smithi123.stdout:3/253: link d0/lc d0/dd/d48/l5d 0 2024-02-20T08:05:23.649 INFO:tasks.workunit.client.0.smithi123.stdout:1/225: symlink d3/de/d14/d26/d2e/l50 0 2024-02-20T08:05:23.649 INFO:tasks.workunit.client.0.smithi123.stdout:3/254: chown d0/d6/d1a/d4b 10 1 2024-02-20T08:05:23.650 INFO:tasks.workunit.client.0.smithi123.stdout:9/181: rmdir d6/d19/d1a/d2b/d28 39 2024-02-20T08:05:23.651 INFO:tasks.workunit.client.0.smithi123.stdout:3/255: stat d0/d6/d1a/d1b/f54 0 2024-02-20T08:05:23.652 INFO:tasks.workunit.client.0.smithi123.stdout:8/242: dwrite d6/d1c/d29/f38 [0,4194304] 0 2024-02-20T08:05:23.653 INFO:tasks.workunit.client.0.smithi123.stdout:8/243: readlink d6/l50 0 2024-02-20T08:05:23.654 INFO:tasks.workunit.client.0.smithi123.stdout:7/163: creat d0/d6/d7/d10/d1d/f36 x:0 0 0 2024-02-20T08:05:23.661 INFO:tasks.workunit.client.0.smithi123.stdout:3/256: mkdir d0/d6/d1a/d1b/d1c/d21/d5e 0 2024-02-20T08:05:23.665 INFO:tasks.workunit.client.0.smithi123.stdout:4/184: write d3/d1f/d26/f29 [4199603,31484] 0 2024-02-20T08:05:23.667 INFO:tasks.workunit.client.0.smithi123.stdout:8/244: link d6/f1b d6/d1c/d2c/f51 0 2024-02-20T08:05:23.670 INFO:tasks.workunit.client.0.smithi123.stdout:8/245: write d6/d1c/d22/f48 [746192,49188] 0 2024-02-20T08:05:23.671 INFO:tasks.workunit.client.0.smithi123.stdout:3/257: creat d0/d6/d1a/d1b/d5c/f5f x:0 0 0 2024-02-20T08:05:23.671 INFO:tasks.workunit.client.0.smithi123.stdout:8/246: chown d6/d1c/d22/d4f 8868 1 2024-02-20T08:05:23.673 INFO:tasks.workunit.client.0.smithi123.stdout:4/185: dwrite d3/d18/f1c [0,4194304] 0 2024-02-20T08:05:23.675 INFO:tasks.workunit.client.0.smithi123.stdout:7/164: getdents d0/d6/dd 0 2024-02-20T08:05:23.676 INFO:tasks.workunit.client.0.smithi123.stdout:4/186: write d3/d18/f32 [672769,103808] 0 2024-02-20T08:05:23.681 INFO:tasks.workunit.client.0.smithi123.stdout:8/247: dwrite d6/d1c/d22/f48 [0,4194304] 0 2024-02-20T08:05:23.682 INFO:tasks.workunit.client.0.smithi123.stdout:4/187: unlink d3/d1e/c38 0 2024-02-20T08:05:23.686 INFO:tasks.workunit.client.0.smithi123.stdout:4/188: creat d3/d2c/f40 x:0 0 0 2024-02-20T08:05:23.690 INFO:tasks.workunit.client.0.smithi123.stdout:8/248: link d6/l26 d6/d1c/d22/l52 0 2024-02-20T08:05:23.694 INFO:tasks.workunit.client.0.smithi123.stdout:4/189: dwrite d3/d1f/d34/f3b [0,4194304] 0 2024-02-20T08:05:23.695 INFO:tasks.workunit.client.0.smithi123.stdout:4/190: chown d3/cb 25 1 2024-02-20T08:05:23.698 INFO:tasks.workunit.client.0.smithi123.stdout:8/249: symlink d6/d1c/d2c/l53 0 2024-02-20T08:05:23.699 INFO:tasks.workunit.client.0.smithi123.stdout:4/191: truncate d3/d18/f19 2478800 0 2024-02-20T08:05:23.699 INFO:tasks.workunit.client.0.smithi123.stdout:4/192: chown d3/d18/c27 60322305 1 2024-02-20T08:05:23.701 INFO:tasks.workunit.client.0.smithi123.stdout:7/165: dread d0/d6/dd/d15/f1f [0,4194304] 0 2024-02-20T08:05:23.704 INFO:tasks.workunit.client.0.smithi123.stdout:4/193: rename d3/l16 to d3/d1f/d26/d2e/l41 0 2024-02-20T08:05:23.706 INFO:tasks.workunit.client.0.smithi123.stdout:8/250: rmdir d6/d32 39 2024-02-20T08:05:23.708 INFO:tasks.workunit.client.0.smithi123.stdout:4/194: mknod d3/d18/c42 0 2024-02-20T08:05:23.713 INFO:tasks.workunit.client.0.smithi123.stdout:7/166: creat d0/f37 x:0 0 0 2024-02-20T08:05:23.714 INFO:tasks.workunit.client.0.smithi123.stdout:7/167: chown d0/d23/c32 173919 1 2024-02-20T08:05:23.717 INFO:tasks.workunit.client.0.smithi123.stdout:7/168: mkdir d0/db/d38 0 2024-02-20T08:05:23.718 INFO:tasks.workunit.client.0.smithi123.stdout:7/169: read d0/f2f [89576,40374] 0 2024-02-20T08:05:23.720 INFO:tasks.workunit.client.0.smithi123.stdout:0/206: truncate d2/f8 8024426 0 2024-02-20T08:05:23.720 INFO:tasks.workunit.client.0.smithi123.stdout:0/207: readlink d2/d3/l11 0 2024-02-20T08:05:23.723 INFO:tasks.workunit.client.0.smithi123.stdout:7/170: mknod d0/d6/d7/d10/d1d/c39 0 2024-02-20T08:05:23.725 INFO:tasks.workunit.client.0.smithi123.stdout:0/208: creat d2/de/d19/f45 x:0 0 0 2024-02-20T08:05:23.728 INFO:tasks.workunit.client.0.smithi123.stdout:7/171: write d0/d6/dd/d15/f1f [4591160,80166] 0 2024-02-20T08:05:23.731 INFO:tasks.workunit.client.0.smithi123.stdout:7/172: write d0/f4 [888280,6829] 0 2024-02-20T08:05:23.737 INFO:tasks.workunit.client.0.smithi123.stdout:2/177: rmdir d1a/d29 39 2024-02-20T08:05:23.737 INFO:tasks.workunit.client.0.smithi123.stdout:2/178: fdatasync d1a/f28 0 2024-02-20T08:05:23.739 INFO:tasks.workunit.client.0.smithi123.stdout:9/182: dread d6/fa [0,4194304] 0 2024-02-20T08:05:23.742 INFO:tasks.workunit.client.0.smithi123.stdout:9/183: fsync d6/fb 0 2024-02-20T08:05:23.746 INFO:tasks.workunit.client.0.smithi123.stdout:9/184: creat d6/d19/d1a/d2b/f37 x:0 0 0 2024-02-20T08:05:23.748 INFO:tasks.workunit.client.0.smithi123.stdout:9/185: chown d6/ff 9 1 2024-02-20T08:05:23.753 INFO:tasks.workunit.client.0.smithi123.stdout:1/226: dwrite d3/de/d14/d26/d2e/f40 [0,4194304] 0 2024-02-20T08:05:23.756 INFO:tasks.workunit.client.0.smithi123.stdout:1/227: creat d3/df/f51 x:0 0 0 2024-02-20T08:05:23.757 INFO:tasks.workunit.client.0.smithi123.stdout:1/228: dread - d3/f42 zero size 2024-02-20T08:05:23.759 INFO:tasks.workunit.client.0.smithi123.stdout:1/229: mkdir d3/d52 0 2024-02-20T08:05:23.760 INFO:tasks.workunit.client.0.smithi123.stdout:1/230: rmdir d3/db/d34 39 2024-02-20T08:05:23.770 INFO:tasks.workunit.client.0.smithi123.stdout:1/231: dread d3/db/f21 [0,4194304] 0 2024-02-20T08:05:23.770 INFO:tasks.workunit.client.0.smithi123.stdout:4/195: rename d3/d1f to d3/d2c/d43 0 2024-02-20T08:05:23.770 INFO:tasks.workunit.client.0.smithi123.stdout:1/232: truncate d3/db/f21 2791577 0 2024-02-20T08:05:23.770 INFO:tasks.workunit.client.0.smithi123.stdout:0/209: rename d2/f18 to d2/de/d1e/f46 0 2024-02-20T08:05:23.770 INFO:tasks.workunit.client.0.smithi123.stdout:4/196: read d3/fd [5385119,67624] 0 2024-02-20T08:05:23.804 INFO:tasks.workunit.client.0.smithi123.stdout:8/251: write d6/d1c/f21 [63237,10398] 0 2024-02-20T08:05:23.805 INFO:tasks.workunit.client.0.smithi123.stdout:7/173: truncate d0/f4 3653762 0 2024-02-20T08:05:23.816 INFO:tasks.workunit.client.0.smithi123.stdout:7/174: creat d0/d6/d29/f3a x:0 0 0 2024-02-20T08:05:23.817 INFO:tasks.workunit.client.0.smithi123.stdout:7/175: write d0/d6/d7/f1e [2378348,58265] 0 2024-02-20T08:05:23.818 INFO:tasks.workunit.client.0.smithi123.stdout:4/197: creat d3/d2c/d43/f44 x:0 0 0 2024-02-20T08:05:23.824 INFO:tasks.workunit.client.0.smithi123.stdout:1/233: dwrite d3/df/f11 [0,4194304] 0 2024-02-20T08:05:23.826 INFO:tasks.workunit.client.0.smithi123.stdout:1/234: write d3/de/d14/d36/f3d [1180776,90207] 0 2024-02-20T08:05:23.830 INFO:tasks.workunit.client.0.smithi123.stdout:1/235: creat d3/de/d14/d26/f53 x:0 0 0 2024-02-20T08:05:23.834 INFO:tasks.workunit.client.0.smithi123.stdout:1/236: rename d3/db/d3a to d3/de/d14/d26/d2e/d54 0 2024-02-20T08:05:23.838 INFO:tasks.workunit.client.0.smithi123.stdout:4/198: dread d3/fd [4194304,4194304] 0 2024-02-20T08:05:23.839 INFO:tasks.workunit.client.0.smithi123.stdout:1/237: unlink d3/de/d14/c2a 0 2024-02-20T08:05:23.840 INFO:tasks.workunit.client.0.smithi123.stdout:1/238: write d3/de/d14/d2c/f32 [189797,118199] 0 2024-02-20T08:05:23.841 INFO:tasks.workunit.client.0.smithi123.stdout:1/239: fdatasync d3/de/d14/d26/f53 0 2024-02-20T08:05:23.842 INFO:tasks.workunit.client.0.smithi123.stdout:4/199: creat d3/d2c/f45 x:0 0 0 2024-02-20T08:05:23.845 INFO:tasks.workunit.client.0.smithi123.stdout:4/200: unlink d3/d2c/d43/d34/f3a 0 2024-02-20T08:05:23.845 INFO:tasks.workunit.client.0.smithi123.stdout:4/201: chown d3/c9 19078299 1 2024-02-20T08:05:23.846 INFO:tasks.workunit.client.0.smithi123.stdout:4/202: chown d3/l7 93141270 1 2024-02-20T08:05:23.850 INFO:tasks.workunit.client.0.smithi123.stdout:4/203: creat d3/d2c/f46 x:0 0 0 2024-02-20T08:05:23.851 INFO:tasks.workunit.client.0.smithi123.stdout:4/204: chown d3/c9 155493074 1 2024-02-20T08:05:23.853 INFO:tasks.workunit.client.0.smithi123.stdout:1/240: getdents d3/de/d14/d26/d2e/d54 0 2024-02-20T08:05:23.853 INFO:tasks.workunit.client.0.smithi123.stdout:8/252: dwrite d6/f1b [0,4194304] 0 2024-02-20T08:05:23.857 INFO:tasks.workunit.client.0.smithi123.stdout:4/205: unlink d3/d2c/d43/d26/d3e/l22 0 2024-02-20T08:05:23.858 INFO:tasks.workunit.client.0.smithi123.stdout:8/253: readlink d6/d1c/d22/l42 0 2024-02-20T08:05:23.864 INFO:tasks.workunit.client.0.smithi123.stdout:1/241: mkdir d3/de/d14/d2c/d4f/d55 0 2024-02-20T08:05:23.864 INFO:tasks.workunit.client.0.smithi123.stdout:8/254: write d6/fa [4326797,19960] 0 2024-02-20T08:05:23.865 INFO:tasks.workunit.client.0.smithi123.stdout:4/206: dwrite d3/d2c/d43/d34/f3b [0,4194304] 0 2024-02-20T08:05:23.867 INFO:tasks.workunit.client.0.smithi123.stdout:4/207: readlink d3/l7 0 2024-02-20T08:05:23.868 INFO:tasks.workunit.client.0.smithi123.stdout:4/208: chown d3/fd 1 1 2024-02-20T08:05:23.868 INFO:tasks.workunit.client.0.smithi123.stdout:7/176: dwrite d0/f4 [0,4194304] 0 2024-02-20T08:05:23.869 INFO:tasks.workunit.client.0.smithi123.stdout:4/209: stat d3/d2c/f45 0 2024-02-20T08:05:23.869 INFO:tasks.workunit.client.0.smithi123.stdout:7/177: readlink d0/l34 0 2024-02-20T08:05:23.870 INFO:tasks.workunit.client.0.smithi123.stdout:8/255: symlink d6/d1c/d29/l54 0 2024-02-20T08:05:23.870 INFO:tasks.workunit.client.0.smithi123.stdout:1/242: dread d3/de/d14/d2c/f32 [0,4194304] 0 2024-02-20T08:05:23.871 INFO:tasks.workunit.client.0.smithi123.stdout:4/210: truncate d3/ff 12832527 0 2024-02-20T08:05:23.875 INFO:tasks.workunit.client.0.smithi123.stdout:7/178: creat d0/d6/d7/d22/f3b x:0 0 0 2024-02-20T08:05:23.882 INFO:tasks.workunit.client.0.smithi123.stdout:8/256: symlink d6/d1c/l55 0 2024-02-20T08:05:23.883 INFO:tasks.workunit.client.0.smithi123.stdout:8/257: dread - d6/d1c/d22/f4b zero size 2024-02-20T08:05:23.884 INFO:tasks.workunit.client.0.smithi123.stdout:7/179: rmdir d0/d6/d7/d10/d1d/d2a 39 2024-02-20T08:05:23.885 INFO:tasks.workunit.client.0.smithi123.stdout:7/180: chown d0/d6/d7/c12 21 1 2024-02-20T08:05:23.891 INFO:tasks.workunit.client.0.smithi123.stdout:7/181: creat d0/d23/f3c x:0 0 0 2024-02-20T08:05:23.892 INFO:tasks.workunit.client.0.smithi123.stdout:8/258: creat d6/d1c/d22/d4f/f56 x:0 0 0 2024-02-20T08:05:23.895 INFO:tasks.workunit.client.0.smithi123.stdout:8/259: creat d6/d1c/d29/f57 x:0 0 0 2024-02-20T08:05:23.896 INFO:tasks.workunit.client.0.smithi123.stdout:8/260: fdatasync d6/d1c/d22/f48 0 2024-02-20T08:05:23.898 INFO:tasks.workunit.client.0.smithi123.stdout:7/182: creat d0/f3d x:0 0 0 2024-02-20T08:05:23.899 INFO:tasks.workunit.client.0.smithi123.stdout:7/183: truncate d0/d6/d7/f25 14278 0 2024-02-20T08:05:23.900 INFO:tasks.workunit.client.0.smithi123.stdout:7/184: stat d0/l11 0 2024-02-20T08:05:23.901 INFO:tasks.workunit.client.0.smithi123.stdout:8/261: mknod d6/d1c/d22/d4f/c58 0 2024-02-20T08:05:23.902 INFO:tasks.workunit.client.0.smithi123.stdout:7/185: symlink d0/d6/d7/d22/l3e 0 2024-02-20T08:05:23.904 INFO:tasks.workunit.client.0.smithi123.stdout:7/186: mknod d0/d6/d7/d10/c3f 0 2024-02-20T08:05:23.904 INFO:tasks.workunit.client.0.smithi123.stdout:1/243: write d3/df/f1e [4622575,59771] 0 2024-02-20T08:05:23.907 INFO:tasks.workunit.client.0.smithi123.stdout:1/244: dread d3/de/d14/d2c/f32 [0,4194304] 0 2024-02-20T08:05:23.912 INFO:tasks.workunit.client.0.smithi123.stdout:4/211: dwrite d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:23.916 INFO:tasks.workunit.client.0.smithi123.stdout:1/245: dwrite d3/db/f38 [0,4194304] 0 2024-02-20T08:05:23.917 INFO:tasks.workunit.client.0.smithi123.stdout:1/246: chown d3/db/d41/f4b 557 1 2024-02-20T08:05:23.921 INFO:tasks.workunit.client.0.smithi123.stdout:1/247: mkdir d3/de/d14/d26/d56 0 2024-02-20T08:05:23.922 INFO:tasks.workunit.client.0.smithi123.stdout:1/248: truncate d3/db/f4e 698256 0 2024-02-20T08:05:23.925 INFO:tasks.workunit.client.0.smithi123.stdout:1/249: rename d3/db/f23 to d3/de/d14/d2c/d4f/f57 0 2024-02-20T08:05:23.927 INFO:tasks.workunit.client.0.smithi123.stdout:1/250: getdents d3/de/d14/d26/d2e/d54 0 2024-02-20T08:05:23.928 INFO:tasks.workunit.client.0.smithi123.stdout:1/251: write d3/de/d14/d2c/d45/f4a [802500,120394] 0 2024-02-20T08:05:23.930 INFO:tasks.workunit.client.0.smithi123.stdout:1/252: creat d3/de/d14/d26/d56/f58 x:0 0 0 2024-02-20T08:05:23.933 INFO:tasks.workunit.client.0.smithi123.stdout:1/253: rmdir d3/de/d14/d2c/d4f/d55 0 2024-02-20T08:05:23.995 INFO:tasks.workunit.client.0.smithi123.stdout:1/254: mkdir d3/de/d14/d36/d59 0 2024-02-20T08:05:23.998 INFO:tasks.workunit.client.0.smithi123.stdout:1/255: creat d3/de/f5a x:0 0 0 2024-02-20T08:05:23.999 INFO:tasks.workunit.client.0.smithi123.stdout:1/256: chown d3/de/d14/d36/d59 3472 1 2024-02-20T08:05:23.999 INFO:tasks.workunit.client.0.smithi123.stdout:1/257: chown d3/de/d14/d26 0 1 2024-02-20T08:05:24.000 INFO:tasks.workunit.client.0.smithi123.stdout:4/212: truncate d3/d2c/d43/d34/f3b 1581294 0 2024-02-20T08:05:24.003 INFO:tasks.workunit.client.0.smithi123.stdout:1/258: rename d3/de/d14/d26/f53 to d3/de/d14/d36/d59/f5b 0 2024-02-20T08:05:24.005 INFO:tasks.workunit.client.0.smithi123.stdout:4/213: symlink d3/d2c/d43/d34/l47 0 2024-02-20T08:05:24.011 INFO:tasks.workunit.client.0.smithi123.stdout:4/214: dwrite d3/d2c/d43/f44 [0,4194304] 0 2024-02-20T08:05:24.014 INFO:tasks.workunit.client.0.smithi123.stdout:4/215: unlink d3/d2c/d43/d26/l2f 0 2024-02-20T08:05:24.016 INFO:tasks.workunit.client.0.smithi123.stdout:4/216: fdatasync d3/f1b 0 2024-02-20T08:05:24.018 INFO:tasks.workunit.client.0.smithi123.stdout:4/217: read d3/d18/f31 [2784235,119159] 0 2024-02-20T08:05:24.020 INFO:tasks.workunit.client.0.smithi123.stdout:4/218: symlink d3/d1e/l48 0 2024-02-20T08:05:24.027 INFO:tasks.workunit.client.0.smithi123.stdout:4/219: dwrite d3/f2a [0,4194304] 0 2024-02-20T08:05:24.031 INFO:tasks.workunit.client.0.smithi123.stdout:1/259: dread d3/df/f1a [0,4194304] 0 2024-02-20T08:05:24.034 INFO:tasks.workunit.client.0.smithi123.stdout:4/220: rename d3/d2c/d43/l3f to d3/d2c/d43/d34/l49 0 2024-02-20T08:05:24.304 INFO:tasks.workunit.client.0.smithi123.stdout:5/169: sync 2024-02-20T08:05:24.306 INFO:tasks.workunit.client.0.smithi123.stdout:5/170: mknod d0/d13/c35 0 2024-02-20T08:05:24.308 INFO:tasks.workunit.client.0.smithi123.stdout:5/171: mknod d0/c36 0 2024-02-20T08:05:24.309 INFO:tasks.workunit.client.0.smithi123.stdout:5/172: chown d0/f8 4 1 2024-02-20T08:05:24.309 INFO:tasks.workunit.client.0.smithi123.stdout:5/173: stat d0/l22 0 2024-02-20T08:05:24.310 INFO:tasks.workunit.client.0.smithi123.stdout:5/174: chown d0/d13/f1e 3964 1 2024-02-20T08:05:24.310 INFO:tasks.workunit.client.0.smithi123.stdout:5/175: stat d0/d13/d1f/d25/f29 0 2024-02-20T08:05:24.315 INFO:tasks.workunit.client.0.smithi123.stdout:5/176: dwrite d0/d13/d1f/d25/f29 [0,4194304] 0 2024-02-20T08:05:24.316 INFO:tasks.workunit.client.0.smithi123.stdout:5/177: fdatasync d0/d13/d1f/d25/f31 0 2024-02-20T08:05:24.318 INFO:tasks.workunit.client.0.smithi123.stdout:5/178: write d0/d13/d1f/d25/f2d [1010022,31868] 0 2024-02-20T08:05:24.322 INFO:tasks.workunit.client.0.smithi123.stdout:5/179: mkdir d0/d13/d27/d37 0 2024-02-20T08:05:24.325 INFO:tasks.workunit.client.0.smithi123.stdout:5/180: mknod d0/d13/c38 0 2024-02-20T08:05:24.447 INFO:tasks.workunit.client.0.smithi123.stdout:6/283: sync 2024-02-20T08:05:24.448 INFO:tasks.workunit.client.0.smithi123.stdout:6/284: chown d0/d3e/d41/d56/f5a 1 1 2024-02-20T08:05:24.449 INFO:tasks.workunit.client.0.smithi123.stdout:6/285: chown d0/d3e/d40/d48/d4a 403567443 1 2024-02-20T08:05:24.451 INFO:tasks.workunit.client.0.smithi123.stdout:6/286: mkdir d0/d3e/d40/d48/d5d 0 2024-02-20T08:05:24.453 INFO:tasks.workunit.client.0.smithi123.stdout:6/287: creat d0/d3e/d41/d56/f5e x:0 0 0 2024-02-20T08:05:24.454 INFO:tasks.workunit.client.0.smithi123.stdout:6/288: chown d0/f51 33530260 1 2024-02-20T08:05:24.455 INFO:tasks.workunit.client.0.smithi123.stdout:6/289: unlink d0/c4d 0 2024-02-20T08:05:24.586 INFO:tasks.workunit.client.0.smithi123.stdout:3/258: sync 2024-02-20T08:05:24.586 INFO:tasks.workunit.client.0.smithi123.stdout:2/179: sync 2024-02-20T08:05:24.586 INFO:tasks.workunit.client.0.smithi123.stdout:0/210: sync 2024-02-20T08:05:24.586 INFO:tasks.workunit.client.0.smithi123.stdout:9/186: sync 2024-02-20T08:05:24.587 INFO:tasks.workunit.client.0.smithi123.stdout:2/180: chown f17 3 1 2024-02-20T08:05:24.588 INFO:tasks.workunit.client.0.smithi123.stdout:3/259: truncate d0/d6/d1a/f39 26778 0 2024-02-20T08:05:24.592 INFO:tasks.workunit.client.0.smithi123.stdout:9/187: creat d6/d2a/d27/d29/f38 x:0 0 0 2024-02-20T08:05:24.592 INFO:tasks.workunit.client.0.smithi123.stdout:0/211: write d2/de/d1e/d1f/f20 [476404,100667] 0 2024-02-20T08:05:24.592 INFO:tasks.workunit.client.0.smithi123.stdout:0/212: fsync d2/de/d1e/d1f/f29 0 2024-02-20T08:05:24.596 INFO:tasks.workunit.client.0.smithi123.stdout:3/260: rmdir d0 39 2024-02-20T08:05:24.598 INFO:tasks.workunit.client.0.smithi123.stdout:2/181: mknod d1a/d29/c36 0 2024-02-20T08:05:24.599 INFO:tasks.workunit.client.0.smithi123.stdout:0/213: dwrite d2/dd/f44 [0,4194304] 0 2024-02-20T08:05:24.604 INFO:tasks.workunit.client.0.smithi123.stdout:9/188: dread d6/fb [0,4194304] 0 2024-02-20T08:05:24.607 INFO:tasks.workunit.client.0.smithi123.stdout:9/189: fdatasync d6/f11 0 2024-02-20T08:05:24.610 INFO:tasks.workunit.client.0.smithi123.stdout:3/261: rename d0/d6/d1a/d1b/d1c/d21/c44 to d0/d6/d1a/d1b/d1c/d20/c60 0 2024-02-20T08:05:24.612 INFO:tasks.workunit.client.0.smithi123.stdout:0/214: mknod d2/c47 0 2024-02-20T08:05:24.617 INFO:tasks.workunit.client.0.smithi123.stdout:3/262: rename d0/d6/d1a/d1b/d5c to d0/d6/d1a/d1b/d1c/d61 0 2024-02-20T08:05:24.618 INFO:tasks.workunit.client.0.smithi123.stdout:9/190: symlink d6/d2a/d27/d29/d32/l39 0 2024-02-20T08:05:24.618 INFO:tasks.workunit.client.0.smithi123.stdout:3/263: fsync d0/d6/d1a/d1b/f22 0 2024-02-20T08:05:24.618 INFO:tasks.workunit.client.0.smithi123.stdout:0/215: read d2/de/f17 [389412,35866] 0 2024-02-20T08:05:24.624 INFO:tasks.workunit.client.0.smithi123.stdout:3/264: mkdir d0/d6/d1a/d62 0 2024-02-20T08:05:24.625 INFO:tasks.workunit.client.0.smithi123.stdout:3/265: dread - d0/d6/d1a/d1b/d1c/d21/f3e zero size 2024-02-20T08:05:24.625 INFO:tasks.workunit.client.0.smithi123.stdout:3/266: readlink d0/dd/d48/l59 0 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:8/262: sync 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:1/260: sync 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:6/290: sync 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:5/181: sync 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:7/187: sync 2024-02-20T08:05:24.628 INFO:tasks.workunit.client.0.smithi123.stdout:4/221: sync 2024-02-20T08:05:24.629 INFO:tasks.workunit.client.0.smithi123.stdout:8/263: stat d6/d1c/d22 0 2024-02-20T08:05:24.630 INFO:tasks.workunit.client.0.smithi123.stdout:5/182: stat d0/f16 0 2024-02-20T08:05:24.630 INFO:tasks.workunit.client.0.smithi123.stdout:9/191: link d6/d19/d1a/c23 d6/c3a 0 2024-02-20T08:05:24.631 INFO:tasks.workunit.client.0.smithi123.stdout:7/188: readlink d0/d6/d7/d22/l3e 0 2024-02-20T08:05:24.631 INFO:tasks.workunit.client.0.smithi123.stdout:4/222: chown d3/d2c/d43/d34 1677 1 2024-02-20T08:05:24.633 INFO:tasks.workunit.client.0.smithi123.stdout:7/189: dread - d0/db/f27 zero size 2024-02-20T08:05:24.633 INFO:tasks.workunit.client.0.smithi123.stdout:0/216: dread d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:24.636 INFO:tasks.workunit.client.0.smithi123.stdout:1/261: creat d3/df/f5c x:0 0 0 2024-02-20T08:05:24.638 INFO:tasks.workunit.client.0.smithi123.stdout:5/183: chown d0/l10 3 1 2024-02-20T08:05:24.639 INFO:tasks.workunit.client.0.smithi123.stdout:9/192: creat d6/d19/d1b/f3b x:0 0 0 2024-02-20T08:05:24.639 INFO:tasks.workunit.client.0.smithi123.stdout:4/223: dwrite d3/d18/f30 [0,4194304] 0 2024-02-20T08:05:24.640 INFO:tasks.workunit.client.0.smithi123.stdout:4/224: chown d3/c9 688 1 2024-02-20T08:05:24.643 INFO:tasks.workunit.client.0.smithi123.stdout:0/217: symlink d2/d3/l48 0 2024-02-20T08:05:24.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:24 smithi194 ceph-mon[37804]: pgmap v31: 65 pgs: 65 active+clean; 519 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.2 MiB/s rd, 50 MiB/s wr, 181 op/s 2024-02-20T08:05:24.646 INFO:tasks.workunit.client.0.smithi123.stdout:0/218: read d2/d3/ff [324800,107703] 0 2024-02-20T08:05:24.647 INFO:tasks.workunit.client.0.smithi123.stdout:4/225: dwrite d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:24.648 INFO:tasks.workunit.client.0.smithi123.stdout:1/262: unlink d3/de/d14/d26/d2e/l50 0 2024-02-20T08:05:24.652 INFO:tasks.workunit.client.0.smithi123.stdout:9/193: chown d6/d19/d1a/d2b/d28/c35 1696420721 1 2024-02-20T08:05:24.653 INFO:tasks.workunit.client.0.smithi123.stdout:9/194: write d6/fb [6513651,44354] 0 2024-02-20T08:05:24.659 INFO:tasks.workunit.client.0.smithi123.stdout:6/291: dread d0/f16 [0,4194304] 0 2024-02-20T08:05:24.659 INFO:tasks.workunit.client.0.smithi123.stdout:6/292: chown d0/d3e/d40/d48/d4a 58413 1 2024-02-20T08:05:24.662 INFO:tasks.workunit.client.0.smithi123.stdout:5/184: mknod d0/d34/c39 0 2024-02-20T08:05:24.663 INFO:tasks.workunit.client.0.smithi123.stdout:1/263: mkdir d3/de/d14/d26/d2e/d54/d5d 0 2024-02-20T08:05:24.664 INFO:tasks.workunit.client.0.smithi123.stdout:4/226: creat d3/d2c/d43/d26/d2e/f4a x:0 0 0 2024-02-20T08:05:24.666 INFO:tasks.workunit.client.0.smithi123.stdout:0/219: dwrite d2/dd/f31 [0,4194304] 0 2024-02-20T08:05:24.668 INFO:tasks.workunit.client.0.smithi123.stdout:9/195: mkdir d6/d2a/d27/d3c 0 2024-02-20T08:05:24.669 INFO:tasks.workunit.client.0.smithi123.stdout:7/190: creat d0/f40 x:0 0 0 2024-02-20T08:05:24.671 INFO:tasks.workunit.client.0.smithi123.stdout:7/191: write d0/f30 [811607,2659] 0 2024-02-20T08:05:24.673 INFO:tasks.workunit.client.0.smithi123.stdout:1/264: dwrite d3/de/d14/d36/f3d [0,4194304] 0 2024-02-20T08:05:24.674 INFO:tasks.workunit.client.0.smithi123.stdout:1/265: readlink d3/db/d41/l4c 0 2024-02-20T08:05:24.679 INFO:tasks.workunit.client.0.smithi123.stdout:0/220: rmdir d2/d3/d37 39 2024-02-20T08:05:24.680 INFO:tasks.workunit.client.0.smithi123.stdout:0/221: chown d2/de/d1e/f46 4014 1 2024-02-20T08:05:24.680 INFO:tasks.workunit.client.0.smithi123.stdout:6/293: mknod d0/c5f 0 2024-02-20T08:05:24.684 INFO:tasks.workunit.client.0.smithi123.stdout:4/227: symlink d3/l4b 0 2024-02-20T08:05:24.686 INFO:tasks.workunit.client.0.smithi123.stdout:0/222: write d2/dd/f2f [345580,97262] 0 2024-02-20T08:05:24.686 INFO:tasks.workunit.client.0.smithi123.stdout:0/223: chown d2/de/d19/d28 74584962 1 2024-02-20T08:05:24.688 INFO:tasks.workunit.client.0.smithi123.stdout:0/224: write d2/f42 [987002,54065] 0 2024-02-20T08:05:24.692 INFO:tasks.workunit.client.0.smithi123.stdout:4/228: unlink d3/d1e/c3c 0 2024-02-20T08:05:24.696 INFO:tasks.workunit.client.0.smithi123.stdout:0/225: symlink d2/de/d19/d28/l49 0 2024-02-20T08:05:24.698 INFO:tasks.workunit.client.0.smithi123.stdout:0/226: stat d2/de/d19/l43 0 2024-02-20T08:05:24.698 INFO:tasks.workunit.client.0.smithi123.stdout:4/229: symlink d3/d2c/d43/d26/d2e/l4c 0 2024-02-20T08:05:24.700 INFO:tasks.workunit.client.0.smithi123.stdout:6/294: dwrite d0/f28 [0,4194304] 0 2024-02-20T08:05:24.700 INFO:tasks.workunit.client.0.smithi123.stdout:4/230: write d3/d2c/f40 [929742,10711] 0 2024-02-20T08:05:24.701 INFO:tasks.workunit.client.0.smithi123.stdout:7/192: getdents d0/d6/d29 0 2024-02-20T08:05:24.702 INFO:tasks.workunit.client.0.smithi123.stdout:6/295: read d0/f16 [1142761,27240] 0 2024-02-20T08:05:24.703 INFO:tasks.workunit.client.0.smithi123.stdout:5/185: dread d0/f19 [0,4194304] 0 2024-02-20T08:05:24.704 INFO:tasks.workunit.client.0.smithi123.stdout:0/227: rename d2/de/d1e/l3b to d2/de/d1e/d1f/l4a 0 2024-02-20T08:05:24.707 INFO:tasks.workunit.client.0.smithi123.stdout:6/296: unlink d0/c5f 0 2024-02-20T08:05:24.709 INFO:tasks.workunit.client.0.smithi123.stdout:7/193: symlink d0/d6/dd/l41 0 2024-02-20T08:05:24.711 INFO:tasks.workunit.client.0.smithi123.stdout:7/194: truncate d0/d6/d7/d10/d1d/f36 310470 0 2024-02-20T08:05:24.711 INFO:tasks.workunit.client.0.smithi123.stdout:5/186: unlink d0/l22 0 2024-02-20T08:05:24.712 INFO:tasks.workunit.client.0.smithi123.stdout:5/187: dread - d0/d13/d1f/d25/f31 zero size 2024-02-20T08:05:24.717 INFO:tasks.workunit.client.0.smithi123.stdout:7/195: rename d0/d6/d7/d10 to d0/db/d21/d42 0 2024-02-20T08:05:24.718 INFO:tasks.workunit.client.0.smithi123.stdout:0/228: mknod d2/d3/c4b 0 2024-02-20T08:05:24.722 INFO:tasks.workunit.client.0.smithi123.stdout:5/188: rmdir d0/d13/d27 39 2024-02-20T08:05:24.724 INFO:tasks.workunit.client.0.smithi123.stdout:5/189: truncate d0/d13/d1f/d25/f2a 882434 0 2024-02-20T08:05:24.729 INFO:tasks.workunit.client.0.smithi123.stdout:5/190: symlink d0/d13/d1f/d25/l3a 0 2024-02-20T08:05:24.730 INFO:tasks.workunit.client.0.smithi123.stdout:7/196: creat d0/db/d38/f43 x:0 0 0 2024-02-20T08:05:24.732 INFO:tasks.workunit.client.0.smithi123.stdout:0/229: mknod d2/d3/c4c 0 2024-02-20T08:05:24.735 INFO:tasks.workunit.client.0.smithi123.stdout:7/197: dwrite d0/f30 [0,4194304] 0 2024-02-20T08:05:24.736 INFO:tasks.workunit.client.0.smithi123.stdout:5/191: rename d0/d13/d1f/f23 to d0/d13/d1f/d25/f3b 0 2024-02-20T08:05:24.737 INFO:tasks.workunit.client.0.smithi123.stdout:7/198: write d0/d6/d29/f3a [397562,120986] 0 2024-02-20T08:05:24.741 INFO:tasks.workunit.client.0.smithi123.stdout:0/230: mknod d2/de/c4d 0 2024-02-20T08:05:24.743 INFO:tasks.workunit.client.0.smithi123.stdout:7/199: rmdir d0/d6/d7/d22/d26 39 2024-02-20T08:05:24.752 INFO:tasks.workunit.client.0.smithi123.stdout:7/200: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:24.754 INFO:tasks.workunit.client.0.smithi123.stdout:2/182: write d1a/d29/f2d [2211284,115615] 0 2024-02-20T08:05:24.755 INFO:tasks.workunit.client.0.smithi123.stdout:7/201: creat d0/d6/dd/d15/f44 x:0 0 0 2024-02-20T08:05:24.755 INFO:tasks.workunit.client.0.smithi123.stdout:2/183: write d1a/f26 [77448,60549] 0 2024-02-20T08:05:24.755 INFO:tasks.workunit.client.0.smithi123.stdout:2/184: readlink l19 0 2024-02-20T08:05:24.757 INFO:tasks.workunit.client.0.smithi123.stdout:2/185: read f15 [299461,65825] 0 2024-02-20T08:05:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:24 smithi123 ceph-mon[29383]: pgmap v31: 65 pgs: 65 active+clean; 519 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.2 MiB/s rd, 50 MiB/s wr, 181 op/s 2024-02-20T08:05:24.758 INFO:tasks.workunit.client.0.smithi123.stdout:2/186: chown d1a/d29/c36 3069 1 2024-02-20T08:05:24.763 INFO:tasks.workunit.client.0.smithi123.stdout:7/202: dwrite d0/d6/d7/d22/f3b [0,4194304] 0 2024-02-20T08:05:24.767 INFO:tasks.workunit.client.0.smithi123.stdout:2/187: dwrite d1a/f32 [0,4194304] 0 2024-02-20T08:05:24.770 INFO:tasks.workunit.client.0.smithi123.stdout:2/188: chown d1a/d29/l34 2485 1 2024-02-20T08:05:24.773 INFO:tasks.workunit.client.0.smithi123.stdout:3/267: write d0/d6/d1a/d1e/f17 [3840509,55370] 0 2024-02-20T08:05:24.773 INFO:tasks.workunit.client.0.smithi123.stdout:7/203: mknod d0/d6/d7/d22/d35/c45 0 2024-02-20T08:05:24.775 INFO:tasks.workunit.client.0.smithi123.stdout:2/189: mknod d1a/d29/c37 0 2024-02-20T08:05:24.777 INFO:tasks.workunit.client.0.smithi123.stdout:7/204: creat d0/d6/d29/f46 x:0 0 0 2024-02-20T08:05:24.779 INFO:tasks.workunit.client.0.smithi123.stdout:8/264: dwrite d6/f2f [0,4194304] 0 2024-02-20T08:05:24.779 INFO:tasks.workunit.client.0.smithi123.stdout:3/268: symlink d0/d6/d1a/d62/l63 0 2024-02-20T08:05:24.785 INFO:tasks.workunit.client.0.smithi123.stdout:3/269: unlink d0/l4 0 2024-02-20T08:05:24.786 INFO:tasks.workunit.client.0.smithi123.stdout:2/190: link l16 d1a/d29/l38 0 2024-02-20T08:05:24.786 INFO:tasks.workunit.client.0.smithi123.stdout:7/205: dwrite d0/d6/dd/d15/f44 [0,4194304] 0 2024-02-20T08:05:24.787 INFO:tasks.workunit.client.0.smithi123.stdout:3/270: fsync d0/d6/d1a/f15 0 2024-02-20T08:05:24.789 INFO:tasks.workunit.client.0.smithi123.stdout:3/271: read d0/d6/d1a/f23 [2484318,54393] 0 2024-02-20T08:05:24.792 INFO:tasks.workunit.client.0.smithi123.stdout:8/265: rename d6/d1c/d22/f23 to d6/d1c/d47/f59 0 2024-02-20T08:05:24.795 INFO:tasks.workunit.client.0.smithi123.stdout:7/206: dwrite d0/d6/d7/d22/f33 [0,4194304] 0 2024-02-20T08:05:24.800 INFO:tasks.workunit.client.0.smithi123.stdout:2/191: mkdir d1a/d29/d39 0 2024-02-20T08:05:24.803 INFO:tasks.workunit.client.0.smithi123.stdout:7/207: mkdir d0/db/d38/d47 0 2024-02-20T08:05:24.805 INFO:tasks.workunit.client.0.smithi123.stdout:7/208: write d0/d6/d29/f46 [395463,59966] 0 2024-02-20T08:05:24.807 INFO:tasks.workunit.client.0.smithi123.stdout:2/192: creat d1a/d29/d39/f3a x:0 0 0 2024-02-20T08:05:24.808 INFO:tasks.workunit.client.0.smithi123.stdout:7/209: symlink d0/d6/l48 0 2024-02-20T08:05:24.809 INFO:tasks.workunit.client.0.smithi123.stdout:7/210: readlink d0/d6/dd/l41 0 2024-02-20T08:05:24.809 INFO:tasks.workunit.client.0.smithi123.stdout:1/266: truncate d3/fa 1041872 0 2024-02-20T08:05:24.810 INFO:tasks.workunit.client.0.smithi123.stdout:1/267: fsync d3/db/f4e 0 2024-02-20T08:05:24.812 INFO:tasks.workunit.client.0.smithi123.stdout:2/193: dread d1a/f32 [0,4194304] 0 2024-02-20T08:05:24.813 INFO:tasks.workunit.client.0.smithi123.stdout:3/272: getdents d0/dd 0 2024-02-20T08:05:24.815 INFO:tasks.workunit.client.0.smithi123.stdout:4/231: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:24.817 INFO:tasks.workunit.client.0.smithi123.stdout:7/211: dread d0/f4 [0,4194304] 0 2024-02-20T08:05:24.818 INFO:tasks.workunit.client.0.smithi123.stdout:7/212: read - d0/d6/f31 zero size 2024-02-20T08:05:24.819 INFO:tasks.workunit.client.0.smithi123.stdout:1/268: creat d3/db/d41/f5e x:0 0 0 2024-02-20T08:05:24.820 INFO:tasks.workunit.client.0.smithi123.stdout:2/194: dwrite d1a/f23 [0,4194304] 0 2024-02-20T08:05:24.821 INFO:tasks.workunit.client.0.smithi123.stdout:2/195: chown fc 1 1 2024-02-20T08:05:24.821 INFO:tasks.workunit.client.0.smithi123.stdout:1/269: truncate d3/db/d41/f4b 1202276 0 2024-02-20T08:05:24.822 INFO:tasks.workunit.client.0.smithi123.stdout:1/270: stat d3/fc 0 2024-02-20T08:05:24.823 INFO:tasks.workunit.client.0.smithi123.stdout:3/273: rmdir d0/d6/d1a/d1b/d57 39 2024-02-20T08:05:24.825 INFO:tasks.workunit.client.0.smithi123.stdout:5/192: getdents d0 0 2024-02-20T08:05:24.830 INFO:tasks.workunit.client.0.smithi123.stdout:6/297: write d0/f18 [675859,26530] 0 2024-02-20T08:05:24.831 INFO:tasks.workunit.client.0.smithi123.stdout:1/271: mkdir d3/de/d14/d26/d56/d5f 0 2024-02-20T08:05:24.832 INFO:tasks.workunit.client.0.smithi123.stdout:6/298: fsync d0/d3e/d41/d56/f5e 0 2024-02-20T08:05:24.833 INFO:tasks.workunit.client.0.smithi123.stdout:1/272: read - d3/df/f5c zero size 2024-02-20T08:05:24.834 INFO:tasks.workunit.client.0.smithi123.stdout:6/299: read d0/f28 [3916135,102849] 0 2024-02-20T08:05:24.836 INFO:tasks.workunit.client.0.smithi123.stdout:2/196: dwrite f10 [0,4194304] 0 2024-02-20T08:05:24.836 INFO:tasks.workunit.client.0.smithi123.stdout:5/193: unlink d0/f8 0 2024-02-20T08:05:24.840 INFO:tasks.workunit.client.0.smithi123.stdout:7/213: link d0/d6/dd/d15/f1f d0/db/d21/d42/f49 0 2024-02-20T08:05:24.844 INFO:tasks.workunit.client.0.smithi123.stdout:1/273: creat d3/de/f60 x:0 0 0 2024-02-20T08:05:24.846 INFO:tasks.workunit.client.0.smithi123.stdout:4/232: creat d3/f4d x:0 0 0 2024-02-20T08:05:24.847 INFO:tasks.workunit.client.0.smithi123.stdout:4/233: write d3/d2c/f46 [558618,127134] 0 2024-02-20T08:05:24.848 INFO:tasks.workunit.client.0.smithi123.stdout:4/234: stat d3/l7 0 2024-02-20T08:05:24.848 INFO:tasks.workunit.client.0.smithi123.stdout:6/300: chown d0/d3e/l54 2 1 2024-02-20T08:05:24.851 INFO:tasks.workunit.client.0.smithi123.stdout:5/194: readlink d0/d13/d1f/l18 0 2024-02-20T08:05:24.855 INFO:tasks.workunit.client.0.smithi123.stdout:0/231: readlink d2/de/d1e/d1f/l26 0 2024-02-20T08:05:24.859 INFO:tasks.workunit.client.0.smithi123.stdout:7/214: mkdir d0/db/d38/d47/d4a 0 2024-02-20T08:05:24.862 INFO:tasks.workunit.client.0.smithi123.stdout:3/274: getdents d0/d6/d1a 0 2024-02-20T08:05:24.865 INFO:tasks.workunit.client.0.smithi123.stdout:1/274: mknod d3/db/d34/c61 0 2024-02-20T08:05:24.869 INFO:tasks.workunit.client.0.smithi123.stdout:2/197: link d1a/c30 d1a/d29/c3b 0 2024-02-20T08:05:24.870 INFO:tasks.workunit.client.0.smithi123.stdout:2/198: stat d1a/l21 0 2024-02-20T08:05:24.872 INFO:tasks.workunit.client.0.smithi123.stdout:6/301: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:24.879 INFO:tasks.workunit.client.0.smithi123.stdout:3/275: dread d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:24.880 INFO:tasks.workunit.client.0.smithi123.stdout:7/215: dwrite d0/f4 [4194304,4194304] 0 2024-02-20T08:05:24.881 INFO:tasks.workunit.client.0.smithi123.stdout:2/199: unlink d1a/d29/c36 0 2024-02-20T08:05:24.881 INFO:tasks.workunit.client.0.smithi123.stdout:0/232: dread d2/f8 [0,4194304] 0 2024-02-20T08:05:24.883 INFO:tasks.workunit.client.0.smithi123.stdout:6/302: chown d0/l20 5837542 1 2024-02-20T08:05:24.884 INFO:tasks.workunit.client.0.smithi123.stdout:0/233: read d2/f1c [747766,113896] 0 2024-02-20T08:05:24.891 INFO:tasks.workunit.client.0.smithi123.stdout:2/200: creat d1a/d29/d39/f3c x:0 0 0 2024-02-20T08:05:24.893 INFO:tasks.workunit.client.0.smithi123.stdout:6/303: mknod d0/d38/c60 0 2024-02-20T08:05:24.894 INFO:tasks.workunit.client.0.smithi123.stdout:5/195: link d0/d13/d1f/d25/l3a d0/d13/d27/d37/l3c 0 2024-02-20T08:05:24.895 INFO:tasks.workunit.client.0.smithi123.stdout:4/235: getdents d3/d2c/d43/d26/d3e 0 2024-02-20T08:05:24.896 INFO:tasks.workunit.client.0.smithi123.stdout:7/216: mkdir d0/db/d21/d42/d1d/d2a/d4b 0 2024-02-20T08:05:24.897 INFO:tasks.workunit.client.0.smithi123.stdout:2/201: mknod d1a/d29/c3d 0 2024-02-20T08:05:24.898 INFO:tasks.workunit.client.0.smithi123.stdout:2/202: write f17 [3756336,47470] 0 2024-02-20T08:05:24.900 INFO:tasks.workunit.client.0.smithi123.stdout:7/217: dread d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:24.901 INFO:tasks.workunit.client.0.smithi123.stdout:7/218: chown d0/db/d21/d42/d1d/c39 112 1 2024-02-20T08:05:24.902 INFO:tasks.workunit.client.0.smithi123.stdout:5/196: stat d0/l10 0 2024-02-20T08:05:24.902 INFO:tasks.workunit.client.0.smithi123.stdout:4/236: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:24.906 INFO:tasks.workunit.client.0.smithi123.stdout:7/219: creat d0/db/d38/f4c x:0 0 0 2024-02-20T08:05:24.908 INFO:tasks.workunit.client.0.smithi123.stdout:9/196: sync 2024-02-20T08:05:24.908 INFO:tasks.workunit.client.0.smithi123.stdout:8/266: sync 2024-02-20T08:05:24.910 INFO:tasks.workunit.client.0.smithi123.stdout:0/234: link d2/l21 d2/dd/l4e 0 2024-02-20T08:05:24.910 INFO:tasks.workunit.client.0.smithi123.stdout:9/197: write d6/f11 [4162263,16131] 0 2024-02-20T08:05:24.911 INFO:tasks.workunit.client.0.smithi123.stdout:7/220: symlink d0/db/d21/d42/l4d 0 2024-02-20T08:05:24.913 INFO:tasks.workunit.client.0.smithi123.stdout:9/198: chown d6/d19/d1a/d2b/d28 29 1 2024-02-20T08:05:24.915 INFO:tasks.workunit.client.0.smithi123.stdout:4/237: rename d3/l4 to d3/d2c/d43/d26/d3e/l4e 0 2024-02-20T08:05:24.915 INFO:tasks.workunit.client.0.smithi123.stdout:5/197: dwrite d0/d13/f2f [0,4194304] 0 2024-02-20T08:05:24.916 INFO:tasks.workunit.client.0.smithi123.stdout:8/267: mknod d6/d1c/d22/d4f/c5a 0 2024-02-20T08:05:24.916 INFO:tasks.workunit.client.0.smithi123.stdout:4/238: fsync d3/f2a 0 2024-02-20T08:05:24.917 INFO:tasks.workunit.client.0.smithi123.stdout:4/239: fdatasync d3/f4d 0 2024-02-20T08:05:24.919 INFO:tasks.workunit.client.0.smithi123.stdout:0/235: dread - d2/de/d19/d28/f2e zero size 2024-02-20T08:05:24.920 INFO:tasks.workunit.client.0.smithi123.stdout:2/203: link d1a/d29/c3b d1a/c3e 0 2024-02-20T08:05:24.921 INFO:tasks.workunit.client.0.smithi123.stdout:2/204: readlink l13 0 2024-02-20T08:05:24.923 INFO:tasks.workunit.client.0.smithi123.stdout:0/236: truncate d2/f6 1145872 0 2024-02-20T08:05:24.927 INFO:tasks.workunit.client.0.smithi123.stdout:8/268: dread d6/f1b [0,4194304] 0 2024-02-20T08:05:24.928 INFO:tasks.workunit.client.0.smithi123.stdout:9/199: dwrite d6/d19/d1a/d2b/d28/f2e [0,4194304] 0 2024-02-20T08:05:24.930 INFO:tasks.workunit.client.0.smithi123.stdout:4/240: dread d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:24.930 INFO:tasks.workunit.client.0.smithi123.stdout:9/200: read d6/d19/d1a/d2b/d28/f2e [1545863,95932] 0 2024-02-20T08:05:24.934 INFO:tasks.workunit.client.0.smithi123.stdout:2/205: chown d1a/c20 195749 1 2024-02-20T08:05:24.937 INFO:tasks.workunit.client.0.smithi123.stdout:0/237: chown d2/de/d1e/d1f/l4a 4346 1 2024-02-20T08:05:24.940 INFO:tasks.workunit.client.0.smithi123.stdout:4/241: dwrite d3/d18/f23 [0,4194304] 0 2024-02-20T08:05:24.942 INFO:tasks.workunit.client.0.smithi123.stdout:4/242: dread - d3/d2c/f45 zero size 2024-02-20T08:05:24.948 INFO:tasks.workunit.client.0.smithi123.stdout:9/201: rmdir d6/d19/d1a/d2b 39 2024-02-20T08:05:24.948 INFO:tasks.workunit.client.0.smithi123.stdout:5/198: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:24.948 INFO:tasks.workunit.client.0.smithi123.stdout:6/304: dread d0/f30 [0,4194304] 0 2024-02-20T08:05:24.950 INFO:tasks.workunit.client.0.smithi123.stdout:5/199: truncate d0/d13/f1e 420432 0 2024-02-20T08:05:24.956 INFO:tasks.workunit.client.0.smithi123.stdout:4/243: creat d3/d2c/d43/d34/f4f x:0 0 0 2024-02-20T08:05:24.956 INFO:tasks.workunit.client.0.smithi123.stdout:1/275: write d3/df/f1a [4241082,53098] 0 2024-02-20T08:05:24.963 INFO:tasks.workunit.client.0.smithi123.stdout:0/238: mkdir d2/dd/d4f 0 2024-02-20T08:05:24.963 INFO:tasks.workunit.client.0.smithi123.stdout:9/202: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:24.965 INFO:tasks.workunit.client.0.smithi123.stdout:2/206: rmdir d1a/d29/d39 39 2024-02-20T08:05:24.966 INFO:tasks.workunit.client.0.smithi123.stdout:2/207: write f5 [3651631,64887] 0 2024-02-20T08:05:24.967 INFO:tasks.workunit.client.0.smithi123.stdout:2/208: dread - d1a/f27 zero size 2024-02-20T08:05:24.974 INFO:tasks.workunit.client.0.smithi123.stdout:6/305: symlink d0/d5c/l61 0 2024-02-20T08:05:24.975 INFO:tasks.workunit.client.0.smithi123.stdout:3/276: truncate d0/d6/f1f 4036733 0 2024-02-20T08:05:24.975 INFO:tasks.workunit.client.0.smithi123.stdout:5/200: rmdir d0/d34 39 2024-02-20T08:05:24.983 INFO:tasks.workunit.client.0.smithi123.stdout:3/277: mkdir d0/d6/d1a/d1b/d1c/d21/d64 0 2024-02-20T08:05:24.985 INFO:tasks.workunit.client.0.smithi123.stdout:1/276: creat d3/f62 x:0 0 0 2024-02-20T08:05:24.988 INFO:tasks.workunit.client.0.smithi123.stdout:4/244: rename d3/d1e/f2b to d3/d2c/d43/f50 0 2024-02-20T08:05:24.989 INFO:tasks.workunit.client.0.smithi123.stdout:6/306: creat d0/d3e/d40/d48/d5d/f62 x:0 0 0 2024-02-20T08:05:24.990 INFO:tasks.workunit.client.0.smithi123.stdout:4/245: truncate d3/d2c/d43/d26/d2e/f4a 176279 0 2024-02-20T08:05:24.995 INFO:tasks.workunit.client.0.smithi123.stdout:6/307: mkdir d0/d38/d63 0 2024-02-20T08:05:24.998 INFO:tasks.workunit.client.0.smithi123.stdout:4/246: rename d3/d2c/f46 to d3/d18/f51 0 2024-02-20T08:05:24.999 INFO:tasks.workunit.client.0.smithi123.stdout:5/201: creat d0/f3d x:0 0 0 2024-02-20T08:05:25.000 INFO:tasks.workunit.client.0.smithi123.stdout:5/202: read d0/d13/d1f/d25/f2a [755464,34308] 0 2024-02-20T08:05:25.003 INFO:tasks.workunit.client.0.smithi123.stdout:2/209: getdents d1a/d29 0 2024-02-20T08:05:25.004 INFO:tasks.workunit.client.0.smithi123.stdout:8/269: write d6/fd [750520,74151] 0 2024-02-20T08:05:25.004 INFO:tasks.workunit.client.0.smithi123.stdout:2/210: chown d1a/d29/d39/f3a 220798024 1 2024-02-20T08:05:25.005 INFO:tasks.workunit.client.0.smithi123.stdout:4/247: dwrite d3/d1e/f2d [0,4194304] 0 2024-02-20T08:05:25.006 INFO:tasks.workunit.client.0.smithi123.stdout:8/270: truncate d6/fa 5262078 0 2024-02-20T08:05:25.007 INFO:tasks.workunit.client.0.smithi123.stdout:4/248: readlink d3/l15 0 2024-02-20T08:05:25.010 INFO:tasks.workunit.client.0.smithi123.stdout:5/203: mkdir d0/d13/d1f/d3e 0 2024-02-20T08:05:25.012 INFO:tasks.workunit.client.0.smithi123.stdout:6/308: dwrite d0/f31 [0,4194304] 0 2024-02-20T08:05:25.014 INFO:tasks.workunit.client.0.smithi123.stdout:2/211: readlink d1a/d29/l38 0 2024-02-20T08:05:25.022 INFO:tasks.workunit.client.0.smithi123.stdout:8/271: mkdir d6/d1c/d22/d4f/d5b 0 2024-02-20T08:05:25.024 INFO:tasks.workunit.client.0.smithi123.stdout:3/278: unlink d0/d6/f1f 0 2024-02-20T08:05:25.025 INFO:tasks.workunit.client.0.smithi123.stdout:0/239: write d2/d3/ff [1177453,65674] 0 2024-02-20T08:05:25.030 INFO:tasks.workunit.client.0.smithi123.stdout:4/249: rmdir d3/d2c/d43 39 2024-02-20T08:05:25.031 INFO:tasks.workunit.client.0.smithi123.stdout:4/250: chown d3/cb 0 1 2024-02-20T08:05:25.032 INFO:tasks.workunit.client.0.smithi123.stdout:3/279: creat d0/d6/d1a/d1b/d1c/f65 x:0 0 0 2024-02-20T08:05:25.036 INFO:tasks.workunit.client.0.smithi123.stdout:5/204: link d0/d13/d1f/d25/f2a d0/d13/d1f/d3e/f3f 0 2024-02-20T08:05:25.038 INFO:tasks.workunit.client.0.smithi123.stdout:2/212: mknod d1a/c3f 0 2024-02-20T08:05:25.050 INFO:tasks.workunit.client.0.smithi123.stdout:3/280: dread d0/d6/d1a/d1b/d2a/f3a [0,4194304] 0 2024-02-20T08:05:25.054 INFO:tasks.workunit.client.0.smithi123.stdout:0/240: creat d2/dd/f50 x:0 0 0 2024-02-20T08:05:25.055 INFO:tasks.workunit.client.0.smithi123.stdout:2/213: dread fc [0,4194304] 0 2024-02-20T08:05:25.059 INFO:tasks.workunit.client.0.smithi123.stdout:3/281: symlink d0/d6/d1a/d1b/d1c/d61/l66 0 2024-02-20T08:05:25.062 INFO:tasks.workunit.client.0.smithi123.stdout:2/214: mknod d1a/d29/d39/c40 0 2024-02-20T08:05:25.063 INFO:tasks.workunit.client.0.smithi123.stdout:8/272: truncate d6/d1c/d29/f38 3897976 0 2024-02-20T08:05:25.063 INFO:tasks.workunit.client.0.smithi123.stdout:2/215: write d1a/d29/d39/f3c [498058,87134] 0 2024-02-20T08:05:25.064 INFO:tasks.workunit.client.0.smithi123.stdout:8/273: chown d6/fd 6725 1 2024-02-20T08:05:25.065 INFO:tasks.workunit.client.0.smithi123.stdout:3/282: chown d0/c5 1600427 1 2024-02-20T08:05:25.066 INFO:tasks.workunit.client.0.smithi123.stdout:6/309: truncate d0/f1e 174094 0 2024-02-20T08:05:25.068 INFO:tasks.workunit.client.0.smithi123.stdout:5/205: rename d0/c32 to d0/d13/c40 0 2024-02-20T08:05:25.071 INFO:tasks.workunit.client.0.smithi123.stdout:8/274: read d6/fc [360590,25220] 0 2024-02-20T08:05:25.071 INFO:tasks.workunit.client.0.smithi123.stdout:4/251: write d3/d2c/d43/d34/f3b [204599,27602] 0 2024-02-20T08:05:25.072 INFO:tasks.workunit.client.0.smithi123.stdout:8/275: chown d6/d1c/d29 0 1 2024-02-20T08:05:25.072 INFO:tasks.workunit.client.0.smithi123.stdout:6/310: rmdir d0/d3e 39 2024-02-20T08:05:25.076 INFO:tasks.workunit.client.0.smithi123.stdout:3/283: symlink d0/d6/d1a/d1b/d1c/d21/d5e/l67 0 2024-02-20T08:05:25.077 INFO:tasks.workunit.client.0.smithi123.stdout:4/252: creat d3/d2c/d43/d26/d2e/f52 x:0 0 0 2024-02-20T08:05:25.077 INFO:tasks.workunit.client.0.smithi123.stdout:5/206: rmdir d0/d34 39 2024-02-20T08:05:25.081 INFO:tasks.workunit.client.0.smithi123.stdout:6/311: dwrite d0/d38/f3a [0,4194304] 0 2024-02-20T08:05:25.081 INFO:tasks.workunit.client.0.smithi123.stdout:2/216: creat d1a/f41 x:0 0 0 2024-02-20T08:05:25.083 INFO:tasks.workunit.client.0.smithi123.stdout:6/312: write d0/f18 [497088,104872] 0 2024-02-20T08:05:25.085 INFO:tasks.workunit.client.0.smithi123.stdout:5/207: chown d0/ca 2026 1 2024-02-20T08:05:25.087 INFO:tasks.workunit.client.0.smithi123.stdout:3/284: dwrite d0/d6/f14 [0,4194304] 0 2024-02-20T08:05:25.088 INFO:tasks.workunit.client.0.smithi123.stdout:0/241: rename d2/de/d19/d28/f33 to d2/de/f51 0 2024-02-20T08:05:25.105 INFO:tasks.workunit.client.0.smithi123.stdout:2/217: dread fc [8388608,4194304] 0 2024-02-20T08:05:25.107 INFO:tasks.workunit.client.0.smithi123.stdout:8/276: getdents d6/d1c/d29/d3f 0 2024-02-20T08:05:25.110 INFO:tasks.workunit.client.0.smithi123.stdout:5/208: creat d0/d13/d1f/d3e/f41 x:0 0 0 2024-02-20T08:05:25.113 INFO:tasks.workunit.client.0.smithi123.stdout:8/277: dwrite d6/d1c/d22/d4f/f56 [0,4194304] 0 2024-02-20T08:05:25.115 INFO:tasks.workunit.client.0.smithi123.stdout:0/242: symlink d2/d3/d37/l52 0 2024-02-20T08:05:25.116 INFO:tasks.workunit.client.0.smithi123.stdout:6/313: write d0/d38/f3b [2670391,83926] 0 2024-02-20T08:05:25.117 INFO:tasks.workunit.client.0.smithi123.stdout:2/218: mkdir d1a/d29/d42 0 2024-02-20T08:05:25.120 INFO:tasks.workunit.client.0.smithi123.stdout:5/209: mkdir d0/d13/d1f/d25/d42 0 2024-02-20T08:05:25.122 INFO:tasks.workunit.client.0.smithi123.stdout:4/253: rename d3/d2c/d43/d26/d2e/f4a to d3/d2c/f53 0 2024-02-20T08:05:25.123 INFO:tasks.workunit.client.0.smithi123.stdout:4/254: write d3/d2c/d43/d26/f29 [4106688,54218] 0 2024-02-20T08:05:25.129 INFO:tasks.workunit.client.0.smithi123.stdout:8/278: dwrite d6/f20 [0,4194304] 0 2024-02-20T08:05:25.130 INFO:tasks.workunit.client.0.smithi123.stdout:0/243: write d2/de/d19/f45 [665700,18821] 0 2024-02-20T08:05:25.134 INFO:tasks.workunit.client.0.smithi123.stdout:2/219: mknod d1a/d29/c43 0 2024-02-20T08:05:25.137 INFO:tasks.workunit.client.0.smithi123.stdout:6/314: dwrite d0/f29 [4194304,4194304] 0 2024-02-20T08:05:25.160 INFO:tasks.workunit.client.0.smithi123.stdout:2/220: creat d1a/d29/f44 x:0 0 0 2024-02-20T08:05:25.161 INFO:tasks.workunit.client.0.smithi123.stdout:6/315: dwrite d0/fe [0,4194304] 0 2024-02-20T08:05:25.165 INFO:tasks.workunit.client.0.smithi123.stdout:8/279: dwrite d6/f3b [0,4194304] 0 2024-02-20T08:05:25.166 INFO:tasks.workunit.client.0.smithi123.stdout:8/280: stat d6/d1c/d2c 0 2024-02-20T08:05:25.167 INFO:tasks.workunit.client.0.smithi123.stdout:5/210: mkdir d0/d13/d1f/d25/d42/d43 0 2024-02-20T08:05:25.172 INFO:tasks.workunit.client.0.smithi123.stdout:0/244: mknod d2/de/d1e/d1f/c53 0 2024-02-20T08:05:25.180 INFO:tasks.workunit.client.0.smithi123.stdout:5/211: mknod d0/d13/d1f/d25/d42/c44 0 2024-02-20T08:05:25.182 INFO:tasks.workunit.client.0.smithi123.stdout:4/255: creat d3/d2c/f54 x:0 0 0 2024-02-20T08:05:25.186 INFO:tasks.workunit.client.0.smithi123.stdout:2/221: link d1a/f27 d1a/d29/d42/f45 0 2024-02-20T08:05:25.187 INFO:tasks.workunit.client.0.smithi123.stdout:6/316: creat d0/d3e/d41/d56/f64 x:0 0 0 2024-02-20T08:05:25.189 INFO:tasks.workunit.client.0.smithi123.stdout:8/281: mknod d6/d32/c5c 0 2024-02-20T08:05:25.192 INFO:tasks.workunit.client.0.smithi123.stdout:4/256: creat d3/d2c/d43/d34/f55 x:0 0 0 2024-02-20T08:05:25.192 INFO:tasks.workunit.client.0.smithi123.stdout:4/257: chown d3/c5 30 1 2024-02-20T08:05:25.193 INFO:tasks.workunit.client.0.smithi123.stdout:4/258: write d3/d2c/f45 [542654,22626] 0 2024-02-20T08:05:25.204 INFO:tasks.workunit.client.0.smithi123.stdout:0/245: dwrite d2/f8 [0,4194304] 0 2024-02-20T08:05:25.205 INFO:tasks.workunit.client.0.smithi123.stdout:0/246: chown d2/d3/l2d 58271211 1 2024-02-20T08:05:25.207 INFO:tasks.workunit.client.0.smithi123.stdout:0/247: write d2/f1c [988684,130605] 0 2024-02-20T08:05:25.208 INFO:tasks.workunit.client.0.smithi123.stdout:0/248: chown d2/dd/d4f 7678 1 2024-02-20T08:05:25.209 INFO:tasks.workunit.client.0.smithi123.stdout:0/249: write d2/d3/ff [1109495,91685] 0 2024-02-20T08:05:25.212 INFO:tasks.workunit.client.0.smithi123.stdout:8/282: dread d6/fb [0,4194304] 0 2024-02-20T08:05:25.214 INFO:tasks.workunit.client.0.smithi123.stdout:6/317: rmdir d0/d38/d63 0 2024-02-20T08:05:25.217 INFO:tasks.workunit.client.0.smithi123.stdout:5/212: truncate d0/d13/d1f/d25/f2d 15730 0 2024-02-20T08:05:25.219 INFO:tasks.workunit.client.0.smithi123.stdout:2/222: getdents d1a/d29/d42 0 2024-02-20T08:05:25.220 INFO:tasks.workunit.client.0.smithi123.stdout:6/318: stat d0/l1f 0 2024-02-20T08:05:25.223 INFO:tasks.workunit.client.0.smithi123.stdout:4/259: getdents d3 0 2024-02-20T08:05:25.225 INFO:tasks.workunit.client.0.smithi123.stdout:5/213: fdatasync d0/f30 0 2024-02-20T08:05:25.228 INFO:tasks.workunit.client.0.smithi123.stdout:0/250: mkdir d2/d54 0 2024-02-20T08:05:25.228 INFO:tasks.workunit.client.0.smithi123.stdout:0/251: chown d2/de/d19/l43 701 1 2024-02-20T08:05:25.230 INFO:tasks.workunit.client.0.smithi123.stdout:2/223: symlink d1a/d29/d39/l46 0 2024-02-20T08:05:25.230 INFO:tasks.workunit.client.0.smithi123.stdout:2/224: dread - d1a/f27 zero size 2024-02-20T08:05:25.231 INFO:tasks.workunit.client.0.smithi123.stdout:2/225: chown f10 12270 1 2024-02-20T08:05:25.231 INFO:tasks.workunit.client.0.smithi123.stdout:2/226: chown d1a/d29/f35 185 1 2024-02-20T08:05:25.236 INFO:tasks.workunit.client.0.smithi123.stdout:0/252: mknod d2/d3/d37/c55 0 2024-02-20T08:05:25.238 INFO:tasks.workunit.client.0.smithi123.stdout:0/253: read d2/de/f51 [4538677,50501] 0 2024-02-20T08:05:25.239 INFO:tasks.workunit.client.0.smithi123.stdout:0/254: truncate d2/de/d1e/d1f/f20 1206146 0 2024-02-20T08:05:25.240 INFO:tasks.workunit.client.0.smithi123.stdout:2/227: write d1a/f1f [3507128,25911] 0 2024-02-20T08:05:25.240 INFO:tasks.workunit.client.0.smithi123.stdout:0/255: readlink d2/de/d19/l43 0 2024-02-20T08:05:25.241 INFO:tasks.workunit.client.0.smithi123.stdout:2/228: fsync d1a/d29/f44 0 2024-02-20T08:05:25.242 INFO:tasks.workunit.client.0.smithi123.stdout:0/256: chown d2/de/d1e/f35 2996752 1 2024-02-20T08:05:25.243 INFO:tasks.workunit.client.0.smithi123.stdout:4/260: symlink d3/d2c/l56 0 2024-02-20T08:05:25.247 INFO:tasks.workunit.client.0.smithi123.stdout:0/257: dwrite d2/f8 [4194304,4194304] 0 2024-02-20T08:05:25.253 INFO:tasks.workunit.client.0.smithi123.stdout:6/319: dread d0/f14 [8388608,4194304] 0 2024-02-20T08:05:25.254 INFO:tasks.workunit.client.0.smithi123.stdout:4/261: rmdir d3/d2c/d43/d26/d3e 39 2024-02-20T08:05:25.261 INFO:tasks.workunit.client.0.smithi123.stdout:6/320: mknod d0/d3e/d41/d56/c65 0 2024-02-20T08:05:25.261 INFO:tasks.workunit.client.0.smithi123.stdout:6/321: chown d0/d3e/d40 33140885 1 2024-02-20T08:05:25.264 INFO:tasks.workunit.client.0.smithi123.stdout:5/214: getdents d0/d13/d1f/d3e 0 2024-02-20T08:05:25.264 INFO:tasks.workunit.client.0.smithi123.stdout:5/215: dread - d0/f3d zero size 2024-02-20T08:05:25.268 INFO:tasks.workunit.client.0.smithi123.stdout:6/322: mknod d0/d38/c66 0 2024-02-20T08:05:25.269 INFO:tasks.workunit.client.0.smithi123.stdout:0/258: dread d2/de/d1e/f22 [0,4194304] 0 2024-02-20T08:05:25.269 INFO:tasks.workunit.client.0.smithi123.stdout:0/259: chown d2/de/d1e/d1f/f20 34533186 1 2024-02-20T08:05:25.270 INFO:tasks.workunit.client.0.smithi123.stdout:4/262: symlink d3/d2c/d43/l57 0 2024-02-20T08:05:25.271 INFO:tasks.workunit.client.0.smithi123.stdout:4/263: fsync d3/d18/f19 0 2024-02-20T08:05:25.271 INFO:tasks.workunit.client.0.smithi123.stdout:4/264: readlink d3/l15 0 2024-02-20T08:05:25.275 INFO:tasks.workunit.client.0.smithi123.stdout:5/216: creat d0/d13/d1f/d25/d42/f45 x:0 0 0 2024-02-20T08:05:25.276 INFO:tasks.workunit.client.0.smithi123.stdout:2/229: dwrite f15 [0,4194304] 0 2024-02-20T08:05:25.276 INFO:tasks.workunit.client.0.smithi123.stdout:5/217: fdatasync d0/d13/d1f/d25/d42/f45 0 2024-02-20T08:05:25.279 INFO:tasks.workunit.client.0.smithi123.stdout:0/260: creat d2/de/d19/f56 x:0 0 0 2024-02-20T08:05:25.281 INFO:tasks.workunit.client.0.smithi123.stdout:4/265: creat d3/d2c/d43/d34/f58 x:0 0 0 2024-02-20T08:05:25.285 INFO:tasks.workunit.client.0.smithi123.stdout:6/323: creat d0/d3e/d41/d56/d57/f67 x:0 0 0 2024-02-20T08:05:25.288 INFO:tasks.workunit.client.0.smithi123.stdout:2/230: symlink d1a/d29/d42/l47 0 2024-02-20T08:05:25.290 INFO:tasks.workunit.client.0.smithi123.stdout:4/266: dwrite d3/d1e/f2d [4194304,4194304] 0 2024-02-20T08:05:25.290 INFO:tasks.workunit.client.0.smithi123.stdout:0/261: mknod d2/de/d1e/c57 0 2024-02-20T08:05:25.291 INFO:tasks.workunit.client.0.smithi123.stdout:0/262: write d2/d3/f9 [3373278,43028] 0 2024-02-20T08:05:25.295 INFO:tasks.workunit.client.0.smithi123.stdout:5/218: symlink d0/d34/l46 0 2024-02-20T08:05:25.297 INFO:tasks.workunit.client.0.smithi123.stdout:2/231: stat d1a/c3e 0 2024-02-20T08:05:25.299 INFO:tasks.workunit.client.0.smithi123.stdout:4/267: creat d3/d1e/f59 x:0 0 0 2024-02-20T08:05:25.300 INFO:tasks.workunit.client.0.smithi123.stdout:6/324: symlink d0/d3e/d40/l68 0 2024-02-20T08:05:25.302 INFO:tasks.workunit.client.0.smithi123.stdout:2/232: fsync d1a/f32 0 2024-02-20T08:05:25.304 INFO:tasks.workunit.client.0.smithi123.stdout:0/263: read d2/f6 [362908,53747] 0 2024-02-20T08:05:25.334 INFO:tasks.workunit.client.0.smithi123.stdout:4/268: mkdir d3/d2c/d5a 0 2024-02-20T08:05:25.338 INFO:tasks.workunit.client.0.smithi123.stdout:6/325: dwrite d0/f2c [0,4194304] 0 2024-02-20T08:05:25.339 INFO:tasks.workunit.client.0.smithi123.stdout:6/326: dread - d0/d38/f55 zero size 2024-02-20T08:05:25.340 INFO:tasks.workunit.client.0.smithi123.stdout:0/264: dwrite d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:25.343 INFO:tasks.workunit.client.0.smithi123.stdout:2/233: truncate d1a/f1d 3569691 0 2024-02-20T08:05:25.343 INFO:tasks.workunit.client.0.smithi123.stdout:5/219: link d0/d13/d1f/d25/l3a d0/d13/d1f/d3e/l47 0 2024-02-20T08:05:25.344 INFO:tasks.workunit.client.0.smithi123.stdout:2/234: chown d1a/f26 31700246 1 2024-02-20T08:05:25.345 INFO:tasks.workunit.client.0.smithi123.stdout:2/235: write d1a/f1f [4409156,92620] 0 2024-02-20T08:05:25.345 INFO:tasks.workunit.client.0.smithi123.stdout:4/269: creat d3/d1e/f5b x:0 0 0 2024-02-20T08:05:25.347 INFO:tasks.workunit.client.0.smithi123.stdout:6/327: rmdir d0/d5c 39 2024-02-20T08:05:25.349 INFO:tasks.workunit.client.0.smithi123.stdout:2/236: dread f15 [0,4194304] 0 2024-02-20T08:05:25.350 INFO:tasks.workunit.client.0.smithi123.stdout:2/237: chown d1a/d29/f44 22534597 1 2024-02-20T08:05:25.350 INFO:tasks.workunit.client.0.smithi123.stdout:5/220: mkdir d0/d34/d48 0 2024-02-20T08:05:25.355 INFO:tasks.workunit.client.0.smithi123.stdout:4/270: rmdir d3/d18 39 2024-02-20T08:05:25.364 INFO:tasks.workunit.client.0.smithi123.stdout:5/221: unlink d0/lf 0 2024-02-20T08:05:25.366 INFO:tasks.workunit.client.0.smithi123.stdout:6/328: creat d0/f69 x:0 0 0 2024-02-20T08:05:25.366 INFO:tasks.workunit.client.0.smithi123.stdout:5/222: dread d0/d13/d1f/d3e/f3f [0,4194304] 0 2024-02-20T08:05:25.367 INFO:tasks.workunit.client.0.smithi123.stdout:4/271: write d3/d18/f32 [824878,59186] 0 2024-02-20T08:05:25.368 INFO:tasks.workunit.client.0.smithi123.stdout:5/223: fsync d0/d13/d1f/d3e/f41 0 2024-02-20T08:05:25.371 INFO:tasks.workunit.client.0.smithi123.stdout:5/224: rmdir d0/d13/d1f/d25 39 2024-02-20T08:05:25.372 INFO:tasks.workunit.client.0.smithi123.stdout:5/225: chown d0/d34/l46 0 1 2024-02-20T08:05:25.379 INFO:tasks.workunit.client.0.smithi123.stdout:6/329: rename d0/d38/c66 to d0/d3e/d40/c6a 0 2024-02-20T08:05:25.381 INFO:tasks.workunit.client.0.smithi123.stdout:5/226: symlink d0/d13/d1f/d25/d42/l49 0 2024-02-20T08:05:25.382 INFO:tasks.workunit.client.0.smithi123.stdout:2/238: dread d1a/f2f [0,4194304] 0 2024-02-20T08:05:25.382 INFO:tasks.workunit.client.0.smithi123.stdout:0/265: truncate d2/f15 5379362 0 2024-02-20T08:05:25.384 INFO:tasks.workunit.client.0.smithi123.stdout:6/330: read d0/f1e [24825,18183] 0 2024-02-20T08:05:25.386 INFO:tasks.workunit.client.0.smithi123.stdout:4/272: rename d3/d2c/d43/d34/l47 to d3/d2c/d5a/l5c 0 2024-02-20T08:05:25.390 INFO:tasks.workunit.client.0.smithi123.stdout:2/239: mknod d1a/d29/c48 0 2024-02-20T08:05:25.391 INFO:tasks.workunit.client.0.smithi123.stdout:0/266: creat d2/de/d19/f58 x:0 0 0 2024-02-20T08:05:25.393 INFO:tasks.workunit.client.0.smithi123.stdout:6/331: creat d0/d3e/d41/d56/d57/f6b x:0 0 0 2024-02-20T08:05:25.393 INFO:tasks.workunit.client.0.smithi123.stdout:5/227: getdents d0/d34/d48 0 2024-02-20T08:05:25.394 INFO:tasks.workunit.client.0.smithi123.stdout:2/240: rmdir d1a/d29/d42 39 2024-02-20T08:05:25.395 INFO:tasks.workunit.client.0.smithi123.stdout:0/267: readlink d2/dd/l1d 0 2024-02-20T08:05:25.396 INFO:tasks.workunit.client.0.smithi123.stdout:0/268: write d2/de/d1e/d1f/f20 [715411,48135] 0 2024-02-20T08:05:25.400 INFO:tasks.workunit.client.0.smithi123.stdout:5/228: symlink d0/d13/d27/l4a 0 2024-02-20T08:05:25.407 INFO:tasks.workunit.client.0.smithi123.stdout:2/241: rmdir d1a/d29 39 2024-02-20T08:05:25.412 INFO:tasks.workunit.client.0.smithi123.stdout:5/229: mkdir d0/d34/d48/d4b 0 2024-02-20T08:05:25.414 INFO:tasks.workunit.client.0.smithi123.stdout:2/242: creat d1a/d29/d42/f49 x:0 0 0 2024-02-20T08:05:25.415 INFO:tasks.workunit.client.0.smithi123.stdout:6/332: write d0/f21 [1163558,80374] 0 2024-02-20T08:05:25.416 INFO:tasks.workunit.client.0.smithi123.stdout:2/243: stat f10 0 2024-02-20T08:05:25.416 INFO:tasks.workunit.client.0.smithi123.stdout:0/269: dread d2/f1b [0,4194304] 0 2024-02-20T08:05:25.417 INFO:tasks.workunit.client.0.smithi123.stdout:5/230: dwrite d0/d13/d1f/f1a [0,4194304] 0 2024-02-20T08:05:25.418 INFO:tasks.workunit.client.0.smithi123.stdout:6/333: fdatasync d0/f51 0 2024-02-20T08:05:25.418 INFO:tasks.workunit.client.0.smithi123.stdout:5/231: chown d0 4928485 1 2024-02-20T08:05:25.421 INFO:tasks.workunit.client.0.smithi123.stdout:0/270: read - d2/de/d19/d28/f2e zero size 2024-02-20T08:05:25.422 INFO:tasks.workunit.client.0.smithi123.stdout:2/244: write fc [2830579,7883] 0 2024-02-20T08:05:25.423 INFO:tasks.workunit.client.0.smithi123.stdout:4/273: dwrite d3/f28 [0,4194304] 0 2024-02-20T08:05:25.425 INFO:tasks.workunit.client.0.smithi123.stdout:2/245: read - d1a/d29/f44 zero size 2024-02-20T08:05:25.431 INFO:tasks.workunit.client.0.smithi123.stdout:6/334: symlink d0/d3e/d40/d48/d4a/l6c 0 2024-02-20T08:05:25.433 INFO:tasks.workunit.client.0.smithi123.stdout:2/246: dwrite f10 [0,4194304] 0 2024-02-20T08:05:25.434 INFO:tasks.workunit.client.0.smithi123.stdout:4/274: chown d3/d2c/d43/d34/l3d 1 1 2024-02-20T08:05:25.435 INFO:tasks.workunit.client.0.smithi123.stdout:4/275: write d3/d2c/d43/d34/f55 [970812,38677] 0 2024-02-20T08:05:25.435 INFO:tasks.workunit.client.0.smithi123.stdout:0/271: rename d2/de/d19/d28/l3a to d2/d3/d37/l59 0 2024-02-20T08:05:25.438 INFO:tasks.workunit.client.0.smithi123.stdout:0/272: write d2/de/d1e/d1f/f29 [3528462,101763] 0 2024-02-20T08:05:25.439 INFO:tasks.workunit.client.0.smithi123.stdout:7/221: sync 2024-02-20T08:05:25.439 INFO:tasks.workunit.client.0.smithi123.stdout:9/203: sync 2024-02-20T08:05:25.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/247: rename d1a/d29/d39/f3c to d1a/d29/d42/f4a 0 2024-02-20T08:05:25.443 INFO:tasks.workunit.client.0.smithi123.stdout:6/335: symlink d0/d3e/d40/l6d 0 2024-02-20T08:05:25.444 INFO:tasks.workunit.client.0.smithi123.stdout:2/248: chown d1a/f28 16377232 1 2024-02-20T08:05:25.448 INFO:tasks.workunit.client.0.smithi123.stdout:9/204: rename d6/d2a/d27/d29 to d6/d19/d1b/d3d 0 2024-02-20T08:05:25.451 INFO:tasks.workunit.client.0.smithi123.stdout:6/336: rmdir d0/d3e/d40/d48/d5d 39 2024-02-20T08:05:25.454 INFO:tasks.workunit.client.0.smithi123.stdout:5/232: dwrite d0/f11 [0,4194304] 0 2024-02-20T08:05:25.456 INFO:tasks.workunit.client.0.smithi123.stdout:4/276: link d3/d2c/d43/f50 d3/d2c/f5d 0 2024-02-20T08:05:25.458 INFO:tasks.workunit.client.0.smithi123.stdout:9/205: mknod d6/d19/d1b/c3e 0 2024-02-20T08:05:25.459 INFO:tasks.workunit.client.0.smithi123.stdout:6/337: symlink d0/d3e/d41/l6e 0 2024-02-20T08:05:25.459 INFO:tasks.workunit.client.0.smithi123.stdout:6/338: stat d0/d3e/d41/d56 0 2024-02-20T08:05:25.460 INFO:tasks.workunit.client.0.smithi123.stdout:6/339: readlink d0/d38/l44 0 2024-02-20T08:05:25.460 INFO:tasks.workunit.client.0.smithi123.stdout:6/340: readlink d0/d3e/d41/l43 0 2024-02-20T08:05:25.461 INFO:tasks.workunit.client.0.smithi123.stdout:7/222: link d0/d6/dd/d15/f44 d0/d6/d7/f4e 0 2024-02-20T08:05:25.463 INFO:tasks.workunit.client.0.smithi123.stdout:7/223: write d0/d6/f31 [66215,34509] 0 2024-02-20T08:05:25.463 INFO:tasks.workunit.client.0.smithi123.stdout:4/277: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:25.464 INFO:tasks.workunit.client.0.smithi123.stdout:7/224: truncate d0/d6/d29/f46 1056254 0 2024-02-20T08:05:25.468 INFO:tasks.workunit.client.0.smithi123.stdout:6/341: rmdir d0/d3e/d41/d56/d57 39 2024-02-20T08:05:25.471 INFO:tasks.workunit.client.0.smithi123.stdout:1/277: sync 2024-02-20T08:05:25.472 INFO:tasks.workunit.client.0.smithi123.stdout:3/285: sync 2024-02-20T08:05:25.472 INFO:tasks.workunit.client.0.smithi123.stdout:8/283: sync 2024-02-20T08:05:25.472 INFO:tasks.workunit.client.0.smithi123.stdout:7/225: dread d0/d6/f31 [0,4194304] 0 2024-02-20T08:05:25.475 INFO:tasks.workunit.client.0.smithi123.stdout:9/206: creat d6/f3f x:0 0 0 2024-02-20T08:05:25.477 INFO:tasks.workunit.client.0.smithi123.stdout:6/342: mknod d0/d3e/d40/d48/c6f 0 2024-02-20T08:05:25.478 INFO:tasks.workunit.client.0.smithi123.stdout:9/207: write d6/d19/d1b/d3d/f38 [402875,11653] 0 2024-02-20T08:05:25.480 INFO:tasks.workunit.client.0.smithi123.stdout:2/249: dread d1a/f1e [0,4194304] 0 2024-02-20T08:05:25.482 INFO:tasks.workunit.client.0.smithi123.stdout:3/286: mkdir d0/d6/d1a/d1b/d1c/d3b/d43/d68 0 2024-02-20T08:05:25.483 INFO:tasks.workunit.client.0.smithi123.stdout:2/250: dread - d1a/d29/f35 zero size 2024-02-20T08:05:25.485 INFO:tasks.workunit.client.0.smithi123.stdout:7/226: dwrite d0/d6/d7/d22/f3b [4194304,4194304] 0 2024-02-20T08:05:25.487 INFO:tasks.workunit.client.0.smithi123.stdout:5/233: write d0/fc [3809566,49874] 0 2024-02-20T08:05:25.488 INFO:tasks.workunit.client.0.smithi123.stdout:6/343: chown d0/d3e/d41/d56/d57/f67 287437249 1 2024-02-20T08:05:25.494 INFO:tasks.workunit.client.0.smithi123.stdout:1/278: mkdir d3/d52/d63 0 2024-02-20T08:05:25.494 INFO:tasks.workunit.client.0.smithi123.stdout:9/208: dwrite d6/d19/d1b/f3b [0,4194304] 0 2024-02-20T08:05:25.495 INFO:tasks.workunit.client.0.smithi123.stdout:6/344: write d0/d38/f55 [831379,36878] 0 2024-02-20T08:05:25.497 INFO:tasks.workunit.client.0.smithi123.stdout:4/278: rename d3/l15 to d3/d2c/d43/d26/l5e 0 2024-02-20T08:05:25.500 INFO:tasks.workunit.client.0.smithi123.stdout:1/279: chown d3/db/d34/f1b 340228 1 2024-02-20T08:05:25.502 INFO:tasks.workunit.client.0.smithi123.stdout:2/251: dwrite fc [4194304,4194304] 0 2024-02-20T08:05:25.502 INFO:tasks.workunit.client.0.smithi123.stdout:6/345: chown d0/d3e/d41/d56/f64 3164206 1 2024-02-20T08:05:25.506 INFO:tasks.workunit.client.0.smithi123.stdout:3/287: dwrite d0/d6/d1a/d1b/d1c/d61/f5f [0,4194304] 0 2024-02-20T08:05:25.507 INFO:tasks.workunit.client.0.smithi123.stdout:2/252: write d1a/f32 [2559507,84324] 0 2024-02-20T08:05:25.508 INFO:tasks.workunit.client.0.smithi123.stdout:8/284: rename d6/d1c/f49 to d6/d1c/d29/f5d 0 2024-02-20T08:05:25.512 INFO:tasks.workunit.client.0.smithi123.stdout:4/279: symlink d3/d2c/d43/d26/d2e/l5f 0 2024-02-20T08:05:25.515 INFO:tasks.workunit.client.0.smithi123.stdout:7/227: rename d0/d6/d7/f25 to d0/d23/f4f 0 2024-02-20T08:05:25.517 INFO:tasks.workunit.client.0.smithi123.stdout:3/288: symlink d0/d6/d1a/d1b/d1c/l69 0 2024-02-20T08:05:25.517 INFO:tasks.workunit.client.0.smithi123.stdout:7/228: chown d0/db/d21/d42/l4d 46048707 1 2024-02-20T08:05:25.517 INFO:tasks.workunit.client.0.smithi123.stdout:7/229: chown d0/l11 122193 1 2024-02-20T08:05:25.520 INFO:tasks.workunit.client.0.smithi123.stdout:4/280: chown d3/ff 2 1 2024-02-20T08:05:25.522 INFO:tasks.workunit.client.0.smithi123.stdout:3/289: mkdir d0/dd/d48/d6a 0 2024-02-20T08:05:25.523 INFO:tasks.workunit.client.0.smithi123.stdout:3/290: readlink d0/d6/d1a/d1b/d1c/d61/l66 0 2024-02-20T08:05:25.524 INFO:tasks.workunit.client.0.smithi123.stdout:7/230: mknod d0/db/d38/d47/c50 0 2024-02-20T08:05:25.525 INFO:tasks.workunit.client.0.smithi123.stdout:3/291: write d0/d6/d1a/f39 [52721,101085] 0 2024-02-20T08:05:25.525 INFO:tasks.workunit.client.0.smithi123.stdout:4/281: readlink d3/l4b 0 2024-02-20T08:05:25.526 INFO:tasks.workunit.client.0.smithi123.stdout:7/231: truncate d0/db/f27 142447 0 2024-02-20T08:05:25.528 INFO:tasks.workunit.client.0.smithi123.stdout:3/292: write d0/d6/d1a/d1b/f30 [7675304,53861] 0 2024-02-20T08:05:25.528 INFO:tasks.workunit.client.0.smithi123.stdout:5/234: rename d0/d13/d1f/d25/d42 to d0/d13/d1f/d4c 0 2024-02-20T08:05:25.528 INFO:tasks.workunit.client.0.smithi123.stdout:7/232: readlink d0/d6/d7/l14 0 2024-02-20T08:05:25.531 INFO:tasks.workunit.client.0.smithi123.stdout:9/209: dread d6/d2a/f17 [0,4194304] 0 2024-02-20T08:05:25.532 INFO:tasks.workunit.client.0.smithi123.stdout:1/280: rename d3/de/d14/d26/d2e/f37 to d3/de/d14/d2c/d4f/f64 0 2024-02-20T08:05:25.533 INFO:tasks.workunit.client.0.smithi123.stdout:4/282: creat d3/d1e/f60 x:0 0 0 2024-02-20T08:05:25.533 INFO:tasks.workunit.client.0.smithi123.stdout:1/281: write d3/de/f5a [560248,4366] 0 2024-02-20T08:05:25.537 INFO:tasks.workunit.client.0.smithi123.stdout:2/253: truncate d1a/f1f 2854591 0 2024-02-20T08:05:25.539 INFO:tasks.workunit.client.0.smithi123.stdout:2/254: write d1a/f41 [637495,7970] 0 2024-02-20T08:05:25.540 INFO:tasks.workunit.client.0.smithi123.stdout:8/285: truncate d6/f2f 3359120 0 2024-02-20T08:05:25.541 INFO:tasks.workunit.client.0.smithi123.stdout:4/283: dwrite d3/d2c/f40 [0,4194304] 0 2024-02-20T08:05:25.543 INFO:tasks.workunit.client.0.smithi123.stdout:6/346: rename d0/d3e/d41/d56/f5e to d0/d3e/d41/d56/d57/f70 0 2024-02-20T08:05:25.546 INFO:tasks.workunit.client.0.smithi123.stdout:1/282: creat d3/de/d14/d2c/f65 x:0 0 0 2024-02-20T08:05:25.546 INFO:tasks.workunit.client.0.smithi123.stdout:5/235: mknod d0/d13/d1f/c4d 0 2024-02-20T08:05:25.550 INFO:tasks.workunit.client.0.smithi123.stdout:2/255: dwrite f5 [4194304,4194304] 0 2024-02-20T08:05:25.550 INFO:tasks.workunit.client.0.smithi123.stdout:1/283: truncate d3/de/d14/d26/d56/f58 225010 0 2024-02-20T08:05:25.551 INFO:tasks.workunit.client.0.smithi123.stdout:2/256: dread - d1a/d29/d42/f49 zero size 2024-02-20T08:05:25.552 INFO:tasks.workunit.client.0.smithi123.stdout:8/286: symlink d6/d1c/d47/l5e 0 2024-02-20T08:05:25.554 INFO:tasks.workunit.client.0.smithi123.stdout:4/284: symlink d3/d18/l61 0 2024-02-20T08:05:25.557 INFO:tasks.workunit.client.0.smithi123.stdout:3/293: creat d0/d6/d1a/d1b/f6b x:0 0 0 2024-02-20T08:05:25.557 INFO:tasks.workunit.client.0.smithi123.stdout:7/233: creat d0/d6/d7/d22/f51 x:0 0 0 2024-02-20T08:05:25.558 INFO:tasks.workunit.client.0.smithi123.stdout:5/236: mkdir d0/d13/d27/d4e 0 2024-02-20T08:05:25.560 INFO:tasks.workunit.client.0.smithi123.stdout:5/237: dread d0/d13/f1e [0,4194304] 0 2024-02-20T08:05:25.563 INFO:tasks.workunit.client.0.smithi123.stdout:3/294: creat d0/d6/d1a/f6c x:0 0 0 2024-02-20T08:05:25.564 INFO:tasks.workunit.client.0.smithi123.stdout:9/210: getdents d6/d19/d1a/d31 0 2024-02-20T08:05:25.565 INFO:tasks.workunit.client.0.smithi123.stdout:1/284: creat d3/d47/f66 x:0 0 0 2024-02-20T08:05:25.570 INFO:tasks.workunit.client.0.smithi123.stdout:6/347: creat d0/d3e/d41/d56/f71 x:0 0 0 2024-02-20T08:05:25.572 INFO:tasks.workunit.client.0.smithi123.stdout:4/285: rmdir d3/d1e 39 2024-02-20T08:05:25.573 INFO:tasks.workunit.client.0.smithi123.stdout:6/348: dread d0/fe [0,4194304] 0 2024-02-20T08:05:25.574 INFO:tasks.workunit.client.0.smithi123.stdout:4/286: truncate d3/d2c/d43/d34/f37 693502 0 2024-02-20T08:05:25.575 INFO:tasks.workunit.client.0.smithi123.stdout:2/257: fsync d1a/f1f 0 2024-02-20T08:05:25.576 INFO:tasks.workunit.client.0.smithi123.stdout:9/211: chown d6/d19/d1a/d2b 479 1 2024-02-20T08:05:25.577 INFO:tasks.workunit.client.0.smithi123.stdout:2/258: truncate d1a/f2e 1156226 0 2024-02-20T08:05:25.581 INFO:tasks.workunit.client.0.smithi123.stdout:6/349: dwrite d0/d38/f55 [0,4194304] 0 2024-02-20T08:05:25.582 INFO:tasks.workunit.client.0.smithi123.stdout:5/238: creat d0/d34/d48/d4b/f4f x:0 0 0 2024-02-20T08:05:25.583 INFO:tasks.workunit.client.0.smithi123.stdout:5/239: fdatasync d0/f11 0 2024-02-20T08:05:25.586 INFO:tasks.workunit.client.0.smithi123.stdout:4/287: write d3/d1e/f60 [362826,120403] 0 2024-02-20T08:05:25.587 INFO:tasks.workunit.client.0.smithi123.stdout:4/288: write d3/d1e/f59 [104132,58725] 0 2024-02-20T08:05:25.591 INFO:tasks.workunit.client.0.smithi123.stdout:9/212: symlink d6/d19/d1a/d2b/d28/l40 0 2024-02-20T08:05:25.594 INFO:tasks.workunit.client.0.smithi123.stdout:7/234: rename d0/d6/d7/d22 to d0/d6/dd/d52 0 2024-02-20T08:05:25.594 INFO:tasks.workunit.client.0.smithi123.stdout:9/213: dread d6/d2a/f17 [0,4194304] 0 2024-02-20T08:05:25.595 INFO:tasks.workunit.client.0.smithi123.stdout:9/214: chown d6/d19/d1b/l24 34324013 1 2024-02-20T08:05:25.600 INFO:tasks.workunit.client.0.smithi123.stdout:2/259: mknod d1a/c4b 0 2024-02-20T08:05:25.601 INFO:tasks.workunit.client.0.smithi123.stdout:6/350: fdatasync d0/f13 0 2024-02-20T08:05:25.603 INFO:tasks.workunit.client.0.smithi123.stdout:7/235: creat d0/d6/f53 x:0 0 0 2024-02-20T08:05:25.604 INFO:tasks.workunit.client.0.smithi123.stdout:7/236: chown d0/db/d21/d42/d1d/f36 6 1 2024-02-20T08:05:25.608 INFO:tasks.workunit.client.0.smithi123.stdout:4/289: mknod d3/c62 0 2024-02-20T08:05:25.608 INFO:tasks.workunit.client.0.smithi123.stdout:4/290: readlink d3/d1e/l48 0 2024-02-20T08:05:25.609 INFO:tasks.workunit.client.0.smithi123.stdout:4/291: fsync d3/d2c/f40 0 2024-02-20T08:05:25.610 INFO:tasks.workunit.client.0.smithi123.stdout:2/260: rename d1a/d29/c37 to d1a/d29/d42/c4c 0 2024-02-20T08:05:25.611 INFO:tasks.workunit.client.0.smithi123.stdout:6/351: mkdir d0/d3e/d40/d48/d4a/d72 0 2024-02-20T08:05:25.611 INFO:tasks.workunit.client.0.smithi123.stdout:1/285: write d3/f17 [695209,120296] 0 2024-02-20T08:05:25.612 INFO:tasks.workunit.client.0.smithi123.stdout:1/286: chown d3/df/l25 10306 1 2024-02-20T08:05:25.613 INFO:tasks.workunit.client.0.smithi123.stdout:1/287: readlink d3/df/l12 0 2024-02-20T08:05:25.614 INFO:tasks.workunit.client.0.smithi123.stdout:9/215: unlink d6/d19/d1a/c23 0 2024-02-20T08:05:25.616 INFO:tasks.workunit.client.0.smithi123.stdout:3/295: creat d0/d6/d1a/d1b/d1c/d21/d5e/f6d x:0 0 0 2024-02-20T08:05:25.619 INFO:tasks.workunit.client.0.smithi123.stdout:3/296: write d0/dd/f8 [2717124,126174] 0 2024-02-20T08:05:25.620 INFO:tasks.workunit.client.0.smithi123.stdout:4/292: mkdir d3/d18/d63 0 2024-02-20T08:05:25.622 INFO:tasks.workunit.client.0.smithi123.stdout:1/288: creat d3/de/d14/d36/d59/f67 x:0 0 0 2024-02-20T08:05:25.625 INFO:tasks.workunit.client.0.smithi123.stdout:9/216: mknod d6/d19/c41 0 2024-02-20T08:05:25.627 INFO:tasks.workunit.client.0.smithi123.stdout:5/240: getdents d0/d13/d1f/d25 0 2024-02-20T08:05:25.628 INFO:tasks.workunit.client.0.smithi123.stdout:4/293: stat d3/f4d 0 2024-02-20T08:05:25.631 INFO:tasks.workunit.client.0.smithi123.stdout:6/352: mkdir d0/d3e/d40/d48/d4a/d72/d73 0 2024-02-20T08:05:25.633 INFO:tasks.workunit.client.0.smithi123.stdout:1/289: mknod d3/db/d41/c68 0 2024-02-20T08:05:25.634 INFO:tasks.workunit.client.0.smithi123.stdout:9/217: rename d6 to d6/d19/d1a/d42 22 2024-02-20T08:05:25.643 INFO:tasks.workunit.client.0.smithi123.stdout:6/353: creat d0/d3e/d41/d56/d57/f74 x:0 0 0 2024-02-20T08:05:25.646 INFO:tasks.workunit.client.0.smithi123.stdout:7/237: getdents d0/d6/dd/d52/d35 0 2024-02-20T08:05:25.648 INFO:tasks.workunit.client.0.smithi123.stdout:9/218: dread d6/ff [0,4194304] 0 2024-02-20T08:05:25.650 INFO:tasks.workunit.client.0.smithi123.stdout:7/238: write d0/db/d21/d42/d1d/f36 [536100,73031] 0 2024-02-20T08:05:25.650 INFO:tasks.workunit.client.0.smithi123.stdout:2/261: dwrite d1a/f1d [0,4194304] 0 2024-02-20T08:05:25.652 INFO:tasks.workunit.client.0.smithi123.stdout:4/294: symlink d3/d2c/l64 0 2024-02-20T08:05:25.653 INFO:tasks.workunit.client.0.smithi123.stdout:4/295: chown d3/d2c 3 1 2024-02-20T08:05:25.659 INFO:tasks.workunit.client.0.smithi123.stdout:3/297: write d0/d6/d1a/d1b/d1c/d21/f29 [1548070,19789] 0 2024-02-20T08:05:25.661 INFO:tasks.workunit.client.0.smithi123.stdout:7/239: dwrite d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:25.661 INFO:tasks.workunit.client.0.smithi123.stdout:1/290: truncate d3/db/f21 716875 0 2024-02-20T08:05:25.662 INFO:tasks.workunit.client.0.smithi123.stdout:3/298: write d0/dd/f38 [2424280,112164] 0 2024-02-20T08:05:25.666 INFO:tasks.workunit.client.0.smithi123.stdout:5/241: creat d0/d13/f50 x:0 0 0 2024-02-20T08:05:25.668 INFO:tasks.workunit.client.0.smithi123.stdout:5/242: read d0/d13/d1f/d25/f2a [360231,25210] 0 2024-02-20T08:05:25.675 INFO:tasks.workunit.client.0.smithi123.stdout:6/354: mkdir d0/d3e/d40/d48/d4a/d72/d73/d75 0 2024-02-20T08:05:25.675 INFO:tasks.workunit.client.0.smithi123.stdout:5/243: dwrite d0/f30 [0,4194304] 0 2024-02-20T08:05:25.679 INFO:tasks.workunit.client.0.smithi123.stdout:9/219: read - d6/f30 zero size 2024-02-20T08:05:25.683 INFO:tasks.workunit.client.0.smithi123.stdout:2/262: mknod d1a/d29/c4d 0 2024-02-20T08:05:25.684 INFO:tasks.workunit.client.0.smithi123.stdout:4/296: mknod d3/d2c/d43/d26/c65 0 2024-02-20T08:05:25.686 INFO:tasks.workunit.client.0.smithi123.stdout:4/297: read d3/d1e/f60 [16750,81435] 0 2024-02-20T08:05:25.688 INFO:tasks.workunit.client.0.smithi123.stdout:5/244: mkdir d0/d34/d48/d4b/d51 0 2024-02-20T08:05:25.688 INFO:tasks.workunit.client.0.smithi123.stdout:1/291: symlink d3/de/d14/l69 0 2024-02-20T08:05:25.689 INFO:tasks.workunit.client.0.smithi123.stdout:1/292: stat d3/de/d14/d26/d56/f58 0 2024-02-20T08:05:25.694 INFO:tasks.workunit.client.0.smithi123.stdout:8/287: sync 2024-02-20T08:05:25.694 INFO:tasks.workunit.client.0.smithi123.stdout:0/273: sync 2024-02-20T08:05:25.695 INFO:tasks.workunit.client.0.smithi123.stdout:2/263: mkdir d1a/d29/d42/d4e 0 2024-02-20T08:05:25.696 INFO:tasks.workunit.client.0.smithi123.stdout:2/264: stat d1a/d29/l38 0 2024-02-20T08:05:25.698 INFO:tasks.workunit.client.0.smithi123.stdout:0/274: dread d2/d3/f9 [0,4194304] 0 2024-02-20T08:05:25.700 INFO:tasks.workunit.client.0.smithi123.stdout:6/355: rename d0/d3e/d40/l53 to d0/d38/l76 0 2024-02-20T08:05:25.702 INFO:tasks.workunit.client.0.smithi123.stdout:5/245: rmdir d0/d13/d27/d37 39 2024-02-20T08:05:25.708 INFO:tasks.workunit.client.0.smithi123.stdout:3/299: write d0/d6/d1a/f23 [2556233,34413] 0 2024-02-20T08:05:25.711 INFO:tasks.workunit.client.0.smithi123.stdout:0/275: chown d2/de/f17 466240 1 2024-02-20T08:05:25.712 INFO:tasks.workunit.client.0.smithi123.stdout:0/276: write d2/de/d19/d28/f2e [839378,64878] 0 2024-02-20T08:05:25.713 INFO:tasks.workunit.client.0.smithi123.stdout:0/277: stat d2/de/d1e/l2c 0 2024-02-20T08:05:25.713 INFO:tasks.workunit.client.0.smithi123.stdout:0/278: fsync d2/dd/f50 0 2024-02-20T08:05:25.715 INFO:tasks.workunit.client.0.smithi123.stdout:1/293: mknod d3/de/d14/c6a 0 2024-02-20T08:05:25.715 INFO:tasks.workunit.client.0.smithi123.stdout:7/240: link d0/d6/dd/c19 d0/db/d21/d42/d1d/c54 0 2024-02-20T08:05:25.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/220: rmdir d6/d2a 39 2024-02-20T08:05:25.716 INFO:tasks.workunit.client.0.smithi123.stdout:1/294: write d3/de/f5a [415304,84269] 0 2024-02-20T08:05:25.717 INFO:tasks.workunit.client.0.smithi123.stdout:9/221: dread - d6/f30 zero size 2024-02-20T08:05:25.717 INFO:tasks.workunit.client.0.smithi123.stdout:1/295: dread - d3/f42 zero size 2024-02-20T08:05:25.718 INFO:tasks.workunit.client.0.smithi123.stdout:8/288: mknod d6/d1c/d22/d4f/d5b/c5f 0 2024-02-20T08:05:25.718 INFO:tasks.workunit.client.0.smithi123.stdout:2/265: mkdir d1a/d4f 0 2024-02-20T08:05:25.719 INFO:tasks.workunit.client.0.smithi123.stdout:3/300: chown d0/d6/d1a/d62/l63 64887 1 2024-02-20T08:05:25.720 INFO:tasks.workunit.client.0.smithi123.stdout:3/301: readlink d0/d6/d1a/d1b/d1c/d61/l66 0 2024-02-20T08:05:25.720 INFO:tasks.workunit.client.0.smithi123.stdout:6/356: mknod d0/d5c/c77 0 2024-02-20T08:05:25.722 INFO:tasks.workunit.client.0.smithi123.stdout:5/246: creat d0/d13/d27/d4e/f52 x:0 0 0 2024-02-20T08:05:25.722 INFO:tasks.workunit.client.0.smithi123.stdout:6/357: write d0/d3e/d41/d56/f64 [74231,43465] 0 2024-02-20T08:05:25.723 INFO:tasks.workunit.client.0.smithi123.stdout:6/358: fsync d0/f51 0 2024-02-20T08:05:25.724 INFO:tasks.workunit.client.0.smithi123.stdout:5/247: truncate d0/f3d 274691 0 2024-02-20T08:05:25.726 INFO:tasks.workunit.client.0.smithi123.stdout:9/222: truncate d6/ff 5845983 0 2024-02-20T08:05:25.726 INFO:tasks.workunit.client.0.smithi123.stdout:1/296: mknod d3/db/d41/c6b 0 2024-02-20T08:05:25.727 INFO:tasks.workunit.client.0.smithi123.stdout:8/289: creat d6/d32/f60 x:0 0 0 2024-02-20T08:05:25.729 INFO:tasks.workunit.client.0.smithi123.stdout:3/302: dwrite d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:25.731 INFO:tasks.workunit.client.0.smithi123.stdout:0/279: symlink d2/l5a 0 2024-02-20T08:05:25.731 INFO:tasks.workunit.client.0.smithi123.stdout:3/303: read d0/d6/d1a/d1b/d1c/d21/f29 [36408,15213] 0 2024-02-20T08:05:25.732 INFO:tasks.workunit.client.0.smithi123.stdout:0/280: dread - d2/de/d19/f56 zero size 2024-02-20T08:05:25.733 INFO:tasks.workunit.client.0.smithi123.stdout:0/281: write d2/f1c [1717952,92416] 0 2024-02-20T08:05:25.733 INFO:tasks.workunit.client.0.smithi123.stdout:7/241: mknod d0/c55 0 2024-02-20T08:05:25.734 INFO:tasks.workunit.client.0.smithi123.stdout:6/359: mknod d0/d3e/d41/c78 0 2024-02-20T08:05:25.734 INFO:tasks.workunit.client.0.smithi123.stdout:6/360: fsync d0/f2c 0 2024-02-20T08:05:25.735 INFO:tasks.workunit.client.0.smithi123.stdout:6/361: fsync d0/f14 0 2024-02-20T08:05:25.736 INFO:tasks.workunit.client.0.smithi123.stdout:5/248: creat d0/d34/d48/f53 x:0 0 0 2024-02-20T08:05:25.740 INFO:tasks.workunit.client.0.smithi123.stdout:4/298: link d3/d2c/d43/d26/d3e/l4e d3/d2c/d43/d26/d2e/l66 0 2024-02-20T08:05:25.744 INFO:tasks.workunit.client.0.smithi123.stdout:1/297: rename d3/de/d14/d2c/c35 to d3/de/d14/d26/d2e/d54/d5d/c6c 0 2024-02-20T08:05:25.749 INFO:tasks.workunit.client.0.smithi123.stdout:7/242: unlink d0/d6/c9 0 2024-02-20T08:05:25.749 INFO:tasks.workunit.client.0.smithi123.stdout:7/243: fdatasync d0/f3d 0 2024-02-20T08:05:25.753 INFO:tasks.workunit.client.0.smithi123.stdout:6/362: unlink d0/d3e/d40/d48/c6f 0 2024-02-20T08:05:25.754 INFO:tasks.workunit.client.0.smithi123.stdout:9/223: unlink d6/f11 0 2024-02-20T08:05:25.756 INFO:tasks.workunit.client.0.smithi123.stdout:2/266: creat d1a/f50 x:0 0 0 2024-02-20T08:05:25.758 INFO:tasks.workunit.client.0.smithi123.stdout:4/299: mknod d3/d2c/d43/d26/d2e/c67 0 2024-02-20T08:05:25.762 INFO:tasks.workunit.client.0.smithi123.stdout:2/267: dwrite d1a/d29/f2d [4194304,4194304] 0 2024-02-20T08:05:25.765 INFO:tasks.workunit.client.0.smithi123.stdout:3/304: mknod d0/d6/d1a/d1e/c6e 0 2024-02-20T08:05:25.767 INFO:tasks.workunit.client.0.smithi123.stdout:5/249: mknod d0/c54 0 2024-02-20T08:05:25.768 INFO:tasks.workunit.client.0.smithi123.stdout:2/268: dread d1a/d29/f2d [4194304,4194304] 0 2024-02-20T08:05:25.774 INFO:tasks.workunit.client.0.smithi123.stdout:2/269: dwrite d1a/f1d [0,4194304] 0 2024-02-20T08:05:25.775 INFO:tasks.workunit.client.0.smithi123.stdout:2/270: chown cd 437 1 2024-02-20T08:05:25.780 INFO:tasks.workunit.client.0.smithi123.stdout:0/282: rename d2/d3/d37/l59 to d2/d54/l5b 0 2024-02-20T08:05:25.785 INFO:tasks.workunit.client.0.smithi123.stdout:5/250: readlink d0/d13/d27/d37/l3c 0 2024-02-20T08:05:25.792 INFO:tasks.workunit.client.0.smithi123.stdout:8/290: getdents d6/d1c/d47 0 2024-02-20T08:05:25.793 INFO:tasks.workunit.client.0.smithi123.stdout:3/305: dread d0/d6/d1a/f23 [4194304,4194304] 0 2024-02-20T08:05:25.796 INFO:tasks.workunit.client.0.smithi123.stdout:4/300: unlink d3/f2a 0 2024-02-20T08:05:25.801 INFO:tasks.workunit.client.0.smithi123.stdout:0/283: unlink d2/de/d19/f56 0 2024-02-20T08:05:25.805 INFO:tasks.workunit.client.0.smithi123.stdout:5/251: fsync d0/f15 0 2024-02-20T08:05:25.807 INFO:tasks.workunit.client.0.smithi123.stdout:2/271: write d1a/f1f [2511570,20491] 0 2024-02-20T08:05:25.809 INFO:tasks.workunit.client.0.smithi123.stdout:3/306: rmdir d0/d6/d1a/d62 39 2024-02-20T08:05:25.811 INFO:tasks.workunit.client.0.smithi123.stdout:1/298: getdents d3/de/d14/d2c/d45 0 2024-02-20T08:05:25.812 INFO:tasks.workunit.client.0.smithi123.stdout:1/299: stat d3/df/l25 0 2024-02-20T08:05:25.812 INFO:tasks.workunit.client.0.smithi123.stdout:1/300: stat d3/de/d14/d36/f3d 0 2024-02-20T08:05:25.813 INFO:tasks.workunit.client.0.smithi123.stdout:6/363: getdents d0/d3e/d40/d48/d4a 0 2024-02-20T08:05:25.815 INFO:tasks.workunit.client.0.smithi123.stdout:8/291: symlink d6/l61 0 2024-02-20T08:05:25.815 INFO:tasks.workunit.client.0.smithi123.stdout:8/292: stat d6/d1c/d29/l46 0 2024-02-20T08:05:25.816 INFO:tasks.workunit.client.0.smithi123.stdout:2/272: mkdir d1a/d29/d39/d51 0 2024-02-20T08:05:25.816 INFO:tasks.workunit.client.0.smithi123.stdout:2/273: readlink l16 0 2024-02-20T08:05:25.819 INFO:tasks.workunit.client.0.smithi123.stdout:4/301: symlink d3/d2c/d43/l68 0 2024-02-20T08:05:25.820 INFO:tasks.workunit.client.0.smithi123.stdout:7/244: rename d0/d6/d7/f1e to d0/db/d21/d42/d1d/f56 0 2024-02-20T08:05:25.831 INFO:tasks.workunit.client.0.smithi123.stdout:0/284: unlink d2/dd/f30 0 2024-02-20T08:05:25.831 INFO:tasks.workunit.client.0.smithi123.stdout:7/245: readlink d0/d6/l8 0 2024-02-20T08:05:25.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/224: getdents d6/d19/d1b 0 2024-02-20T08:05:25.832 INFO:tasks.workunit.client.0.smithi123.stdout:8/293: creat d6/d1c/d47/f62 x:0 0 0 2024-02-20T08:05:25.834 INFO:tasks.workunit.client.0.smithi123.stdout:6/364: mkdir d0/d3e/d40/d48/d79 0 2024-02-20T08:05:25.834 INFO:tasks.workunit.client.0.smithi123.stdout:4/302: write d3/d18/f30 [4987027,112393] 0 2024-02-20T08:05:25.836 INFO:tasks.workunit.client.0.smithi123.stdout:7/246: creat d0/d6/f57 x:0 0 0 2024-02-20T08:05:25.837 INFO:tasks.workunit.client.0.smithi123.stdout:3/307: creat d0/d6/d1a/d1b/d2a/f6f x:0 0 0 2024-02-20T08:05:25.838 INFO:tasks.workunit.client.0.smithi123.stdout:9/225: symlink d6/d19/d1b/l43 0 2024-02-20T08:05:25.840 INFO:tasks.workunit.client.0.smithi123.stdout:2/274: rmdir d1a/d29/d39/d51 0 2024-02-20T08:05:25.842 INFO:tasks.workunit.client.0.smithi123.stdout:1/301: dwrite d3/de/d14/d2c/f32 [0,4194304] 0 2024-02-20T08:05:25.842 INFO:tasks.workunit.client.0.smithi123.stdout:2/275: read f10 [2894004,102611] 0 2024-02-20T08:05:25.843 INFO:tasks.workunit.client.0.smithi123.stdout:4/303: dread d3/d18/f1d [4194304,4194304] 0 2024-02-20T08:05:25.844 INFO:tasks.workunit.client.0.smithi123.stdout:0/285: truncate d2/f1b 677787 0 2024-02-20T08:05:25.849 INFO:tasks.workunit.client.0.smithi123.stdout:7/247: creat d0/db/d21/d42/d1d/d2a/f58 x:0 0 0 2024-02-20T08:05:25.851 INFO:tasks.workunit.client.0.smithi123.stdout:3/308: stat d0/d6/d1a/d1b/d1c/d20/c60 0 2024-02-20T08:05:25.852 INFO:tasks.workunit.client.0.smithi123.stdout:7/248: read d0/d6/dd/d15/f44 [927615,28667] 0 2024-02-20T08:05:25.853 INFO:tasks.workunit.client.0.smithi123.stdout:9/226: unlink d6/d19/d1a/c2c 0 2024-02-20T08:05:25.853 INFO:tasks.workunit.client.0.smithi123.stdout:7/249: write d0/f40 [495639,8983] 0 2024-02-20T08:05:25.857 INFO:tasks.workunit.client.0.smithi123.stdout:2/276: mkdir d1a/d29/d42/d52 0 2024-02-20T08:05:25.858 INFO:tasks.workunit.client.0.smithi123.stdout:2/277: dread - d1a/d29/f44 zero size 2024-02-20T08:05:25.859 INFO:tasks.workunit.client.0.smithi123.stdout:1/302: write d3/de/d14/d36/d59/f5b [79213,63642] 0 2024-02-20T08:05:25.860 INFO:tasks.workunit.client.0.smithi123.stdout:7/250: dwrite d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:25.863 INFO:tasks.workunit.client.0.smithi123.stdout:7/251: write d0/db/d21/d42/d1d/d2a/f2b [354978,122073] 0 2024-02-20T08:05:25.865 INFO:tasks.workunit.client.0.smithi123.stdout:2/278: dread d1a/d29/d42/f4a [0,4194304] 0 2024-02-20T08:05:25.865 INFO:tasks.workunit.client.0.smithi123.stdout:2/279: readlink d1a/l24 0 2024-02-20T08:05:25.866 INFO:tasks.workunit.client.0.smithi123.stdout:8/294: write d6/f7 [1423783,77282] 0 2024-02-20T08:05:25.869 INFO:tasks.workunit.client.0.smithi123.stdout:6/365: creat d0/d3e/d40/d48/d79/f7a x:0 0 0 2024-02-20T08:05:25.875 INFO:tasks.workunit.client.0.smithi123.stdout:9/227: creat d6/d19/f44 x:0 0 0 2024-02-20T08:05:25.875 INFO:tasks.workunit.client.0.smithi123.stdout:9/228: chown d6/d19/d1a/l2d 32122328 1 2024-02-20T08:05:25.880 INFO:tasks.workunit.client.0.smithi123.stdout:1/303: rename d3/db/d41/c43 to d3/de/d14/d26/d2e/d54/d5d/c6d 0 2024-02-20T08:05:25.883 INFO:tasks.workunit.client.0.smithi123.stdout:1/304: read - d3/de/d14/d2c/d4f/f64 zero size 2024-02-20T08:05:25.884 INFO:tasks.workunit.client.0.smithi123.stdout:4/304: dwrite d3/d2c/d43/f50 [0,4194304] 0 2024-02-20T08:05:25.888 INFO:tasks.workunit.client.0.smithi123.stdout:3/309: symlink d0/d6/d1a/d1e/l70 0 2024-02-20T08:05:25.889 INFO:tasks.workunit.client.0.smithi123.stdout:9/229: fsync d6/d19/f34 0 2024-02-20T08:05:25.890 INFO:tasks.workunit.client.0.smithi123.stdout:6/366: dwrite d0/f33 [8388608,4194304] 0 2024-02-20T08:05:25.892 INFO:tasks.workunit.client.0.smithi123.stdout:7/252: mkdir d0/db/d38/d47/d4a/d59 0 2024-02-20T08:05:25.895 INFO:tasks.workunit.client.0.smithi123.stdout:2/280: creat d1a/d4f/f53 x:0 0 0 2024-02-20T08:05:25.896 INFO:tasks.workunit.client.0.smithi123.stdout:2/281: write d1a/f28 [3542983,113943] 0 2024-02-20T08:05:25.897 INFO:tasks.workunit.client.0.smithi123.stdout:0/286: creat d2/f5c x:0 0 0 2024-02-20T08:05:25.899 INFO:tasks.workunit.client.0.smithi123.stdout:6/367: dwrite d0/f31 [0,4194304] 0 2024-02-20T08:05:25.910 INFO:tasks.workunit.client.0.smithi123.stdout:9/230: rename d6/d19/d1a/d2b to d6/d19/d1a/d2b/d45 22 2024-02-20T08:05:25.913 INFO:tasks.workunit.client.0.smithi123.stdout:2/282: write d1a/d29/d42/f4a [1264639,64823] 0 2024-02-20T08:05:25.913 INFO:tasks.workunit.client.0.smithi123.stdout:6/368: dwrite d0/d3e/d40/d48/d79/f7a [0,4194304] 0 2024-02-20T08:05:25.914 INFO:tasks.workunit.client.0.smithi123.stdout:1/305: dwrite d3/de/d14/d2c/d4f/f57 [0,4194304] 0 2024-02-20T08:05:25.917 INFO:tasks.workunit.client.0.smithi123.stdout:3/310: rmdir d0/d6/d1a/d1b/d57 39 2024-02-20T08:05:25.921 INFO:tasks.workunit.client.0.smithi123.stdout:9/231: dread - d6/fd zero size 2024-02-20T08:05:25.922 INFO:tasks.workunit.client.0.smithi123.stdout:9/232: dread - d6/d19/d1b/f26 zero size 2024-02-20T08:05:25.924 INFO:tasks.workunit.client.0.smithi123.stdout:7/253: mknod d0/db/d21/d42/d1d/c5a 0 2024-02-20T08:05:25.925 INFO:tasks.workunit.client.0.smithi123.stdout:4/305: creat d3/d2c/f69 x:0 0 0 2024-02-20T08:05:25.926 INFO:tasks.workunit.client.0.smithi123.stdout:7/254: chown d0/db/d21/d42/d1d/d2a/f58 104170303 1 2024-02-20T08:05:25.926 INFO:tasks.workunit.client.0.smithi123.stdout:8/295: truncate d6/d1c/d22/d4f/f56 68253 0 2024-02-20T08:05:25.929 INFO:tasks.workunit.client.0.smithi123.stdout:1/306: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:25.930 INFO:tasks.workunit.client.0.smithi123.stdout:3/311: rename d0/d6/f14 to d0/dd/d48/f71 0 2024-02-20T08:05:25.931 INFO:tasks.workunit.client.0.smithi123.stdout:4/306: dread d3/d2c/f40 [0,4194304] 0 2024-02-20T08:05:25.933 INFO:tasks.workunit.client.0.smithi123.stdout:3/312: chown d0/dd/d48 706 1 2024-02-20T08:05:25.933 INFO:tasks.workunit.client.0.smithi123.stdout:4/307: readlink d3/d18/l61 0 2024-02-20T08:05:25.933 INFO:tasks.workunit.client.0.smithi123.stdout:9/233: chown d6/f14 15195 1 2024-02-20T08:05:25.937 INFO:tasks.workunit.client.0.smithi123.stdout:7/255: dwrite d0/d6/d29/f3a [0,4194304] 0 2024-02-20T08:05:25.938 INFO:tasks.workunit.client.0.smithi123.stdout:1/307: dread d3/de/d14/d2c/f32 [0,4194304] 0 2024-02-20T08:05:25.938 INFO:tasks.workunit.client.0.smithi123.stdout:6/369: mkdir d0/d3e/d40/d48/d7b 0 2024-02-20T08:05:25.942 INFO:tasks.workunit.client.0.smithi123.stdout:8/296: creat d6/d1c/d29/d3f/f63 x:0 0 0 2024-02-20T08:05:25.948 INFO:tasks.workunit.client.0.smithi123.stdout:0/287: link d2/de/d19/d28/l49 d2/l5d 0 2024-02-20T08:05:25.949 INFO:tasks.workunit.client.0.smithi123.stdout:4/308: rmdir d3/d2c 39 2024-02-20T08:05:25.949 INFO:tasks.workunit.client.0.smithi123.stdout:1/308: dwrite d3/f42 [0,4194304] 0 2024-02-20T08:05:25.952 INFO:tasks.workunit.client.0.smithi123.stdout:1/309: dread - d3/df/f5c zero size 2024-02-20T08:05:25.953 INFO:tasks.workunit.client.0.smithi123.stdout:9/234: creat d6/d19/d1a/d31/f46 x:0 0 0 2024-02-20T08:05:25.955 INFO:tasks.workunit.client.0.smithi123.stdout:7/256: dread d0/d6/dd/d52/f3b [0,4194304] 0 2024-02-20T08:05:25.958 INFO:tasks.workunit.client.0.smithi123.stdout:6/370: fsync d0/f28 0 2024-02-20T08:05:25.959 INFO:tasks.workunit.client.0.smithi123.stdout:6/371: write d0/d3e/d41/d56/d57/f6b [194989,95227] 0 2024-02-20T08:05:25.963 INFO:tasks.workunit.client.0.smithi123.stdout:8/297: mknod d6/d1c/d22/d4f/c64 0 2024-02-20T08:05:25.966 INFO:tasks.workunit.client.0.smithi123.stdout:2/283: getdents d1a 0 2024-02-20T08:05:25.968 INFO:tasks.workunit.client.0.smithi123.stdout:1/310: rmdir d3/de/d14/d2c/d45 39 2024-02-20T08:05:25.972 INFO:tasks.workunit.client.0.smithi123.stdout:9/235: unlink d6/d19/d1a/d2b/d28/f2e 0 2024-02-20T08:05:25.979 INFO:tasks.workunit.client.0.smithi123.stdout:4/309: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:25.980 INFO:tasks.workunit.client.0.smithi123.stdout:9/236: dwrite d6/d19/d1a/d31/f46 [0,4194304] 0 2024-02-20T08:05:25.980 INFO:tasks.workunit.client.0.smithi123.stdout:4/310: read d3/d2c/f53 [15671,85309] 0 2024-02-20T08:05:25.981 INFO:tasks.workunit.client.0.smithi123.stdout:4/311: dread - d3/d2c/f54 zero size 2024-02-20T08:05:25.984 INFO:tasks.workunit.client.0.smithi123.stdout:0/288: dread d2/f15 [0,4194304] 0 2024-02-20T08:05:25.984 INFO:tasks.workunit.client.0.smithi123.stdout:1/311: dread d3/f48 [0,4194304] 0 2024-02-20T08:05:25.989 INFO:tasks.workunit.client.0.smithi123.stdout:2/284: symlink d1a/d29/d42/d4e/l54 0 2024-02-20T08:05:25.993 INFO:tasks.workunit.client.0.smithi123.stdout:9/237: read d6/d2a/f17 [840973,79881] 0 2024-02-20T08:05:25.994 INFO:tasks.workunit.client.0.smithi123.stdout:4/312: symlink d3/d1e/l6a 0 2024-02-20T08:05:25.996 INFO:tasks.workunit.client.0.smithi123.stdout:0/289: rmdir d2 39 2024-02-20T08:05:25.997 INFO:tasks.workunit.client.0.smithi123.stdout:7/257: truncate d0/db/d21/d42/d1d/f56 1024953 0 2024-02-20T08:05:25.999 INFO:tasks.workunit.client.0.smithi123.stdout:6/372: creat d0/d3e/f7c x:0 0 0 2024-02-20T08:05:26.002 INFO:tasks.workunit.client.0.smithi123.stdout:2/285: rename cd to d1a/c55 0 2024-02-20T08:05:26.003 INFO:tasks.workunit.client.0.smithi123.stdout:9/238: rmdir d6/d19/d1a/d2b/d28 39 2024-02-20T08:05:26.004 INFO:tasks.workunit.client.0.smithi123.stdout:9/239: chown d6/d19/f44 984245 1 2024-02-20T08:05:26.007 INFO:tasks.workunit.client.0.smithi123.stdout:0/290: chown d2/f1c 33 1 2024-02-20T08:05:26.011 INFO:tasks.workunit.client.0.smithi123.stdout:9/240: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:26.011 INFO:tasks.workunit.client.0.smithi123.stdout:8/298: getdents d6/d1c 0 2024-02-20T08:05:26.014 INFO:tasks.workunit.client.0.smithi123.stdout:7/258: creat d0/db/d38/d47/d4a/d59/f5b x:0 0 0 2024-02-20T08:05:26.015 INFO:tasks.workunit.client.0.smithi123.stdout:0/291: mkdir d2/de/d1e/d1f/d5e 0 2024-02-20T08:05:26.019 INFO:tasks.workunit.client.0.smithi123.stdout:9/241: fdatasync d6/f30 0 2024-02-20T08:05:26.020 INFO:tasks.workunit.client.0.smithi123.stdout:9/242: chown d6/d19/d1b/c3e 1 1 2024-02-20T08:05:26.020 INFO:tasks.workunit.client.0.smithi123.stdout:8/299: creat d6/d32/f65 x:0 0 0 2024-02-20T08:05:26.028 INFO:tasks.workunit.client.0.smithi123.stdout:0/292: write d2/de/f51 [3863676,27424] 0 2024-02-20T08:05:26.028 INFO:tasks.workunit.client.0.smithi123.stdout:0/293: write d2/dd/f41 [775842,47661] 0 2024-02-20T08:05:26.028 INFO:tasks.workunit.client.0.smithi123.stdout:1/312: getdents d3/de/d14/d26/d56 0 2024-02-20T08:05:26.028 INFO:tasks.workunit.client.0.smithi123.stdout:1/313: chown d3/df/f1e 57 1 2024-02-20T08:05:26.030 INFO:tasks.workunit.client.0.smithi123.stdout:8/300: fdatasync d6/fc 0 2024-02-20T08:05:26.030 INFO:tasks.workunit.client.0.smithi123.stdout:1/314: write d3/db/d34/f1b [3576489,111891] 0 2024-02-20T08:05:26.032 INFO:tasks.workunit.client.0.smithi123.stdout:0/294: dwrite d2/de/d1e/f46 [0,4194304] 0 2024-02-20T08:05:26.032 INFO:tasks.workunit.client.0.smithi123.stdout:1/315: dread - d3/de/d14/d36/d59/f67 zero size 2024-02-20T08:05:26.033 INFO:tasks.workunit.client.0.smithi123.stdout:9/243: rename d6/d19/c1e to d6/d19/d1a/d31/c47 0 2024-02-20T08:05:26.034 INFO:tasks.workunit.client.0.smithi123.stdout:9/244: fsync d6/d19/d1a/d2b/f37 0 2024-02-20T08:05:26.034 INFO:tasks.workunit.client.0.smithi123.stdout:4/313: getdents d3/d1e 0 2024-02-20T08:05:26.040 INFO:tasks.workunit.client.0.smithi123.stdout:7/259: unlink d0/d6/dd/d52/d26/c28 0 2024-02-20T08:05:26.041 INFO:tasks.workunit.client.0.smithi123.stdout:7/260: dread - d0/db/d38/f4c zero size 2024-02-20T08:05:26.041 INFO:tasks.workunit.client.0.smithi123.stdout:9/245: dwrite f5 [0,4194304] 0 2024-02-20T08:05:26.042 INFO:tasks.workunit.client.0.smithi123.stdout:9/246: stat d6/d19/d1b/l24 0 2024-02-20T08:05:26.043 INFO:tasks.workunit.client.0.smithi123.stdout:2/286: creat d1a/d29/d42/d52/f56 x:0 0 0 2024-02-20T08:05:26.044 INFO:tasks.workunit.client.0.smithi123.stdout:0/295: mkdir d2/d3/d37/d5f 0 2024-02-20T08:05:26.047 INFO:tasks.workunit.client.0.smithi123.stdout:1/316: symlink d3/d52/l6e 0 2024-02-20T08:05:26.048 INFO:tasks.workunit.client.0.smithi123.stdout:1/317: fdatasync d3/de/f60 0 2024-02-20T08:05:26.051 INFO:tasks.workunit.client.0.smithi123.stdout:7/261: rmdir d0/db/d38/d47/d4a/d59 39 2024-02-20T08:05:26.054 INFO:tasks.workunit.client.0.smithi123.stdout:9/247: mknod d6/d19/d1b/d3d/c48 0 2024-02-20T08:05:26.054 INFO:tasks.workunit.client.0.smithi123.stdout:9/248: readlink d6/d2a/l16 0 2024-02-20T08:05:26.061 INFO:tasks.workunit.client.0.smithi123.stdout:2/287: dwrite d1a/f32 [0,4194304] 0 2024-02-20T08:05:26.061 INFO:tasks.workunit.client.0.smithi123.stdout:7/262: mkdir d0/db/d38/d47/d4a/d59/d5c 0 2024-02-20T08:05:26.064 INFO:tasks.workunit.client.0.smithi123.stdout:0/296: creat d2/de/f60 x:0 0 0 2024-02-20T08:05:26.066 INFO:tasks.workunit.client.0.smithi123.stdout:9/249: link d6/d19/d1b/f26 d6/d19/f49 0 2024-02-20T08:05:26.068 INFO:tasks.workunit.client.0.smithi123.stdout:1/318: rename d3/d52 to d3/df/d6f 0 2024-02-20T08:05:26.071 INFO:tasks.workunit.client.0.smithi123.stdout:0/297: truncate d2/f12 775211 0 2024-02-20T08:05:26.071 INFO:tasks.workunit.client.0.smithi123.stdout:0/298: stat d2/de/d19/f58 0 2024-02-20T08:05:26.072 INFO:tasks.workunit.client.0.smithi123.stdout:0/299: read d2/de/d1e/f22 [660151,24368] 0 2024-02-20T08:05:26.072 INFO:tasks.workunit.client.0.smithi123.stdout:9/250: creat d6/d19/f4a x:0 0 0 2024-02-20T08:05:26.073 INFO:tasks.workunit.client.0.smithi123.stdout:2/288: mknod d1a/c57 0 2024-02-20T08:05:26.073 INFO:tasks.workunit.client.0.smithi123.stdout:9/251: write d6/d19/d1a/d2b/f37 [912143,58101] 0 2024-02-20T08:05:26.076 INFO:tasks.workunit.client.0.smithi123.stdout:7/263: mkdir d0/db/d38/d47/d4a/d5d 0 2024-02-20T08:05:26.077 INFO:tasks.workunit.client.0.smithi123.stdout:2/289: chown d1a/f26 897996 1 2024-02-20T08:05:26.078 INFO:tasks.workunit.client.0.smithi123.stdout:9/252: chown d6/f3f 1131028760 1 2024-02-20T08:05:26.078 INFO:tasks.workunit.client.0.smithi123.stdout:0/300: mkdir d2/dd/d4f/d61 0 2024-02-20T08:05:26.078 INFO:tasks.workunit.client.0.smithi123.stdout:9/253: fsync d6/d2a/d27/f2f 0 2024-02-20T08:05:26.079 INFO:tasks.workunit.client.0.smithi123.stdout:7/264: mknod d0/db/d21/d42/d1d/d2a/c5e 0 2024-02-20T08:05:26.079 INFO:tasks.workunit.client.0.smithi123.stdout:9/254: write d6/f3f [102792,60423] 0 2024-02-20T08:05:26.081 INFO:tasks.workunit.client.0.smithi123.stdout:2/290: write d1a/f50 [375567,110192] 0 2024-02-20T08:05:26.082 INFO:tasks.workunit.client.0.smithi123.stdout:9/255: chown d6/d19/f49 490189992 1 2024-02-20T08:05:26.082 INFO:tasks.workunit.client.0.smithi123.stdout:2/291: fdatasync d1a/d29/d42/f4a 0 2024-02-20T08:05:26.083 INFO:tasks.workunit.client.0.smithi123.stdout:0/301: rename d2/d3/l11 to d2/de/d1e/l62 0 2024-02-20T08:05:26.083 INFO:tasks.workunit.client.0.smithi123.stdout:0/302: stat d2/d3/f9 0 2024-02-20T08:05:26.084 INFO:tasks.workunit.client.0.smithi123.stdout:0/303: write d2/de/d1e/d1f/f20 [293506,49460] 0 2024-02-20T08:05:26.085 INFO:tasks.workunit.client.0.smithi123.stdout:9/256: mkdir d6/d19/d1a/d31/d4b 0 2024-02-20T08:05:26.085 INFO:tasks.workunit.client.0.smithi123.stdout:9/257: stat d6/d19/d1a 0 2024-02-20T08:05:26.086 INFO:tasks.workunit.client.0.smithi123.stdout:0/304: write d2/dd/f2f [88549,36638] 0 2024-02-20T08:05:26.086 INFO:tasks.workunit.client.0.smithi123.stdout:9/258: fsync f5 0 2024-02-20T08:05:26.086 INFO:tasks.workunit.client.0.smithi123.stdout:0/305: dread - d2/de/d19/f58 zero size 2024-02-20T08:05:26.088 INFO:tasks.workunit.client.0.smithi123.stdout:1/319: dread d3/db/f19 [0,4194304] 0 2024-02-20T08:05:26.089 INFO:tasks.workunit.client.0.smithi123.stdout:0/306: read d2/de/d1e/d1f/f29 [35236,122665] 0 2024-02-20T08:05:26.092 INFO:tasks.workunit.client.0.smithi123.stdout:0/307: rmdir d2/dd/d4f 39 2024-02-20T08:05:26.093 INFO:tasks.workunit.client.0.smithi123.stdout:0/308: read d2/dd/f31 [1183120,90338] 0 2024-02-20T08:05:26.099 INFO:tasks.workunit.client.0.smithi123.stdout:0/309: dwrite d2/d3/ff [0,4194304] 0 2024-02-20T08:05:26.103 INFO:tasks.workunit.client.0.smithi123.stdout:9/259: link d6/fb d6/d19/d1a/d2b/d28/f4c 0 2024-02-20T08:05:26.107 INFO:tasks.workunit.client.0.smithi123.stdout:9/260: mknod d6/d19/d1a/d31/c4d 0 2024-02-20T08:05:26.113 INFO:tasks.workunit.client.0.smithi123.stdout:0/310: creat d2/dd/f63 x:0 0 0 2024-02-20T08:05:26.117 INFO:tasks.workunit.client.0.smithi123.stdout:0/311: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:26.118 INFO:tasks.workunit.client.0.smithi123.stdout:7/265: rename d0/db/d21/d42/d1d/d2a to d0/db/d21/d42/d5f 0 2024-02-20T08:05:26.120 INFO:tasks.workunit.client.0.smithi123.stdout:7/266: write d0/db/d21/d42/d1d/f36 [2431,97655] 0 2024-02-20T08:05:26.125 INFO:tasks.workunit.client.0.smithi123.stdout:7/267: dwrite d0/f4 [4194304,4194304] 0 2024-02-20T08:05:26.133 INFO:tasks.workunit.client.0.smithi123.stdout:9/261: link d6/d19/d1b/d3d/d32/l39 d6/d19/d1a/l4e 0 2024-02-20T08:05:26.134 INFO:tasks.workunit.client.0.smithi123.stdout:1/320: truncate d3/df/f1e 3599465 0 2024-02-20T08:05:26.137 INFO:tasks.workunit.client.0.smithi123.stdout:7/268: rename d0/d6/d7/l14 to d0/db/d21/d42/d5f/d4b/l60 0 2024-02-20T08:05:26.144 INFO:tasks.workunit.client.0.smithi123.stdout:7/269: mkdir d0/d6/dd/d15/d61 0 2024-02-20T08:05:26.148 INFO:tasks.workunit.client.0.smithi123.stdout:0/312: link d2/l5d d2/de/d1e/d1f/l64 0 2024-02-20T08:05:26.151 INFO:tasks.workunit.client.0.smithi123.stdout:9/262: link d6/d19/d1b/l43 d6/d19/d1b/l4f 0 2024-02-20T08:05:26.154 INFO:tasks.workunit.client.0.smithi123.stdout:1/321: creat d3/f70 x:0 0 0 2024-02-20T08:05:26.155 INFO:tasks.workunit.client.0.smithi123.stdout:7/270: dwrite d0/d6/f31 [0,4194304] 0 2024-02-20T08:05:26.157 INFO:tasks.workunit.client.0.smithi123.stdout:0/313: readlink d2/dd/l2a 0 2024-02-20T08:05:26.160 INFO:tasks.workunit.client.0.smithi123.stdout:9/263: mkdir d6/d19/d1a/d2b/d28/d50 0 2024-02-20T08:05:26.163 INFO:tasks.workunit.client.0.smithi123.stdout:9/264: dread d6/fd [0,4194304] 0 2024-02-20T08:05:26.165 INFO:tasks.workunit.client.0.smithi123.stdout:9/265: write d6/fd [3289421,105022] 0 2024-02-20T08:05:26.166 INFO:tasks.workunit.client.0.smithi123.stdout:0/314: fsync d2/de/d1e/d1f/f29 0 2024-02-20T08:05:26.171 INFO:tasks.workunit.client.0.smithi123.stdout:9/266: creat d6/d19/d1b/d3d/d32/f51 x:0 0 0 2024-02-20T08:05:26.178 INFO:tasks.workunit.client.0.smithi123.stdout:0/315: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:26.181 INFO:tasks.workunit.client.0.smithi123.stdout:7/271: rename d0/db/d21/d42/f49 to d0/db/d38/d47/d4a/f62 0 2024-02-20T08:05:26.185 INFO:tasks.workunit.client.0.smithi123.stdout:0/316: dwrite d2/de/d19/d28/f2e [0,4194304] 0 2024-02-20T08:05:26.187 INFO:tasks.workunit.client.0.smithi123.stdout:9/267: symlink d6/d19/d1a/d31/d4b/l52 0 2024-02-20T08:05:26.190 INFO:tasks.workunit.client.0.smithi123.stdout:7/272: unlink d0/d6/dd/d15/f44 0 2024-02-20T08:05:26.192 INFO:tasks.workunit.client.0.smithi123.stdout:0/317: fdatasync d2/de/d1e/d1f/f29 0 2024-02-20T08:05:26.195 INFO:tasks.workunit.client.0.smithi123.stdout:9/268: symlink d6/d19/d1b/d3d/l53 0 2024-02-20T08:05:26.198 INFO:tasks.workunit.client.0.smithi123.stdout:9/269: dread d6/f3f [0,4194304] 0 2024-02-20T08:05:26.199 INFO:tasks.workunit.client.0.smithi123.stdout:0/318: dwrite d2/f42 [0,4194304] 0 2024-02-20T08:05:26.208 INFO:tasks.workunit.client.0.smithi123.stdout:9/270: creat d6/d2a/d27/f54 x:0 0 0 2024-02-20T08:05:26.213 INFO:tasks.workunit.client.0.smithi123.stdout:7/273: rename d0/d23/f3c to d0/d6/d7/f63 0 2024-02-20T08:05:26.214 INFO:tasks.workunit.client.0.smithi123.stdout:7/274: chown d0/db/d21/d42/d1d 2 1 2024-02-20T08:05:26.216 INFO:tasks.workunit.client.0.smithi123.stdout:9/271: rmdir d6/d2a 39 2024-02-20T08:05:26.219 INFO:tasks.workunit.client.0.smithi123.stdout:0/319: symlink d2/dd/d4f/l65 0 2024-02-20T08:05:26.223 INFO:tasks.workunit.client.0.smithi123.stdout:7/275: unlink d0/db/d38/d47/d4a/f62 0 2024-02-20T08:05:26.233 INFO:tasks.workunit.client.0.smithi123.stdout:9/272: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:26.234 INFO:tasks.workunit.client.0.smithi123.stdout:9/273: dread - d6/d19/f34 zero size 2024-02-20T08:05:26.238 INFO:tasks.workunit.client.0.smithi123.stdout:7/276: dread d0/d6/dd/d52/f33 [0,4194304] 0 2024-02-20T08:05:26.238 INFO:tasks.workunit.client.0.smithi123.stdout:7/277: stat d0/f37 0 2024-02-20T08:05:26.254 INFO:tasks.workunit.client.0.smithi123.stdout:7/278: write d0/d6/dd/d52/f51 [3257,104706] 0 2024-02-20T08:05:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:25 smithi123 ceph-mon[29383]: pgmap v32: 65 pgs: 65 active+clean; 606 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 8.6 MiB/s rd, 58 MiB/s wr, 155 op/s 2024-02-20T08:05:26.305 INFO:tasks.workunit.client.0.smithi123.stdout:0/320: rename d2/de/d19/d28/l49 to d2/d3/d37/l66 0 2024-02-20T08:05:26.326 INFO:tasks.workunit.client.0.smithi123.stdout:9/274: creat d6/d19/d1a/d2b/d28/f55 x:0 0 0 2024-02-20T08:05:26.332 INFO:tasks.workunit.client.0.smithi123.stdout:9/275: unlink d6/d19/d1b/d3d/f38 0 2024-02-20T08:05:26.340 INFO:tasks.workunit.client.0.smithi123.stdout:9/276: mknod d6/d19/d1b/c56 0 2024-02-20T08:05:26.345 INFO:tasks.workunit.client.0.smithi123.stdout:7/279: creat d0/f64 x:0 0 0 2024-02-20T08:05:26.347 INFO:tasks.workunit.client.0.smithi123.stdout:9/277: fdatasync d6/d2a/d27/f2f 0 2024-02-20T08:05:26.348 INFO:tasks.workunit.client.0.smithi123.stdout:9/278: dread - d6/d19/d1b/d3d/d32/f51 zero size 2024-02-20T08:05:26.352 INFO:tasks.workunit.client.0.smithi123.stdout:7/280: unlink d0/d6/dd/d15/f1f 0 2024-02-20T08:05:26.352 INFO:tasks.workunit.client.0.smithi123.stdout:7/281: chown d0/f30 980 1 2024-02-20T08:05:26.355 INFO:tasks.workunit.client.0.smithi123.stdout:9/279: rename d6/fd to d6/d19/d1b/d3d/f57 0 2024-02-20T08:05:26.357 INFO:tasks.workunit.client.0.smithi123.stdout:7/282: creat d0/d6/dd/f65 x:0 0 0 2024-02-20T08:05:26.357 INFO:tasks.workunit.client.0.smithi123.stdout:0/321: write d2/de/d1e/f46 [3732528,30780] 0 2024-02-20T08:05:26.358 INFO:tasks.workunit.client.0.smithi123.stdout:0/322: chown d2/f5c 583292878 1 2024-02-20T08:05:26.359 INFO:tasks.workunit.client.0.smithi123.stdout:9/280: chown d6/d19/d1b/l43 7 1 2024-02-20T08:05:26.367 INFO:tasks.workunit.client.0.smithi123.stdout:9/281: unlink d6/d19/d1b/d3d/d32/f51 0 2024-02-20T08:05:26.367 INFO:tasks.workunit.client.0.smithi123.stdout:7/283: dwrite d0/f5 [0,4194304] 0 2024-02-20T08:05:26.369 INFO:tasks.workunit.client.0.smithi123.stdout:7/284: write d0/d23/f2d [1059564,120053] 0 2024-02-20T08:05:26.370 INFO:tasks.workunit.client.0.smithi123.stdout:7/285: readlink d0/d6/dd/d52/l3e 0 2024-02-20T08:05:26.371 INFO:tasks.workunit.client.0.smithi123.stdout:0/323: rename d2/de/l3f to d2/d3/d37/l67 0 2024-02-20T08:05:26.374 INFO:tasks.workunit.client.0.smithi123.stdout:9/282: dwrite d6/d19/d1a/d31/f46 [0,4194304] 0 2024-02-20T08:05:26.381 INFO:tasks.workunit.client.0.smithi123.stdout:0/324: unlink d2/de/d1e/c57 0 2024-02-20T08:05:26.384 INFO:tasks.workunit.client.0.smithi123.stdout:7/286: symlink d0/d6/l66 0 2024-02-20T08:05:26.391 INFO:tasks.workunit.client.0.smithi123.stdout:0/325: mkdir d2/dd/d4f/d61/d68 0 2024-02-20T08:05:26.393 INFO:tasks.workunit.client.0.smithi123.stdout:9/283: dwrite d6/d2a/f17 [4194304,4194304] 0 2024-02-20T08:05:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:25 smithi194 ceph-mon[37804]: pgmap v32: 65 pgs: 65 active+clean; 606 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 8.6 MiB/s rd, 58 MiB/s wr, 155 op/s 2024-02-20T08:05:26.394 INFO:tasks.workunit.client.0.smithi123.stdout:0/326: mknod d2/dd/d4f/d61/c69 0 2024-02-20T08:05:26.399 INFO:tasks.workunit.client.0.smithi123.stdout:0/327: mkdir d2/dd/d4f/d6a 0 2024-02-20T08:05:26.401 INFO:tasks.workunit.client.0.smithi123.stdout:0/328: write d2/de/d19/d28/f2e [2113863,117062] 0 2024-02-20T08:05:26.406 INFO:tasks.workunit.client.0.smithi123.stdout:0/329: link d2/de/d1e/f22 d2/dd/d4f/d61/d68/f6b 0 2024-02-20T08:05:26.406 INFO:tasks.workunit.client.0.smithi123.stdout:9/284: dread d6/fa [0,4194304] 0 2024-02-20T08:05:26.409 INFO:tasks.workunit.client.0.smithi123.stdout:0/330: creat d2/dd/d4f/d61/d68/f6c x:0 0 0 2024-02-20T08:05:26.413 INFO:tasks.workunit.client.0.smithi123.stdout:0/331: dread d2/f42 [0,4194304] 0 2024-02-20T08:05:26.416 INFO:tasks.workunit.client.0.smithi123.stdout:0/332: dread d2/de/d19/f45 [0,4194304] 0 2024-02-20T08:05:26.417 INFO:tasks.workunit.client.0.smithi123.stdout:0/333: chown d2/dd/d4f/d61/c69 58936 1 2024-02-20T08:05:26.423 INFO:tasks.workunit.client.0.smithi123.stdout:0/334: dwrite d2/dd/f2f [0,4194304] 0 2024-02-20T08:05:26.429 INFO:tasks.workunit.client.0.smithi123.stdout:0/335: write d2/dd/f31 [1745968,949] 0 2024-02-20T08:05:26.430 INFO:tasks.workunit.client.0.smithi123.stdout:0/336: write d2/f5c [170886,64069] 0 2024-02-20T08:05:26.432 INFO:tasks.workunit.client.0.smithi123.stdout:0/337: write d2/dd/f41 [1747643,18076] 0 2024-02-20T08:05:26.434 INFO:tasks.workunit.client.0.smithi123.stdout:0/338: chown d2/de/d1e/c3d 0 1 2024-02-20T08:05:26.440 INFO:tasks.workunit.client.0.smithi123.stdout:0/339: dwrite d2/de/d19/d28/f2e [0,4194304] 0 2024-02-20T08:05:26.443 INFO:tasks.workunit.client.0.smithi123.stdout:0/340: write d2/dd/f41 [2756817,84326] 0 2024-02-20T08:05:26.446 INFO:tasks.workunit.client.0.smithi123.stdout:0/341: dread d2/d3/ff [0,4194304] 0 2024-02-20T08:05:26.449 INFO:tasks.workunit.client.0.smithi123.stdout:0/342: creat d2/dd/d4f/d61/f6d x:0 0 0 2024-02-20T08:05:26.451 INFO:tasks.workunit.client.0.smithi123.stdout:0/343: fdatasync d2/f6 0 2024-02-20T08:05:26.459 INFO:tasks.workunit.client.0.smithi123.stdout:0/344: link d2/l5d d2/de/d1e/l6e 0 2024-02-20T08:05:26.461 INFO:tasks.workunit.client.0.smithi123.stdout:0/345: fdatasync d2/de/d1e/f22 0 2024-02-20T08:05:26.474 INFO:tasks.workunit.client.0.smithi123.stdout:0/346: dwrite d2/f1b [0,4194304] 0 2024-02-20T08:05:26.476 INFO:tasks.workunit.client.0.smithi123.stdout:0/347: dread d2/de/d19/f45 [0,4194304] 0 2024-02-20T08:05:26.477 INFO:tasks.workunit.client.0.smithi123.stdout:0/348: creat d2/de/d1e/d1f/f6f x:0 0 0 2024-02-20T08:05:26.479 INFO:tasks.workunit.client.0.smithi123.stdout:0/349: fdatasync d2/d3/f9 0 2024-02-20T08:05:26.491 INFO:tasks.workunit.client.0.smithi123.stdout:0/350: creat d2/dd/d4f/d6a/f70 x:0 0 0 2024-02-20T08:05:26.493 INFO:tasks.workunit.client.0.smithi123.stdout:0/351: read d2/de/d1e/f35 [2972340,111549] 0 2024-02-20T08:05:26.503 INFO:tasks.workunit.client.0.smithi123.stdout:0/352: dwrite d2/f12 [0,4194304] 0 2024-02-20T08:05:26.504 INFO:tasks.workunit.client.0.smithi123.stdout:0/353: write d2/de/f51 [1864629,45662] 0 2024-02-20T08:05:26.505 INFO:tasks.workunit.client.0.smithi123.stdout:0/354: chown d2/f1b 89123361 1 2024-02-20T08:05:26.513 INFO:tasks.workunit.client.0.smithi123.stdout:0/355: dwrite d2/de/d19/f58 [0,4194304] 0 2024-02-20T08:05:26.517 INFO:tasks.workunit.client.0.smithi123.stdout:0/356: mknod d2/dd/d4f/d6a/c71 0 2024-02-20T08:05:26.519 INFO:tasks.workunit.client.0.smithi123.stdout:0/357: symlink d2/de/l72 0 2024-02-20T08:05:26.532 INFO:tasks.workunit.client.0.smithi123.stdout:0/358: truncate d2/f42 3226600 0 2024-02-20T08:05:26.533 INFO:tasks.workunit.client.0.smithi123.stdout:0/359: fdatasync d2/de/d1e/f35 0 2024-02-20T08:05:26.534 INFO:tasks.workunit.client.0.smithi123.stdout:0/360: read d2/f12 [3767790,89649] 0 2024-02-20T08:05:26.535 INFO:tasks.workunit.client.0.smithi123.stdout:0/361: chown d2/dd/d4f/d61/d68/f6b 102 1 2024-02-20T08:05:26.542 INFO:tasks.workunit.client.0.smithi123.stdout:0/362: getdents d2/de 0 2024-02-20T08:05:26.544 INFO:tasks.workunit.client.0.smithi123.stdout:0/363: symlink d2/dd/l73 0 2024-02-20T08:05:26.545 INFO:tasks.workunit.client.0.smithi123.stdout:0/364: read d2/de/d19/d28/f2e [1434139,126439] 0 2024-02-20T08:05:26.551 INFO:tasks.workunit.client.0.smithi123.stdout:0/365: dwrite d2/dd/f31 [4194304,4194304] 0 2024-02-20T08:05:26.552 INFO:tasks.workunit.client.0.smithi123.stdout:0/366: dread - d2/dd/d4f/d6a/f70 zero size 2024-02-20T08:05:26.554 INFO:tasks.workunit.client.0.smithi123.stdout:0/367: mkdir d2/de/d1e/d1f/d74 0 2024-02-20T08:05:26.556 INFO:tasks.workunit.client.0.smithi123.stdout:0/368: mknod d2/d3/c75 0 2024-02-20T08:05:26.570 INFO:tasks.workunit.client.0.smithi123.stdout:0/369: dwrite d2/f15 [0,4194304] 0 2024-02-20T08:05:26.574 INFO:tasks.workunit.client.0.smithi123.stdout:0/370: creat d2/dd/d4f/d61/d68/f76 x:0 0 0 2024-02-20T08:05:26.580 INFO:tasks.workunit.client.0.smithi123.stdout:0/371: dwrite d2/dd/f41 [0,4194304] 0 2024-02-20T08:05:26.585 INFO:tasks.workunit.client.0.smithi123.stdout:0/372: rename d2/d3/f9 to d2/de/d1e/d1f/f77 0 2024-02-20T08:05:26.644 INFO:tasks.workunit.client.0.smithi123.stdout:5/252: sync 2024-02-20T08:05:26.645 INFO:tasks.workunit.client.0.smithi123.stdout:5/253: truncate d0/d13/d27/d4e/f52 565883 0 2024-02-20T08:05:26.645 INFO:tasks.workunit.client.0.smithi123.stdout:5/254: chown d0/d13/d1f/d4c/l49 564 1 2024-02-20T08:05:26.646 INFO:tasks.workunit.client.0.smithi123.stdout:5/255: read d0/d13/d1f/d3e/f3f [805787,9314] 0 2024-02-20T08:05:26.692 INFO:tasks.workunit.client.0.smithi123.stdout:0/373: write d2/de/d19/d28/f2e [884255,48820] 0 2024-02-20T08:05:26.700 INFO:tasks.workunit.client.0.smithi123.stdout:0/374: dwrite d2/de/d1e/d1f/f29 [0,4194304] 0 2024-02-20T08:05:26.708 INFO:tasks.workunit.client.0.smithi123.stdout:0/375: dwrite d2/dd/d4f/d61/d68/f6c [0,4194304] 0 2024-02-20T08:05:26.710 INFO:tasks.workunit.client.0.smithi123.stdout:0/376: write d2/de/d1e/f46 [2460683,91881] 0 2024-02-20T08:05:26.711 INFO:tasks.workunit.client.0.smithi123.stdout:0/377: truncate d2/dd/f63 55574 0 2024-02-20T08:05:26.713 INFO:tasks.workunit.client.0.smithi123.stdout:0/378: mkdir d2/d54/d78 0 2024-02-20T08:05:26.717 INFO:tasks.workunit.client.0.smithi123.stdout:0/379: rename d2/l5d to d2/d3/d37/d5f/l79 0 2024-02-20T08:05:26.720 INFO:tasks.workunit.client.0.smithi123.stdout:0/380: creat d2/de/d1e/d1f/d5e/f7a x:0 0 0 2024-02-20T08:05:26.730 INFO:tasks.workunit.client.0.smithi123.stdout:0/381: dwrite d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:26.734 INFO:tasks.workunit.client.0.smithi123.stdout:0/382: rename d2/dd/f44 to d2/dd/d4f/d61/f7b 0 2024-02-20T08:05:26.892 INFO:tasks.workunit.client.0.smithi123.stdout:3/313: sync 2024-02-20T08:05:26.892 INFO:tasks.workunit.client.0.smithi123.stdout:6/373: sync 2024-02-20T08:05:26.893 INFO:tasks.workunit.client.0.smithi123.stdout:6/374: stat d0/d3e/d40/d48/d4a/l6c 0 2024-02-20T08:05:26.895 INFO:tasks.workunit.client.0.smithi123.stdout:6/375: creat d0/d3e/d40/d48/d7b/f7d x:0 0 0 2024-02-20T08:05:26.896 INFO:tasks.workunit.client.0.smithi123.stdout:6/376: write d0/d38/f3b [2674916,65315] 0 2024-02-20T08:05:26.897 INFO:tasks.workunit.client.0.smithi123.stdout:6/377: readlink d0/d38/l76 0 2024-02-20T08:05:26.901 INFO:tasks.workunit.client.0.smithi123.stdout:6/378: rename d0/d3e/d41/d56/d57/f70 to d0/d3e/d40/d48/d4a/d72/d73/d75/f7e 0 2024-02-20T08:05:26.903 INFO:tasks.workunit.client.0.smithi123.stdout:6/379: mkdir d0/d3e/d40/d7f 0 2024-02-20T08:05:26.905 INFO:tasks.workunit.client.0.smithi123.stdout:6/380: creat d0/d3e/d40/d48/d4a/d72/d73/f80 x:0 0 0 2024-02-20T08:05:26.907 INFO:tasks.workunit.client.0.smithi123.stdout:6/381: mknod d0/d3e/d40/d48/d4a/d72/d73/c81 0 2024-02-20T08:05:26.908 INFO:tasks.workunit.client.0.smithi123.stdout:6/382: chown d0/d3e/d40 827820173 1 2024-02-20T08:05:26.909 INFO:tasks.workunit.client.0.smithi123.stdout:6/383: chown d0/l5b 21621145 1 2024-02-20T08:05:26.910 INFO:tasks.workunit.client.0.smithi123.stdout:6/384: write d0/f14 [3097210,52863] 0 2024-02-20T08:05:26.913 INFO:tasks.workunit.client.0.smithi123.stdout:6/385: creat d0/d3e/d40/d48/d79/f82 x:0 0 0 2024-02-20T08:05:26.918 INFO:tasks.workunit.client.0.smithi123.stdout:6/386: creat d0/f83 x:0 0 0 2024-02-20T08:05:26.918 INFO:tasks.workunit.client.0.smithi123.stdout:6/387: stat d0/d3e/c59 0 2024-02-20T08:05:26.918 INFO:tasks.workunit.client.0.smithi123.stdout:6/388: stat d0/d3e/d40/d48 0 2024-02-20T08:05:26.923 INFO:tasks.workunit.client.0.smithi123.stdout:6/389: getdents d0/d3e/d41/d56 0 2024-02-20T08:05:26.925 INFO:tasks.workunit.client.0.smithi123.stdout:6/390: chown d0/c2d 7480 1 2024-02-20T08:05:26.926 INFO:tasks.workunit.client.0.smithi123.stdout:6/391: write d0/d3e/d40/d48/d79/f82 [32194,103471] 0 2024-02-20T08:05:26.927 INFO:tasks.workunit.client.0.smithi123.stdout:6/392: dread - d0/d38/f4f zero size 2024-02-20T08:05:26.959 INFO:tasks.workunit.client.0.smithi123.stdout:6/393: rmdir d0 39 2024-02-20T08:05:26.964 INFO:tasks.workunit.client.0.smithi123.stdout:6/394: getdents d0/d3e/d40/d48/d4a/d72/d73/d75 0 2024-02-20T08:05:26.966 INFO:tasks.workunit.client.0.smithi123.stdout:6/395: creat d0/f84 x:0 0 0 2024-02-20T08:05:26.967 INFO:tasks.workunit.client.0.smithi123.stdout:6/396: stat d0/d3e/d41/d56/d57/f6b 0 2024-02-20T08:05:26.968 INFO:tasks.workunit.client.0.smithi123.stdout:6/397: symlink d0/d3e/d41/l85 0 2024-02-20T08:05:26.969 INFO:tasks.workunit.client.0.smithi123.stdout:6/398: dread - d0/d3e/d40/d48/d4a/d72/d73/d75/f7e zero size 2024-02-20T08:05:26.970 INFO:tasks.workunit.client.0.smithi123.stdout:6/399: write d0/d3e/d40/d48/d7b/f7d [281657,90340] 0 2024-02-20T08:05:26.972 INFO:tasks.workunit.client.0.smithi123.stdout:6/400: rename d0/d38/c60 to d0/d3e/d40/d48/d4a/d72/c86 0 2024-02-20T08:05:26.975 INFO:tasks.workunit.client.0.smithi123.stdout:6/401: creat d0/f87 x:0 0 0 2024-02-20T08:05:26.980 INFO:tasks.workunit.client.0.smithi123.stdout:6/402: dwrite d0/f13 [4194304,4194304] 0 2024-02-20T08:05:26.982 INFO:tasks.workunit.client.0.smithi123.stdout:6/403: dread - d0/d3e/d40/d48/d5d/f62 zero size 2024-02-20T08:05:26.984 INFO:tasks.workunit.client.0.smithi123.stdout:8/301: sync 2024-02-20T08:05:26.984 INFO:tasks.workunit.client.0.smithi123.stdout:4/314: sync 2024-02-20T08:05:26.986 INFO:tasks.workunit.client.0.smithi123.stdout:8/302: write d6/d32/f65 [362349,54060] 0 2024-02-20T08:05:26.990 INFO:tasks.workunit.client.0.smithi123.stdout:8/303: mknod d6/d1c/d22/c66 0 2024-02-20T08:05:26.990 INFO:tasks.workunit.client.0.smithi123.stdout:6/404: dwrite d0/d3e/d41/d56/f5a [0,4194304] 0 2024-02-20T08:05:26.991 INFO:tasks.workunit.client.0.smithi123.stdout:8/304: chown d6/fc 15214 1 2024-02-20T08:05:26.991 INFO:tasks.workunit.client.0.smithi123.stdout:6/405: write d0/f51 [762883,52403] 0 2024-02-20T08:05:26.992 INFO:tasks.workunit.client.0.smithi123.stdout:6/406: stat d0/d38 0 2024-02-20T08:05:26.993 INFO:tasks.workunit.client.0.smithi123.stdout:4/315: link d3/d18/f19 d3/d2c/d5a/f6b 0 2024-02-20T08:05:26.993 INFO:tasks.workunit.client.0.smithi123.stdout:6/407: chown d0/d3e/d41/d56/c65 1 1 2024-02-20T08:05:26.996 INFO:tasks.workunit.client.0.smithi123.stdout:4/316: mkdir d3/d18/d6c 0 2024-02-20T08:05:26.997 INFO:tasks.workunit.client.0.smithi123.stdout:4/317: stat d3/d18/f51 0 2024-02-20T08:05:26.998 INFO:tasks.workunit.client.0.smithi123.stdout:6/408: symlink d0/d38/l88 0 2024-02-20T08:05:27.006 INFO:tasks.workunit.client.0.smithi123.stdout:4/318: link d3/d2c/d43/d34/f3b d3/d2c/d43/d26/d3e/f6d 0 2024-02-20T08:05:27.006 INFO:tasks.workunit.client.0.smithi123.stdout:6/409: getdents d0/d3e/d41/d56 0 2024-02-20T08:05:27.007 INFO:tasks.workunit.client.0.smithi123.stdout:4/319: write d3/d2c/d43/f50 [3863121,35014] 0 2024-02-20T08:05:27.011 INFO:tasks.workunit.client.0.smithi123.stdout:4/320: mknod d3/d2c/d5a/c6e 0 2024-02-20T08:05:27.013 INFO:tasks.workunit.client.0.smithi123.stdout:6/410: dwrite d0/f21 [0,4194304] 0 2024-02-20T08:05:27.013 INFO:tasks.workunit.client.0.smithi123.stdout:6/411: chown d0/l1f 2584 1 2024-02-20T08:05:27.014 INFO:tasks.workunit.client.0.smithi123.stdout:6/412: dread - d0/f83 zero size 2024-02-20T08:05:27.015 INFO:tasks.workunit.client.0.smithi123.stdout:4/321: symlink d3/d2c/d43/d26/d2e/l6f 0 2024-02-20T08:05:27.015 INFO:tasks.workunit.client.0.smithi123.stdout:6/413: write d0/d38/f55 [3497227,99193] 0 2024-02-20T08:05:27.018 INFO:tasks.workunit.client.0.smithi123.stdout:6/414: write d0/d3e/d40/d48/d4a/d72/d73/f80 [626916,5113] 0 2024-02-20T08:05:27.020 INFO:tasks.workunit.client.0.smithi123.stdout:6/415: write d0/d3e/d41/d56/d57/f6b [50716,81590] 0 2024-02-20T08:05:27.020 INFO:tasks.workunit.client.0.smithi123.stdout:4/322: symlink d3/d2c/d43/d26/d3e/l70 0 2024-02-20T08:05:27.021 INFO:tasks.workunit.client.0.smithi123.stdout:4/323: write d3/d2c/d43/d34/f55 [651751,19819] 0 2024-02-20T08:05:27.023 INFO:tasks.workunit.client.0.smithi123.stdout:4/324: dread - d3/d2c/d43/d34/f4f zero size 2024-02-20T08:05:27.023 INFO:tasks.workunit.client.0.smithi123.stdout:4/325: fdatasync d3/ff 0 2024-02-20T08:05:27.027 INFO:tasks.workunit.client.0.smithi123.stdout:4/326: mknod d3/d1e/c71 0 2024-02-20T08:05:27.028 INFO:tasks.workunit.client.0.smithi123.stdout:4/327: write d3/d2c/d43/d34/f4f [381919,92072] 0 2024-02-20T08:05:27.029 INFO:tasks.workunit.client.0.smithi123.stdout:4/328: fdatasync d3/d2c/d43/d26/d2e/f52 0 2024-02-20T08:05:27.032 INFO:tasks.workunit.client.0.smithi123.stdout:4/329: creat d3/d2c/d43/d26/d3e/f72 x:0 0 0 2024-02-20T08:05:27.045 INFO:tasks.workunit.client.0.smithi123.stdout:4/330: dread d3/d2c/d43/f44 [0,4194304] 0 2024-02-20T08:05:27.050 INFO:tasks.workunit.client.0.smithi123.stdout:4/331: link d3/d2c/d5a/l5c d3/d2c/d43/d26/d2e/l73 0 2024-02-20T08:05:27.061 INFO:tasks.workunit.client.0.smithi123.stdout:4/332: dread d3/d18/f23 [0,4194304] 0 2024-02-20T08:05:27.061 INFO:tasks.workunit.client.0.smithi123.stdout:4/333: fsync d3/d2c/d43/d26/f29 0 2024-02-20T08:05:27.062 INFO:tasks.workunit.client.0.smithi123.stdout:4/334: chown d3/d2c 1 1 2024-02-20T08:05:27.063 INFO:tasks.workunit.client.0.smithi123.stdout:4/335: chown d3/l7 27967978 1 2024-02-20T08:05:27.065 INFO:tasks.workunit.client.0.smithi123.stdout:4/336: symlink d3/d18/d6c/l74 0 2024-02-20T08:05:27.065 INFO:tasks.workunit.client.0.smithi123.stdout:4/337: chown d3/d2c/d5a/f6b 13944 1 2024-02-20T08:05:27.068 INFO:tasks.workunit.client.0.smithi123.stdout:4/338: rename d3/d18/f30 to d3/d2c/d43/f75 0 2024-02-20T08:05:27.068 INFO:tasks.workunit.client.0.smithi123.stdout:4/339: read - d3/f4d zero size 2024-02-20T08:05:27.072 INFO:tasks.workunit.client.0.smithi123.stdout:4/340: rename d3/c5 to d3/d18/d63/c76 0 2024-02-20T08:05:27.074 INFO:tasks.workunit.client.0.smithi123.stdout:4/341: link d3/f4d d3/d18/f77 0 2024-02-20T08:05:27.088 INFO:tasks.workunit.client.0.smithi123.stdout:4/342: dwrite d3/d18/f1d [0,4194304] 0 2024-02-20T08:05:27.090 INFO:tasks.workunit.client.0.smithi123.stdout:4/343: stat d3/l11 0 2024-02-20T08:05:27.094 INFO:tasks.workunit.client.0.smithi123.stdout:4/344: write d3/d2c/d5a/f6b [2426274,129947] 0 2024-02-20T08:05:27.096 INFO:tasks.workunit.client.0.smithi123.stdout:4/345: write d3/d2c/d43/d34/f58 [228086,74144] 0 2024-02-20T08:05:27.097 INFO:tasks.workunit.client.0.smithi123.stdout:4/346: readlink d3/d2c/d43/l68 0 2024-02-20T08:05:27.099 INFO:tasks.workunit.client.0.smithi123.stdout:4/347: symlink d3/d18/l78 0 2024-02-20T08:05:27.109 INFO:tasks.workunit.client.0.smithi123.stdout:0/383: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:3/314: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:2/292: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:7/287: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:9/285: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:1/322: sync 2024-02-20T08:05:27.110 INFO:tasks.workunit.client.0.smithi123.stdout:5/256: sync 2024-02-20T08:05:27.111 INFO:tasks.workunit.client.0.smithi123.stdout:7/288: fsync d0/d23/f2d 0 2024-02-20T08:05:27.111 INFO:tasks.workunit.client.0.smithi123.stdout:2/293: fsync d1a/d29/d42/d52/f56 0 2024-02-20T08:05:27.112 INFO:tasks.workunit.client.0.smithi123.stdout:0/384: fdatasync d2/f8 0 2024-02-20T08:05:27.116 INFO:tasks.workunit.client.0.smithi123.stdout:4/348: link d3/d2c/d43/d26/d2e/l73 d3/d2c/d43/d26/d2e/l79 0 2024-02-20T08:05:27.123 INFO:tasks.workunit.client.0.smithi123.stdout:7/289: creat d0/db/d21/f67 x:0 0 0 2024-02-20T08:05:27.126 INFO:tasks.workunit.client.0.smithi123.stdout:0/385: dwrite d2/de/f17 [0,4194304] 0 2024-02-20T08:05:27.126 INFO:tasks.workunit.client.0.smithi123.stdout:3/315: symlink d0/d6/d1a/d1b/d1c/d3b/d43/l72 0 2024-02-20T08:05:27.134 INFO:tasks.workunit.client.0.smithi123.stdout:2/294: dread d1a/f23 [0,4194304] 0 2024-02-20T08:05:27.147 INFO:tasks.workunit.client.0.smithi123.stdout:9/286: creat d6/f58 x:0 0 0 2024-02-20T08:05:27.156 INFO:tasks.workunit.client.0.smithi123.stdout:3/316: symlink d0/d6/d1a/d1b/d57/l73 0 2024-02-20T08:05:27.158 INFO:tasks.workunit.client.0.smithi123.stdout:9/287: creat d6/d2a/f59 x:0 0 0 2024-02-20T08:05:27.160 INFO:tasks.workunit.client.0.smithi123.stdout:0/386: write d2/de/d1e/f22 [2156705,13958] 0 2024-02-20T08:05:27.161 INFO:tasks.workunit.client.0.smithi123.stdout:0/387: dread - d2/de/f60 zero size 2024-02-20T08:05:27.162 INFO:tasks.workunit.client.0.smithi123.stdout:5/257: rename d0/l2 to d0/d13/l55 0 2024-02-20T08:05:27.163 INFO:tasks.workunit.client.0.smithi123.stdout:1/323: truncate d3/de/d14/d26/d2e/f40 2181022 0 2024-02-20T08:05:27.165 INFO:tasks.workunit.client.0.smithi123.stdout:1/324: dread d3/fa [0,4194304] 0 2024-02-20T08:05:27.165 INFO:tasks.workunit.client.0.smithi123.stdout:7/290: mkdir d0/d6/d7/d68 0 2024-02-20T08:05:27.168 INFO:tasks.workunit.client.0.smithi123.stdout:4/349: truncate d3/d2c/d43/f44 1333333 0 2024-02-20T08:05:27.170 INFO:tasks.workunit.client.0.smithi123.stdout:1/325: dread d3/db/f31 [0,4194304] 0 2024-02-20T08:05:27.171 INFO:tasks.workunit.client.0.smithi123.stdout:0/388: mkdir d2/dd/d4f/d7c 0 2024-02-20T08:05:27.172 INFO:tasks.workunit.client.0.smithi123.stdout:1/326: truncate d3/de/f5a 1255302 0 2024-02-20T08:05:27.174 INFO:tasks.workunit.client.0.smithi123.stdout:5/258: rename d0/d13/d1f to d0/d34/d48/d56 0 2024-02-20T08:05:27.175 INFO:tasks.workunit.client.0.smithi123.stdout:4/350: dwrite d3/d2c/d43/d34/f4f [0,4194304] 0 2024-02-20T08:05:27.179 INFO:tasks.workunit.client.0.smithi123.stdout:3/317: mkdir d0/dd/d48/d6a/d74 0 2024-02-20T08:05:27.183 INFO:tasks.workunit.client.0.smithi123.stdout:2/295: getdents d1a/d29/d39 0 2024-02-20T08:05:27.188 INFO:tasks.workunit.client.0.smithi123.stdout:0/389: creat d2/dd/d4f/d61/f7d x:0 0 0 2024-02-20T08:05:27.192 INFO:tasks.workunit.client.0.smithi123.stdout:0/390: dread d2/de/d19/d28/f2e [0,4194304] 0 2024-02-20T08:05:27.194 INFO:tasks.workunit.client.0.smithi123.stdout:0/391: write d2/de/f60 [722292,102894] 0 2024-02-20T08:05:27.194 INFO:tasks.workunit.client.0.smithi123.stdout:7/291: rename d0/db/d38/d47/c50 to d0/db/d38/d47/d4a/d5d/c69 0 2024-02-20T08:05:27.196 INFO:tasks.workunit.client.0.smithi123.stdout:7/292: write d0/db/d38/f43 [460660,105334] 0 2024-02-20T08:05:27.199 INFO:tasks.workunit.client.0.smithi123.stdout:4/351: mknod d3/d18/c7a 0 2024-02-20T08:05:27.199 INFO:tasks.workunit.client.0.smithi123.stdout:3/318: dread d0/d6/d32/f4e [0,4194304] 0 2024-02-20T08:05:27.200 INFO:tasks.workunit.client.0.smithi123.stdout:4/352: chown d3/l7 1481 1 2024-02-20T08:05:27.201 INFO:tasks.workunit.client.0.smithi123.stdout:9/288: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:27.201 INFO:tasks.workunit.client.0.smithi123.stdout:4/353: stat d3/d1e/f60 0 2024-02-20T08:05:27.202 INFO:tasks.workunit.client.0.smithi123.stdout:4/354: write d3/d1e/f2d [5226412,66904] 0 2024-02-20T08:05:27.206 INFO:tasks.workunit.client.0.smithi123.stdout:8/305: sync 2024-02-20T08:05:27.207 INFO:tasks.workunit.client.0.smithi123.stdout:2/296: stat d1a/f27 0 2024-02-20T08:05:27.208 INFO:tasks.workunit.client.0.smithi123.stdout:8/306: truncate d6/d1c/d22/f4b 845526 0 2024-02-20T08:05:27.216 INFO:tasks.workunit.client.0.smithi123.stdout:5/259: symlink d0/d13/d27/l57 0 2024-02-20T08:05:27.218 INFO:tasks.workunit.client.0.smithi123.stdout:7/293: creat d0/db/d38/f6a x:0 0 0 2024-02-20T08:05:27.220 INFO:tasks.workunit.client.0.smithi123.stdout:3/319: mknod d0/d6/d1a/d1b/d1c/d20/c75 0 2024-02-20T08:05:27.221 INFO:tasks.workunit.client.0.smithi123.stdout:3/320: chown d0/d6/d1a/d1b/d1c/d21/d64 14544 1 2024-02-20T08:05:27.223 INFO:tasks.workunit.client.0.smithi123.stdout:9/289: creat d6/d2a/d27/f5a x:0 0 0 2024-02-20T08:05:27.224 INFO:tasks.workunit.client.0.smithi123.stdout:9/290: dread - d6/d2a/d27/f5a zero size 2024-02-20T08:05:27.234 INFO:tasks.workunit.client.0.smithi123.stdout:1/327: link d3/db/c28 d3/db/d34/c71 0 2024-02-20T08:05:27.240 INFO:tasks.workunit.client.0.smithi123.stdout:5/260: symlink d0/d13/d27/d37/l58 0 2024-02-20T08:05:27.242 INFO:tasks.workunit.client.0.smithi123.stdout:5/261: write d0/d34/d48/d4b/f4f [722053,125908] 0 2024-02-20T08:05:27.244 INFO:tasks.workunit.client.0.smithi123.stdout:7/294: creat d0/db/d21/f6b x:0 0 0 2024-02-20T08:05:27.249 INFO:tasks.workunit.client.0.smithi123.stdout:2/297: mknod d1a/d29/c58 0 2024-02-20T08:05:27.251 INFO:tasks.workunit.client.0.smithi123.stdout:4/355: dwrite d3/f4d [0,4194304] 0 2024-02-20T08:05:27.253 INFO:tasks.workunit.client.0.smithi123.stdout:0/392: link d2/c38 d2/de/d19/d28/c7e 0 2024-02-20T08:05:27.257 INFO:tasks.workunit.client.0.smithi123.stdout:5/262: creat d0/d34/d48/d56/d25/f59 x:0 0 0 2024-02-20T08:05:27.257 INFO:tasks.workunit.client.0.smithi123.stdout:0/393: read d2/f5c [115777,89187] 0 2024-02-20T08:05:27.258 INFO:tasks.workunit.client.0.smithi123.stdout:2/298: dwrite d1a/d29/d42/f49 [0,4194304] 0 2024-02-20T08:05:27.259 INFO:tasks.workunit.client.0.smithi123.stdout:0/394: chown d2/de/d1e/f35 589064325 1 2024-02-20T08:05:27.260 INFO:tasks.workunit.client.0.smithi123.stdout:0/395: read - d2/de/d1e/d1f/f6f zero size 2024-02-20T08:05:27.265 INFO:tasks.workunit.client.0.smithi123.stdout:1/328: creat d3/df/d6f/d63/f72 x:0 0 0 2024-02-20T08:05:27.267 INFO:tasks.workunit.client.0.smithi123.stdout:1/329: chown d3/df/f11 1 1 2024-02-20T08:05:27.268 INFO:tasks.workunit.client.0.smithi123.stdout:0/396: dwrite d2/de/d1e/f22 [0,4194304] 0 2024-02-20T08:05:27.269 INFO:tasks.workunit.client.0.smithi123.stdout:6/416: sync 2024-02-20T08:05:27.269 INFO:tasks.workunit.client.0.smithi123.stdout:6/417: chown d0/f1e 62384 1 2024-02-20T08:05:27.274 INFO:tasks.workunit.client.0.smithi123.stdout:4/356: dread d3/d2c/d43/d26/d3e/f6d [0,4194304] 0 2024-02-20T08:05:27.276 INFO:tasks.workunit.client.0.smithi123.stdout:6/418: dwrite d0/f21 [0,4194304] 0 2024-02-20T08:05:27.280 INFO:tasks.workunit.client.0.smithi123.stdout:9/291: creat d6/d19/d1a/f5b x:0 0 0 2024-02-20T08:05:27.283 INFO:tasks.workunit.client.0.smithi123.stdout:2/299: rename d1a/f23 to d1a/d29/d39/f59 0 2024-02-20T08:05:27.287 INFO:tasks.workunit.client.0.smithi123.stdout:8/307: getdents d6/d1c/d47 0 2024-02-20T08:05:27.289 INFO:tasks.workunit.client.0.smithi123.stdout:1/330: creat d3/de/d14/d26/f73 x:0 0 0 2024-02-20T08:05:27.292 INFO:tasks.workunit.client.0.smithi123.stdout:8/308: dwrite d6/d1c/d22/f4b [0,4194304] 0 2024-02-20T08:05:27.293 INFO:tasks.workunit.client.0.smithi123.stdout:0/397: creat d2/dd/d4f/d6a/f7f x:0 0 0 2024-02-20T08:05:27.301 INFO:tasks.workunit.client.0.smithi123.stdout:4/357: creat d3/d1e/f7b x:0 0 0 2024-02-20T08:05:27.303 INFO:tasks.workunit.client.0.smithi123.stdout:5/263: getdents d0/d34/d48/d4b/d51 0 2024-02-20T08:05:27.305 INFO:tasks.workunit.client.0.smithi123.stdout:9/292: symlink d6/d19/d1b/d3d/d32/l5c 0 2024-02-20T08:05:27.306 INFO:tasks.workunit.client.0.smithi123.stdout:9/293: truncate d6/f12 4694575 0 2024-02-20T08:05:27.310 INFO:tasks.workunit.client.0.smithi123.stdout:6/419: rename d0/d3e/d40/d48/d4a/d72 to d0/d3e/d41/d56/d89 0 2024-02-20T08:05:27.310 INFO:tasks.workunit.client.0.smithi123.stdout:3/321: truncate d0/d6/f2e 3934303 0 2024-02-20T08:05:27.312 INFO:tasks.workunit.client.0.smithi123.stdout:6/420: truncate d0/d3e/d40/d48/d79/f82 977654 0 2024-02-20T08:05:27.318 INFO:tasks.workunit.client.0.smithi123.stdout:7/295: getdents d0/db/d38/d47 0 2024-02-20T08:05:27.321 INFO:tasks.workunit.client.0.smithi123.stdout:4/358: creat d3/d2c/d43/d34/f7c x:0 0 0 2024-02-20T08:05:27.323 INFO:tasks.workunit.client.0.smithi123.stdout:4/359: write d3/d1e/f59 [1209801,38128] 0 2024-02-20T08:05:27.326 INFO:tasks.workunit.client.0.smithi123.stdout:3/322: dread d0/d6/d1a/d1e/f17 [0,4194304] 0 2024-02-20T08:05:27.326 INFO:tasks.workunit.client.0.smithi123.stdout:7/296: dwrite d0/db/d38/f6a [0,4194304] 0 2024-02-20T08:05:27.327 INFO:tasks.workunit.client.0.smithi123.stdout:2/300: symlink d1a/d4f/l5a 0 2024-02-20T08:05:27.328 INFO:tasks.workunit.client.0.smithi123.stdout:2/301: dread - d1a/d29/d42/d52/f56 zero size 2024-02-20T08:05:27.329 INFO:tasks.workunit.client.0.smithi123.stdout:2/302: dread - d1a/d29/d39/f3a zero size 2024-02-20T08:05:27.329 INFO:tasks.workunit.client.0.smithi123.stdout:2/303: fsync d1a/d29/f35 0 2024-02-20T08:05:27.330 INFO:tasks.workunit.client.0.smithi123.stdout:2/304: stat c1 0 2024-02-20T08:05:27.331 INFO:tasks.workunit.client.0.smithi123.stdout:1/331: rename d3/df to d3/db/d34/d74 0 2024-02-20T08:05:27.336 INFO:tasks.workunit.client.0.smithi123.stdout:0/398: mknod d2/dd/d4f/d7c/c80 0 2024-02-20T08:05:27.342 INFO:tasks.workunit.client.0.smithi123.stdout:0/399: dread d2/de/d1e/f22 [0,4194304] 0 2024-02-20T08:05:27.343 INFO:tasks.workunit.client.0.smithi123.stdout:5/264: mknod d0/d34/d48/d56/d4c/d43/c5a 0 2024-02-20T08:05:27.347 INFO:tasks.workunit.client.0.smithi123.stdout:4/360: mkdir d3/d18/d7d 0 2024-02-20T08:05:27.349 INFO:tasks.workunit.client.0.smithi123.stdout:9/294: creat d6/d19/d1a/d2b/d28/d50/f5d x:0 0 0 2024-02-20T08:05:27.349 INFO:tasks.workunit.client.0.smithi123.stdout:9/295: stat d6 0 2024-02-20T08:05:27.351 INFO:tasks.workunit.client.0.smithi123.stdout:3/323: mknod d0/dd/d48/c76 0 2024-02-20T08:05:27.356 INFO:tasks.workunit.client.0.smithi123.stdout:2/305: write d1a/f1e [889486,103087] 0 2024-02-20T08:05:27.357 INFO:tasks.workunit.client.0.smithi123.stdout:2/306: chown fc 212 1 2024-02-20T08:05:27.357 INFO:tasks.workunit.client.0.smithi123.stdout:2/307: chown d1a/c57 80 1 2024-02-20T08:05:27.362 INFO:tasks.workunit.client.0.smithi123.stdout:6/421: mknod d0/d3e/c8a 0 2024-02-20T08:05:27.363 INFO:tasks.workunit.client.0.smithi123.stdout:6/422: chown d0/d3e/d41/d56/d89/d73/c81 4058960 1 2024-02-20T08:05:27.363 INFO:tasks.workunit.client.0.smithi123.stdout:6/423: chown d0 1 1 2024-02-20T08:05:27.371 INFO:tasks.workunit.client.0.smithi123.stdout:8/309: truncate d6/d32/f4a 132507 0 2024-02-20T08:05:27.378 INFO:tasks.workunit.client.0.smithi123.stdout:5/265: chown d0/f19 3018263 1 2024-02-20T08:05:27.381 INFO:tasks.workunit.client.0.smithi123.stdout:9/296: mknod d6/d2a/d27/c5e 0 2024-02-20T08:05:27.382 INFO:tasks.workunit.client.0.smithi123.stdout:9/297: read - d6/d2a/d27/f54 zero size 2024-02-20T08:05:27.382 INFO:tasks.workunit.client.0.smithi123.stdout:9/298: write f5 [2512075,65726] 0 2024-02-20T08:05:27.398 INFO:tasks.workunit.client.0.smithi123.stdout:3/324: rename d0/d6/d1a/d1b/d1c/d3b/d43/c4a to d0/d6/d1a/d1e/c77 0 2024-02-20T08:05:27.398 INFO:tasks.workunit.client.0.smithi123.stdout:1/332: truncate d3/f48 1837636 0 2024-02-20T08:05:27.399 INFO:tasks.workunit.client.0.smithi123.stdout:6/424: creat d0/d3e/d40/d48/d79/f8b x:0 0 0 2024-02-20T08:05:27.400 INFO:tasks.workunit.client.0.smithi123.stdout:3/325: chown d0/d6/d1a/d1b/d1c/d21/d5e/l67 0 1 2024-02-20T08:05:27.400 INFO:tasks.workunit.client.0.smithi123.stdout:7/297: mknod d0/d6/d7/d68/c6c 0 2024-02-20T08:05:27.402 INFO:tasks.workunit.client.0.smithi123.stdout:9/299: mknod d6/d19/d1a/c5f 0 2024-02-20T08:05:27.404 INFO:tasks.workunit.client.0.smithi123.stdout:8/310: rename d6/d1c/d22/f4b to d6/d1c/d29/f67 0 2024-02-20T08:05:27.513 INFO:tasks.workunit.client.0.smithi123.stdout:7/298: unlink d0/l13 0 2024-02-20T08:05:27.513 INFO:tasks.workunit.client.0.smithi123.stdout:3/326: mknod d0/d6/d34/c78 0 2024-02-20T08:05:27.516 INFO:tasks.workunit.client.0.smithi123.stdout:0/400: truncate d2/de/f51 440397 0 2024-02-20T08:05:27.516 INFO:tasks.workunit.client.0.smithi123.stdout:4/361: truncate d3/d18/f1c 2497622 0 2024-02-20T08:05:27.518 INFO:tasks.workunit.client.0.smithi123.stdout:8/311: dwrite d6/d1c/d47/f62 [0,4194304] 0 2024-02-20T08:05:27.519 INFO:tasks.workunit.client.0.smithi123.stdout:4/362: fsync d3/d2c/f54 0 2024-02-20T08:05:27.519 INFO:tasks.workunit.client.0.smithi123.stdout:4/363: chown d3 24471 1 2024-02-20T08:05:27.521 INFO:tasks.workunit.client.0.smithi123.stdout:5/266: rename d0/ld to d0/d34/d48/d56/d3e/l5b 0 2024-02-20T08:05:27.521 INFO:tasks.workunit.client.0.smithi123.stdout:0/401: write d2/de/d1e/d1f/f29 [1013086,71024] 0 2024-02-20T08:05:27.523 INFO:tasks.workunit.client.0.smithi123.stdout:1/333: getdents d3/db/d34 0 2024-02-20T08:05:27.523 INFO:tasks.workunit.client.0.smithi123.stdout:8/312: write d6/d1c/d47/f62 [1881611,128116] 0 2024-02-20T08:05:27.524 INFO:tasks.workunit.client.0.smithi123.stdout:0/402: write d2/dd/f50 [146477,80455] 0 2024-02-20T08:05:27.526 INFO:tasks.workunit.client.0.smithi123.stdout:0/403: write d2/dd/f31 [238996,52958] 0 2024-02-20T08:05:27.529 INFO:tasks.workunit.client.0.smithi123.stdout:4/364: mkdir d3/d2c/d5a/d7e 0 2024-02-20T08:05:27.533 INFO:tasks.workunit.client.0.smithi123.stdout:5/267: symlink d0/d34/d48/d56/d25/l5c 0 2024-02-20T08:05:27.534 INFO:tasks.workunit.client.0.smithi123.stdout:5/268: fdatasync d0/d34/d48/d56/f1a 0 2024-02-20T08:05:27.535 INFO:tasks.workunit.client.0.smithi123.stdout:5/269: stat d0/d34/d48/d56/d4c/d43/c5a 0 2024-02-20T08:05:27.537 INFO:tasks.workunit.client.0.smithi123.stdout:8/313: rmdir d6/d1c/d29 39 2024-02-20T08:05:27.544 INFO:tasks.workunit.client.0.smithi123.stdout:4/365: creat d3/d2c/d43/d26/d2e/f7f x:0 0 0 2024-02-20T08:05:27.545 INFO:tasks.workunit.client.0.smithi123.stdout:4/366: truncate d3/d2c/d43/f50 4217523 0 2024-02-20T08:05:27.546 INFO:tasks.workunit.client.0.smithi123.stdout:8/314: stat d6/d1c/d22/l52 0 2024-02-20T08:05:27.547 INFO:tasks.workunit.client.0.smithi123.stdout:1/334: symlink d3/de/d14/d2c/d45/l75 0 2024-02-20T08:05:27.552 INFO:tasks.workunit.client.0.smithi123.stdout:6/425: rename d0/d5c/c77 to d0/d3e/d40/d48/c8c 0 2024-02-20T08:05:27.553 INFO:tasks.workunit.client.0.smithi123.stdout:4/367: rmdir d3/d2c/d5a 39 2024-02-20T08:05:27.555 INFO:tasks.workunit.client.0.smithi123.stdout:8/315: mknod d6/d1c/d2c/c68 0 2024-02-20T08:05:27.556 INFO:tasks.workunit.client.0.smithi123.stdout:1/335: chown d3/de/d14/l29 14235945 1 2024-02-20T08:05:27.558 INFO:tasks.workunit.client.0.smithi123.stdout:4/368: mknod d3/d1e/c80 0 2024-02-20T08:05:27.559 INFO:tasks.workunit.client.0.smithi123.stdout:4/369: write d3/d2c/d43/d34/f58 [800447,84393] 0 2024-02-20T08:05:27.565 INFO:tasks.workunit.client.0.smithi123.stdout:3/327: rename d0/d6/d32/c45 to d0/d6/d1a/c79 0 2024-02-20T08:05:27.567 INFO:tasks.workunit.client.0.smithi123.stdout:4/370: mkdir d3/d1e/d81 0 2024-02-20T08:05:27.568 INFO:tasks.workunit.client.0.smithi123.stdout:4/371: stat d3/d2c/d43/d34 0 2024-02-20T08:05:27.571 INFO:tasks.workunit.client.0.smithi123.stdout:7/299: rename d0/d6/dd/d52/d26/f2e to d0/db/d38/d47/f6d 0 2024-02-20T08:05:27.572 INFO:tasks.workunit.client.0.smithi123.stdout:7/300: write d0/f37 [139722,127440] 0 2024-02-20T08:05:27.577 INFO:tasks.workunit.client.0.smithi123.stdout:5/270: rename d0/ca to d0/d34/c5d 0 2024-02-20T08:05:27.579 INFO:tasks.workunit.client.0.smithi123.stdout:8/316: getdents d6/d1c/d29 0 2024-02-20T08:05:27.583 INFO:tasks.workunit.client.0.smithi123.stdout:4/372: creat d3/d2c/d5a/d7e/f82 x:0 0 0 2024-02-20T08:05:27.584 INFO:tasks.workunit.client.0.smithi123.stdout:8/317: mknod d6/d1c/d22/d4f/d5b/c69 0 2024-02-20T08:05:27.587 INFO:tasks.workunit.client.0.smithi123.stdout:4/373: dread d3/d2c/d43/f75 [4194304,4194304] 0 2024-02-20T08:05:27.588 INFO:tasks.workunit.client.0.smithi123.stdout:7/301: dread d0/db/d38/d47/f6d [0,4194304] 0 2024-02-20T08:05:27.591 INFO:tasks.workunit.client.0.smithi123.stdout:8/318: creat d6/d1c/d2c/f6a x:0 0 0 2024-02-20T08:05:27.593 INFO:tasks.workunit.client.0.smithi123.stdout:6/426: rename d0/d38/f49 to d0/d3e/d40/f8d 0 2024-02-20T08:05:27.593 INFO:tasks.workunit.client.0.smithi123.stdout:6/427: stat d0/d38/l88 0 2024-02-20T08:05:27.593 INFO:tasks.workunit.client.0.smithi123.stdout:6/428: stat d0/f15 0 2024-02-20T08:05:27.595 INFO:tasks.workunit.client.0.smithi123.stdout:1/336: rmdir d3/de/d14/d2c 39 2024-02-20T08:05:27.597 INFO:tasks.workunit.client.0.smithi123.stdout:5/271: creat d0/d34/d48/d56/f5e x:0 0 0 2024-02-20T08:05:27.598 INFO:tasks.workunit.client.0.smithi123.stdout:0/404: truncate d2/d3/f24 3642213 0 2024-02-20T08:05:27.599 INFO:tasks.workunit.client.0.smithi123.stdout:0/405: dread - d2/dd/d4f/d61/f6d zero size 2024-02-20T08:05:27.599 INFO:tasks.workunit.client.0.smithi123.stdout:7/302: creat d0/d6/d29/f6e x:0 0 0 2024-02-20T08:05:27.600 INFO:tasks.workunit.client.0.smithi123.stdout:7/303: readlink d0/d6/dd/d52/l24 0 2024-02-20T08:05:27.602 INFO:tasks.workunit.client.0.smithi123.stdout:8/319: creat d6/d1c/d22/f6b x:0 0 0 2024-02-20T08:05:27.604 INFO:tasks.workunit.client.0.smithi123.stdout:6/429: rmdir d0/d3e/d41 39 2024-02-20T08:05:27.606 INFO:tasks.workunit.client.0.smithi123.stdout:1/337: dread - d3/de/d14/d2c/d45/f4d zero size 2024-02-20T08:05:27.607 INFO:tasks.workunit.client.0.smithi123.stdout:5/272: rmdir d0/d13/d27/d37 39 2024-02-20T08:05:27.609 INFO:tasks.workunit.client.0.smithi123.stdout:0/406: mkdir d2/dd/d4f/d61/d81 0 2024-02-20T08:05:27.614 INFO:tasks.workunit.client.0.smithi123.stdout:5/273: fdatasync d0/d34/d48/d56/d25/f3b 0 2024-02-20T08:05:27.614 INFO:tasks.workunit.client.0.smithi123.stdout:1/338: dread d3/db/f31 [0,4194304] 0 2024-02-20T08:05:27.615 INFO:tasks.workunit.client.0.smithi123.stdout:7/304: mknod d0/d6/dd/d52/c6f 0 2024-02-20T08:05:27.617 INFO:tasks.workunit.client.0.smithi123.stdout:3/328: rename d0/d6/d1a/d1b/d1c/d20/c46 to d0/d6/c7a 0 2024-02-20T08:05:27.619 INFO:tasks.workunit.client.0.smithi123.stdout:6/430: unlink d0/l32 0 2024-02-20T08:05:27.621 INFO:tasks.workunit.client.0.smithi123.stdout:5/274: unlink d0/f3d 0 2024-02-20T08:05:27.624 INFO:tasks.workunit.client.0.smithi123.stdout:1/339: write d3/de/d14/d2c/d4f/f64 [422406,6735] 0 2024-02-20T08:05:27.628 INFO:tasks.workunit.client.0.smithi123.stdout:0/407: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:27.636 INFO:tasks.workunit.client.0.smithi123.stdout:7/305: dread d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:27.636 INFO:tasks.workunit.client.0.smithi123.stdout:3/329: mknod d0/d6/d34/d5a/c7b 0 2024-02-20T08:05:27.638 INFO:tasks.workunit.client.0.smithi123.stdout:8/320: rename d6/ce to d6/d1c/d22/d4f/c6c 0 2024-02-20T08:05:27.641 INFO:tasks.workunit.client.0.smithi123.stdout:0/408: chown d2/f42 35 1 2024-02-20T08:05:27.642 INFO:tasks.workunit.client.0.smithi123.stdout:6/431: mknod d0/d3e/d41/d56/d57/c8e 0 2024-02-20T08:05:27.643 INFO:tasks.workunit.client.0.smithi123.stdout:7/306: dwrite d0/d6/f57 [0,4194304] 0 2024-02-20T08:05:27.648 INFO:tasks.workunit.client.0.smithi123.stdout:3/330: mknod d0/d6/d1a/d1b/d57/c7c 0 2024-02-20T08:05:27.651 INFO:tasks.workunit.client.0.smithi123.stdout:0/409: mkdir d2/dd/d4f/d7c/d82 0 2024-02-20T08:05:27.653 INFO:tasks.workunit.client.0.smithi123.stdout:7/307: dwrite d0/db/d21/d42/d5f/f58 [0,4194304] 0 2024-02-20T08:05:27.656 INFO:tasks.workunit.client.0.smithi123.stdout:6/432: unlink d0/f83 0 2024-02-20T08:05:27.659 INFO:tasks.workunit.client.0.smithi123.stdout:6/433: write d0/f2c [3389986,114839] 0 2024-02-20T08:05:27.662 INFO:tasks.workunit.client.0.smithi123.stdout:8/321: rename d6/l39 to d6/d1c/d22/l6d 0 2024-02-20T08:05:27.673 INFO:tasks.workunit.client.0.smithi123.stdout:3/331: rename d0/d6/d1a/d1b/d2a/c2c to d0/d6/d34/c7d 0 2024-02-20T08:05:27.678 INFO:tasks.workunit.client.0.smithi123.stdout:1/340: dwrite d3/de/d14/d26/d2e/f40 [0,4194304] 0 2024-02-20T08:05:27.679 INFO:tasks.workunit.client.0.smithi123.stdout:1/341: fsync d3/de/d14/d2c/d4f/f64 0 2024-02-20T08:05:27.681 INFO:tasks.workunit.client.0.smithi123.stdout:3/332: truncate d0/d6/d1a/d1b/d1c/f3c 557872 0 2024-02-20T08:05:27.683 INFO:tasks.workunit.client.0.smithi123.stdout:3/333: write d0/d6/d1a/d1b/d2a/f6f [356959,126299] 0 2024-02-20T08:05:27.688 INFO:tasks.workunit.client.0.smithi123.stdout:8/322: creat d6/f6e x:0 0 0 2024-02-20T08:05:27.689 INFO:tasks.workunit.client.0.smithi123.stdout:1/342: symlink d3/de/d14/d26/d56/l76 0 2024-02-20T08:05:27.694 INFO:tasks.workunit.client.0.smithi123.stdout:3/334: dwrite d0/d6/d1a/d1b/d1c/d21/f3e [0,4194304] 0 2024-02-20T08:05:27.695 INFO:tasks.workunit.client.0.smithi123.stdout:0/410: dwrite d2/f12 [0,4194304] 0 2024-02-20T08:05:27.695 INFO:tasks.workunit.client.0.smithi123.stdout:1/343: dread d3/db/f4e [0,4194304] 0 2024-02-20T08:05:27.697 INFO:tasks.workunit.client.0.smithi123.stdout:7/308: truncate d0/d6/f31 912624 0 2024-02-20T08:05:27.703 INFO:tasks.workunit.client.0.smithi123.stdout:6/434: dwrite d0/f17 [0,4194304] 0 2024-02-20T08:05:27.704 INFO:tasks.workunit.client.0.smithi123.stdout:1/344: dread d3/f3e [0,4194304] 0 2024-02-20T08:05:27.707 INFO:tasks.workunit.client.0.smithi123.stdout:1/345: write d3/db/f38 [3395859,39559] 0 2024-02-20T08:05:27.709 INFO:tasks.workunit.client.0.smithi123.stdout:8/323: creat d6/d1c/f6f x:0 0 0 2024-02-20T08:05:27.714 INFO:tasks.workunit.client.0.smithi123.stdout:3/335: dwrite d0/f3f [0,4194304] 0 2024-02-20T08:05:27.715 INFO:tasks.workunit.client.0.smithi123.stdout:0/411: rename d2/de/d1e/d1f/l4a to d2/de/d1e/l83 0 2024-02-20T08:05:27.716 INFO:tasks.workunit.client.0.smithi123.stdout:0/412: chown d2/de/d1e/d1f/c53 25 1 2024-02-20T08:05:27.721 INFO:tasks.workunit.client.0.smithi123.stdout:6/435: creat d0/d3e/d40/d7f/f8f x:0 0 0 2024-02-20T08:05:27.724 INFO:tasks.workunit.client.0.smithi123.stdout:8/324: mknod d6/d1c/c70 0 2024-02-20T08:05:27.724 INFO:tasks.workunit.client.0.smithi123.stdout:3/336: chown d0/d6/d1a/f23 51491516 1 2024-02-20T08:05:27.728 INFO:tasks.workunit.client.0.smithi123.stdout:6/436: fsync d0/d3e/d40/f8d 0 2024-02-20T08:05:27.729 INFO:tasks.workunit.client.0.smithi123.stdout:0/413: dwrite d2/dd/f31 [8388608,4194304] 0 2024-02-20T08:05:27.730 INFO:tasks.workunit.client.0.smithi123.stdout:3/337: mknod d0/d6/d1a/d1b/d2a/c7e 0 2024-02-20T08:05:27.731 INFO:tasks.workunit.client.0.smithi123.stdout:1/346: dwrite d3/de/d14/d26/f39 [0,4194304] 0 2024-02-20T08:05:27.733 INFO:tasks.workunit.client.0.smithi123.stdout:0/414: write d2/de/d1e/d1f/d5e/f7a [793043,119025] 0 2024-02-20T08:05:27.733 INFO:tasks.workunit.client.0.smithi123.stdout:8/325: fdatasync d6/d32/f4a 0 2024-02-20T08:05:27.734 INFO:tasks.workunit.client.0.smithi123.stdout:1/347: write d3/db/f4e [912663,2065] 0 2024-02-20T08:05:27.736 INFO:tasks.workunit.client.0.smithi123.stdout:3/338: write d0/d6/d1a/d1b/d1c/d20/f40 [146006,102722] 0 2024-02-20T08:05:27.738 INFO:tasks.workunit.client.0.smithi123.stdout:3/339: chown d0/d6/d1a/d1b/f54 16237 1 2024-02-20T08:05:27.740 INFO:tasks.workunit.client.0.smithi123.stdout:6/437: mkdir d0/d3e/d40/d90 0 2024-02-20T08:05:27.743 INFO:tasks.workunit.client.0.smithi123.stdout:1/348: creat d3/de/d14/d26/d2e/f77 x:0 0 0 2024-02-20T08:05:27.745 INFO:tasks.workunit.client.0.smithi123.stdout:3/340: rmdir d0/d6/d1a/d1b/d57 39 2024-02-20T08:05:27.746 INFO:tasks.workunit.client.0.smithi123.stdout:6/438: mkdir d0/d3e/d41/d56/d57/d91 0 2024-02-20T08:05:27.748 INFO:tasks.workunit.client.0.smithi123.stdout:1/349: unlink d3/de/d14/d2c/d45/f4a 0 2024-02-20T08:05:27.751 INFO:tasks.workunit.client.0.smithi123.stdout:3/341: creat d0/dd/d48/f7f x:0 0 0 2024-02-20T08:05:27.752 INFO:tasks.workunit.client.0.smithi123.stdout:3/342: chown d0/dd/d48/c76 515032 1 2024-02-20T08:05:27.755 INFO:tasks.workunit.client.0.smithi123.stdout:1/350: dwrite d3/db/d34/d74/f1a [0,4194304] 0 2024-02-20T08:05:27.760 INFO:tasks.workunit.client.0.smithi123.stdout:1/351: chown d3/db/f21 32811046 1 2024-02-20T08:05:27.764 INFO:tasks.workunit.client.0.smithi123.stdout:3/343: dwrite d0/d6/d1a/d1b/d1c/d3b/d43/f50 [0,4194304] 0 2024-02-20T08:05:27.766 INFO:tasks.workunit.client.0.smithi123.stdout:0/415: dread d2/dd/d4f/d61/f7b [0,4194304] 0 2024-02-20T08:05:27.768 INFO:tasks.workunit.client.0.smithi123.stdout:3/344: mknod d0/d6/d1a/d1b/d1c/c80 0 2024-02-20T08:05:27.768 INFO:tasks.workunit.client.0.smithi123.stdout:7/309: dread d0/d6/d7/f4e [0,4194304] 0 2024-02-20T08:05:27.770 INFO:tasks.workunit.client.0.smithi123.stdout:7/310: fsync d0/db/d38/f6a 0 2024-02-20T08:05:27.772 INFO:tasks.workunit.client.0.smithi123.stdout:8/326: truncate d6/d32/f4a 1096081 0 2024-02-20T08:05:27.773 INFO:tasks.workunit.client.0.smithi123.stdout:0/416: mkdir d2/de/d1e/d84 0 2024-02-20T08:05:27.774 INFO:tasks.workunit.client.0.smithi123.stdout:7/311: write d0/d6/d29/f6e [348971,118734] 0 2024-02-20T08:05:27.776 INFO:tasks.workunit.client.0.smithi123.stdout:1/352: getdents d3 0 2024-02-20T08:05:27.777 INFO:tasks.workunit.client.0.smithi123.stdout:1/353: read - d3/db/d34/d74/f5c zero size 2024-02-20T08:05:27.780 INFO:tasks.workunit.client.0.smithi123.stdout:8/327: unlink d6/d1c/d22/d4f/d5b/c69 0 2024-02-20T08:05:27.782 INFO:tasks.workunit.client.0.smithi123.stdout:6/439: rename d0/d3e/d41 to d0/d3e/d92 0 2024-02-20T08:05:27.782 INFO:tasks.workunit.client.0.smithi123.stdout:7/312: dwrite d0/d6/dd/d52/f51 [0,4194304] 0 2024-02-20T08:05:27.787 INFO:tasks.workunit.client.0.smithi123.stdout:0/417: chown d2/de/d1e/l62 170 1 2024-02-20T08:05:27.790 INFO:tasks.workunit.client.0.smithi123.stdout:1/354: creat d3/de/d14/d36/f78 x:0 0 0 2024-02-20T08:05:27.791 INFO:tasks.workunit.client.0.smithi123.stdout:3/345: dread d0/dd/f38 [0,4194304] 0 2024-02-20T08:05:27.795 INFO:tasks.workunit.client.0.smithi123.stdout:7/313: dwrite d0/db/d38/d47/d4a/d59/f5b [0,4194304] 0 2024-02-20T08:05:27.795 INFO:tasks.workunit.client.0.smithi123.stdout:0/418: dwrite d2/f12 [0,4194304] 0 2024-02-20T08:05:27.796 INFO:tasks.workunit.client.0.smithi123.stdout:0/419: chown d2/dd/l2a 21003573 1 2024-02-20T08:05:27.797 INFO:tasks.workunit.client.0.smithi123.stdout:7/314: fdatasync d0/d6/f53 0 2024-02-20T08:05:27.800 INFO:tasks.workunit.client.0.smithi123.stdout:1/355: symlink d3/de/l79 0 2024-02-20T08:05:27.807 INFO:tasks.workunit.client.0.smithi123.stdout:0/420: creat d2/de/d1e/f85 x:0 0 0 2024-02-20T08:05:27.810 INFO:tasks.workunit.client.0.smithi123.stdout:1/356: symlink d3/de/d14/d26/d56/l7a 0 2024-02-20T08:05:27.811 INFO:tasks.workunit.client.0.smithi123.stdout:8/328: creat d6/f71 x:0 0 0 2024-02-20T08:05:27.811 INFO:tasks.workunit.client.0.smithi123.stdout:1/357: read d3/f1d [2424681,44205] 0 2024-02-20T08:05:27.815 INFO:tasks.workunit.client.0.smithi123.stdout:1/358: dread d3/de/d14/d36/d59/f5b [0,4194304] 0 2024-02-20T08:05:27.815 INFO:tasks.workunit.client.0.smithi123.stdout:6/440: creat d0/d3e/d40/d48/f93 x:0 0 0 2024-02-20T08:05:27.816 INFO:tasks.workunit.client.0.smithi123.stdout:8/329: dread d6/d1c/d29/f67 [0,4194304] 0 2024-02-20T08:05:27.816 INFO:tasks.workunit.client.0.smithi123.stdout:7/315: mkdir d0/db/d21/d42/d1d/d70 0 2024-02-20T08:05:27.819 INFO:tasks.workunit.client.0.smithi123.stdout:1/359: creat d3/de/d14/d26/d2e/f7b x:0 0 0 2024-02-20T08:05:27.820 INFO:tasks.workunit.client.0.smithi123.stdout:8/330: chown c5 4276369 1 2024-02-20T08:05:27.821 INFO:tasks.workunit.client.0.smithi123.stdout:7/316: mknod d0/d6/d29/c71 0 2024-02-20T08:05:27.824 INFO:tasks.workunit.client.0.smithi123.stdout:6/441: mkdir d0/d3e/d40/d90/d94 0 2024-02-20T08:05:27.824 INFO:tasks.workunit.client.0.smithi123.stdout:1/360: dwrite d3/db/f38 [0,4194304] 0 2024-02-20T08:05:27.826 INFO:tasks.workunit.client.0.smithi123.stdout:8/331: symlink d6/d32/l72 0 2024-02-20T08:05:27.829 INFO:tasks.workunit.client.0.smithi123.stdout:1/361: creat d3/d47/f7c x:0 0 0 2024-02-20T08:05:27.831 INFO:tasks.workunit.client.0.smithi123.stdout:6/442: symlink d0/d3e/d92/d56/d89/d73/d75/l95 0 2024-02-20T08:05:27.835 INFO:tasks.workunit.client.0.smithi123.stdout:8/332: fdatasync d6/d1c/d2c/f44 0 2024-02-20T08:05:27.836 INFO:tasks.workunit.client.0.smithi123.stdout:6/443: dread d0/d3e/d92/d56/f5a [0,4194304] 0 2024-02-20T08:05:27.837 INFO:tasks.workunit.client.0.smithi123.stdout:6/444: write d0/f22 [2528212,78437] 0 2024-02-20T08:05:27.839 INFO:tasks.workunit.client.0.smithi123.stdout:1/362: mkdir d3/db/d7d 0 2024-02-20T08:05:27.844 INFO:tasks.workunit.client.0.smithi123.stdout:6/445: dwrite d0/f18 [0,4194304] 0 2024-02-20T08:05:27.844 INFO:tasks.workunit.client.0.smithi123.stdout:6/446: stat d0/f1e 0 2024-02-20T08:05:27.850 INFO:tasks.workunit.client.0.smithi123.stdout:8/333: mknod d6/d1c/c73 0 2024-02-20T08:05:27.854 INFO:tasks.workunit.client.0.smithi123.stdout:8/334: unlink d6/d1c/d29/d3f/f63 0 2024-02-20T08:05:27.855 INFO:tasks.workunit.client.0.smithi123.stdout:6/447: link d0/d3e/d92/d56/d57/f6b d0/d3e/d40/d90/d94/f96 0 2024-02-20T08:05:27.856 INFO:tasks.workunit.client.0.smithi123.stdout:6/448: write d0/d38/f3a [3080984,64722] 0 2024-02-20T08:05:27.857 INFO:tasks.workunit.client.0.smithi123.stdout:1/363: creat d3/db/f7e x:0 0 0 2024-02-20T08:05:27.861 INFO:tasks.workunit.client.0.smithi123.stdout:8/335: rmdir d6/d1c/d2c 39 2024-02-20T08:05:27.862 INFO:tasks.workunit.client.0.smithi123.stdout:1/364: dread d3/de/f5a [0,4194304] 0 2024-02-20T08:05:27.864 INFO:tasks.workunit.client.0.smithi123.stdout:1/365: write d3/f70 [697190,14784] 0 2024-02-20T08:05:27.865 INFO:tasks.workunit.client.0.smithi123.stdout:7/317: dwrite d0/f2f [0,4194304] 0 2024-02-20T08:05:27.872 INFO:tasks.workunit.client.0.smithi123.stdout:7/318: write d0/d6/d7/f16 [1172943,65224] 0 2024-02-20T08:05:27.880 INFO:tasks.workunit.client.0.smithi123.stdout:6/449: creat d0/f97 x:0 0 0 2024-02-20T08:05:27.880 INFO:tasks.workunit.client.0.smithi123.stdout:7/319: dwrite d0/f37 [0,4194304] 0 2024-02-20T08:05:27.884 INFO:tasks.workunit.client.0.smithi123.stdout:6/450: rmdir d0/d3e/d40/d48 39 2024-02-20T08:05:27.885 INFO:tasks.workunit.client.0.smithi123.stdout:6/451: write d0/f29 [6012439,93009] 0 2024-02-20T08:05:27.885 INFO:tasks.workunit.client.0.smithi123.stdout:6/452: fsync d0/f22 0 2024-02-20T08:05:27.887 INFO:tasks.workunit.client.0.smithi123.stdout:1/366: rename d3/de/d14/d26/d56/d5f to d3/db/d7f 0 2024-02-20T08:05:27.888 INFO:tasks.workunit.client.0.smithi123.stdout:7/320: creat d0/db/d38/d47/d4a/d5d/f72 x:0 0 0 2024-02-20T08:05:27.890 INFO:tasks.workunit.client.0.smithi123.stdout:8/336: getdents d6/d1c/d29/d3f 0 2024-02-20T08:05:27.891 INFO:tasks.workunit.client.0.smithi123.stdout:8/337: dread - d6/d1c/d29/f57 zero size 2024-02-20T08:05:27.895 INFO:tasks.workunit.client.0.smithi123.stdout:1/367: mknod d3/db/d34/d74/c80 0 2024-02-20T08:05:27.899 INFO:tasks.workunit.client.0.smithi123.stdout:8/338: dread d6/d1c/d22/d4f/f56 [0,4194304] 0 2024-02-20T08:05:27.899 INFO:tasks.workunit.client.0.smithi123.stdout:6/453: symlink d0/d3e/d40/d48/l98 0 2024-02-20T08:05:27.900 INFO:tasks.workunit.client.0.smithi123.stdout:1/368: getdents d3/db/d7d 0 2024-02-20T08:05:27.902 INFO:tasks.workunit.client.0.smithi123.stdout:7/321: read d0/db/d21/d42/d1d/f56 [411412,102905] 0 2024-02-20T08:05:27.902 INFO:tasks.workunit.client.0.smithi123.stdout:6/454: rmdir d0/d3e/d40/d48 39 2024-02-20T08:05:27.903 INFO:tasks.workunit.client.0.smithi123.stdout:6/455: write d0/f16 [369816,41047] 0 2024-02-20T08:05:27.904 INFO:tasks.workunit.client.0.smithi123.stdout:1/369: creat d3/de/d14/d26/f81 x:0 0 0 2024-02-20T08:05:27.907 INFO:tasks.workunit.client.0.smithi123.stdout:1/370: creat d3/de/d14/d36/d59/f82 x:0 0 0 2024-02-20T08:05:27.908 INFO:tasks.workunit.client.0.smithi123.stdout:6/456: link d0/f31 d0/d3e/d92/d56/f99 0 2024-02-20T08:05:27.910 INFO:tasks.workunit.client.0.smithi123.stdout:1/371: creat d3/db/d34/d74/d6f/f83 x:0 0 0 2024-02-20T08:05:27.911 INFO:tasks.workunit.client.0.smithi123.stdout:6/457: chown d0/c27 412219714 1 2024-02-20T08:05:27.912 INFO:tasks.workunit.client.0.smithi123.stdout:6/458: chown d0/d3e/d92/d56/d89/d73/f80 88336 1 2024-02-20T08:05:27.917 INFO:tasks.workunit.client.0.smithi123.stdout:8/339: dwrite d6/f2f [0,4194304] 0 2024-02-20T08:05:27.917 INFO:tasks.workunit.client.0.smithi123.stdout:6/459: symlink d0/d3e/d40/d48/d79/l9a 0 2024-02-20T08:05:27.918 INFO:tasks.workunit.client.0.smithi123.stdout:8/340: chown d6/d1c/c28 453 1 2024-02-20T08:05:27.926 INFO:tasks.workunit.client.0.smithi123.stdout:8/341: creat d6/f74 x:0 0 0 2024-02-20T08:05:27.926 INFO:tasks.workunit.client.0.smithi123.stdout:8/342: readlink d6/l61 0 2024-02-20T08:05:27.926 INFO:tasks.workunit.client.0.smithi123.stdout:6/460: getdents d0/d5c 0 2024-02-20T08:05:27.970 INFO:tasks.workunit.client.0.smithi123.stdout:1/372: dwrite d3/f10 [0,4194304] 0 2024-02-20T08:05:27.971 INFO:tasks.workunit.client.0.smithi123.stdout:6/461: dread d0/f1e [0,4194304] 0 2024-02-20T08:05:27.973 INFO:tasks.workunit.client.0.smithi123.stdout:1/373: write d3/de/f60 [369596,67210] 0 2024-02-20T08:05:27.974 INFO:tasks.workunit.client.0.smithi123.stdout:8/343: dread d6/d1c/d29/f67 [0,4194304] 0 2024-02-20T08:05:27.976 INFO:tasks.workunit.client.0.smithi123.stdout:6/462: unlink d0/d3e/l54 0 2024-02-20T08:05:27.976 INFO:tasks.workunit.client.0.smithi123.stdout:6/463: readlink d0/d3e/d40/d48/l98 0 2024-02-20T08:05:27.980 INFO:tasks.workunit.client.0.smithi123.stdout:8/344: rename d6/d1c/d47/f62 to d6/d1c/d2c/f75 0 2024-02-20T08:05:27.982 INFO:tasks.workunit.client.0.smithi123.stdout:6/464: creat d0/d3e/d40/f9b x:0 0 0 2024-02-20T08:05:27.983 INFO:tasks.workunit.client.0.smithi123.stdout:6/465: stat d0/d3e/d40/d48/d7b/f7d 0 2024-02-20T08:05:27.984 INFO:tasks.workunit.client.0.smithi123.stdout:8/345: truncate d6/d1c/d29/f3a 366548 0 2024-02-20T08:05:27.984 INFO:tasks.workunit.client.0.smithi123.stdout:8/346: chown d6/f2f 3123142 1 2024-02-20T08:05:27.985 INFO:tasks.workunit.client.0.smithi123.stdout:8/347: stat d6/f2f 0 2024-02-20T08:05:27.985 INFO:tasks.workunit.client.0.smithi123.stdout:6/466: mkdir d0/d3e/d40/d48/d4a/d9c 0 2024-02-20T08:05:27.985 INFO:tasks.workunit.client.0.smithi123.stdout:8/348: readlink d6/d1c/d29/l54 0 2024-02-20T08:05:27.986 INFO:tasks.workunit.client.0.smithi123.stdout:6/467: fdatasync d0/f22 0 2024-02-20T08:05:27.988 INFO:tasks.workunit.client.0.smithi123.stdout:6/468: rmdir d0/d38 39 2024-02-20T08:05:27.989 INFO:tasks.workunit.client.0.smithi123.stdout:6/469: write d0/f14 [3610571,82244] 0 2024-02-20T08:05:27.990 INFO:tasks.workunit.client.0.smithi123.stdout:8/349: truncate d6/fa 2999914 0 2024-02-20T08:05:27.993 INFO:tasks.workunit.client.0.smithi123.stdout:6/470: fdatasync d0/f31 0 2024-02-20T08:05:27.997 INFO:tasks.workunit.client.0.smithi123.stdout:6/471: dread d0/f21 [0,4194304] 0 2024-02-20T08:05:27.998 INFO:tasks.workunit.client.0.smithi123.stdout:6/472: write d0/d3e/d92/d56/d89/d73/f80 [347516,82100] 0 2024-02-20T08:05:28.005 INFO:tasks.workunit.client.0.smithi123.stdout:1/374: write d3/f1d [3759135,80280] 0 2024-02-20T08:05:28.005 INFO:tasks.workunit.client.0.smithi123.stdout:8/350: getdents d6/d1c/d22/d4f 0 2024-02-20T08:05:28.006 INFO:tasks.workunit.client.0.smithi123.stdout:1/375: chown d3/de/d14 0 1 2024-02-20T08:05:28.007 INFO:tasks.workunit.client.0.smithi123.stdout:1/376: dread - d3/f62 zero size 2024-02-20T08:05:28.007 INFO:tasks.workunit.client.0.smithi123.stdout:1/377: chown d3/db/d34/d74 3 1 2024-02-20T08:05:28.009 INFO:tasks.workunit.client.0.smithi123.stdout:8/351: symlink d6/d1c/d29/l76 0 2024-02-20T08:05:28.010 INFO:tasks.workunit.client.0.smithi123.stdout:8/352: fdatasync d6/f71 0 2024-02-20T08:05:28.012 INFO:tasks.workunit.client.0.smithi123.stdout:8/353: truncate d6/d1c/f6f 644308 0 2024-02-20T08:05:28.015 INFO:tasks.workunit.client.0.smithi123.stdout:1/378: dwrite d3/de/d14/d36/f78 [0,4194304] 0 2024-02-20T08:05:28.016 INFO:tasks.workunit.client.0.smithi123.stdout:6/473: dread d0/f30 [8388608,4194304] 0 2024-02-20T08:05:28.016 INFO:tasks.workunit.client.0.smithi123.stdout:1/379: dread - d3/de/d14/d26/f73 zero size 2024-02-20T08:05:28.020 INFO:tasks.workunit.client.0.smithi123.stdout:6/474: dread d0/d3e/d92/d56/d89/d73/f80 [0,4194304] 0 2024-02-20T08:05:28.021 INFO:tasks.workunit.client.0.smithi123.stdout:6/475: write d0/f29 [3837416,114445] 0 2024-02-20T08:05:28.022 INFO:tasks.workunit.client.0.smithi123.stdout:1/380: rename d3/f62 to d3/de/f84 0 2024-02-20T08:05:28.028 INFO:tasks.workunit.client.0.smithi123.stdout:6/476: creat d0/d3e/d92/d56/d89/d73/f9d x:0 0 0 2024-02-20T08:05:28.028 INFO:tasks.workunit.client.0.smithi123.stdout:6/477: chown d0/f87 521589 1 2024-02-20T08:05:28.030 INFO:tasks.workunit.client.0.smithi123.stdout:6/478: mknod d0/d3e/d40/d48/d5d/c9e 0 2024-02-20T08:05:28.037 INFO:tasks.workunit.client.0.smithi123.stdout:6/479: getdents d0/d3e/d40/d7f 0 2024-02-20T08:05:28.039 INFO:tasks.workunit.client.0.smithi123.stdout:8/354: dwrite d6/d1c/d22/d4f/f56 [0,4194304] 0 2024-02-20T08:05:28.041 INFO:tasks.workunit.client.0.smithi123.stdout:1/381: chown d3/de/d14/d2c/d45/f4d 1121 1 2024-02-20T08:05:28.042 INFO:tasks.workunit.client.0.smithi123.stdout:8/355: creat d6/d1c/d22/d4f/d5b/f77 x:0 0 0 2024-02-20T08:05:28.043 INFO:tasks.workunit.client.0.smithi123.stdout:6/480: truncate d0/d3e/d92/d56/f5a 916230 0 2024-02-20T08:05:28.050 INFO:tasks.workunit.client.0.smithi123.stdout:8/356: truncate d6/d1c/d29/f3a 790864 0 2024-02-20T08:05:28.052 INFO:tasks.workunit.client.0.smithi123.stdout:6/481: mkdir d0/d9f 0 2024-02-20T08:05:28.053 INFO:tasks.workunit.client.0.smithi123.stdout:6/482: chown d0/d38/l46 2057756955 1 2024-02-20T08:05:28.055 INFO:tasks.workunit.client.0.smithi123.stdout:8/357: link d6/d1c/c70 d6/d1c/d29/c78 0 2024-02-20T08:05:28.057 INFO:tasks.workunit.client.0.smithi123.stdout:6/483: unlink d0/d3e/d40/d90/d94/f96 0 2024-02-20T08:05:28.059 INFO:tasks.workunit.client.0.smithi123.stdout:8/358: creat d6/d1c/d2c/f79 x:0 0 0 2024-02-20T08:05:28.059 INFO:tasks.workunit.client.0.smithi123.stdout:8/359: chown d6/d1c/f21 56477418 1 2024-02-20T08:05:28.060 INFO:tasks.workunit.client.0.smithi123.stdout:8/360: fsync d6/d1c/d22/f48 0 2024-02-20T08:05:28.063 INFO:tasks.workunit.client.0.smithi123.stdout:6/484: fdatasync d0/f15 0 2024-02-20T08:05:28.063 INFO:tasks.workunit.client.0.smithi123.stdout:1/382: write d3/db/f19 [2041106,18359] 0 2024-02-20T08:05:28.065 INFO:tasks.workunit.client.0.smithi123.stdout:8/361: creat d6/d1c/d29/f7a x:0 0 0 2024-02-20T08:05:28.066 INFO:tasks.workunit.client.0.smithi123.stdout:8/362: dread - d6/d32/f60 zero size 2024-02-20T08:05:28.067 INFO:tasks.workunit.client.0.smithi123.stdout:8/363: write d6/d1c/d22/d4f/d5b/f77 [126590,115566] 0 2024-02-20T08:05:28.068 INFO:tasks.workunit.client.0.smithi123.stdout:1/383: write d3/f70 [1000497,41073] 0 2024-02-20T08:05:28.072 INFO:tasks.workunit.client.0.smithi123.stdout:8/364: fsync d6/d1c/d2c/f79 0 2024-02-20T08:05:28.073 INFO:tasks.workunit.client.0.smithi123.stdout:6/485: mknod d0/d3e/d92/d56/d57/d91/ca0 0 2024-02-20T08:05:28.074 INFO:tasks.workunit.client.0.smithi123.stdout:6/486: chown d0/d3e/d40/d48/d79/f7a 513761968 1 2024-02-20T08:05:28.074 INFO:tasks.workunit.client.0.smithi123.stdout:1/384: symlink d3/de/d14/d36/l85 0 2024-02-20T08:05:28.081 INFO:tasks.workunit.client.0.smithi123.stdout:1/385: symlink d3/l86 0 2024-02-20T08:05:28.082 INFO:tasks.workunit.client.0.smithi123.stdout:6/487: creat d0/fa1 x:0 0 0 2024-02-20T08:05:28.082 INFO:tasks.workunit.client.0.smithi123.stdout:8/365: write d6/d1c/d2c/f51 [4095534,35574] 0 2024-02-20T08:05:28.085 INFO:tasks.workunit.client.0.smithi123.stdout:8/366: creat d6/d1c/d2c/f7b x:0 0 0 2024-02-20T08:05:28.086 INFO:tasks.workunit.client.0.smithi123.stdout:6/488: mknod d0/d3e/d40/d48/d79/ca2 0 2024-02-20T08:05:28.088 INFO:tasks.workunit.client.0.smithi123.stdout:8/367: creat d6/d1c/d22/d4f/f7c x:0 0 0 2024-02-20T08:05:28.089 INFO:tasks.workunit.client.0.smithi123.stdout:6/489: creat d0/d3e/d40/d90/d94/fa3 x:0 0 0 2024-02-20T08:05:28.090 INFO:tasks.workunit.client.0.smithi123.stdout:6/490: read - d0/d3e/d40/d90/d94/fa3 zero size 2024-02-20T08:05:28.090 INFO:tasks.workunit.client.0.smithi123.stdout:1/386: creat d3/de/d14/f87 x:0 0 0 2024-02-20T08:05:28.091 INFO:tasks.workunit.client.0.smithi123.stdout:6/491: chown d0/d3e/d40/d90/d94 430 1 2024-02-20T08:05:28.092 INFO:tasks.workunit.client.0.smithi123.stdout:8/368: getdents d6/d1c/d29/d3f 0 2024-02-20T08:05:28.094 INFO:tasks.workunit.client.0.smithi123.stdout:1/387: rename d3/db/d41/c6b to d3/db/d34/d74/d6f/c88 0 2024-02-20T08:05:28.100 INFO:tasks.workunit.client.0.smithi123.stdout:8/369: getdents d6/d1c/d29 0 2024-02-20T08:05:28.103 INFO:tasks.workunit.client.0.smithi123.stdout:8/370: mkdir d6/d1c/d29/d7d 0 2024-02-20T08:05:28.104 INFO:tasks.workunit.client.0.smithi123.stdout:1/388: link d3/db/f31 d3/de/d14/d36/d59/f89 0 2024-02-20T08:05:28.106 INFO:tasks.workunit.client.0.smithi123.stdout:1/389: truncate d3/de/d14/d26/d56/f58 605656 0 2024-02-20T08:05:28.107 INFO:tasks.workunit.client.0.smithi123.stdout:1/390: readlink d3/db/d41/l4c 0 2024-02-20T08:05:28.107 INFO:tasks.workunit.client.0.smithi123.stdout:8/371: mkdir d6/d1c/d22/d4f/d7e 0 2024-02-20T08:05:28.107 INFO:tasks.workunit.client.0.smithi123.stdout:1/391: chown d3/db/d34/d74/d6f/d63/f72 62829 1 2024-02-20T08:05:28.108 INFO:tasks.workunit.client.0.smithi123.stdout:6/492: write d0/d3e/d92/d56/f5a [1592059,109546] 0 2024-02-20T08:05:28.111 INFO:tasks.workunit.client.0.smithi123.stdout:6/493: rmdir d0/d3e/d92/d56 39 2024-02-20T08:05:28.112 INFO:tasks.workunit.client.0.smithi123.stdout:6/494: write d0/d38/f4f [89840,100601] 0 2024-02-20T08:05:28.113 INFO:tasks.workunit.client.0.smithi123.stdout:1/392: mkdir d3/db/d7d/d8a 0 2024-02-20T08:05:28.114 INFO:tasks.workunit.client.0.smithi123.stdout:1/393: fdatasync d3/de/d14/d26/d2e/f7b 0 2024-02-20T08:05:28.115 INFO:tasks.workunit.client.0.smithi123.stdout:6/495: creat d0/d3e/d40/d90/fa4 x:0 0 0 2024-02-20T08:05:28.117 INFO:tasks.workunit.client.0.smithi123.stdout:1/394: write d3/f17 [79898,105776] 0 2024-02-20T08:05:28.118 INFO:tasks.workunit.client.0.smithi123.stdout:6/496: dread - d0/d3e/d92/d56/d89/d73/f9d zero size 2024-02-20T08:05:28.120 INFO:tasks.workunit.client.0.smithi123.stdout:6/497: write d0/f30 [693781,128497] 0 2024-02-20T08:05:28.137 INFO:tasks.workunit.client.0.smithi123.stdout:6/498: dread d0/d3e/d40/d48/d79/f7a [0,4194304] 0 2024-02-20T08:05:28.141 INFO:tasks.workunit.client.0.smithi123.stdout:6/499: symlink d0/d3e/d92/la5 0 2024-02-20T08:05:28.143 INFO:tasks.workunit.client.0.smithi123.stdout:6/500: creat d0/d38/fa6 x:0 0 0 2024-02-20T08:05:28.145 INFO:tasks.workunit.client.0.smithi123.stdout:6/501: symlink d0/d3e/d40/d7f/la7 0 2024-02-20T08:05:28.146 INFO:tasks.workunit.client.0.smithi123.stdout:6/502: read d0/f34 [1837236,8996] 0 2024-02-20T08:05:28.215 INFO:tasks.workunit.client.0.smithi123.stdout:2/308: sync 2024-02-20T08:05:28.217 INFO:tasks.workunit.client.0.smithi123.stdout:6/503: mkdir d0/d3e/d40/d48/d4a/da8 0 2024-02-20T08:05:28.220 INFO:tasks.workunit.client.0.smithi123.stdout:2/309: symlink d1a/d29/d42/d52/l5b 0 2024-02-20T08:05:28.224 INFO:tasks.workunit.client.0.smithi123.stdout:6/504: creat d0/d3e/d40/d48/d7b/fa9 x:0 0 0 2024-02-20T08:05:28.233 INFO:tasks.workunit.client.0.smithi123.stdout:2/310: creat d1a/f5c x:0 0 0 2024-02-20T08:05:28.235 INFO:tasks.workunit.client.0.smithi123.stdout:2/311: fdatasync f10 0 2024-02-20T08:05:28.240 INFO:tasks.workunit.client.0.smithi123.stdout:2/312: fsync d1a/f1f 0 2024-02-20T08:05:28.249 INFO:tasks.workunit.client.0.smithi123.stdout:2/313: mkdir d1a/d29/d5d 0 2024-02-20T08:05:28.253 INFO:tasks.workunit.client.0.smithi123.stdout:2/314: mknod d1a/c5e 0 2024-02-20T08:05:28.256 INFO:tasks.workunit.client.0.smithi123.stdout:2/315: creat d1a/d29/d39/f5f x:0 0 0 2024-02-20T08:05:28.261 INFO:tasks.workunit.client.0.smithi123.stdout:2/316: dread d1a/f41 [0,4194304] 0 2024-02-20T08:05:28.262 INFO:tasks.workunit.client.0.smithi123.stdout:6/505: truncate d0/f17 2008392 0 2024-02-20T08:05:28.264 INFO:tasks.workunit.client.0.smithi123.stdout:6/506: truncate d0/d3e/d92/d56/d89/d73/d75/f7e 519892 0 2024-02-20T08:05:28.265 INFO:tasks.workunit.client.0.smithi123.stdout:2/317: write f5 [1289610,17924] 0 2024-02-20T08:05:28.265 INFO:tasks.workunit.client.0.smithi123.stdout:2/318: stat f10 0 2024-02-20T08:05:28.266 INFO:tasks.workunit.client.0.smithi123.stdout:2/319: write d1a/d29/f35 [59235,80412] 0 2024-02-20T08:05:28.267 INFO:tasks.workunit.client.0.smithi123.stdout:2/320: chown c1 96171265 1 2024-02-20T08:05:28.271 INFO:tasks.workunit.client.0.smithi123.stdout:6/507: mkdir d0/d3e/d40/d48/daa 0 2024-02-20T08:05:28.273 INFO:tasks.workunit.client.0.smithi123.stdout:2/321: dwrite d1a/d29/d42/f49 [0,4194304] 0 2024-02-20T08:05:28.275 INFO:tasks.workunit.client.0.smithi123.stdout:2/322: write d1a/d29/d39/f3a [822695,66894] 0 2024-02-20T08:05:28.278 INFO:tasks.workunit.client.0.smithi123.stdout:6/508: dwrite d0/d38/fa6 [0,4194304] 0 2024-02-20T08:05:28.283 INFO:tasks.workunit.client.0.smithi123.stdout:6/509: rename d0/d3e/d40/d48/d4a/da8 to d0/d3e/d40/d48/daa/dab 0 2024-02-20T08:05:28.288 INFO:tasks.workunit.client.0.smithi123.stdout:6/510: creat d0/d3e/d40/d7f/fac x:0 0 0 2024-02-20T08:05:28.289 INFO:tasks.workunit.client.0.smithi123.stdout:6/511: read d0/f13 [9572811,53947] 0 2024-02-20T08:05:28.290 INFO:tasks.workunit.client.0.smithi123.stdout:6/512: chown d0/d3e/d92/l43 445 1 2024-02-20T08:05:28.290 INFO:tasks.workunit.client.0.smithi123.stdout:6/513: stat d0/f31 0 2024-02-20T08:05:28.329 INFO:tasks.workunit.client.0.smithi123.stdout:6/514: dwrite d0/d3e/d40/f8d [0,4194304] 0 2024-02-20T08:05:28.334 INFO:tasks.workunit.client.0.smithi123.stdout:6/515: creat d0/d3e/d40/d48/d4a/fad x:0 0 0 2024-02-20T08:05:28.338 INFO:tasks.workunit.client.0.smithi123.stdout:6/516: mkdir d0/d3e/d92/d56/dae 0 2024-02-20T08:05:28.344 INFO:tasks.workunit.client.0.smithi123.stdout:6/517: truncate d0/f21 16135 0 2024-02-20T08:05:28.345 INFO:tasks.workunit.client.0.smithi123.stdout:6/518: dread - d0/d3e/d40/d48/d5d/f62 zero size 2024-02-20T08:05:28.346 INFO:tasks.workunit.client.0.smithi123.stdout:6/519: write d0/d3e/f7c [700562,93910] 0 2024-02-20T08:05:28.358 INFO:tasks.workunit.client.0.smithi123.stdout:6/520: rename d0/d3e/d40/d48/d79/ca2 to d0/d3e/d40/d90/d94/caf 0 2024-02-20T08:05:28.384 INFO:tasks.workunit.client.0.smithi123.stdout:6/521: write d0/fe [3337725,110072] 0 2024-02-20T08:05:28.385 INFO:tasks.workunit.client.0.smithi123.stdout:6/522: dread - d0/d3e/d40/d90/d94/fa3 zero size 2024-02-20T08:05:28.386 INFO:tasks.workunit.client.0.smithi123.stdout:6/523: read - d0/d3e/d92/d56/d57/f74 zero size 2024-02-20T08:05:28.387 INFO:tasks.workunit.client.0.smithi123.stdout:6/524: read d0/f51 [690126,94009] 0 2024-02-20T08:05:28.392 INFO:tasks.workunit.client.0.smithi123.stdout:6/525: dwrite d0/f2c [0,4194304] 0 2024-02-20T08:05:28.394 INFO:tasks.workunit.client.0.smithi123.stdout:6/526: chown d0/d3e/d92/d56/d57/f6b 950080 1 2024-02-20T08:05:28.399 INFO:tasks.workunit.client.0.smithi123.stdout:6/527: dwrite d0/fe [0,4194304] 0 2024-02-20T08:05:28.400 INFO:tasks.workunit.client.0.smithi123.stdout:6/528: dread - d0/d3e/d40/d48/d79/f8b zero size 2024-02-20T08:05:28.404 INFO:tasks.workunit.client.0.smithi123.stdout:6/529: link d0/d38/f3a d0/d9f/fb0 0 2024-02-20T08:05:28.408 INFO:tasks.workunit.client.0.smithi123.stdout:6/530: dread d0/f18 [0,4194304] 0 2024-02-20T08:05:28.410 INFO:tasks.workunit.client.0.smithi123.stdout:6/531: symlink d0/d9f/lb1 0 2024-02-20T08:05:28.411 INFO:tasks.workunit.client.0.smithi123.stdout:6/532: write d0/d3e/d40/d48/d5d/f62 [438332,74823] 0 2024-02-20T08:05:28.412 INFO:tasks.workunit.client.0.smithi123.stdout:9/300: sync 2024-02-20T08:05:28.412 INFO:tasks.workunit.client.0.smithi123.stdout:9/301: stat d6/d2a/f59 0 2024-02-20T08:05:28.413 INFO:tasks.workunit.client.0.smithi123.stdout:9/302: readlink d6/d19/d1a/d31/d4b/l52 0 2024-02-20T08:05:28.450 INFO:tasks.workunit.client.0.smithi123.stdout:9/303: readlink d6/d19/d1a/l4e 0 2024-02-20T08:05:28.452 INFO:tasks.workunit.client.0.smithi123.stdout:6/533: link d0/f2c d0/d3e/d40/d48/daa/dab/fb2 0 2024-02-20T08:05:28.452 INFO:tasks.workunit.client.0.smithi123.stdout:6/534: dread - d0/fa1 zero size 2024-02-20T08:05:28.454 INFO:tasks.workunit.client.0.smithi123.stdout:9/304: dread d6/f3f [0,4194304] 0 2024-02-20T08:05:28.473 INFO:tasks.workunit.client.0.smithi123.stdout:9/305: symlink d6/d19/d1a/d2b/l60 0 2024-02-20T08:05:28.474 INFO:tasks.workunit.client.0.smithi123.stdout:6/535: mkdir d0/d3e/d92/db3 0 2024-02-20T08:05:28.475 INFO:tasks.workunit.client.0.smithi123.stdout:6/536: dread - d0/fa1 zero size 2024-02-20T08:05:28.477 INFO:tasks.workunit.client.0.smithi123.stdout:9/306: rename d6/d19/d1b/d3d/l53 to d6/d2a/d27/d3c/l61 0 2024-02-20T08:05:28.477 INFO:tasks.workunit.client.0.smithi123.stdout:9/307: fsync d6/d19/d1a/d2b/d28/f4c 0 2024-02-20T08:05:28.478 INFO:tasks.workunit.client.0.smithi123.stdout:9/308: chown d6/d19/d1a/d2b/d28/d50 5890 1 2024-02-20T08:05:28.479 INFO:tasks.workunit.client.0.smithi123.stdout:6/537: mknod d0/d3e/d40/d90/cb4 0 2024-02-20T08:05:28.482 INFO:tasks.workunit.client.0.smithi123.stdout:9/309: creat d6/d19/d1b/d3d/f62 x:0 0 0 2024-02-20T08:05:28.483 INFO:tasks.workunit.client.0.smithi123.stdout:9/310: fsync d6/d19/f44 0 2024-02-20T08:05:28.485 INFO:tasks.workunit.client.0.smithi123.stdout:6/538: link d0/d38/f4f d0/d3e/d92/d56/d89/d73/d75/fb5 0 2024-02-20T08:05:28.489 INFO:tasks.workunit.client.0.smithi123.stdout:6/539: dread d0/d3e/d40/d48/d79/f82 [0,4194304] 0 2024-02-20T08:05:28.491 INFO:tasks.workunit.client.0.smithi123.stdout:9/311: getdents d6/d2a/d27 0 2024-02-20T08:05:28.494 INFO:tasks.workunit.client.0.smithi123.stdout:9/312: symlink d6/d19/d1b/d3d/d32/l63 0 2024-02-20T08:05:28.495 INFO:tasks.workunit.client.0.smithi123.stdout:9/313: fsync d6/fa 0 2024-02-20T08:05:28.495 INFO:tasks.workunit.client.0.smithi123.stdout:9/314: chown d6/d19/c41 31781342 1 2024-02-20T08:05:28.497 INFO:tasks.workunit.client.0.smithi123.stdout:9/315: creat d6/d19/d1a/d2b/d28/f64 x:0 0 0 2024-02-20T08:05:28.498 INFO:tasks.workunit.client.0.smithi123.stdout:9/316: write d6/d19/d1a/d2b/d28/f4c [2984055,79898] 0 2024-02-20T08:05:28.501 INFO:tasks.workunit.client.0.smithi123.stdout:9/317: mkdir d6/d19/d1a/d2b/d65 0 2024-02-20T08:05:28.517 INFO:tasks.workunit.client.0.smithi123.stdout:6/540: creat d0/d3e/fb6 x:0 0 0 2024-02-20T08:05:28.518 INFO:tasks.workunit.client.0.smithi123.stdout:6/541: write d0/d3e/d92/d56/d57/f74 [664877,89689] 0 2024-02-20T08:05:28.522 INFO:tasks.workunit.client.0.smithi123.stdout:6/542: unlink d0/d3e/d40/d48/d4a/l6c 0 2024-02-20T08:05:28.523 INFO:tasks.workunit.client.0.smithi123.stdout:9/318: dwrite d6/d19/f49 [0,4194304] 0 2024-02-20T08:05:28.527 INFO:tasks.workunit.client.0.smithi123.stdout:9/319: mkdir d6/d19/d1a/d2b/d28/d66 0 2024-02-20T08:05:28.527 INFO:tasks.workunit.client.0.smithi123.stdout:9/320: dread d6/f3f [0,4194304] 0 2024-02-20T08:05:28.528 INFO:tasks.workunit.client.0.smithi123.stdout:9/321: readlink d6/d19/d1a/l2d 0 2024-02-20T08:05:28.529 INFO:tasks.workunit.client.0.smithi123.stdout:9/322: dread - d6/d19/f44 zero size 2024-02-20T08:05:28.531 INFO:tasks.workunit.client.0.smithi123.stdout:9/323: creat d6/d19/d1a/d2b/d28/d50/f67 x:0 0 0 2024-02-20T08:05:28.535 INFO:tasks.workunit.client.0.smithi123.stdout:6/543: dwrite d0/f34 [4194304,4194304] 0 2024-02-20T08:05:28.536 INFO:tasks.workunit.client.0.smithi123.stdout:9/324: getdents d6/d19/d1a 0 2024-02-20T08:05:28.538 INFO:tasks.workunit.client.0.smithi123.stdout:6/544: rmdir d0/d3e/d92/d56/d89 39 2024-02-20T08:05:28.543 INFO:tasks.workunit.client.0.smithi123.stdout:9/325: dwrite d6/d19/d1a/d2b/d28/f64 [0,4194304] 0 2024-02-20T08:05:28.544 INFO:tasks.workunit.client.0.smithi123.stdout:9/326: stat d6/d19/d1b/d3d/d32/l63 0 2024-02-20T08:05:28.549 INFO:tasks.workunit.client.0.smithi123.stdout:9/327: read d6/f14 [4825324,29070] 0 2024-02-20T08:05:28.553 INFO:tasks.workunit.client.0.smithi123.stdout:6/545: write d0/f23 [3154436,14525] 0 2024-02-20T08:05:28.557 INFO:tasks.workunit.client.0.smithi123.stdout:6/546: creat d0/d3e/d92/db3/fb7 x:0 0 0 2024-02-20T08:05:28.559 INFO:tasks.workunit.client.0.smithi123.stdout:6/547: rename d0/d38/l88 to d0/d3e/d40/d48/d7b/lb8 0 2024-02-20T08:05:28.560 INFO:tasks.workunit.client.0.smithi123.stdout:6/548: write d0/d3e/d40/d48/d7b/f7d [20175,32813] 0 2024-02-20T08:05:28.562 INFO:tasks.workunit.client.0.smithi123.stdout:6/549: creat d0/d3e/d40/d7f/fb9 x:0 0 0 2024-02-20T08:05:28.567 INFO:tasks.workunit.client.0.smithi123.stdout:9/328: truncate d6/d19/d1a/d2b/d28/f64 1479405 0 2024-02-20T08:05:28.572 INFO:tasks.workunit.client.0.smithi123.stdout:6/550: write d0/f30 [11486499,99169] 0 2024-02-20T08:05:28.575 INFO:tasks.workunit.client.0.smithi123.stdout:6/551: getdents d0/d3e/d40/d48 0 2024-02-20T08:05:28.579 INFO:tasks.workunit.client.0.smithi123.stdout:6/552: dread d0/f2c [0,4194304] 0 2024-02-20T08:05:28.581 INFO:tasks.workunit.client.0.smithi123.stdout:9/329: dread d6/d2a/f17 [0,4194304] 0 2024-02-20T08:05:28.582 INFO:tasks.workunit.client.0.smithi123.stdout:6/553: unlink d0/f14 0 2024-02-20T08:05:28.584 INFO:tasks.workunit.client.0.smithi123.stdout:6/554: write d0/d3e/d40/d7f/fb9 [248005,59031] 0 2024-02-20T08:05:28.586 INFO:tasks.workunit.client.0.smithi123.stdout:9/330: creat d6/d19/d1b/f68 x:0 0 0 2024-02-20T08:05:28.589 INFO:tasks.workunit.client.0.smithi123.stdout:6/555: symlink d0/d3e/d92/d56/d57/lba 0 2024-02-20T08:05:28.593 INFO:tasks.workunit.client.0.smithi123.stdout:6/556: unlink d0/d3e/d40/f8d 0 2024-02-20T08:05:28.595 INFO:tasks.workunit.client.0.smithi123.stdout:9/331: rename d6/d19/d1a/l2d to d6/d19/d1a/d2b/l69 0 2024-02-20T08:05:28.600 INFO:tasks.workunit.client.0.smithi123.stdout:6/557: mknod d0/d3e/d92/cbb 0 2024-02-20T08:05:28.602 INFO:tasks.workunit.client.0.smithi123.stdout:6/558: fdatasync d0/d3e/d92/d56/f99 0 2024-02-20T08:05:28.605 INFO:tasks.workunit.client.0.smithi123.stdout:6/559: mkdir d0/d9f/dbc 0 2024-02-20T08:05:28.607 INFO:tasks.workunit.client.0.smithi123.stdout:6/560: chown d0/l3c 15602977 1 2024-02-20T08:05:28.610 INFO:tasks.workunit.client.0.smithi123.stdout:6/561: creat d0/d3e/d40/d48/fbd x:0 0 0 2024-02-20T08:05:28.615 INFO:tasks.workunit.client.0.smithi123.stdout:9/332: creat d6/d19/d1a/f6a x:0 0 0 2024-02-20T08:05:28.616 INFO:tasks.workunit.client.0.smithi123.stdout:9/333: symlink d6/d2a/l6b 0 2024-02-20T08:05:28.621 INFO:tasks.workunit.client.0.smithi123.stdout:9/334: creat d6/d19/d1a/f6c x:0 0 0 2024-02-20T08:05:28.623 INFO:tasks.workunit.client.0.smithi123.stdout:6/562: creat d0/d3e/d40/d48/d4a/fbe x:0 0 0 2024-02-20T08:05:28.624 INFO:tasks.workunit.client.0.smithi123.stdout:9/335: mkdir d6/d19/d1a/d6d 0 2024-02-20T08:05:28.625 INFO:tasks.workunit.client.0.smithi123.stdout:9/336: creat d6/d19/d1a/d6d/f6e x:0 0 0 2024-02-20T08:05:28.627 INFO:tasks.workunit.client.0.smithi123.stdout:9/337: dread - d6/d19/d1a/d2b/d28/f55 zero size 2024-02-20T08:05:28.628 INFO:tasks.workunit.client.0.smithi123.stdout:9/338: truncate d6/d2a/d27/f54 677835 0 2024-02-20T08:05:28.629 INFO:tasks.workunit.client.0.smithi123.stdout:9/339: dread d6/f3f [0,4194304] 0 2024-02-20T08:05:28.631 INFO:tasks.workunit.client.0.smithi123.stdout:9/340: mkdir d6/d2a/d27/d6f 0 2024-02-20T08:05:28.632 INFO:tasks.workunit.client.0.smithi123.stdout:9/341: creat d6/d19/d1b/f70 x:0 0 0 2024-02-20T08:05:28.635 INFO:tasks.workunit.client.0.smithi123.stdout:9/342: creat d6/d19/d1a/f71 x:0 0 0 2024-02-20T08:05:28.636 INFO:tasks.workunit.client.0.smithi123.stdout:9/343: dread - d6/d19/d1a/d2b/d28/f55 zero size 2024-02-20T08:05:28.638 INFO:tasks.workunit.client.0.smithi123.stdout:9/344: unlink d6/ff 0 2024-02-20T08:05:28.643 INFO:tasks.workunit.client.0.smithi123.stdout:9/345: dwrite f5 [4194304,4194304] 0 2024-02-20T08:05:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:28 smithi194 ceph-mon[37804]: pgmap v33: 65 pgs: 65 active+clean; 606 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 8.6 MiB/s rd, 58 MiB/s wr, 155 op/s 2024-02-20T08:05:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:28.644 INFO:tasks.workunit.client.0.smithi123.stdout:9/346: chown d6/d19/d1b/f26 215 1 2024-02-20T08:05:28.645 INFO:tasks.workunit.client.0.smithi123.stdout:9/347: write d6/d19/d1a/d2b/d28/d50/f67 [449842,49976] 0 2024-02-20T08:05:28.646 INFO:tasks.workunit.client.0.smithi123.stdout:9/348: chown d6/d19/d1b/d3d/d32/l39 9 1 2024-02-20T08:05:28.647 INFO:tasks.workunit.client.0.smithi123.stdout:9/349: write d6/d19/f4a [103754,5719] 0 2024-02-20T08:05:28.648 INFO:tasks.workunit.client.0.smithi123.stdout:9/350: dread - d6/d19/d1a/f6a zero size 2024-02-20T08:05:28.652 INFO:tasks.workunit.client.0.smithi123.stdout:9/351: link d6/d2a/l6b d6/d19/d1a/d2b/d28/d66/l72 0 2024-02-20T08:05:28.656 INFO:tasks.workunit.client.0.smithi123.stdout:9/352: creat d6/d19/d1a/d31/d4b/f73 x:0 0 0 2024-02-20T08:05:28.656 INFO:tasks.workunit.client.0.smithi123.stdout:9/353: chown d6/d19/f49 8 1 2024-02-20T08:05:28.657 INFO:tasks.workunit.client.0.smithi123.stdout:9/354: write f5 [2067361,129478] 0 2024-02-20T08:05:28.659 INFO:tasks.workunit.client.0.smithi123.stdout:9/355: write d6/d19/d1a/d31/f46 [4247588,90057] 0 2024-02-20T08:05:28.673 INFO:tasks.workunit.client.0.smithi123.stdout:9/356: mkdir d6/d19/d1a/d31/d4b/d74 0 2024-02-20T08:05:28.679 INFO:tasks.workunit.client.0.smithi123.stdout:9/357: dwrite d6/d19/d1a/d2b/f37 [0,4194304] 0 2024-02-20T08:05:28.686 INFO:tasks.workunit.client.0.smithi123.stdout:9/358: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:28.694 INFO:tasks.workunit.client.0.smithi123.stdout:9/359: dwrite d6/d2a/d27/f54 [0,4194304] 0 2024-02-20T08:05:28.706 INFO:tasks.workunit.client.0.smithi123.stdout:9/360: chown d6/d2a/f59 37 1 2024-02-20T08:05:28.708 INFO:tasks.workunit.client.0.smithi123.stdout:9/361: dread - d6/d19/d1b/f70 zero size 2024-02-20T08:05:28.710 INFO:tasks.workunit.client.0.smithi123.stdout:9/362: creat d6/d19/d1a/d31/f75 x:0 0 0 2024-02-20T08:05:28.713 INFO:tasks.workunit.client.0.smithi123.stdout:9/363: getdents d6/d19/d1a/d2b/d28 0 2024-02-20T08:05:28.715 INFO:tasks.workunit.client.0.smithi123.stdout:9/364: write d6/d2a/f17 [5138993,124779] 0 2024-02-20T08:05:28.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/365: dread - d6/d19/f44 zero size 2024-02-20T08:05:28.717 INFO:tasks.workunit.client.0.smithi123.stdout:9/366: write d6/d19/d1a/d31/f75 [825104,41470] 0 2024-02-20T08:05:28.718 INFO:tasks.workunit.client.0.smithi123.stdout:9/367: write d6/d19/f4a [109879,66742] 0 2024-02-20T08:05:28.719 INFO:tasks.workunit.client.0.smithi123.stdout:9/368: dread - d6/f30 zero size 2024-02-20T08:05:28.721 INFO:tasks.workunit.client.0.smithi123.stdout:9/369: write d6/d19/d1a/d2b/f37 [732972,50458] 0 2024-02-20T08:05:28.723 INFO:tasks.workunit.client.0.smithi123.stdout:9/370: mknod d6/d19/d1a/d2b/c76 0 2024-02-20T08:05:28.725 INFO:tasks.workunit.client.0.smithi123.stdout:9/371: write d6/d19/d1a/d2b/f37 [310787,129931] 0 2024-02-20T08:05:28.726 INFO:tasks.workunit.client.0.smithi123.stdout:9/372: readlink d6/d19/d1a/l4e 0 2024-02-20T08:05:28.728 INFO:tasks.workunit.client.0.smithi123.stdout:9/373: mkdir d6/d19/d1a/d2b/d65/d77 0 2024-02-20T08:05:28.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/374: read - d6/d19/d1b/f68 zero size 2024-02-20T08:05:28.730 INFO:tasks.workunit.client.0.smithi123.stdout:9/375: fdatasync d6/d19/f49 0 2024-02-20T08:05:28.731 INFO:tasks.workunit.client.0.smithi123.stdout:9/376: write d6/d2a/f17 [1924862,11225] 0 2024-02-20T08:05:28.732 INFO:tasks.workunit.client.0.smithi123.stdout:9/377: symlink d6/d19/d1a/d31/l78 0 2024-02-20T08:05:28.747 INFO:tasks.workunit.client.0.smithi123.stdout:9/378: dread d6/d19/d1b/d3d/f57 [0,4194304] 0 2024-02-20T08:05:28.748 INFO:tasks.workunit.client.0.smithi123.stdout:9/379: dread - d6/d19/d1b/f68 zero size 2024-02-20T08:05:28.751 INFO:tasks.workunit.client.0.smithi123.stdout:9/380: link d6/d19/d1b/f70 d6/d19/d1a/d6d/f79 0 2024-02-20T08:05:28.755 INFO:tasks.workunit.client.0.smithi123.stdout:9/381: getdents d6/d2a 0 2024-02-20T08:05:28.756 INFO:tasks.workunit.client.0.smithi123.stdout:9/382: truncate d6/d19/d1a/f6c 39656 0 2024-02-20T08:05:28.756 INFO:tasks.workunit.client.0.smithi123.stdout:9/383: stat d6/d19/f49 0 2024-02-20T08:05:28.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:28 smithi123 ceph-mon[29383]: pgmap v33: 65 pgs: 65 active+clean; 606 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 8.6 MiB/s rd, 58 MiB/s wr, 155 op/s 2024-02-20T08:05:28.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:28.764 INFO:tasks.workunit.client.0.smithi123.stdout:9/384: dwrite d6/d19/d1b/f70 [0,4194304] 0 2024-02-20T08:05:28.771 INFO:tasks.workunit.client.0.smithi123.stdout:9/385: rename d6/d19/d1a/c1f to d6/d19/d1a/d31/d4b/c7a 0 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:2/323: sync 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:3/346: sync 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:1/395: sync 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:8/372: sync 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:7/322: sync 2024-02-20T08:05:28.941 INFO:tasks.workunit.client.0.smithi123.stdout:6/563: sync 2024-02-20T08:05:28.942 INFO:tasks.workunit.client.0.smithi123.stdout:4/374: sync 2024-02-20T08:05:28.942 INFO:tasks.workunit.client.0.smithi123.stdout:0/421: sync 2024-02-20T08:05:28.942 INFO:tasks.workunit.client.0.smithi123.stdout:5/275: sync 2024-02-20T08:05:28.944 INFO:tasks.workunit.client.0.smithi123.stdout:2/324: read d1a/f1d [1049611,49321] 0 2024-02-20T08:05:28.944 INFO:tasks.workunit.client.0.smithi123.stdout:8/373: read d6/fd [3186258,82971] 0 2024-02-20T08:05:28.945 INFO:tasks.workunit.client.0.smithi123.stdout:6/564: unlink d0/d38/f55 0 2024-02-20T08:05:28.947 INFO:tasks.workunit.client.0.smithi123.stdout:4/375: stat d3/d18/f19 0 2024-02-20T08:05:28.949 INFO:tasks.workunit.client.0.smithi123.stdout:4/376: chown d3/d18/d6c/l74 13381558 1 2024-02-20T08:05:28.949 INFO:tasks.workunit.client.0.smithi123.stdout:0/422: symlink d2/de/d19/l86 0 2024-02-20T08:05:28.952 INFO:tasks.workunit.client.0.smithi123.stdout:2/325: truncate d1a/f27 942159 0 2024-02-20T08:05:28.953 INFO:tasks.workunit.client.0.smithi123.stdout:6/565: chown d0/c42 96038 1 2024-02-20T08:05:28.954 INFO:tasks.workunit.client.0.smithi123.stdout:2/326: write d1a/f26 [444026,116068] 0 2024-02-20T08:05:28.954 INFO:tasks.workunit.client.0.smithi123.stdout:1/396: dwrite d3/db/d34/d74/f5c [0,4194304] 0 2024-02-20T08:05:28.956 INFO:tasks.workunit.client.0.smithi123.stdout:2/327: stat d1a/d29/d42/d4e 0 2024-02-20T08:05:28.956 INFO:tasks.workunit.client.0.smithi123.stdout:7/323: write d0/d6/dd/d52/f33 [3171026,120746] 0 2024-02-20T08:05:28.958 INFO:tasks.workunit.client.0.smithi123.stdout:2/328: write d1a/d29/f44 [435563,28553] 0 2024-02-20T08:05:28.966 INFO:tasks.workunit.client.0.smithi123.stdout:4/377: rename d3/d2c/d43/d26/f29 to d3/d18/d63/f83 0 2024-02-20T08:05:28.967 INFO:tasks.workunit.client.0.smithi123.stdout:9/386: sync 2024-02-20T08:05:28.970 INFO:tasks.workunit.client.0.smithi123.stdout:1/397: symlink d3/de/d14/d26/d56/l8b 0 2024-02-20T08:05:28.971 INFO:tasks.workunit.client.0.smithi123.stdout:1/398: rename d3 to d3/db/d34/d74/d6f/d8c 22 2024-02-20T08:05:28.971 INFO:tasks.workunit.client.0.smithi123.stdout:3/347: symlink d0/dd/d48/d6a/d74/l81 0 2024-02-20T08:05:28.972 INFO:tasks.workunit.client.0.smithi123.stdout:3/348: fdatasync d0/f3f 0 2024-02-20T08:05:28.974 INFO:tasks.workunit.client.0.smithi123.stdout:7/324: mkdir d0/db/d21/d42/d5f/d73 0 2024-02-20T08:05:28.975 INFO:tasks.workunit.client.0.smithi123.stdout:1/399: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:28.976 INFO:tasks.workunit.client.0.smithi123.stdout:0/423: symlink d2/d54/d78/l87 0 2024-02-20T08:05:28.979 INFO:tasks.workunit.client.0.smithi123.stdout:9/387: creat d6/d19/d1b/f7b x:0 0 0 2024-02-20T08:05:28.980 INFO:tasks.workunit.client.0.smithi123.stdout:9/388: write d6/d2a/d27/f2f [287654,53800] 0 2024-02-20T08:05:28.980 INFO:tasks.workunit.client.0.smithi123.stdout:6/566: mkdir d0/d3e/d40/d48/d5d/dbf 0 2024-02-20T08:05:28.981 INFO:tasks.workunit.client.0.smithi123.stdout:6/567: write d0/f22 [2769303,36828] 0 2024-02-20T08:05:28.982 INFO:tasks.workunit.client.0.smithi123.stdout:9/389: write d6/d2a/f59 [283480,69952] 0 2024-02-20T08:05:28.987 INFO:tasks.workunit.client.0.smithi123.stdout:7/325: creat d0/d6/dd/d52/d35/f74 x:0 0 0 2024-02-20T08:05:28.989 INFO:tasks.workunit.client.0.smithi123.stdout:0/424: symlink d2/dd/d4f/d61/d68/l88 0 2024-02-20T08:05:28.990 INFO:tasks.workunit.client.0.smithi123.stdout:0/425: write d2/de/d1e/d1f/f6f [585860,42429] 0 2024-02-20T08:05:28.993 INFO:tasks.workunit.client.0.smithi123.stdout:9/390: rmdir d6/d2a 39 2024-02-20T08:05:28.994 INFO:tasks.workunit.client.0.smithi123.stdout:3/349: mkdir d0/d6/d1a/d62/d82 0 2024-02-20T08:05:28.997 INFO:tasks.workunit.client.0.smithi123.stdout:2/329: rename d1a/d29/c31 to d1a/d29/c60 0 2024-02-20T08:05:28.997 INFO:tasks.workunit.client.0.smithi123.stdout:7/326: rmdir d0/db/d21/d42 39 2024-02-20T08:05:29.001 INFO:tasks.workunit.client.0.smithi123.stdout:4/378: creat d3/d2c/d43/f84 x:0 0 0 2024-02-20T08:05:29.001 INFO:tasks.workunit.client.0.smithi123.stdout:4/379: dread - d3/d2c/d43/d34/f7c zero size 2024-02-20T08:05:29.002 INFO:tasks.workunit.client.0.smithi123.stdout:0/426: rename d2/f5c to d2/de/d1e/d1f/d5e/f89 0 2024-02-20T08:05:29.004 INFO:tasks.workunit.client.0.smithi123.stdout:6/568: rmdir d0/d3e/d40/d48/daa 39 2024-02-20T08:05:29.007 INFO:tasks.workunit.client.0.smithi123.stdout:2/330: mknod d1a/d29/d42/d4e/c61 0 2024-02-20T08:05:29.008 INFO:tasks.workunit.client.0.smithi123.stdout:7/327: mknod d0/db/c75 0 2024-02-20T08:05:29.008 INFO:tasks.workunit.client.0.smithi123.stdout:7/328: truncate d0/d6/dd/f65 119568 0 2024-02-20T08:05:29.018 INFO:tasks.workunit.client.0.smithi123.stdout:4/380: symlink d3/d2c/d43/d26/l85 0 2024-02-20T08:05:29.019 INFO:tasks.workunit.client.0.smithi123.stdout:4/381: read d3/d1e/f60 [175799,35989] 0 2024-02-20T08:05:29.020 INFO:tasks.workunit.client.0.smithi123.stdout:4/382: write d3/d2c/d43/d34/f37 [424782,62707] 0 2024-02-20T08:05:29.022 INFO:tasks.workunit.client.0.smithi123.stdout:3/350: creat d0/d6/d1a/d1b/f83 x:0 0 0 2024-02-20T08:05:29.023 INFO:tasks.workunit.client.0.smithi123.stdout:3/351: dread - d0/d6/d1a/f6c zero size 2024-02-20T08:05:29.024 INFO:tasks.workunit.client.0.smithi123.stdout:3/352: dread - d0/dd/d48/f7f zero size 2024-02-20T08:05:29.024 INFO:tasks.workunit.client.0.smithi123.stdout:2/331: unlink d1a/d29/d42/c4c 0 2024-02-20T08:05:29.028 INFO:tasks.workunit.client.0.smithi123.stdout:9/391: rename d6/d19/d1a/d2b/d28/d66 to d6/d19/d1a/d7c 0 2024-02-20T08:05:29.031 INFO:tasks.workunit.client.0.smithi123.stdout:2/332: dwrite d1a/d29/d39/f5f [0,4194304] 0 2024-02-20T08:05:29.032 INFO:tasks.workunit.client.0.smithi123.stdout:6/569: creat d0/d3e/d40/d48/daa/dab/fc0 x:0 0 0 2024-02-20T08:05:29.034 INFO:tasks.workunit.client.0.smithi123.stdout:5/276: write d0/d13/f2c [3744736,126630] 0 2024-02-20T08:05:29.034 INFO:tasks.workunit.client.0.smithi123.stdout:6/570: write d0/f97 [176832,51799] 0 2024-02-20T08:05:29.038 INFO:tasks.workunit.client.0.smithi123.stdout:3/353: unlink d0/d6/d32/f4e 0 2024-02-20T08:05:29.040 INFO:tasks.workunit.client.0.smithi123.stdout:4/383: dread d3/d2c/f5d [0,4194304] 0 2024-02-20T08:05:29.040 INFO:tasks.workunit.client.0.smithi123.stdout:8/374: write d6/fa [478342,20570] 0 2024-02-20T08:05:29.048 INFO:tasks.workunit.client.0.smithi123.stdout:5/277: creat d0/d34/d48/d56/d25/f5f x:0 0 0 2024-02-20T08:05:29.050 INFO:tasks.workunit.client.0.smithi123.stdout:3/354: dread - d0/d6/d1a/f2f zero size 2024-02-20T08:05:29.051 INFO:tasks.workunit.client.0.smithi123.stdout:8/375: creat d6/d1c/d22/d4f/d5b/f7f x:0 0 0 2024-02-20T08:05:29.054 INFO:tasks.workunit.client.0.smithi123.stdout:9/392: link d6/d19/f4a d6/d19/d1a/d7c/f7d 0 2024-02-20T08:05:29.056 INFO:tasks.workunit.client.0.smithi123.stdout:6/571: mknod d0/d3e/d92/cc1 0 2024-02-20T08:05:29.059 INFO:tasks.workunit.client.0.smithi123.stdout:8/376: dwrite d6/d1c/d22/d4f/d5b/f7f [0,4194304] 0 2024-02-20T08:05:29.061 INFO:tasks.workunit.client.0.smithi123.stdout:3/355: read d0/d6/f2e [1107464,110150] 0 2024-02-20T08:05:29.062 INFO:tasks.workunit.client.0.smithi123.stdout:2/333: dread d1a/f1d [0,4194304] 0 2024-02-20T08:05:29.066 INFO:tasks.workunit.client.0.smithi123.stdout:9/393: mkdir d6/d19/d1a/d6d/d7e 0 2024-02-20T08:05:29.071 INFO:tasks.workunit.client.0.smithi123.stdout:5/278: mkdir d0/d13/d60 0 2024-02-20T08:05:29.073 INFO:tasks.workunit.client.0.smithi123.stdout:8/377: truncate d6/fd 367049 0 2024-02-20T08:05:29.074 INFO:tasks.workunit.client.0.smithi123.stdout:2/334: dread f10 [0,4194304] 0 2024-02-20T08:05:29.074 INFO:tasks.workunit.client.0.smithi123.stdout:8/378: read d6/d1c/d2c/f44 [3381309,37899] 0 2024-02-20T08:05:29.075 INFO:tasks.workunit.client.0.smithi123.stdout:2/335: write fc [8966970,51093] 0 2024-02-20T08:05:29.076 INFO:tasks.workunit.client.0.smithi123.stdout:2/336: truncate d1a/d29/f35 621119 0 2024-02-20T08:05:29.077 INFO:tasks.workunit.client.0.smithi123.stdout:1/400: truncate d3/f70 78806 0 2024-02-20T08:05:29.081 INFO:tasks.workunit.client.0.smithi123.stdout:3/356: link d0/d6/d1a/f23 d0/d6/d1a/d1b/d1c/d3b/f84 0 2024-02-20T08:05:29.084 INFO:tasks.workunit.client.0.smithi123.stdout:7/329: dwrite d0/d6/dd/d52/f51 [4194304,4194304] 0 2024-02-20T08:05:29.086 INFO:tasks.workunit.client.0.smithi123.stdout:7/330: write d0/f30 [3965640,85439] 0 2024-02-20T08:05:29.090 INFO:tasks.workunit.client.0.smithi123.stdout:3/357: creat d0/dd/d48/d6a/f85 x:0 0 0 2024-02-20T08:05:29.095 INFO:tasks.workunit.client.0.smithi123.stdout:9/394: rename d6/d19/d1a/d2b/d28/d50 to d6/d19/d1a/d7f 0 2024-02-20T08:05:29.096 INFO:tasks.workunit.client.0.smithi123.stdout:9/395: write d6/d19/d1a/d31/f46 [3972769,45453] 0 2024-02-20T08:05:29.098 INFO:tasks.workunit.client.0.smithi123.stdout:9/396: write d6/d19/d1a/f6a [272389,103319] 0 2024-02-20T08:05:29.100 INFO:tasks.workunit.client.0.smithi123.stdout:2/337: dread d1a/f1f [0,4194304] 0 2024-02-20T08:05:29.101 INFO:tasks.workunit.client.0.smithi123.stdout:7/331: dread d0/db/d38/d47/f6d [0,4194304] 0 2024-02-20T08:05:29.101 INFO:tasks.workunit.client.0.smithi123.stdout:8/379: creat d6/f80 x:0 0 0 2024-02-20T08:05:29.102 INFO:tasks.workunit.client.0.smithi123.stdout:7/332: chown d0/d6/dd/d15 8094 1 2024-02-20T08:05:29.104 INFO:tasks.workunit.client.0.smithi123.stdout:7/333: write d0/db/d38/d47/d4a/d59/f5b [5192375,25595] 0 2024-02-20T08:05:29.109 INFO:tasks.workunit.client.0.smithi123.stdout:4/384: truncate d3/d18/f77 934848 0 2024-02-20T08:05:29.111 INFO:tasks.workunit.client.0.smithi123.stdout:8/380: unlink d6/d32/f65 0 2024-02-20T08:05:29.114 INFO:tasks.workunit.client.0.smithi123.stdout:6/572: write d0/d3e/d92/d56/d57/f6b [287720,27615] 0 2024-02-20T08:05:29.114 INFO:tasks.workunit.client.0.smithi123.stdout:9/397: mkdir d6/d19/d1a/d6d/d7e/d80 0 2024-02-20T08:05:29.114 INFO:tasks.workunit.client.0.smithi123.stdout:7/334: chown d0/db/d21/d42/d1d/f56 3098119 1 2024-02-20T08:05:29.121 INFO:tasks.workunit.client.0.smithi123.stdout:5/279: write d0/d13/f1b [1173501,44813] 0 2024-02-20T08:05:29.122 INFO:tasks.workunit.client.0.smithi123.stdout:4/385: truncate d3/d2c/d43/f75 2926063 0 2024-02-20T08:05:29.122 INFO:tasks.workunit.client.0.smithi123.stdout:6/573: dwrite d0/d3e/d92/d56/d57/f74 [0,4194304] 0 2024-02-20T08:05:29.131 INFO:tasks.workunit.client.0.smithi123.stdout:5/280: dwrite d0/d13/d27/d4e/f52 [0,4194304] 0 2024-02-20T08:05:29.131 INFO:tasks.workunit.client.0.smithi123.stdout:9/398: mkdir d6/d19/d1a/d7c/d81 0 2024-02-20T08:05:29.132 INFO:tasks.workunit.client.0.smithi123.stdout:9/399: readlink d6/d19/d1a/d31/d4b/l52 0 2024-02-20T08:05:29.133 INFO:tasks.workunit.client.0.smithi123.stdout:5/281: truncate d0/f19 5204013 0 2024-02-20T08:05:29.136 INFO:tasks.workunit.client.0.smithi123.stdout:1/401: dwrite d3/de/d14/d2c/f32 [0,4194304] 0 2024-02-20T08:05:29.149 INFO:tasks.workunit.client.0.smithi123.stdout:3/358: truncate d0/dd/d48/f71 6132785 0 2024-02-20T08:05:29.151 INFO:tasks.workunit.client.0.smithi123.stdout:7/335: mknod d0/db/d21/d42/d5f/d73/c76 0 2024-02-20T08:05:29.154 INFO:tasks.workunit.client.0.smithi123.stdout:9/400: mknod d6/d19/d1a/d31/c82 0 2024-02-20T08:05:29.156 INFO:tasks.workunit.client.0.smithi123.stdout:2/338: getdents d1a/d29/d42/d4e 0 2024-02-20T08:05:29.158 INFO:tasks.workunit.client.0.smithi123.stdout:2/339: read d1a/f32 [3878566,127564] 0 2024-02-20T08:05:29.159 INFO:tasks.workunit.client.0.smithi123.stdout:4/386: rename d3/cb to d3/d2c/d5a/d7e/c86 0 2024-02-20T08:05:29.167 INFO:tasks.workunit.client.0.smithi123.stdout:8/381: write d6/d1c/d47/f59 [12375,121621] 0 2024-02-20T08:05:29.169 INFO:tasks.workunit.client.0.smithi123.stdout:8/382: write d6/d1c/d22/d4f/f56 [3032955,14625] 0 2024-02-20T08:05:29.170 INFO:tasks.workunit.client.0.smithi123.stdout:8/383: truncate d6/f3b 4605077 0 2024-02-20T08:05:29.171 INFO:tasks.workunit.client.0.smithi123.stdout:8/384: fdatasync d6/f71 0 2024-02-20T08:05:29.173 INFO:tasks.workunit.client.0.smithi123.stdout:7/336: dread d0/f5 [0,4194304] 0 2024-02-20T08:05:29.173 INFO:tasks.workunit.client.0.smithi123.stdout:5/282: rename d0/d34/d48/d56/f1a to d0/d34/d48/f61 0 2024-02-20T08:05:29.179 INFO:tasks.workunit.client.0.smithi123.stdout:5/283: dwrite d0/d13/f50 [0,4194304] 0 2024-02-20T08:05:29.186 INFO:tasks.workunit.client.0.smithi123.stdout:2/340: symlink d1a/l62 0 2024-02-20T08:05:29.190 INFO:tasks.workunit.client.0.smithi123.stdout:4/387: unlink d3/c24 0 2024-02-20T08:05:29.195 INFO:tasks.workunit.client.0.smithi123.stdout:3/359: rename d0/d6/d34/d5a to d0/d6/d1a/d1b/d2a/d86 0 2024-02-20T08:05:29.198 INFO:tasks.workunit.client.0.smithi123.stdout:6/574: getdents d0/d3e/d92/d56/d57/d91 0 2024-02-20T08:05:29.200 INFO:tasks.workunit.client.0.smithi123.stdout:9/401: link d6/d19/d1a/d2b/l60 d6/d19/d1b/l83 0 2024-02-20T08:05:29.209 INFO:tasks.workunit.client.0.smithi123.stdout:3/360: symlink d0/dd/l87 0 2024-02-20T08:05:29.209 INFO:tasks.workunit.client.0.smithi123.stdout:3/361: chown d0/d6/d1a/d62/l63 14 1 2024-02-20T08:05:29.211 INFO:tasks.workunit.client.0.smithi123.stdout:7/337: symlink d0/db/d38/d47/d4a/l77 0 2024-02-20T08:05:29.215 INFO:tasks.workunit.client.0.smithi123.stdout:6/575: chown d0/d3e/d92/d56/d89/d73/f9d 56848 1 2024-02-20T08:05:29.217 INFO:tasks.workunit.client.0.smithi123.stdout:9/402: stat d6/d2a/d27/d6f 0 2024-02-20T08:05:29.218 INFO:tasks.workunit.client.0.smithi123.stdout:2/341: mknod d1a/d29/d5d/c63 0 2024-02-20T08:05:29.221 INFO:tasks.workunit.client.0.smithi123.stdout:4/388: mkdir d3/d18/d7d/d87 0 2024-02-20T08:05:29.223 INFO:tasks.workunit.client.0.smithi123.stdout:8/385: creat d6/d1c/f81 x:0 0 0 2024-02-20T08:05:29.226 INFO:tasks.workunit.client.0.smithi123.stdout:4/389: dwrite d3/d1e/f7b [0,4194304] 0 2024-02-20T08:05:29.227 INFO:tasks.workunit.client.0.smithi123.stdout:4/390: chown d3/d2c/f5d 20052890 1 2024-02-20T08:05:29.228 INFO:tasks.workunit.client.0.smithi123.stdout:3/362: fsync d0/d6/d1a/d1b/d1c/f4f 0 2024-02-20T08:05:29.228 INFO:tasks.workunit.client.0.smithi123.stdout:4/391: chown d3/d2c/d43/d26/l85 839 1 2024-02-20T08:05:29.236 INFO:tasks.workunit.client.0.smithi123.stdout:9/403: write d6/d19/d1a/f5b [970237,111430] 0 2024-02-20T08:05:29.236 INFO:tasks.workunit.client.0.smithi123.stdout:9/404: chown d6/d19/d1a 170 1 2024-02-20T08:05:29.241 INFO:tasks.workunit.client.0.smithi123.stdout:5/284: rename d0/d13/f2f to d0/d34/d48/d56/f62 0 2024-02-20T08:05:29.249 INFO:tasks.workunit.client.0.smithi123.stdout:6/576: unlink d0/l12 0 2024-02-20T08:05:29.249 INFO:tasks.workunit.client.0.smithi123.stdout:6/577: dread - d0/d3e/d92/d56/f71 zero size 2024-02-20T08:05:29.252 INFO:tasks.workunit.client.0.smithi123.stdout:8/386: mkdir d6/d1c/d22/d4f/d7e/d82 0 2024-02-20T08:05:29.255 INFO:tasks.workunit.client.0.smithi123.stdout:9/405: dwrite d6/f58 [0,4194304] 0 2024-02-20T08:05:29.257 INFO:tasks.workunit.client.0.smithi123.stdout:2/342: rename d1a/d29/c2b to d1a/d4f/c64 0 2024-02-20T08:05:29.259 INFO:tasks.workunit.client.0.smithi123.stdout:5/285: write d0/d34/d48/d56/d3e/f3f [475802,3944] 0 2024-02-20T08:05:29.261 INFO:tasks.workunit.client.0.smithi123.stdout:7/338: link d0/d6/l66 d0/d6/dd/d52/d26/l78 0 2024-02-20T08:05:29.267 INFO:tasks.workunit.client.0.smithi123.stdout:9/406: mknod d6/d19/d1a/d2b/d28/c84 0 2024-02-20T08:05:29.274 INFO:tasks.workunit.client.0.smithi123.stdout:6/578: creat d0/d3e/d40/d48/d5d/fc2 x:0 0 0 2024-02-20T08:05:29.275 INFO:tasks.workunit.client.0.smithi123.stdout:8/387: symlink d6/d1c/l83 0 2024-02-20T08:05:29.276 INFO:tasks.workunit.client.0.smithi123.stdout:5/286: dwrite d0/d13/f1e [0,4194304] 0 2024-02-20T08:05:29.277 INFO:tasks.workunit.client.0.smithi123.stdout:8/388: write d6/f71 [934863,14568] 0 2024-02-20T08:05:29.278 INFO:tasks.workunit.client.0.smithi123.stdout:8/389: fsync d6/f6e 0 2024-02-20T08:05:29.278 INFO:tasks.workunit.client.0.smithi123.stdout:5/287: dread - d0/d34/d48/d56/f5e zero size 2024-02-20T08:05:29.279 INFO:tasks.workunit.client.0.smithi123.stdout:8/390: write d6/d1c/f81 [617579,1170] 0 2024-02-20T08:05:29.279 INFO:tasks.workunit.client.0.smithi123.stdout:0/427: sync 2024-02-20T08:05:29.282 INFO:tasks.workunit.client.0.smithi123.stdout:3/363: rename d0/d6/d1a/c79 to d0/d6/d1a/d1e/d49/c88 0 2024-02-20T08:05:29.289 INFO:tasks.workunit.client.0.smithi123.stdout:6/579: mkdir d0/d3e/d92/d56/d89/d73/d75/dc3 0 2024-02-20T08:05:29.291 INFO:tasks.workunit.client.0.smithi123.stdout:9/407: unlink d6/d2a/l6b 0 2024-02-20T08:05:29.293 INFO:tasks.workunit.client.0.smithi123.stdout:8/391: rmdir d6/d1c/d22/d4f 39 2024-02-20T08:05:29.293 INFO:tasks.workunit.client.0.smithi123.stdout:8/392: dread - d6/d1c/d29/f57 zero size 2024-02-20T08:05:29.295 INFO:tasks.workunit.client.0.smithi123.stdout:0/428: mkdir d2/d3/d37/d5f/d8a 0 2024-02-20T08:05:29.297 INFO:tasks.workunit.client.0.smithi123.stdout:2/343: rename fb to d1a/d29/d39/f65 0 2024-02-20T08:05:29.298 INFO:tasks.workunit.client.0.smithi123.stdout:0/429: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:29.299 INFO:tasks.workunit.client.0.smithi123.stdout:0/430: write d2/de/d1e/d1f/f6f [900829,47345] 0 2024-02-20T08:05:29.300 INFO:tasks.workunit.client.0.smithi123.stdout:0/431: chown d2/dd/f41 3 1 2024-02-20T08:05:29.301 INFO:tasks.workunit.client.0.smithi123.stdout:0/432: write d2/dd/f41 [2745133,18225] 0 2024-02-20T08:05:29.302 INFO:tasks.workunit.client.0.smithi123.stdout:6/580: symlink d0/d3e/d40/d90/lc4 0 2024-02-20T08:05:29.310 INFO:tasks.workunit.client.0.smithi123.stdout:8/393: dread d6/d32/f4a [0,4194304] 0 2024-02-20T08:05:29.311 INFO:tasks.workunit.client.0.smithi123.stdout:6/581: dwrite d0/f84 [0,4194304] 0 2024-02-20T08:05:29.314 INFO:tasks.workunit.client.0.smithi123.stdout:7/339: getdents d0/db 0 2024-02-20T08:05:29.317 INFO:tasks.workunit.client.0.smithi123.stdout:7/340: chown d0/db/d38/d47/d4a 1807 1 2024-02-20T08:05:29.319 INFO:tasks.workunit.client.0.smithi123.stdout:0/433: dread d2/dd/f31 [0,4194304] 0 2024-02-20T08:05:29.321 INFO:tasks.workunit.client.0.smithi123.stdout:8/394: dwrite d6/f7 [0,4194304] 0 2024-02-20T08:05:29.322 INFO:tasks.workunit.client.0.smithi123.stdout:7/341: write d0/d23/f2d [3078789,110347] 0 2024-02-20T08:05:29.324 INFO:tasks.workunit.client.0.smithi123.stdout:6/582: dwrite d0/d3e/d40/d48/d5d/fc2 [0,4194304] 0 2024-02-20T08:05:29.331 INFO:tasks.workunit.client.0.smithi123.stdout:6/583: read d0/d38/f3b [1031834,73329] 0 2024-02-20T08:05:29.332 INFO:tasks.workunit.client.0.smithi123.stdout:6/584: stat d0/d3e/d40/d48/daa/dab/fc0 0 2024-02-20T08:05:29.339 INFO:tasks.workunit.client.0.smithi123.stdout:2/344: dwrite d1a/f32 [0,4194304] 0 2024-02-20T08:05:29.339 INFO:tasks.workunit.client.0.smithi123.stdout:3/364: truncate d0/d6/d1a/d1b/d1c/d61/f5f 2858129 0 2024-02-20T08:05:29.340 INFO:tasks.workunit.client.0.smithi123.stdout:8/395: fsync d6/d1c/d29/f67 0 2024-02-20T08:05:29.349 INFO:tasks.workunit.client.0.smithi123.stdout:2/345: dwrite d1a/f50 [0,4194304] 0 2024-02-20T08:05:29.356 INFO:tasks.workunit.client.0.smithi123.stdout:3/365: creat d0/d6/d1a/d1b/d1c/d3b/d43/f89 x:0 0 0 2024-02-20T08:05:29.376 INFO:tasks.workunit.client.0.smithi123.stdout:7/342: mkdir d0/db/d38/d47/d4a/d59/d5c/d79 0 2024-02-20T08:05:29.381 INFO:tasks.workunit.client.0.smithi123.stdout:8/396: dread d6/f15 [0,4194304] 0 2024-02-20T08:05:29.382 INFO:tasks.workunit.client.0.smithi123.stdout:8/397: read - d6/d32/f60 zero size 2024-02-20T08:05:29.382 INFO:tasks.workunit.client.0.smithi123.stdout:5/288: rename d0/f33 to d0/d13/d27/f63 0 2024-02-20T08:05:29.384 INFO:tasks.workunit.client.0.smithi123.stdout:2/346: dwrite d1a/f2e [0,4194304] 0 2024-02-20T08:05:29.384 INFO:tasks.workunit.client.0.smithi123.stdout:5/289: fdatasync d0/d34/d48/d56/d3e/f3f 0 2024-02-20T08:05:29.384 INFO:tasks.workunit.client.0.smithi123.stdout:3/366: creat d0/d6/d1a/d1b/d1c/d3b/f8a x:0 0 0 2024-02-20T08:05:29.391 INFO:tasks.workunit.client.0.smithi123.stdout:9/408: rename d6/d2a/l16 to d6/d19/l85 0 2024-02-20T08:05:29.393 INFO:tasks.workunit.client.0.smithi123.stdout:8/398: symlink d6/d1c/d29/l84 0 2024-02-20T08:05:29.396 INFO:tasks.workunit.client.0.smithi123.stdout:3/367: chown d0/d6/d1a/f39 18863 1 2024-02-20T08:05:29.398 INFO:tasks.workunit.client.0.smithi123.stdout:5/290: creat d0/d34/d48/f64 x:0 0 0 2024-02-20T08:05:29.401 INFO:tasks.workunit.client.0.smithi123.stdout:7/343: creat d0/d6/dd/d15/d61/f7a x:0 0 0 2024-02-20T08:05:29.402 INFO:tasks.workunit.client.0.smithi123.stdout:6/585: getdents d0/d3e/d40/d7f 0 2024-02-20T08:05:29.404 INFO:tasks.workunit.client.0.smithi123.stdout:0/434: rename d2/de/d1e/d1f/f6f to d2/d3/d37/d5f/d8a/f8b 0 2024-02-20T08:05:29.405 INFO:tasks.workunit.client.0.smithi123.stdout:0/435: dread - d2/dd/d4f/d61/f7d zero size 2024-02-20T08:05:29.414 INFO:tasks.workunit.client.0.smithi123.stdout:1/402: sync 2024-02-20T08:05:29.429 INFO:tasks.workunit.client.0.smithi123.stdout:5/291: mknod d0/d34/d48/c65 0 2024-02-20T08:05:29.430 INFO:tasks.workunit.client.0.smithi123.stdout:0/436: dread - d2/de/d1e/f85 zero size 2024-02-20T08:05:29.432 INFO:tasks.workunit.client.0.smithi123.stdout:3/368: write d0/d6/d1a/d1e/d49/f56 [204194,13367] 0 2024-02-20T08:05:29.432 INFO:tasks.workunit.client.0.smithi123.stdout:8/399: rename d6/d32/f60 to d6/d1c/d22/d4f/f85 0 2024-02-20T08:05:29.434 INFO:tasks.workunit.client.0.smithi123.stdout:1/403: creat d3/de/f8d x:0 0 0 2024-02-20T08:05:29.435 INFO:tasks.workunit.client.0.smithi123.stdout:2/347: link d1a/d29/d42/l47 d1a/d4f/l66 0 2024-02-20T08:05:29.437 INFO:tasks.workunit.client.0.smithi123.stdout:5/292: rmdir d0/d34/d48/d56/d25 39 2024-02-20T08:05:29.440 INFO:tasks.workunit.client.0.smithi123.stdout:8/400: dwrite d6/f80 [0,4194304] 0 2024-02-20T08:05:29.440 INFO:tasks.workunit.client.0.smithi123.stdout:6/586: rename d0/d3e/d92/c78 to d0/d3e/d40/d48/d4a/cc5 0 2024-02-20T08:05:29.442 INFO:tasks.workunit.client.0.smithi123.stdout:6/587: write d0/d3e/d92/d56/d57/f74 [2299742,30699] 0 2024-02-20T08:05:29.443 INFO:tasks.workunit.client.0.smithi123.stdout:6/588: write d0/f34 [2559081,88370] 0 2024-02-20T08:05:29.447 INFO:tasks.workunit.client.0.smithi123.stdout:0/437: unlink d2/de/l3c 0 2024-02-20T08:05:29.451 INFO:tasks.workunit.client.0.smithi123.stdout:5/293: creat d0/d34/f66 x:0 0 0 2024-02-20T08:05:29.454 INFO:tasks.workunit.client.0.smithi123.stdout:3/369: creat d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8b x:0 0 0 2024-02-20T08:05:29.457 INFO:tasks.workunit.client.0.smithi123.stdout:3/370: dread d0/d6/d1a/d1b/d1c/d20/f40 [0,4194304] 0 2024-02-20T08:05:29.458 INFO:tasks.workunit.client.0.smithi123.stdout:7/344: getdents d0/d6/dd/d15 0 2024-02-20T08:05:29.459 INFO:tasks.workunit.client.0.smithi123.stdout:3/371: truncate d0/dd/d48/f7f 703525 0 2024-02-20T08:05:29.459 INFO:tasks.workunit.client.0.smithi123.stdout:6/589: creat d0/d3e/d92/d56/d57/d91/fc6 x:0 0 0 2024-02-20T08:05:29.460 INFO:tasks.workunit.client.0.smithi123.stdout:6/590: fdatasync d0/d3e/d40/d48/d5d/f62 0 2024-02-20T08:05:29.462 INFO:tasks.workunit.client.0.smithi123.stdout:1/404: link d3/de/d14/d36/f78 d3/de/f8e 0 2024-02-20T08:05:29.464 INFO:tasks.workunit.client.0.smithi123.stdout:0/438: creat d2/dd/d4f/d7c/f8c x:0 0 0 2024-02-20T08:05:29.467 INFO:tasks.workunit.client.0.smithi123.stdout:5/294: mkdir d0/d34/d67 0 2024-02-20T08:05:29.468 INFO:tasks.workunit.client.0.smithi123.stdout:6/591: dwrite d0/f69 [0,4194304] 0 2024-02-20T08:05:29.468 INFO:tasks.workunit.client.0.smithi123.stdout:5/295: stat d0/d34/d48/d56/d3e 0 2024-02-20T08:05:29.469 INFO:tasks.workunit.client.0.smithi123.stdout:2/348: rename d1a/c20 to d1a/d29/d42/d4e/c67 0 2024-02-20T08:05:29.470 INFO:tasks.workunit.client.0.smithi123.stdout:5/296: chown d0/d34/c39 14832794 1 2024-02-20T08:05:29.476 INFO:tasks.workunit.client.0.smithi123.stdout:7/345: unlink d0/db/c1b 0 2024-02-20T08:05:29.480 INFO:tasks.workunit.client.0.smithi123.stdout:5/297: dwrite d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:29.483 INFO:tasks.workunit.client.0.smithi123.stdout:1/405: dread d3/de/d14/d36/f3d [0,4194304] 0 2024-02-20T08:05:29.485 INFO:tasks.workunit.client.0.smithi123.stdout:6/592: creat d0/d9f/fc7 x:0 0 0 2024-02-20T08:05:29.486 INFO:tasks.workunit.client.0.smithi123.stdout:0/439: dread d2/de/f17 [0,4194304] 0 2024-02-20T08:05:29.492 INFO:tasks.workunit.client.0.smithi123.stdout:1/406: dwrite d3/db/d34/d74/f5c [0,4194304] 0 2024-02-20T08:05:29.492 INFO:tasks.workunit.client.0.smithi123.stdout:7/346: mkdir d0/d6/dd/d52/d26/d7b 0 2024-02-20T08:05:29.495 INFO:tasks.workunit.client.0.smithi123.stdout:1/407: read - d3/db/f7e zero size 2024-02-20T08:05:29.495 INFO:tasks.workunit.client.0.smithi123.stdout:6/593: dwrite d0/d3e/d40/d7f/fb9 [0,4194304] 0 2024-02-20T08:05:29.498 INFO:tasks.workunit.client.0.smithi123.stdout:5/298: symlink d0/d34/d48/d56/d3e/l68 0 2024-02-20T08:05:29.500 INFO:tasks.workunit.client.0.smithi123.stdout:5/299: chown d0/d34/d48/d56/d4c 104569774 1 2024-02-20T08:05:29.501 INFO:tasks.workunit.client.0.smithi123.stdout:3/372: write d0/d6/f2e [1992443,122363] 0 2024-02-20T08:05:29.504 INFO:tasks.workunit.client.0.smithi123.stdout:8/401: getdents d6/d32 0 2024-02-20T08:05:29.505 INFO:tasks.workunit.client.0.smithi123.stdout:7/347: dwrite d0/db/d21/d42/d5f/f2b [0,4194304] 0 2024-02-20T08:05:29.505 INFO:tasks.workunit.client.0.smithi123.stdout:8/402: stat d6/d32/l72 0 2024-02-20T08:05:29.507 INFO:tasks.workunit.client.0.smithi123.stdout:2/349: rename d1a/c25 to d1a/d29/d42/d52/c68 0 2024-02-20T08:05:29.508 INFO:tasks.workunit.client.0.smithi123.stdout:2/350: chown d1a/c5e 19 1 2024-02-20T08:05:29.510 INFO:tasks.workunit.client.0.smithi123.stdout:6/594: chown d0/d3e/d40/d48/l98 1264 1 2024-02-20T08:05:29.512 INFO:tasks.workunit.client.0.smithi123.stdout:1/408: creat d3/de/d14/d2c/d45/f8f x:0 0 0 2024-02-20T08:05:29.513 INFO:tasks.workunit.client.0.smithi123.stdout:1/409: fsync d3/db/d34/d74/d6f/d63/f72 0 2024-02-20T08:05:29.515 INFO:tasks.workunit.client.0.smithi123.stdout:3/373: fsync d0/d6/d1a/f23 0 2024-02-20T08:05:29.516 INFO:tasks.workunit.client.0.smithi123.stdout:5/300: mknod d0/d34/d48/d56/d3e/c69 0 2024-02-20T08:05:29.517 INFO:tasks.workunit.client.0.smithi123.stdout:0/440: symlink d2/d3/l8d 0 2024-02-20T08:05:29.520 INFO:tasks.workunit.client.0.smithi123.stdout:7/348: symlink d0/db/d21/d42/d5f/d4b/l7c 0 2024-02-20T08:05:29.522 INFO:tasks.workunit.client.0.smithi123.stdout:2/351: rmdir d1a/d29/d39 39 2024-02-20T08:05:29.526 INFO:tasks.workunit.client.0.smithi123.stdout:1/410: symlink d3/de/d14/d26/d2e/d54/l90 0 2024-02-20T08:05:29.528 INFO:tasks.workunit.client.0.smithi123.stdout:0/441: creat d2/de/d1e/d1f/f8e x:0 0 0 2024-02-20T08:05:29.531 INFO:tasks.workunit.client.0.smithi123.stdout:7/349: write d0/d23/f4f [12803,16345] 0 2024-02-20T08:05:29.533 INFO:tasks.workunit.client.0.smithi123.stdout:7/350: truncate d0/f64 230522 0 2024-02-20T08:05:29.533 INFO:tasks.workunit.client.0.smithi123.stdout:8/403: link d6/f20 d6/d1c/d22/d4f/d7e/d82/f86 0 2024-02-20T08:05:29.534 INFO:tasks.workunit.client.0.smithi123.stdout:2/352: truncate f10 3011509 0 2024-02-20T08:05:29.534 INFO:tasks.workunit.client.0.smithi123.stdout:7/351: read d0/db/d21/d42/d1d/f36 [359327,12750] 0 2024-02-20T08:05:29.535 INFO:tasks.workunit.client.0.smithi123.stdout:2/353: stat d1a/f1f 0 2024-02-20T08:05:29.539 INFO:tasks.workunit.client.0.smithi123.stdout:1/411: creat d3/de/d14/d26/d56/f91 x:0 0 0 2024-02-20T08:05:29.539 INFO:tasks.workunit.client.0.smithi123.stdout:0/442: symlink d2/dd/d4f/d61/d68/l8f 0 2024-02-20T08:05:29.542 INFO:tasks.workunit.client.0.smithi123.stdout:3/374: dwrite d0/d6/d1a/d1b/d1c/f25 [0,4194304] 0 2024-02-20T08:05:29.542 INFO:tasks.workunit.client.0.smithi123.stdout:1/412: readlink d3/de/d14/d2c/d45/l75 0 2024-02-20T08:05:29.543 INFO:tasks.workunit.client.0.smithi123.stdout:2/354: mknod d1a/d29/d42/d4e/c69 0 2024-02-20T08:05:29.544 INFO:tasks.workunit.client.0.smithi123.stdout:7/352: mknod d0/db/d38/d47/d4a/d59/d5c/c7d 0 2024-02-20T08:05:29.546 INFO:tasks.workunit.client.0.smithi123.stdout:6/595: rename d0/d3e/d40/d90/lc4 to d0/lc8 0 2024-02-20T08:05:29.548 INFO:tasks.workunit.client.0.smithi123.stdout:8/404: dread d6/d1c/d2c/f75 [0,4194304] 0 2024-02-20T08:05:29.549 INFO:tasks.workunit.client.0.smithi123.stdout:1/413: creat d3/db/d34/f92 x:0 0 0 2024-02-20T08:05:29.550 INFO:tasks.workunit.client.0.smithi123.stdout:6/596: read d0/d3e/d40/d48/d5d/fc2 [823699,28082] 0 2024-02-20T08:05:29.551 INFO:tasks.workunit.client.0.smithi123.stdout:0/443: dwrite d2/dd/d4f/d61/d68/f76 [0,4194304] 0 2024-02-20T08:05:29.553 INFO:tasks.workunit.client.0.smithi123.stdout:7/353: unlink d0/db/d21/d42/d5f/f58 0 2024-02-20T08:05:29.557 INFO:tasks.workunit.client.0.smithi123.stdout:8/405: creat d6/d1c/d22/d4f/f87 x:0 0 0 2024-02-20T08:05:29.560 INFO:tasks.workunit.client.0.smithi123.stdout:1/414: mknod d3/de/d14/d26/d2e/d54/d5d/c93 0 2024-02-20T08:05:29.562 INFO:tasks.workunit.client.0.smithi123.stdout:0/444: creat d2/dd/d4f/d6a/f90 x:0 0 0 2024-02-20T08:05:29.563 INFO:tasks.workunit.client.0.smithi123.stdout:0/445: fsync d2/f1b 0 2024-02-20T08:05:29.564 INFO:tasks.workunit.client.0.smithi123.stdout:7/354: dwrite d0/f64 [0,4194304] 0 2024-02-20T08:05:29.564 INFO:tasks.workunit.client.0.smithi123.stdout:3/375: creat d0/f8c x:0 0 0 2024-02-20T08:05:29.569 INFO:tasks.workunit.client.0.smithi123.stdout:2/355: truncate d1a/d29/d39/f65 5099677 0 2024-02-20T08:05:29.570 INFO:tasks.workunit.client.0.smithi123.stdout:2/356: readlink d1a/d29/d39/l46 0 2024-02-20T08:05:29.573 INFO:tasks.workunit.client.0.smithi123.stdout:8/406: fsync d6/d1c/d29/f5d 0 2024-02-20T08:05:29.575 INFO:tasks.workunit.client.0.smithi123.stdout:8/407: chown d6/d1c/d29/l76 61 1 2024-02-20T08:05:29.578 INFO:tasks.workunit.client.0.smithi123.stdout:1/415: creat d3/db/d34/f94 x:0 0 0 2024-02-20T08:05:29.578 INFO:tasks.workunit.client.0.smithi123.stdout:2/357: dwrite d1a/d29/d39/f3a [0,4194304] 0 2024-02-20T08:05:29.580 INFO:tasks.workunit.client.0.smithi123.stdout:3/376: mkdir d0/dd/d48/d8d 0 2024-02-20T08:05:29.583 INFO:tasks.workunit.client.0.smithi123.stdout:0/446: read d2/de/d1e/d1f/f77 [1584962,36178] 0 2024-02-20T08:05:29.588 INFO:tasks.workunit.client.0.smithi123.stdout:1/416: creat d3/de/d14/d2c/d45/f95 x:0 0 0 2024-02-20T08:05:29.589 INFO:tasks.workunit.client.0.smithi123.stdout:3/377: mkdir d0/d6/d1a/d1b/d1c/d21/d8e 0 2024-02-20T08:05:29.590 INFO:tasks.workunit.client.0.smithi123.stdout:3/378: chown d0/d6/d1a/d1b/d1c/f25 0 1 2024-02-20T08:05:29.591 INFO:tasks.workunit.client.0.smithi123.stdout:7/355: creat d0/d6/dd/d52/d26/d7b/f7e x:0 0 0 2024-02-20T08:05:29.592 INFO:tasks.workunit.client.0.smithi123.stdout:0/447: creat d2/dd/d4f/f91 x:0 0 0 2024-02-20T08:05:29.593 INFO:tasks.workunit.client.0.smithi123.stdout:8/408: symlink d6/d1c/d22/d4f/d7e/d82/l88 0 2024-02-20T08:05:29.597 INFO:tasks.workunit.client.0.smithi123.stdout:3/379: creat d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8f x:0 0 0 2024-02-20T08:05:29.598 INFO:tasks.workunit.client.0.smithi123.stdout:6/597: dwrite d0/d3e/d92/d56/f99 [4194304,4194304] 0 2024-02-20T08:05:29.603 INFO:tasks.workunit.client.0.smithi123.stdout:8/409: creat d6/d1c/d29/d3f/f89 x:0 0 0 2024-02-20T08:05:29.604 INFO:tasks.workunit.client.0.smithi123.stdout:8/410: readlink d6/d1c/d22/l24 0 2024-02-20T08:05:29.605 INFO:tasks.workunit.client.0.smithi123.stdout:8/411: fdatasync d6/f74 0 2024-02-20T08:05:29.606 INFO:tasks.workunit.client.0.smithi123.stdout:8/412: fdatasync d6/d1c/f81 0 2024-02-20T08:05:29.607 INFO:tasks.workunit.client.0.smithi123.stdout:6/598: rmdir d0/d3e/d40/d90 39 2024-02-20T08:05:29.608 INFO:tasks.workunit.client.0.smithi123.stdout:6/599: write d0/d3e/f7c [1676582,56586] 0 2024-02-20T08:05:29.611 INFO:tasks.workunit.client.0.smithi123.stdout:1/417: rmdir d3/db/d34 39 2024-02-20T08:05:29.612 INFO:tasks.workunit.client.0.smithi123.stdout:1/418: readlink d3/de/d14/d26/d56/l76 0 2024-02-20T08:05:29.613 INFO:tasks.workunit.client.0.smithi123.stdout:1/419: read - d3/de/d14/d26/d56/f91 zero size 2024-02-20T08:05:29.614 INFO:tasks.workunit.client.0.smithi123.stdout:2/358: dread f15 [0,4194304] 0 2024-02-20T08:05:29.615 INFO:tasks.workunit.client.0.smithi123.stdout:2/359: read f11 [11569934,45115] 0 2024-02-20T08:05:29.618 INFO:tasks.workunit.client.0.smithi123.stdout:6/600: read d0/f33 [1729515,110488] 0 2024-02-20T08:05:29.619 INFO:tasks.workunit.client.0.smithi123.stdout:6/601: chown d0/d38/l58 63 1 2024-02-20T08:05:29.620 INFO:tasks.workunit.client.0.smithi123.stdout:1/420: dread - d3/db/d34/d74/d6f/d63/f72 zero size 2024-02-20T08:05:29.622 INFO:tasks.workunit.client.0.smithi123.stdout:8/413: creat d6/d1c/d29/d7d/f8a x:0 0 0 2024-02-20T08:05:29.625 INFO:tasks.workunit.client.0.smithi123.stdout:7/356: write d0/d6/dd/d52/f3b [6409549,48854] 0 2024-02-20T08:05:29.626 INFO:tasks.workunit.client.0.smithi123.stdout:6/602: dwrite d0/d3e/d92/d56/f5a [0,4194304] 0 2024-02-20T08:05:29.630 INFO:tasks.workunit.client.0.smithi123.stdout:7/357: write d0/d6/dd/d52/f33 [2388029,95181] 0 2024-02-20T08:05:29.632 INFO:tasks.workunit.client.0.smithi123.stdout:8/414: dwrite d6/d1c/f81 [0,4194304] 0 2024-02-20T08:05:29.633 INFO:tasks.workunit.client.0.smithi123.stdout:1/421: creat d3/de/d14/d26/d2e/d54/d5d/f96 x:0 0 0 2024-02-20T08:05:29.634 INFO:tasks.workunit.client.0.smithi123.stdout:0/448: write d2/de/d1e/d1f/d5e/f89 [369580,116944] 0 2024-02-20T08:05:29.635 INFO:tasks.workunit.client.0.smithi123.stdout:1/422: dread - d3/db/d34/f92 zero size 2024-02-20T08:05:29.635 INFO:tasks.workunit.client.0.smithi123.stdout:0/449: readlink d2/dd/d4f/d61/d68/l88 0 2024-02-20T08:05:29.641 INFO:tasks.workunit.client.0.smithi123.stdout:7/358: fdatasync d0/d6/d7/f4e 0 2024-02-20T08:05:29.643 INFO:tasks.workunit.client.0.smithi123.stdout:7/359: write d0/d6/d29/f6e [1415382,42053] 0 2024-02-20T08:05:29.644 INFO:tasks.workunit.client.0.smithi123.stdout:0/450: creat d2/d3/d37/d5f/f92 x:0 0 0 2024-02-20T08:05:29.644 INFO:tasks.workunit.client.0.smithi123.stdout:7/360: chown d0/db/d21/d42/c1c 54801 1 2024-02-20T08:05:29.645 INFO:tasks.workunit.client.0.smithi123.stdout:7/361: write d0/d6/dd/f65 [575236,82869] 0 2024-02-20T08:05:29.646 INFO:tasks.workunit.client.0.smithi123.stdout:6/603: truncate d0/d38/f3a 1704285 0 2024-02-20T08:05:29.647 INFO:tasks.workunit.client.0.smithi123.stdout:6/604: chown d0/d3e/d40/d48/daa/dab/fb2 1 1 2024-02-20T08:05:29.648 INFO:tasks.workunit.client.0.smithi123.stdout:1/423: rename d3/de/d14/d26/d2e/d54/d5d/f96 to d3/db/d7f/f97 0 2024-02-20T08:05:29.655 INFO:tasks.workunit.client.0.smithi123.stdout:8/415: write d6/d1c/f21 [854576,27772] 0 2024-02-20T08:05:29.656 INFO:tasks.workunit.client.0.smithi123.stdout:6/605: dwrite d0/f31 [4194304,4194304] 0 2024-02-20T08:05:29.660 INFO:tasks.workunit.client.0.smithi123.stdout:1/424: dwrite d3/db/d41/f4b [0,4194304] 0 2024-02-20T08:05:29.661 INFO:tasks.workunit.client.0.smithi123.stdout:0/451: rename d2/d3/c75 to d2/d3/d37/d5f/c93 0 2024-02-20T08:05:29.662 INFO:tasks.workunit.client.0.smithi123.stdout:2/360: dwrite d1a/f1e [0,4194304] 0 2024-02-20T08:05:29.664 INFO:tasks.workunit.client.0.smithi123.stdout:1/425: fdatasync d3/db/d34/d74/f1a 0 2024-02-20T08:05:29.670 INFO:tasks.workunit.client.0.smithi123.stdout:0/452: fsync d2/f42 0 2024-02-20T08:05:29.671 INFO:tasks.workunit.client.0.smithi123.stdout:2/361: mknod d1a/d29/d42/d52/c6a 0 2024-02-20T08:05:29.672 INFO:tasks.workunit.client.0.smithi123.stdout:7/362: creat d0/f7f x:0 0 0 2024-02-20T08:05:29.672 INFO:tasks.workunit.client.0.smithi123.stdout:6/606: dread d0/f21 [0,4194304] 0 2024-02-20T08:05:29.673 INFO:tasks.workunit.client.0.smithi123.stdout:8/416: rename d6/c13 to d6/d1c/d2c/c8b 0 2024-02-20T08:05:29.673 INFO:tasks.workunit.client.0.smithi123.stdout:2/362: dread - d1a/d4f/f53 zero size 2024-02-20T08:05:29.675 INFO:tasks.workunit.client.0.smithi123.stdout:0/453: write d2/de/d1e/f85 [945601,631] 0 2024-02-20T08:05:29.680 INFO:tasks.workunit.client.0.smithi123.stdout:2/363: chown d1a/d29/d39/f65 1524254575 1 2024-02-20T08:05:29.681 INFO:tasks.workunit.client.0.smithi123.stdout:4/392: sync 2024-02-20T08:05:29.682 INFO:tasks.workunit.client.0.smithi123.stdout:1/426: dwrite d3/de/d14/d26/f81 [0,4194304] 0 2024-02-20T08:05:29.682 INFO:tasks.workunit.client.0.smithi123.stdout:8/417: write d6/f15 [2233955,8065] 0 2024-02-20T08:05:29.683 INFO:tasks.workunit.client.0.smithi123.stdout:7/363: mknod d0/d6/d29/c80 0 2024-02-20T08:05:29.686 INFO:tasks.workunit.client.0.smithi123.stdout:7/364: chown d0/db/d38/d47/d4a/d59/f5b 0 1 2024-02-20T08:05:29.689 INFO:tasks.workunit.client.0.smithi123.stdout:1/427: creat d3/de/f98 x:0 0 0 2024-02-20T08:05:29.693 INFO:tasks.workunit.client.0.smithi123.stdout:8/418: truncate d6/f2f 2432823 0 2024-02-20T08:05:29.694 INFO:tasks.workunit.client.0.smithi123.stdout:7/365: write d0/d6/d29/f3a [913395,119147] 0 2024-02-20T08:05:29.695 INFO:tasks.workunit.client.0.smithi123.stdout:4/393: mkdir d3/d18/d63/d88 0 2024-02-20T08:05:29.696 INFO:tasks.workunit.client.0.smithi123.stdout:6/607: dread d0/d3e/d92/d56/f99 [4194304,4194304] 0 2024-02-20T08:05:29.698 INFO:tasks.workunit.client.0.smithi123.stdout:7/366: truncate d0/d6/dd/f65 725302 0 2024-02-20T08:05:29.702 INFO:tasks.workunit.client.0.smithi123.stdout:1/428: creat d3/de/d14/d26/d2e/d54/d5d/f99 x:0 0 0 2024-02-20T08:05:29.705 INFO:tasks.workunit.client.0.smithi123.stdout:4/394: dwrite d3/d2c/d43/d34/f7c [0,4194304] 0 2024-02-20T08:05:29.705 INFO:tasks.workunit.client.0.smithi123.stdout:2/364: rename d1a/d29/d39/l46 to d1a/d29/l6b 0 2024-02-20T08:05:29.706 INFO:tasks.workunit.client.0.smithi123.stdout:0/454: dread d2/d3/f24 [0,4194304] 0 2024-02-20T08:05:29.707 INFO:tasks.workunit.client.0.smithi123.stdout:4/395: write d3/ff [10905242,77861] 0 2024-02-20T08:05:29.708 INFO:tasks.workunit.client.0.smithi123.stdout:2/365: write d1a/d29/d39/f5f [700199,6692] 0 2024-02-20T08:05:29.715 INFO:tasks.workunit.client.0.smithi123.stdout:2/366: dread d1a/d29/d39/f65 [4194304,4194304] 0 2024-02-20T08:05:29.716 INFO:tasks.workunit.client.0.smithi123.stdout:1/429: symlink d3/de/l9a 0 2024-02-20T08:05:29.718 INFO:tasks.workunit.client.0.smithi123.stdout:6/608: mkdir d0/d3e/d40/d90/d94/dc9 0 2024-02-20T08:05:29.718 INFO:tasks.workunit.client.0.smithi123.stdout:6/609: chown d0/f13 56757 1 2024-02-20T08:05:29.723 INFO:tasks.workunit.client.0.smithi123.stdout:7/367: symlink d0/d6/dd/d52/l81 0 2024-02-20T08:05:29.726 INFO:tasks.workunit.client.0.smithi123.stdout:2/367: creat d1a/d29/d39/f6c x:0 0 0 2024-02-20T08:05:29.728 INFO:tasks.workunit.client.0.smithi123.stdout:1/430: unlink d3/db/f2d 0 2024-02-20T08:05:29.730 INFO:tasks.workunit.client.0.smithi123.stdout:1/431: dread - d3/d47/f66 zero size 2024-02-20T08:05:29.733 INFO:tasks.workunit.client.0.smithi123.stdout:0/455: getdents d2/de/d1e/d1f/d74 0 2024-02-20T08:05:29.734 INFO:tasks.workunit.client.0.smithi123.stdout:8/419: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:29.734 INFO:tasks.workunit.client.0.smithi123.stdout:0/456: stat d2/dd 0 2024-02-20T08:05:29.737 INFO:tasks.workunit.client.0.smithi123.stdout:2/368: read d1a/d29/d39/f59 [617379,77363] 0 2024-02-20T08:05:29.739 INFO:tasks.workunit.client.0.smithi123.stdout:1/432: rmdir d3/de/d14/d26/d2e 39 2024-02-20T08:05:29.744 INFO:tasks.workunit.client.0.smithi123.stdout:7/368: write d0/d6/d7/f4e [3399381,124105] 0 2024-02-20T08:05:29.745 INFO:tasks.workunit.client.0.smithi123.stdout:2/369: symlink d1a/d29/d42/d4e/l6d 0 2024-02-20T08:05:29.746 INFO:tasks.workunit.client.0.smithi123.stdout:2/370: chown d1a/d29/l38 50 1 2024-02-20T08:05:29.747 INFO:tasks.workunit.client.0.smithi123.stdout:4/396: rename d3/d2c/d5a/l5c to d3/d2c/l89 0 2024-02-20T08:05:29.748 INFO:tasks.workunit.client.0.smithi123.stdout:4/397: write d3/d2c/d43/d34/f37 [754106,41456] 0 2024-02-20T08:05:29.749 INFO:tasks.workunit.client.0.smithi123.stdout:1/433: creat d3/db/d34/d74/f9b x:0 0 0 2024-02-20T08:05:29.750 INFO:tasks.workunit.client.0.smithi123.stdout:8/420: mkdir d6/d1c/d22/d8c 0 2024-02-20T08:05:29.755 INFO:tasks.workunit.client.0.smithi123.stdout:6/610: rename d0/f34 to d0/d5c/fca 0 2024-02-20T08:05:29.758 INFO:tasks.workunit.client.0.smithi123.stdout:8/421: mknod d6/d1c/d29/c8d 0 2024-02-20T08:05:29.758 INFO:tasks.workunit.client.0.smithi123.stdout:4/398: dwrite d3/d2c/d43/d26/d2e/f52 [0,4194304] 0 2024-02-20T08:05:29.760 INFO:tasks.workunit.client.0.smithi123.stdout:1/434: dwrite d3/db/d34/d74/f1a [4194304,4194304] 0 2024-02-20T08:05:29.765 INFO:tasks.workunit.client.0.smithi123.stdout:1/435: dread - d3/db/d7f/f97 zero size 2024-02-20T08:05:29.767 INFO:tasks.workunit.client.0.smithi123.stdout:0/457: getdents d2/dd/d4f 0 2024-02-20T08:05:29.771 INFO:tasks.workunit.client.0.smithi123.stdout:2/371: getdents d1a/d29/d39 0 2024-02-20T08:05:29.911 INFO:tasks.workunit.client.0.smithi123.stdout:6/611: dwrite d0/d3e/d40/f9b [0,4194304] 0 2024-02-20T08:05:29.915 INFO:tasks.workunit.client.0.smithi123.stdout:8/422: dwrite d6/d1c/d22/f6b [0,4194304] 0 2024-02-20T08:05:29.915 INFO:tasks.workunit.client.0.smithi123.stdout:4/399: dwrite d3/d2c/f40 [0,4194304] 0 2024-02-20T08:05:29.920 INFO:tasks.workunit.client.0.smithi123.stdout:1/436: dwrite d3/db/d34/d74/d6f/d63/f72 [0,4194304] 0 2024-02-20T08:05:29.925 INFO:tasks.workunit.client.0.smithi123.stdout:8/423: unlink d6/d1c/f81 0 2024-02-20T08:05:29.934 INFO:tasks.workunit.client.0.smithi123.stdout:6/612: symlink d0/d3e/d92/lcb 0 2024-02-20T08:05:29.934 INFO:tasks.workunit.client.0.smithi123.stdout:0/458: dread d2/de/d1e/d1f/f77 [0,4194304] 0 2024-02-20T08:05:29.935 INFO:tasks.workunit.client.0.smithi123.stdout:6/613: truncate d0/d3e/d92/d56/f64 601064 0 2024-02-20T08:05:29.939 INFO:tasks.workunit.client.0.smithi123.stdout:0/459: mknod d2/d3/d37/d5f/c94 0 2024-02-20T08:05:29.941 INFO:tasks.workunit.client.0.smithi123.stdout:1/437: link d3/de/f84 d3/d47/f9c 0 2024-02-20T08:05:29.944 INFO:tasks.workunit.client.0.smithi123.stdout:8/424: symlink d6/l8e 0 2024-02-20T08:05:29.945 INFO:tasks.workunit.client.0.smithi123.stdout:8/425: fsync d6/d1c/d29/d7d/f8a 0 2024-02-20T08:05:29.945 INFO:tasks.workunit.client.0.smithi123.stdout:6/614: dread d0/d3e/d40/d48/d5d/fc2 [0,4194304] 0 2024-02-20T08:05:29.947 INFO:tasks.workunit.client.0.smithi123.stdout:2/372: dread d1a/d29/d42/f49 [0,4194304] 0 2024-02-20T08:05:29.948 INFO:tasks.workunit.client.0.smithi123.stdout:1/438: mkdir d3/de/d14/d2c/d45/d9d 0 2024-02-20T08:05:29.949 INFO:tasks.workunit.client.0.smithi123.stdout:6/615: readlink d0/lb 0 2024-02-20T08:05:29.952 INFO:tasks.workunit.client.0.smithi123.stdout:8/426: mkdir d6/d1c/d22/d4f/d5b/d8f 0 2024-02-20T08:05:29.953 INFO:tasks.workunit.client.0.smithi123.stdout:0/460: unlink d2/dd/l4e 0 2024-02-20T08:05:29.956 INFO:tasks.workunit.client.0.smithi123.stdout:6/616: mknod d0/d3e/d40/d48/d5d/ccc 0 2024-02-20T08:05:29.960 INFO:tasks.workunit.client.0.smithi123.stdout:0/461: read d2/dd/d4f/d61/d68/f6b [87541,11957] 0 2024-02-20T08:05:29.960 INFO:tasks.workunit.client.0.smithi123.stdout:2/373: symlink d1a/l6e 0 2024-02-20T08:05:29.961 INFO:tasks.workunit.client.0.smithi123.stdout:2/374: chown c1 1 1 2024-02-20T08:05:29.961 INFO:tasks.workunit.client.0.smithi123.stdout:0/462: stat d2/de/d19/d28 0 2024-02-20T08:05:29.961 INFO:tasks.workunit.client.0.smithi123.stdout:2/375: chown d1a/d29/d39 114 1 2024-02-20T08:05:29.962 INFO:tasks.workunit.client.0.smithi123.stdout:1/439: creat d3/de/d14/d26/d2e/d54/f9e x:0 0 0 2024-02-20T08:05:29.963 INFO:tasks.workunit.client.0.smithi123.stdout:1/440: write d3/de/d14/d26/f81 [1153030,92880] 0 2024-02-20T08:05:29.965 INFO:tasks.workunit.client.0.smithi123.stdout:1/441: truncate d3/db/d34/f94 13602 0 2024-02-20T08:05:29.967 INFO:tasks.workunit.client.0.smithi123.stdout:4/400: dread d3/fd [4194304,4194304] 0 2024-02-20T08:05:29.969 INFO:tasks.workunit.client.0.smithi123.stdout:0/463: write d2/d3/ff [2778373,44449] 0 2024-02-20T08:05:29.973 INFO:tasks.workunit.client.0.smithi123.stdout:6/617: link d0/f87 d0/d3e/d40/d90/fcd 0 2024-02-20T08:05:29.975 INFO:tasks.workunit.client.0.smithi123.stdout:1/442: mkdir d3/de/d14/d26/d2e/d54/d9f 0 2024-02-20T08:05:29.975 INFO:tasks.workunit.client.0.smithi123.stdout:1/443: readlink d3/de/l79 0 2024-02-20T08:05:29.976 INFO:tasks.workunit.client.0.smithi123.stdout:1/444: write d3/de/d14/d26/d2e/f7b [331885,31075] 0 2024-02-20T08:05:29.978 INFO:tasks.workunit.client.0.smithi123.stdout:4/401: mkdir d3/d2c/d43/d26/d3e/d8a 0 2024-02-20T08:05:29.980 INFO:tasks.workunit.client.0.smithi123.stdout:0/464: rmdir d2/d3/d37 39 2024-02-20T08:05:29.982 INFO:tasks.workunit.client.0.smithi123.stdout:1/445: creat d3/d47/fa0 x:0 0 0 2024-02-20T08:05:29.983 INFO:tasks.workunit.client.0.smithi123.stdout:0/465: dread d2/d3/f24 [0,4194304] 0 2024-02-20T08:05:29.989 INFO:tasks.workunit.client.0.smithi123.stdout:6/618: dread d0/f17 [0,4194304] 0 2024-02-20T08:05:29.989 INFO:tasks.workunit.client.0.smithi123.stdout:1/446: mkdir d3/db/d34/d74/da1 0 2024-02-20T08:05:29.990 INFO:tasks.workunit.client.0.smithi123.stdout:1/447: read - d3/de/d14/d2c/d45/f4d zero size 2024-02-20T08:05:29.993 INFO:tasks.workunit.client.0.smithi123.stdout:2/376: link c6 d1a/c6f 0 2024-02-20T08:05:29.994 INFO:tasks.workunit.client.0.smithi123.stdout:6/619: rmdir d0/d3e/d92/d56 39 2024-02-20T08:05:29.994 INFO:tasks.workunit.client.0.smithi123.stdout:2/377: write d1a/d29/f35 [352633,38912] 0 2024-02-20T08:05:29.997 INFO:tasks.workunit.client.0.smithi123.stdout:0/466: dwrite d2/d3/d37/d5f/f92 [0,4194304] 0 2024-02-20T08:05:30.001 INFO:tasks.workunit.client.0.smithi123.stdout:6/620: creat d0/d3e/d92/db3/fce x:0 0 0 2024-02-20T08:05:30.002 INFO:tasks.workunit.client.0.smithi123.stdout:0/467: symlink d2/de/d1e/l95 0 2024-02-20T08:05:30.004 INFO:tasks.workunit.client.0.smithi123.stdout:2/378: symlink d1a/d29/l70 0 2024-02-20T08:05:30.006 INFO:tasks.workunit.client.0.smithi123.stdout:6/621: creat d0/d3e/d40/d90/d94/fcf x:0 0 0 2024-02-20T08:05:30.006 INFO:tasks.workunit.client.0.smithi123.stdout:6/622: write d0/d3e/fb6 [848331,119956] 0 2024-02-20T08:05:30.010 INFO:tasks.workunit.client.0.smithi123.stdout:2/379: creat d1a/d29/d5d/f71 x:0 0 0 2024-02-20T08:05:30.012 INFO:tasks.workunit.client.0.smithi123.stdout:6/623: symlink d0/d3e/d40/ld0 0 2024-02-20T08:05:30.024 INFO:tasks.workunit.client.0.smithi123.stdout:8/427: truncate d6/d1c/d22/d4f/d5b/f7f 1205656 0 2024-02-20T08:05:30.024 INFO:tasks.workunit.client.0.smithi123.stdout:8/428: fsync d6/d1c/d29/f38 0 2024-02-20T08:05:30.028 INFO:tasks.workunit.client.0.smithi123.stdout:8/429: mkdir d6/d90 0 2024-02-20T08:05:30.035 INFO:tasks.workunit.client.0.smithi123.stdout:4/402: write d3/d2c/d43/f75 [1273102,127912] 0 2024-02-20T08:05:30.038 INFO:tasks.workunit.client.0.smithi123.stdout:4/403: mkdir d3/d18/d7d/d8b 0 2024-02-20T08:05:30.039 INFO:tasks.workunit.client.0.smithi123.stdout:4/404: chown d3/d18/f31 1301165748 1 2024-02-20T08:05:30.040 INFO:tasks.workunit.client.0.smithi123.stdout:8/430: dread d6/f2f [0,4194304] 0 2024-02-20T08:05:30.041 INFO:tasks.workunit.client.0.smithi123.stdout:4/405: mknod d3/d2c/d5a/c8c 0 2024-02-20T08:05:30.041 INFO:tasks.workunit.client.0.smithi123.stdout:4/406: fsync d3/d2c/d5a/d7e/f82 0 2024-02-20T08:05:30.043 INFO:tasks.workunit.client.0.smithi123.stdout:8/431: symlink d6/l91 0 2024-02-20T08:05:30.048 INFO:tasks.workunit.client.0.smithi123.stdout:0/468: dwrite d2/de/d1e/d1f/f25 [0,4194304] 0 2024-02-20T08:05:30.048 INFO:tasks.workunit.client.0.smithi123.stdout:4/407: symlink d3/d2c/d43/d26/d3e/d8a/l8d 0 2024-02-20T08:05:30.049 INFO:tasks.workunit.client.0.smithi123.stdout:2/380: truncate d1a/f50 2607958 0 2024-02-20T08:05:30.050 INFO:tasks.workunit.client.0.smithi123.stdout:8/432: dread d6/f2f [0,4194304] 0 2024-02-20T08:05:30.050 INFO:tasks.workunit.client.0.smithi123.stdout:0/469: write d2/de/d19/f58 [1450757,130297] 0 2024-02-20T08:05:30.051 INFO:tasks.workunit.client.0.smithi123.stdout:6/624: write d0/d3e/d40/d48/daa/dab/fb2 [4053108,5312] 0 2024-02-20T08:05:30.055 INFO:tasks.workunit.client.0.smithi123.stdout:2/381: creat d1a/d29/d42/f72 x:0 0 0 2024-02-20T08:05:30.058 INFO:tasks.workunit.client.0.smithi123.stdout:6/625: symlink d0/d3e/d40/d90/ld1 0 2024-02-20T08:05:30.061 INFO:tasks.workunit.client.0.smithi123.stdout:8/433: symlink d6/l92 0 2024-02-20T08:05:30.062 INFO:tasks.workunit.client.0.smithi123.stdout:2/382: mkdir d1a/d29/d42/d73 0 2024-02-20T08:05:30.064 INFO:tasks.workunit.client.0.smithi123.stdout:8/434: dread d6/d1c/d2c/f75 [0,4194304] 0 2024-02-20T08:05:30.065 INFO:tasks.workunit.client.0.smithi123.stdout:6/626: write d0/f31 [7383833,96931] 0 2024-02-20T08:05:30.066 INFO:tasks.workunit.client.0.smithi123.stdout:4/408: creat d3/d2c/d43/d26/f8e x:0 0 0 2024-02-20T08:05:30.113 INFO:tasks.workunit.client.0.smithi123.stdout:3/380: sync 2024-02-20T08:05:30.113 INFO:tasks.workunit.client.0.smithi123.stdout:9/409: sync 2024-02-20T08:05:30.113 INFO:tasks.workunit.client.0.smithi123.stdout:5/301: sync 2024-02-20T08:05:30.114 INFO:tasks.workunit.client.0.smithi123.stdout:8/435: mkdir d6/d1c/d22/d4f/d5b/d93 0 2024-02-20T08:05:30.117 INFO:tasks.workunit.client.0.smithi123.stdout:9/410: write d6/f58 [3232965,46596] 0 2024-02-20T08:05:30.117 INFO:tasks.workunit.client.0.smithi123.stdout:3/381: stat d0/d6/d1a/d62/d82 0 2024-02-20T08:05:30.120 INFO:tasks.workunit.client.0.smithi123.stdout:0/470: getdents d2/de/d1e 0 2024-02-20T08:05:30.121 INFO:tasks.workunit.client.0.smithi123.stdout:8/436: rmdir d6/d1c/d47 39 2024-02-20T08:05:30.122 INFO:tasks.workunit.client.0.smithi123.stdout:6/627: dwrite d0/d9f/fc7 [0,4194304] 0 2024-02-20T08:05:30.131 INFO:tasks.workunit.client.0.smithi123.stdout:8/437: dwrite d6/d1c/d22/f48 [4194304,4194304] 0 2024-02-20T08:05:30.137 INFO:tasks.workunit.client.0.smithi123.stdout:3/382: mknod d0/d6/d34/c90 0 2024-02-20T08:05:30.142 INFO:tasks.workunit.client.0.smithi123.stdout:4/409: creat d3/d2c/d43/d26/f8f x:0 0 0 2024-02-20T08:05:30.143 INFO:tasks.workunit.client.0.smithi123.stdout:4/410: dread - d3/d1e/f5b zero size 2024-02-20T08:05:30.146 INFO:tasks.workunit.client.0.smithi123.stdout:5/302: dread d0/f19 [0,4194304] 0 2024-02-20T08:05:30.148 INFO:tasks.workunit.client.0.smithi123.stdout:2/383: link c0 d1a/d29/c74 0 2024-02-20T08:05:30.152 INFO:tasks.workunit.client.0.smithi123.stdout:0/471: creat d2/dd/d4f/d7c/d82/f96 x:0 0 0 2024-02-20T08:05:30.153 INFO:tasks.workunit.client.0.smithi123.stdout:0/472: write d2/de/d1e/d1f/f25 [4419185,16399] 0 2024-02-20T08:05:30.154 INFO:tasks.workunit.client.0.smithi123.stdout:8/438: dwrite d6/d1c/d22/d4f/f85 [0,4194304] 0 2024-02-20T08:05:30.154 INFO:tasks.workunit.client.0.smithi123.stdout:6/628: unlink d0/d3e/d92/d56/d89/d73/f80 0 2024-02-20T08:05:30.158 INFO:tasks.workunit.client.0.smithi123.stdout:0/473: write d2/f1b [3413744,127337] 0 2024-02-20T08:05:30.160 INFO:tasks.workunit.client.0.smithi123.stdout:0/474: readlink d2/dd/l1d 0 2024-02-20T08:05:30.161 INFO:tasks.workunit.client.0.smithi123.stdout:4/411: rename d3/d1e/f59 to d3/d18/d7d/f90 0 2024-02-20T08:05:30.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/303: fdatasync d0/d34/d48/d56/d25/f31 0 2024-02-20T08:05:30.165 INFO:tasks.workunit.client.0.smithi123.stdout:8/439: dwrite d6/f1b [4194304,4194304] 0 2024-02-20T08:05:30.167 INFO:tasks.workunit.client.0.smithi123.stdout:6/629: dwrite d0/d3e/d40/d48/daa/dab/fb2 [0,4194304] 0 2024-02-20T08:05:30.168 INFO:tasks.workunit.client.0.smithi123.stdout:8/440: write d6/d1c/d29/f5d [364561,80838] 0 2024-02-20T08:05:30.176 INFO:tasks.workunit.client.0.smithi123.stdout:9/411: creat d6/d19/d1a/d7c/f86 x:0 0 0 2024-02-20T08:05:30.177 INFO:tasks.workunit.client.0.smithi123.stdout:9/412: chown d6/d2a/c1d 13098020 1 2024-02-20T08:05:30.183 INFO:tasks.workunit.client.0.smithi123.stdout:2/384: rename ca to d1a/d29/d5d/c75 0 2024-02-20T08:05:30.185 INFO:tasks.workunit.client.0.smithi123.stdout:0/475: creat d2/d3/d37/d5f/f97 x:0 0 0 2024-02-20T08:05:30.186 INFO:tasks.workunit.client.0.smithi123.stdout:0/476: chown d2/dd/d4f/d61/d68/f6b 2134931 1 2024-02-20T08:05:30.187 INFO:tasks.workunit.client.0.smithi123.stdout:0/477: stat d2/f15 0 2024-02-20T08:05:30.189 INFO:tasks.workunit.client.0.smithi123.stdout:9/413: dread d6/d19/d1a/f5b [0,4194304] 0 2024-02-20T08:05:30.193 INFO:tasks.workunit.client.0.smithi123.stdout:3/383: truncate d0/d6/d1a/f15 4077287 0 2024-02-20T08:05:30.197 INFO:tasks.workunit.client.0.smithi123.stdout:0/478: creat d2/d54/d78/f98 x:0 0 0 2024-02-20T08:05:30.201 INFO:tasks.workunit.client.0.smithi123.stdout:6/630: symlink d0/ld2 0 2024-02-20T08:05:30.205 INFO:tasks.workunit.client.0.smithi123.stdout:3/384: fsync d0/d6/d1a/d1b/d1c/f4f 0 2024-02-20T08:05:30.205 INFO:tasks.workunit.client.0.smithi123.stdout:4/412: dread d3/d2c/d43/f50 [0,4194304] 0 2024-02-20T08:05:30.205 INFO:tasks.workunit.client.0.smithi123.stdout:0/479: dwrite d2/d3/d37/d5f/f97 [0,4194304] 0 2024-02-20T08:05:30.207 INFO:tasks.workunit.client.0.smithi123.stdout:3/385: truncate d0/d6/d1a/f2f 818657 0 2024-02-20T08:05:30.213 INFO:tasks.workunit.client.0.smithi123.stdout:5/304: creat d0/f6a x:0 0 0 2024-02-20T08:05:30.216 INFO:tasks.workunit.client.0.smithi123.stdout:3/386: dwrite d0/d6/d1a/d1b/d2a/f6f [0,4194304] 0 2024-02-20T08:05:30.217 INFO:tasks.workunit.client.0.smithi123.stdout:6/631: mknod d0/d3e/d92/db3/cd3 0 2024-02-20T08:05:30.222 INFO:tasks.workunit.client.0.smithi123.stdout:4/413: mknod d3/d18/d63/c91 0 2024-02-20T08:05:30.224 INFO:tasks.workunit.client.0.smithi123.stdout:0/480: dread d2/dd/d4f/d61/d68/f6c [0,4194304] 0 2024-02-20T08:05:30.229 INFO:tasks.workunit.client.0.smithi123.stdout:5/305: creat d0/d34/d48/d56/d4c/f6b x:0 0 0 2024-02-20T08:05:30.230 INFO:tasks.workunit.client.0.smithi123.stdout:5/306: truncate d0/f30 5040392 0 2024-02-20T08:05:30.234 INFO:tasks.workunit.client.0.smithi123.stdout:6/632: unlink d0/d38/f3b 0 2024-02-20T08:05:30.239 INFO:tasks.workunit.client.0.smithi123.stdout:4/414: chown d3/d2c/d43/d26/d3e/l4e 2 1 2024-02-20T08:05:30.241 INFO:tasks.workunit.client.0.smithi123.stdout:6/633: dwrite d0/d3e/d40/d7f/fac [0,4194304] 0 2024-02-20T08:05:30.242 INFO:tasks.workunit.client.0.smithi123.stdout:0/481: unlink d2/de/d1e/d1f/c53 0 2024-02-20T08:05:30.247 INFO:tasks.workunit.client.0.smithi123.stdout:4/415: dwrite d3/d2c/d5a/f6b [4194304,4194304] 0 2024-02-20T08:05:30.247 INFO:tasks.workunit.client.0.smithi123.stdout:2/385: rename d1a/c55 to d1a/c76 0 2024-02-20T08:05:30.267 INFO:tasks.workunit.client.0.smithi123.stdout:0/482: link d2/de/d1e/d1f/d5e/f7a d2/de/d1e/d84/f99 0 2024-02-20T08:05:30.269 INFO:tasks.workunit.client.0.smithi123.stdout:4/416: fdatasync d3/f1b 0 2024-02-20T08:05:30.270 INFO:tasks.workunit.client.0.smithi123.stdout:2/386: mknod d1a/d29/c77 0 2024-02-20T08:05:30.273 INFO:tasks.workunit.client.0.smithi123.stdout:3/387: write d0/d6/d1a/f3d [112565,78238] 0 2024-02-20T08:05:30.274 INFO:tasks.workunit.client.0.smithi123.stdout:3/388: write d0/d6/d1a/d1b/d2a/f6f [2964104,2500] 0 2024-02-20T08:05:30.274 INFO:tasks.workunit.client.0.smithi123.stdout:5/307: write d0/d34/d48/d56/d25/f29 [3351598,44120] 0 2024-02-20T08:05:30.277 INFO:tasks.workunit.client.0.smithi123.stdout:5/308: chown d0/d34/d48/d56/d4c/l49 9430 1 2024-02-20T08:05:30.278 INFO:tasks.workunit.client.0.smithi123.stdout:3/389: write d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8b [66633,10927] 0 2024-02-20T08:05:30.281 INFO:tasks.workunit.client.0.smithi123.stdout:2/387: dread d1a/f1e [4194304,4194304] 0 2024-02-20T08:05:30.283 INFO:tasks.workunit.client.0.smithi123.stdout:2/388: chown d1a/l62 6971866 1 2024-02-20T08:05:30.284 INFO:tasks.workunit.client.0.smithi123.stdout:4/417: dwrite d3/d18/f51 [0,4194304] 0 2024-02-20T08:05:30.287 INFO:tasks.workunit.client.0.smithi123.stdout:6/634: dwrite d0/f30 [8388608,4194304] 0 2024-02-20T08:05:30.288 INFO:tasks.workunit.client.0.smithi123.stdout:3/390: symlink d0/d6/d1a/d1b/d2a/d86/l91 0 2024-02-20T08:05:30.292 INFO:tasks.workunit.client.0.smithi123.stdout:3/391: chown d0/d6/d1a/d1b/d1c/d3b/f84 19 1 2024-02-20T08:05:30.294 INFO:tasks.workunit.client.0.smithi123.stdout:4/418: creat d3/d2c/d5a/f92 x:0 0 0 2024-02-20T08:05:30.295 INFO:tasks.workunit.client.0.smithi123.stdout:6/635: dwrite d0/f97 [0,4194304] 0 2024-02-20T08:05:30.296 INFO:tasks.workunit.client.0.smithi123.stdout:4/419: dread - d3/d2c/d43/f84 zero size 2024-02-20T08:05:30.297 INFO:tasks.workunit.client.0.smithi123.stdout:0/483: write d2/de/d1e/f46 [393727,127236] 0 2024-02-20T08:05:30.299 INFO:tasks.workunit.client.0.smithi123.stdout:5/309: dread d0/d13/f2c [0,4194304] 0 2024-02-20T08:05:30.301 INFO:tasks.workunit.client.0.smithi123.stdout:5/310: write d0/d34/d48/d56/d4c/f6b [91380,59578] 0 2024-02-20T08:05:30.303 INFO:tasks.workunit.client.0.smithi123.stdout:5/311: dread - d0/d34/d48/f64 zero size 2024-02-20T08:05:30.306 INFO:tasks.workunit.client.0.smithi123.stdout:3/392: creat d0/dd/d48/f92 x:0 0 0 2024-02-20T08:05:30.310 INFO:tasks.workunit.client.0.smithi123.stdout:7/369: sync 2024-02-20T08:05:30.311 INFO:tasks.workunit.client.0.smithi123.stdout:4/420: dread d3/d18/f32 [0,4194304] 0 2024-02-20T08:05:30.312 INFO:tasks.workunit.client.0.smithi123.stdout:2/389: dwrite d1a/f2f [4194304,4194304] 0 2024-02-20T08:05:30.314 INFO:tasks.workunit.client.0.smithi123.stdout:0/484: rmdir d2/dd/d4f 39 2024-02-20T08:05:30.314 INFO:tasks.workunit.client.0.smithi123.stdout:7/370: stat d0/db/d38/d47/d4a/d59/d5c/d79 0 2024-02-20T08:05:30.315 INFO:tasks.workunit.client.0.smithi123.stdout:7/371: write d0/d6/dd/d52/d26/d7b/f7e [16629,83519] 0 2024-02-20T08:05:30.316 INFO:tasks.workunit.client.0.smithi123.stdout:7/372: chown d0/c55 25 1 2024-02-20T08:05:30.322 INFO:tasks.workunit.client.0.smithi123.stdout:4/421: readlink d3/l1a 0 2024-02-20T08:05:30.324 INFO:tasks.workunit.client.0.smithi123.stdout:6/636: truncate d0/d3e/d40/d48/d79/f82 895621 0 2024-02-20T08:05:30.326 INFO:tasks.workunit.client.0.smithi123.stdout:2/390: rmdir d1a/d29 39 2024-02-20T08:05:30.328 INFO:tasks.workunit.client.0.smithi123.stdout:6/637: dread d0/d3e/d40/d48/daa/dab/fb2 [0,4194304] 0 2024-02-20T08:05:30.329 INFO:tasks.workunit.client.0.smithi123.stdout:0/485: truncate d2/dd/d4f/d7c/f8c 367844 0 2024-02-20T08:05:30.330 INFO:tasks.workunit.client.0.smithi123.stdout:0/486: chown d2/d3/l8d 855 1 2024-02-20T08:05:30.332 INFO:tasks.workunit.client.0.smithi123.stdout:7/373: creat d0/d6/dd/d15/d61/f82 x:0 0 0 2024-02-20T08:05:30.333 INFO:tasks.workunit.client.0.smithi123.stdout:0/487: write d2/f1b [4994050,56296] 0 2024-02-20T08:05:30.335 INFO:tasks.workunit.client.0.smithi123.stdout:7/374: write d0/db/d21/f67 [502929,72881] 0 2024-02-20T08:05:30.338 INFO:tasks.workunit.client.0.smithi123.stdout:6/638: dwrite d0/d3e/d40/d48/daa/dab/fc0 [0,4194304] 0 2024-02-20T08:05:30.342 INFO:tasks.workunit.client.0.smithi123.stdout:2/391: readlink d1a/l1b 0 2024-02-20T08:05:30.344 INFO:tasks.workunit.client.0.smithi123.stdout:4/422: dwrite d3/d18/f32 [0,4194304] 0 2024-02-20T08:05:30.345 INFO:tasks.workunit.client.0.smithi123.stdout:5/312: dread d0/d13/f1e [0,4194304] 0 2024-02-20T08:05:30.352 INFO:tasks.workunit.client.0.smithi123.stdout:7/375: mknod d0/db/d21/d42/d5f/d4b/c83 0 2024-02-20T08:05:30.354 INFO:tasks.workunit.client.0.smithi123.stdout:7/376: write d0/d6/dd/d52/d26/d7b/f7e [505223,64774] 0 2024-02-20T08:05:30.354 INFO:tasks.workunit.client.0.smithi123.stdout:6/639: creat d0/d3e/d92/d56/d57/fd4 x:0 0 0 2024-02-20T08:05:30.356 INFO:tasks.workunit.client.0.smithi123.stdout:3/393: write d0/d6/d1a/d1b/d1c/d61/f5f [2118347,118094] 0 2024-02-20T08:05:30.373 INFO:tasks.workunit.client.0.smithi123.stdout:3/394: dread d0/d6/d1a/d1b/d1c/d3b/f84 [4194304,4194304] 0 2024-02-20T08:05:30.377 INFO:tasks.workunit.client.0.smithi123.stdout:6/640: creat d0/d3e/d92/d56/d89/d73/fd5 x:0 0 0 2024-02-20T08:05:30.379 INFO:tasks.workunit.client.0.smithi123.stdout:5/313: symlink d0/d34/d48/d4b/d51/l6c 0 2024-02-20T08:05:30.384 INFO:tasks.workunit.client.0.smithi123.stdout:5/314: mknod d0/d34/d48/c6d 0 2024-02-20T08:05:30.387 INFO:tasks.workunit.client.0.smithi123.stdout:0/488: getdents d2/dd 0 2024-02-20T08:05:30.389 INFO:tasks.workunit.client.0.smithi123.stdout:7/377: rename d0/d6/d29/c80 to d0/d6/d7/c84 0 2024-02-20T08:05:30.391 INFO:tasks.workunit.client.0.smithi123.stdout:6/641: creat d0/d9f/dbc/fd6 x:0 0 0 2024-02-20T08:05:30.394 INFO:tasks.workunit.client.0.smithi123.stdout:3/395: creat d0/d6/d1a/d4b/f93 x:0 0 0 2024-02-20T08:05:30.395 INFO:tasks.workunit.client.0.smithi123.stdout:0/489: symlink d2/dd/d4f/l9a 0 2024-02-20T08:05:30.404 INFO:tasks.workunit.client.0.smithi123.stdout:5/315: dwrite d0/f16 [0,4194304] 0 2024-02-20T08:05:30.405 INFO:tasks.workunit.client.0.smithi123.stdout:7/378: mknod d0/db/d38/d47/d4a/c85 0 2024-02-20T08:05:30.408 INFO:tasks.workunit.client.0.smithi123.stdout:3/396: getdents d0/d6/d1a/d1b/d1c/d21/d64 0 2024-02-20T08:05:30.412 INFO:tasks.workunit.client.0.smithi123.stdout:6/642: rename d0/d9f/fc7 to d0/d3e/d40/fd7 0 2024-02-20T08:05:30.413 INFO:tasks.workunit.client.0.smithi123.stdout:6/643: write d0/f69 [3552692,81531] 0 2024-02-20T08:05:30.414 INFO:tasks.workunit.client.0.smithi123.stdout:5/316: dread d0/d34/d48/d56/d3e/f3f [0,4194304] 0 2024-02-20T08:05:30.416 INFO:tasks.workunit.client.0.smithi123.stdout:0/490: creat d2/d3/f9b x:0 0 0 2024-02-20T08:05:30.423 INFO:tasks.workunit.client.0.smithi123.stdout:5/317: rename d0/d34/d48/d56/d3e/f3f to d0/d34/d48/f6e 0 2024-02-20T08:05:30.424 INFO:tasks.workunit.client.0.smithi123.stdout:5/318: dread - d0/d34/d48/d56/d25/f5f zero size 2024-02-20T08:05:30.425 INFO:tasks.workunit.client.0.smithi123.stdout:0/491: unlink d2/dd/d4f/l9a 0 2024-02-20T08:05:30.430 INFO:tasks.workunit.client.0.smithi123.stdout:5/319: fdatasync d0/d34/d48/d56/d25/f2d 0 2024-02-20T08:05:30.430 INFO:tasks.workunit.client.0.smithi123.stdout:6/644: rmdir d0/d9f/dbc 39 2024-02-20T08:05:30.433 INFO:tasks.workunit.client.0.smithi123.stdout:0/492: rename d2/de/d1e/d1f/f29 to d2/dd/d4f/d6a/f9c 0 2024-02-20T08:05:30.433 INFO:tasks.workunit.client.0.smithi123.stdout:0/493: chown d2/dd/d4f/f91 15 1 2024-02-20T08:05:30.434 INFO:tasks.workunit.client.0.smithi123.stdout:0/494: write d2/de/d1e/d1f/f20 [534397,4847] 0 2024-02-20T08:05:30.437 INFO:tasks.workunit.client.0.smithi123.stdout:5/320: truncate d0/fc 5915405 0 2024-02-20T08:05:30.440 INFO:tasks.workunit.client.0.smithi123.stdout:6/645: creat d0/d3e/d92/d56/d89/d73/d75/fd8 x:0 0 0 2024-02-20T08:05:30.440 INFO:tasks.workunit.client.0.smithi123.stdout:0/495: dwrite d2/dd/d4f/d61/d68/f76 [0,4194304] 0 2024-02-20T08:05:30.441 INFO:tasks.workunit.client.0.smithi123.stdout:6/646: dread - d0/d3e/d92/d56/d57/fd4 zero size 2024-02-20T08:05:30.449 INFO:tasks.workunit.client.0.smithi123.stdout:5/321: chown d0/c20 453387 1 2024-02-20T08:05:30.451 INFO:tasks.workunit.client.0.smithi123.stdout:5/322: write d0/d13/d27/d4e/f52 [3828472,74119] 0 2024-02-20T08:05:30.454 INFO:tasks.workunit.client.0.smithi123.stdout:0/496: dread d2/dd/d4f/d61/d68/f6b [0,4194304] 0 2024-02-20T08:05:30.456 INFO:tasks.workunit.client.0.smithi123.stdout:0/497: chown d2/dd/d4f/d7c/c80 1 1 2024-02-20T08:05:30.460 INFO:tasks.workunit.client.0.smithi123.stdout:6/647: creat d0/d3e/d92/d56/d89/d73/d75/dc3/fd9 x:0 0 0 2024-02-20T08:05:30.463 INFO:tasks.workunit.client.0.smithi123.stdout:0/498: unlink d2/de/d19/f58 0 2024-02-20T08:05:30.465 INFO:tasks.workunit.client.0.smithi123.stdout:5/323: mknod d0/d13/d60/c6f 0 2024-02-20T08:05:30.467 INFO:tasks.workunit.client.0.smithi123.stdout:3/397: dwrite d0/d6/d1a/f12 [0,4194304] 0 2024-02-20T08:05:30.468 INFO:tasks.workunit.client.0.smithi123.stdout:6/648: dwrite d0/d3e/d40/d7f/fb9 [0,4194304] 0 2024-02-20T08:05:30.478 INFO:tasks.workunit.client.0.smithi123.stdout:0/499: chown d2/de/d1e/d1f/l64 18451355 1 2024-02-20T08:05:30.481 INFO:tasks.workunit.client.0.smithi123.stdout:5/324: unlink d0/d13/c38 0 2024-02-20T08:05:30.482 INFO:tasks.workunit.client.0.smithi123.stdout:3/398: symlink d0/d6/d1a/d1b/d1c/d21/d5e/l94 0 2024-02-20T08:05:30.485 INFO:tasks.workunit.client.0.smithi123.stdout:6/649: rmdir d0/d3e/d40/d48/daa/dab 39 2024-02-20T08:05:30.487 INFO:tasks.workunit.client.0.smithi123.stdout:0/500: mkdir d2/d3/d37/d9d 0 2024-02-20T08:05:30.488 INFO:tasks.workunit.client.0.smithi123.stdout:5/325: readlink d0/d13/d27/l28 0 2024-02-20T08:05:30.490 INFO:tasks.workunit.client.0.smithi123.stdout:5/326: truncate d0/d34/d48/d56/d3e/f41 587063 0 2024-02-20T08:05:30.491 INFO:tasks.workunit.client.0.smithi123.stdout:5/327: write d0/f6a [855785,42440] 0 2024-02-20T08:05:30.492 INFO:tasks.workunit.client.0.smithi123.stdout:3/399: mkdir d0/d6/d1a/d4b/d95 0 2024-02-20T08:05:30.492 INFO:tasks.workunit.client.0.smithi123.stdout:3/400: fsync d0/dd/d48/f7f 0 2024-02-20T08:05:30.494 INFO:tasks.workunit.client.0.smithi123.stdout:6/650: creat d0/d3e/d92/d56/d57/d91/fda x:0 0 0 2024-02-20T08:05:30.495 INFO:tasks.workunit.client.0.smithi123.stdout:0/501: symlink d2/d3/d37/d5f/l9e 0 2024-02-20T08:05:30.500 INFO:tasks.workunit.client.0.smithi123.stdout:3/401: creat d0/d6/d1a/d1b/d1c/d61/f96 x:0 0 0 2024-02-20T08:05:30.501 INFO:tasks.workunit.client.0.smithi123.stdout:1/448: sync 2024-02-20T08:05:30.507 INFO:tasks.workunit.client.0.smithi123.stdout:3/402: dwrite d0/d6/d1a/d1b/d1c/f25 [0,4194304] 0 2024-02-20T08:05:30.507 INFO:tasks.workunit.client.0.smithi123.stdout:3/403: fsync d0/d6/d1a/f12 0 2024-02-20T08:05:30.521 INFO:tasks.workunit.client.0.smithi123.stdout:3/404: rename d0/dd/d48/f7f to d0/d6/d1a/d4b/f97 0 2024-02-20T08:05:30.522 INFO:tasks.workunit.client.0.smithi123.stdout:3/405: chown d0/dd/d48/d6a/d74 4 1 2024-02-20T08:05:30.522 INFO:tasks.workunit.client.0.smithi123.stdout:3/406: stat d0/d6/d1a/d62 0 2024-02-20T08:05:30.526 INFO:tasks.workunit.client.0.smithi123.stdout:5/328: getdents d0/d13/d60 0 2024-02-20T08:05:30.528 INFO:tasks.workunit.client.0.smithi123.stdout:5/329: read d0/f30 [3475530,15789] 0 2024-02-20T08:05:30.529 INFO:tasks.workunit.client.0.smithi123.stdout:3/407: mknod d0/dd/d48/d6a/d74/c98 0 2024-02-20T08:05:30.530 INFO:tasks.workunit.client.0.smithi123.stdout:6/651: write d0/f17 [738075,108529] 0 2024-02-20T08:05:30.530 INFO:tasks.workunit.client.0.smithi123.stdout:0/502: getdents d2/d3/d37/d5f/d8a 0 2024-02-20T08:05:30.532 INFO:tasks.workunit.client.0.smithi123.stdout:0/503: fdatasync d2/dd/d4f/d61/f7d 0 2024-02-20T08:05:30.539 INFO:tasks.workunit.client.0.smithi123.stdout:1/449: dwrite d3/db/d41/f5e [0,4194304] 0 2024-02-20T08:05:30.545 INFO:tasks.workunit.client.0.smithi123.stdout:6/652: dwrite d0/d3e/d40/d48/daa/dab/fc0 [4194304,4194304] 0 2024-02-20T08:05:30.547 INFO:tasks.workunit.client.0.smithi123.stdout:6/653: chown d0/d3e/d92/d56/d57/f74 173768177 1 2024-02-20T08:05:30.549 INFO:tasks.workunit.client.0.smithi123.stdout:3/408: symlink d0/d6/d1a/d62/d82/l99 0 2024-02-20T08:05:30.556 INFO:tasks.workunit.client.0.smithi123.stdout:6/654: symlink d0/d3e/d40/d90/d94/ldb 0 2024-02-20T08:05:30.557 INFO:tasks.workunit.client.0.smithi123.stdout:3/409: rename d0/d6/d1a/d1e/f17 to d0/d6/d1a/d1b/d1c/d21/d8e/f9a 0 2024-02-20T08:05:30.559 INFO:tasks.workunit.client.0.smithi123.stdout:3/410: read d0/d6/d1a/d1b/d1c/d61/f5f [1172163,56980] 0 2024-02-20T08:05:30.560 INFO:tasks.workunit.client.0.smithi123.stdout:5/330: getdents d0/d34/d48/d4b 0 2024-02-20T08:05:30.563 INFO:tasks.workunit.client.0.smithi123.stdout:0/504: write d2/f42 [2222728,88412] 0 2024-02-20T08:05:30.564 INFO:tasks.workunit.client.0.smithi123.stdout:0/505: dread - d2/dd/d4f/d7c/d82/f96 zero size 2024-02-20T08:05:30.566 INFO:tasks.workunit.client.0.smithi123.stdout:1/450: rename d3/db/f19 to d3/db/fa2 0 2024-02-20T08:05:30.569 INFO:tasks.workunit.client.0.smithi123.stdout:3/411: write d0/d6/d1a/d1b/d1c/d21/f29 [475259,62243] 0 2024-02-20T08:05:30.571 INFO:tasks.workunit.client.0.smithi123.stdout:5/331: symlink d0/d34/d48/d56/d25/l70 0 2024-02-20T08:05:30.573 INFO:tasks.workunit.client.0.smithi123.stdout:5/332: truncate d0/d34/d48/d56/d3e/f41 871919 0 2024-02-20T08:05:30.573 INFO:tasks.workunit.client.0.smithi123.stdout:6/655: symlink d0/d3e/d40/d48/d5d/dbf/ldc 0 2024-02-20T08:05:30.575 INFO:tasks.workunit.client.0.smithi123.stdout:6/656: truncate d0/d3e/d92/d56/d57/f6b 703349 0 2024-02-20T08:05:30.578 INFO:tasks.workunit.client.0.smithi123.stdout:0/506: rmdir d2/d3 39 2024-02-20T08:05:30.589 INFO:tasks.workunit.client.0.smithi123.stdout:5/333: dread d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:30.589 INFO:tasks.workunit.client.0.smithi123.stdout:5/334: dread - d0/d34/d48/d56/d25/f31 zero size 2024-02-20T08:05:30.591 INFO:tasks.workunit.client.0.smithi123.stdout:0/507: mknod d2/de/d1e/c9f 0 2024-02-20T08:05:30.596 INFO:tasks.workunit.client.0.smithi123.stdout:3/412: truncate d0/d6/d1a/f12 226011 0 2024-02-20T08:05:30.599 INFO:tasks.workunit.client.0.smithi123.stdout:5/335: fsync d0/d34/d48/f61 0 2024-02-20T08:05:30.600 INFO:tasks.workunit.client.0.smithi123.stdout:5/336: stat d0/d34/d48/f6e 0 2024-02-20T08:05:30.601 INFO:tasks.workunit.client.0.smithi123.stdout:5/337: write d0/d34/d48/f61 [1223766,16702] 0 2024-02-20T08:05:30.603 INFO:tasks.workunit.client.0.smithi123.stdout:0/508: unlink d2/de/l72 0 2024-02-20T08:05:30.605 INFO:tasks.workunit.client.0.smithi123.stdout:3/413: mknod d0/d6/d1a/d1b/d2a/c9b 0 2024-02-20T08:05:30.605 INFO:tasks.workunit.client.0.smithi123.stdout:3/414: stat d0/f53 0 2024-02-20T08:05:30.606 INFO:tasks.workunit.client.0.smithi123.stdout:1/451: write d3/de/d14/d36/d59/f89 [898875,47749] 0 2024-02-20T08:05:30.610 INFO:tasks.workunit.client.0.smithi123.stdout:3/415: dread - d0/d6/d1a/d1b/d1c/f65 zero size 2024-02-20T08:05:30.611 INFO:tasks.workunit.client.0.smithi123.stdout:6/657: getdents d0/d3e/d40/d48/d79 0 2024-02-20T08:05:30.613 INFO:tasks.workunit.client.0.smithi123.stdout:9/414: sync 2024-02-20T08:05:30.613 INFO:tasks.workunit.client.0.smithi123.stdout:8/441: sync 2024-02-20T08:05:30.614 INFO:tasks.workunit.client.0.smithi123.stdout:3/416: dread d0/d6/d1a/d1b/d1c/d3b/f84 [4194304,4194304] 0 2024-02-20T08:05:30.614 INFO:tasks.workunit.client.0.smithi123.stdout:5/338: creat d0/d34/d67/f71 x:0 0 0 2024-02-20T08:05:30.615 INFO:tasks.workunit.client.0.smithi123.stdout:0/509: creat d2/d3/d37/d5f/d8a/fa0 x:0 0 0 2024-02-20T08:05:30.616 INFO:tasks.workunit.client.0.smithi123.stdout:8/442: read d6/d1c/d22/d4f/f56 [1003206,55945] 0 2024-02-20T08:05:30.623 INFO:tasks.workunit.client.0.smithi123.stdout:1/452: link d3/de/f8e d3/db/d7d/fa3 0 2024-02-20T08:05:30.627 INFO:tasks.workunit.client.0.smithi123.stdout:0/510: creat d2/d3/d37/d9d/fa1 x:0 0 0 2024-02-20T08:05:30.628 INFO:tasks.workunit.client.0.smithi123.stdout:0/511: chown d2/de/c16 10 1 2024-02-20T08:05:30.628 INFO:tasks.workunit.client.0.smithi123.stdout:0/512: readlink d2/d3/l34 0 2024-02-20T08:05:30.629 INFO:tasks.workunit.client.0.smithi123.stdout:0/513: fdatasync d2/dd/d4f/d7c/f8c 0 2024-02-20T08:05:30.629 INFO:tasks.workunit.client.0.smithi123.stdout:6/658: creat d0/d3e/d40/fdd x:0 0 0 2024-02-20T08:05:30.631 INFO:tasks.workunit.client.0.smithi123.stdout:3/417: dread d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:30.631 INFO:tasks.workunit.client.0.smithi123.stdout:9/415: link d6/d19/d1b/l4f d6/d19/d1b/d3d/l87 0 2024-02-20T08:05:30.636 INFO:tasks.workunit.client.0.smithi123.stdout:9/416: symlink d6/d19/d1a/d31/l88 0 2024-02-20T08:05:30.639 INFO:tasks.workunit.client.0.smithi123.stdout:3/418: mknod d0/d6/d1a/d1b/d1c/d21/d8e/c9c 0 2024-02-20T08:05:30.641 INFO:tasks.workunit.client.0.smithi123.stdout:1/453: creat d3/de/d14/d26/fa4 x:0 0 0 2024-02-20T08:05:30.643 INFO:tasks.workunit.client.0.smithi123.stdout:1/454: truncate d3/db/d7f/f97 429725 0 2024-02-20T08:05:30.643 INFO:tasks.workunit.client.0.smithi123.stdout:6/659: mknod d0/d3e/d92/d56/dae/cde 0 2024-02-20T08:05:30.643 INFO:tasks.workunit.client.0.smithi123.stdout:1/455: chown d3/de/f8d 14 1 2024-02-20T08:05:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:30 smithi194 ceph-mon[37804]: pgmap v34: 65 pgs: 65 active+clean; 918 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 25 MiB/s rd, 112 MiB/s wr, 280 op/s 2024-02-20T08:05:30.655 INFO:tasks.workunit.client.0.smithi123.stdout:9/417: dwrite d6/f14 [0,4194304] 0 2024-02-20T08:05:30.657 INFO:tasks.workunit.client.0.smithi123.stdout:9/418: read d6/d19/f4a [119868,46055] 0 2024-02-20T08:05:30.662 INFO:tasks.workunit.client.0.smithi123.stdout:3/419: rename d0/d6/d1a/d1b/d1c/d21/d5e to d0/d6/d1a/d1b/d9d 0 2024-02-20T08:05:30.667 INFO:tasks.workunit.client.0.smithi123.stdout:9/419: mknod d6/d19/d1a/d2b/d28/c89 0 2024-02-20T08:05:30.669 INFO:tasks.workunit.client.0.smithi123.stdout:1/456: rmdir d3/db/d7d/d8a 0 2024-02-20T08:05:30.675 INFO:tasks.workunit.client.0.smithi123.stdout:3/420: unlink d0/d6/d1a/d1b/d1c/d3b/d43/f89 0 2024-02-20T08:05:30.679 INFO:tasks.workunit.client.0.smithi123.stdout:1/457: mknod d3/db/d34/d74/d6f/d63/ca5 0 2024-02-20T08:05:30.684 INFO:tasks.workunit.client.0.smithi123.stdout:0/514: dwrite d2/de/d1e/d1f/d5e/f7a [0,4194304] 0 2024-02-20T08:05:30.698 INFO:tasks.workunit.client.0.smithi123.stdout:6/660: rename d0/d9f/dbc to d0/d3e/d40/d48/daa/ddf 0 2024-02-20T08:05:30.700 INFO:tasks.workunit.client.0.smithi123.stdout:0/515: symlink d2/la2 0 2024-02-20T08:05:30.701 INFO:tasks.workunit.client.0.smithi123.stdout:0/516: chown d2/f1b 48 1 2024-02-20T08:05:30.702 INFO:tasks.workunit.client.0.smithi123.stdout:3/421: link d0/d6/d1a/d1b/d2a/c7e d0/d6/d1a/d62/c9e 0 2024-02-20T08:05:30.703 INFO:tasks.workunit.client.0.smithi123.stdout:3/422: readlink d0/d6/d1a/d62/d82/l99 0 2024-02-20T08:05:30.704 INFO:tasks.workunit.client.0.smithi123.stdout:9/420: getdents d6/d19/d1a/d2b 0 2024-02-20T08:05:30.705 INFO:tasks.workunit.client.0.smithi123.stdout:6/661: dwrite d0/d3e/d92/d56/f71 [0,4194304] 0 2024-02-20T08:05:30.706 INFO:tasks.workunit.client.0.smithi123.stdout:6/662: write d0/f23 [3910839,30643] 0 2024-02-20T08:05:30.706 INFO:tasks.workunit.client.0.smithi123.stdout:0/517: creat d2/de/fa3 x:0 0 0 2024-02-20T08:05:30.707 INFO:tasks.workunit.client.0.smithi123.stdout:6/663: fsync d0/f33 0 2024-02-20T08:05:30.712 INFO:tasks.workunit.client.0.smithi123.stdout:0/518: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:30.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/421: rmdir d6/d19/d1a/d31 39 2024-02-20T08:05:30.717 INFO:tasks.workunit.client.0.smithi123.stdout:9/422: truncate d6/d2a/d27/f5a 212924 0 2024-02-20T08:05:30.723 INFO:tasks.workunit.client.0.smithi123.stdout:3/423: mkdir d0/d6/d1a/d4b/d95/d9f 0 2024-02-20T08:05:30.725 INFO:tasks.workunit.client.0.smithi123.stdout:0/519: rename d2/de/d19 to d2/dd/d4f/d7c/da4 0 2024-02-20T08:05:30.730 INFO:tasks.workunit.client.0.smithi123.stdout:3/424: mknod d0/d6/d1a/d1b/d9d/ca0 0 2024-02-20T08:05:30.730 INFO:tasks.workunit.client.0.smithi123.stdout:3/425: read - d0/d6/d1a/d1b/f6b zero size 2024-02-20T08:05:30.731 INFO:tasks.workunit.client.0.smithi123.stdout:3/426: chown d0/d6/d1a/d1b/d9d 1481 1 2024-02-20T08:05:30.731 INFO:tasks.workunit.client.0.smithi123.stdout:0/520: readlink d2/d54/l5b 0 2024-02-20T08:05:30.732 INFO:tasks.workunit.client.0.smithi123.stdout:0/521: fsync d2/de/d1e/d84/f99 0 2024-02-20T08:05:30.734 INFO:tasks.workunit.client.0.smithi123.stdout:3/427: fdatasync d0/d6/d1a/d1b/d1c/f4f 0 2024-02-20T08:05:30.736 INFO:tasks.workunit.client.0.smithi123.stdout:0/522: unlink d2/d3/l2d 0 2024-02-20T08:05:30.739 INFO:tasks.workunit.client.0.smithi123.stdout:0/523: rmdir d2/d3/d37 39 2024-02-20T08:05:30.740 INFO:tasks.workunit.client.0.smithi123.stdout:3/428: mkdir d0/d6/d1a/da1 0 2024-02-20T08:05:30.740 INFO:tasks.workunit.client.0.smithi123.stdout:0/524: truncate d2/dd/d4f/d6a/f90 574930 0 2024-02-20T08:05:30.741 INFO:tasks.workunit.client.0.smithi123.stdout:3/429: write d0/d6/d1a/f6c [504942,72032] 0 2024-02-20T08:05:30.743 INFO:tasks.workunit.client.0.smithi123.stdout:0/525: creat d2/d54/fa5 x:0 0 0 2024-02-20T08:05:30.749 INFO:tasks.workunit.client.0.smithi123.stdout:3/430: fdatasync d0/d6/d1a/d1b/d1c/d20/f40 0 2024-02-20T08:05:30.749 INFO:tasks.workunit.client.0.smithi123.stdout:3/431: chown d0/d6/d1a/d1b/d1c/d61/f5f 627939 1 2024-02-20T08:05:30.749 INFO:tasks.workunit.client.0.smithi123.stdout:3/432: mkdir d0/d6/d1a/d62/d82/da2 0 2024-02-20T08:05:30.749 INFO:tasks.workunit.client.0.smithi123.stdout:6/664: write d0/d3e/d92/d56/f5a [5068467,127814] 0 2024-02-20T08:05:30.754 INFO:tasks.workunit.client.0.smithi123.stdout:9/423: write d6/f30 [802272,81162] 0 2024-02-20T08:05:30.756 INFO:tasks.workunit.client.0.smithi123.stdout:3/433: dwrite d0/d6/d1a/d1b/f83 [0,4194304] 0 2024-02-20T08:05:30.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:30 smithi123 ceph-mon[29383]: pgmap v34: 65 pgs: 65 active+clean; 918 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 25 MiB/s rd, 112 MiB/s wr, 280 op/s 2024-02-20T08:05:30.758 INFO:tasks.workunit.client.0.smithi123.stdout:6/665: rename d0/d3e/d40/d48/d79/f82 to d0/d3e/d40/d48/d7b/fe0 0 2024-02-20T08:05:30.761 INFO:tasks.workunit.client.0.smithi123.stdout:6/666: dread - d0/d3e/d92/d56/d89/d73/d75/dc3/fd9 zero size 2024-02-20T08:05:30.761 INFO:tasks.workunit.client.0.smithi123.stdout:3/434: rmdir d0/dd/d48/d6a 39 2024-02-20T08:05:30.762 INFO:tasks.workunit.client.0.smithi123.stdout:6/667: chown d0/d3e/d92/d56/f71 0 1 2024-02-20T08:05:30.762 INFO:tasks.workunit.client.0.smithi123.stdout:0/526: truncate d2/de/d1e/d84/f99 1577626 0 2024-02-20T08:05:30.765 INFO:tasks.workunit.client.0.smithi123.stdout:3/435: truncate d0/dd/d48/d6a/f85 692446 0 2024-02-20T08:05:30.767 INFO:tasks.workunit.client.0.smithi123.stdout:6/668: rename d0/d3e/d40/d90/ld1 to d0/d3e/d40/d90/d94/dc9/le1 0 2024-02-20T08:05:30.767 INFO:tasks.workunit.client.0.smithi123.stdout:7/379: sync 2024-02-20T08:05:30.767 INFO:tasks.workunit.client.0.smithi123.stdout:4/423: sync 2024-02-20T08:05:30.767 INFO:tasks.workunit.client.0.smithi123.stdout:2/392: sync 2024-02-20T08:05:30.773 INFO:tasks.workunit.client.0.smithi123.stdout:6/669: truncate d0/d3e/d40/d48/d79/f8b 143693 0 2024-02-20T08:05:30.774 INFO:tasks.workunit.client.0.smithi123.stdout:7/380: dwrite d0/d6/f57 [0,4194304] 0 2024-02-20T08:05:30.778 INFO:tasks.workunit.client.0.smithi123.stdout:7/381: write d0/d6/d29/f6e [1671728,55785] 0 2024-02-20T08:05:30.780 INFO:tasks.workunit.client.0.smithi123.stdout:4/424: creat d3/d2c/d43/d34/f93 x:0 0 0 2024-02-20T08:05:30.782 INFO:tasks.workunit.client.0.smithi123.stdout:3/436: symlink d0/la3 0 2024-02-20T08:05:30.786 INFO:tasks.workunit.client.0.smithi123.stdout:2/393: dwrite d1a/d29/d39/f5f [4194304,4194304] 0 2024-02-20T08:05:30.788 INFO:tasks.workunit.client.0.smithi123.stdout:6/670: dwrite d0/d3e/d92/d56/d89/d73/fd5 [0,4194304] 0 2024-02-20T08:05:30.790 INFO:tasks.workunit.client.0.smithi123.stdout:3/437: write d0/d6/d1a/d1b/d9d/f6d [959872,3891] 0 2024-02-20T08:05:30.791 INFO:tasks.workunit.client.0.smithi123.stdout:3/438: chown d0/d6/f2e 0 1 2024-02-20T08:05:30.792 INFO:tasks.workunit.client.0.smithi123.stdout:0/527: getdents d2 0 2024-02-20T08:05:30.797 INFO:tasks.workunit.client.0.smithi123.stdout:4/425: symlink d3/d18/d6c/l94 0 2024-02-20T08:05:30.799 INFO:tasks.workunit.client.0.smithi123.stdout:3/439: dwrite d0/d6/d1a/d1b/d9d/f6d [0,4194304] 0 2024-02-20T08:05:30.803 INFO:tasks.workunit.client.0.smithi123.stdout:2/394: creat d1a/d29/d42/d4e/f78 x:0 0 0 2024-02-20T08:05:30.804 INFO:tasks.workunit.client.0.smithi123.stdout:2/395: fdatasync d1a/d29/f44 0 2024-02-20T08:05:30.805 INFO:tasks.workunit.client.0.smithi123.stdout:2/396: write d1a/d29/f2d [1754651,77065] 0 2024-02-20T08:05:30.807 INFO:tasks.workunit.client.0.smithi123.stdout:6/671: creat d0/d3e/d40/d90/fe2 x:0 0 0 2024-02-20T08:05:30.808 INFO:tasks.workunit.client.0.smithi123.stdout:0/528: dread - d2/d3/d37/d5f/d8a/fa0 zero size 2024-02-20T08:05:30.813 INFO:tasks.workunit.client.0.smithi123.stdout:0/529: dread d2/d3/d37/d5f/f92 [0,4194304] 0 2024-02-20T08:05:30.815 INFO:tasks.workunit.client.0.smithi123.stdout:2/397: chown d1a/l21 174575 1 2024-02-20T08:05:30.816 INFO:tasks.workunit.client.0.smithi123.stdout:6/672: mkdir d0/d3e/d40/d48/d5d/dbf/de3 0 2024-02-20T08:05:30.816 INFO:tasks.workunit.client.0.smithi123.stdout:7/382: link d0/l1a d0/db/d38/d47/d4a/d59/d5c/d79/l86 0 2024-02-20T08:05:30.818 INFO:tasks.workunit.client.0.smithi123.stdout:7/383: truncate d0/f30 4446892 0 2024-02-20T08:05:30.818 INFO:tasks.workunit.client.0.smithi123.stdout:3/440: symlink d0/d6/d1a/d1b/d57/la4 0 2024-02-20T08:05:30.820 INFO:tasks.workunit.client.0.smithi123.stdout:7/384: write d0/d6/f53 [63643,26061] 0 2024-02-20T08:05:30.820 INFO:tasks.workunit.client.0.smithi123.stdout:0/530: creat d2/dd/d4f/fa6 x:0 0 0 2024-02-20T08:05:30.822 INFO:tasks.workunit.client.0.smithi123.stdout:0/531: chown d2/d3/l8d 956236 1 2024-02-20T08:05:30.824 INFO:tasks.workunit.client.0.smithi123.stdout:6/673: dwrite d0/d3e/d40/d90/fa4 [0,4194304] 0 2024-02-20T08:05:30.827 INFO:tasks.workunit.client.0.smithi123.stdout:6/674: read - d0/d3e/d92/d56/d89/d73/d75/fd8 zero size 2024-02-20T08:05:30.827 INFO:tasks.workunit.client.0.smithi123.stdout:3/441: truncate d0/d6/d1a/d4b/f97 618878 0 2024-02-20T08:05:30.828 INFO:tasks.workunit.client.0.smithi123.stdout:2/398: dwrite d1a/d29/d42/f49 [0,4194304] 0 2024-02-20T08:05:30.830 INFO:tasks.workunit.client.0.smithi123.stdout:2/399: stat d1a/d29/d39 0 2024-02-20T08:05:30.831 INFO:tasks.workunit.client.0.smithi123.stdout:0/532: mkdir d2/dd/d4f/da7 0 2024-02-20T08:05:30.834 INFO:tasks.workunit.client.0.smithi123.stdout:3/442: dwrite d0/d6/f2e [0,4194304] 0 2024-02-20T08:05:30.841 INFO:tasks.workunit.client.0.smithi123.stdout:3/443: symlink d0/d6/d1a/d1b/d1c/d61/la5 0 2024-02-20T08:05:30.843 INFO:tasks.workunit.client.0.smithi123.stdout:2/400: dwrite d1a/f28 [0,4194304] 0 2024-02-20T08:05:30.843 INFO:tasks.workunit.client.0.smithi123.stdout:3/444: read d0/d6/d1a/f2f [35399,70681] 0 2024-02-20T08:05:30.844 INFO:tasks.workunit.client.0.smithi123.stdout:0/533: creat d2/de/d1e/d1f/d74/fa8 x:0 0 0 2024-02-20T08:05:30.846 INFO:tasks.workunit.client.0.smithi123.stdout:0/534: write d2/f42 [2825902,103352] 0 2024-02-20T08:05:30.847 INFO:tasks.workunit.client.0.smithi123.stdout:3/445: dread - d0/d6/d1a/d1b/d1c/f4f zero size 2024-02-20T08:05:30.855 INFO:tasks.workunit.client.0.smithi123.stdout:3/446: dread d0/d6/d1a/f12 [0,4194304] 0 2024-02-20T08:05:30.857 INFO:tasks.workunit.client.0.smithi123.stdout:0/535: link d2/dd/d4f/d61/c69 d2/dd/d4f/d7c/ca9 0 2024-02-20T08:05:30.858 INFO:tasks.workunit.client.0.smithi123.stdout:2/401: dread d1a/d29/f35 [0,4194304] 0 2024-02-20T08:05:30.858 INFO:tasks.workunit.client.0.smithi123.stdout:0/536: chown d2/l40 27313 1 2024-02-20T08:05:30.859 INFO:tasks.workunit.client.0.smithi123.stdout:3/447: truncate d0/d6/d1a/f15 8274 0 2024-02-20T08:05:30.861 INFO:tasks.workunit.client.0.smithi123.stdout:2/402: mknod d1a/d29/d42/d73/c79 0 2024-02-20T08:05:30.863 INFO:tasks.workunit.client.0.smithi123.stdout:0/537: mknod d2/d3/d37/d5f/d8a/caa 0 2024-02-20T08:05:30.865 INFO:tasks.workunit.client.0.smithi123.stdout:4/426: dread d3/d18/f1c [0,4194304] 0 2024-02-20T08:05:30.865 INFO:tasks.workunit.client.0.smithi123.stdout:3/448: rename d0/d6/d1a/d1b/d9d/l67 to d0/d6/d1a/d1b/d1c/d21/la6 0 2024-02-20T08:05:30.867 INFO:tasks.workunit.client.0.smithi123.stdout:0/538: mknod d2/dd/d4f/d7c/cab 0 2024-02-20T08:05:30.867 INFO:tasks.workunit.client.0.smithi123.stdout:3/449: dread - d0/d6/d1a/d1b/d1c/f4f zero size 2024-02-20T08:05:30.867 INFO:tasks.workunit.client.0.smithi123.stdout:0/539: chown d2/dd/l73 319113 1 2024-02-20T08:05:30.870 INFO:tasks.workunit.client.0.smithi123.stdout:2/403: rename d1a/d29/c3b to d1a/d29/d42/d52/c7a 0 2024-02-20T08:05:30.873 INFO:tasks.workunit.client.0.smithi123.stdout:0/540: dread d2/dd/d4f/d61/d68/f76 [0,4194304] 0 2024-02-20T08:05:30.874 INFO:tasks.workunit.client.0.smithi123.stdout:4/427: unlink d3/f8 0 2024-02-20T08:05:30.876 INFO:tasks.workunit.client.0.smithi123.stdout:7/385: dread d0/d6/dd/d52/f51 [4194304,4194304] 0 2024-02-20T08:05:30.878 INFO:tasks.workunit.client.0.smithi123.stdout:2/404: dwrite d1a/f32 [0,4194304] 0 2024-02-20T08:05:30.882 INFO:tasks.workunit.client.0.smithi123.stdout:0/541: dread d2/de/d1e/d1f/d5e/f7a [0,4194304] 0 2024-02-20T08:05:30.886 INFO:tasks.workunit.client.0.smithi123.stdout:2/405: creat d1a/d29/d39/f7b x:0 0 0 2024-02-20T08:05:30.886 INFO:tasks.workunit.client.0.smithi123.stdout:4/428: mkdir d3/d18/d7d/d8b/d95 0 2024-02-20T08:05:30.889 INFO:tasks.workunit.client.0.smithi123.stdout:2/406: write d1a/f2e [828259,21241] 0 2024-02-20T08:05:30.890 INFO:tasks.workunit.client.0.smithi123.stdout:4/429: mkdir d3/d18/d7d/d96 0 2024-02-20T08:05:30.890 INFO:tasks.workunit.client.0.smithi123.stdout:3/450: dread d0/f24 [4194304,4194304] 0 2024-02-20T08:05:30.890 INFO:tasks.workunit.client.0.smithi123.stdout:7/386: dwrite d0/db/d38/d47/f6d [0,4194304] 0 2024-02-20T08:05:30.893 INFO:tasks.workunit.client.0.smithi123.stdout:4/430: chown d3/d1e/c71 1190 1 2024-02-20T08:05:30.893 INFO:tasks.workunit.client.0.smithi123.stdout:0/542: dwrite d2/f1b [4194304,4194304] 0 2024-02-20T08:05:30.894 INFO:tasks.workunit.client.0.smithi123.stdout:2/407: fsync d1a/f1e 0 2024-02-20T08:05:30.896 INFO:tasks.workunit.client.0.smithi123.stdout:2/408: chown d1a/d29/d39/f3a 851261227 1 2024-02-20T08:05:30.896 INFO:tasks.workunit.client.0.smithi123.stdout:3/451: creat d0/d6/d1a/d1b/d1c/d21/fa7 x:0 0 0 2024-02-20T08:05:30.899 INFO:tasks.workunit.client.0.smithi123.stdout:7/387: readlink d0/db/d38/d47/d4a/d59/d5c/d79/l86 0 2024-02-20T08:05:30.900 INFO:tasks.workunit.client.0.smithi123.stdout:7/388: dread - d0/f7f zero size 2024-02-20T08:05:30.901 INFO:tasks.workunit.client.0.smithi123.stdout:0/543: mkdir d2/d54/dac 0 2024-02-20T08:05:30.902 INFO:tasks.workunit.client.0.smithi123.stdout:2/409: creat d1a/d29/d42/d52/f7c x:0 0 0 2024-02-20T08:05:30.902 INFO:tasks.workunit.client.0.smithi123.stdout:4/431: dwrite d3/d18/f51 [0,4194304] 0 2024-02-20T08:05:30.903 INFO:tasks.workunit.client.0.smithi123.stdout:7/389: symlink d0/d6/d7/d68/l87 0 2024-02-20T08:05:30.904 INFO:tasks.workunit.client.0.smithi123.stdout:3/452: mknod d0/d6/d1a/da1/ca8 0 2024-02-20T08:05:30.905 INFO:tasks.workunit.client.0.smithi123.stdout:0/544: fdatasync d2/de/f51 0 2024-02-20T08:05:30.906 INFO:tasks.workunit.client.0.smithi123.stdout:0/545: readlink d2/d3/d37/l52 0 2024-02-20T08:05:30.906 INFO:tasks.workunit.client.0.smithi123.stdout:2/410: creat d1a/d29/d42/d4e/f7d x:0 0 0 2024-02-20T08:05:30.907 INFO:tasks.workunit.client.0.smithi123.stdout:2/411: stat d1a/l6e 0 2024-02-20T08:05:30.907 INFO:tasks.workunit.client.0.smithi123.stdout:7/390: dread - d0/d6/d7/f63 zero size 2024-02-20T08:05:30.907 INFO:tasks.workunit.client.0.smithi123.stdout:0/546: chown d2/dd/l2a 369768211 1 2024-02-20T08:05:30.907 INFO:tasks.workunit.client.0.smithi123.stdout:2/412: stat d1a/d29/l38 0 2024-02-20T08:05:30.909 INFO:tasks.workunit.client.0.smithi123.stdout:3/453: symlink d0/d6/d1a/d4b/d95/d9f/la9 0 2024-02-20T08:05:30.910 INFO:tasks.workunit.client.0.smithi123.stdout:2/413: fsync d1a/f1d 0 2024-02-20T08:05:30.913 INFO:tasks.workunit.client.0.smithi123.stdout:3/454: mkdir d0/d6/d1a/d1e/d49/daa 0 2024-02-20T08:05:30.916 INFO:tasks.workunit.client.0.smithi123.stdout:7/391: link d0/f2f d0/d6/dd/d15/d61/f88 0 2024-02-20T08:05:30.917 INFO:tasks.workunit.client.0.smithi123.stdout:0/547: link d2/dd/d4f/d61/f6d d2/dd/d4f/fad 0 2024-02-20T08:05:30.918 INFO:tasks.workunit.client.0.smithi123.stdout:0/548: dread - d2/dd/d4f/d7c/d82/f96 zero size 2024-02-20T08:05:30.923 INFO:tasks.workunit.client.0.smithi123.stdout:3/455: creat d0/d6/d1a/d1e/d49/daa/fab x:0 0 0 2024-02-20T08:05:30.925 INFO:tasks.workunit.client.0.smithi123.stdout:0/549: truncate d2/dd/d4f/d61/d68/f6b 2345154 0 2024-02-20T08:05:30.925 INFO:tasks.workunit.client.0.smithi123.stdout:0/550: chown d2/d3/d37/d5f/f92 10 1 2024-02-20T08:05:30.927 INFO:tasks.workunit.client.0.smithi123.stdout:3/456: link d0/dd/l87 d0/dd/d48/d6a/lac 0 2024-02-20T08:05:30.928 INFO:tasks.workunit.client.0.smithi123.stdout:3/457: rmdir d0/dd 39 2024-02-20T08:05:30.931 INFO:tasks.workunit.client.0.smithi123.stdout:3/458: truncate d0/dd/d48/f92 357657 0 2024-02-20T08:05:30.931 INFO:tasks.workunit.client.0.smithi123.stdout:3/459: chown d0/d6/d34 296 1 2024-02-20T08:05:30.934 INFO:tasks.workunit.client.0.smithi123.stdout:3/460: dread d0/d6/d1a/d1e/d49/f56 [0,4194304] 0 2024-02-20T08:05:30.960 INFO:tasks.workunit.client.0.smithi123.stdout:4/432: write d3/d2c/d43/d34/f3b [2335538,4716] 0 2024-02-20T08:05:30.965 INFO:tasks.workunit.client.0.smithi123.stdout:0/551: getdents d2/dd/d4f 0 2024-02-20T08:05:30.966 INFO:tasks.workunit.client.0.smithi123.stdout:0/552: chown d2/f42 39367 1 2024-02-20T08:05:30.968 INFO:tasks.workunit.client.0.smithi123.stdout:0/553: write d2/dd/f2f [977218,71439] 0 2024-02-20T08:05:30.971 INFO:tasks.workunit.client.0.smithi123.stdout:0/554: read d2/de/d1e/f46 [225347,24049] 0 2024-02-20T08:05:30.974 INFO:tasks.workunit.client.0.smithi123.stdout:7/392: dwrite d0/d6/f31 [0,4194304] 0 2024-02-20T08:05:30.975 INFO:tasks.workunit.client.0.smithi123.stdout:0/555: fdatasync d2/dd/f31 0 2024-02-20T08:05:30.975 INFO:tasks.workunit.client.0.smithi123.stdout:2/414: dwrite d1a/f50 [0,4194304] 0 2024-02-20T08:05:30.976 INFO:tasks.workunit.client.0.smithi123.stdout:0/556: chown d2/d3/f9b 3310174 1 2024-02-20T08:05:30.977 INFO:tasks.workunit.client.0.smithi123.stdout:2/415: write d1a/f50 [361189,122647] 0 2024-02-20T08:05:30.986 INFO:tasks.workunit.client.0.smithi123.stdout:7/393: rename d0/d6/d29/f3a to d0/d6/d7/d68/f89 0 2024-02-20T08:05:30.987 INFO:tasks.workunit.client.0.smithi123.stdout:7/394: truncate d0/d6/dd/d15/d61/f82 83053 0 2024-02-20T08:05:30.994 INFO:tasks.workunit.client.0.smithi123.stdout:2/416: rename d1a/d29/d39/f7b to d1a/d29/d5d/f7e 0 2024-02-20T08:05:30.994 INFO:tasks.workunit.client.0.smithi123.stdout:2/417: fsync d1a/f26 0 2024-02-20T08:05:30.994 INFO:tasks.workunit.client.0.smithi123.stdout:2/418: readlink l12 0 2024-02-20T08:05:30.996 INFO:tasks.workunit.client.0.smithi123.stdout:4/433: mkdir d3/d97 0 2024-02-20T08:05:31.007 INFO:tasks.workunit.client.0.smithi123.stdout:2/419: dwrite d1a/f1f [0,4194304] 0 2024-02-20T08:05:31.008 INFO:tasks.workunit.client.0.smithi123.stdout:0/557: truncate d2/dd/f41 2376651 0 2024-02-20T08:05:31.011 INFO:tasks.workunit.client.0.smithi123.stdout:2/420: mkdir d1a/d7f 0 2024-02-20T08:05:31.014 INFO:tasks.workunit.client.0.smithi123.stdout:4/434: mkdir d3/d2c/d43/d98 0 2024-02-20T08:05:31.015 INFO:tasks.workunit.client.0.smithi123.stdout:2/421: mkdir d1a/d29/d42/d80 0 2024-02-20T08:05:31.018 INFO:tasks.workunit.client.0.smithi123.stdout:2/422: creat d1a/d29/d5d/f81 x:0 0 0 2024-02-20T08:05:31.019 INFO:tasks.workunit.client.0.smithi123.stdout:4/435: dread d3/d1e/f60 [0,4194304] 0 2024-02-20T08:05:31.034 INFO:tasks.workunit.client.0.smithi123.stdout:2/423: write d1a/d29/d39/f59 [3865226,113394] 0 2024-02-20T08:05:31.036 INFO:tasks.workunit.client.0.smithi123.stdout:2/424: read d1a/f2e [1063989,18929] 0 2024-02-20T08:05:31.040 INFO:tasks.workunit.client.0.smithi123.stdout:4/436: dwrite d3/d2c/d43/f44 [0,4194304] 0 2024-02-20T08:05:31.042 INFO:tasks.workunit.client.0.smithi123.stdout:2/425: dread d1a/f28 [0,4194304] 0 2024-02-20T08:05:31.047 INFO:tasks.workunit.client.0.smithi123.stdout:4/437: dwrite d3/d2c/d43/d34/f37 [0,4194304] 0 2024-02-20T08:05:31.052 INFO:tasks.workunit.client.0.smithi123.stdout:4/438: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:31.070 INFO:tasks.workunit.client.0.smithi123.stdout:2/426: dread d1a/f2e [0,4194304] 0 2024-02-20T08:05:31.073 INFO:tasks.workunit.client.0.smithi123.stdout:2/427: rename d1a/d29/d5d/f81 to d1a/d29/f82 0 2024-02-20T08:05:31.075 INFO:tasks.workunit.client.0.smithi123.stdout:2/428: symlink d1a/d29/d39/l83 0 2024-02-20T08:05:31.076 INFO:tasks.workunit.client.0.smithi123.stdout:2/429: write d1a/d29/d42/f4a [1881712,461] 0 2024-02-20T08:05:31.077 INFO:tasks.workunit.client.0.smithi123.stdout:2/430: mknod d1a/d29/d42/d73/c84 0 2024-02-20T08:05:31.078 INFO:tasks.workunit.client.0.smithi123.stdout:2/431: chown d1a/d29/d39/f65 5 1 2024-02-20T08:05:31.078 INFO:tasks.workunit.client.0.smithi123.stdout:2/432: write d1a/d29/d42/d4e/f7d [873755,63487] 0 2024-02-20T08:05:31.084 INFO:tasks.workunit.client.0.smithi123.stdout:2/433: dwrite d1a/d4f/f53 [0,4194304] 0 2024-02-20T08:05:31.084 INFO:tasks.workunit.client.0.smithi123.stdout:2/434: chown l13 8 1 2024-02-20T08:05:31.097 INFO:tasks.workunit.client.0.smithi123.stdout:2/435: truncate d1a/d29/d42/f4a 1532995 0 2024-02-20T08:05:31.100 INFO:tasks.workunit.client.0.smithi123.stdout:2/436: dread d1a/f41 [0,4194304] 0 2024-02-20T08:05:31.100 INFO:tasks.workunit.client.0.smithi123.stdout:2/437: chown d1a/f5c 355229570 1 2024-02-20T08:05:31.108 INFO:tasks.workunit.client.0.smithi123.stdout:2/438: write f10 [2482500,7812] 0 2024-02-20T08:05:31.111 INFO:tasks.workunit.client.0.smithi123.stdout:2/439: mknod d1a/d29/c85 0 2024-02-20T08:05:31.118 INFO:tasks.workunit.client.0.smithi123.stdout:2/440: truncate d1a/f50 324033 0 2024-02-20T08:05:31.122 INFO:tasks.workunit.client.0.smithi123.stdout:2/441: rename d1a/d29/c60 to d1a/d29/d42/d80/c86 0 2024-02-20T08:05:31.123 INFO:tasks.workunit.client.0.smithi123.stdout:2/442: fsync d1a/f28 0 2024-02-20T08:05:31.125 INFO:tasks.workunit.client.0.smithi123.stdout:2/443: stat d1a/d29/d42/l47 0 2024-02-20T08:05:31.125 INFO:tasks.workunit.client.0.smithi123.stdout:2/444: fdatasync d1a/d29/d42/d4e/f78 0 2024-02-20T08:05:31.130 INFO:tasks.workunit.client.0.smithi123.stdout:2/445: dwrite d1a/d29/d39/f3a [0,4194304] 0 2024-02-20T08:05:31.156 INFO:tasks.workunit.client.0.smithi123.stdout:2/446: dread d1a/f1d [0,4194304] 0 2024-02-20T08:05:31.159 INFO:tasks.workunit.client.0.smithi123.stdout:5/339: sync 2024-02-20T08:05:31.161 INFO:tasks.workunit.client.0.smithi123.stdout:5/340: creat d0/d34/d48/d4b/d51/f72 x:0 0 0 2024-02-20T08:05:31.162 INFO:tasks.workunit.client.0.smithi123.stdout:5/341: write d0/d13/f2c [2607433,5922] 0 2024-02-20T08:05:31.163 INFO:tasks.workunit.client.0.smithi123.stdout:2/447: mknod d1a/c87 0 2024-02-20T08:05:31.163 INFO:tasks.workunit.client.0.smithi123.stdout:5/342: dread - d0/d13/d27/f63 zero size 2024-02-20T08:05:31.165 INFO:tasks.workunit.client.0.smithi123.stdout:2/448: write d1a/d29/d42/d52/f56 [771691,77495] 0 2024-02-20T08:05:31.179 INFO:tasks.workunit.client.0.smithi123.stdout:5/343: dread d0/f11 [0,4194304] 0 2024-02-20T08:05:31.180 INFO:tasks.workunit.client.0.smithi123.stdout:5/344: dread - d0/d34/d48/d56/d25/f5f zero size 2024-02-20T08:05:31.192 INFO:tasks.workunit.client.0.smithi123.stdout:5/345: link d0/c54 d0/d34/d48/d56/c73 0 2024-02-20T08:05:31.194 INFO:tasks.workunit.client.0.smithi123.stdout:2/449: dwrite fc [4194304,4194304] 0 2024-02-20T08:05:31.195 INFO:tasks.workunit.client.0.smithi123.stdout:2/450: write d1a/d29/d42/f72 [286186,44405] 0 2024-02-20T08:05:31.196 INFO:tasks.workunit.client.0.smithi123.stdout:5/346: mknod d0/d13/d27/d37/c74 0 2024-02-20T08:05:31.198 INFO:tasks.workunit.client.0.smithi123.stdout:5/347: chown d0/d34/d48/d56/d4c/d43/c5a 19530 1 2024-02-20T08:05:31.201 INFO:tasks.workunit.client.0.smithi123.stdout:5/348: mknod d0/d34/d48/d56/d3e/c75 0 2024-02-20T08:05:31.205 INFO:tasks.workunit.client.0.smithi123.stdout:5/349: creat d0/d34/d48/d56/d25/f76 x:0 0 0 2024-02-20T08:05:31.207 INFO:tasks.workunit.client.0.smithi123.stdout:5/350: mknod d0/d34/c77 0 2024-02-20T08:05:31.208 INFO:tasks.workunit.client.0.smithi123.stdout:5/351: readlink d0/d13/d27/l4a 0 2024-02-20T08:05:31.209 INFO:tasks.workunit.client.0.smithi123.stdout:5/352: write d0/d34/d48/f53 [682501,42544] 0 2024-02-20T08:05:31.214 INFO:tasks.workunit.client.0.smithi123.stdout:5/353: dwrite d0/f15 [4194304,4194304] 0 2024-02-20T08:05:31.219 INFO:tasks.workunit.client.0.smithi123.stdout:5/354: mknod d0/d34/c78 0 2024-02-20T08:05:31.220 INFO:tasks.workunit.client.0.smithi123.stdout:5/355: write d0/d34/d48/d4b/f4f [1888535,3084] 0 2024-02-20T08:05:31.224 INFO:tasks.workunit.client.0.smithi123.stdout:5/356: symlink d0/d13/d60/l79 0 2024-02-20T08:05:31.225 INFO:tasks.workunit.client.0.smithi123.stdout:2/451: write d1a/f1d [3437695,25163] 0 2024-02-20T08:05:31.229 INFO:tasks.workunit.client.0.smithi123.stdout:2/452: dread d1a/f28 [0,4194304] 0 2024-02-20T08:05:31.236 INFO:tasks.workunit.client.0.smithi123.stdout:2/453: link d1a/d29/d5d/f7e d1a/d7f/f88 0 2024-02-20T08:05:31.237 INFO:tasks.workunit.client.0.smithi123.stdout:2/454: chown d1a/d29/d42/d52/f7c 3 1 2024-02-20T08:05:31.240 INFO:tasks.workunit.client.0.smithi123.stdout:2/455: creat d1a/d29/d39/f89 x:0 0 0 2024-02-20T08:05:31.241 INFO:tasks.workunit.client.0.smithi123.stdout:2/456: chown d1a/d29/d39/f3a 13794151 1 2024-02-20T08:05:31.255 INFO:tasks.workunit.client.0.smithi123.stdout:5/357: write d0/d34/d48/d56/d25/f2d [516714,47505] 0 2024-02-20T08:05:31.258 INFO:tasks.workunit.client.0.smithi123.stdout:5/358: creat d0/d34/d67/f7a x:0 0 0 2024-02-20T08:05:31.261 INFO:tasks.workunit.client.0.smithi123.stdout:5/359: creat d0/d34/d67/f7b x:0 0 0 2024-02-20T08:05:31.264 INFO:tasks.workunit.client.0.smithi123.stdout:5/360: creat d0/d13/d60/f7c x:0 0 0 2024-02-20T08:05:31.265 INFO:tasks.workunit.client.0.smithi123.stdout:5/361: fdatasync d0/d34/d48/d56/d25/f31 0 2024-02-20T08:05:31.266 INFO:tasks.workunit.client.0.smithi123.stdout:5/362: fdatasync d0/d34/d48/d4b/f4f 0 2024-02-20T08:05:31.276 INFO:tasks.workunit.client.0.smithi123.stdout:2/457: dwrite d1a/f27 [0,4194304] 0 2024-02-20T08:05:31.280 INFO:tasks.workunit.client.0.smithi123.stdout:2/458: rename d1a/d29/c58 to d1a/d29/d42/d4e/c8a 0 2024-02-20T08:05:31.290 INFO:tasks.workunit.client.0.smithi123.stdout:5/363: rmdir d0/d13 39 2024-02-20T08:05:31.299 INFO:tasks.workunit.client.0.smithi123.stdout:5/364: getdents d0 0 2024-02-20T08:05:31.300 INFO:tasks.workunit.client.0.smithi123.stdout:5/365: fsync d0/d34/d48/d56/d3e/f41 0 2024-02-20T08:05:31.306 INFO:tasks.workunit.client.0.smithi123.stdout:5/366: link d0/d34/d48/d4b/d51/f72 d0/d34/d48/d4b/f7d 0 2024-02-20T08:05:31.307 INFO:tasks.workunit.client.0.smithi123.stdout:5/367: truncate d0/d13/f1e 4763759 0 2024-02-20T08:05:31.317 INFO:tasks.workunit.client.0.smithi123.stdout:5/368: dwrite d0/d34/d48/d4b/d51/f72 [0,4194304] 0 2024-02-20T08:05:31.319 INFO:tasks.workunit.client.0.smithi123.stdout:2/459: dwrite d1a/d29/d42/f4a [0,4194304] 0 2024-02-20T08:05:31.326 INFO:tasks.workunit.client.0.smithi123.stdout:2/460: creat d1a/d29/d42/d73/f8b x:0 0 0 2024-02-20T08:05:31.334 INFO:tasks.workunit.client.0.smithi123.stdout:2/461: link d1a/f27 d1a/d29/d42/d4e/f8c 0 2024-02-20T08:05:31.335 INFO:tasks.workunit.client.0.smithi123.stdout:2/462: write d1a/d29/d42/f4a [1229699,80189] 0 2024-02-20T08:05:31.340 INFO:tasks.workunit.client.0.smithi123.stdout:2/463: mkdir d1a/d29/d5d/d8d 0 2024-02-20T08:05:31.340 INFO:tasks.workunit.client.0.smithi123.stdout:2/464: read d1a/f1f [1886219,21600] 0 2024-02-20T08:05:31.344 INFO:tasks.workunit.client.0.smithi123.stdout:2/465: creat d1a/d7f/f8e x:0 0 0 2024-02-20T08:05:31.345 INFO:tasks.workunit.client.0.smithi123.stdout:2/466: chown d1a/c57 257491593 1 2024-02-20T08:05:31.346 INFO:tasks.workunit.client.0.smithi123.stdout:2/467: write d1a/d29/d42/d4e/f7d [1100010,62229] 0 2024-02-20T08:05:31.346 INFO:tasks.workunit.client.0.smithi123.stdout:2/468: readlink d1a/d4f/l5a 0 2024-02-20T08:05:31.349 INFO:tasks.workunit.client.0.smithi123.stdout:2/469: mkdir d1a/d29/d42/d73/d8f 0 2024-02-20T08:05:31.349 INFO:tasks.workunit.client.0.smithi123.stdout:2/470: read d1a/f2f [5144485,53235] 0 2024-02-20T08:05:31.359 INFO:tasks.workunit.client.0.smithi123.stdout:2/471: dwrite f11 [4194304,4194304] 0 2024-02-20T08:05:31.366 INFO:tasks.workunit.client.0.smithi123.stdout:2/472: dwrite d1a/d29/d42/d52/f56 [0,4194304] 0 2024-02-20T08:05:31.370 INFO:tasks.workunit.client.0.smithi123.stdout:8/443: sync 2024-02-20T08:05:31.374 INFO:tasks.workunit.client.0.smithi123.stdout:2/473: chown d1a/d29/c74 976912 1 2024-02-20T08:05:31.376 INFO:tasks.workunit.client.0.smithi123.stdout:8/444: unlink d6/d1c/d29/l84 0 2024-02-20T08:05:31.377 INFO:tasks.workunit.client.0.smithi123.stdout:2/474: mknod d1a/d29/d42/d4e/c90 0 2024-02-20T08:05:31.379 INFO:tasks.workunit.client.0.smithi123.stdout:8/445: symlink d6/d1c/d29/d3f/l94 0 2024-02-20T08:05:31.380 INFO:tasks.workunit.client.0.smithi123.stdout:2/475: creat d1a/d7f/f91 x:0 0 0 2024-02-20T08:05:31.380 INFO:tasks.workunit.client.0.smithi123.stdout:2/476: readlink l13 0 2024-02-20T08:05:31.381 INFO:tasks.workunit.client.0.smithi123.stdout:2/477: dread - d1a/d29/d39/f6c zero size 2024-02-20T08:05:31.383 INFO:tasks.workunit.client.0.smithi123.stdout:2/478: unlink d1a/d29/d42/d73/c84 0 2024-02-20T08:05:31.384 INFO:tasks.workunit.client.0.smithi123.stdout:2/479: write d1a/d29/f44 [555804,115813] 0 2024-02-20T08:05:31.385 INFO:tasks.workunit.client.0.smithi123.stdout:2/480: chown d1a/d29/d5d/c75 1327820 1 2024-02-20T08:05:31.402 INFO:tasks.workunit.client.0.smithi123.stdout:8/446: rename d6/d1c/d29 to d6/d32/d95 0 2024-02-20T08:05:31.403 INFO:tasks.workunit.client.0.smithi123.stdout:2/481: rmdir d1a/d7f 39 2024-02-20T08:05:31.406 INFO:tasks.workunit.client.0.smithi123.stdout:2/482: dread d1a/d4f/f53 [0,4194304] 0 2024-02-20T08:05:31.407 INFO:tasks.workunit.client.0.smithi123.stdout:2/483: readlink d1a/d29/l38 0 2024-02-20T08:05:31.419 INFO:tasks.workunit.client.0.smithi123.stdout:2/484: dread f5 [4194304,4194304] 0 2024-02-20T08:05:31.420 INFO:tasks.workunit.client.0.smithi123.stdout:2/485: truncate d1a/d7f/f91 260077 0 2024-02-20T08:05:31.421 INFO:tasks.workunit.client.0.smithi123.stdout:2/486: rmdir d1a/d29 39 2024-02-20T08:05:31.427 INFO:tasks.workunit.client.0.smithi123.stdout:2/487: write d1a/d29/d42/d52/f56 [4340182,26751] 0 2024-02-20T08:05:31.429 INFO:tasks.workunit.client.0.smithi123.stdout:2/488: symlink d1a/d29/l92 0 2024-02-20T08:05:31.434 INFO:tasks.workunit.client.0.smithi123.stdout:2/489: link d1a/d29/d42/d52/c68 d1a/d29/d42/d4e/c93 0 2024-02-20T08:05:31.436 INFO:tasks.workunit.client.0.smithi123.stdout:2/490: unlink d1a/d29/l92 0 2024-02-20T08:05:31.437 INFO:tasks.workunit.client.0.smithi123.stdout:2/491: symlink d1a/l94 0 2024-02-20T08:05:31.438 INFO:tasks.workunit.client.0.smithi123.stdout:2/492: readlink l4 0 2024-02-20T08:05:31.438 INFO:tasks.workunit.client.0.smithi123.stdout:2/493: chown d1a/d29/f2d 1044 1 2024-02-20T08:05:31.439 INFO:tasks.workunit.client.0.smithi123.stdout:2/494: mknod d1a/d7f/c95 0 2024-02-20T08:05:31.440 INFO:tasks.workunit.client.0.smithi123.stdout:2/495: write d1a/d7f/f8e [82950,46712] 0 2024-02-20T08:05:31.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/496: mknod d1a/d29/d42/d73/c96 0 2024-02-20T08:05:31.452 INFO:tasks.workunit.client.0.smithi123.stdout:2/497: write d1a/d29/d5d/f7e [417241,62551] 0 2024-02-20T08:05:31.453 INFO:tasks.workunit.client.0.smithi123.stdout:2/498: fdatasync d1a/d29/d39/f89 0 2024-02-20T08:05:31.455 INFO:tasks.workunit.client.0.smithi123.stdout:2/499: mkdir d1a/d29/d5d/d97 0 2024-02-20T08:05:31.456 INFO:tasks.workunit.client.0.smithi123.stdout:2/500: mkdir d1a/d29/d42/d52/d98 0 2024-02-20T08:05:31.458 INFO:tasks.workunit.client.0.smithi123.stdout:2/501: symlink d1a/d4f/l99 0 2024-02-20T08:05:31.460 INFO:tasks.workunit.client.0.smithi123.stdout:2/502: creat d1a/f9a x:0 0 0 2024-02-20T08:05:31.461 INFO:tasks.workunit.client.0.smithi123.stdout:2/503: creat d1a/d29/d5d/f9b x:0 0 0 2024-02-20T08:05:31.463 INFO:tasks.workunit.client.0.smithi123.stdout:2/504: fdatasync d1a/f2f 0 2024-02-20T08:05:31.466 INFO:tasks.workunit.client.0.smithi123.stdout:2/505: truncate d1a/d29/d42/f45 1465907 0 2024-02-20T08:05:31.467 INFO:tasks.workunit.client.0.smithi123.stdout:2/506: read d1a/d29/d39/f5f [3814562,41080] 0 2024-02-20T08:05:31.470 INFO:tasks.workunit.client.0.smithi123.stdout:2/507: unlink c1 0 2024-02-20T08:05:31.476 INFO:tasks.workunit.client.0.smithi123.stdout:2/508: dwrite d1a/d4f/f53 [0,4194304] 0 2024-02-20T08:05:31.479 INFO:tasks.workunit.client.0.smithi123.stdout:2/509: symlink d1a/d4f/l9c 0 2024-02-20T08:05:31.486 INFO:tasks.workunit.client.0.smithi123.stdout:2/510: dwrite d1a/d7f/f91 [0,4194304] 0 2024-02-20T08:05:31.491 INFO:tasks.workunit.client.0.smithi123.stdout:2/511: link d1a/d29/f35 d1a/d29/d42/d52/d98/f9d 0 2024-02-20T08:05:31.494 INFO:tasks.workunit.client.0.smithi123.stdout:2/512: mknod d1a/d29/d42/d73/c9e 0 2024-02-20T08:05:31.497 INFO:tasks.workunit.client.0.smithi123.stdout:2/513: rename d1a/d29/f2d to d1a/d29/d5d/d8d/f9f 0 2024-02-20T08:05:31.503 INFO:tasks.workunit.client.0.smithi123.stdout:2/514: dwrite d1a/d29/d39/f89 [0,4194304] 0 2024-02-20T08:05:31.584 INFO:tasks.workunit.client.0.smithi123.stdout:2/515: mkdir d1a/d29/d42/d4e/da0 0 2024-02-20T08:05:31.584 INFO:tasks.workunit.client.0.smithi123.stdout:2/516: chown d1a/d29/d39/f89 257 1 2024-02-20T08:05:31.604 INFO:tasks.workunit.client.0.smithi123.stdout:1/458: sync 2024-02-20T08:05:31.604 INFO:tasks.workunit.client.0.smithi123.stdout:2/517: mkdir d1a/d29/d42/d52/d98/da1 0 2024-02-20T08:05:31.606 INFO:tasks.workunit.client.0.smithi123.stdout:2/518: creat d1a/d29/d42/d4e/da0/fa2 x:0 0 0 2024-02-20T08:05:31.613 INFO:tasks.workunit.client.0.smithi123.stdout:2/519: rename d1a/d29/d42/d4e/da0 to d1a/d29/d42/d80/da3 0 2024-02-20T08:05:31.617 INFO:tasks.workunit.client.0.smithi123.stdout:2/520: rmdir d1a/d29/d42/d80/da3 39 2024-02-20T08:05:31.618 INFO:tasks.workunit.client.0.smithi123.stdout:2/521: dread d1a/d29/d42/d52/d98/f9d [0,4194304] 0 2024-02-20T08:05:31.624 INFO:tasks.workunit.client.0.smithi123.stdout:2/522: dwrite d1a/d29/d39/f89 [0,4194304] 0 2024-02-20T08:05:31.625 INFO:tasks.workunit.client.0.smithi123.stdout:2/523: write d1a/f32 [3906727,79049] 0 2024-02-20T08:05:31.629 INFO:tasks.workunit.client.0.smithi123.stdout:2/524: creat d1a/d29/d42/d80/fa4 x:0 0 0 2024-02-20T08:05:31.632 INFO:tasks.workunit.client.0.smithi123.stdout:2/525: dread d1a/f28 [0,4194304] 0 2024-02-20T08:05:31.634 INFO:tasks.workunit.client.0.smithi123.stdout:2/526: write d1a/d29/d42/d52/f7c [434311,25554] 0 2024-02-20T08:05:31.636 INFO:tasks.workunit.client.0.smithi123.stdout:2/527: mkdir d1a/da5 0 2024-02-20T08:05:31.728 INFO:tasks.workunit.client.0.smithi123.stdout:9/424: sync 2024-02-20T08:05:31.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/425: mknod d6/d19/d1b/d3d/d32/c8a 0 2024-02-20T08:05:31.733 INFO:tasks.workunit.client.0.smithi123.stdout:9/426: mkdir d6/d2a/d27/d6f/d8b 0 2024-02-20T08:05:31.734 INFO:tasks.workunit.client.0.smithi123.stdout:9/427: readlink d6/d19/d1a/d2b/l69 0 2024-02-20T08:05:31.735 INFO:tasks.workunit.client.0.smithi123.stdout:9/428: symlink d6/d2a/l8c 0 2024-02-20T08:05:31.738 INFO:tasks.workunit.client.0.smithi123.stdout:9/429: creat d6/f8d x:0 0 0 2024-02-20T08:05:31.772 INFO:tasks.workunit.client.0.smithi123.stdout:9/430: dwrite d6/d19/f4a [0,4194304] 0 2024-02-20T08:05:31.774 INFO:tasks.workunit.client.0.smithi123.stdout:9/431: chown d6/d19/d1a/d7c/f86 277724 1 2024-02-20T08:05:31.777 INFO:tasks.workunit.client.0.smithi123.stdout:9/432: mknod d6/d19/d1b/d3d/c8e 0 2024-02-20T08:05:31.780 INFO:tasks.workunit.client.0.smithi123.stdout:9/433: truncate d6/fa 464756 0 2024-02-20T08:05:31.885 INFO:tasks.workunit.client.0.smithi123.stdout:6/675: sync 2024-02-20T08:05:31.887 INFO:tasks.workunit.client.0.smithi123.stdout:6/676: symlink d0/d3e/d40/d48/d5d/le4 0 2024-02-20T08:05:31.888 INFO:tasks.workunit.client.0.smithi123.stdout:6/677: truncate d0/d3e/d40/d7f/f8f 134390 0 2024-02-20T08:05:31.888 INFO:tasks.workunit.client.0.smithi123.stdout:6/678: read - d0/d3e/d40/d48/fbd zero size 2024-02-20T08:05:31.894 INFO:tasks.workunit.client.0.smithi123.stdout:6/679: dwrite d0/d3e/d92/d56/d57/f6b [0,4194304] 0 2024-02-20T08:05:31.901 INFO:tasks.workunit.client.0.smithi123.stdout:6/680: dwrite d0/d3e/d92/d56/d89/d73/fd5 [0,4194304] 0 2024-02-20T08:05:31.908 INFO:tasks.workunit.client.0.smithi123.stdout:6/681: dwrite d0/d3e/d40/d48/d4a/fad [0,4194304] 0 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:3/461: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:9/434: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:2/528: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:7/395: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:8/447: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:4/439: sync 2024-02-20T08:05:31.922 INFO:tasks.workunit.client.0.smithi123.stdout:0/558: sync 2024-02-20T08:05:31.923 INFO:tasks.workunit.client.0.smithi123.stdout:1/459: sync 2024-02-20T08:05:31.923 INFO:tasks.workunit.client.0.smithi123.stdout:5/369: sync 2024-02-20T08:05:31.925 INFO:tasks.workunit.client.0.smithi123.stdout:4/440: dread - d3/d2c/d43/f84 zero size 2024-02-20T08:05:31.926 INFO:tasks.workunit.client.0.smithi123.stdout:7/396: stat d0/db/d21/d42/d1d/f56 0 2024-02-20T08:05:31.930 INFO:tasks.workunit.client.0.smithi123.stdout:3/462: rmdir d0/d6/d1a/da1 39 2024-02-20T08:05:31.933 INFO:tasks.workunit.client.0.smithi123.stdout:0/559: dwrite d2/dd/f63 [0,4194304] 0 2024-02-20T08:05:31.933 INFO:tasks.workunit.client.0.smithi123.stdout:2/529: creat d1a/d29/d42/d73/fa6 x:0 0 0 2024-02-20T08:05:31.937 INFO:tasks.workunit.client.0.smithi123.stdout:6/682: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:31.940 INFO:tasks.workunit.client.0.smithi123.stdout:7/397: creat d0/d23/f8a x:0 0 0 2024-02-20T08:05:31.941 INFO:tasks.workunit.client.0.smithi123.stdout:5/370: dread d0/fc [0,4194304] 0 2024-02-20T08:05:31.946 INFO:tasks.workunit.client.0.smithi123.stdout:0/560: mkdir d2/dd/d4f/d7c/da4/dae 0 2024-02-20T08:05:31.948 INFO:tasks.workunit.client.0.smithi123.stdout:6/683: unlink d0/l20 0 2024-02-20T08:05:31.949 INFO:tasks.workunit.client.0.smithi123.stdout:9/435: dwrite d6/d19/d1a/f5b [0,4194304] 0 2024-02-20T08:05:31.952 INFO:tasks.workunit.client.0.smithi123.stdout:7/398: symlink d0/d6/dd/d52/d26/l8b 0 2024-02-20T08:05:31.952 INFO:tasks.workunit.client.0.smithi123.stdout:6/684: write d0/d3e/d92/d56/d89/d73/fd5 [4481052,85747] 0 2024-02-20T08:05:31.954 INFO:tasks.workunit.client.0.smithi123.stdout:7/399: chown d0/d6/dd/d52/d26/d7b 11297073 1 2024-02-20T08:05:31.955 INFO:tasks.workunit.client.0.smithi123.stdout:3/463: fdatasync d0/d6/d1a/d4b/f97 0 2024-02-20T08:05:31.956 INFO:tasks.workunit.client.0.smithi123.stdout:1/460: creat d3/de/d14/d26/fa6 x:0 0 0 2024-02-20T08:05:31.958 INFO:tasks.workunit.client.0.smithi123.stdout:8/448: link d6/d1c/l1d d6/d1c/d2c/l96 0 2024-02-20T08:05:31.958 INFO:tasks.workunit.client.0.smithi123.stdout:1/461: dread - d3/d47/fa0 zero size 2024-02-20T08:05:31.958 INFO:tasks.workunit.client.0.smithi123.stdout:9/436: dwrite f5 [0,4194304] 0 2024-02-20T08:05:31.959 INFO:tasks.workunit.client.0.smithi123.stdout:0/561: unlink d2/d54/d78/f98 0 2024-02-20T08:05:31.960 INFO:tasks.workunit.client.0.smithi123.stdout:0/562: dread - d2/d3/f9b zero size 2024-02-20T08:05:31.961 INFO:tasks.workunit.client.0.smithi123.stdout:0/563: write d2/f8 [8672368,94781] 0 2024-02-20T08:05:31.961 INFO:tasks.workunit.client.0.smithi123.stdout:4/441: creat d3/f99 x:0 0 0 2024-02-20T08:05:31.972 INFO:tasks.workunit.client.0.smithi123.stdout:7/400: unlink d0/d6/d7/f63 0 2024-02-20T08:05:31.973 INFO:tasks.workunit.client.0.smithi123.stdout:7/401: write d0/db/d21/f6b [242989,44444] 0 2024-02-20T08:05:31.974 INFO:tasks.workunit.client.0.smithi123.stdout:3/464: creat d0/d6/d34/fad x:0 0 0 2024-02-20T08:05:31.974 INFO:tasks.workunit.client.0.smithi123.stdout:7/402: stat d0/db/d38/d47/d4a/c85 0 2024-02-20T08:05:31.976 INFO:tasks.workunit.client.0.smithi123.stdout:8/449: symlink d6/d1c/d2c/l97 0 2024-02-20T08:05:31.976 INFO:tasks.workunit.client.0.smithi123.stdout:7/403: dread - d0/db/d38/d47/d4a/d5d/f72 zero size 2024-02-20T08:05:31.977 INFO:tasks.workunit.client.0.smithi123.stdout:1/462: creat d3/de/d14/d26/d2e/d54/fa7 x:0 0 0 2024-02-20T08:05:31.978 INFO:tasks.workunit.client.0.smithi123.stdout:8/450: chown d6/d32/d95/l41 67389 1 2024-02-20T08:05:31.979 INFO:tasks.workunit.client.0.smithi123.stdout:0/564: mkdir d2/dd/d4f/d7c/da4/d28/daf 0 2024-02-20T08:05:31.980 INFO:tasks.workunit.client.0.smithi123.stdout:5/371: creat d0/d13/d27/f7e x:0 0 0 2024-02-20T08:05:31.981 INFO:tasks.workunit.client.0.smithi123.stdout:6/685: mknod d0/d3e/d40/d48/ce5 0 2024-02-20T08:05:31.982 INFO:tasks.workunit.client.0.smithi123.stdout:2/530: getdents d1a/d7f 0 2024-02-20T08:05:31.985 INFO:tasks.workunit.client.0.smithi123.stdout:7/404: unlink d0/d6/d7/d68/f89 0 2024-02-20T08:05:31.987 INFO:tasks.workunit.client.0.smithi123.stdout:4/442: unlink d3/d2c/d43/d34/l3d 0 2024-02-20T08:05:31.993 INFO:tasks.workunit.client.0.smithi123.stdout:8/451: dwrite d6/d1c/d2c/f75 [0,4194304] 0 2024-02-20T08:05:31.994 INFO:tasks.workunit.client.0.smithi123.stdout:5/372: creat d0/d13/d27/d4e/f7f x:0 0 0 2024-02-20T08:05:31.994 INFO:tasks.workunit.client.0.smithi123.stdout:0/565: dread d2/f42 [0,4194304] 0 2024-02-20T08:05:31.998 INFO:tasks.workunit.client.0.smithi123.stdout:2/531: creat d1a/d29/d5d/d8d/fa7 x:0 0 0 2024-02-20T08:05:32.000 INFO:tasks.workunit.client.0.smithi123.stdout:2/532: dread - d1a/d29/d39/f6c zero size 2024-02-20T08:05:32.002 INFO:tasks.workunit.client.0.smithi123.stdout:8/452: dwrite d6/d1c/d2c/f75 [0,4194304] 0 2024-02-20T08:05:32.005 INFO:tasks.workunit.client.0.smithi123.stdout:4/443: dread - d3/d1e/f5b zero size 2024-02-20T08:05:32.007 INFO:tasks.workunit.client.0.smithi123.stdout:1/463: rename d3/de/f8e to d3/de/d14/d36/fa8 0 2024-02-20T08:05:32.009 INFO:tasks.workunit.client.0.smithi123.stdout:2/533: dwrite d1a/d29/f44 [0,4194304] 0 2024-02-20T08:05:32.011 INFO:tasks.workunit.client.0.smithi123.stdout:5/373: mkdir d0/d34/d67/d80 0 2024-02-20T08:05:32.015 INFO:tasks.workunit.client.0.smithi123.stdout:6/686: truncate d0/d38/f4f 166086 0 2024-02-20T08:05:32.015 INFO:tasks.workunit.client.0.smithi123.stdout:3/465: write d0/d6/d1a/f2f [140948,47891] 0 2024-02-20T08:05:32.016 INFO:tasks.workunit.client.0.smithi123.stdout:0/566: truncate d2/dd/d4f/d61/d68/f76 4249371 0 2024-02-20T08:05:32.018 INFO:tasks.workunit.client.0.smithi123.stdout:7/405: mknod d0/db/d21/c8c 0 2024-02-20T08:05:32.020 INFO:tasks.workunit.client.0.smithi123.stdout:2/534: creat d1a/d29/d42/d4e/fa8 x:0 0 0 2024-02-20T08:05:32.022 INFO:tasks.workunit.client.0.smithi123.stdout:3/466: symlink d0/d6/d1a/d1b/d1c/d3b/d43/lae 0 2024-02-20T08:05:32.022 INFO:tasks.workunit.client.0.smithi123.stdout:6/687: mknod d0/d3e/d92/d56/d89/d73/d75/dc3/ce6 0 2024-02-20T08:05:32.025 INFO:tasks.workunit.client.0.smithi123.stdout:7/406: rmdir d0/d6/dd/d52/d26/d7b 39 2024-02-20T08:05:32.028 INFO:tasks.workunit.client.0.smithi123.stdout:3/467: dread d0/d6/d1a/d1b/d1c/f3c [0,4194304] 0 2024-02-20T08:05:32.029 INFO:tasks.workunit.client.0.smithi123.stdout:0/567: link d2/dd/d4f/d6a/f90 d2/de/d1e/fb0 0 2024-02-20T08:05:32.031 INFO:tasks.workunit.client.0.smithi123.stdout:4/444: creat d3/d18/d7d/d87/f9a x:0 0 0 2024-02-20T08:05:32.034 INFO:tasks.workunit.client.0.smithi123.stdout:7/407: chown d0/d6/dd/d52/d26/l78 6 1 2024-02-20T08:05:32.036 INFO:tasks.workunit.client.0.smithi123.stdout:5/374: rename d0/f15 to d0/d13/f81 0 2024-02-20T08:05:32.038 INFO:tasks.workunit.client.0.smithi123.stdout:0/568: mkdir d2/d3/d37/d5f/d8a/db1 0 2024-02-20T08:05:32.039 INFO:tasks.workunit.client.0.smithi123.stdout:2/535: dread f17 [0,4194304] 0 2024-02-20T08:05:32.040 INFO:tasks.workunit.client.0.smithi123.stdout:2/536: chown d1a/d29/d42/d4e/f7d 32141 1 2024-02-20T08:05:32.040 INFO:tasks.workunit.client.0.smithi123.stdout:4/445: rmdir d3/d18/d7d 39 2024-02-20T08:05:32.044 INFO:tasks.workunit.client.0.smithi123.stdout:6/688: rename d0/f87 to d0/d3e/d40/d90/fe7 0 2024-02-20T08:05:32.046 INFO:tasks.workunit.client.0.smithi123.stdout:0/569: mknod d2/d3/d37/d5f/d8a/cb2 0 2024-02-20T08:05:32.046 INFO:tasks.workunit.client.0.smithi123.stdout:6/689: chown d0/d3e/d92/d56/d89/d73/d75/dc3 4469402 1 2024-02-20T08:05:32.047 INFO:tasks.workunit.client.0.smithi123.stdout:5/375: dread d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:32.049 INFO:tasks.workunit.client.0.smithi123.stdout:5/376: fdatasync d0/d34/d48/d56/d25/f3b 0 2024-02-20T08:05:32.055 INFO:tasks.workunit.client.0.smithi123.stdout:5/377: symlink d0/d34/d48/d56/d3e/l82 0 2024-02-20T08:05:32.057 INFO:tasks.workunit.client.0.smithi123.stdout:3/468: rename d0/dd/d48/d6a/lac to d0/d6/d1a/d1b/d2a/laf 0 2024-02-20T08:05:32.058 INFO:tasks.workunit.client.0.smithi123.stdout:4/446: rename d3/d2c/d43 to d3/d2c/d43/d26/d3e/d9b 22 2024-02-20T08:05:32.058 INFO:tasks.workunit.client.0.smithi123.stdout:2/537: dread f5 [0,4194304] 0 2024-02-20T08:05:32.059 INFO:tasks.workunit.client.0.smithi123.stdout:3/469: chown d0/d6/d1a/f3d 0 1 2024-02-20T08:05:32.059 INFO:tasks.workunit.client.0.smithi123.stdout:2/538: fsync f10 0 2024-02-20T08:05:32.061 INFO:tasks.workunit.client.0.smithi123.stdout:0/570: symlink d2/d3/lb3 0 2024-02-20T08:05:32.062 INFO:tasks.workunit.client.0.smithi123.stdout:0/571: chown d2/d3/d37/d9d/fa1 2186 1 2024-02-20T08:05:32.063 INFO:tasks.workunit.client.0.smithi123.stdout:5/378: unlink d0/d34/d67/f7a 0 2024-02-20T08:05:32.064 INFO:tasks.workunit.client.0.smithi123.stdout:5/379: write d0/d34/d48/f53 [1639358,103449] 0 2024-02-20T08:05:32.065 INFO:tasks.workunit.client.0.smithi123.stdout:1/464: dwrite d3/f42 [0,4194304] 0 2024-02-20T08:05:32.093 INFO:tasks.workunit.client.0.smithi123.stdout:0/572: rmdir d2 39 2024-02-20T08:05:32.093 INFO:tasks.workunit.client.0.smithi123.stdout:4/447: mknod d3/d2c/d43/c9c 0 2024-02-20T08:05:32.095 INFO:tasks.workunit.client.0.smithi123.stdout:4/448: chown d3/d18/d63/d88 49018 1 2024-02-20T08:05:32.096 INFO:tasks.workunit.client.0.smithi123.stdout:1/465: fdatasync d3/db/d34/d74/f1a 0 2024-02-20T08:05:32.096 INFO:tasks.workunit.client.0.smithi123.stdout:5/380: truncate d0/d34/d48/d56/d25/f31 451124 0 2024-02-20T08:05:32.099 INFO:tasks.workunit.client.0.smithi123.stdout:5/381: dread - d0/d13/d27/f63 zero size 2024-02-20T08:05:32.099 INFO:tasks.workunit.client.0.smithi123.stdout:4/449: write d3/d2c/d43/d34/f93 [531646,117287] 0 2024-02-20T08:05:32.101 INFO:tasks.workunit.client.0.smithi123.stdout:1/466: mknod d3/ca9 0 2024-02-20T08:05:32.102 INFO:tasks.workunit.client.0.smithi123.stdout:6/690: dread d0/d3e/d92/d56/d89/d73/d75/fb5 [0,4194304] 0 2024-02-20T08:05:32.105 INFO:tasks.workunit.client.0.smithi123.stdout:1/467: read d3/de/f60 [237301,99089] 0 2024-02-20T08:05:32.105 INFO:tasks.workunit.client.0.smithi123.stdout:5/382: write d0/d34/d48/f61 [3975812,58703] 0 2024-02-20T08:05:32.106 INFO:tasks.workunit.client.0.smithi123.stdout:0/573: link d2/de/f60 d2/dd/d4f/d6a/fb4 0 2024-02-20T08:05:32.108 INFO:tasks.workunit.client.0.smithi123.stdout:6/691: dread - d0/d3e/d40/d48/d7b/fa9 zero size 2024-02-20T08:05:32.109 INFO:tasks.workunit.client.0.smithi123.stdout:2/539: dwrite d1a/d29/d42/d52/d98/f9d [0,4194304] 0 2024-02-20T08:05:32.109 INFO:tasks.workunit.client.0.smithi123.stdout:3/470: dwrite d0/d6/d1a/d1b/d1c/d20/f31 [0,4194304] 0 2024-02-20T08:05:32.111 INFO:tasks.workunit.client.0.smithi123.stdout:6/692: chown d0/d3e/d92/d56 1720 1 2024-02-20T08:05:32.113 INFO:tasks.workunit.client.0.smithi123.stdout:3/471: dread - d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8f zero size 2024-02-20T08:05:32.114 INFO:tasks.workunit.client.0.smithi123.stdout:3/472: readlink d0/dd/d48/l59 0 2024-02-20T08:05:32.116 INFO:tasks.workunit.client.0.smithi123.stdout:1/468: fdatasync d3/de/d14/d36/f3d 0 2024-02-20T08:05:32.116 INFO:tasks.workunit.client.0.smithi123.stdout:6/693: chown d0/d3e/d92/d56/d89/d73/d75 264860381 1 2024-02-20T08:05:32.119 INFO:tasks.workunit.client.0.smithi123.stdout:0/574: truncate d2/f1c 4020576 0 2024-02-20T08:05:32.121 INFO:tasks.workunit.client.0.smithi123.stdout:4/450: dread d3/d2c/f5d [0,4194304] 0 2024-02-20T08:05:32.121 INFO:tasks.workunit.client.0.smithi123.stdout:0/575: write d2/de/d1e/d1f/d5e/f89 [957240,13633] 0 2024-02-20T08:05:32.127 INFO:tasks.workunit.client.0.smithi123.stdout:1/469: fsync d3/de/f5a 0 2024-02-20T08:05:32.127 INFO:tasks.workunit.client.0.smithi123.stdout:5/383: write d0/f11 [516484,85814] 0 2024-02-20T08:05:32.128 INFO:tasks.workunit.client.0.smithi123.stdout:2/540: mkdir d1a/d29/d5d/d97/da9 0 2024-02-20T08:05:32.133 INFO:tasks.workunit.client.0.smithi123.stdout:4/451: read - d3/d18/d7d/d87/f9a zero size 2024-02-20T08:05:32.133 INFO:tasks.workunit.client.0.smithi123.stdout:5/384: read d0/d34/d48/d56/d25/f3b [2201806,43956] 0 2024-02-20T08:05:32.137 INFO:tasks.workunit.client.0.smithi123.stdout:1/470: dwrite d3/de/d14/d26/d2e/d54/fa7 [0,4194304] 0 2024-02-20T08:05:32.144 INFO:tasks.workunit.client.0.smithi123.stdout:5/385: symlink d0/d13/d27/d4e/l83 0 2024-02-20T08:05:32.144 INFO:tasks.workunit.client.0.smithi123.stdout:0/576: dread d2/dd/d4f/d61/d68/f6c [0,4194304] 0 2024-02-20T08:05:32.146 INFO:tasks.workunit.client.0.smithi123.stdout:1/471: mknod d3/de/d14/d26/d2e/d54/caa 0 2024-02-20T08:05:32.147 INFO:tasks.workunit.client.0.smithi123.stdout:6/694: getdents d0/d3e/d40/d90/d94/dc9 0 2024-02-20T08:05:32.148 INFO:tasks.workunit.client.0.smithi123.stdout:1/472: dread - d3/d47/f7c zero size 2024-02-20T08:05:32.149 INFO:tasks.workunit.client.0.smithi123.stdout:3/473: getdents d0/d6/d1a/d1b/d1c/d61 0 2024-02-20T08:05:32.153 INFO:tasks.workunit.client.0.smithi123.stdout:5/386: dwrite d0/d34/d48/d56/d25/f29 [4194304,4194304] 0 2024-02-20T08:05:32.153 INFO:tasks.workunit.client.0.smithi123.stdout:1/473: truncate d3/de/d14/d26/d56/f91 766344 0 2024-02-20T08:05:32.159 INFO:tasks.workunit.client.0.smithi123.stdout:3/474: read d0/d6/d1a/d1b/f22 [6475594,1045] 0 2024-02-20T08:05:32.160 INFO:tasks.workunit.client.0.smithi123.stdout:4/452: getdents d3/d2c/d43 0 2024-02-20T08:05:32.161 INFO:tasks.workunit.client.0.smithi123.stdout:3/475: readlink d0/d6/d1a/d1b/d1c/d3b/l47 0 2024-02-20T08:05:32.162 INFO:tasks.workunit.client.0.smithi123.stdout:4/453: write d3/d2c/d43/d26/d2e/f52 [4189385,72879] 0 2024-02-20T08:05:32.165 INFO:tasks.workunit.client.0.smithi123.stdout:0/577: write d2/de/f51 [1414696,79350] 0 2024-02-20T08:05:32.171 INFO:tasks.workunit.client.0.smithi123.stdout:5/387: mkdir d0/d34/d67/d80/d84 0 2024-02-20T08:05:32.172 INFO:tasks.workunit.client.0.smithi123.stdout:5/388: stat d0/d34/d48/d56/l18 0 2024-02-20T08:05:32.173 INFO:tasks.workunit.client.0.smithi123.stdout:5/389: fdatasync d0/d13/d27/d4e/f52 0 2024-02-20T08:05:32.174 INFO:tasks.workunit.client.0.smithi123.stdout:4/454: creat d3/d18/d7d/d8b/f9d x:0 0 0 2024-02-20T08:05:32.175 INFO:tasks.workunit.client.0.smithi123.stdout:1/474: dread d3/db/d34/d74/d6f/d63/f72 [0,4194304] 0 2024-02-20T08:05:32.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/390: truncate d0/d34/d67/f71 245629 0 2024-02-20T08:05:32.176 INFO:tasks.workunit.client.0.smithi123.stdout:5/391: fsync d0/d34/d48/d56/d4c/f6b 0 2024-02-20T08:05:32.179 INFO:tasks.workunit.client.0.smithi123.stdout:0/578: symlink d2/de/lb5 0 2024-02-20T08:05:32.188 INFO:tasks.workunit.client.0.smithi123.stdout:6/695: getdents d0/d3e/d40/d48/d79 0 2024-02-20T08:05:32.188 INFO:tasks.workunit.client.0.smithi123.stdout:6/696: chown d0/d3e/d40/d48/d4a/l4c 428800596 1 2024-02-20T08:05:32.188 INFO:tasks.workunit.client.0.smithi123.stdout:6/697: chown d0/d3e/c8a 6 1 2024-02-20T08:05:32.188 INFO:tasks.workunit.client.0.smithi123.stdout:5/392: rename d0/d13/l55 to d0/d34/d48/d4b/d51/l85 0 2024-02-20T08:05:32.190 INFO:tasks.workunit.client.0.smithi123.stdout:0/579: mkdir d2/dd/d4f/d7c/da4/db6 0 2024-02-20T08:05:32.193 INFO:tasks.workunit.client.0.smithi123.stdout:4/455: creat d3/d18/d63/d88/f9e x:0 0 0 2024-02-20T08:05:32.220 INFO:tasks.workunit.client.0.smithi123.stdout:0/580: symlink d2/d3/d37/d9d/lb7 0 2024-02-20T08:05:32.220 INFO:tasks.workunit.client.0.smithi123.stdout:1/475: creat d3/fab x:0 0 0 2024-02-20T08:05:32.221 INFO:tasks.workunit.client.0.smithi123.stdout:3/476: dwrite d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:32.222 INFO:tasks.workunit.client.0.smithi123.stdout:6/698: link d0/d3e/d40/fd7 d0/d3e/d92/d56/d57/d91/fe8 0 2024-02-20T08:05:32.223 INFO:tasks.workunit.client.0.smithi123.stdout:3/477: chown d0/d6/d1a/d1b/d2a/c4d 7761 1 2024-02-20T08:05:32.225 INFO:tasks.workunit.client.0.smithi123.stdout:5/393: mkdir d0/d13/d27/d86 0 2024-02-20T08:05:32.225 INFO:tasks.workunit.client.0.smithi123.stdout:4/456: dread d3/d2c/d43/f50 [0,4194304] 0 2024-02-20T08:05:32.227 INFO:tasks.workunit.client.0.smithi123.stdout:4/457: chown d3/d2c/d5a/c6e 17 1 2024-02-20T08:05:32.228 INFO:tasks.workunit.client.0.smithi123.stdout:1/476: rmdir d3/d47 39 2024-02-20T08:05:32.231 INFO:tasks.workunit.client.0.smithi123.stdout:6/699: mkdir d0/d3e/d40/d48/d7b/de9 0 2024-02-20T08:05:32.233 INFO:tasks.workunit.client.0.smithi123.stdout:5/394: dwrite d0/d34/d48/d56/d25/f2d [0,4194304] 0 2024-02-20T08:05:32.233 INFO:tasks.workunit.client.0.smithi123.stdout:3/478: fdatasync d0/d6/d1a/d1e/f42 0 2024-02-20T08:05:32.239 INFO:tasks.workunit.client.0.smithi123.stdout:0/581: creat d2/d54/dac/fb8 x:0 0 0 2024-02-20T08:05:32.241 INFO:tasks.workunit.client.0.smithi123.stdout:4/458: rename d3/d2c/d43/d26/d3e/c33 to d3/d18/d6c/c9f 0 2024-02-20T08:05:32.243 INFO:tasks.workunit.client.0.smithi123.stdout:1/477: creat d3/de/d14/d2c/d4f/fac x:0 0 0 2024-02-20T08:05:32.245 INFO:tasks.workunit.client.0.smithi123.stdout:6/700: symlink d0/d3e/d92/d56/d89/d73/lea 0 2024-02-20T08:05:32.251 INFO:tasks.workunit.client.0.smithi123.stdout:5/395: creat d0/d34/d48/d56/d4c/d43/f87 x:0 0 0 2024-02-20T08:05:32.253 INFO:tasks.workunit.client.0.smithi123.stdout:4/459: mknod d3/d2c/d43/d34/ca0 0 2024-02-20T08:05:32.257 INFO:tasks.workunit.client.0.smithi123.stdout:6/701: write d0/d3e/d40/d48/d79/f7a [715125,79956] 0 2024-02-20T08:05:32.259 INFO:tasks.workunit.client.0.smithi123.stdout:1/478: dread d3/de/f5a [0,4194304] 0 2024-02-20T08:05:32.262 INFO:tasks.workunit.client.0.smithi123.stdout:4/460: dwrite d3/d1e/f5b [0,4194304] 0 2024-02-20T08:05:32.262 INFO:tasks.workunit.client.0.smithi123.stdout:6/702: write d0/d3e/d40/d48/d4a/fbe [491162,86048] 0 2024-02-20T08:05:32.263 INFO:tasks.workunit.client.0.smithi123.stdout:4/461: stat d3/d2c/d43/c9c 0 2024-02-20T08:05:32.264 INFO:tasks.workunit.client.0.smithi123.stdout:3/479: creat d0/dd/d48/fb0 x:0 0 0 2024-02-20T08:05:32.266 INFO:tasks.workunit.client.0.smithi123.stdout:4/462: write d3/d2c/d43/d34/f3b [2230198,2167] 0 2024-02-20T08:05:32.267 INFO:tasks.workunit.client.0.smithi123.stdout:3/480: chown d0/d6/d1a/d1b/d2a/d86/l91 6973214 1 2024-02-20T08:05:32.270 INFO:tasks.workunit.client.0.smithi123.stdout:5/396: dread d0/d34/d48/d56/f62 [0,4194304] 0 2024-02-20T08:05:32.273 INFO:tasks.workunit.client.0.smithi123.stdout:1/479: symlink d3/de/d14/d26/d2e/d54/d9f/lad 0 2024-02-20T08:05:32.275 INFO:tasks.workunit.client.0.smithi123.stdout:1/480: truncate d3/de/d14/d26/d56/f91 1061280 0 2024-02-20T08:05:32.284 INFO:tasks.workunit.client.0.smithi123.stdout:1/481: read d3/fc [73937,122825] 0 2024-02-20T08:05:32.285 INFO:tasks.workunit.client.0.smithi123.stdout:3/481: symlink d0/d6/d1a/d1b/lb1 0 2024-02-20T08:05:32.286 INFO:tasks.workunit.client.0.smithi123.stdout:6/703: link d0/d3e/d40/d90/fcd d0/d3e/d40/d48/d7b/feb 0 2024-02-20T08:05:32.287 INFO:tasks.workunit.client.0.smithi123.stdout:6/704: write d0/f23 [4881010,64750] 0 2024-02-20T08:05:32.290 INFO:tasks.workunit.client.0.smithi123.stdout:4/463: link d3/d2c/d43/c9c d3/d1e/ca1 0 2024-02-20T08:05:32.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/464: read d3/d18/d7d/f90 [1021823,24721] 0 2024-02-20T08:05:32.292 INFO:tasks.workunit.client.0.smithi123.stdout:1/482: mknod d3/db/d41/cae 0 2024-02-20T08:05:32.293 INFO:tasks.workunit.client.0.smithi123.stdout:3/482: fsync d0/f24 0 2024-02-20T08:05:32.296 INFO:tasks.workunit.client.0.smithi123.stdout:5/397: creat d0/d13/f88 x:0 0 0 2024-02-20T08:05:32.298 INFO:tasks.workunit.client.0.smithi123.stdout:6/705: mkdir d0/d3e/d40/d48/d79/dec 0 2024-02-20T08:05:32.300 INFO:tasks.workunit.client.0.smithi123.stdout:4/465: symlink d3/d18/d7d/la2 0 2024-02-20T08:05:32.310 INFO:tasks.workunit.client.0.smithi123.stdout:4/466: mknod d3/d18/d7d/ca3 0 2024-02-20T08:05:32.314 INFO:tasks.workunit.client.0.smithi123.stdout:6/706: dread d0/f30 [0,4194304] 0 2024-02-20T08:05:32.316 INFO:tasks.workunit.client.0.smithi123.stdout:6/707: fsync d0/d3e/d40/d48/d79/f8b 0 2024-02-20T08:05:32.317 INFO:tasks.workunit.client.0.smithi123.stdout:1/483: dwrite d3/fa [0,4194304] 0 2024-02-20T08:05:32.318 INFO:tasks.workunit.client.0.smithi123.stdout:1/484: fdatasync d3/db/f38 0 2024-02-20T08:05:32.337 INFO:tasks.workunit.client.0.smithi123.stdout:3/483: dwrite d0/d6/d1a/d1b/d1c/f65 [0,4194304] 0 2024-02-20T08:05:32.339 INFO:tasks.workunit.client.0.smithi123.stdout:5/398: truncate d0/d13/f1b 699959 0 2024-02-20T08:05:32.339 INFO:tasks.workunit.client.0.smithi123.stdout:6/708: getdents d0/d3e/d40/d48/daa/ddf 0 2024-02-20T08:05:32.343 INFO:tasks.workunit.client.0.smithi123.stdout:3/484: chown d0/lc 22 1 2024-02-20T08:05:32.344 INFO:tasks.workunit.client.0.smithi123.stdout:5/399: chown d0/d34/c5d 55 1 2024-02-20T08:05:32.347 INFO:tasks.workunit.client.0.smithi123.stdout:3/485: truncate d0/d6/d1a/d1b/d1c/d20/f40 869089 0 2024-02-20T08:05:32.350 INFO:tasks.workunit.client.0.smithi123.stdout:5/400: creat d0/d34/d48/d4b/f89 x:0 0 0 2024-02-20T08:05:32.350 INFO:tasks.workunit.client.0.smithi123.stdout:4/467: write d3/f1b [1137050,26552] 0 2024-02-20T08:05:32.352 INFO:tasks.workunit.client.0.smithi123.stdout:4/468: chown d3/d2c/d43/d26/d2e/f39 180125 1 2024-02-20T08:05:32.352 INFO:tasks.workunit.client.0.smithi123.stdout:5/401: write d0/d34/d48/d56/d4c/d43/f87 [1010605,47573] 0 2024-02-20T08:05:32.353 INFO:tasks.workunit.client.0.smithi123.stdout:3/486: creat d0/d6/d1a/d1b/d1c/d21/d8e/fb2 x:0 0 0 2024-02-20T08:05:32.355 INFO:tasks.workunit.client.0.smithi123.stdout:3/487: write d0/d6/d1a/d1b/d2a/f6f [3861481,63367] 0 2024-02-20T08:05:32.362 INFO:tasks.workunit.client.0.smithi123.stdout:4/469: dwrite d3/d2c/d43/d34/f58 [0,4194304] 0 2024-02-20T08:05:32.382 INFO:tasks.workunit.client.0.smithi123.stdout:4/470: dread d3/d18/f51 [0,4194304] 0 2024-02-20T08:05:32.392 INFO:tasks.workunit.client.0.smithi123.stdout:4/471: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:32.394 INFO:tasks.workunit.client.0.smithi123.stdout:4/472: read d3/d2c/d43/d34/f93 [351635,118611] 0 2024-02-20T08:05:32.396 INFO:tasks.workunit.client.0.smithi123.stdout:4/473: mknod d3/d18/d7d/d87/ca4 0 2024-02-20T08:05:32.403 INFO:tasks.workunit.client.0.smithi123.stdout:4/474: rename d3/d18/f77 to d3/d2c/d43/d26/fa5 0 2024-02-20T08:05:32.452 INFO:tasks.workunit.client.0.smithi123.stdout:4/475: dwrite d3/d2c/f53 [0,4194304] 0 2024-02-20T08:05:32.592 INFO:tasks.workunit.client.0.smithi123.stdout:9/437: sync 2024-02-20T08:05:32.594 INFO:tasks.workunit.client.0.smithi123.stdout:9/438: write d6/d19/d1a/d31/d4b/f73 [275139,119989] 0 2024-02-20T08:05:32.597 INFO:tasks.workunit.client.0.smithi123.stdout:9/439: creat d6/d19/d1a/d31/f8f x:0 0 0 2024-02-20T08:05:32.598 INFO:tasks.workunit.client.0.smithi123.stdout:9/440: write d6/d19/f4a [1869032,73115] 0 2024-02-20T08:05:32.601 INFO:tasks.workunit.client.0.smithi123.stdout:9/441: unlink d6/d19/d1a/d7c/l72 0 2024-02-20T08:05:32.603 INFO:tasks.workunit.client.0.smithi123.stdout:9/442: mknod d6/d2a/d27/c90 0 2024-02-20T08:05:32.605 INFO:tasks.workunit.client.0.smithi123.stdout:9/443: unlink d6/d2a/d27/c90 0 2024-02-20T08:05:32.606 INFO:tasks.workunit.client.0.smithi123.stdout:9/444: chown d6/d19/d1a/d2b/d28/f4c 384 1 2024-02-20T08:05:32.608 INFO:tasks.workunit.client.0.smithi123.stdout:9/445: unlink d6/d19/d1a/d2b/d28/f4c 0 2024-02-20T08:05:32.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:32 smithi194 ceph-mon[37804]: pgmap v35: 65 pgs: 65 active+clean; 918 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 25 MiB/s rd, 110 MiB/s wr, 218 op/s 2024-02-20T08:05:32.646 INFO:tasks.workunit.client.0.smithi123.stdout:9/446: dread d6/fb [4194304,4194304] 0 2024-02-20T08:05:32.648 INFO:tasks.workunit.client.0.smithi123.stdout:9/447: mkdir d6/d19/d1a/d2b/d91 0 2024-02-20T08:05:32.695 INFO:tasks.workunit.client.0.smithi123.stdout:8/453: sync 2024-02-20T08:05:32.715 INFO:tasks.workunit.client.0.smithi123.stdout:9/448: rmdir d6/d19/d1a/d2b/d28 39 2024-02-20T08:05:32.717 INFO:tasks.workunit.client.0.smithi123.stdout:8/454: mkdir d6/d1c/d22/d4f/d5b/d8f/d98 0 2024-02-20T08:05:32.718 INFO:tasks.workunit.client.0.smithi123.stdout:8/455: write d6/d1c/d2c/f7b [627562,93772] 0 2024-02-20T08:05:32.719 INFO:tasks.workunit.client.0.smithi123.stdout:9/449: rmdir d6 39 2024-02-20T08:05:32.725 INFO:tasks.workunit.client.0.smithi123.stdout:8/456: getdents d6/d32/d95/d7d 0 2024-02-20T08:05:32.728 INFO:tasks.workunit.client.0.smithi123.stdout:8/457: mkdir d6/d1c/d22/d4f/d5b/d8f/d99 0 2024-02-20T08:05:32.728 INFO:tasks.workunit.client.0.smithi123.stdout:9/450: link d6/f3f d6/d19/d1a/d6d/f92 0 2024-02-20T08:05:32.728 INFO:tasks.workunit.client.0.smithi123.stdout:9/451: fsync d6/d19/d1a/f5b 0 2024-02-20T08:05:32.729 INFO:tasks.workunit.client.0.smithi123.stdout:8/458: readlink d6/l18 0 2024-02-20T08:05:32.730 INFO:tasks.workunit.client.0.smithi123.stdout:8/459: chown d6/d1c/d22/c66 1 1 2024-02-20T08:05:32.737 INFO:tasks.workunit.client.0.smithi123.stdout:8/460: dwrite d6/d1c/f6f [0,4194304] 0 2024-02-20T08:05:32.740 INFO:tasks.workunit.client.0.smithi123.stdout:8/461: unlink d6/d1c/d22/l27 0 2024-02-20T08:05:32.745 INFO:tasks.workunit.client.0.smithi123.stdout:9/452: dread d6/d19/d1b/f70 [0,4194304] 0 2024-02-20T08:05:32.747 INFO:tasks.workunit.client.0.smithi123.stdout:8/462: dread d6/f71 [0,4194304] 0 2024-02-20T08:05:32.749 INFO:tasks.workunit.client.0.smithi123.stdout:8/463: creat d6/d1c/d22/d8c/f9a x:0 0 0 2024-02-20T08:05:32.752 INFO:tasks.workunit.client.0.smithi123.stdout:9/453: rename d6/d19/d1b/d3d/c8e to d6/d19/d1a/d2b/c93 0 2024-02-20T08:05:32.754 INFO:tasks.workunit.client.0.smithi123.stdout:8/464: rename d6/fa to d6/d1c/d22/d4f/d5b/d8f/d98/f9b 0 2024-02-20T08:05:32.755 INFO:tasks.workunit.client.0.smithi123.stdout:9/454: symlink d6/d19/d1b/d3d/d32/l94 0 2024-02-20T08:05:32.756 INFO:tasks.workunit.client.0.smithi123.stdout:8/465: symlink d6/d1c/d22/d4f/d5b/l9c 0 2024-02-20T08:05:32.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:32 smithi123 ceph-mon[29383]: pgmap v35: 65 pgs: 65 active+clean; 918 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 25 MiB/s rd, 110 MiB/s wr, 218 op/s 2024-02-20T08:05:32.758 INFO:tasks.workunit.client.0.smithi123.stdout:8/466: symlink d6/d32/d95/d3f/l9d 0 2024-02-20T08:05:32.777 INFO:tasks.workunit.client.0.smithi123.stdout:8/467: dread d6/f80 [0,4194304] 0 2024-02-20T08:05:32.777 INFO:tasks.workunit.client.0.smithi123.stdout:9/455: dread d6/d19/f49 [0,4194304] 0 2024-02-20T08:05:32.778 INFO:tasks.workunit.client.0.smithi123.stdout:9/456: dread - d6/d19/d1b/f68 zero size 2024-02-20T08:05:32.778 INFO:tasks.workunit.client.0.smithi123.stdout:8/468: fdatasync d6/d1c/d22/d4f/d5b/f77 0 2024-02-20T08:05:32.780 INFO:tasks.workunit.client.0.smithi123.stdout:9/457: symlink d6/d19/d1a/d31/l95 0 2024-02-20T08:05:32.784 INFO:tasks.workunit.client.0.smithi123.stdout:8/469: dwrite d6/d1c/d22/d4f/f85 [4194304,4194304] 0 2024-02-20T08:05:32.786 INFO:tasks.workunit.client.0.smithi123.stdout:8/470: truncate d6/d1c/d2c/f7b 1545092 0 2024-02-20T08:05:32.787 INFO:tasks.workunit.client.0.smithi123.stdout:8/471: chown d6/d1c/d22/d4f/f7c 2550025 1 2024-02-20T08:05:32.790 INFO:tasks.workunit.client.0.smithi123.stdout:8/472: symlink d6/d1c/d22/d4f/d7e/l9e 0 2024-02-20T08:05:32.794 INFO:tasks.workunit.client.0.smithi123.stdout:8/473: unlink d6/l26 0 2024-02-20T08:05:32.795 INFO:tasks.workunit.client.0.smithi123.stdout:8/474: write d6/d1c/d22/d4f/f85 [8840602,55730] 0 2024-02-20T08:05:32.796 INFO:tasks.workunit.client.0.smithi123.stdout:9/458: write d6/d19/d1a/d7f/f5d [246206,27000] 0 2024-02-20T08:05:32.799 INFO:tasks.workunit.client.0.smithi123.stdout:8/475: mknod d6/c9f 0 2024-02-20T08:05:32.800 INFO:tasks.workunit.client.0.smithi123.stdout:9/459: creat d6/d19/d1a/d31/d4b/f96 x:0 0 0 2024-02-20T08:05:32.803 INFO:tasks.workunit.client.0.smithi123.stdout:8/476: creat d6/d1c/d22/d4f/d5b/d8f/d99/fa0 x:0 0 0 2024-02-20T08:05:32.805 INFO:tasks.workunit.client.0.smithi123.stdout:9/460: readlink d6/d19/d1a/d2b/d28/l40 0 2024-02-20T08:05:32.807 INFO:tasks.workunit.client.0.smithi123.stdout:8/477: write d6/d1c/d47/f59 [1879881,1722] 0 2024-02-20T08:05:32.810 INFO:tasks.workunit.client.0.smithi123.stdout:9/461: dread d6/d19/d1a/f5b [0,4194304] 0 2024-02-20T08:05:32.814 INFO:tasks.workunit.client.0.smithi123.stdout:7/408: sync 2024-02-20T08:05:32.818 INFO:tasks.workunit.client.0.smithi123.stdout:9/462: getdents d6/d19/d1a/d31/d4b/d74 0 2024-02-20T08:05:32.820 INFO:tasks.workunit.client.0.smithi123.stdout:7/409: mknod d0/d6/dd/d52/d26/c8d 0 2024-02-20T08:05:32.820 INFO:tasks.workunit.client.0.smithi123.stdout:7/410: chown d0/db 1559 1 2024-02-20T08:05:32.821 INFO:tasks.workunit.client.0.smithi123.stdout:8/478: dread d6/d1c/d22/f6b [0,4194304] 0 2024-02-20T08:05:32.824 INFO:tasks.workunit.client.0.smithi123.stdout:9/463: dwrite d6/d19/d1a/d7f/f67 [0,4194304] 0 2024-02-20T08:05:32.826 INFO:tasks.workunit.client.0.smithi123.stdout:7/411: rmdir d0/db/d21/d42 39 2024-02-20T08:05:32.826 INFO:tasks.workunit.client.0.smithi123.stdout:9/464: chown d6/d2a/d27/c5e 389 1 2024-02-20T08:05:32.827 INFO:tasks.workunit.client.0.smithi123.stdout:9/465: stat d6/d2a/f59 0 2024-02-20T08:05:32.828 INFO:tasks.workunit.client.0.smithi123.stdout:8/479: readlink d6/d1c/d22/d4f/d5b/l9c 0 2024-02-20T08:05:32.828 INFO:tasks.workunit.client.0.smithi123.stdout:9/466: read - d6/d19/d1a/d7c/f86 zero size 2024-02-20T08:05:32.830 INFO:tasks.workunit.client.0.smithi123.stdout:9/467: write d6/d19/d1a/d31/f46 [3344094,4227] 0 2024-02-20T08:05:32.830 INFO:tasks.workunit.client.0.smithi123.stdout:8/480: creat d6/d1c/d2c/fa1 x:0 0 0 2024-02-20T08:05:32.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/468: read d6/d19/f4a [4014066,27294] 0 2024-02-20T08:05:32.832 INFO:tasks.workunit.client.0.smithi123.stdout:8/481: chown d6/d32/d95/c8d 375323 1 2024-02-20T08:05:32.833 INFO:tasks.workunit.client.0.smithi123.stdout:9/469: write d6/d19/d1a/f71 [613354,2994] 0 2024-02-20T08:05:32.833 INFO:tasks.workunit.client.0.smithi123.stdout:8/482: fsync d6/d1c/d22/d4f/d5b/f77 0 2024-02-20T08:05:32.838 INFO:tasks.workunit.client.0.smithi123.stdout:9/470: link d6/f8d d6/d19/d1a/d7c/d81/f97 0 2024-02-20T08:05:32.838 INFO:tasks.workunit.client.0.smithi123.stdout:8/483: getdents d6/d1c/d22/d4f/d7e 0 2024-02-20T08:05:32.839 INFO:tasks.workunit.client.0.smithi123.stdout:8/484: fdatasync d6/d1c/d47/f59 0 2024-02-20T08:05:32.840 INFO:tasks.workunit.client.0.smithi123.stdout:9/471: mkdir d6/d2a/d27/d6f/d8b/d98 0 2024-02-20T08:05:32.846 INFO:tasks.workunit.client.0.smithi123.stdout:8/485: dwrite d6/d1c/d22/f48 [4194304,4194304] 0 2024-02-20T08:05:32.847 INFO:tasks.workunit.client.0.smithi123.stdout:9/472: dwrite d6/d19/d1b/d3d/f57 [0,4194304] 0 2024-02-20T08:05:32.863 INFO:tasks.workunit.client.0.smithi123.stdout:9/473: write d6/d19/d1a/d6d/f92 [1171898,99642] 0 2024-02-20T08:05:32.867 INFO:tasks.workunit.client.0.smithi123.stdout:8/486: dwrite d6/f1a [0,4194304] 0 2024-02-20T08:05:32.869 INFO:tasks.workunit.client.0.smithi123.stdout:8/487: write d6/f1a [180381,36251] 0 2024-02-20T08:05:32.873 INFO:tasks.workunit.client.0.smithi123.stdout:8/488: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:32.877 INFO:tasks.workunit.client.0.smithi123.stdout:8/489: mkdir d6/d1c/d22/d8c/da2 0 2024-02-20T08:05:32.879 INFO:tasks.workunit.client.0.smithi123.stdout:9/474: truncate d6/f12 1202940 0 2024-02-20T08:05:32.880 INFO:tasks.workunit.client.0.smithi123.stdout:9/475: fdatasync d6/d19/d1a/d7f/f5d 0 2024-02-20T08:05:32.880 INFO:tasks.workunit.client.0.smithi123.stdout:8/490: creat d6/d1c/d22/d4f/d7e/fa3 x:0 0 0 2024-02-20T08:05:32.881 INFO:tasks.workunit.client.0.smithi123.stdout:9/476: chown d6/d19/d1a/d6d/f79 60968 1 2024-02-20T08:05:32.885 INFO:tasks.workunit.client.0.smithi123.stdout:9/477: creat d6/d19/d1a/d6d/f99 x:0 0 0 2024-02-20T08:05:32.886 INFO:tasks.workunit.client.0.smithi123.stdout:8/491: truncate d6/d1c/d22/d4f/d5b/f7f 765721 0 2024-02-20T08:05:32.886 INFO:tasks.workunit.client.0.smithi123.stdout:9/478: chown d6/d19/d1a/d7c/d81/f97 107723865 1 2024-02-20T08:05:32.892 INFO:tasks.workunit.client.0.smithi123.stdout:9/479: dwrite d6/f14 [4194304,4194304] 0 2024-02-20T08:05:32.895 INFO:tasks.workunit.client.0.smithi123.stdout:9/480: rename d6/d19/d1b to d6/d19/d1a/d2b/d28/d9a 0 2024-02-20T08:05:32.899 INFO:tasks.workunit.client.0.smithi123.stdout:9/481: symlink d6/d2a/d27/d6f/d8b/d98/l9b 0 2024-02-20T08:05:32.903 INFO:tasks.workunit.client.0.smithi123.stdout:9/482: truncate d6/d19/d1a/f5b 2969280 0 2024-02-20T08:05:32.907 INFO:tasks.workunit.client.0.smithi123.stdout:8/492: truncate d6/f1a 3174063 0 2024-02-20T08:05:32.908 INFO:tasks.workunit.client.0.smithi123.stdout:9/483: read d6/d19/d1a/d2b/d28/d9a/f3b [2353172,87333] 0 2024-02-20T08:05:32.909 INFO:tasks.workunit.client.0.smithi123.stdout:9/484: stat d6/d19/d1a/d31/l88 0 2024-02-20T08:05:32.910 INFO:tasks.workunit.client.0.smithi123.stdout:9/485: write d6/d19/d1a/d6d/f6e [33163,45979] 0 2024-02-20T08:05:32.910 INFO:tasks.workunit.client.0.smithi123.stdout:8/493: mknod d6/d1c/d22/d4f/d5b/d8f/d99/ca4 0 2024-02-20T08:05:32.916 INFO:tasks.workunit.client.0.smithi123.stdout:9/486: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/f57 [4194304,4194304] 0 2024-02-20T08:05:32.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/494: link d6/d1c/d2c/l96 d6/d1c/d22/d4f/d7e/d82/la5 0 2024-02-20T08:05:32.924 INFO:tasks.workunit.client.0.smithi123.stdout:8/495: dread - d6/d1c/d22/d8c/f9a zero size 2024-02-20T08:05:32.926 INFO:tasks.workunit.client.0.smithi123.stdout:9/487: unlink d6/d19/d1a/d31/c36 0 2024-02-20T08:05:32.927 INFO:tasks.workunit.client.0.smithi123.stdout:9/488: write d6/d19/d1a/f6a [1305790,69896] 0 2024-02-20T08:05:32.929 INFO:tasks.workunit.client.0.smithi123.stdout:8/496: readlink d6/d1c/d2c/l96 0 2024-02-20T08:05:32.932 INFO:tasks.workunit.client.0.smithi123.stdout:9/489: mknod d6/d19/d1a/d2b/d65/c9c 0 2024-02-20T08:05:32.934 INFO:tasks.workunit.client.0.smithi123.stdout:8/497: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:32.936 INFO:tasks.workunit.client.0.smithi123.stdout:2/541: sync 2024-02-20T08:05:32.936 INFO:tasks.workunit.client.0.smithi123.stdout:0/582: sync 2024-02-20T08:05:32.936 INFO:tasks.workunit.client.0.smithi123.stdout:6/709: sync 2024-02-20T08:05:32.937 INFO:tasks.workunit.client.0.smithi123.stdout:9/490: rename d6/d19/d1a/d31/d4b to d6/d2a/d9d 0 2024-02-20T08:05:32.940 INFO:tasks.workunit.client.0.smithi123.stdout:6/710: truncate d0/d3e/d92/db3/fce 669321 0 2024-02-20T08:05:32.942 INFO:tasks.workunit.client.0.smithi123.stdout:6/711: truncate d0/f84 4515950 0 2024-02-20T08:05:32.942 INFO:tasks.workunit.client.0.smithi123.stdout:8/498: dwrite d6/f1b [4194304,4194304] 0 2024-02-20T08:05:32.943 INFO:tasks.workunit.client.0.smithi123.stdout:9/491: rmdir d6/d2a/d27/d6f 39 2024-02-20T08:05:32.945 INFO:tasks.workunit.client.0.smithi123.stdout:9/492: fdatasync d6/d19/d1a/d6d/f99 0 2024-02-20T08:05:32.946 INFO:tasks.workunit.client.0.smithi123.stdout:2/542: mkdir d1a/d29/d42/d52/d98/da1/daa 0 2024-02-20T08:05:32.946 INFO:tasks.workunit.client.0.smithi123.stdout:6/712: write d0/d3e/d92/d56/d57/f6b [15407,15098] 0 2024-02-20T08:05:32.949 INFO:tasks.workunit.client.0.smithi123.stdout:8/499: creat d6/d1c/d22/d4f/d5b/fa6 x:0 0 0 2024-02-20T08:05:32.953 INFO:tasks.workunit.client.0.smithi123.stdout:9/493: creat d6/d19/f9e x:0 0 0 2024-02-20T08:05:32.956 INFO:tasks.workunit.client.0.smithi123.stdout:8/500: dwrite d6/d1c/d22/d4f/d5b/f77 [0,4194304] 0 2024-02-20T08:05:32.957 INFO:tasks.workunit.client.0.smithi123.stdout:2/543: rename d1a/d7f/f8e to d1a/d29/d42/d73/d8f/fab 0 2024-02-20T08:05:32.958 INFO:tasks.workunit.client.0.smithi123.stdout:9/494: mknod d6/d19/d1a/d7f/c9f 0 2024-02-20T08:05:32.966 INFO:tasks.workunit.client.0.smithi123.stdout:8/501: creat d6/d32/fa7 x:0 0 0 2024-02-20T08:05:32.968 INFO:tasks.workunit.client.0.smithi123.stdout:8/502: write d6/fd [4798677,42366] 0 2024-02-20T08:05:32.969 INFO:tasks.workunit.client.0.smithi123.stdout:9/495: mkdir d6/d19/d1a/d2b/d28/da0 0 2024-02-20T08:05:32.973 INFO:tasks.workunit.client.0.smithi123.stdout:2/544: rename d1a/d29/d39/l83 to d1a/d29/d42/d80/da3/lac 0 2024-02-20T08:05:32.974 INFO:tasks.workunit.client.0.smithi123.stdout:2/545: write d1a/d4f/f53 [3224285,70401] 0 2024-02-20T08:05:32.975 INFO:tasks.workunit.client.0.smithi123.stdout:8/503: rmdir d6/d1c/d22/d8c 39 2024-02-20T08:05:32.978 INFO:tasks.workunit.client.0.smithi123.stdout:9/496: creat d6/d19/d1a/d2b/d28/fa1 x:0 0 0 2024-02-20T08:05:32.981 INFO:tasks.workunit.client.0.smithi123.stdout:6/713: write d0/f28 [395545,80823] 0 2024-02-20T08:05:32.985 INFO:tasks.workunit.client.0.smithi123.stdout:2/546: mknod d1a/d29/d42/d52/cad 0 2024-02-20T08:05:32.987 INFO:tasks.workunit.client.0.smithi123.stdout:6/714: mkdir d0/d38/ded 0 2024-02-20T08:05:32.988 INFO:tasks.workunit.client.0.smithi123.stdout:6/715: chown d0/d3e/d40/d48/d5d/f62 0 1 2024-02-20T08:05:32.990 INFO:tasks.workunit.client.0.smithi123.stdout:2/547: symlink d1a/d29/d42/d73/d8f/lae 0 2024-02-20T08:05:32.991 INFO:tasks.workunit.client.0.smithi123.stdout:2/548: write d1a/d29/d42/d4e/f78 [7941,81271] 0 2024-02-20T08:05:32.991 INFO:tasks.workunit.client.0.smithi123.stdout:9/497: mkdir d6/d19/d1a/d2b/d65/d77/da2 0 2024-02-20T08:05:32.992 INFO:tasks.workunit.client.0.smithi123.stdout:2/549: dread - d1a/f5c zero size 2024-02-20T08:05:32.994 INFO:tasks.workunit.client.0.smithi123.stdout:8/504: creat d6/fa8 x:0 0 0 2024-02-20T08:05:32.995 INFO:tasks.workunit.client.0.smithi123.stdout:8/505: stat d6/l92 0 2024-02-20T08:05:32.999 INFO:tasks.workunit.client.0.smithi123.stdout:9/498: mknod d6/d19/d1a/d2b/d28/d9a/d3d/d32/ca3 0 2024-02-20T08:05:33.000 INFO:tasks.workunit.client.0.smithi123.stdout:8/506: dwrite d6/d1c/d22/d4f/f85 [4194304,4194304] 0 2024-02-20T08:05:33.001 INFO:tasks.workunit.client.0.smithi123.stdout:8/507: fdatasync d6/f74 0 2024-02-20T08:05:33.009 INFO:tasks.workunit.client.0.smithi123.stdout:8/508: symlink d6/d32/la9 0 2024-02-20T08:05:33.011 INFO:tasks.workunit.client.0.smithi123.stdout:9/499: mkdir d6/d19/d1a/d6d/d7e/d80/da4 0 2024-02-20T08:05:33.012 INFO:tasks.workunit.client.0.smithi123.stdout:8/509: write d6/d1c/d22/f48 [5691353,81982] 0 2024-02-20T08:05:33.012 INFO:tasks.workunit.client.0.smithi123.stdout:9/500: fsync d6/f3f 0 2024-02-20T08:05:33.015 INFO:tasks.workunit.client.0.smithi123.stdout:6/716: dwrite d0/f21 [0,4194304] 0 2024-02-20T08:05:33.016 INFO:tasks.workunit.client.0.smithi123.stdout:8/510: write d6/d1c/d22/d4f/d5b/f77 [762054,30265] 0 2024-02-20T08:05:33.016 INFO:tasks.workunit.client.0.smithi123.stdout:2/550: truncate d1a/d4f/f53 2478504 0 2024-02-20T08:05:33.017 INFO:tasks.workunit.client.0.smithi123.stdout:2/551: dread - d1a/f9a zero size 2024-02-20T08:05:33.017 INFO:tasks.workunit.client.0.smithi123.stdout:6/717: dread - d0/d3e/d92/d56/d57/fd4 zero size 2024-02-20T08:05:33.022 INFO:tasks.workunit.client.0.smithi123.stdout:6/718: creat d0/d3e/d92/d56/d89/d73/d75/dc3/fee x:0 0 0 2024-02-20T08:05:33.026 INFO:tasks.workunit.client.0.smithi123.stdout:6/719: mkdir d0/d3e/d40/d90/d94/def 0 2024-02-20T08:05:33.027 INFO:tasks.workunit.client.0.smithi123.stdout:6/720: fdatasync d0/d3e/d40/d48/f93 0 2024-02-20T08:05:33.033 INFO:tasks.workunit.client.0.smithi123.stdout:9/501: dread d6/d19/d1a/d2b/d28/d9a/f3b [0,4194304] 0 2024-02-20T08:05:33.033 INFO:tasks.workunit.client.0.smithi123.stdout:6/721: getdents d0/d3e/d40/d48/daa/dab 0 2024-02-20T08:05:33.034 INFO:tasks.workunit.client.0.smithi123.stdout:2/552: write d1a/f50 [889973,2855] 0 2024-02-20T08:05:33.038 INFO:tasks.workunit.client.0.smithi123.stdout:6/722: unlink d0/lb 0 2024-02-20T08:05:33.040 INFO:tasks.workunit.client.0.smithi123.stdout:2/553: unlink d1a/d7f/c95 0 2024-02-20T08:05:33.043 INFO:tasks.workunit.client.0.smithi123.stdout:6/723: write d0/d38/f4f [182194,31823] 0 2024-02-20T08:05:33.043 INFO:tasks.workunit.client.0.smithi123.stdout:9/502: write d6/d19/f4a [4738702,38973] 0 2024-02-20T08:05:33.044 INFO:tasks.workunit.client.0.smithi123.stdout:9/503: stat d6/d2a/d27/f5a 0 2024-02-20T08:05:33.045 INFO:tasks.workunit.client.0.smithi123.stdout:6/724: chown d0/d3e/d92/la5 4 1 2024-02-20T08:05:33.045 INFO:tasks.workunit.client.0.smithi123.stdout:2/554: creat d1a/d29/d5d/d97/faf x:0 0 0 2024-02-20T08:05:33.047 INFO:tasks.workunit.client.0.smithi123.stdout:9/504: readlink d6/d2a/d27/d6f/d8b/d98/l9b 0 2024-02-20T08:05:33.049 INFO:tasks.workunit.client.0.smithi123.stdout:2/555: unlink d1a/d7f/f88 0 2024-02-20T08:05:33.054 INFO:tasks.workunit.client.0.smithi123.stdout:6/725: write d0/d3e/d40/fd7 [2588591,8546] 0 2024-02-20T08:05:33.057 INFO:tasks.workunit.client.0.smithi123.stdout:9/505: dwrite d6/d19/d1a/d2b/f37 [4194304,4194304] 0 2024-02-20T08:05:33.061 INFO:tasks.workunit.client.0.smithi123.stdout:2/556: link d1a/d29/d39/f89 d1a/d29/d42/d52/fb0 0 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:3/488: sync 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:4/476: sync 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:7/412: sync 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:5/402: sync 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:1/485: sync 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:9/506: mkdir d6/d19/d1a/d2b/d65/d77/da5 0 2024-02-20T08:05:33.063 INFO:tasks.workunit.client.0.smithi123.stdout:2/557: write d1a/d29/f35 [613080,127254] 0 2024-02-20T08:05:33.065 INFO:tasks.workunit.client.0.smithi123.stdout:5/403: write d0/f11 [4151540,42274] 0 2024-02-20T08:05:33.066 INFO:tasks.workunit.client.0.smithi123.stdout:1/486: write d3/de/d14/d26/fa4 [115059,1436] 0 2024-02-20T08:05:33.070 INFO:tasks.workunit.client.0.smithi123.stdout:1/487: dread d3/db/d7f/f97 [0,4194304] 0 2024-02-20T08:05:33.072 INFO:tasks.workunit.client.0.smithi123.stdout:4/477: unlink d3/d2c/d5a/c8c 0 2024-02-20T08:05:33.073 INFO:tasks.workunit.client.0.smithi123.stdout:2/558: creat d1a/d29/d42/fb1 x:0 0 0 2024-02-20T08:05:33.075 INFO:tasks.workunit.client.0.smithi123.stdout:2/559: read f5 [6365786,6236] 0 2024-02-20T08:05:33.076 INFO:tasks.workunit.client.0.smithi123.stdout:5/404: dwrite d0/d34/d48/f64 [0,4194304] 0 2024-02-20T08:05:33.077 INFO:tasks.workunit.client.0.smithi123.stdout:5/405: read - d0/d13/f88 zero size 2024-02-20T08:05:33.082 INFO:tasks.workunit.client.0.smithi123.stdout:3/489: write d0/d6/d1a/f23 [9329408,68900] 0 2024-02-20T08:05:33.086 INFO:tasks.workunit.client.0.smithi123.stdout:6/726: creat d0/d5c/ff0 x:0 0 0 2024-02-20T08:05:33.094 INFO:tasks.workunit.client.0.smithi123.stdout:9/507: link d6/d19/d1a/d2b/d28/l40 d6/d19/d1a/d2b/d65/la6 0 2024-02-20T08:05:33.097 INFO:tasks.workunit.client.0.smithi123.stdout:7/413: link d0/d6/dd/d52/d26/l78 d0/l8e 0 2024-02-20T08:05:33.097 INFO:tasks.workunit.client.0.smithi123.stdout:9/508: write d6/fa [1509654,109733] 0 2024-02-20T08:05:33.101 INFO:tasks.workunit.client.0.smithi123.stdout:4/478: dwrite d3/d18/f1c [0,4194304] 0 2024-02-20T08:05:33.101 INFO:tasks.workunit.client.0.smithi123.stdout:1/488: getdents d3/de/d14/d26/d2e/d54/d9f 0 2024-02-20T08:05:33.102 INFO:tasks.workunit.client.0.smithi123.stdout:5/406: dread d0/f16 [0,4194304] 0 2024-02-20T08:05:33.102 INFO:tasks.workunit.client.0.smithi123.stdout:7/414: truncate d0/db/d21/f67 946787 0 2024-02-20T08:05:33.103 INFO:tasks.workunit.client.0.smithi123.stdout:2/560: getdents d1a/d29/d42/d80 0 2024-02-20T08:05:33.109 INFO:tasks.workunit.client.0.smithi123.stdout:5/407: chown d0/d34/d48/d4b 48154537 1 2024-02-20T08:05:33.111 INFO:tasks.workunit.client.0.smithi123.stdout:4/479: creat d3/d18/d63/fa6 x:0 0 0 2024-02-20T08:05:33.112 INFO:tasks.workunit.client.0.smithi123.stdout:1/489: mknod d3/de/d14/d36/caf 0 2024-02-20T08:05:33.115 INFO:tasks.workunit.client.0.smithi123.stdout:9/509: dwrite d6/d19/d1a/f6c [0,4194304] 0 2024-02-20T08:05:33.116 INFO:tasks.workunit.client.0.smithi123.stdout:5/408: creat d0/d34/d48/d4b/d51/f8a x:0 0 0 2024-02-20T08:05:33.117 INFO:tasks.workunit.client.0.smithi123.stdout:3/490: dread d0/d6/d32/f33 [0,4194304] 0 2024-02-20T08:05:33.120 INFO:tasks.workunit.client.0.smithi123.stdout:7/415: link d0/db/d38/d47/d4a/d5d/f72 d0/db/d38/d47/d4a/d5d/f8f 0 2024-02-20T08:05:33.121 INFO:tasks.workunit.client.0.smithi123.stdout:9/510: chown d6/d19/d1a/d2b/d28/d9a/d3d/d32/l94 13 1 2024-02-20T08:05:33.122 INFO:tasks.workunit.client.0.smithi123.stdout:4/480: rename d3/l7 to d3/d18/d7d/d8b/la7 0 2024-02-20T08:05:33.123 INFO:tasks.workunit.client.0.smithi123.stdout:2/561: dwrite d1a/d29/d5d/d97/faf [0,4194304] 0 2024-02-20T08:05:33.129 INFO:tasks.workunit.client.0.smithi123.stdout:3/491: rename d0/d6/d1a/d1b/d9d/ca0 to d0/dd/d48/d8d/cb3 0 2024-02-20T08:05:33.132 INFO:tasks.workunit.client.0.smithi123.stdout:6/727: dread d0/d38/f3a [0,4194304] 0 2024-02-20T08:05:33.133 INFO:tasks.workunit.client.0.smithi123.stdout:3/492: write d0/dd/f38 [997871,3142] 0 2024-02-20T08:05:33.136 INFO:tasks.workunit.client.0.smithi123.stdout:4/481: dwrite d3/d18/d7d/d87/f9a [0,4194304] 0 2024-02-20T08:05:33.138 INFO:tasks.workunit.client.0.smithi123.stdout:3/493: read d0/f3f [1816216,52142] 0 2024-02-20T08:05:33.139 INFO:tasks.workunit.client.0.smithi123.stdout:5/409: rename d0/d34/d48/d56/d4c/d43/f87 to d0/d13/d27/d37/f8b 0 2024-02-20T08:05:33.141 INFO:tasks.workunit.client.0.smithi123.stdout:7/416: dwrite d0/d6/dd/d52/d26/d7b/f7e [0,4194304] 0 2024-02-20T08:05:33.150 INFO:tasks.workunit.client.0.smithi123.stdout:9/511: rename d6/d19/d1a/d6d/f99 to d6/d19/d1a/d2b/d28/d9a/d3d/fa7 0 2024-02-20T08:05:33.150 INFO:tasks.workunit.client.0.smithi123.stdout:1/490: dwrite d3/db/d34/f1b [0,4194304] 0 2024-02-20T08:05:33.150 INFO:tasks.workunit.client.0.smithi123.stdout:6/728: read d0/d3e/d92/d56/f99 [4038319,33172] 0 2024-02-20T08:05:33.151 INFO:tasks.workunit.client.0.smithi123.stdout:4/482: dwrite d3/d2c/f40 [0,4194304] 0 2024-02-20T08:05:33.152 INFO:tasks.workunit.client.0.smithi123.stdout:9/512: fsync d6/d19/f49 0 2024-02-20T08:05:33.155 INFO:tasks.workunit.client.0.smithi123.stdout:2/562: rename d1a/f1f to d1a/fb2 0 2024-02-20T08:05:33.159 INFO:tasks.workunit.client.0.smithi123.stdout:5/410: rename d0/d34/d48/d56/d25/l2b to d0/d13/d60/l8c 0 2024-02-20T08:05:33.168 INFO:tasks.workunit.client.0.smithi123.stdout:4/483: mknod d3/ca8 0 2024-02-20T08:05:33.172 INFO:tasks.workunit.client.0.smithi123.stdout:2/563: mknod d1a/d29/cb3 0 2024-02-20T08:05:33.174 INFO:tasks.workunit.client.0.smithi123.stdout:6/729: mkdir d0/d9f/df1 0 2024-02-20T08:05:33.175 INFO:tasks.workunit.client.0.smithi123.stdout:4/484: mkdir d3/d2c/d43/d26/d3e/da9 0 2024-02-20T08:05:33.177 INFO:tasks.workunit.client.0.smithi123.stdout:5/411: link d0/d34/d48/d56/d4c/f6b d0/f8d 0 2024-02-20T08:05:33.178 INFO:tasks.workunit.client.0.smithi123.stdout:7/417: getdents d0/db/d38/d47 0 2024-02-20T08:05:33.180 INFO:tasks.workunit.client.0.smithi123.stdout:7/418: truncate d0/d23/f4f 221800 0 2024-02-20T08:05:33.180 INFO:tasks.workunit.client.0.smithi123.stdout:2/564: mkdir d1a/d29/d5d/d8d/db4 0 2024-02-20T08:05:33.188 INFO:tasks.workunit.client.0.smithi123.stdout:2/565: dwrite d1a/f50 [0,4194304] 0 2024-02-20T08:05:33.190 INFO:tasks.workunit.client.0.smithi123.stdout:2/566: dread - d1a/d29/d42/fb1 zero size 2024-02-20T08:05:33.190 INFO:tasks.workunit.client.0.smithi123.stdout:6/730: dread d0/d3e/d92/d56/f71 [0,4194304] 0 2024-02-20T08:05:33.191 INFO:tasks.workunit.client.0.smithi123.stdout:5/412: creat d0/d34/d48/d56/d25/f8e x:0 0 0 2024-02-20T08:05:33.191 INFO:tasks.workunit.client.0.smithi123.stdout:2/567: chown d1a/f28 1233 1 2024-02-20T08:05:33.194 INFO:tasks.workunit.client.0.smithi123.stdout:7/419: dread d0/d6/dd/d52/f51 [0,4194304] 0 2024-02-20T08:05:33.194 INFO:tasks.workunit.client.0.smithi123.stdout:5/413: dread d0/f8d [0,4194304] 0 2024-02-20T08:05:33.195 INFO:tasks.workunit.client.0.smithi123.stdout:5/414: readlink d0/d34/d48/d4b/d51/l6c 0 2024-02-20T08:05:33.195 INFO:tasks.workunit.client.0.smithi123.stdout:4/485: mknod d3/d18/caa 0 2024-02-20T08:05:33.201 INFO:tasks.workunit.client.0.smithi123.stdout:2/568: creat d1a/d29/d5d/d97/fb5 x:0 0 0 2024-02-20T08:05:33.202 INFO:tasks.workunit.client.0.smithi123.stdout:9/513: truncate d6/d2a/d27/f54 2545013 0 2024-02-20T08:05:33.204 INFO:tasks.workunit.client.0.smithi123.stdout:9/514: write d6/d19/d1a/d2b/d28/d9a/f68 [613638,57954] 0 2024-02-20T08:05:33.205 INFO:tasks.workunit.client.0.smithi123.stdout:7/420: creat d0/db/d38/d47/d4a/d59/f90 x:0 0 0 2024-02-20T08:05:33.207 INFO:tasks.workunit.client.0.smithi123.stdout:4/486: rmdir d3/d18/d7d 39 2024-02-20T08:05:33.212 INFO:tasks.workunit.client.0.smithi123.stdout:2/569: creat d1a/d29/d42/d52/d98/fb6 x:0 0 0 2024-02-20T08:05:33.216 INFO:tasks.workunit.client.0.smithi123.stdout:6/731: dread d0/fe [0,4194304] 0 2024-02-20T08:05:33.219 INFO:tasks.workunit.client.0.smithi123.stdout:4/487: creat d3/d18/d63/fab x:0 0 0 2024-02-20T08:05:33.221 INFO:tasks.workunit.client.0.smithi123.stdout:5/415: creat d0/d34/d67/d80/d84/f8f x:0 0 0 2024-02-20T08:05:33.222 INFO:tasks.workunit.client.0.smithi123.stdout:6/732: dwrite d0/d3e/d40/f9b [0,4194304] 0 2024-02-20T08:05:33.222 INFO:tasks.workunit.client.0.smithi123.stdout:5/416: chown d0/d34/d48/d56/d3e/l47 0 1 2024-02-20T08:05:33.224 INFO:tasks.workunit.client.0.smithi123.stdout:6/733: write d0/d3e/d92/d56/d57/d91/fda [141830,22420] 0 2024-02-20T08:05:33.224 INFO:tasks.workunit.client.0.smithi123.stdout:2/570: symlink d1a/d29/d42/lb7 0 2024-02-20T08:05:33.228 INFO:tasks.workunit.client.0.smithi123.stdout:6/734: dread d0/d3e/d92/d56/f71 [0,4194304] 0 2024-02-20T08:05:33.229 INFO:tasks.workunit.client.0.smithi123.stdout:6/735: stat d0/d3e/d92/l43 0 2024-02-20T08:05:33.230 INFO:tasks.workunit.client.0.smithi123.stdout:4/488: dread - d3/d2c/f69 zero size 2024-02-20T08:05:33.232 INFO:tasks.workunit.client.0.smithi123.stdout:5/417: rename d0/f30 to d0/d34/d48/d56/d4c/d43/f90 0 2024-02-20T08:05:33.235 INFO:tasks.workunit.client.0.smithi123.stdout:9/515: creat d6/d19/d1a/d7c/fa8 x:0 0 0 2024-02-20T08:05:33.237 INFO:tasks.workunit.client.0.smithi123.stdout:9/516: chown d6/d19/d1a/d2b/d28/da0 244567 1 2024-02-20T08:05:33.238 INFO:tasks.workunit.client.0.smithi123.stdout:6/736: creat d0/d3e/d40/d48/d7b/ff2 x:0 0 0 2024-02-20T08:05:33.240 INFO:tasks.workunit.client.0.smithi123.stdout:5/418: dwrite d0/d13/d60/f7c [0,4194304] 0 2024-02-20T08:05:33.245 INFO:tasks.workunit.client.0.smithi123.stdout:4/489: truncate d3/d18/d7d/d87/f9a 5011296 0 2024-02-20T08:05:33.249 INFO:tasks.workunit.client.0.smithi123.stdout:6/737: dwrite d0/d3e/d92/d56/d57/d91/fda [0,4194304] 0 2024-02-20T08:05:33.254 INFO:tasks.workunit.client.0.smithi123.stdout:7/421: write d0/db/d38/f43 [919862,9600] 0 2024-02-20T08:05:33.264 INFO:tasks.workunit.client.0.smithi123.stdout:2/571: getdents d1a 0 2024-02-20T08:05:33.266 INFO:tasks.workunit.client.0.smithi123.stdout:7/422: fsync d0/db/d38/f4c 0 2024-02-20T08:05:33.266 INFO:tasks.workunit.client.0.smithi123.stdout:7/423: stat d0/d6/dd/d15 0 2024-02-20T08:05:33.268 INFO:tasks.workunit.client.0.smithi123.stdout:4/490: fdatasync d3/f4d 0 2024-02-20T08:05:33.272 INFO:tasks.workunit.client.0.smithi123.stdout:5/419: truncate d0/d13/d27/d4e/f52 3106520 0 2024-02-20T08:05:33.276 INFO:tasks.workunit.client.0.smithi123.stdout:2/572: creat d1a/d29/d42/d52/d98/da1/fb8 x:0 0 0 2024-02-20T08:05:33.278 INFO:tasks.workunit.client.0.smithi123.stdout:2/573: write d1a/d29/d42/d52/f7c [282107,119716] 0 2024-02-20T08:05:33.280 INFO:tasks.workunit.client.0.smithi123.stdout:0/583: sync 2024-02-20T08:05:33.282 INFO:tasks.workunit.client.0.smithi123.stdout:4/491: readlink d3/d2c/d43/l68 0 2024-02-20T08:05:33.286 INFO:tasks.workunit.client.0.smithi123.stdout:6/738: rename d0/d3e/d92/db3/fb7 to d0/d3e/d92/d56/ff3 0 2024-02-20T08:05:33.291 INFO:tasks.workunit.client.0.smithi123.stdout:2/574: mknod d1a/d29/d5d/d97/cb9 0 2024-02-20T08:05:33.294 INFO:tasks.workunit.client.0.smithi123.stdout:0/584: symlink d2/dd/d4f/lb9 0 2024-02-20T08:05:33.295 INFO:tasks.workunit.client.0.smithi123.stdout:4/492: mknod d3/d1e/cac 0 2024-02-20T08:05:33.299 INFO:tasks.workunit.client.0.smithi123.stdout:6/739: fsync d0/f29 0 2024-02-20T08:05:33.301 INFO:tasks.workunit.client.0.smithi123.stdout:9/517: write d6/d2a/d27/f54 [3008379,81116] 0 2024-02-20T08:05:33.303 INFO:tasks.workunit.client.0.smithi123.stdout:7/424: creat d0/d6/dd/d52/f91 x:0 0 0 2024-02-20T08:05:33.306 INFO:tasks.workunit.client.0.smithi123.stdout:4/493: creat d3/d2c/d5a/fad x:0 0 0 2024-02-20T08:05:33.317 INFO:tasks.workunit.client.0.smithi123.stdout:6/740: write d0/f51 [1147191,48974] 0 2024-02-20T08:05:33.319 INFO:tasks.workunit.client.0.smithi123.stdout:5/420: truncate d0/d34/d48/f64 3250321 0 2024-02-20T08:05:33.322 INFO:tasks.workunit.client.0.smithi123.stdout:7/425: creat d0/db/d21/d42/d5f/f92 x:0 0 0 2024-02-20T08:05:33.328 INFO:tasks.workunit.client.0.smithi123.stdout:5/421: mkdir d0/d13/d27/d4e/d91 0 2024-02-20T08:05:33.331 INFO:tasks.workunit.client.0.smithi123.stdout:0/585: getdents d2/dd/d4f/d7c/da4 0 2024-02-20T08:05:33.332 INFO:tasks.workunit.client.0.smithi123.stdout:0/586: chown d2/d3/d37/d5f/d8a 14 1 2024-02-20T08:05:33.335 INFO:tasks.workunit.client.0.smithi123.stdout:9/518: getdents d6/d2a/d27/d6f 0 2024-02-20T08:05:33.337 INFO:tasks.workunit.client.0.smithi123.stdout:5/422: rmdir d0/d34/d67 39 2024-02-20T08:05:33.342 INFO:tasks.workunit.client.0.smithi123.stdout:6/741: rmdir d0/d38/ded 0 2024-02-20T08:05:33.346 INFO:tasks.workunit.client.0.smithi123.stdout:5/423: creat d0/d13/d27/d37/f92 x:0 0 0 2024-02-20T08:05:33.346 INFO:tasks.workunit.client.0.smithi123.stdout:4/494: truncate d3/d2c/d43/d34/f3b 1010588 0 2024-02-20T08:05:33.347 INFO:tasks.workunit.client.0.smithi123.stdout:5/424: write d0/d34/d48/f53 [1653496,78250] 0 2024-02-20T08:05:33.350 INFO:tasks.workunit.client.0.smithi123.stdout:6/742: creat d0/d3e/d92/d56/d89/d73/ff4 x:0 0 0 2024-02-20T08:05:33.353 INFO:tasks.workunit.client.0.smithi123.stdout:5/425: dwrite d0/d13/d27/f7e [0,4194304] 0 2024-02-20T08:05:33.353 INFO:tasks.workunit.client.0.smithi123.stdout:7/426: write d0/f3d [165429,67367] 0 2024-02-20T08:05:33.357 INFO:tasks.workunit.client.0.smithi123.stdout:4/495: symlink d3/d18/d63/lae 0 2024-02-20T08:05:33.358 INFO:tasks.workunit.client.0.smithi123.stdout:4/496: chown d3/d2c/d43/l68 15879 1 2024-02-20T08:05:33.358 INFO:tasks.workunit.client.0.smithi123.stdout:6/743: read d0/f97 [3642020,2219] 0 2024-02-20T08:05:33.360 INFO:tasks.workunit.client.0.smithi123.stdout:6/744: truncate d0/d3e/d92/db3/fce 1673213 0 2024-02-20T08:05:33.364 INFO:tasks.workunit.client.0.smithi123.stdout:0/587: write d2/dd/d4f/fad [783662,34263] 0 2024-02-20T08:05:33.364 INFO:tasks.workunit.client.0.smithi123.stdout:5/426: mknod d0/d34/d48/d56/d4c/c93 0 2024-02-20T08:05:33.367 INFO:tasks.workunit.client.0.smithi123.stdout:7/427: rename d0/d6/l8 to d0/db/d38/d47/d4a/d59/l93 0 2024-02-20T08:05:33.371 INFO:tasks.workunit.client.0.smithi123.stdout:4/497: dread d3/d2c/d43/d26/fa5 [0,4194304] 0 2024-02-20T08:05:33.371 INFO:tasks.workunit.client.0.smithi123.stdout:9/519: getdents d6/d2a/d9d/d74 0 2024-02-20T08:05:33.372 INFO:tasks.workunit.client.0.smithi123.stdout:6/745: dwrite d0/d3e/d40/d7f/fac [0,4194304] 0 2024-02-20T08:05:33.413 INFO:tasks.workunit.client.0.smithi123.stdout:0/588: mknod d2/de/d1e/d1f/d5e/cba 0 2024-02-20T08:05:33.419 INFO:tasks.workunit.client.0.smithi123.stdout:0/589: dwrite d2/de/d1e/f85 [0,4194304] 0 2024-02-20T08:05:33.423 INFO:tasks.workunit.client.0.smithi123.stdout:7/428: dwrite d0/d6/d7/f16 [0,4194304] 0 2024-02-20T08:05:33.474 INFO:tasks.workunit.client.0.smithi123.stdout:8/511: sync 2024-02-20T08:05:33.480 INFO:tasks.workunit.client.0.smithi123.stdout:9/520: rmdir d6/d2a/d9d 39 2024-02-20T08:05:33.484 INFO:tasks.workunit.client.0.smithi123.stdout:8/512: dread d6/d32/d95/f38 [0,4194304] 0 2024-02-20T08:05:33.492 INFO:tasks.workunit.client.0.smithi123.stdout:7/429: rmdir d0/d6/dd/d52/d35 39 2024-02-20T08:05:33.508 INFO:tasks.workunit.client.0.smithi123.stdout:9/521: creat d6/d2a/fa9 x:0 0 0 2024-02-20T08:05:33.511 INFO:tasks.workunit.client.0.smithi123.stdout:8/513: getdents d6/d1c/d22/d4f/d5b/d8f/d98 0 2024-02-20T08:05:33.511 INFO:tasks.workunit.client.0.smithi123.stdout:1/491: sync 2024-02-20T08:05:33.511 INFO:tasks.workunit.client.0.smithi123.stdout:3/494: sync 2024-02-20T08:05:33.512 INFO:tasks.workunit.client.0.smithi123.stdout:1/492: read d3/db/d34/f1b [1822165,55047] 0 2024-02-20T08:05:33.513 INFO:tasks.workunit.client.0.smithi123.stdout:1/493: chown d3/db/d34/d74/d6f/d63 294934 1 2024-02-20T08:05:33.518 INFO:tasks.workunit.client.0.smithi123.stdout:3/495: dwrite d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:33.520 INFO:tasks.workunit.client.0.smithi123.stdout:1/494: creat d3/db/d7f/fb0 x:0 0 0 2024-02-20T08:05:33.555 INFO:tasks.workunit.client.0.smithi123.stdout:4/498: write d3/d2c/f5d [5027214,78395] 0 2024-02-20T08:05:33.559 INFO:tasks.workunit.client.0.smithi123.stdout:5/427: truncate d0/d13/d27/f7e 1340287 0 2024-02-20T08:05:33.561 INFO:tasks.workunit.client.0.smithi123.stdout:4/499: dwrite d3/d2c/f40 [4194304,4194304] 0 2024-02-20T08:05:33.562 INFO:tasks.workunit.client.0.smithi123.stdout:5/428: dread - d0/d34/d67/f7b zero size 2024-02-20T08:05:33.562 INFO:tasks.workunit.client.0.smithi123.stdout:4/500: chown d3/d18/d63/fab 46946 1 2024-02-20T08:05:33.563 INFO:tasks.workunit.client.0.smithi123.stdout:6/746: truncate d0/d3e/d92/d56/d57/d91/fe8 1882202 0 2024-02-20T08:05:33.565 INFO:tasks.workunit.client.0.smithi123.stdout:5/429: symlink d0/d13/d27/d4e/l94 0 2024-02-20T08:05:33.569 INFO:tasks.workunit.client.0.smithi123.stdout:6/747: rename d0/d3e/d92/d56/dae/cde to d0/d3e/d40/d90/d94/def/cf5 0 2024-02-20T08:05:33.570 INFO:tasks.workunit.client.0.smithi123.stdout:6/748: fsync d0/f29 0 2024-02-20T08:05:33.572 INFO:tasks.workunit.client.0.smithi123.stdout:5/430: dwrite d0/d34/d67/f71 [0,4194304] 0 2024-02-20T08:05:33.572 INFO:tasks.workunit.client.0.smithi123.stdout:4/501: symlink d3/d2c/d43/d26/d3e/da9/laf 0 2024-02-20T08:05:33.574 INFO:tasks.workunit.client.0.smithi123.stdout:4/502: readlink d3/d2c/d43/d26/d2e/l6f 0 2024-02-20T08:05:33.575 INFO:tasks.workunit.client.0.smithi123.stdout:4/503: readlink d3/d18/d7d/la2 0 2024-02-20T08:05:33.581 INFO:tasks.workunit.client.0.smithi123.stdout:7/430: dwrite d0/db/d21/d42/d5f/f2b [4194304,4194304] 0 2024-02-20T08:05:33.583 INFO:tasks.workunit.client.0.smithi123.stdout:4/504: symlink d3/d2c/d43/d26/d2e/lb0 0 2024-02-20T08:05:33.588 INFO:tasks.workunit.client.0.smithi123.stdout:7/431: creat d0/db/d21/d42/f94 x:0 0 0 2024-02-20T08:05:33.590 INFO:tasks.workunit.client.0.smithi123.stdout:7/432: readlink d0/db/d38/d47/d4a/l77 0 2024-02-20T08:05:33.591 INFO:tasks.workunit.client.0.smithi123.stdout:4/505: mknod d3/d2c/d43/d26/cb1 0 2024-02-20T08:05:33.591 INFO:tasks.workunit.client.0.smithi123.stdout:7/433: write d0/f64 [1982744,20187] 0 2024-02-20T08:05:33.595 INFO:tasks.workunit.client.0.smithi123.stdout:8/514: dwrite d6/d1c/d22/d4f/f56 [0,4194304] 0 2024-02-20T08:05:33.597 INFO:tasks.workunit.client.0.smithi123.stdout:7/434: unlink d0/d6/d7/d68/l87 0 2024-02-20T08:05:33.602 INFO:tasks.workunit.client.0.smithi123.stdout:7/435: mknod d0/d6/dd/d52/d26/d7b/c95 0 2024-02-20T08:05:33.604 INFO:tasks.workunit.client.0.smithi123.stdout:1/495: write d3/db/f4e [1359985,34778] 0 2024-02-20T08:05:33.605 INFO:tasks.workunit.client.0.smithi123.stdout:1/496: stat d3/db/d7f 0 2024-02-20T08:05:33.606 INFO:tasks.workunit.client.0.smithi123.stdout:8/515: creat d6/d1c/d22/d4f/d5b/d93/faa x:0 0 0 2024-02-20T08:05:33.608 INFO:tasks.workunit.client.0.smithi123.stdout:7/436: creat d0/d6/dd/f96 x:0 0 0 2024-02-20T08:05:33.609 INFO:tasks.workunit.client.0.smithi123.stdout:3/496: dwrite d0/d6/d1a/d1b/d1c/f3c [0,4194304] 0 2024-02-20T08:05:33.610 INFO:tasks.workunit.client.0.smithi123.stdout:7/437: readlink d0/db/d38/d47/d4a/l77 0 2024-02-20T08:05:33.611 INFO:tasks.workunit.client.0.smithi123.stdout:1/497: unlink d3/l86 0 2024-02-20T08:05:33.620 INFO:tasks.workunit.client.0.smithi123.stdout:3/497: dwrite d0/dd/d48/d6a/f85 [0,4194304] 0 2024-02-20T08:05:33.620 INFO:tasks.workunit.client.0.smithi123.stdout:3/498: fsync d0/f8c 0 2024-02-20T08:05:33.620 INFO:tasks.workunit.client.0.smithi123.stdout:7/438: mkdir d0/d6/dd/d97 0 2024-02-20T08:05:33.621 INFO:tasks.workunit.client.0.smithi123.stdout:1/498: dwrite d3/de/f13 [0,4194304] 0 2024-02-20T08:05:33.628 INFO:tasks.workunit.client.0.smithi123.stdout:1/499: chown d3/de/d14/d36/f78 11 1 2024-02-20T08:05:33.631 INFO:tasks.workunit.client.0.smithi123.stdout:7/439: symlink d0/d6/d29/l98 0 2024-02-20T08:05:33.631 INFO:tasks.workunit.client.0.smithi123.stdout:7/440: chown d0/d23/f4f 7301 1 2024-02-20T08:05:33.632 INFO:tasks.workunit.client.0.smithi123.stdout:3/499: mkdir d0/d6/d1a/d1b/db4 0 2024-02-20T08:05:33.636 INFO:tasks.workunit.client.0.smithi123.stdout:7/441: mknod d0/d6/d7/d68/c99 0 2024-02-20T08:05:33.637 INFO:tasks.workunit.client.0.smithi123.stdout:3/500: fdatasync d0/d6/d1a/d1b/d1c/d21/f3e 0 2024-02-20T08:05:33.639 INFO:tasks.workunit.client.0.smithi123.stdout:4/506: creat d3/d2c/fb2 x:0 0 0 2024-02-20T08:05:33.640 INFO:tasks.workunit.client.0.smithi123.stdout:7/442: mkdir d0/d6/dd/d15/d9a 0 2024-02-20T08:05:33.643 INFO:tasks.workunit.client.0.smithi123.stdout:3/501: creat d0/d6/d1a/d4b/fb5 x:0 0 0 2024-02-20T08:05:33.650 INFO:tasks.workunit.client.0.smithi123.stdout:0/590: creat d2/dd/fbb x:0 0 0 2024-02-20T08:05:33.662 INFO:tasks.workunit.client.0.smithi123.stdout:1/500: dread d3/db/d34/d74/f11 [0,4194304] 0 2024-02-20T08:05:33.663 INFO:tasks.workunit.client.0.smithi123.stdout:5/431: truncate d0/d13/f81 2262602 0 2024-02-20T08:05:33.665 INFO:tasks.workunit.client.0.smithi123.stdout:3/502: dread d0/d6/d1a/d1b/f30 [0,4194304] 0 2024-02-20T08:05:33.666 INFO:tasks.workunit.client.0.smithi123.stdout:2/575: sync 2024-02-20T08:05:33.666 INFO:tasks.workunit.client.0.smithi123.stdout:3/503: chown d0/d6/d1a/d1b/d1c/d3b/l47 1065810 1 2024-02-20T08:05:33.669 INFO:tasks.workunit.client.0.smithi123.stdout:1/501: creat d3/db/fb1 x:0 0 0 2024-02-20T08:05:33.670 INFO:tasks.workunit.client.0.smithi123.stdout:1/502: chown d3/db/d34/l22 7445620 1 2024-02-20T08:05:33.671 INFO:tasks.workunit.client.0.smithi123.stdout:2/576: mknod d1a/cba 0 2024-02-20T08:05:33.674 INFO:tasks.workunit.client.0.smithi123.stdout:1/503: fsync d3/de/d14/d36/f78 0 2024-02-20T08:05:33.678 INFO:tasks.workunit.client.0.smithi123.stdout:3/504: truncate d0/f3f 2413459 0 2024-02-20T08:05:33.678 INFO:tasks.workunit.client.0.smithi123.stdout:3/505: readlink d0/d6/d1a/d1b/d2a/d86/l91 0 2024-02-20T08:05:33.680 INFO:tasks.workunit.client.0.smithi123.stdout:8/516: rename d6/d1c/d22/d4f/d5b/d93 to d6/d32/d95/d7d/dab 0 2024-02-20T08:05:33.680 INFO:tasks.workunit.client.0.smithi123.stdout:3/506: chown d0/d6/d1a/d1b/d1c/d21/fa7 29713111 1 2024-02-20T08:05:33.680 INFO:tasks.workunit.client.0.smithi123.stdout:6/749: symlink d0/d3e/d92/d56/d89/lf6 0 2024-02-20T08:05:33.685 INFO:tasks.workunit.client.0.smithi123.stdout:3/507: creat d0/d6/d1a/d1b/d1c/d20/fb6 x:0 0 0 2024-02-20T08:05:33.689 INFO:tasks.workunit.client.0.smithi123.stdout:8/517: dwrite d6/d32/d95/f38 [0,4194304] 0 2024-02-20T08:05:33.690 INFO:tasks.workunit.client.0.smithi123.stdout:3/508: creat d0/d6/d1a/d1b/d1c/fb7 x:0 0 0 2024-02-20T08:05:33.697 INFO:tasks.workunit.client.0.smithi123.stdout:6/750: dread d0/d3e/d40/d48/d79/f7a [0,4194304] 0 2024-02-20T08:05:33.699 INFO:tasks.workunit.client.0.smithi123.stdout:6/751: chown d0/d3e/d40/d48/d7b/fe0 2002010 1 2024-02-20T08:05:33.701 INFO:tasks.workunit.client.0.smithi123.stdout:6/752: symlink d0/d3e/d92/d56/dae/lf7 0 2024-02-20T08:05:33.704 INFO:tasks.workunit.client.0.smithi123.stdout:6/753: rmdir d0/d9f 39 2024-02-20T08:05:33.708 INFO:tasks.workunit.client.0.smithi123.stdout:6/754: creat d0/d3e/d40/d48/d7b/de9/ff8 x:0 0 0 2024-02-20T08:05:33.708 INFO:tasks.workunit.client.0.smithi123.stdout:4/507: write d3/d1e/f60 [996674,27553] 0 2024-02-20T08:05:33.709 INFO:tasks.workunit.client.0.smithi123.stdout:7/443: write d0/db/d21/d42/d1d/f36 [1613943,129036] 0 2024-02-20T08:05:33.710 INFO:tasks.workunit.client.0.smithi123.stdout:9/522: sync 2024-02-20T08:05:33.711 INFO:tasks.workunit.client.0.smithi123.stdout:6/755: symlink d0/d3e/d40/d90/lf9 0 2024-02-20T08:05:33.712 INFO:tasks.workunit.client.0.smithi123.stdout:4/508: mknod d3/d97/cb3 0 2024-02-20T08:05:33.712 INFO:tasks.workunit.client.0.smithi123.stdout:6/756: read d0/d38/f3a [176603,93184] 0 2024-02-20T08:05:33.713 INFO:tasks.workunit.client.0.smithi123.stdout:8/518: dread d6/fb [0,4194304] 0 2024-02-20T08:05:33.714 INFO:tasks.workunit.client.0.smithi123.stdout:4/509: write d3/d18/d63/d88/f9e [597442,75360] 0 2024-02-20T08:05:33.715 INFO:tasks.workunit.client.0.smithi123.stdout:7/444: chown d0/db/d38/d47/d4a/d59/l93 7042341 1 2024-02-20T08:05:33.715 INFO:tasks.workunit.client.0.smithi123.stdout:4/510: chown d3/d2c/d5a/fad 194859982 1 2024-02-20T08:05:33.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/523: mknod d6/d2a/d27/d3c/caa 0 2024-02-20T08:05:33.719 INFO:tasks.workunit.client.0.smithi123.stdout:9/524: write d6/d2a/d27/f2f [108189,14635] 0 2024-02-20T08:05:33.719 INFO:tasks.workunit.client.0.smithi123.stdout:8/519: symlink d6/d1c/d47/lac 0 2024-02-20T08:05:33.722 INFO:tasks.workunit.client.0.smithi123.stdout:0/591: dwrite d2/dd/d4f/d6a/f70 [0,4194304] 0 2024-02-20T08:05:33.724 INFO:tasks.workunit.client.0.smithi123.stdout:0/592: stat d2/dd/d4f/d7c/cab 0 2024-02-20T08:05:33.727 INFO:tasks.workunit.client.0.smithi123.stdout:4/511: creat d3/d2c/d43/d26/d2e/fb4 x:0 0 0 2024-02-20T08:05:33.729 INFO:tasks.workunit.client.0.smithi123.stdout:5/432: truncate d0/d13/f50 1824762 0 2024-02-20T08:05:33.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/525: dwrite d6/d19/d1a/d7f/f5d [0,4194304] 0 2024-02-20T08:05:33.730 INFO:tasks.workunit.client.0.smithi123.stdout:5/433: chown d0/d13/d27/d37/c74 2 1 2024-02-20T08:05:33.737 INFO:tasks.workunit.client.0.smithi123.stdout:6/757: creat d0/d3e/d92/d56/ffa x:0 0 0 2024-02-20T08:05:33.742 INFO:tasks.workunit.client.0.smithi123.stdout:4/512: readlink d3/d2c/d43/l57 0 2024-02-20T08:05:33.745 INFO:tasks.workunit.client.0.smithi123.stdout:5/434: symlink d0/d13/d27/d37/l95 0 2024-02-20T08:05:33.750 INFO:tasks.workunit.client.0.smithi123.stdout:4/513: dread d3/d18/f1c [0,4194304] 0 2024-02-20T08:05:33.751 INFO:tasks.workunit.client.0.smithi123.stdout:1/504: dwrite d3/de/f60 [0,4194304] 0 2024-02-20T08:05:33.753 INFO:tasks.workunit.client.0.smithi123.stdout:3/509: write d0/d6/d32/f33 [367071,23179] 0 2024-02-20T08:05:33.760 INFO:tasks.workunit.client.0.smithi123.stdout:5/435: dwrite d0/d34/d48/d56/d25/f31 [0,4194304] 0 2024-02-20T08:05:33.764 INFO:tasks.workunit.client.0.smithi123.stdout:7/445: rename d0/d6/dd/d15 to d0/d6/dd/d52/d26/d9b 0 2024-02-20T08:05:33.766 INFO:tasks.workunit.client.0.smithi123.stdout:2/577: mkdir d1a/d29/d42/dbb 0 2024-02-20T08:05:33.769 INFO:tasks.workunit.client.0.smithi123.stdout:4/514: rmdir d3/d2c/d5a/d7e 39 2024-02-20T08:05:33.771 INFO:tasks.workunit.client.0.smithi123.stdout:8/520: rmdir d6/d90 0 2024-02-20T08:05:33.774 INFO:tasks.workunit.client.0.smithi123.stdout:0/593: link d2/f12 d2/dd/d4f/d7c/da4/dae/fbc 0 2024-02-20T08:05:33.780 INFO:tasks.workunit.client.0.smithi123.stdout:9/526: creat d6/d2a/d27/fab x:0 0 0 2024-02-20T08:05:33.781 INFO:tasks.workunit.client.0.smithi123.stdout:9/527: write d6/d2a/d27/f2f [962412,56135] 0 2024-02-20T08:05:33.781 INFO:tasks.workunit.client.0.smithi123.stdout:2/578: fdatasync d1a/f28 0 2024-02-20T08:05:33.784 INFO:tasks.workunit.client.0.smithi123.stdout:4/515: dread - d3/d2c/d43/f84 zero size 2024-02-20T08:05:33.785 INFO:tasks.workunit.client.0.smithi123.stdout:8/521: mknod d6/d32/d95/cad 0 2024-02-20T08:05:33.786 INFO:tasks.workunit.client.0.smithi123.stdout:6/758: creat d0/d3e/ffb x:0 0 0 2024-02-20T08:05:33.793 INFO:tasks.workunit.client.0.smithi123.stdout:7/446: dread d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:33.797 INFO:tasks.workunit.client.0.smithi123.stdout:9/528: creat d6/d19/d1a/d6d/d7e/fac x:0 0 0 2024-02-20T08:05:33.800 INFO:tasks.workunit.client.0.smithi123.stdout:4/516: creat d3/d2c/d43/d26/d3e/da9/fb5 x:0 0 0 2024-02-20T08:05:33.801 INFO:tasks.workunit.client.0.smithi123.stdout:2/579: dread d1a/d29/d39/f65 [0,4194304] 0 2024-02-20T08:05:33.801 INFO:tasks.workunit.client.0.smithi123.stdout:8/522: creat d6/d32/fae x:0 0 0 2024-02-20T08:05:33.801 INFO:tasks.workunit.client.0.smithi123.stdout:7/447: dwrite d0/db/d38/f43 [0,4194304] 0 2024-02-20T08:05:33.806 INFO:tasks.workunit.client.0.smithi123.stdout:6/759: unlink d0/d3e/d40/d48/d4a/l4c 0 2024-02-20T08:05:33.806 INFO:tasks.workunit.client.0.smithi123.stdout:6/760: fdatasync d0/d3e/d40/d48/d7b/fa9 0 2024-02-20T08:05:33.807 INFO:tasks.workunit.client.0.smithi123.stdout:0/594: creat d2/dd/d4f/d7c/da4/dae/fbd x:0 0 0 2024-02-20T08:05:33.808 INFO:tasks.workunit.client.0.smithi123.stdout:6/761: write d0/d3e/d40/d90/d94/fa3 [67782,126065] 0 2024-02-20T08:05:33.810 INFO:tasks.workunit.client.0.smithi123.stdout:3/510: link d0/d6/d1a/d1b/d1c/d3b/l47 d0/dd/lb8 0 2024-02-20T08:05:33.816 INFO:tasks.workunit.client.0.smithi123.stdout:9/529: mknod d6/d19/d1a/d2b/d28/d9a/cad 0 2024-02-20T08:05:33.817 INFO:tasks.workunit.client.0.smithi123.stdout:2/580: mkdir d1a/d29/d42/d4e/dbc 0 2024-02-20T08:05:33.818 INFO:tasks.workunit.client.0.smithi123.stdout:6/762: dwrite d0/d3e/d92/d56/d89/d73/d75/fd8 [0,4194304] 0 2024-02-20T08:05:33.822 INFO:tasks.workunit.client.0.smithi123.stdout:3/511: dwrite d0/d6/d1a/d1b/d1c/d61/f96 [0,4194304] 0 2024-02-20T08:05:33.823 INFO:tasks.workunit.client.0.smithi123.stdout:4/517: rename d3/d18/d63/d88 to d3/d18/d6c/db6 0 2024-02-20T08:05:33.825 INFO:tasks.workunit.client.0.smithi123.stdout:0/595: symlink d2/dd/d4f/d61/d68/lbe 0 2024-02-20T08:05:33.826 INFO:tasks.workunit.client.0.smithi123.stdout:3/512: truncate d0/d6/d1a/d1b/d1c/f25 4403123 0 2024-02-20T08:05:33.827 INFO:tasks.workunit.client.0.smithi123.stdout:3/513: stat d0/d6/d1a/d62 0 2024-02-20T08:05:33.830 INFO:tasks.workunit.client.0.smithi123.stdout:5/436: write d0/d34/d48/d56/d4c/d43/f90 [3192677,11690] 0 2024-02-20T08:05:33.833 INFO:tasks.workunit.client.0.smithi123.stdout:2/581: creat d1a/d29/d42/fbd x:0 0 0 2024-02-20T08:05:33.834 INFO:tasks.workunit.client.0.smithi123.stdout:6/763: creat d0/d3e/d40/d90/d94/ffc x:0 0 0 2024-02-20T08:05:33.835 INFO:tasks.workunit.client.0.smithi123.stdout:7/448: rename d0/db/d21/d42/d1d to d0/d6/dd/d52/d35/d9c 0 2024-02-20T08:05:33.837 INFO:tasks.workunit.client.0.smithi123.stdout:7/449: dread - d0/d6/dd/d52/d35/f74 zero size 2024-02-20T08:05:33.839 INFO:tasks.workunit.client.0.smithi123.stdout:0/596: creat d2/de/d1e/d1f/fbf x:0 0 0 2024-02-20T08:05:33.840 INFO:tasks.workunit.client.0.smithi123.stdout:7/450: read - d0/db/d21/d42/f94 zero size 2024-02-20T08:05:33.840 INFO:tasks.workunit.client.0.smithi123.stdout:3/514: truncate d0/dd/d48/f71 5475239 0 2024-02-20T08:05:33.841 INFO:tasks.workunit.client.0.smithi123.stdout:8/523: dread d6/d1c/d22/f6b [0,4194304] 0 2024-02-20T08:05:33.842 INFO:tasks.workunit.client.0.smithi123.stdout:5/437: creat d0/d34/d48/f96 x:0 0 0 2024-02-20T08:05:33.844 INFO:tasks.workunit.client.0.smithi123.stdout:3/515: stat d0/d6/d1a/d1b/d1c/d20 0 2024-02-20T08:05:33.845 INFO:tasks.workunit.client.0.smithi123.stdout:8/524: chown d6/d32/d95/d3f/c4e 314372169 1 2024-02-20T08:05:33.845 INFO:tasks.workunit.client.0.smithi123.stdout:4/518: dwrite d3/d2c/d43/d34/f93 [0,4194304] 0 2024-02-20T08:05:33.848 INFO:tasks.workunit.client.0.smithi123.stdout:2/582: dread d1a/f1e [4194304,4194304] 0 2024-02-20T08:05:33.848 INFO:tasks.workunit.client.0.smithi123.stdout:4/519: truncate d3/d2c/d43/d26/f8e 743904 0 2024-02-20T08:05:33.850 INFO:tasks.workunit.client.0.smithi123.stdout:4/520: write d3/d2c/d43/d34/f37 [1083971,100382] 0 2024-02-20T08:05:33.850 INFO:tasks.workunit.client.0.smithi123.stdout:9/530: rename d6/d19/d1a/d6d/d7e/d80/da4 to d6/d19/d1a/d2b/d28/d9a/dae 0 2024-02-20T08:05:33.856 INFO:tasks.workunit.client.0.smithi123.stdout:5/438: mknod d0/d34/d67/c97 0 2024-02-20T08:05:33.857 INFO:tasks.workunit.client.0.smithi123.stdout:7/451: dread d0/f30 [0,4194304] 0 2024-02-20T08:05:33.858 INFO:tasks.workunit.client.0.smithi123.stdout:8/525: rmdir d6/d32 39 2024-02-20T08:05:33.860 INFO:tasks.workunit.client.0.smithi123.stdout:6/764: symlink d0/d3e/lfd 0 2024-02-20T08:05:33.861 INFO:tasks.workunit.client.0.smithi123.stdout:2/583: symlink d1a/d29/d42/d4e/lbe 0 2024-02-20T08:05:33.865 INFO:tasks.workunit.client.0.smithi123.stdout:9/531: mknod d6/d19/d1a/d6d/caf 0 2024-02-20T08:05:33.866 INFO:tasks.workunit.client.0.smithi123.stdout:0/597: rmdir d2/de 39 2024-02-20T08:05:33.869 INFO:tasks.workunit.client.0.smithi123.stdout:3/516: mkdir d0/db9 0 2024-02-20T08:05:33.870 INFO:tasks.workunit.client.0.smithi123.stdout:5/439: read d0/d13/f1b [648419,43642] 0 2024-02-20T08:05:33.871 INFO:tasks.workunit.client.0.smithi123.stdout:5/440: read - d0/d34/d48/d56/d25/f5f zero size 2024-02-20T08:05:33.872 INFO:tasks.workunit.client.0.smithi123.stdout:7/452: truncate d0/d6/d7/f20 1403405 0 2024-02-20T08:05:33.873 INFO:tasks.workunit.client.0.smithi123.stdout:8/526: creat d6/d1c/d22/d4f/d5b/d8f/faf x:0 0 0 2024-02-20T08:05:33.874 INFO:tasks.workunit.client.0.smithi123.stdout:6/765: mknod d0/d3e/d40/d48/d7b/de9/cfe 0 2024-02-20T08:05:33.876 INFO:tasks.workunit.client.0.smithi123.stdout:7/453: dread d0/db/d38/f43 [0,4194304] 0 2024-02-20T08:05:33.878 INFO:tasks.workunit.client.0.smithi123.stdout:2/584: rmdir d1a/d29/d39 39 2024-02-20T08:05:33.881 INFO:tasks.workunit.client.0.smithi123.stdout:9/532: write d6/d19/d1a/d2b/d28/f64 [441021,35876] 0 2024-02-20T08:05:33.882 INFO:tasks.workunit.client.0.smithi123.stdout:3/517: dread d0/d6/d1a/d1b/d9d/f6d [0,4194304] 0 2024-02-20T08:05:33.887 INFO:tasks.workunit.client.0.smithi123.stdout:5/441: write d0/d34/d48/d56/d25/f2a [220673,87345] 0 2024-02-20T08:05:33.892 INFO:tasks.workunit.client.0.smithi123.stdout:7/454: mkdir d0/d6/d9d 0 2024-02-20T08:05:33.896 INFO:tasks.workunit.client.0.smithi123.stdout:4/521: creat d3/fb7 x:0 0 0 2024-02-20T08:05:33.897 INFO:tasks.workunit.client.0.smithi123.stdout:4/522: readlink d3/d2c/d43/d26/d2e/l66 0 2024-02-20T08:05:33.900 INFO:tasks.workunit.client.0.smithi123.stdout:9/533: mkdir d6/d19/d1a/d2b/d28/d9a/d3d/db0 0 2024-02-20T08:05:33.903 INFO:tasks.workunit.client.0.smithi123.stdout:3/518: rmdir d0/d6/d1a/d1b/d1c/d3b 39 2024-02-20T08:05:33.905 INFO:tasks.workunit.client.0.smithi123.stdout:9/534: dwrite d6/d19/f44 [0,4194304] 0 2024-02-20T08:05:33.909 INFO:tasks.workunit.client.0.smithi123.stdout:8/527: mkdir d6/d32/d95/db0 0 2024-02-20T08:05:33.911 INFO:tasks.workunit.client.0.smithi123.stdout:7/455: mknod d0/d6/dd/c9e 0 2024-02-20T08:05:33.914 INFO:tasks.workunit.client.0.smithi123.stdout:0/598: mkdir d2/de/d1e/d1f/dc0 0 2024-02-20T08:05:33.916 INFO:tasks.workunit.client.0.smithi123.stdout:7/456: dwrite d0/d6/f31 [0,4194304] 0 2024-02-20T08:05:33.918 INFO:tasks.workunit.client.0.smithi123.stdout:7/457: dread - d0/db/d21/d42/d5f/f92 zero size 2024-02-20T08:05:33.918 INFO:tasks.workunit.client.0.smithi123.stdout:9/535: mknod d6/d19/d1a/d6d/d7e/cb1 0 2024-02-20T08:05:33.919 INFO:tasks.workunit.client.0.smithi123.stdout:9/536: fdatasync d6/d19/d1a/d2b/d28/f64 0 2024-02-20T08:05:33.985 INFO:tasks.workunit.client.0.smithi123.stdout:5/442: rename d0/d13/d27/c2e to d0/d34/d48/d4b/c98 0 2024-02-20T08:05:33.986 INFO:tasks.workunit.client.0.smithi123.stdout:6/766: creat d0/d9f/df1/fff x:0 0 0 2024-02-20T08:05:33.987 INFO:tasks.workunit.client.0.smithi123.stdout:5/443: chown d0/d13/d60 894 1 2024-02-20T08:05:33.989 INFO:tasks.workunit.client.0.smithi123.stdout:5/444: readlink d0/d13/d27/d37/l95 0 2024-02-20T08:05:33.991 INFO:tasks.workunit.client.0.smithi123.stdout:4/523: rename d3/d18/f1c to d3/d2c/d43/d26/d2e/fb8 0 2024-02-20T08:05:33.995 INFO:tasks.workunit.client.0.smithi123.stdout:2/585: dwrite d1a/d29/d42/d4e/f8c [0,4194304] 0 2024-02-20T08:05:33.997 INFO:tasks.workunit.client.0.smithi123.stdout:3/519: dwrite d0/d6/d1a/d1b/d1c/d21/d8e/f9a [0,4194304] 0 2024-02-20T08:05:33.999 INFO:tasks.workunit.client.0.smithi123.stdout:7/458: link d0/d6/dd/f65 d0/d6/dd/d52/d26/d9b/d61/f9f 0 2024-02-20T08:05:34.004 INFO:tasks.workunit.client.0.smithi123.stdout:4/524: dwrite d3/d2c/d43/d26/f8e [0,4194304] 0 2024-02-20T08:05:34.011 INFO:tasks.workunit.client.0.smithi123.stdout:6/767: dread d0/d3e/d92/d56/d57/f6b [0,4194304] 0 2024-02-20T08:05:34.012 INFO:tasks.workunit.client.0.smithi123.stdout:2/586: mknod d1a/d29/d42/d73/d8f/cbf 0 2024-02-20T08:05:34.014 INFO:tasks.workunit.client.0.smithi123.stdout:7/459: fsync d0/d6/d29/f46 0 2024-02-20T08:05:34.016 INFO:tasks.workunit.client.0.smithi123.stdout:3/520: mknod d0/d6/d1a/d1b/d1c/d21/d8e/cba 0 2024-02-20T08:05:34.019 INFO:tasks.workunit.client.0.smithi123.stdout:9/537: rmdir d6/d19/d1a/d2b/d91 0 2024-02-20T08:05:34.020 INFO:tasks.workunit.client.0.smithi123.stdout:6/768: mkdir d0/d3e/d40/d48/d79/d100 0 2024-02-20T08:05:34.022 INFO:tasks.workunit.client.0.smithi123.stdout:6/769: chown d0/d3e/d40/d48/d79/l9a 248368116 1 2024-02-20T08:05:34.023 INFO:tasks.workunit.client.0.smithi123.stdout:2/587: creat d1a/d29/d42/d52/d98/fc0 x:0 0 0 2024-02-20T08:05:34.023 INFO:tasks.workunit.client.0.smithi123.stdout:6/770: truncate d0/d3e/ffb 980124 0 2024-02-20T08:05:34.030 INFO:tasks.workunit.client.0.smithi123.stdout:7/460: symlink d0/db/d21/la0 0 2024-02-20T08:05:34.033 INFO:tasks.workunit.client.0.smithi123.stdout:4/525: link d3/d2c/l56 d3/d18/d7d/d87/lb9 0 2024-02-20T08:05:34.035 INFO:tasks.workunit.client.0.smithi123.stdout:6/771: dwrite d0/d3e/d92/d56/ff3 [0,4194304] 0 2024-02-20T08:05:34.039 INFO:tasks.workunit.client.0.smithi123.stdout:7/461: rename d0/d6/d29/f46 to d0/db/fa1 0 2024-02-20T08:05:34.043 INFO:tasks.workunit.client.0.smithi123.stdout:4/526: dwrite d3/d1e/f7b [0,4194304] 0 2024-02-20T08:05:34.045 INFO:tasks.workunit.client.0.smithi123.stdout:6/772: rmdir d0/d3e/d40/d90/d94/def 39 2024-02-20T08:05:34.045 INFO:tasks.workunit.client.0.smithi123.stdout:9/538: dread d6/d19/d1a/d2b/d28/d9a/f70 [0,4194304] 0 2024-02-20T08:05:34.049 INFO:tasks.workunit.client.0.smithi123.stdout:6/773: write d0/d3e/d40/d7f/fac [372958,64194] 0 2024-02-20T08:05:34.050 INFO:tasks.workunit.client.0.smithi123.stdout:7/462: mkdir d0/db/d21/d42/d5f/da2 0 2024-02-20T08:05:34.052 INFO:tasks.workunit.client.0.smithi123.stdout:0/599: dwrite d2/dd/f41 [0,4194304] 0 2024-02-20T08:05:34.057 INFO:tasks.workunit.client.0.smithi123.stdout:6/774: chown d0/d3e/d40/d48/daa/ddf/fd6 8444 1 2024-02-20T08:05:34.059 INFO:tasks.workunit.client.0.smithi123.stdout:4/527: dwrite d3/d18/d63/fab [0,4194304] 0 2024-02-20T08:05:34.061 INFO:tasks.workunit.client.0.smithi123.stdout:5/445: dwrite d0/d34/d48/d56/d4c/f6b [0,4194304] 0 2024-02-20T08:05:34.062 INFO:tasks.workunit.client.0.smithi123.stdout:6/775: write d0/d3e/d40/d90/fe2 [621870,6288] 0 2024-02-20T08:05:34.069 INFO:tasks.workunit.client.0.smithi123.stdout:4/528: rmdir d3/d2c/d43/d26/d3e 39 2024-02-20T08:05:34.074 INFO:tasks.workunit.client.0.smithi123.stdout:6/776: mkdir d0/d3e/d92/d56/d57/d91/d101 0 2024-02-20T08:05:34.077 INFO:tasks.workunit.client.0.smithi123.stdout:9/539: rename d6/d19/d1a/d2b/d28/d9a/d3d/d32/l63 to d6/d19/d1a/d7c/lb2 0 2024-02-20T08:05:34.079 INFO:tasks.workunit.client.0.smithi123.stdout:3/521: dwrite d0/f24 [0,4194304] 0 2024-02-20T08:05:34.079 INFO:tasks.workunit.client.0.smithi123.stdout:7/463: fsync d0/db/fa1 0 2024-02-20T08:05:34.081 INFO:tasks.workunit.client.0.smithi123.stdout:4/529: mknod d3/d18/d6c/db6/cba 0 2024-02-20T08:05:34.085 INFO:tasks.workunit.client.0.smithi123.stdout:7/464: write d0/d6/dd/d52/d26/d7b/f7e [1848335,71992] 0 2024-02-20T08:05:34.089 INFO:tasks.workunit.client.0.smithi123.stdout:9/540: dwrite d6/d19/d1a/d2b/d28/d9a/f7b [0,4194304] 0 2024-02-20T08:05:34.091 INFO:tasks.workunit.client.0.smithi123.stdout:3/522: symlink d0/d6/d1a/d1b/d1c/d21/d8e/lbb 0 2024-02-20T08:05:34.091 INFO:tasks.workunit.client.0.smithi123.stdout:9/541: write d6/d19/d1a/d2b/d28/d9a/f26 [3957484,30556] 0 2024-02-20T08:05:34.093 INFO:tasks.workunit.client.0.smithi123.stdout:3/523: fsync d0/d6/d1a/d1b/f83 0 2024-02-20T08:05:34.096 INFO:tasks.workunit.client.0.smithi123.stdout:7/465: creat d0/db/d38/d47/fa3 x:0 0 0 2024-02-20T08:05:34.098 INFO:tasks.workunit.client.0.smithi123.stdout:4/530: creat d3/d2c/d43/d26/d3e/da9/fbb x:0 0 0 2024-02-20T08:05:34.099 INFO:tasks.workunit.client.0.smithi123.stdout:0/600: write d2/d3/f24 [4090583,127374] 0 2024-02-20T08:05:34.103 INFO:tasks.workunit.client.0.smithi123.stdout:9/542: chown d6/d19/d1a/d2b/l69 5551 1 2024-02-20T08:05:34.104 INFO:tasks.workunit.client.0.smithi123.stdout:3/524: dwrite d0/d6/d34/fad [0,4194304] 0 2024-02-20T08:05:34.106 INFO:tasks.workunit.client.0.smithi123.stdout:6/777: dread d0/d5c/fca [4194304,4194304] 0 2024-02-20T08:05:34.110 INFO:tasks.workunit.client.0.smithi123.stdout:5/446: dwrite d0/d13/f1b [0,4194304] 0 2024-02-20T08:05:34.112 INFO:tasks.workunit.client.0.smithi123.stdout:0/601: creat d2/de/fc1 x:0 0 0 2024-02-20T08:05:34.113 INFO:tasks.workunit.client.0.smithi123.stdout:0/602: read d2/dd/d4f/d6a/f70 [1876416,44454] 0 2024-02-20T08:05:34.114 INFO:tasks.workunit.client.0.smithi123.stdout:3/525: symlink d0/d6/d1a/d4b/d95/lbc 0 2024-02-20T08:05:34.119 INFO:tasks.workunit.client.0.smithi123.stdout:6/778: mkdir d0/d3e/d40/d90/d102 0 2024-02-20T08:05:34.120 INFO:tasks.workunit.client.0.smithi123.stdout:5/447: mknod d0/d34/d48/d4b/d51/c99 0 2024-02-20T08:05:34.124 INFO:tasks.workunit.client.0.smithi123.stdout:7/466: write d0/db/d38/d47/d4a/d5d/f72 [963844,94526] 0 2024-02-20T08:05:34.126 INFO:tasks.workunit.client.0.smithi123.stdout:7/467: write d0/db/d38/d47/d4a/d5d/f72 [1402775,110876] 0 2024-02-20T08:05:34.127 INFO:tasks.workunit.client.0.smithi123.stdout:6/779: stat d0/f2c 0 2024-02-20T08:05:34.127 INFO:tasks.workunit.client.0.smithi123.stdout:7/468: fdatasync d0/d6/f57 0 2024-02-20T08:05:34.128 INFO:tasks.workunit.client.0.smithi123.stdout:5/448: mkdir d0/d34/d48/d56/d25/d9a 0 2024-02-20T08:05:34.131 INFO:tasks.workunit.client.0.smithi123.stdout:0/603: mknod d2/d54/dac/cc2 0 2024-02-20T08:05:34.134 INFO:tasks.workunit.client.0.smithi123.stdout:3/526: link d0/d6/d1a/d1b/d1c/f25 d0/d6/d1a/d1e/d49/fbd 0 2024-02-20T08:05:34.137 INFO:tasks.workunit.client.0.smithi123.stdout:5/449: mkdir d0/d13/d27/d4e/d9b 0 2024-02-20T08:05:34.138 INFO:tasks.workunit.client.0.smithi123.stdout:9/543: getdents d6/d2a/d27/d6f/d8b/d98 0 2024-02-20T08:05:34.139 INFO:tasks.workunit.client.0.smithi123.stdout:5/450: truncate d0/d34/d48/d4b/f4f 2614517 0 2024-02-20T08:05:34.140 INFO:tasks.workunit.client.0.smithi123.stdout:0/604: rename d2/de/d1e/l27 to d2/dd/d4f/d61/lc3 0 2024-02-20T08:05:34.142 INFO:tasks.workunit.client.0.smithi123.stdout:3/527: creat d0/d6/d34/fbe x:0 0 0 2024-02-20T08:05:34.142 INFO:tasks.workunit.client.0.smithi123.stdout:6/780: creat d0/d3e/d92/d56/d57/d91/d101/f103 x:0 0 0 2024-02-20T08:05:34.145 INFO:tasks.workunit.client.0.smithi123.stdout:0/605: creat d2/d54/fc4 x:0 0 0 2024-02-20T08:05:34.146 INFO:tasks.workunit.client.0.smithi123.stdout:9/544: symlink d6/d19/d1a/d2b/d28/da0/lb3 0 2024-02-20T08:05:34.148 INFO:tasks.workunit.client.0.smithi123.stdout:6/781: mknod d0/d3e/d40/d7f/c104 0 2024-02-20T08:05:34.152 INFO:tasks.workunit.client.0.smithi123.stdout:5/451: dread d0/d34/d48/d4b/d51/f72 [0,4194304] 0 2024-02-20T08:05:34.152 INFO:tasks.workunit.client.0.smithi123.stdout:9/545: unlink d6/d19/d1a/d31/l95 0 2024-02-20T08:05:34.154 INFO:tasks.workunit.client.0.smithi123.stdout:0/606: dwrite d2/de/d1e/d1f/f8e [0,4194304] 0 2024-02-20T08:05:34.165 INFO:tasks.workunit.client.0.smithi123.stdout:3/528: truncate d0/d6/d1a/d1b/d1c/d20/f31 3126830 0 2024-02-20T08:05:34.166 INFO:tasks.workunit.client.0.smithi123.stdout:3/529: readlink d0/d6/d1a/d1e/l4c 0 2024-02-20T08:05:34.172 INFO:tasks.workunit.client.0.smithi123.stdout:5/452: dwrite d0/d13/d27/f7e [0,4194304] 0 2024-02-20T08:05:34.176 INFO:tasks.workunit.client.0.smithi123.stdout:3/530: write d0/d6/d1a/d1b/d1c/f4f [774279,40204] 0 2024-02-20T08:05:34.178 INFO:tasks.workunit.client.0.smithi123.stdout:5/453: rename d0/d34/d48/d56/d3e/c69 to d0/d13/d60/c9c 0 2024-02-20T08:05:34.181 INFO:tasks.workunit.client.0.smithi123.stdout:3/531: dwrite d0/f8c [0,4194304] 0 2024-02-20T08:05:34.184 INFO:tasks.workunit.client.0.smithi123.stdout:5/454: creat d0/f9d x:0 0 0 2024-02-20T08:05:34.188 INFO:tasks.workunit.client.0.smithi123.stdout:5/455: unlink d0/d34/c5d 0 2024-02-20T08:05:34.190 INFO:tasks.workunit.client.0.smithi123.stdout:5/456: readlink d0/d34/d48/d56/d3e/l68 0 2024-02-20T08:05:34.191 INFO:tasks.workunit.client.0.smithi123.stdout:5/457: read - d0/d34/d48/d56/d25/f8e zero size 2024-02-20T08:05:34.199 INFO:tasks.workunit.client.0.smithi123.stdout:5/458: fsync d0/d13/d27/d4e/f52 0 2024-02-20T08:05:34.205 INFO:tasks.workunit.client.0.smithi123.stdout:5/459: symlink d0/d34/l9e 0 2024-02-20T08:05:34.208 INFO:tasks.workunit.client.0.smithi123.stdout:3/532: dread d0/dd/f8 [0,4194304] 0 2024-02-20T08:05:34.209 INFO:tasks.workunit.client.0.smithi123.stdout:5/460: mknod d0/d34/d67/d80/d84/c9f 0 2024-02-20T08:05:34.213 INFO:tasks.workunit.client.0.smithi123.stdout:5/461: creat d0/d13/d27/d4e/d9b/fa0 x:0 0 0 2024-02-20T08:05:34.213 INFO:tasks.workunit.client.0.smithi123.stdout:3/533: dwrite d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:34.218 INFO:tasks.workunit.client.0.smithi123.stdout:3/534: symlink d0/d6/d1a/d4b/d95/d9f/lbf 0 2024-02-20T08:05:34.219 INFO:tasks.workunit.client.0.smithi123.stdout:3/535: read - d0/d6/d1a/d1b/d1c/fb7 zero size 2024-02-20T08:05:34.221 INFO:tasks.workunit.client.0.smithi123.stdout:5/462: dwrite d0/d34/d48/d56/f62 [0,4194304] 0 2024-02-20T08:05:34.253 INFO:tasks.workunit.client.0.smithi123.stdout:3/536: dwrite d0/f53 [0,4194304] 0 2024-02-20T08:05:34.254 INFO:tasks.workunit.client.0.smithi123.stdout:3/537: write d0/d6/d1a/d1b/d1c/d21/d8e/fb2 [871100,99731] 0 2024-02-20T08:05:34.257 INFO:tasks.workunit.client.0.smithi123.stdout:1/505: sync 2024-02-20T08:05:34.392 INFO:tasks.workunit.client.0.smithi123.stdout:8/528: sync 2024-02-20T08:05:34.393 INFO:tasks.workunit.client.0.smithi123.stdout:8/529: fdatasync d6/d1c/f6f 0 2024-02-20T08:05:34.396 INFO:tasks.workunit.client.0.smithi123.stdout:8/530: symlink d6/d1c/d22/d4f/d5b/d8f/lb1 0 2024-02-20T08:05:34.400 INFO:tasks.workunit.client.0.smithi123.stdout:8/531: dwrite d6/d1c/f21 [0,4194304] 0 2024-02-20T08:05:34.407 INFO:tasks.workunit.client.0.smithi123.stdout:8/532: getdents d6/d1c/d22 0 2024-02-20T08:05:34.409 INFO:tasks.workunit.client.0.smithi123.stdout:8/533: creat d6/d32/fb2 x:0 0 0 2024-02-20T08:05:34.410 INFO:tasks.workunit.client.0.smithi123.stdout:8/534: write d6/d1c/d22/d4f/f85 [4441638,19861] 0 2024-02-20T08:05:34.417 INFO:tasks.workunit.client.0.smithi123.stdout:8/535: dwrite d6/d1c/d22/d4f/d5b/f77 [0,4194304] 0 2024-02-20T08:05:34.560 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:34 smithi123 ceph-mon[29383]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 156 MiB/s wr, 297 op/s 2024-02-20T08:05:34.569 INFO:tasks.workunit.client.0.smithi123.stdout:8/536: dwrite d6/fc [0,4194304] 0 2024-02-20T08:05:34.577 INFO:tasks.workunit.client.0.smithi123.stdout:8/537: creat d6/fb3 x:0 0 0 2024-02-20T08:05:34.592 INFO:tasks.workunit.client.0.smithi123.stdout:8/538: dwrite d6/d32/d95/f3a [0,4194304] 0 2024-02-20T08:05:34.598 INFO:tasks.workunit.client.0.smithi123.stdout:8/539: dwrite d6/d1c/d22/d4f/f85 [4194304,4194304] 0 2024-02-20T08:05:34.605 INFO:tasks.workunit.client.0.smithi123.stdout:8/540: write d6/fb [1132631,73344] 0 2024-02-20T08:05:34.609 INFO:tasks.workunit.client.0.smithi123.stdout:8/541: getdents d6/d1c/d22/d8c 0 2024-02-20T08:05:34.619 INFO:tasks.workunit.client.0.smithi123.stdout:8/542: dwrite d6/f3b [0,4194304] 0 2024-02-20T08:05:34.620 INFO:tasks.workunit.client.0.smithi123.stdout:8/543: write d6/f1b [9241925,25104] 0 2024-02-20T08:05:34.623 INFO:tasks.workunit.client.0.smithi123.stdout:8/544: creat d6/d32/fb4 x:0 0 0 2024-02-20T08:05:34.624 INFO:tasks.workunit.client.0.smithi123.stdout:8/545: creat d6/d1c/d22/d4f/fb5 x:0 0 0 2024-02-20T08:05:34.629 INFO:tasks.workunit.client.0.smithi123.stdout:8/546: link d6/d1c/d2c/f7b d6/d1c/d22/d4f/d5b/d8f/d98/fb6 0 2024-02-20T08:05:34.630 INFO:tasks.workunit.client.0.smithi123.stdout:8/547: read - d6/d1c/d22/d4f/d7e/fa3 zero size 2024-02-20T08:05:34.633 INFO:tasks.workunit.client.0.smithi123.stdout:8/548: unlink d6/d1c/d2c/f7b 0 2024-02-20T08:05:34.636 INFO:tasks.workunit.client.0.smithi123.stdout:8/549: rename d6/d1c/d22/d4f/d5b/d8f/d99/fa0 to d6/d32/fb7 0 2024-02-20T08:05:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:34 smithi194 ceph-mon[37804]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 156 MiB/s wr, 297 op/s 2024-02-20T08:05:34.646 INFO:tasks.workunit.client.0.smithi123.stdout:2/588: sync 2024-02-20T08:05:34.646 INFO:tasks.workunit.client.0.smithi123.stdout:4/531: sync 2024-02-20T08:05:34.647 INFO:tasks.workunit.client.0.smithi123.stdout:2/589: dread - d1a/d29/d42/d52/d98/da1/fb8 zero size 2024-02-20T08:05:34.648 INFO:tasks.workunit.client.0.smithi123.stdout:2/590: fdatasync d1a/d29/d42/f45 0 2024-02-20T08:05:34.653 INFO:tasks.workunit.client.0.smithi123.stdout:8/550: dwrite d6/d1c/d2c/f6a [0,4194304] 0 2024-02-20T08:05:34.658 INFO:tasks.workunit.client.0.smithi123.stdout:8/551: dwrite d6/f1b [0,4194304] 0 2024-02-20T08:05:34.660 INFO:tasks.workunit.client.0.smithi123.stdout:8/552: write d6/d1c/d2c/f75 [2109159,124496] 0 2024-02-20T08:05:34.661 INFO:tasks.workunit.client.0.smithi123.stdout:2/591: chown d1a/d29/d5d/f7e 411 1 2024-02-20T08:05:34.666 INFO:tasks.workunit.client.0.smithi123.stdout:4/532: mkdir d3/d18/d7d/d96/dbc 0 2024-02-20T08:05:34.669 INFO:tasks.workunit.client.0.smithi123.stdout:8/553: rename d6/f7 to d6/d32/d95/d7d/dab/fb8 0 2024-02-20T08:05:34.673 INFO:tasks.workunit.client.0.smithi123.stdout:2/592: creat d1a/d29/d5d/d8d/fc1 x:0 0 0 2024-02-20T08:05:34.673 INFO:tasks.workunit.client.0.smithi123.stdout:4/533: fdatasync d3/d2c/f69 0 2024-02-20T08:05:34.675 INFO:tasks.workunit.client.0.smithi123.stdout:4/534: write d3/d2c/d43/d34/f93 [468295,116924] 0 2024-02-20T08:05:34.676 INFO:tasks.workunit.client.0.smithi123.stdout:2/593: rmdir d1a/d29/d42/d4e 39 2024-02-20T08:05:34.681 INFO:tasks.workunit.client.0.smithi123.stdout:4/535: dread - d3/d2c/f54 zero size 2024-02-20T08:05:34.684 INFO:tasks.workunit.client.0.smithi123.stdout:2/594: write d1a/d29/d42/d73/d8f/fab [375590,65943] 0 2024-02-20T08:05:34.688 INFO:tasks.workunit.client.0.smithi123.stdout:2/595: mknod d1a/d29/d42/d73/cc2 0 2024-02-20T08:05:34.691 INFO:tasks.workunit.client.0.smithi123.stdout:2/596: symlink d1a/d29/d42/d73/lc3 0 2024-02-20T08:05:34.691 INFO:tasks.workunit.client.0.smithi123.stdout:2/597: stat d1a/d29/c74 0 2024-02-20T08:05:34.692 INFO:tasks.workunit.client.0.smithi123.stdout:4/536: getdents d3/d2c/d43/d34 0 2024-02-20T08:05:34.693 INFO:tasks.workunit.client.0.smithi123.stdout:2/598: write d1a/f28 [1742067,9286] 0 2024-02-20T08:05:34.694 INFO:tasks.workunit.client.0.smithi123.stdout:4/537: write d3/d18/d7d/d87/f9a [2501882,129660] 0 2024-02-20T08:05:34.697 INFO:tasks.workunit.client.0.smithi123.stdout:2/599: mknod d1a/d29/d39/cc4 0 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:1/506: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:0/607: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:3/538: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:6/782: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:9/546: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:7/469: sync 2024-02-20T08:05:34.700 INFO:tasks.workunit.client.0.smithi123.stdout:5/463: sync 2024-02-20T08:05:34.701 INFO:tasks.workunit.client.0.smithi123.stdout:2/600: rmdir d1a/d29/d42/d73 39 2024-02-20T08:05:34.705 INFO:tasks.workunit.client.0.smithi123.stdout:4/538: dwrite d3/d2c/d5a/fad [0,4194304] 0 2024-02-20T08:05:34.705 INFO:tasks.workunit.client.0.smithi123.stdout:3/539: write d0/dd/d48/f71 [1294384,83183] 0 2024-02-20T08:05:34.709 INFO:tasks.workunit.client.0.smithi123.stdout:4/539: dread - d3/d2c/d43/d26/d2e/fb4 zero size 2024-02-20T08:05:34.710 INFO:tasks.workunit.client.0.smithi123.stdout:9/547: dwrite f5 [4194304,4194304] 0 2024-02-20T08:05:34.712 INFO:tasks.workunit.client.0.smithi123.stdout:0/608: dread d2/de/d1e/d1f/f8e [0,4194304] 0 2024-02-20T08:05:34.713 INFO:tasks.workunit.client.0.smithi123.stdout:7/470: fsync d0/d6/dd/f65 0 2024-02-20T08:05:34.721 INFO:tasks.workunit.client.0.smithi123.stdout:5/464: dwrite d0/d34/d48/d4b/f7d [0,4194304] 0 2024-02-20T08:05:34.723 INFO:tasks.workunit.client.0.smithi123.stdout:3/540: dread d0/d6/d1a/d1b/d1c/f4f [0,4194304] 0 2024-02-20T08:05:34.725 INFO:tasks.workunit.client.0.smithi123.stdout:4/540: chown d3/d2c/d43/f50 7813 1 2024-02-20T08:05:34.727 INFO:tasks.workunit.client.0.smithi123.stdout:4/541: write d3/d2c/d43/d34/f37 [2773699,96482] 0 2024-02-20T08:05:34.728 INFO:tasks.workunit.client.0.smithi123.stdout:4/542: chown d3/d2c/d43/d26/l85 68413833 1 2024-02-20T08:05:34.731 INFO:tasks.workunit.client.0.smithi123.stdout:0/609: rename d2/de/f60 to d2/d3/d37/fc5 0 2024-02-20T08:05:34.734 INFO:tasks.workunit.client.0.smithi123.stdout:6/783: write d0/f16 [2670033,84348] 0 2024-02-20T08:05:34.736 INFO:tasks.workunit.client.0.smithi123.stdout:1/507: write d3/f1d [4877013,28210] 0 2024-02-20T08:05:34.737 INFO:tasks.workunit.client.0.smithi123.stdout:1/508: readlink d3/de/l9a 0 2024-02-20T08:05:34.738 INFO:tasks.workunit.client.0.smithi123.stdout:3/541: write d0/d6/d1a/d1b/d9d/f6d [2190003,122574] 0 2024-02-20T08:05:34.740 INFO:tasks.workunit.client.0.smithi123.stdout:4/543: mknod d3/d2c/d43/d26/d3e/cbd 0 2024-02-20T08:05:34.740 INFO:tasks.workunit.client.0.smithi123.stdout:4/544: chown d3/d2c/d5a 1 1 2024-02-20T08:05:34.741 INFO:tasks.workunit.client.0.smithi123.stdout:2/601: creat d1a/fc5 x:0 0 0 2024-02-20T08:05:34.743 INFO:tasks.workunit.client.0.smithi123.stdout:0/610: mkdir d2/de/dc6 0 2024-02-20T08:05:34.746 INFO:tasks.workunit.client.0.smithi123.stdout:3/542: fdatasync d0/d6/d1a/f39 0 2024-02-20T08:05:34.747 INFO:tasks.workunit.client.0.smithi123.stdout:4/545: rmdir d3/d18/d7d 39 2024-02-20T08:05:34.748 INFO:tasks.workunit.client.0.smithi123.stdout:3/543: write d0/dd/d48/f71 [3444043,114727] 0 2024-02-20T08:05:34.753 INFO:tasks.workunit.client.0.smithi123.stdout:5/465: rmdir d0/d34/d48/d56/d25/d9a 0 2024-02-20T08:05:34.755 INFO:tasks.workunit.client.0.smithi123.stdout:6/784: truncate d0/d3e/d40/d90/fe7 334362 0 2024-02-20T08:05:34.756 INFO:tasks.workunit.client.0.smithi123.stdout:4/546: dwrite d3/d18/f23 [0,4194304] 0 2024-02-20T08:05:34.758 INFO:tasks.workunit.client.0.smithi123.stdout:4/547: read d3/d1e/f5b [1073385,164] 0 2024-02-20T08:05:34.764 INFO:tasks.workunit.client.0.smithi123.stdout:7/471: rename d0/d23/f2d to d0/d6/dd/d52/d26/fa4 0 2024-02-20T08:05:34.768 INFO:tasks.workunit.client.0.smithi123.stdout:5/466: rmdir d0/d34/d48/d56 39 2024-02-20T08:05:34.772 INFO:tasks.workunit.client.0.smithi123.stdout:1/509: dwrite d3/db/d34/d74/f11 [0,4194304] 0 2024-02-20T08:05:34.776 INFO:tasks.workunit.client.0.smithi123.stdout:4/548: creat d3/d97/fbe x:0 0 0 2024-02-20T08:05:34.777 INFO:tasks.workunit.client.0.smithi123.stdout:2/602: rename d1a/d29/d42/d73/c9e to d1a/d29/d42/d73/cc6 0 2024-02-20T08:05:34.779 INFO:tasks.workunit.client.0.smithi123.stdout:0/611: rename d2/dd/d4f/d7c/cab to d2/de/d1e/d1f/d74/cc7 0 2024-02-20T08:05:34.783 INFO:tasks.workunit.client.0.smithi123.stdout:7/472: creat d0/d6/dd/d52/d26/d7b/fa5 x:0 0 0 2024-02-20T08:05:34.785 INFO:tasks.workunit.client.0.smithi123.stdout:6/785: dread d0/f31 [0,4194304] 0 2024-02-20T08:05:34.786 INFO:tasks.workunit.client.0.smithi123.stdout:5/467: symlink d0/d13/d27/d37/la1 0 2024-02-20T08:05:34.788 INFO:tasks.workunit.client.0.smithi123.stdout:1/510: symlink d3/db/d34/d74/lb2 0 2024-02-20T08:05:34.793 INFO:tasks.workunit.client.0.smithi123.stdout:6/786: rmdir d0/d3e/d92/d56/d57/d91/d101 39 2024-02-20T08:05:34.794 INFO:tasks.workunit.client.0.smithi123.stdout:5/468: dwrite d0/d34/d48/d4b/d51/f8a [0,4194304] 0 2024-02-20T08:05:34.801 INFO:tasks.workunit.client.0.smithi123.stdout:3/544: link d0/d6/d1a/d1b/d1c/d20/f31 d0/d6/d1a/d1b/db4/fc0 0 2024-02-20T08:05:34.803 INFO:tasks.workunit.client.0.smithi123.stdout:7/473: getdents d0/d6/dd/d97 0 2024-02-20T08:05:34.805 INFO:tasks.workunit.client.0.smithi123.stdout:2/603: creat d1a/d29/fc7 x:0 0 0 2024-02-20T08:05:34.807 INFO:tasks.workunit.client.0.smithi123.stdout:3/545: dread d0/d6/d34/fad [0,4194304] 0 2024-02-20T08:05:34.809 INFO:tasks.workunit.client.0.smithi123.stdout:6/787: symlink d0/d3e/d40/d48/daa/ddf/l105 0 2024-02-20T08:05:34.810 INFO:tasks.workunit.client.0.smithi123.stdout:5/469: stat d0/d34/d48/d4b/d51/l85 0 2024-02-20T08:05:34.811 INFO:tasks.workunit.client.0.smithi123.stdout:5/470: chown d0/d13/d27/l28 126 1 2024-02-20T08:05:34.814 INFO:tasks.workunit.client.0.smithi123.stdout:1/511: rename d3/l24 to d3/db/d34/lb3 0 2024-02-20T08:05:34.815 INFO:tasks.workunit.client.0.smithi123.stdout:0/612: link d2/d3/c4b d2/d54/d78/cc8 0 2024-02-20T08:05:34.820 INFO:tasks.workunit.client.0.smithi123.stdout:5/471: dread - d0/d34/d48/d56/d25/f76 zero size 2024-02-20T08:05:34.824 INFO:tasks.workunit.client.0.smithi123.stdout:1/512: unlink c2 0 2024-02-20T08:05:34.824 INFO:tasks.workunit.client.0.smithi123.stdout:1/513: write d3/de/f8d [132973,6286] 0 2024-02-20T08:05:34.825 INFO:tasks.workunit.client.0.smithi123.stdout:0/613: symlink d2/dd/d4f/d61/d68/lc9 0 2024-02-20T08:05:34.828 INFO:tasks.workunit.client.0.smithi123.stdout:7/474: creat d0/d6/dd/d52/d35/d9c/d70/fa6 x:0 0 0 2024-02-20T08:05:34.829 INFO:tasks.workunit.client.0.smithi123.stdout:2/604: mkdir d1a/d29/d42/dc8 0 2024-02-20T08:05:34.834 INFO:tasks.workunit.client.0.smithi123.stdout:4/549: getdents d3/d18/d7d/d87 0 2024-02-20T08:05:34.837 INFO:tasks.workunit.client.0.smithi123.stdout:5/472: creat d0/d34/d67/d80/d84/fa2 x:0 0 0 2024-02-20T08:05:34.838 INFO:tasks.workunit.client.0.smithi123.stdout:1/514: mkdir d3/db/d34/db4 0 2024-02-20T08:05:34.841 INFO:tasks.workunit.client.0.smithi123.stdout:0/614: creat d2/de/d1e/d1f/fca x:0 0 0 2024-02-20T08:05:34.844 INFO:tasks.workunit.client.0.smithi123.stdout:5/473: dwrite d0/d34/d48/d56/d25/f8e [0,4194304] 0 2024-02-20T08:05:34.847 INFO:tasks.workunit.client.0.smithi123.stdout:0/615: truncate d2/dd/d4f/d6a/fb4 1056355 0 2024-02-20T08:05:34.847 INFO:tasks.workunit.client.0.smithi123.stdout:5/474: chown d0/d13/d27/d4e/d91 6539557 1 2024-02-20T08:05:34.848 INFO:tasks.workunit.client.0.smithi123.stdout:3/546: write d0/d6/d1a/d1b/db4/fc0 [662115,68824] 0 2024-02-20T08:05:34.848 INFO:tasks.workunit.client.0.smithi123.stdout:5/475: read d0/d34/d48/d4b/d51/f8a [1763366,6290] 0 2024-02-20T08:05:34.848 INFO:tasks.workunit.client.0.smithi123.stdout:6/788: truncate d0/d3e/d92/d56/f5a 2910598 0 2024-02-20T08:05:34.849 INFO:tasks.workunit.client.0.smithi123.stdout:4/550: fdatasync d3/d18/f51 0 2024-02-20T08:05:34.850 INFO:tasks.workunit.client.0.smithi123.stdout:5/476: write d0/d34/d48/d56/d25/f3b [1269578,62396] 0 2024-02-20T08:05:34.851 INFO:tasks.workunit.client.0.smithi123.stdout:4/551: read d3/d18/d63/fab [632412,88942] 0 2024-02-20T08:05:34.853 INFO:tasks.workunit.client.0.smithi123.stdout:6/789: truncate d0/d3e/d92/db3/fce 2131432 0 2024-02-20T08:05:34.854 INFO:tasks.workunit.client.0.smithi123.stdout:4/552: write d3/d2c/d43/d26/f8e [1828044,96160] 0 2024-02-20T08:05:34.855 INFO:tasks.workunit.client.0.smithi123.stdout:0/616: mkdir d2/de/d1e/d1f/dcb 0 2024-02-20T08:05:34.859 INFO:tasks.workunit.client.0.smithi123.stdout:3/547: creat d0/d6/d1a/d62/fc1 x:0 0 0 2024-02-20T08:05:34.859 INFO:tasks.workunit.client.0.smithi123.stdout:6/790: dread d0/f31 [0,4194304] 0 2024-02-20T08:05:34.865 INFO:tasks.workunit.client.0.smithi123.stdout:7/475: creat d0/d6/dd/d52/d35/d9c/fa7 x:0 0 0 2024-02-20T08:05:34.871 INFO:tasks.workunit.client.0.smithi123.stdout:5/477: dread d0/d34/d48/d56/d25/f31 [0,4194304] 0 2024-02-20T08:05:34.872 INFO:tasks.workunit.client.0.smithi123.stdout:0/617: rmdir d2/dd 39 2024-02-20T08:05:34.875 INFO:tasks.workunit.client.0.smithi123.stdout:4/553: creat d3/d2c/d43/d26/d2e/fbf x:0 0 0 2024-02-20T08:05:34.877 INFO:tasks.workunit.client.0.smithi123.stdout:2/605: dread d1a/d7f/f91 [0,4194304] 0 2024-02-20T08:05:34.878 INFO:tasks.workunit.client.0.smithi123.stdout:6/791: rmdir d0/d38 39 2024-02-20T08:05:34.882 INFO:tasks.workunit.client.0.smithi123.stdout:1/515: rename d3/de/f98 to d3/de/d14/d2c/fb5 0 2024-02-20T08:05:34.882 INFO:tasks.workunit.client.0.smithi123.stdout:1/516: stat d3/de/d14/d2c/d4f/fac 0 2024-02-20T08:05:34.883 INFO:tasks.workunit.client.0.smithi123.stdout:1/517: dread - d3/fab zero size 2024-02-20T08:05:34.884 INFO:tasks.workunit.client.0.smithi123.stdout:7/476: creat d0/d23/fa8 x:0 0 0 2024-02-20T08:05:34.895 INFO:tasks.workunit.client.0.smithi123.stdout:1/518: creat d3/de/d14/d36/fb6 x:0 0 0 2024-02-20T08:05:34.897 INFO:tasks.workunit.client.0.smithi123.stdout:2/606: creat d1a/d29/d42/d4e/fc9 x:0 0 0 2024-02-20T08:05:34.898 INFO:tasks.workunit.client.0.smithi123.stdout:1/519: write d3/de/d14/d26/fa6 [742419,116172] 0 2024-02-20T08:05:34.899 INFO:tasks.workunit.client.0.smithi123.stdout:6/792: unlink d0/f17 0 2024-02-20T08:05:34.899 INFO:tasks.workunit.client.0.smithi123.stdout:3/548: dwrite d0/d6/d1a/d4b/f97 [0,4194304] 0 2024-02-20T08:05:34.902 INFO:tasks.workunit.client.0.smithi123.stdout:1/520: chown d3/de/d14/d26/d2e/d54/fa7 887425360 1 2024-02-20T08:05:34.902 INFO:tasks.workunit.client.0.smithi123.stdout:4/554: symlink d3/d2c/d43/d98/lc0 0 2024-02-20T08:05:34.903 INFO:tasks.workunit.client.0.smithi123.stdout:0/618: dread d2/de/d1e/f22 [0,4194304] 0 2024-02-20T08:05:34.904 INFO:tasks.workunit.client.0.smithi123.stdout:4/555: chown d3/d2c/f5d 207 1 2024-02-20T08:05:34.907 INFO:tasks.workunit.client.0.smithi123.stdout:5/478: rename d0/d34/d48/d56/d4c/c44 to d0/d34/ca3 0 2024-02-20T08:05:34.910 INFO:tasks.workunit.client.0.smithi123.stdout:5/479: readlink d0/d34/d48/d56/d25/l70 0 2024-02-20T08:05:34.912 INFO:tasks.workunit.client.0.smithi123.stdout:6/793: write d0/d38/f4f [460659,128336] 0 2024-02-20T08:05:34.912 INFO:tasks.workunit.client.0.smithi123.stdout:0/619: dwrite d2/de/d1e/d1f/f20 [0,4194304] 0 2024-02-20T08:05:34.915 INFO:tasks.workunit.client.0.smithi123.stdout:5/480: write d0/d34/d48/d56/d25/f29 [3900284,21546] 0 2024-02-20T08:05:34.916 INFO:tasks.workunit.client.0.smithi123.stdout:1/521: creat d3/de/d14/d26/d56/fb7 x:0 0 0 2024-02-20T08:05:34.920 INFO:tasks.workunit.client.0.smithi123.stdout:2/607: mknod d1a/cca 0 2024-02-20T08:05:34.921 INFO:tasks.workunit.client.0.smithi123.stdout:5/481: dread d0/d34/d48/d4b/d51/f72 [0,4194304] 0 2024-02-20T08:05:34.921 INFO:tasks.workunit.client.0.smithi123.stdout:4/556: rmdir d3/d2c/d43/d26/d3e 39 2024-02-20T08:05:34.928 INFO:tasks.workunit.client.0.smithi123.stdout:3/549: mknod d0/d6/d1a/d1b/d1c/d3b/d43/d68/cc2 0 2024-02-20T08:05:34.931 INFO:tasks.workunit.client.0.smithi123.stdout:1/522: unlink d3/db/d34/c61 0 2024-02-20T08:05:34.932 INFO:tasks.workunit.client.0.smithi123.stdout:1/523: chown d3/de/d14/d2c/fb5 179868 1 2024-02-20T08:05:34.934 INFO:tasks.workunit.client.0.smithi123.stdout:5/482: mknod d0/d34/d67/d80/d84/ca4 0 2024-02-20T08:05:34.937 INFO:tasks.workunit.client.0.smithi123.stdout:0/620: fsync d2/dd/f50 0 2024-02-20T08:05:34.945 INFO:tasks.workunit.client.0.smithi123.stdout:2/608: dread f15 [0,4194304] 0 2024-02-20T08:05:34.947 INFO:tasks.workunit.client.0.smithi123.stdout:2/609: chown d1a/d29/d42/d73/d8f 14 1 2024-02-20T08:05:34.948 INFO:tasks.workunit.client.0.smithi123.stdout:5/483: mknod d0/d34/d48/d56/d25/ca5 0 2024-02-20T08:05:34.948 INFO:tasks.workunit.client.0.smithi123.stdout:3/550: dread d0/d6/d1a/d1b/d1c/d21/f3e [0,4194304] 0 2024-02-20T08:05:34.949 INFO:tasks.workunit.client.0.smithi123.stdout:5/484: fdatasync d0/d34/d48/f53 0 2024-02-20T08:05:34.954 INFO:tasks.workunit.client.0.smithi123.stdout:1/524: fsync d3/f48 0 2024-02-20T08:05:34.954 INFO:tasks.workunit.client.0.smithi123.stdout:1/525: stat d3/db/d34/f92 0 2024-02-20T08:05:34.957 INFO:tasks.workunit.client.0.smithi123.stdout:6/794: truncate d0/d3e/d92/d56/d57/d91/fda 1424825 0 2024-02-20T08:05:34.961 INFO:tasks.workunit.client.0.smithi123.stdout:3/551: rename d0/d6/d1a/d1b/d1c/c80 to d0/d6/d1a/d1e/d49/daa/cc3 0 2024-02-20T08:05:34.961 INFO:tasks.workunit.client.0.smithi123.stdout:0/621: write d2/d3/d37/fc5 [1725499,36116] 0 2024-02-20T08:05:34.962 INFO:tasks.workunit.client.0.smithi123.stdout:3/552: chown d0/d6/d1a/d1b/d1c/d21/d64 36066 1 2024-02-20T08:05:34.967 INFO:tasks.workunit.client.0.smithi123.stdout:4/557: getdents d3/d2c/d43/d26/d2e 0 2024-02-20T08:05:34.968 INFO:tasks.workunit.client.0.smithi123.stdout:5/485: write d0/fc [2936722,1890] 0 2024-02-20T08:05:34.974 INFO:tasks.workunit.client.0.smithi123.stdout:1/526: write d3/de/d14/d36/f78 [3843878,4401] 0 2024-02-20T08:05:34.978 INFO:tasks.workunit.client.0.smithi123.stdout:5/486: write d0/d34/d48/d56/d4c/f45 [3308449,8050] 0 2024-02-20T08:05:34.979 INFO:tasks.workunit.client.0.smithi123.stdout:6/795: symlink d0/d9f/l106 0 2024-02-20T08:05:34.980 INFO:tasks.workunit.client.0.smithi123.stdout:5/487: readlink d0/d13/d27/d37/l95 0 2024-02-20T08:05:34.980 INFO:tasks.workunit.client.0.smithi123.stdout:6/796: stat d0/d3e/d92/cc1 0 2024-02-20T08:05:34.981 INFO:tasks.workunit.client.0.smithi123.stdout:5/488: readlink d0/d34/d48/d56/d3e/l47 0 2024-02-20T08:05:34.981 INFO:tasks.workunit.client.0.smithi123.stdout:6/797: stat d0/d3e/d40/d48/d79/dec 0 2024-02-20T08:05:34.987 INFO:tasks.workunit.client.0.smithi123.stdout:0/622: dread d2/dd/d4f/d7c/da4/d28/f2e [0,4194304] 0 2024-02-20T08:05:34.987 INFO:tasks.workunit.client.0.smithi123.stdout:2/610: link d1a/f50 d1a/d29/fcb 0 2024-02-20T08:05:34.988 INFO:tasks.workunit.client.0.smithi123.stdout:9/548: sync 2024-02-20T08:05:34.988 INFO:tasks.workunit.client.0.smithi123.stdout:8/554: sync 2024-02-20T08:05:34.990 INFO:tasks.workunit.client.0.smithi123.stdout:5/489: dwrite d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:34.991 INFO:tasks.workunit.client.0.smithi123.stdout:1/527: rename d3/de/d14/d26/d56/f58 to d3/db/d34/d74/fb8 0 2024-02-20T08:05:34.992 INFO:tasks.workunit.client.0.smithi123.stdout:3/553: truncate d0/d6/d1a/d1b/d1c/d21/d8e/f9a 3027485 0 2024-02-20T08:05:34.993 INFO:tasks.workunit.client.0.smithi123.stdout:4/558: dwrite d3/d2c/f45 [0,4194304] 0 2024-02-20T08:05:34.994 INFO:tasks.workunit.client.0.smithi123.stdout:8/555: read - d6/d1c/d22/d8c/f9a zero size 2024-02-20T08:05:34.995 INFO:tasks.workunit.client.0.smithi123.stdout:2/611: chown d1a/d29/d42/d73/d8f/cbf 124975866 1 2024-02-20T08:05:34.997 INFO:tasks.workunit.client.0.smithi123.stdout:6/798: getdents d0/d3e/d40/d48/d79/dec 0 2024-02-20T08:05:34.999 INFO:tasks.workunit.client.0.smithi123.stdout:5/490: mkdir d0/d34/d67/d80/d84/da6 0 2024-02-20T08:05:35.000 INFO:tasks.workunit.client.0.smithi123.stdout:0/623: fsync d2/dd/d4f/d7c/da4/dae/fbc 0 2024-02-20T08:05:35.003 INFO:tasks.workunit.client.0.smithi123.stdout:3/554: creat d0/d6/d1a/d4b/fc4 x:0 0 0 2024-02-20T08:05:35.007 INFO:tasks.workunit.client.0.smithi123.stdout:9/549: mknod d6/d19/d1a/d7c/cb4 0 2024-02-20T08:05:35.010 INFO:tasks.workunit.client.0.smithi123.stdout:4/559: mkdir d3/d18/d7d/d96/dc1 0 2024-02-20T08:05:35.011 INFO:tasks.workunit.client.0.smithi123.stdout:2/612: mkdir d1a/d29/d42/d52/dcc 0 2024-02-20T08:05:35.017 INFO:tasks.workunit.client.0.smithi123.stdout:5/491: dwrite d0/d13/f2c [0,4194304] 0 2024-02-20T08:05:35.018 INFO:tasks.workunit.client.0.smithi123.stdout:9/550: mknod d6/d19/d1a/d2b/d28/d9a/dae/cb5 0 2024-02-20T08:05:35.020 INFO:tasks.workunit.client.0.smithi123.stdout:5/492: write d0/d34/d48/d56/d25/f2d [2829797,128565] 0 2024-02-20T08:05:35.023 INFO:tasks.workunit.client.0.smithi123.stdout:5/493: write d0/d34/d48/d4b/f89 [175340,18669] 0 2024-02-20T08:05:35.026 INFO:tasks.workunit.client.0.smithi123.stdout:5/494: write d0/d34/d48/d56/d25/f2a [898640,106752] 0 2024-02-20T08:05:35.027 INFO:tasks.workunit.client.0.smithi123.stdout:3/555: symlink d0/d6/d1a/lc5 0 2024-02-20T08:05:35.033 INFO:tasks.workunit.client.0.smithi123.stdout:8/556: dwrite d6/d1c/d22/d4f/f7c [0,4194304] 0 2024-02-20T08:05:35.034 INFO:tasks.workunit.client.0.smithi123.stdout:6/799: rename d0/d3e/lfd to d0/d9f/l107 0 2024-02-20T08:05:35.037 INFO:tasks.workunit.client.0.smithi123.stdout:6/800: read d0/d3e/d40/d7f/fac [2485312,33559] 0 2024-02-20T08:05:35.037 INFO:tasks.workunit.client.0.smithi123.stdout:0/624: write d2/dd/d4f/d7c/da4/f45 [1659321,19986] 0 2024-02-20T08:05:35.039 INFO:tasks.workunit.client.0.smithi123.stdout:0/625: stat d2/dd/d4f/d61/d68/lc9 0 2024-02-20T08:05:35.039 INFO:tasks.workunit.client.0.smithi123.stdout:2/613: mknod d1a/d4f/ccd 0 2024-02-20T08:05:35.040 INFO:tasks.workunit.client.0.smithi123.stdout:0/626: fsync d2/de/d1e/d1f/fca 0 2024-02-20T08:05:35.040 INFO:tasks.workunit.client.0.smithi123.stdout:5/495: symlink d0/d13/d27/d37/la7 0 2024-02-20T08:05:35.041 INFO:tasks.workunit.client.0.smithi123.stdout:5/496: stat d0/d34/d48/d56/d25/f31 0 2024-02-20T08:05:35.047 INFO:tasks.workunit.client.0.smithi123.stdout:4/560: rename d3/d2c/d43/d26/d3e/l4e to d3/d1e/lc2 0 2024-02-20T08:05:35.053 INFO:tasks.workunit.client.0.smithi123.stdout:2/614: mknod d1a/d29/d5d/cce 0 2024-02-20T08:05:35.054 INFO:tasks.workunit.client.0.smithi123.stdout:0/627: stat d2/dd/d4f/d7c/ca9 0 2024-02-20T08:05:35.055 INFO:tasks.workunit.client.0.smithi123.stdout:3/556: creat d0/d6/d1a/d1b/db4/fc6 x:0 0 0 2024-02-20T08:05:35.056 INFO:tasks.workunit.client.0.smithi123.stdout:5/497: symlink d0/d34/d48/d56/d4c/la8 0 2024-02-20T08:05:35.057 INFO:tasks.workunit.client.0.smithi123.stdout:6/801: dwrite d0/f33 [0,4194304] 0 2024-02-20T08:05:35.058 INFO:tasks.workunit.client.0.smithi123.stdout:9/551: link d6/d19/d1a/d2b/d28/d9a/d3d/d32/ca3 d6/d19/d1a/d6d/cb6 0 2024-02-20T08:05:35.059 INFO:tasks.workunit.client.0.smithi123.stdout:9/552: truncate d6/d19/d1a/d7c/f86 493948 0 2024-02-20T08:05:35.073 INFO:tasks.workunit.client.0.smithi123.stdout:8/557: truncate d6/d1c/d22/d4f/d5b/d8f/d98/fb6 231476 0 2024-02-20T08:05:35.076 INFO:tasks.workunit.client.0.smithi123.stdout:4/561: write d3/d2c/d43/d26/d2e/f7f [98444,95953] 0 2024-02-20T08:05:35.078 INFO:tasks.workunit.client.0.smithi123.stdout:2/615: write d1a/d29/d5d/f7e [60597,93278] 0 2024-02-20T08:05:35.080 INFO:tasks.workunit.client.0.smithi123.stdout:8/558: mkdir d6/d1c/d2c/db9 0 2024-02-20T08:05:35.082 INFO:tasks.workunit.client.0.smithi123.stdout:6/802: write d0/d38/fa6 [2123352,73861] 0 2024-02-20T08:05:35.082 INFO:tasks.workunit.client.0.smithi123.stdout:8/559: chown d6/d1c/c33 1 1 2024-02-20T08:05:35.082 INFO:tasks.workunit.client.0.smithi123.stdout:4/562: dread d3/d18/d6c/db6/f9e [0,4194304] 0 2024-02-20T08:05:35.085 INFO:tasks.workunit.client.0.smithi123.stdout:6/803: chown d0/d3e/d92/db3/fce 808015 1 2024-02-20T08:05:35.087 INFO:tasks.workunit.client.0.smithi123.stdout:2/616: dwrite d1a/d29/d42/d4e/f8c [0,4194304] 0 2024-02-20T08:05:35.088 INFO:tasks.workunit.client.0.smithi123.stdout:2/617: chown d1a/d29/d42/d52/dcc 4806769 1 2024-02-20T08:05:35.090 INFO:tasks.workunit.client.0.smithi123.stdout:0/628: getdents d2/d54/dac 0 2024-02-20T08:05:35.092 INFO:tasks.workunit.client.0.smithi123.stdout:8/560: mknod d6/d32/cba 0 2024-02-20T08:05:35.095 INFO:tasks.workunit.client.0.smithi123.stdout:3/557: getdents d0 0 2024-02-20T08:05:35.097 INFO:tasks.workunit.client.0.smithi123.stdout:4/563: unlink d3/d2c/f69 0 2024-02-20T08:05:35.098 INFO:tasks.workunit.client.0.smithi123.stdout:5/498: getdents d0/d34/d48/d56/d4c 0 2024-02-20T08:05:35.099 INFO:tasks.workunit.client.0.smithi123.stdout:6/804: dread - d0/d3e/d92/d56/d57/f67 zero size 2024-02-20T08:05:35.099 INFO:tasks.workunit.client.0.smithi123.stdout:5/499: chown d0/d34/d48/d56/d25/f5f 13458305 1 2024-02-20T08:05:35.101 INFO:tasks.workunit.client.0.smithi123.stdout:9/553: getdents d6/d19/d1a/d2b/d28 0 2024-02-20T08:05:35.105 INFO:tasks.workunit.client.0.smithi123.stdout:6/805: chown d0/d3e/d40/fd7 238 1 2024-02-20T08:05:35.107 INFO:tasks.workunit.client.0.smithi123.stdout:2/618: truncate d1a/d29/d39/f89 2747904 0 2024-02-20T08:05:35.107 INFO:tasks.workunit.client.0.smithi123.stdout:2/619: chown d1a/f50 16833 1 2024-02-20T08:05:35.111 INFO:tasks.workunit.client.0.smithi123.stdout:3/558: creat d0/d6/d1a/d1b/d1c/d21/d64/fc7 x:0 0 0 2024-02-20T08:05:35.112 INFO:tasks.workunit.client.0.smithi123.stdout:0/629: write d2/dd/d4f/d7c/da4/dae/fbc [2819881,14447] 0 2024-02-20T08:05:35.114 INFO:tasks.workunit.client.0.smithi123.stdout:5/500: rename d0/d13/f50 to d0/fa9 0 2024-02-20T08:05:35.120 INFO:tasks.workunit.client.0.smithi123.stdout:6/806: mkdir d0/d3e/d40/d90/d102/d108 0 2024-02-20T08:05:35.122 INFO:tasks.workunit.client.0.smithi123.stdout:9/554: mknod d6/d2a/d9d/cb7 0 2024-02-20T08:05:35.122 INFO:tasks.workunit.client.0.smithi123.stdout:4/564: dwrite d3/d2c/d43/d26/d3e/f72 [0,4194304] 0 2024-02-20T08:05:35.123 INFO:tasks.workunit.client.0.smithi123.stdout:8/561: getdents d6/d1c/d22/d4f/d7e/d82 0 2024-02-20T08:05:35.127 INFO:tasks.workunit.client.0.smithi123.stdout:3/559: dwrite d0/d6/d1a/d1b/d1c/d20/fb6 [0,4194304] 0 2024-02-20T08:05:35.127 INFO:tasks.workunit.client.0.smithi123.stdout:4/565: fsync d3/d18/d7d/d8b/f9d 0 2024-02-20T08:05:35.129 INFO:tasks.workunit.client.0.smithi123.stdout:9/555: chown d6/d19/d1a/d2b/d28/d9a/d3d/fa7 1627051 1 2024-02-20T08:05:35.129 INFO:tasks.workunit.client.0.smithi123.stdout:2/620: creat d1a/d29/fcf x:0 0 0 2024-02-20T08:05:35.134 INFO:tasks.workunit.client.0.smithi123.stdout:8/562: creat d6/d32/d95/fbb x:0 0 0 2024-02-20T08:05:35.136 INFO:tasks.workunit.client.0.smithi123.stdout:5/501: link d0/f16 d0/d34/d67/d80/d84/faa 0 2024-02-20T08:05:35.141 INFO:tasks.workunit.client.0.smithi123.stdout:3/560: mknod d0/dd/d48/d6a/d74/cc8 0 2024-02-20T08:05:35.145 INFO:tasks.workunit.client.0.smithi123.stdout:0/630: dread d2/f1b [0,4194304] 0 2024-02-20T08:05:35.147 INFO:tasks.workunit.client.0.smithi123.stdout:6/807: creat d0/d3e/d40/d90/d94/def/f109 x:0 0 0 2024-02-20T08:05:35.151 INFO:tasks.workunit.client.0.smithi123.stdout:3/561: symlink d0/d6/d1a/d1b/d1c/d21/lc9 0 2024-02-20T08:05:35.153 INFO:tasks.workunit.client.0.smithi123.stdout:3/562: write d0/d6/d1a/d1b/db4/fc6 [418079,32156] 0 2024-02-20T08:05:35.155 INFO:tasks.workunit.client.0.smithi123.stdout:3/563: write d0/d6/d1a/f2f [1461317,8553] 0 2024-02-20T08:05:35.157 INFO:tasks.workunit.client.0.smithi123.stdout:2/621: mkdir d1a/d29/d42/d52/d98/da1/daa/dd0 0 2024-02-20T08:05:35.158 INFO:tasks.workunit.client.0.smithi123.stdout:3/564: rename d0/d6/d1a/d1b/d1c/d61 to d0/d6/d1a/d1b/d1c/d61/dca 22 2024-02-20T08:05:35.159 INFO:tasks.workunit.client.0.smithi123.stdout:2/622: chown d1a/d29/d42 188231394 1 2024-02-20T08:05:35.159 INFO:tasks.workunit.client.0.smithi123.stdout:3/565: read - d0/d6/d1a/d1b/f6b zero size 2024-02-20T08:05:35.160 INFO:tasks.workunit.client.0.smithi123.stdout:6/808: chown d0/l5b 13 1 2024-02-20T08:05:35.162 INFO:tasks.workunit.client.0.smithi123.stdout:3/566: write d0/d6/d1a/d1b/d1c/d20/fb6 [420547,80701] 0 2024-02-20T08:05:35.162 INFO:tasks.workunit.client.0.smithi123.stdout:4/566: dread d3/f1b [0,4194304] 0 2024-02-20T08:05:35.164 INFO:tasks.workunit.client.0.smithi123.stdout:0/631: mknod d2/dd/d4f/d7c/da4/db6/ccc 0 2024-02-20T08:05:35.166 INFO:tasks.workunit.client.0.smithi123.stdout:2/623: write d1a/d7f/f91 [1507725,110959] 0 2024-02-20T08:05:35.167 INFO:tasks.workunit.client.0.smithi123.stdout:9/556: dread d6/d19/d1a/d2b/d28/d9a/f26 [0,4194304] 0 2024-02-20T08:05:35.169 INFO:tasks.workunit.client.0.smithi123.stdout:3/567: creat d0/d6/d1a/d1b/d1c/d21/d8e/fcb x:0 0 0 2024-02-20T08:05:35.170 INFO:tasks.workunit.client.0.smithi123.stdout:2/624: truncate d1a/d29/d42/d80/fa4 1043705 0 2024-02-20T08:05:35.172 INFO:tasks.workunit.client.0.smithi123.stdout:6/809: creat d0/d3e/d40/d48/d5d/dbf/de3/f10a x:0 0 0 2024-02-20T08:05:35.174 INFO:tasks.workunit.client.0.smithi123.stdout:5/502: getdents d0/d13/d27 0 2024-02-20T08:05:35.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/503: truncate d0/d34/f66 576508 0 2024-02-20T08:05:35.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/504: chown d0/d13/d27/l57 220 1 2024-02-20T08:05:35.176 INFO:tasks.workunit.client.0.smithi123.stdout:9/557: write d6/d19/f49 [2240379,7041] 0 2024-02-20T08:05:35.177 INFO:tasks.workunit.client.0.smithi123.stdout:0/632: creat d2/de/d1e/d1f/dcb/fcd x:0 0 0 2024-02-20T08:05:35.179 INFO:tasks.workunit.client.0.smithi123.stdout:0/633: write d2/dd/f2f [1774504,93189] 0 2024-02-20T08:05:35.181 INFO:tasks.workunit.client.0.smithi123.stdout:0/634: truncate d2/d54/dac/fb8 417829 0 2024-02-20T08:05:35.182 INFO:tasks.workunit.client.0.smithi123.stdout:3/568: creat d0/d6/d1a/d1b/d1c/d3b/d43/fcc x:0 0 0 2024-02-20T08:05:35.184 INFO:tasks.workunit.client.0.smithi123.stdout:0/635: dread d2/f1b [4194304,4194304] 0 2024-02-20T08:05:35.186 INFO:tasks.workunit.client.0.smithi123.stdout:6/810: creat d0/d3e/d92/d56/d89/f10b x:0 0 0 2024-02-20T08:05:35.189 INFO:tasks.workunit.client.0.smithi123.stdout:5/505: unlink d0/d34/c78 0 2024-02-20T08:05:35.190 INFO:tasks.workunit.client.0.smithi123.stdout:5/506: dread - d0/d13/f88 zero size 2024-02-20T08:05:35.199 INFO:tasks.workunit.client.0.smithi123.stdout:2/625: write d1a/d29/d39/f5f [9251704,51802] 0 2024-02-20T08:05:35.199 INFO:tasks.workunit.client.0.smithi123.stdout:9/558: dwrite d6/d19/d1a/d2b/d28/d9a/f70 [0,4194304] 0 2024-02-20T08:05:35.203 INFO:tasks.workunit.client.0.smithi123.stdout:6/811: mkdir d0/d9f/df1/d10c 0 2024-02-20T08:05:35.205 INFO:tasks.workunit.client.0.smithi123.stdout:4/567: truncate d3/d18/d63/fab 2377534 0 2024-02-20T08:05:35.207 INFO:tasks.workunit.client.0.smithi123.stdout:4/568: chown d3/d18/d7d/d96/dbc 295127434 1 2024-02-20T08:05:35.208 INFO:tasks.workunit.client.0.smithi123.stdout:5/507: rename d0/d13/d27/f7e to d0/d34/d67/d80/fab 0 2024-02-20T08:05:35.210 INFO:tasks.workunit.client.0.smithi123.stdout:0/636: dwrite d2/f1b [8388608,4194304] 0 2024-02-20T08:05:35.210 INFO:tasks.workunit.client.0.smithi123.stdout:4/569: stat d3/d2c/d43/d34/f7c 0 2024-02-20T08:05:35.212 INFO:tasks.workunit.client.0.smithi123.stdout:5/508: chown d0/d34/d48/d56/d4c/la8 39712 1 2024-02-20T08:05:35.215 INFO:tasks.workunit.client.0.smithi123.stdout:6/812: dwrite d0/d3e/d40/d90/fe2 [0,4194304] 0 2024-02-20T08:05:35.248 INFO:tasks.workunit.client.0.smithi123.stdout:2/626: mkdir d1a/d29/d5d/d8d/dd1 0 2024-02-20T08:05:35.257 INFO:tasks.workunit.client.0.smithi123.stdout:9/559: rename d6/d19/d1a/d2b/l69 to d6/d19/d1a/d6d/d7e/lb8 0 2024-02-20T08:05:35.259 INFO:tasks.workunit.client.0.smithi123.stdout:4/570: fdatasync d3/d2c/d43/d34/f4f 0 2024-02-20T08:05:35.259 INFO:tasks.workunit.client.0.smithi123.stdout:3/569: dwrite d0/d6/d1a/f12 [0,4194304] 0 2024-02-20T08:05:35.261 INFO:tasks.workunit.client.0.smithi123.stdout:4/571: readlink d3/d2c/d43/d34/l49 0 2024-02-20T08:05:35.263 INFO:tasks.workunit.client.0.smithi123.stdout:0/637: creat d2/dd/d4f/d7c/da4/db6/fce x:0 0 0 2024-02-20T08:05:35.268 INFO:tasks.workunit.client.0.smithi123.stdout:5/509: chown d0/d34/d48/d56/d25/c26 3058 1 2024-02-20T08:05:35.280 INFO:tasks.workunit.client.0.smithi123.stdout:9/560: creat d6/d2a/d27/d6f/fb9 x:0 0 0 2024-02-20T08:05:35.280 INFO:tasks.workunit.client.0.smithi123.stdout:9/561: stat d6/d19 0 2024-02-20T08:05:35.282 INFO:tasks.workunit.client.0.smithi123.stdout:9/562: read d6/d19/d1a/d2b/d28/d9a/f7b [3702974,93698] 0 2024-02-20T08:05:35.283 INFO:tasks.workunit.client.0.smithi123.stdout:9/563: chown d6/d2a/d27/d3c 16812 1 2024-02-20T08:05:35.284 INFO:tasks.workunit.client.0.smithi123.stdout:3/570: creat d0/d6/d1a/d1b/d1c/d3b/fcd x:0 0 0 2024-02-20T08:05:35.285 INFO:tasks.workunit.client.0.smithi123.stdout:2/627: dread d1a/d29/d39/f89 [0,4194304] 0 2024-02-20T08:05:35.286 INFO:tasks.workunit.client.0.smithi123.stdout:2/628: chown d1a/d29/d42/d4e/dbc 7590 1 2024-02-20T08:05:35.293 INFO:tasks.workunit.client.0.smithi123.stdout:9/564: mknod d6/d19/d1a/d2b/d28/d9a/dae/cba 0 2024-02-20T08:05:35.294 INFO:tasks.workunit.client.0.smithi123.stdout:9/565: chown d6/d19/d1a/d6d/f6e 57 1 2024-02-20T08:05:35.294 INFO:tasks.workunit.client.0.smithi123.stdout:6/813: write d0/d3e/d92/d56/f99 [1054181,32330] 0 2024-02-20T08:05:35.295 INFO:tasks.workunit.client.0.smithi123.stdout:4/572: symlink d3/d1e/d81/lc3 0 2024-02-20T08:05:35.302 INFO:tasks.workunit.client.0.smithi123.stdout:4/573: dwrite d3/d2c/d43/d26/d3e/f72 [0,4194304] 0 2024-02-20T08:05:35.310 INFO:tasks.workunit.client.0.smithi123.stdout:4/574: dwrite d3/d2c/d43/d26/d2e/f52 [0,4194304] 0 2024-02-20T08:05:35.310 INFO:tasks.workunit.client.0.smithi123.stdout:6/814: creat d0/d38/f10d x:0 0 0 2024-02-20T08:05:35.324 INFO:tasks.workunit.client.0.smithi123.stdout:3/571: dwrite d0/d6/d1a/d1b/d1c/d61/f5f [0,4194304] 0 2024-02-20T08:05:35.325 INFO:tasks.workunit.client.0.smithi123.stdout:3/572: stat d0/d6/d1a/d1b/d1c/d20/c75 0 2024-02-20T08:05:35.328 INFO:tasks.workunit.client.0.smithi123.stdout:6/815: rmdir d0/d3e/d40/d48/d7b 39 2024-02-20T08:05:35.330 INFO:tasks.workunit.client.0.smithi123.stdout:6/816: stat d0/d3e/d40/d90/d94/def 0 2024-02-20T08:05:35.331 INFO:tasks.workunit.client.0.smithi123.stdout:3/573: dread d0/d6/d34/fad [0,4194304] 0 2024-02-20T08:05:35.331 INFO:tasks.workunit.client.0.smithi123.stdout:6/817: readlink d0/d3e/d40/d48/d5d/dbf/ldc 0 2024-02-20T08:05:35.334 INFO:tasks.workunit.client.0.smithi123.stdout:2/629: mkdir d1a/da5/dd2 0 2024-02-20T08:05:35.335 INFO:tasks.workunit.client.0.smithi123.stdout:5/510: getdents d0/d13/d60 0 2024-02-20T08:05:35.338 INFO:tasks.workunit.client.0.smithi123.stdout:4/575: unlink d3/d2c/d43/d26/d2e/l66 0 2024-02-20T08:05:35.341 INFO:tasks.workunit.client.0.smithi123.stdout:5/511: dread d0/d34/d48/f53 [0,4194304] 0 2024-02-20T08:05:35.343 INFO:tasks.workunit.client.0.smithi123.stdout:6/818: rmdir d0/d9f/df1 39 2024-02-20T08:05:35.345 INFO:tasks.workunit.client.0.smithi123.stdout:5/512: dread d0/f19 [4194304,4194304] 0 2024-02-20T08:05:35.346 INFO:tasks.workunit.client.0.smithi123.stdout:5/513: dread - d0/d34/d67/d80/d84/f8f zero size 2024-02-20T08:05:35.347 INFO:tasks.workunit.client.0.smithi123.stdout:3/574: creat d0/d6/d1a/d1e/d49/fce x:0 0 0 2024-02-20T08:05:35.348 INFO:tasks.workunit.client.0.smithi123.stdout:5/514: stat d0/d34/d67/d80/d84/c9f 0 2024-02-20T08:05:35.350 INFO:tasks.workunit.client.0.smithi123.stdout:3/575: read d0/d6/d1a/d1b/db4/fc0 [2744935,2132] 0 2024-02-20T08:05:35.350 INFO:tasks.workunit.client.0.smithi123.stdout:2/630: chown d1a/f9a 184 1 2024-02-20T08:05:35.350 INFO:tasks.workunit.client.0.smithi123.stdout:3/576: fsync d0/f8c 0 2024-02-20T08:05:35.352 INFO:tasks.workunit.client.0.smithi123.stdout:3/577: write d0/d6/d1a/d1b/d1c/d61/f96 [3859209,53429] 0 2024-02-20T08:05:35.353 INFO:tasks.workunit.client.0.smithi123.stdout:4/576: dread d3/d18/d7d/d87/f9a [0,4194304] 0 2024-02-20T08:05:35.355 INFO:tasks.workunit.client.0.smithi123.stdout:9/566: getdents d6/d19/d1a/d6d/d7e 0 2024-02-20T08:05:35.360 INFO:tasks.workunit.client.0.smithi123.stdout:5/515: readlink d0/d34/d48/d56/d3e/l5b 0 2024-02-20T08:05:35.373 INFO:tasks.workunit.client.0.smithi123.stdout:3/578: mkdir d0/dd/d48/d8d/dcf 0 2024-02-20T08:05:35.380 INFO:tasks.workunit.client.0.smithi123.stdout:5/516: unlink d0/d34/d67/d80/d84/f8f 0 2024-02-20T08:05:35.381 INFO:tasks.workunit.client.0.smithi123.stdout:2/631: dread d1a/f28 [0,4194304] 0 2024-02-20T08:05:35.386 INFO:tasks.workunit.client.0.smithi123.stdout:5/517: dwrite d0/f11 [4194304,4194304] 0 2024-02-20T08:05:35.402 INFO:tasks.workunit.client.0.smithi123.stdout:7/477: sync 2024-02-20T08:05:35.418 INFO:tasks.workunit.client.0.smithi123.stdout:7/478: dread d0/d6/f57 [0,4194304] 0 2024-02-20T08:05:35.500 INFO:tasks.workunit.client.0.smithi123.stdout:5/518: mknod d0/d34/d67/d80/cac 0 2024-02-20T08:05:35.503 INFO:tasks.workunit.client.0.smithi123.stdout:7/479: symlink d0/db/d38/d47/d4a/d59/la9 0 2024-02-20T08:05:35.507 INFO:tasks.workunit.client.0.smithi123.stdout:9/567: rename d6/d19/d1a/d2b/d28/fa1 to d6/fbb 0 2024-02-20T08:05:35.508 INFO:tasks.workunit.client.0.smithi123.stdout:9/568: write d6/d2a/d27/f2f [904790,2799] 0 2024-02-20T08:05:35.509 INFO:tasks.workunit.client.0.smithi123.stdout:5/519: creat d0/fad x:0 0 0 2024-02-20T08:05:35.510 INFO:tasks.workunit.client.0.smithi123.stdout:9/569: stat d6/d19/d1a/d2b/d28/d9a/c18 0 2024-02-20T08:05:35.510 INFO:tasks.workunit.client.0.smithi123.stdout:5/520: chown d0/f8d 23831 1 2024-02-20T08:05:35.517 INFO:tasks.workunit.client.0.smithi123.stdout:7/480: dwrite d0/d6/dd/d52/f33 [0,4194304] 0 2024-02-20T08:05:35.518 INFO:tasks.workunit.client.0.smithi123.stdout:3/579: rename d0/d6/d1a/d1e/d49 to d0/d6/d1a/d1b/d57/dd0 0 2024-02-20T08:05:35.524 INFO:tasks.workunit.client.0.smithi123.stdout:9/570: stat d6/d19/d1a/d7c/f7d 0 2024-02-20T08:05:35.526 INFO:tasks.workunit.client.0.smithi123.stdout:5/521: fdatasync d0/d34/d67/d80/fab 0 2024-02-20T08:05:35.528 INFO:tasks.workunit.client.0.smithi123.stdout:5/522: dread d0/d34/d48/d4b/f89 [0,4194304] 0 2024-02-20T08:05:35.530 INFO:tasks.workunit.client.0.smithi123.stdout:5/523: chown d0/d34/d48/d4b/c98 109 1 2024-02-20T08:05:35.531 INFO:tasks.workunit.client.0.smithi123.stdout:2/632: rename d1a/d29/d5d/d8d/fc1 to d1a/d29/d42/d52/d98/da1/daa/fd3 0 2024-02-20T08:05:35.533 INFO:tasks.workunit.client.0.smithi123.stdout:3/580: chown d0/d6/d1a/d1b/d2a/c7e 4683 1 2024-02-20T08:05:35.534 INFO:tasks.workunit.client.0.smithi123.stdout:3/581: chown d0/d6/d1a/d1b/d1c/d20/fb6 139743189 1 2024-02-20T08:05:35.535 INFO:tasks.workunit.client.0.smithi123.stdout:3/582: truncate d0/d6/d1a/d4b/f93 273608 0 2024-02-20T08:05:35.539 INFO:tasks.workunit.client.0.smithi123.stdout:2/633: readlink d1a/l21 0 2024-02-20T08:05:35.542 INFO:tasks.workunit.client.0.smithi123.stdout:5/524: rename d0/d13/c35 to d0/d34/d67/cae 0 2024-02-20T08:05:35.545 INFO:tasks.workunit.client.0.smithi123.stdout:9/571: mkdir d6/dbc 0 2024-02-20T08:05:35.545 INFO:tasks.workunit.client.0.smithi123.stdout:9/572: dread - d6/d19/d1a/d6d/d7e/fac zero size 2024-02-20T08:05:35.548 INFO:tasks.workunit.client.0.smithi123.stdout:7/481: dread d0/d6/dd/d52/f3b [4194304,4194304] 0 2024-02-20T08:05:35.548 INFO:tasks.workunit.client.0.smithi123.stdout:7/482: fsync d0/d6/f31 0 2024-02-20T08:05:35.551 INFO:tasks.workunit.client.0.smithi123.stdout:3/583: write d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8b [1024875,108511] 0 2024-02-20T08:05:35.556 INFO:tasks.workunit.client.0.smithi123.stdout:7/483: dwrite d0/db/d38/d47/d4a/d59/f90 [0,4194304] 0 2024-02-20T08:05:35.564 INFO:tasks.workunit.client.0.smithi123.stdout:2/634: getdents d1a/d29/d5d/d97/da9 0 2024-02-20T08:05:35.567 INFO:tasks.workunit.client.0.smithi123.stdout:5/525: chown d0/d13/d27/d4e 15128872 1 2024-02-20T08:05:35.567 INFO:tasks.workunit.client.0.smithi123.stdout:3/584: dread d0/d6/d1a/d1e/f42 [0,4194304] 0 2024-02-20T08:05:35.569 INFO:tasks.workunit.client.0.smithi123.stdout:9/573: creat d6/d19/d1a/d2b/d65/d77/da2/fbd x:0 0 0 2024-02-20T08:05:35.573 INFO:tasks.workunit.client.0.smithi123.stdout:9/574: read d6/d2a/d27/f54 [1771684,102526] 0 2024-02-20T08:05:35.573 INFO:tasks.workunit.client.0.smithi123.stdout:0/638: sync 2024-02-20T08:05:35.573 INFO:tasks.workunit.client.0.smithi123.stdout:1/528: sync 2024-02-20T08:05:35.573 INFO:tasks.workunit.client.0.smithi123.stdout:8/563: sync 2024-02-20T08:05:35.575 INFO:tasks.workunit.client.0.smithi123.stdout:0/639: fsync d2/dd/d4f/fa6 0 2024-02-20T08:05:35.576 INFO:tasks.workunit.client.0.smithi123.stdout:9/575: write d6/d19/d1a/d2b/d28/d9a/f26 [92611,119677] 0 2024-02-20T08:05:35.576 INFO:tasks.workunit.client.0.smithi123.stdout:1/529: truncate d3/de/d14/d26/fa4 1124261 0 2024-02-20T08:05:35.576 INFO:tasks.workunit.client.0.smithi123.stdout:5/526: unlink d0/d34/l46 0 2024-02-20T08:05:35.583 INFO:tasks.workunit.client.0.smithi123.stdout:2/635: mkdir d1a/dd4 0 2024-02-20T08:05:35.587 INFO:tasks.workunit.client.0.smithi123.stdout:0/640: mkdir d2/dd/d4f/d6a/dcf 0 2024-02-20T08:05:35.588 INFO:tasks.workunit.client.0.smithi123.stdout:0/641: read d2/de/d1e/f22 [189850,33987] 0 2024-02-20T08:05:35.589 INFO:tasks.workunit.client.0.smithi123.stdout:1/530: stat d3/db/d41/l49 0 2024-02-20T08:05:35.595 INFO:tasks.workunit.client.0.smithi123.stdout:5/527: rename d0/d13/d27/d4e/l83 to d0/d34/d67/laf 0 2024-02-20T08:05:35.605 INFO:tasks.workunit.client.0.smithi123.stdout:1/531: fdatasync d3/db/d34/f1b 0 2024-02-20T08:05:35.607 INFO:tasks.workunit.client.0.smithi123.stdout:4/577: truncate d3/d2c/d5a/f6b 7538957 0 2024-02-20T08:05:35.608 INFO:tasks.workunit.client.0.smithi123.stdout:4/578: stat d3/d2c/d43/d26/d2e 0 2024-02-20T08:05:35.609 INFO:tasks.workunit.client.0.smithi123.stdout:5/528: dread d0/d13/f1e [0,4194304] 0 2024-02-20T08:05:35.610 INFO:tasks.workunit.client.0.smithi123.stdout:0/642: rename d2/de/d1e/d1f/fca to d2/de/d1e/d1f/dcb/fd0 0 2024-02-20T08:05:35.614 INFO:tasks.workunit.client.0.smithi123.stdout:6/819: truncate d0/f84 3095929 0 2024-02-20T08:05:35.616 INFO:tasks.workunit.client.0.smithi123.stdout:5/529: dwrite d0/d34/f66 [0,4194304] 0 2024-02-20T08:05:35.617 INFO:tasks.workunit.client.0.smithi123.stdout:6/820: truncate d0/d3e/d40/d48/d79/f8b 354087 0 2024-02-20T08:05:35.621 INFO:tasks.workunit.client.0.smithi123.stdout:8/564: creat d6/d1c/fbc x:0 0 0 2024-02-20T08:05:35.626 INFO:tasks.workunit.client.0.smithi123.stdout:7/484: getdents d0/db/d38/d47/d4a/d59 0 2024-02-20T08:05:35.630 INFO:tasks.workunit.client.0.smithi123.stdout:1/532: rename d3/de/d14/d26/d2e/d54/d9f/lad to d3/de/d14/d2c/d45/d9d/lb9 0 2024-02-20T08:05:35.633 INFO:tasks.workunit.client.0.smithi123.stdout:0/643: symlink d2/dd/d4f/d61/ld1 0 2024-02-20T08:05:35.638 INFO:tasks.workunit.client.0.smithi123.stdout:5/530: symlink d0/lb0 0 2024-02-20T08:05:35.639 INFO:tasks.workunit.client.0.smithi123.stdout:5/531: stat d0/d34/d48/d56/d25/f8e 0 2024-02-20T08:05:35.639 INFO:tasks.workunit.client.0.smithi123.stdout:5/532: chown d0/l10 179 1 2024-02-20T08:05:35.640 INFO:tasks.workunit.client.0.smithi123.stdout:6/821: chown d0/d3e/d40/d48/d7b/ff2 17849 1 2024-02-20T08:05:35.643 INFO:tasks.workunit.client.0.smithi123.stdout:7/485: creat d0/d6/dd/d52/d26/d7b/faa x:0 0 0 2024-02-20T08:05:35.645 INFO:tasks.workunit.client.0.smithi123.stdout:5/533: dwrite d0/f8d [0,4194304] 0 2024-02-20T08:05:35.651 INFO:tasks.workunit.client.0.smithi123.stdout:1/533: dread - d3/de/d14/d26/f73 zero size 2024-02-20T08:05:35.658 INFO:tasks.workunit.client.0.smithi123.stdout:6/822: creat d0/d3e/d40/d48/d4a/f10e x:0 0 0 2024-02-20T08:05:35.663 INFO:tasks.workunit.client.0.smithi123.stdout:5/534: fdatasync d0/d34/d48/d56/d4c/f6b 0 2024-02-20T08:05:35.667 INFO:tasks.workunit.client.0.smithi123.stdout:0/644: symlink d2/de/d1e/d1f/dc0/ld2 0 2024-02-20T08:05:35.672 INFO:tasks.workunit.client.0.smithi123.stdout:5/535: unlink d0/d34/d48/d4b/d51/f8a 0 2024-02-20T08:05:35.677 INFO:tasks.workunit.client.0.smithi123.stdout:8/565: rename d6/d1c/d22/d4f to d6/dbd 0 2024-02-20T08:05:35.680 INFO:tasks.workunit.client.0.smithi123.stdout:0/645: creat d2/d3/d37/d5f/fd3 x:0 0 0 2024-02-20T08:05:35.682 INFO:tasks.workunit.client.0.smithi123.stdout:0/646: chown d2/de/d1e/d1f/f20 665519403 1 2024-02-20T08:05:35.684 INFO:tasks.workunit.client.0.smithi123.stdout:8/566: dwrite d6/d1c/d22/f48 [0,4194304] 0 2024-02-20T08:05:35.689 INFO:tasks.workunit.client.0.smithi123.stdout:1/534: rename d3/de/d14/d2c/f32 to d3/db/d34/d74/d6f/fba 0 2024-02-20T08:05:35.691 INFO:tasks.workunit.client.0.smithi123.stdout:6/823: getdents d0/d9f/df1/d10c 0 2024-02-20T08:05:35.693 INFO:tasks.workunit.client.0.smithi123.stdout:0/647: creat d2/dd/fd4 x:0 0 0 2024-02-20T08:05:35.694 INFO:tasks.workunit.client.0.smithi123.stdout:3/585: truncate d0/d6/d32/f33 1548096 0 2024-02-20T08:05:35.698 INFO:tasks.workunit.client.0.smithi123.stdout:1/535: mkdir d3/de/d14/d26/d56/dbb 0 2024-02-20T08:05:35.699 INFO:tasks.workunit.client.0.smithi123.stdout:1/536: readlink d3/de/l9a 0 2024-02-20T08:05:35.700 INFO:tasks.workunit.client.0.smithi123.stdout:1/537: fsync d3/de/d14/d36/f78 0 2024-02-20T08:05:35.700 INFO:tasks.workunit.client.0.smithi123.stdout:6/824: symlink d0/d3e/d92/d56/d57/l10f 0 2024-02-20T08:05:35.702 INFO:tasks.workunit.client.0.smithi123.stdout:0/648: stat d2/f15 0 2024-02-20T08:05:35.704 INFO:tasks.workunit.client.0.smithi123.stdout:5/536: creat d0/d34/d48/d56/fb1 x:0 0 0 2024-02-20T08:05:35.711 INFO:tasks.workunit.client.0.smithi123.stdout:0/649: dwrite d2/d3/f24 [0,4194304] 0 2024-02-20T08:05:35.714 INFO:tasks.workunit.client.0.smithi123.stdout:5/537: dwrite d0/fad [0,4194304] 0 2024-02-20T08:05:35.714 INFO:tasks.workunit.client.0.smithi123.stdout:6/825: unlink d0/d3e/d92/d56/d57/c8e 0 2024-02-20T08:05:35.716 INFO:tasks.workunit.client.0.smithi123.stdout:5/538: chown d0/d13/c1c 11 1 2024-02-20T08:05:35.716 INFO:tasks.workunit.client.0.smithi123.stdout:5/539: fsync d0/d34/d48/d56/d3e/f41 0 2024-02-20T08:05:35.717 INFO:tasks.workunit.client.0.smithi123.stdout:5/540: chown d0/d34/d67/f7b 7 1 2024-02-20T08:05:35.722 INFO:tasks.workunit.client.0.smithi123.stdout:3/586: dread d0/d6/d1a/d1b/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:35.722 INFO:tasks.workunit.client.0.smithi123.stdout:9/576: truncate d6/d19/d1a/d7f/f5d 1641249 0 2024-02-20T08:05:35.727 INFO:tasks.workunit.client.0.smithi123.stdout:6/826: stat d0/d3e/d40/d48/d7b/lb8 0 2024-02-20T08:05:35.728 INFO:tasks.workunit.client.0.smithi123.stdout:5/541: chown d0/d13/f81 20860 1 2024-02-20T08:05:35.730 INFO:tasks.workunit.client.0.smithi123.stdout:3/587: mkdir d0/d6/d1a/d1b/d1c/d61/dd1 0 2024-02-20T08:05:35.730 INFO:tasks.workunit.client.0.smithi123.stdout:5/542: write d0/d34/d48/d56/d25/f76 [905917,15814] 0 2024-02-20T08:05:35.732 INFO:tasks.workunit.client.0.smithi123.stdout:0/650: mkdir d2/dd5 0 2024-02-20T08:05:35.733 INFO:tasks.workunit.client.0.smithi123.stdout:0/651: write d2/dd/d4f/d61/f7d [337636,63680] 0 2024-02-20T08:05:35.734 INFO:tasks.workunit.client.0.smithi123.stdout:1/538: creat d3/de/d14/d2c/fbc x:0 0 0 2024-02-20T08:05:35.741 INFO:tasks.workunit.client.0.smithi123.stdout:0/652: symlink d2/dd/d4f/ld6 0 2024-02-20T08:05:35.741 INFO:tasks.workunit.client.0.smithi123.stdout:5/543: dread d0/d34/d48/d4b/f4f [0,4194304] 0 2024-02-20T08:05:35.744 INFO:tasks.workunit.client.0.smithi123.stdout:1/539: rename d3/fa to d3/de/fbd 0 2024-02-20T08:05:35.745 INFO:tasks.workunit.client.0.smithi123.stdout:1/540: chown d3/de/d14/d26/d2e/d54/d9f 28978 1 2024-02-20T08:05:35.745 INFO:tasks.workunit.client.0.smithi123.stdout:3/588: mknod d0/dd/d48/cd2 0 2024-02-20T08:05:35.746 INFO:tasks.workunit.client.0.smithi123.stdout:3/589: stat d0/d6/d1a/d1b/d1c/d61/l66 0 2024-02-20T08:05:35.747 INFO:tasks.workunit.client.0.smithi123.stdout:3/590: write d0/d6/f2e [4226583,77882] 0 2024-02-20T08:05:35.748 INFO:tasks.workunit.client.0.smithi123.stdout:3/591: readlink d0/d6/d1a/d1b/d9d/l94 0 2024-02-20T08:05:35.750 INFO:tasks.workunit.client.0.smithi123.stdout:3/592: read d0/d6/d1a/d1b/d1c/d21/f3e [1413555,40716] 0 2024-02-20T08:05:35.751 INFO:tasks.workunit.client.0.smithi123.stdout:5/544: mknod d0/d13/d27/d4e/cb2 0 2024-02-20T08:05:35.752 INFO:tasks.workunit.client.0.smithi123.stdout:4/579: write d3/d2c/d5a/d7e/f82 [160554,66676] 0 2024-02-20T08:05:35.757 INFO:tasks.workunit.client.0.smithi123.stdout:1/541: getdents d3/de/d14/d26/d56/dbb 0 2024-02-20T08:05:35.758 INFO:tasks.workunit.client.0.smithi123.stdout:3/593: dread d0/d6/d1a/d1b/d1c/d20/fb6 [0,4194304] 0 2024-02-20T08:05:35.761 INFO:tasks.workunit.client.0.smithi123.stdout:4/580: write d3/d1e/f5b [2769264,80685] 0 2024-02-20T08:05:35.765 INFO:tasks.workunit.client.0.smithi123.stdout:5/545: dwrite d0/d13/d27/d4e/d9b/fa0 [0,4194304] 0 2024-02-20T08:05:35.765 INFO:tasks.workunit.client.0.smithi123.stdout:3/594: creat d0/d6/d1a/d1b/d9d/fd3 x:0 0 0 2024-02-20T08:05:35.768 INFO:tasks.workunit.client.0.smithi123.stdout:2/636: sync 2024-02-20T08:05:35.769 INFO:tasks.workunit.client.0.smithi123.stdout:1/542: mkdir d3/de/d14/d26/d2e/d54/d9f/dbe 0 2024-02-20T08:05:35.771 INFO:tasks.workunit.client.0.smithi123.stdout:7/486: dwrite d0/d6/d7/f4e [0,4194304] 0 2024-02-20T08:05:35.778 INFO:tasks.workunit.client.0.smithi123.stdout:2/637: rmdir d1a/d4f 39 2024-02-20T08:05:35.780 INFO:tasks.workunit.client.0.smithi123.stdout:0/653: dread d2/d3/d37/d5f/f92 [0,4194304] 0 2024-02-20T08:05:35.784 INFO:tasks.workunit.client.0.smithi123.stdout:1/543: mknod d3/de/d14/d26/d2e/d54/d9f/dbe/cbf 0 2024-02-20T08:05:35.785 INFO:tasks.workunit.client.0.smithi123.stdout:4/581: dwrite d3/d2c/d43/d34/f37 [0,4194304] 0 2024-02-20T08:05:35.786 INFO:tasks.workunit.client.0.smithi123.stdout:2/638: write d1a/d29/d5d/d8d/fa7 [695165,61422] 0 2024-02-20T08:05:35.786 INFO:tasks.workunit.client.0.smithi123.stdout:3/595: dwrite d0/d6/d1a/d1b/db4/fc6 [0,4194304] 0 2024-02-20T08:05:35.790 INFO:tasks.workunit.client.0.smithi123.stdout:0/654: creat d2/dd/d4f/d7c/da4/d28/fd7 x:0 0 0 2024-02-20T08:05:35.795 INFO:tasks.workunit.client.0.smithi123.stdout:7/487: rename d0/d6/d29/l98 to d0/d6/dd/d52/d26/d9b/d61/lab 0 2024-02-20T08:05:35.797 INFO:tasks.workunit.client.0.smithi123.stdout:2/639: creat d1a/d7f/fd5 x:0 0 0 2024-02-20T08:05:35.800 INFO:tasks.workunit.client.0.smithi123.stdout:0/655: rmdir d2/d3 39 2024-02-20T08:05:35.800 INFO:tasks.workunit.client.0.smithi123.stdout:4/582: dread d3/d2c/d43/d26/d2e/f52 [0,4194304] 0 2024-02-20T08:05:35.804 INFO:tasks.workunit.client.0.smithi123.stdout:1/544: truncate d3/db/f38 1528235 0 2024-02-20T08:05:35.804 INFO:tasks.workunit.client.0.smithi123.stdout:4/583: stat d3/d18/d7d/d8b 0 2024-02-20T08:05:35.807 INFO:tasks.workunit.client.0.smithi123.stdout:7/488: dwrite d0/d6/dd/d52/f33 [0,4194304] 0 2024-02-20T08:05:35.807 INFO:tasks.workunit.client.0.smithi123.stdout:4/584: dread - d3/d18/d7d/d8b/f9d zero size 2024-02-20T08:05:35.813 INFO:tasks.workunit.client.0.smithi123.stdout:3/596: rename d0/d6/d1a/d1b/d1c/d20/f31 to d0/d6/d1a/d1b/d57/fd4 0 2024-02-20T08:05:35.814 INFO:tasks.workunit.client.0.smithi123.stdout:8/567: truncate d6/d32/d95/f3a 3205944 0 2024-02-20T08:05:35.815 INFO:tasks.workunit.client.0.smithi123.stdout:8/568: read d6/f2f [2052209,115800] 0 2024-02-20T08:05:35.818 INFO:tasks.workunit.client.0.smithi123.stdout:8/569: read d6/f3b [1340016,16145] 0 2024-02-20T08:05:35.820 INFO:tasks.workunit.client.0.smithi123.stdout:1/545: rmdir d3/de/d14/d2c/d45/d9d 39 2024-02-20T08:05:35.822 INFO:tasks.workunit.client.0.smithi123.stdout:4/585: creat d3/d1e/fc4 x:0 0 0 2024-02-20T08:05:35.823 INFO:tasks.workunit.client.0.smithi123.stdout:4/586: chown d3/d18/d6c/l74 1 1 2024-02-20T08:05:35.829 INFO:tasks.workunit.client.0.smithi123.stdout:7/489: dread d0/d6/dd/d52/d26/d7b/f7e [0,4194304] 0 2024-02-20T08:05:35.830 INFO:tasks.workunit.client.0.smithi123.stdout:7/490: chown d0/d6/dd/d52/f51 15 1 2024-02-20T08:05:35.830 INFO:tasks.workunit.client.0.smithi123.stdout:6/827: write d0/d3e/d40/d90/d94/fcf [693096,64173] 0 2024-02-20T08:05:35.833 INFO:tasks.workunit.client.0.smithi123.stdout:9/577: truncate d6/d19/d1a/f71 165707 0 2024-02-20T08:05:35.835 INFO:tasks.workunit.client.0.smithi123.stdout:8/570: unlink d6/d1c/d22/l24 0 2024-02-20T08:05:35.840 INFO:tasks.workunit.client.0.smithi123.stdout:4/587: symlink d3/d1e/d81/lc5 0 2024-02-20T08:05:35.849 INFO:tasks.workunit.client.0.smithi123.stdout:7/491: dwrite d0/d6/dd/d52/f51 [0,4194304] 0 2024-02-20T08:05:35.852 INFO:tasks.workunit.client.0.smithi123.stdout:1/546: creat d3/db/d34/db4/fc0 x:0 0 0 2024-02-20T08:05:35.857 INFO:tasks.workunit.client.0.smithi123.stdout:8/571: getdents d6/d1c/d22/d8c/da2 0 2024-02-20T08:05:35.859 INFO:tasks.workunit.client.0.smithi123.stdout:5/546: truncate d0/d13/d27/d4e/d9b/fa0 1255136 0 2024-02-20T08:05:35.864 INFO:tasks.workunit.client.0.smithi123.stdout:8/572: unlink d6/d32/fae 0 2024-02-20T08:05:35.874 INFO:tasks.workunit.client.0.smithi123.stdout:8/573: mknod d6/dbd/d5b/d8f/cbe 0 2024-02-20T08:05:35.877 INFO:tasks.workunit.client.0.smithi123.stdout:0/656: dwrite d2/dd/d4f/d61/f7b [4194304,4194304] 0 2024-02-20T08:05:35.878 INFO:tasks.workunit.client.0.smithi123.stdout:0/657: chown d2/dd/l1d 1 1 2024-02-20T08:05:35.879 INFO:tasks.workunit.client.0.smithi123.stdout:0/658: fdatasync d2/dd/d4f/d7c/d82/f96 0 2024-02-20T08:05:35.879 INFO:tasks.workunit.client.0.smithi123.stdout:1/547: rename d3/de/d14/d26/d56/f91 to d3/db/fc1 0 2024-02-20T08:05:35.882 INFO:tasks.workunit.client.0.smithi123.stdout:7/492: link d0/d6/dd/d52/d35/d9c/f56 d0/d6/dd/d52/fac 0 2024-02-20T08:05:35.883 INFO:tasks.workunit.client.0.smithi123.stdout:2/640: truncate d1a/d29/d42/d52/f7c 254955 0 2024-02-20T08:05:35.894 INFO:tasks.workunit.client.0.smithi123.stdout:1/548: fsync d3/de/d14/d2c/fb5 0 2024-02-20T08:05:35.895 INFO:tasks.workunit.client.0.smithi123.stdout:0/659: dwrite d2/d3/d37/d9d/fa1 [0,4194304] 0 2024-02-20T08:05:35.898 INFO:tasks.workunit.client.0.smithi123.stdout:0/660: truncate d2/de/d1e/d1f/fbf 62381 0 2024-02-20T08:05:35.900 INFO:tasks.workunit.client.0.smithi123.stdout:2/641: mkdir d1a/d29/d42/d52/d98/dd6 0 2024-02-20T08:05:35.901 INFO:tasks.workunit.client.0.smithi123.stdout:3/597: write d0/d6/d1a/d1b/db4/fc0 [228943,13820] 0 2024-02-20T08:05:35.902 INFO:tasks.workunit.client.0.smithi123.stdout:1/549: dwrite d3/de/d14/d36/f3d [4194304,4194304] 0 2024-02-20T08:05:35.904 INFO:tasks.workunit.client.0.smithi123.stdout:3/598: stat d0/d6/d1a/d1b/d57/dd0/daa 0 2024-02-20T08:05:35.905 INFO:tasks.workunit.client.0.smithi123.stdout:3/599: write d0/d6/d1a/d1b/d57/fd4 [4027036,65568] 0 2024-02-20T08:05:35.908 INFO:tasks.workunit.client.0.smithi123.stdout:8/574: creat d6/dbd/d5b/d8f/d98/fbf x:0 0 0 2024-02-20T08:05:35.910 INFO:tasks.workunit.client.0.smithi123.stdout:7/493: creat d0/d6/dd/d97/fad x:0 0 0 2024-02-20T08:05:35.912 INFO:tasks.workunit.client.0.smithi123.stdout:0/661: creat d2/d54/d78/fd8 x:0 0 0 2024-02-20T08:05:35.912 INFO:tasks.workunit.client.0.smithi123.stdout:9/578: write d6/d19/d1a/d31/f75 [671169,89169] 0 2024-02-20T08:05:35.914 INFO:tasks.workunit.client.0.smithi123.stdout:3/600: fdatasync d0/d6/d1a/d1b/d57/fd4 0 2024-02-20T08:05:35.915 INFO:tasks.workunit.client.0.smithi123.stdout:7/494: write d0/d6/dd/d52/d35/d9c/f36 [1861918,83387] 0 2024-02-20T08:05:35.916 INFO:tasks.workunit.client.0.smithi123.stdout:6/828: dwrite d0/d3e/f7c [0,4194304] 0 2024-02-20T08:05:35.917 INFO:tasks.workunit.client.0.smithi123.stdout:7/495: chown d0/f3d 25 1 2024-02-20T08:05:35.918 INFO:tasks.workunit.client.0.smithi123.stdout:5/547: rename d0/d34/d48/d56/d25/f59 to d0/d34/d48/d56/fb3 0 2024-02-20T08:05:35.918 INFO:tasks.workunit.client.0.smithi123.stdout:3/601: stat d0/d6/d1a/d1b/f22 0 2024-02-20T08:05:35.925 INFO:tasks.workunit.client.0.smithi123.stdout:3/602: dread d0/d6/d1a/d1b/d1c/d20/fb6 [0,4194304] 0 2024-02-20T08:05:35.926 INFO:tasks.workunit.client.0.smithi123.stdout:4/588: write d3/d2c/d43/f75 [3467366,99370] 0 2024-02-20T08:05:35.940 INFO:tasks.workunit.client.0.smithi123.stdout:6/829: unlink d0/d3e/d92/d56/d89/d73/lea 0 2024-02-20T08:05:35.942 INFO:tasks.workunit.client.0.smithi123.stdout:7/496: read d0/d6/dd/d52/fac [392754,96558] 0 2024-02-20T08:05:35.942 INFO:tasks.workunit.client.0.smithi123.stdout:7/497: fsync d0/d23/f8a 0 2024-02-20T08:05:35.944 INFO:tasks.workunit.client.0.smithi123.stdout:7/498: write d0/d6/dd/d52/d35/d9c/f36 [1789161,44292] 0 2024-02-20T08:05:35.945 INFO:tasks.workunit.client.0.smithi123.stdout:7/499: chown d0/db/d21/d42/c1c 10660965 1 2024-02-20T08:05:35.947 INFO:tasks.workunit.client.0.smithi123.stdout:2/642: creat d1a/d29/d42/d52/d98/dd6/fd7 x:0 0 0 2024-02-20T08:05:35.948 INFO:tasks.workunit.client.0.smithi123.stdout:2/643: chown d1a/d29/d42/fb1 3899059 1 2024-02-20T08:05:35.956 INFO:tasks.workunit.client.0.smithi123.stdout:5/548: rename d0/d13/d27/d37/c74 to d0/d34/d48/d4b/d51/cb4 0 2024-02-20T08:05:35.956 INFO:tasks.workunit.client.0.smithi123.stdout:5/549: fsync d0/d34/d48/d56/d25/f5f 0 2024-02-20T08:05:35.959 INFO:tasks.workunit.client.0.smithi123.stdout:7/500: creat d0/d6/dd/d52/d35/d9c/d70/fae x:0 0 0 2024-02-20T08:05:35.961 INFO:tasks.workunit.client.0.smithi123.stdout:1/550: creat d3/fc2 x:0 0 0 2024-02-20T08:05:35.963 INFO:tasks.workunit.client.0.smithi123.stdout:2/644: creat d1a/d29/d42/d80/da3/fd8 x:0 0 0 2024-02-20T08:05:35.963 INFO:tasks.workunit.client.0.smithi123.stdout:7/501: dread d0/db/d38/d47/d4a/d59/f90 [0,4194304] 0 2024-02-20T08:05:35.969 INFO:tasks.workunit.client.0.smithi123.stdout:5/550: creat d0/d13/d27/d4e/d9b/fb5 x:0 0 0 2024-02-20T08:05:35.969 INFO:tasks.workunit.client.0.smithi123.stdout:7/502: dwrite d0/d23/f4f [0,4194304] 0 2024-02-20T08:05:35.971 INFO:tasks.workunit.client.0.smithi123.stdout:7/503: stat d0/db/d21/c8c 0 2024-02-20T08:05:35.971 INFO:tasks.workunit.client.0.smithi123.stdout:7/504: readlink d0/d6/dd/d52/l81 0 2024-02-20T08:05:35.973 INFO:tasks.workunit.client.0.smithi123.stdout:8/575: write d6/f2f [111384,101452] 0 2024-02-20T08:05:35.975 INFO:tasks.workunit.client.0.smithi123.stdout:2/645: write d1a/d29/d39/f65 [1658021,113250] 0 2024-02-20T08:05:35.977 INFO:tasks.workunit.client.0.smithi123.stdout:2/646: write d1a/d29/d42/d52/f56 [1323147,46847] 0 2024-02-20T08:05:35.983 INFO:tasks.workunit.client.0.smithi123.stdout:9/579: dwrite d6/fb [4194304,4194304] 0 2024-02-20T08:05:35.984 INFO:tasks.workunit.client.0.smithi123.stdout:9/580: stat d6/d19/d1a/d31/c4d 0 2024-02-20T08:05:35.984 INFO:tasks.workunit.client.0.smithi123.stdout:7/505: fdatasync d0/db/d38/d47/d4a/d59/f90 0 2024-02-20T08:05:35.986 INFO:tasks.workunit.client.0.smithi123.stdout:9/581: write d6/d19/d1a/f6a [1337132,53487] 0 2024-02-20T08:05:35.987 INFO:tasks.workunit.client.0.smithi123.stdout:8/576: rename d6/dbd/d5b/d8f/d98/fbf to d6/d32/d95/d7d/dab/fc0 0 2024-02-20T08:05:35.988 INFO:tasks.workunit.client.0.smithi123.stdout:6/830: getdents d0/d3e/d40/d48/daa/ddf 0 2024-02-20T08:05:35.989 INFO:tasks.workunit.client.0.smithi123.stdout:3/603: write d0/d6/d1a/d1b/d1c/d21/f3e [4768156,120737] 0 2024-02-20T08:05:35.990 INFO:tasks.workunit.client.0.smithi123.stdout:6/831: chown d0/d3e/d92/la5 1390 1 2024-02-20T08:05:35.994 INFO:tasks.workunit.client.0.smithi123.stdout:9/582: dwrite d6/d19/d1a/d2b/d28/f64 [0,4194304] 0 2024-02-20T08:05:35.994 INFO:tasks.workunit.client.0.smithi123.stdout:2/647: readlink d1a/l6e 0 2024-02-20T08:05:35.995 INFO:tasks.workunit.client.0.smithi123.stdout:5/551: symlink d0/d34/d48/d56/lb6 0 2024-02-20T08:05:35.997 INFO:tasks.workunit.client.0.smithi123.stdout:7/506: read d0/f64 [3506565,41048] 0 2024-02-20T08:05:35.997 INFO:tasks.workunit.client.0.smithi123.stdout:1/551: creat d3/de/d14/fc3 x:0 0 0 2024-02-20T08:05:35.998 INFO:tasks.workunit.client.0.smithi123.stdout:5/552: write d0/d34/d48/f96 [925124,87944] 0 2024-02-20T08:05:35.999 INFO:tasks.workunit.client.0.smithi123.stdout:2/648: write d1a/d29/d39/f5f [9078201,2096] 0 2024-02-20T08:05:36.005 INFO:tasks.workunit.client.0.smithi123.stdout:3/604: creat d0/d6/d32/fd5 x:0 0 0 2024-02-20T08:05:36.007 INFO:tasks.workunit.client.0.smithi123.stdout:5/553: dwrite d0/d34/d67/d80/fab [0,4194304] 0 2024-02-20T08:05:36.009 INFO:tasks.workunit.client.0.smithi123.stdout:6/832: creat d0/d3e/d40/d48/d7b/de9/f110 x:0 0 0 2024-02-20T08:05:36.010 INFO:tasks.workunit.client.0.smithi123.stdout:9/583: unlink d6/d19/d1a/f6c 0 2024-02-20T08:05:36.014 INFO:tasks.workunit.client.0.smithi123.stdout:3/605: dread d0/d6/d1a/f6c [0,4194304] 0 2024-02-20T08:05:36.014 INFO:tasks.workunit.client.0.smithi123.stdout:1/552: readlink d3/db/d34/l22 0 2024-02-20T08:05:36.016 INFO:tasks.workunit.client.0.smithi123.stdout:1/553: fsync d3/de/d14/d2c/d4f/fac 0 2024-02-20T08:05:36.016 INFO:tasks.workunit.client.0.smithi123.stdout:1/554: chown d3/db/d7d 1 1 2024-02-20T08:05:36.033 INFO:tasks.workunit.client.0.smithi123.stdout:8/577: dwrite d6/d32/d95/f57 [0,4194304] 0 2024-02-20T08:05:36.035 INFO:tasks.workunit.client.0.smithi123.stdout:1/555: creat d3/db/d34/db4/fc4 x:0 0 0 2024-02-20T08:05:36.036 INFO:tasks.workunit.client.0.smithi123.stdout:5/554: dread d0/d13/f1b [0,4194304] 0 2024-02-20T08:05:36.037 INFO:tasks.workunit.client.0.smithi123.stdout:5/555: write d0/d34/d48/d56/d4c/f45 [3078594,41274] 0 2024-02-20T08:05:36.038 INFO:tasks.workunit.client.0.smithi123.stdout:9/584: creat d6/dbc/fbe x:0 0 0 2024-02-20T08:05:36.038 INFO:tasks.workunit.client.0.smithi123.stdout:5/556: chown d0/d13/d60 350983 1 2024-02-20T08:05:36.039 INFO:tasks.workunit.client.0.smithi123.stdout:2/649: creat d1a/d29/d42/fd9 x:0 0 0 2024-02-20T08:05:36.041 INFO:tasks.workunit.client.0.smithi123.stdout:3/606: rename d0/dd/d48/d8d/cb3 to d0/d6/d1a/d62/d82/da2/cd6 0 2024-02-20T08:05:36.042 INFO:tasks.workunit.client.0.smithi123.stdout:7/507: link d0/d23/fa8 d0/db/d38/d47/d4a/faf 0 2024-02-20T08:05:36.043 INFO:tasks.workunit.client.0.smithi123.stdout:7/508: fdatasync d0/d6/dd/d52/d35/f74 0 2024-02-20T08:05:36.045 INFO:tasks.workunit.client.0.smithi123.stdout:8/578: rename d6/d32/d95/d7d/dab/faa to d6/d32/d95/d7d/dab/fc1 0 2024-02-20T08:05:36.049 INFO:tasks.workunit.client.0.smithi123.stdout:2/650: readlink d1a/d4f/l5a 0 2024-02-20T08:05:36.052 INFO:tasks.workunit.client.0.smithi123.stdout:3/607: creat d0/d6/d1a/d1e/fd7 x:0 0 0 2024-02-20T08:05:36.053 INFO:tasks.workunit.client.0.smithi123.stdout:7/509: mknod d0/d6/cb0 0 2024-02-20T08:05:36.058 INFO:tasks.workunit.client.0.smithi123.stdout:5/557: getdents d0/d13/d60 0 2024-02-20T08:05:36.061 INFO:tasks.workunit.client.0.smithi123.stdout:1/556: creat d3/de/d14/d26/fc5 x:0 0 0 2024-02-20T08:05:36.063 INFO:tasks.workunit.client.0.smithi123.stdout:7/510: mkdir d0/d6/dd/d52/d26/d9b/d61/db1 0 2024-02-20T08:05:36.064 INFO:tasks.workunit.client.0.smithi123.stdout:7/511: dread - d0/db/d38/d47/fa3 zero size 2024-02-20T08:05:36.066 INFO:tasks.workunit.client.0.smithi123.stdout:7/512: truncate d0/d6/dd/d97/fad 985020 0 2024-02-20T08:05:36.067 INFO:tasks.workunit.client.0.smithi123.stdout:9/585: write d6/d19/d1a/d7f/f5d [2141216,30845] 0 2024-02-20T08:05:36.069 INFO:tasks.workunit.client.0.smithi123.stdout:3/608: mknod d0/d6/d1a/cd8 0 2024-02-20T08:05:36.071 INFO:tasks.workunit.client.0.smithi123.stdout:2/651: creat d1a/d29/d42/fda x:0 0 0 2024-02-20T08:05:36.072 INFO:tasks.workunit.client.0.smithi123.stdout:3/609: dread - d0/d6/d1a/d1b/d57/dd0/fce zero size 2024-02-20T08:05:36.075 INFO:tasks.workunit.client.0.smithi123.stdout:3/610: fdatasync d0/d6/d1a/d1b/d2a/f6f 0 2024-02-20T08:05:36.075 INFO:tasks.workunit.client.0.smithi123.stdout:2/652: write d1a/d29/d42/d73/f8b [652063,22162] 0 2024-02-20T08:05:36.077 INFO:tasks.workunit.client.0.smithi123.stdout:7/513: link d0/d6/dd/d52/d35/d9c/f36 d0/d6/d29/fb2 0 2024-02-20T08:05:36.078 INFO:tasks.workunit.client.0.smithi123.stdout:3/611: write d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8b [210632,68265] 0 2024-02-20T08:05:36.081 INFO:tasks.workunit.client.0.smithi123.stdout:9/586: rename d6/d19/d1a/d31/c47 to d6/d19/d1a/d7c/d81/cbf 0 2024-02-20T08:05:36.083 INFO:tasks.workunit.client.0.smithi123.stdout:7/514: dread d0/db/fa1 [0,4194304] 0 2024-02-20T08:05:36.085 INFO:tasks.workunit.client.0.smithi123.stdout:3/612: chown d0/d6/d1a/d1b/f22 78118 1 2024-02-20T08:05:36.085 INFO:tasks.workunit.client.0.smithi123.stdout:6/833: dread d0/f15 [0,4194304] 0 2024-02-20T08:05:36.085 INFO:tasks.workunit.client.0.smithi123.stdout:9/587: chown d6/d2a/d27/d6f 7029279 1 2024-02-20T08:05:36.086 INFO:tasks.workunit.client.0.smithi123.stdout:1/557: write d3/db/d34/f92 [234755,17670] 0 2024-02-20T08:05:36.089 INFO:tasks.workunit.client.0.smithi123.stdout:5/558: truncate d0/d34/d48/d56/d25/f8e 3304077 0 2024-02-20T08:05:36.091 INFO:tasks.workunit.client.0.smithi123.stdout:2/653: dwrite d1a/d29/d42/d80/da3/fa2 [0,4194304] 0 2024-02-20T08:05:36.091 INFO:tasks.workunit.client.0.smithi123.stdout:3/613: write d0/d6/d1a/d1b/d1c/d3b/fcd [624489,7952] 0 2024-02-20T08:05:36.093 INFO:tasks.workunit.client.0.smithi123.stdout:7/515: chown d0/db/d21/d42/d5f/d4b/c83 7029360 1 2024-02-20T08:05:36.096 INFO:tasks.workunit.client.0.smithi123.stdout:2/654: write f10 [1769220,67012] 0 2024-02-20T08:05:36.096 INFO:tasks.workunit.client.0.smithi123.stdout:3/614: readlink d0/d6/d1a/d1b/lb1 0 2024-02-20T08:05:36.096 INFO:tasks.workunit.client.0.smithi123.stdout:9/588: chown d6/d19/d1a/d2b/d28/d9a/d3d/l87 0 1 2024-02-20T08:05:36.096 INFO:tasks.workunit.client.0.smithi123.stdout:8/579: dread d6/f3b [0,4194304] 0 2024-02-20T08:05:36.097 INFO:tasks.workunit.client.0.smithi123.stdout:6/834: symlink d0/d3e/d40/d48/daa/ddf/l111 0 2024-02-20T08:05:36.099 INFO:tasks.workunit.client.0.smithi123.stdout:3/615: write d0/d6/d1a/d1b/d1c/d21/d64/fc7 [527936,45335] 0 2024-02-20T08:05:36.105 INFO:tasks.workunit.client.0.smithi123.stdout:3/616: dwrite d0/f24 [0,4194304] 0 2024-02-20T08:05:36.127 INFO:tasks.workunit.client.0.smithi123.stdout:5/559: dread d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:36.149 INFO:tasks.workunit.client.0.smithi123.stdout:1/558: creat d3/de/d14/d2c/d4f/fc6 x:0 0 0 2024-02-20T08:05:36.151 INFO:tasks.workunit.client.0.smithi123.stdout:7/516: symlink d0/d6/dd/d97/lb3 0 2024-02-20T08:05:36.154 INFO:tasks.workunit.client.0.smithi123.stdout:6/835: write d0/f28 [80642,51024] 0 2024-02-20T08:05:36.159 INFO:tasks.workunit.client.0.smithi123.stdout:8/580: mknod d6/dbd/d5b/d8f/d99/cc2 0 2024-02-20T08:05:36.162 INFO:tasks.workunit.client.0.smithi123.stdout:5/560: creat d0/d13/d27/d37/fb7 x:0 0 0 2024-02-20T08:05:36.166 INFO:tasks.workunit.client.0.smithi123.stdout:1/559: rename d3/db/f31 to d3/de/d14/d26/d2e/fc7 0 2024-02-20T08:05:36.167 INFO:tasks.workunit.client.0.smithi123.stdout:7/517: creat d0/d6/dd/fb4 x:0 0 0 2024-02-20T08:05:36.169 INFO:tasks.workunit.client.0.smithi123.stdout:3/617: dread d0/d6/d1a/d1b/d2a/f6f [0,4194304] 0 2024-02-20T08:05:36.170 INFO:tasks.workunit.client.0.smithi123.stdout:5/561: dwrite d0/d13/d27/d37/fb7 [0,4194304] 0 2024-02-20T08:05:36.171 INFO:tasks.workunit.client.0.smithi123.stdout:2/655: write d1a/d29/fcb [2371261,12613] 0 2024-02-20T08:05:36.172 INFO:tasks.workunit.client.0.smithi123.stdout:2/656: fdatasync f11 0 2024-02-20T08:05:36.173 INFO:tasks.workunit.client.0.smithi123.stdout:5/562: write d0/d13/d27/d37/fb7 [3586266,97588] 0 2024-02-20T08:05:36.175 INFO:tasks.workunit.client.0.smithi123.stdout:6/836: write d0/f30 [10676279,86093] 0 2024-02-20T08:05:36.177 INFO:tasks.workunit.client.0.smithi123.stdout:3/618: dread d0/dd/f38 [0,4194304] 0 2024-02-20T08:05:36.178 INFO:tasks.workunit.client.0.smithi123.stdout:5/563: dread - d0/d34/d67/d80/d84/fa2 zero size 2024-02-20T08:05:36.186 INFO:tasks.workunit.client.0.smithi123.stdout:3/619: dwrite d0/d6/d1a/d1b/d57/dd0/daa/fab [0,4194304] 0 2024-02-20T08:05:36.190 INFO:tasks.workunit.client.0.smithi123.stdout:9/589: getdents d6 0 2024-02-20T08:05:36.193 INFO:tasks.workunit.client.0.smithi123.stdout:5/564: mkdir d0/d34/d48/d4b/db8 0 2024-02-20T08:05:36.199 INFO:tasks.workunit.client.0.smithi123.stdout:1/560: write d3/db/f7e [765188,101395] 0 2024-02-20T08:05:36.199 INFO:tasks.workunit.client.0.smithi123.stdout:2/657: getdents d1a/d29/d42/d52/d98/da1/daa/dd0 0 2024-02-20T08:05:36.201 INFO:tasks.workunit.client.0.smithi123.stdout:3/620: readlink d0/d6/d1a/d1b/d1c/d3b/l47 0 2024-02-20T08:05:36.203 INFO:tasks.workunit.client.0.smithi123.stdout:9/590: symlink d6/d19/d1a/d31/lc0 0 2024-02-20T08:05:36.204 INFO:tasks.workunit.client.0.smithi123.stdout:9/591: truncate d6/d19/d1a/d31/f46 5039209 0 2024-02-20T08:05:36.204 INFO:tasks.workunit.client.0.smithi123.stdout:5/565: rmdir d0/d34/d48/d56/d25 39 2024-02-20T08:05:36.206 INFO:tasks.workunit.client.0.smithi123.stdout:6/837: creat d0/d3e/d40/d90/d94/f112 x:0 0 0 2024-02-20T08:05:36.208 INFO:tasks.workunit.client.0.smithi123.stdout:6/838: dread d0/d3e/d40/d48/d79/f8b [0,4194304] 0 2024-02-20T08:05:36.208 INFO:tasks.workunit.client.0.smithi123.stdout:1/561: creat d3/db/d34/fc8 x:0 0 0 2024-02-20T08:05:36.212 INFO:tasks.workunit.client.0.smithi123.stdout:3/621: mkdir d0/d6/d1a/d1b/d1c/d21/dd9 0 2024-02-20T08:05:36.214 INFO:tasks.workunit.client.0.smithi123.stdout:5/566: symlink d0/lb9 0 2024-02-20T08:05:36.214 INFO:tasks.workunit.client.0.smithi123.stdout:6/839: dwrite d0/d3e/d40/d48/d4a/fbe [0,4194304] 0 2024-02-20T08:05:36.215 INFO:tasks.workunit.client.0.smithi123.stdout:5/567: stat d0/d34/d48/d56/d4c/la8 0 2024-02-20T08:05:36.216 INFO:tasks.workunit.client.0.smithi123.stdout:9/592: symlink d6/d19/d1a/d31/lc1 0 2024-02-20T08:05:36.220 INFO:tasks.workunit.client.0.smithi123.stdout:1/562: creat d3/de/d14/d2c/d4f/fc9 x:0 0 0 2024-02-20T08:05:36.221 INFO:tasks.workunit.client.0.smithi123.stdout:5/568: dwrite d0/d34/f66 [0,4194304] 0 2024-02-20T08:05:36.227 INFO:tasks.workunit.client.0.smithi123.stdout:6/840: readlink d0/l37 0 2024-02-20T08:05:36.232 INFO:tasks.workunit.client.0.smithi123.stdout:1/563: rmdir d3/de/d14/d2c/d45 39 2024-02-20T08:05:36.234 INFO:tasks.workunit.client.0.smithi123.stdout:2/658: rmdir d1a/d29/d5d/d8d/db4 0 2024-02-20T08:05:36.236 INFO:tasks.workunit.client.0.smithi123.stdout:5/569: unlink d0/d13/f1b 0 2024-02-20T08:05:36.237 INFO:tasks.workunit.client.0.smithi123.stdout:5/570: readlink d0/d34/d48/d4b/d51/l6c 0 2024-02-20T08:05:36.238 INFO:tasks.workunit.client.0.smithi123.stdout:6/841: mknod d0/d3e/d40/d48/d5d/dbf/de3/c113 0 2024-02-20T08:05:36.239 INFO:tasks.workunit.client.0.smithi123.stdout:6/842: chown d0/d3e/f7c 5413 1 2024-02-20T08:05:36.240 INFO:tasks.workunit.client.0.smithi123.stdout:9/593: mknod d6/d2a/d9d/cc2 0 2024-02-20T08:05:36.242 INFO:tasks.workunit.client.0.smithi123.stdout:1/564: chown d3/de/d14/d2c/d45/f4d 3502 1 2024-02-20T08:05:36.243 INFO:tasks.workunit.client.0.smithi123.stdout:1/565: chown d3/db/d34/c71 1298 1 2024-02-20T08:05:36.248 INFO:tasks.workunit.client.0.smithi123.stdout:6/843: creat d0/d3e/d40/d90/d102/f114 x:0 0 0 2024-02-20T08:05:36.250 INFO:tasks.workunit.client.0.smithi123.stdout:9/594: mknod d6/d2a/d27/d6f/d8b/cc3 0 2024-02-20T08:05:36.256 INFO:tasks.workunit.client.0.smithi123.stdout:2/659: getdents d1a/da5/dd2 0 2024-02-20T08:05:36.256 INFO:tasks.workunit.client.0.smithi123.stdout:6/844: dread d0/d38/f3a [0,4194304] 0 2024-02-20T08:05:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:35 smithi123 ceph-mon[29383]: pgmap v37: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 119 MiB/s wr, 282 op/s 2024-02-20T08:05:36.261 INFO:tasks.workunit.client.0.smithi123.stdout:9/595: unlink d6/d19/d1a/d6d/f92 0 2024-02-20T08:05:36.262 INFO:tasks.workunit.client.0.smithi123.stdout:9/596: truncate d6/d2a/d27/f5a 909808 0 2024-02-20T08:05:36.268 INFO:tasks.workunit.client.0.smithi123.stdout:2/660: rename d1a/d29/d42/d73/d8f/fab to d1a/d29/d42/dbb/fdb 0 2024-02-20T08:05:36.270 INFO:tasks.workunit.client.0.smithi123.stdout:3/622: write d0/d6/d1a/f6c [560256,83191] 0 2024-02-20T08:05:36.272 INFO:tasks.workunit.client.0.smithi123.stdout:3/623: stat d0/d6/d1a/d4b/fb5 0 2024-02-20T08:05:36.274 INFO:tasks.workunit.client.0.smithi123.stdout:3/624: write d0/d6/d1a/d1b/f83 [4224032,26373] 0 2024-02-20T08:05:36.276 INFO:tasks.workunit.client.0.smithi123.stdout:2/661: dwrite d1a/d7f/f91 [4194304,4194304] 0 2024-02-20T08:05:36.276 INFO:tasks.workunit.client.0.smithi123.stdout:3/625: readlink d0/d6/d1a/d4b/d95/d9f/la9 0 2024-02-20T08:05:36.282 INFO:tasks.workunit.client.0.smithi123.stdout:6/845: unlink d0/l1a 0 2024-02-20T08:05:36.289 INFO:tasks.workunit.client.0.smithi123.stdout:5/571: getdents d0/d34/d67/d80/d84 0 2024-02-20T08:05:36.298 INFO:tasks.workunit.client.0.smithi123.stdout:5/572: dread d0/d34/d48/d4b/f4f [0,4194304] 0 2024-02-20T08:05:36.299 INFO:tasks.workunit.client.0.smithi123.stdout:2/662: mknod d1a/d29/d42/d52/dcc/cdc 0 2024-02-20T08:05:36.300 INFO:tasks.workunit.client.0.smithi123.stdout:3/626: mkdir d0/d6/d1a/d1b/d1c/d61/dd1/dda 0 2024-02-20T08:05:36.303 INFO:tasks.workunit.client.0.smithi123.stdout:3/627: read d0/d6/d1a/d1b/d1c/d61/f96 [315327,75868] 0 2024-02-20T08:05:36.304 INFO:tasks.workunit.client.0.smithi123.stdout:9/597: link d6/d2a/l8c d6/d2a/d9d/lc4 0 2024-02-20T08:05:36.311 INFO:tasks.workunit.client.0.smithi123.stdout:1/566: dwrite d3/db/f38 [0,4194304] 0 2024-02-20T08:05:36.315 INFO:tasks.workunit.client.0.smithi123.stdout:2/663: dread d1a/d29/f35 [0,4194304] 0 2024-02-20T08:05:36.316 INFO:tasks.workunit.client.0.smithi123.stdout:1/567: dread d3/db/f7e [0,4194304] 0 2024-02-20T08:05:36.322 INFO:tasks.workunit.client.0.smithi123.stdout:5/573: creat d0/d34/d48/d56/d25/fba x:0 0 0 2024-02-20T08:05:36.329 INFO:tasks.workunit.client.0.smithi123.stdout:6/846: write d0/d3e/d40/d48/d79/f8b [788509,106762] 0 2024-02-20T08:05:36.335 INFO:tasks.workunit.client.0.smithi123.stdout:3/628: rename d0/d6/d1a/c2d to d0/d6/d1a/d1b/d1c/d3b/d43/d68/cdb 0 2024-02-20T08:05:36.336 INFO:tasks.workunit.client.0.smithi123.stdout:3/629: write d0/d6/d34/fbe [918496,81781] 0 2024-02-20T08:05:36.344 INFO:tasks.workunit.client.0.smithi123.stdout:2/664: truncate d1a/d4f/f53 3061126 0 2024-02-20T08:05:36.345 INFO:tasks.workunit.client.0.smithi123.stdout:5/574: dwrite d0/d34/d48/d56/d4c/f45 [0,4194304] 0 2024-02-20T08:05:36.347 INFO:tasks.workunit.client.0.smithi123.stdout:5/575: write d0/d34/d48/f61 [1098706,122322] 0 2024-02-20T08:05:36.348 INFO:tasks.workunit.client.0.smithi123.stdout:5/576: stat d0/d13/d27/d4e/f7f 0 2024-02-20T08:05:36.350 INFO:tasks.workunit.client.0.smithi123.stdout:9/598: write d6/f58 [715834,117820] 0 2024-02-20T08:05:36.355 INFO:tasks.workunit.client.0.smithi123.stdout:2/665: symlink d1a/d29/d39/ldd 0 2024-02-20T08:05:36.356 INFO:tasks.workunit.client.0.smithi123.stdout:2/666: write d1a/d29/d5d/d8d/fa7 [60642,5798] 0 2024-02-20T08:05:36.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:35 smithi194 ceph-mon[37804]: pgmap v37: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 119 MiB/s wr, 282 op/s 2024-02-20T08:05:36.429 INFO:tasks.workunit.client.0.smithi123.stdout:3/630: write d0/d6/d1a/d1b/d57/dd0/fbd [3296099,66809] 0 2024-02-20T08:05:36.429 INFO:tasks.workunit.client.0.smithi123.stdout:1/568: getdents d3/de/d14/d26 0 2024-02-20T08:05:36.432 INFO:tasks.workunit.client.0.smithi123.stdout:9/599: unlink d6/d2a/d9d/lc4 0 2024-02-20T08:05:36.436 INFO:tasks.workunit.client.0.smithi123.stdout:3/631: dwrite d0/d6/d1a/d1b/d2a/f6f [4194304,4194304] 0 2024-02-20T08:05:36.438 INFO:tasks.workunit.client.0.smithi123.stdout:9/600: dread d6/d19/d1a/d2b/d28/f64 [0,4194304] 0 2024-02-20T08:05:36.440 INFO:tasks.workunit.client.0.smithi123.stdout:9/601: readlink d6/d19/d1a/d2b/d28/d9a/l24 0 2024-02-20T08:05:36.460 INFO:tasks.workunit.client.0.smithi123.stdout:6/847: link d0/d3e/d92/d56/d89/d73/d75/dc3/ce6 d0/d3e/d40/d48/daa/c115 0 2024-02-20T08:05:36.463 INFO:tasks.workunit.client.0.smithi123.stdout:5/577: rename d0/d13 to d0/d34/d48/d56/dbb 0 2024-02-20T08:05:36.468 INFO:tasks.workunit.client.0.smithi123.stdout:9/602: rmdir d6/d19/d1a/d2b/d28/d9a/d3d/d32 39 2024-02-20T08:05:36.472 INFO:tasks.workunit.client.0.smithi123.stdout:5/578: symlink d0/d34/d67/d80/lbc 0 2024-02-20T08:05:36.477 INFO:tasks.workunit.client.0.smithi123.stdout:2/667: rename d1a/f1e to d1a/d29/d42/dc8/fde 0 2024-02-20T08:05:36.478 INFO:tasks.workunit.client.0.smithi123.stdout:5/579: dwrite d0/d34/d48/d56/d4c/d43/f90 [0,4194304] 0 2024-02-20T08:05:36.479 INFO:tasks.workunit.client.0.smithi123.stdout:5/580: write d0/d34/d48/d56/f62 [1260834,129997] 0 2024-02-20T08:05:36.481 INFO:tasks.workunit.client.0.smithi123.stdout:9/603: truncate d6/d19/d1a/f71 138944 0 2024-02-20T08:05:36.486 INFO:tasks.workunit.client.0.smithi123.stdout:1/569: rename d3/de/d14/d36/d59/f5b to d3/db/d34/d74/d6f/d63/fca 0 2024-02-20T08:05:36.486 INFO:tasks.workunit.client.0.smithi123.stdout:6/848: rename d0/d3e to d0/d3e/d92/db3/d116 22 2024-02-20T08:05:36.487 INFO:tasks.workunit.client.0.smithi123.stdout:2/668: rmdir d1a/da5 39 2024-02-20T08:05:36.488 INFO:tasks.workunit.client.0.smithi123.stdout:9/604: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/f57 [0,4194304] 0 2024-02-20T08:05:36.489 INFO:tasks.workunit.client.0.smithi123.stdout:9/605: stat d6/d19/d1a/d31/f75 0 2024-02-20T08:05:36.491 INFO:tasks.workunit.client.0.smithi123.stdout:5/581: creat d0/d34/d67/fbd x:0 0 0 2024-02-20T08:05:36.494 INFO:tasks.workunit.client.0.smithi123.stdout:6/849: fsync d0/f2c 0 2024-02-20T08:05:36.497 INFO:tasks.workunit.client.0.smithi123.stdout:1/570: fsync d3/de/d14/d2c/d4f/f64 0 2024-02-20T08:05:36.497 INFO:tasks.workunit.client.0.smithi123.stdout:1/571: readlink d3/db/d41/l4c 0 2024-02-20T08:05:36.498 INFO:tasks.workunit.client.0.smithi123.stdout:2/669: write d1a/d29/d42/d52/d98/da1/daa/fd3 [758107,96475] 0 2024-02-20T08:05:36.503 INFO:tasks.workunit.client.0.smithi123.stdout:5/582: chown d0/d34/d48/d56/dbb/d27/f63 4 1 2024-02-20T08:05:36.509 INFO:tasks.workunit.client.0.smithi123.stdout:2/670: rename d1a/d29/d42/d52/c6a to d1a/d29/d42/d80/da3/cdf 0 2024-02-20T08:05:36.513 INFO:tasks.workunit.client.0.smithi123.stdout:5/583: creat d0/d34/d67/fbe x:0 0 0 2024-02-20T08:05:36.516 INFO:tasks.workunit.client.0.smithi123.stdout:2/671: mkdir d1a/d29/d42/d80/da3/de0 0 2024-02-20T08:05:36.517 INFO:tasks.workunit.client.0.smithi123.stdout:6/850: creat d0/d9f/f117 x:0 0 0 2024-02-20T08:05:36.517 INFO:tasks.workunit.client.0.smithi123.stdout:6/851: chown d0/fe 1 1 2024-02-20T08:05:36.521 INFO:tasks.workunit.client.0.smithi123.stdout:2/672: fsync d1a/d29/d42/d4e/f7d 0 2024-02-20T08:05:36.522 INFO:tasks.workunit.client.0.smithi123.stdout:1/572: dread d3/f42 [0,4194304] 0 2024-02-20T08:05:36.522 INFO:tasks.workunit.client.0.smithi123.stdout:2/673: chown d1a/d29/c43 0 1 2024-02-20T08:05:36.523 INFO:tasks.workunit.client.0.smithi123.stdout:2/674: write d1a/d29/d42/d73/f8b [1028071,79529] 0 2024-02-20T08:05:36.524 INFO:tasks.workunit.client.0.smithi123.stdout:2/675: chown d1a/d29/d42/d52/l5b 317936727 1 2024-02-20T08:05:36.525 INFO:tasks.workunit.client.0.smithi123.stdout:6/852: mknod d0/c118 0 2024-02-20T08:05:36.525 INFO:tasks.workunit.client.0.smithi123.stdout:2/676: chown d1a/d29/d39/c40 30938610 1 2024-02-20T08:05:36.526 INFO:tasks.workunit.client.0.smithi123.stdout:1/573: fdatasync d3/db/d41/f4b 0 2024-02-20T08:05:36.527 INFO:tasks.workunit.client.0.smithi123.stdout:6/853: dread - d0/d3e/d92/d56/d57/fd4 zero size 2024-02-20T08:05:36.527 INFO:tasks.workunit.client.0.smithi123.stdout:2/677: truncate d1a/d29/d42/d4e/f78 1022035 0 2024-02-20T08:05:36.528 INFO:tasks.workunit.client.0.smithi123.stdout:1/574: fsync d3/db/fb1 0 2024-02-20T08:05:36.529 INFO:tasks.workunit.client.0.smithi123.stdout:2/678: chown d1a/d7f/f91 161 1 2024-02-20T08:05:36.529 INFO:tasks.workunit.client.0.smithi123.stdout:6/854: dread - d0/d3e/d92/d56/d89/d73/d75/dc3/fee zero size 2024-02-20T08:05:36.531 INFO:tasks.workunit.client.0.smithi123.stdout:1/575: symlink d3/db/d34/d74/d6f/d63/lcb 0 2024-02-20T08:05:36.533 INFO:tasks.workunit.client.0.smithi123.stdout:2/679: rename d1a/d29/d42/d73/d8f/lae to d1a/d29/d42/d4e/dbc/le1 0 2024-02-20T08:05:36.538 INFO:tasks.workunit.client.0.smithi123.stdout:2/680: symlink d1a/d29/d5d/d8d/le2 0 2024-02-20T08:05:36.539 INFO:tasks.workunit.client.0.smithi123.stdout:6/855: creat d0/d3e/d40/d48/f119 x:0 0 0 2024-02-20T08:05:36.543 INFO:tasks.workunit.client.0.smithi123.stdout:6/856: link d0/d3e/d92/d56/f71 d0/d3e/d40/d48/d79/f11a 0 2024-02-20T08:05:36.545 INFO:tasks.workunit.client.0.smithi123.stdout:6/857: truncate d0/d3e/d40/fdd 724976 0 2024-02-20T08:05:36.546 INFO:tasks.workunit.client.0.smithi123.stdout:6/858: dread - d0/d3e/d40/d90/d94/f112 zero size 2024-02-20T08:05:36.547 INFO:tasks.workunit.client.0.smithi123.stdout:9/606: unlink d6/d19/d1a/f71 0 2024-02-20T08:05:36.562 INFO:tasks.workunit.client.0.smithi123.stdout:6/859: dread d0/d5c/fca [4194304,4194304] 0 2024-02-20T08:05:36.667 INFO:tasks.workunit.client.0.smithi123.stdout:6/860: creat d0/d9f/df1/d10c/f11b x:0 0 0 2024-02-20T08:05:36.668 INFO:tasks.workunit.client.0.smithi123.stdout:9/607: link d6/d19/d1a/d2b/d28/d9a/d3d/d32/l5c d6/d19/d1a/d2b/d65/d77/da5/lc5 0 2024-02-20T08:05:36.670 INFO:tasks.workunit.client.0.smithi123.stdout:9/608: truncate d6/d19/d1a/d2b/d28/d9a/f68 846211 0 2024-02-20T08:05:36.670 INFO:tasks.workunit.client.0.smithi123.stdout:6/861: symlink d0/d3e/d92/db3/l11c 0 2024-02-20T08:05:36.671 INFO:tasks.workunit.client.0.smithi123.stdout:9/609: write d6/fb [2912802,40395] 0 2024-02-20T08:05:36.673 INFO:tasks.workunit.client.0.smithi123.stdout:1/576: truncate d3/de/d14/d2c/d4f/f64 1202423 0 2024-02-20T08:05:36.674 INFO:tasks.workunit.client.0.smithi123.stdout:1/577: readlink d3/de/l3c 0 2024-02-20T08:05:36.676 INFO:tasks.workunit.client.0.smithi123.stdout:6/862: mkdir d0/d11d 0 2024-02-20T08:05:36.678 INFO:tasks.workunit.client.0.smithi123.stdout:6/863: truncate d0/d9f/df1/fff 93615 0 2024-02-20T08:05:36.678 INFO:tasks.workunit.client.0.smithi123.stdout:1/578: mkdir d3/de/d14/d2c/d4f/dcc 0 2024-02-20T08:05:36.679 INFO:tasks.workunit.client.0.smithi123.stdout:5/584: write d0/d34/d48/d4b/d51/f72 [1976963,73346] 0 2024-02-20T08:05:36.681 INFO:tasks.workunit.client.0.smithi123.stdout:9/610: rename d6/d19/d1a/d2b/d28/d9a/d3d/db0 to d6/d19/d1a/dc6 0 2024-02-20T08:05:36.684 INFO:tasks.workunit.client.0.smithi123.stdout:1/579: chown d3/db/d34/d74/d6f/d63/fca 665 1 2024-02-20T08:05:36.688 INFO:tasks.workunit.client.0.smithi123.stdout:9/611: unlink d6/d19/d1a/d2b/d65/c9c 0 2024-02-20T08:05:36.691 INFO:tasks.workunit.client.0.smithi123.stdout:1/580: dread - d3/db/d34/d74/d6f/f83 zero size 2024-02-20T08:05:36.694 INFO:tasks.workunit.client.0.smithi123.stdout:6/864: dread d0/d38/fa6 [0,4194304] 0 2024-02-20T08:05:36.698 INFO:tasks.workunit.client.0.smithi123.stdout:5/585: link d0/d34/d48/d56/l21 d0/d34/lbf 0 2024-02-20T08:05:36.701 INFO:tasks.workunit.client.0.smithi123.stdout:5/586: dread d0/d34/d48/f96 [0,4194304] 0 2024-02-20T08:05:36.702 INFO:tasks.workunit.client.0.smithi123.stdout:5/587: stat d0/d34/d48 0 2024-02-20T08:05:36.702 INFO:tasks.workunit.client.0.smithi123.stdout:1/581: creat d3/d47/fcd x:0 0 0 2024-02-20T08:05:36.703 INFO:tasks.workunit.client.0.smithi123.stdout:1/582: write d3/d47/fa0 [916119,56583] 0 2024-02-20T08:05:36.713 INFO:tasks.workunit.client.0.smithi123.stdout:5/588: link d0/d34/d48/d56/dbb/d27/d4e/f7f d0/d34/d48/d56/fc0 0 2024-02-20T08:05:36.715 INFO:tasks.workunit.client.0.smithi123.stdout:5/589: getdents d0/d34/d67/d80/d84/da6 0 2024-02-20T08:05:36.717 INFO:tasks.workunit.client.0.smithi123.stdout:5/590: creat d0/d34/d48/d56/d25/fc1 x:0 0 0 2024-02-20T08:05:36.718 INFO:tasks.workunit.client.0.smithi123.stdout:9/612: write d6/d19/d1a/d2b/d28/d9a/f3b [1699502,130423] 0 2024-02-20T08:05:36.721 INFO:tasks.workunit.client.0.smithi123.stdout:5/591: mknod d0/d34/d48/d56/cc2 0 2024-02-20T08:05:36.722 INFO:tasks.workunit.client.0.smithi123.stdout:6/865: write d0/d3e/d40/d48/d5d/f62 [128263,79737] 0 2024-02-20T08:05:36.723 INFO:tasks.workunit.client.0.smithi123.stdout:9/613: symlink d6/d19/d1a/d2b/d28/d9a/dae/lc7 0 2024-02-20T08:05:36.723 INFO:tasks.workunit.client.0.smithi123.stdout:6/866: fsync d0/fe 0 2024-02-20T08:05:36.724 INFO:tasks.workunit.client.0.smithi123.stdout:5/592: chown d0/d34/d48/d4b/d51/cb4 12017 1 2024-02-20T08:05:36.725 INFO:tasks.workunit.client.0.smithi123.stdout:5/593: read d0/d34/d48/d56/d4c/d43/f90 [3880124,120374] 0 2024-02-20T08:05:36.728 INFO:tasks.workunit.client.0.smithi123.stdout:5/594: creat d0/d34/d67/d80/d84/fc3 x:0 0 0 2024-02-20T08:05:36.730 INFO:tasks.workunit.client.0.smithi123.stdout:5/595: read d0/d34/d48/d56/dbb/d27/d37/f8b [568973,108792] 0 2024-02-20T08:05:36.732 INFO:tasks.workunit.client.0.smithi123.stdout:6/867: link d0/d9f/l107 d0/d3e/d92/d56/d57/d91/l11e 0 2024-02-20T08:05:36.735 INFO:tasks.workunit.client.0.smithi123.stdout:6/868: rmdir d0/d3e/d40/d90/d94/def 39 2024-02-20T08:05:36.739 INFO:tasks.workunit.client.0.smithi123.stdout:5/596: rmdir d0/d34/d67/d80/d84/da6 0 2024-02-20T08:05:36.739 INFO:tasks.workunit.client.0.smithi123.stdout:5/597: stat d0/d34/d67 0 2024-02-20T08:05:36.741 INFO:tasks.workunit.client.0.smithi123.stdout:5/598: rename d0/d34/d48/d56 to d0/d34/d48/d56/dbb/d27/d4e/dc4 22 2024-02-20T08:05:36.742 INFO:tasks.workunit.client.0.smithi123.stdout:5/599: write d0/f11 [7266399,67609] 0 2024-02-20T08:05:36.745 INFO:tasks.workunit.client.0.smithi123.stdout:6/869: getdents d0 0 2024-02-20T08:05:36.747 INFO:tasks.workunit.client.0.smithi123.stdout:5/600: mknod d0/d34/d48/d56/dbb/d27/d4e/cc5 0 2024-02-20T08:05:36.753 INFO:tasks.workunit.client.0.smithi123.stdout:5/601: getdents d0/d34/d48/d56/dbb/d27/d86 0 2024-02-20T08:05:36.757 INFO:tasks.workunit.client.0.smithi123.stdout:5/602: fdatasync d0/fa9 0 2024-02-20T08:05:36.759 INFO:tasks.workunit.client.0.smithi123.stdout:5/603: dread d0/d34/d48/d56/d3e/f41 [0,4194304] 0 2024-02-20T08:05:36.764 INFO:tasks.workunit.client.0.smithi123.stdout:6/870: write d0/d3e/d92/d56/f5a [1137461,111531] 0 2024-02-20T08:05:36.767 INFO:tasks.workunit.client.0.smithi123.stdout:6/871: link d0/d3e/d40/ld0 d0/l11f 0 2024-02-20T08:05:36.775 INFO:tasks.workunit.client.0.smithi123.stdout:6/872: chown d0/d3e/d40/c6a 9779 1 2024-02-20T08:05:36.793 INFO:tasks.workunit.client.0.smithi123.stdout:6/873: dread d0/f33 [4194304,4194304] 0 2024-02-20T08:05:36.817 INFO:tasks.workunit.client.0.smithi123.stdout:6/874: dread d0/d3e/d40/f9b [0,4194304] 0 2024-02-20T08:05:36.818 INFO:tasks.workunit.client.0.smithi123.stdout:6/875: symlink d0/d3e/d40/d90/l120 0 2024-02-20T08:05:36.822 INFO:tasks.workunit.client.0.smithi123.stdout:6/876: creat d0/d9f/f121 x:0 0 0 2024-02-20T08:05:36.822 INFO:tasks.workunit.client.0.smithi123.stdout:6/877: stat d0/d3e/f7c 0 2024-02-20T08:05:36.824 INFO:tasks.workunit.client.0.smithi123.stdout:6/878: mknod d0/d3e/d92/d56/d57/d91/c122 0 2024-02-20T08:05:36.838 INFO:tasks.workunit.client.0.smithi123.stdout:6/879: write d0/d3e/d40/d48/daa/dab/fb2 [1489206,38210] 0 2024-02-20T08:05:36.840 INFO:tasks.workunit.client.0.smithi123.stdout:6/880: read d0/d3e/d92/d56/f5a [957829,98363] 0 2024-02-20T08:05:36.841 INFO:tasks.workunit.client.0.smithi123.stdout:6/881: chown d0/d3e/d40/d90/d94/def/f109 10893 1 2024-02-20T08:05:36.847 INFO:tasks.workunit.client.0.smithi123.stdout:6/882: dwrite d0/f13 [4194304,4194304] 0 2024-02-20T08:05:36.862 INFO:tasks.workunit.client.0.smithi123.stdout:0/662: sync 2024-02-20T08:05:36.866 INFO:tasks.workunit.client.0.smithi123.stdout:0/663: mkdir d2/de/dd9 0 2024-02-20T08:05:36.868 INFO:tasks.workunit.client.0.smithi123.stdout:0/664: chown d2/d3/d37/l67 212204876 1 2024-02-20T08:05:36.869 INFO:tasks.workunit.client.0.smithi123.stdout:0/665: read - d2/dd/d4f/fa6 zero size 2024-02-20T08:05:36.871 INFO:tasks.workunit.client.0.smithi123.stdout:0/666: mknod d2/de/d1e/d1f/d5e/cda 0 2024-02-20T08:05:36.872 INFO:tasks.workunit.client.0.smithi123.stdout:0/667: truncate d2/d3/f9b 729471 0 2024-02-20T08:05:36.874 INFO:tasks.workunit.client.0.smithi123.stdout:0/668: mknod d2/dd5/cdb 0 2024-02-20T08:05:36.878 INFO:tasks.workunit.client.0.smithi123.stdout:6/883: dwrite d0/d3e/d40/d90/fe7 [0,4194304] 0 2024-02-20T08:05:36.879 INFO:tasks.workunit.client.0.smithi123.stdout:0/669: rename d2/dd/d4f/d7c/da4/c39 to d2/d3/d37/cdc 0 2024-02-20T08:05:36.881 INFO:tasks.workunit.client.0.smithi123.stdout:6/884: truncate d0/d3e/d40/d48/f119 539797 0 2024-02-20T08:05:36.882 INFO:tasks.workunit.client.0.smithi123.stdout:6/885: write d0/d3e/d40/d48/f93 [514061,1346] 0 2024-02-20T08:05:36.885 INFO:tasks.workunit.client.0.smithi123.stdout:0/670: dread d2/de/f51 [0,4194304] 0 2024-02-20T08:05:36.886 INFO:tasks.workunit.client.0.smithi123.stdout:6/886: fsync d0/d3e/d92/d56/d89/d73/d75/dc3/fd9 0 2024-02-20T08:05:36.887 INFO:tasks.workunit.client.0.smithi123.stdout:0/671: chown d2/d3/d37/d5f/d8a/caa 291 1 2024-02-20T08:05:36.889 INFO:tasks.workunit.client.0.smithi123.stdout:6/887: read d0/d3e/d40/d48/d7b/fe0 [139416,72848] 0 2024-02-20T08:05:36.890 INFO:tasks.workunit.client.0.smithi123.stdout:0/672: mkdir d2/de/d1e/d1f/dc0/ddd 0 2024-02-20T08:05:36.891 INFO:tasks.workunit.client.0.smithi123.stdout:6/888: chown d0/f22 7 1 2024-02-20T08:05:36.893 INFO:tasks.workunit.client.0.smithi123.stdout:0/673: truncate d2/dd/d4f/f91 701041 0 2024-02-20T08:05:36.894 INFO:tasks.workunit.client.0.smithi123.stdout:0/674: fsync d2/dd/d4f/fad 0 2024-02-20T08:05:36.895 INFO:tasks.workunit.client.0.smithi123.stdout:0/675: chown d2/f12 99088 1 2024-02-20T08:05:36.896 INFO:tasks.workunit.client.0.smithi123.stdout:0/676: readlink d2/d3/l48 0 2024-02-20T08:05:36.901 INFO:tasks.workunit.client.0.smithi123.stdout:0/677: link d2/d3/d37/d9d/fa1 d2/de/d1e/d1f/dc0/ddd/fde 0 2024-02-20T08:05:36.903 INFO:tasks.workunit.client.0.smithi123.stdout:0/678: chown d2/c2b 20291552 1 2024-02-20T08:05:36.910 INFO:tasks.workunit.client.0.smithi123.stdout:0/679: dwrite d2/f8 [0,4194304] 0 2024-02-20T08:05:36.912 INFO:tasks.workunit.client.0.smithi123.stdout:6/889: dwrite d0/d3e/d92/d56/d57/f67 [0,4194304] 0 2024-02-20T08:05:36.914 INFO:tasks.workunit.client.0.smithi123.stdout:0/680: fsync d2/dd/d4f/d6a/f70 0 2024-02-20T08:05:36.922 INFO:tasks.workunit.client.0.smithi123.stdout:6/890: dwrite d0/d3e/d92/d56/d57/fd4 [0,4194304] 0 2024-02-20T08:05:36.929 INFO:tasks.workunit.client.0.smithi123.stdout:6/891: creat d0/d3e/d40/d48/daa/f123 x:0 0 0 2024-02-20T08:05:36.932 INFO:tasks.workunit.client.0.smithi123.stdout:6/892: mknod d0/d3e/d40/d90/c124 0 2024-02-20T08:05:36.944 INFO:tasks.workunit.client.0.smithi123.stdout:6/893: write d0/d3e/d92/d56/d57/f74 [940879,49794] 0 2024-02-20T08:05:36.945 INFO:tasks.workunit.client.0.smithi123.stdout:0/681: dread d2/de/d1e/f85 [0,4194304] 0 2024-02-20T08:05:36.947 INFO:tasks.workunit.client.0.smithi123.stdout:0/682: fsync d2/de/d1e/f46 0 2024-02-20T08:05:36.949 INFO:tasks.workunit.client.0.smithi123.stdout:6/894: rmdir d0/d3e/d40/d48/d79/dec 0 2024-02-20T08:05:36.950 INFO:tasks.workunit.client.0.smithi123.stdout:0/683: creat d2/dd/fdf x:0 0 0 2024-02-20T08:05:36.952 INFO:tasks.workunit.client.0.smithi123.stdout:6/895: truncate d0/d3e/d40/d90/d94/def/f109 458978 0 2024-02-20T08:05:36.952 INFO:tasks.workunit.client.0.smithi123.stdout:0/684: mknod d2/de/d1e/d1f/d5e/ce0 0 2024-02-20T08:05:36.955 INFO:tasks.workunit.client.0.smithi123.stdout:0/685: symlink d2/de/d1e/d1f/dc0/ddd/le1 0 2024-02-20T08:05:36.958 INFO:tasks.workunit.client.0.smithi123.stdout:6/896: dwrite d0/f29 [0,4194304] 0 2024-02-20T08:05:36.961 INFO:tasks.workunit.client.0.smithi123.stdout:6/897: mknod d0/d3e/d92/d56/d57/c125 0 2024-02-20T08:05:36.966 INFO:tasks.workunit.client.0.smithi123.stdout:0/686: dwrite d2/de/d1e/d1f/dcb/fd0 [0,4194304] 0 2024-02-20T08:05:36.970 INFO:tasks.workunit.client.0.smithi123.stdout:0/687: symlink d2/de/d1e/d1f/dc0/ddd/le2 0 2024-02-20T08:05:36.974 INFO:tasks.workunit.client.0.smithi123.stdout:6/898: rmdir d0/d3e/d40 39 2024-02-20T08:05:36.978 INFO:tasks.workunit.client.0.smithi123.stdout:0/688: link d2/d3/c4c d2/de/d1e/d1f/d74/ce3 0 2024-02-20T08:05:36.984 INFO:tasks.workunit.client.0.smithi123.stdout:0/689: getdents d2/dd 0 2024-02-20T08:05:36.987 INFO:tasks.workunit.client.0.smithi123.stdout:0/690: mkdir d2/dd/d4f/d7c/d82/de4 0 2024-02-20T08:05:36.989 INFO:tasks.workunit.client.0.smithi123.stdout:0/691: creat d2/dd/d4f/d61/d68/fe5 x:0 0 0 2024-02-20T08:05:36.990 INFO:tasks.workunit.client.0.smithi123.stdout:6/899: truncate d0/f51 546522 0 2024-02-20T08:05:36.992 INFO:tasks.workunit.client.0.smithi123.stdout:6/900: chown d0/d3e/d40/d48/daa/ddf/fd6 7632718 1 2024-02-20T08:05:36.994 INFO:tasks.workunit.client.0.smithi123.stdout:0/692: dwrite d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:36.998 INFO:tasks.workunit.client.0.smithi123.stdout:0/693: creat d2/de/d1e/d1f/dcb/fe6 x:0 0 0 2024-02-20T08:05:36.999 INFO:tasks.workunit.client.0.smithi123.stdout:0/694: stat d2/d54/dac/cc2 0 2024-02-20T08:05:37.000 INFO:tasks.workunit.client.0.smithi123.stdout:6/901: dwrite d0/f97 [0,4194304] 0 2024-02-20T08:05:37.003 INFO:tasks.workunit.client.0.smithi123.stdout:0/695: creat d2/de/d1e/d1f/dcb/fe7 x:0 0 0 2024-02-20T08:05:37.004 INFO:tasks.workunit.client.0.smithi123.stdout:4/589: sync 2024-02-20T08:05:37.008 INFO:tasks.workunit.client.0.smithi123.stdout:0/696: rename d2/de/d1e/d1f/d5e/f89 to d2/de/fe8 0 2024-02-20T08:05:37.011 INFO:tasks.workunit.client.0.smithi123.stdout:4/590: getdents d3/d18/d7d/d8b/d95 0 2024-02-20T08:05:37.012 INFO:tasks.workunit.client.0.smithi123.stdout:4/591: write d3/d2c/fb2 [95750,65602] 0 2024-02-20T08:05:37.012 INFO:tasks.workunit.client.0.smithi123.stdout:4/592: fdatasync d3/d97/fbe 0 2024-02-20T08:05:37.013 INFO:tasks.workunit.client.0.smithi123.stdout:0/697: rename d2/de/d1e/c3d to d2/dd/d4f/d7c/d82/de4/ce9 0 2024-02-20T08:05:37.013 INFO:tasks.workunit.client.0.smithi123.stdout:4/593: stat d3/d1e/d81 0 2024-02-20T08:05:37.018 INFO:tasks.workunit.client.0.smithi123.stdout:0/698: link d2/de/d1e/d1f/dcb/fd0 d2/de/d1e/d1f/dc0/ddd/fea 0 2024-02-20T08:05:37.020 INFO:tasks.workunit.client.0.smithi123.stdout:0/699: chown d2/d3/c4c 30153 1 2024-02-20T08:05:37.023 INFO:tasks.workunit.client.0.smithi123.stdout:0/700: link d2/f15 d2/de/feb 0 2024-02-20T08:05:37.024 INFO:tasks.workunit.client.0.smithi123.stdout:6/902: dread d0/f84 [0,4194304] 0 2024-02-20T08:05:37.037 INFO:tasks.workunit.client.0.smithi123.stdout:4/594: truncate d3/d2c/f45 944204 0 2024-02-20T08:05:37.038 INFO:tasks.workunit.client.0.smithi123.stdout:4/595: write d3/d2c/f5d [2445991,32638] 0 2024-02-20T08:05:37.042 INFO:tasks.workunit.client.0.smithi123.stdout:4/596: creat d3/d18/d6c/fc6 x:0 0 0 2024-02-20T08:05:37.045 INFO:tasks.workunit.client.0.smithi123.stdout:4/597: rename d3/d18/d7d/d87/ca4 to d3/d2c/d43/d98/cc7 0 2024-02-20T08:05:37.046 INFO:tasks.workunit.client.0.smithi123.stdout:0/701: write d2/de/d1e/fb0 [927360,112519] 0 2024-02-20T08:05:37.047 INFO:tasks.workunit.client.0.smithi123.stdout:6/903: write d0/d3e/d40/d48/d7b/fe0 [414477,48166] 0 2024-02-20T08:05:37.048 INFO:tasks.workunit.client.0.smithi123.stdout:0/702: stat d2/dd/d4f/d6a/fb4 0 2024-02-20T08:05:37.049 INFO:tasks.workunit.client.0.smithi123.stdout:6/904: write d0/f13 [3040327,23579] 0 2024-02-20T08:05:37.050 INFO:tasks.workunit.client.0.smithi123.stdout:0/703: write d2/f1b [534169,69634] 0 2024-02-20T08:05:37.051 INFO:tasks.workunit.client.0.smithi123.stdout:4/598: rename d3/d18/d7d/f90 to d3/d2c/d43/d26/d3e/da9/fc8 0 2024-02-20T08:05:37.052 INFO:tasks.workunit.client.0.smithi123.stdout:4/599: chown d3/d18/l61 893 1 2024-02-20T08:05:37.057 INFO:tasks.workunit.client.0.smithi123.stdout:0/704: rename d2/dd/d4f/d7c/da4/dae to d2/de/d1e/d1f/d74/dec 0 2024-02-20T08:05:37.059 INFO:tasks.workunit.client.0.smithi123.stdout:4/600: mknod d3/d18/d6c/db6/cc9 0 2024-02-20T08:05:37.060 INFO:tasks.workunit.client.0.smithi123.stdout:0/705: chown d2/de/d1e/d1f/d74/dec/fbc 393097 1 2024-02-20T08:05:37.063 INFO:tasks.workunit.client.0.smithi123.stdout:6/905: dwrite d0/d5c/fca [0,4194304] 0 2024-02-20T08:05:37.067 INFO:tasks.workunit.client.0.smithi123.stdout:6/906: write d0/f2c [3137257,113821] 0 2024-02-20T08:05:37.070 INFO:tasks.workunit.client.0.smithi123.stdout:0/706: dwrite d2/d3/d37/fc5 [0,4194304] 0 2024-02-20T08:05:37.084 INFO:tasks.workunit.client.0.smithi123.stdout:4/601: write d3/d2c/d43/f44 [1607737,14152] 0 2024-02-20T08:05:37.085 INFO:tasks.workunit.client.0.smithi123.stdout:0/707: write d2/de/d1e/d84/f99 [2445817,128587] 0 2024-02-20T08:05:37.089 INFO:tasks.workunit.client.0.smithi123.stdout:4/602: rmdir d3/d18/d7d/d96/dc1 0 2024-02-20T08:05:37.090 INFO:tasks.workunit.client.0.smithi123.stdout:0/708: truncate d2/de/d1e/d1f/dcb/fe6 324123 0 2024-02-20T08:05:37.090 INFO:tasks.workunit.client.0.smithi123.stdout:6/907: dwrite d0/d3e/d40/d7f/fac [0,4194304] 0 2024-02-20T08:05:37.099 INFO:tasks.workunit.client.0.smithi123.stdout:4/603: symlink d3/d2c/d43/lca 0 2024-02-20T08:05:37.102 INFO:tasks.workunit.client.0.smithi123.stdout:0/709: dwrite d2/de/d1e/d1f/d74/dec/fbd [0,4194304] 0 2024-02-20T08:05:37.103 INFO:tasks.workunit.client.0.smithi123.stdout:6/908: dwrite d0/d3e/d40/d48/fbd [0,4194304] 0 2024-02-20T08:05:37.111 INFO:tasks.workunit.client.0.smithi123.stdout:0/710: link d2/d3/d37/d9d/lb7 d2/d54/dac/led 0 2024-02-20T08:05:37.115 INFO:tasks.workunit.client.0.smithi123.stdout:0/711: rmdir d2/dd/d4f/d7c 39 2024-02-20T08:05:37.119 INFO:tasks.workunit.client.0.smithi123.stdout:0/712: unlink d2/de/lb5 0 2024-02-20T08:05:37.124 INFO:tasks.workunit.client.0.smithi123.stdout:0/713: rename d2/dd/d4f/d6a/dcf to d2/d3/d37/d5f/d8a/dee 0 2024-02-20T08:05:37.126 INFO:tasks.workunit.client.0.smithi123.stdout:0/714: creat d2/dd/d4f/da7/fef x:0 0 0 2024-02-20T08:05:37.132 INFO:tasks.workunit.client.0.smithi123.stdout:4/604: dread d3/f1b [0,4194304] 0 2024-02-20T08:05:37.133 INFO:tasks.workunit.client.0.smithi123.stdout:6/909: dread d0/d3e/d92/d56/f5a [0,4194304] 0 2024-02-20T08:05:37.141 INFO:tasks.workunit.client.0.smithi123.stdout:6/910: dread d0/d3e/d92/d56/f64 [0,4194304] 0 2024-02-20T08:05:37.142 INFO:tasks.workunit.client.0.smithi123.stdout:0/715: write d2/de/d1e/d1f/f77 [5221726,120677] 0 2024-02-20T08:05:37.143 INFO:tasks.workunit.client.0.smithi123.stdout:6/911: chown d0/d3e/d92/d56/d57/d91/fc6 31280315 1 2024-02-20T08:05:37.144 INFO:tasks.workunit.client.0.smithi123.stdout:4/605: write d3/d2c/d43/d26/fa5 [726677,7470] 0 2024-02-20T08:05:37.146 INFO:tasks.workunit.client.0.smithi123.stdout:4/606: write d3/d2c/d43/f44 [4339052,60214] 0 2024-02-20T08:05:37.148 INFO:tasks.workunit.client.0.smithi123.stdout:0/716: unlink d2/dd/d4f/d61/d68/f76 0 2024-02-20T08:05:37.153 INFO:tasks.workunit.client.0.smithi123.stdout:6/912: dwrite d0/d3e/d40/d48/daa/f123 [0,4194304] 0 2024-02-20T08:05:37.158 INFO:tasks.workunit.client.0.smithi123.stdout:4/607: truncate d3/d2c/d43/f44 3532730 0 2024-02-20T08:05:37.159 INFO:tasks.workunit.client.0.smithi123.stdout:4/608: readlink d3/d2c/d43/d26/d2e/l41 0 2024-02-20T08:05:37.160 INFO:tasks.workunit.client.0.smithi123.stdout:4/609: rmdir d3/d2c/d5a 39 2024-02-20T08:05:37.163 INFO:tasks.workunit.client.0.smithi123.stdout:6/913: getdents d0/d3e/d40/d48 0 2024-02-20T08:05:37.167 INFO:tasks.workunit.client.0.smithi123.stdout:0/717: truncate d2/d3/f24 4149272 0 2024-02-20T08:05:37.167 INFO:tasks.workunit.client.0.smithi123.stdout:4/610: dread d3/d2c/d43/d26/d2e/f7f [0,4194304] 0 2024-02-20T08:05:37.170 INFO:tasks.workunit.client.0.smithi123.stdout:4/611: mkdir d3/dcb 0 2024-02-20T08:05:37.178 INFO:tasks.workunit.client.0.smithi123.stdout:4/612: link d3/d2c/d43/d26/d2e/f52 d3/d18/d6c/fcc 0 2024-02-20T08:05:37.182 INFO:tasks.workunit.client.0.smithi123.stdout:4/613: mkdir d3/d2c/d43/d26/d2e/dcd 0 2024-02-20T08:05:37.183 INFO:tasks.workunit.client.0.smithi123.stdout:0/718: dread d2/d3/d37/d9d/fa1 [0,4194304] 0 2024-02-20T08:05:37.184 INFO:tasks.workunit.client.0.smithi123.stdout:0/719: write d2/de/d1e/d1f/dcb/fcd [607651,33501] 0 2024-02-20T08:05:37.185 INFO:tasks.workunit.client.0.smithi123.stdout:4/614: symlink d3/d18/d7d/d96/dbc/lce 0 2024-02-20T08:05:37.189 INFO:tasks.workunit.client.0.smithi123.stdout:4/615: chown d3/d18/d7d/d8b/la7 2 1 2024-02-20T08:05:37.189 INFO:tasks.workunit.client.0.smithi123.stdout:4/616: readlink d3/d2c/d43/l68 0 2024-02-20T08:05:37.190 INFO:tasks.workunit.client.0.smithi123.stdout:4/617: readlink d3/d2c/d43/d26/d2e/l6f 0 2024-02-20T08:05:37.203 INFO:tasks.workunit.client.0.smithi123.stdout:0/720: dwrite d2/de/fa3 [0,4194304] 0 2024-02-20T08:05:37.209 INFO:tasks.workunit.client.0.smithi123.stdout:4/618: dwrite d3/d2c/d5a/f92 [0,4194304] 0 2024-02-20T08:05:37.209 INFO:tasks.workunit.client.0.smithi123.stdout:0/721: creat d2/de/d1e/d1f/dc0/ff0 x:0 0 0 2024-02-20T08:05:37.214 INFO:tasks.workunit.client.0.smithi123.stdout:4/619: creat d3/d18/d63/fcf x:0 0 0 2024-02-20T08:05:37.218 INFO:tasks.workunit.client.0.smithi123.stdout:4/620: dread d3/f1b [0,4194304] 0 2024-02-20T08:05:37.225 INFO:tasks.workunit.client.0.smithi123.stdout:8/581: sync 2024-02-20T08:05:37.225 INFO:tasks.workunit.client.0.smithi123.stdout:0/722: dread d2/de/d1e/d84/f99 [0,4194304] 0 2024-02-20T08:05:37.227 INFO:tasks.workunit.client.0.smithi123.stdout:4/621: link d3/l1a d3/d18/d6c/db6/ld0 0 2024-02-20T08:05:37.238 INFO:tasks.workunit.client.0.smithi123.stdout:8/582: mkdir d6/d1c/d2c/db9/dc3 0 2024-02-20T08:05:37.241 INFO:tasks.workunit.client.0.smithi123.stdout:0/723: dread d2/dd/f2f [0,4194304] 0 2024-02-20T08:05:37.245 INFO:tasks.workunit.client.0.smithi123.stdout:0/724: creat d2/de/dd9/ff1 x:0 0 0 2024-02-20T08:05:37.250 INFO:tasks.workunit.client.0.smithi123.stdout:0/725: symlink d2/dd/d4f/lf2 0 2024-02-20T08:05:37.251 INFO:tasks.workunit.client.0.smithi123.stdout:4/622: write d3/d2c/d43/d26/f8f [333004,117339] 0 2024-02-20T08:05:37.254 INFO:tasks.workunit.client.0.smithi123.stdout:0/726: mknod d2/de/d1e/cf3 0 2024-02-20T08:05:37.257 INFO:tasks.workunit.client.0.smithi123.stdout:0/727: mkdir d2/d54/df4 0 2024-02-20T08:05:37.263 INFO:tasks.workunit.client.0.smithi123.stdout:0/728: mkdir d2/dd/d4f/d61/d81/df5 0 2024-02-20T08:05:37.264 INFO:tasks.workunit.client.0.smithi123.stdout:0/729: chown d2/d3/d37/d5f/fd3 45672 1 2024-02-20T08:05:37.265 INFO:tasks.workunit.client.0.smithi123.stdout:0/730: fdatasync d2/d3/f9b 0 2024-02-20T08:05:37.271 INFO:tasks.workunit.client.0.smithi123.stdout:0/731: dwrite d2/d3/d37/fc5 [0,4194304] 0 2024-02-20T08:05:37.279 INFO:tasks.workunit.client.0.smithi123.stdout:0/732: creat d2/dd/d4f/d7c/da4/ff6 x:0 0 0 2024-02-20T08:05:37.279 INFO:tasks.workunit.client.0.smithi123.stdout:0/733: chown d2/de/dc6 407 1 2024-02-20T08:05:37.283 INFO:tasks.workunit.client.0.smithi123.stdout:0/734: creat d2/d54/d78/ff7 x:0 0 0 2024-02-20T08:05:37.290 INFO:tasks.workunit.client.0.smithi123.stdout:0/735: dwrite d2/de/d1e/d1f/dcb/fcd [0,4194304] 0 2024-02-20T08:05:37.294 INFO:tasks.workunit.client.0.smithi123.stdout:0/736: truncate d2/de/d1e/d1f/f8e 2068617 0 2024-02-20T08:05:37.331 INFO:tasks.workunit.client.0.smithi123.stdout:0/737: write d2/f6 [707161,80219] 0 2024-02-20T08:05:37.335 INFO:tasks.workunit.client.0.smithi123.stdout:0/738: creat d2/dd/d4f/d7c/d82/ff8 x:0 0 0 2024-02-20T08:05:37.366 INFO:tasks.workunit.client.0.smithi123.stdout:0/739: write d2/dd/d4f/d6a/f70 [728522,83982] 0 2024-02-20T08:05:37.370 INFO:tasks.workunit.client.0.smithi123.stdout:0/740: rmdir d2/dd/d4f/da7 39 2024-02-20T08:05:37.371 INFO:tasks.workunit.client.0.smithi123.stdout:0/741: truncate d2/de/d1e/f46 2191009 0 2024-02-20T08:05:37.381 INFO:tasks.workunit.client.0.smithi123.stdout:0/742: dwrite d2/dd/d4f/d7c/d82/f96 [0,4194304] 0 2024-02-20T08:05:37.414 INFO:tasks.workunit.client.0.smithi123.stdout:0/743: unlink d2/dd/f41 0 2024-02-20T08:05:37.419 INFO:tasks.workunit.client.0.smithi123.stdout:1/583: sync 2024-02-20T08:05:37.419 INFO:tasks.workunit.client.0.smithi123.stdout:2/681: sync 2024-02-20T08:05:37.419 INFO:tasks.workunit.client.0.smithi123.stdout:7/518: sync 2024-02-20T08:05:37.420 INFO:tasks.workunit.client.0.smithi123.stdout:3/632: sync 2024-02-20T08:05:37.420 INFO:tasks.workunit.client.0.smithi123.stdout:5/604: sync 2024-02-20T08:05:37.420 INFO:tasks.workunit.client.0.smithi123.stdout:9/614: sync 2024-02-20T08:05:37.421 INFO:tasks.workunit.client.0.smithi123.stdout:9/615: write d6/d19/f9e [675582,48563] 0 2024-02-20T08:05:37.422 INFO:tasks.workunit.client.0.smithi123.stdout:1/584: fsync d3/fc 0 2024-02-20T08:05:37.423 INFO:tasks.workunit.client.0.smithi123.stdout:9/616: fdatasync d6/d19/d1a/d7f/f67 0 2024-02-20T08:05:37.535 INFO:tasks.workunit.client.0.smithi123.stdout:2/682: mkdir d1a/d29/d42/d52/d98/da1/de3 0 2024-02-20T08:05:37.541 INFO:tasks.workunit.client.0.smithi123.stdout:2/683: dwrite d1a/d29/fc7 [0,4194304] 0 2024-02-20T08:05:37.543 INFO:tasks.workunit.client.0.smithi123.stdout:0/744: link d2/dd/d4f/d7c/d82/de4/ce9 d2/dd/d4f/d7c/d82/cf9 0 2024-02-20T08:05:37.549 INFO:tasks.workunit.client.0.smithi123.stdout:1/585: creat d3/db/d34/d74/d6f/fce x:0 0 0 2024-02-20T08:05:37.549 INFO:tasks.workunit.client.0.smithi123.stdout:2/684: dwrite d1a/d29/fcf [0,4194304] 0 2024-02-20T08:05:37.555 INFO:tasks.workunit.client.0.smithi123.stdout:9/617: dread d6/f3f [0,4194304] 0 2024-02-20T08:05:37.555 INFO:tasks.workunit.client.0.smithi123.stdout:3/633: rename d0/d6/c7a to d0/d6/d1a/d1b/d9d/cdc 0 2024-02-20T08:05:37.559 INFO:tasks.workunit.client.0.smithi123.stdout:1/586: dwrite d3/de/d14/d36/fa8 [0,4194304] 0 2024-02-20T08:05:37.559 INFO:tasks.workunit.client.0.smithi123.stdout:6/914: sync 2024-02-20T08:05:37.560 INFO:tasks.workunit.client.0.smithi123.stdout:0/745: mkdir d2/dd/d4f/d7c/da4/db6/dfa 0 2024-02-20T08:05:37.568 INFO:tasks.workunit.client.0.smithi123.stdout:3/634: creat d0/d6/d1a/d1b/d1c/d3b/d43/d68/fdd x:0 0 0 2024-02-20T08:05:37.570 INFO:tasks.workunit.client.0.smithi123.stdout:1/587: unlink d3/db/fb1 0 2024-02-20T08:05:37.571 INFO:tasks.workunit.client.0.smithi123.stdout:1/588: write d3/de/d14/fc3 [253067,43334] 0 2024-02-20T08:05:37.574 INFO:tasks.workunit.client.0.smithi123.stdout:0/746: mkdir d2/dd/d4f/d61/d68/dfb 0 2024-02-20T08:05:37.575 INFO:tasks.workunit.client.0.smithi123.stdout:0/747: write d2/de/d1e/d1f/dcb/fe7 [222447,77752] 0 2024-02-20T08:05:37.581 INFO:tasks.workunit.client.0.smithi123.stdout:3/635: mkdir d0/d6/d1a/d1b/d57/dd0/daa/dde 0 2024-02-20T08:05:37.582 INFO:tasks.workunit.client.0.smithi123.stdout:1/589: dread - d3/d47/f7c zero size 2024-02-20T08:05:37.587 INFO:tasks.workunit.client.0.smithi123.stdout:7/519: rename d0/db/d38/d47/d4a/d59/l93 to d0/d6/dd/d52/lb5 0 2024-02-20T08:05:37.587 INFO:tasks.workunit.client.0.smithi123.stdout:7/520: stat d0/db/d38/f6a 0 2024-02-20T08:05:37.588 INFO:tasks.workunit.client.0.smithi123.stdout:0/748: creat d2/dd/d4f/d7c/ffc x:0 0 0 2024-02-20T08:05:37.589 INFO:tasks.workunit.client.0.smithi123.stdout:7/521: truncate d0/d6/dd/d52/d26/d7b/faa 77530 0 2024-02-20T08:05:37.593 INFO:tasks.workunit.client.0.smithi123.stdout:1/590: rename d3/de/d14/d26/d2e/d54/c3f to d3/db/d34/d74/ccf 0 2024-02-20T08:05:37.594 INFO:tasks.workunit.client.0.smithi123.stdout:0/749: mknod d2/de/d1e/d1f/d5e/cfd 0 2024-02-20T08:05:37.595 INFO:tasks.workunit.client.0.smithi123.stdout:3/636: symlink d0/d6/d1a/d1b/d57/dd0/daa/dde/ldf 0 2024-02-20T08:05:37.597 INFO:tasks.workunit.client.0.smithi123.stdout:6/915: link d0/d3e/d40/d48/daa/c115 d0/d3e/d40/d48/d7b/de9/c126 0 2024-02-20T08:05:37.599 INFO:tasks.workunit.client.0.smithi123.stdout:6/916: truncate d0/d3e/d92/d56/f5a 3387243 0 2024-02-20T08:05:37.600 INFO:tasks.workunit.client.0.smithi123.stdout:0/750: write d2/de/d1e/d1f/d5e/f7a [2868009,73465] 0 2024-02-20T08:05:37.602 INFO:tasks.workunit.client.0.smithi123.stdout:0/751: readlink d2/dd/d4f/d7c/da4/l86 0 2024-02-20T08:05:37.603 INFO:tasks.workunit.client.0.smithi123.stdout:7/522: creat d0/d6/dd/d52/d26/d9b/d61/db1/fb6 x:0 0 0 2024-02-20T08:05:37.604 INFO:tasks.workunit.client.0.smithi123.stdout:3/637: creat d0/d6/d1a/d1b/d9d/fe0 x:0 0 0 2024-02-20T08:05:37.606 INFO:tasks.workunit.client.0.smithi123.stdout:1/591: dwrite d3/db/d7f/f97 [0,4194304] 0 2024-02-20T08:05:37.607 INFO:tasks.workunit.client.0.smithi123.stdout:0/752: truncate d2/de/d1e/d1f/dc0/ff0 17580 0 2024-02-20T08:05:37.619 INFO:tasks.workunit.client.0.smithi123.stdout:5/605: write d0/d34/d48/f64 [1990632,13062] 0 2024-02-20T08:05:37.620 INFO:tasks.workunit.client.0.smithi123.stdout:1/592: mknod d3/cd0 0 2024-02-20T08:05:37.623 INFO:tasks.workunit.client.0.smithi123.stdout:7/523: link d0/d6/d29/c71 d0/d6/cb7 0 2024-02-20T08:05:37.624 INFO:tasks.workunit.client.0.smithi123.stdout:5/606: creat d0/d34/d48/d56/d3e/fc6 x:0 0 0 2024-02-20T08:05:37.627 INFO:tasks.workunit.client.0.smithi123.stdout:3/638: link d0/d6/d1a/d1b/d1c/d3b/d43/d68/fdd d0/d6/d1a/d1b/d1c/fe1 0 2024-02-20T08:05:37.627 INFO:tasks.workunit.client.0.smithi123.stdout:3/639: dread - d0/d6/d1a/d1b/d1c/fe1 zero size 2024-02-20T08:05:37.628 INFO:tasks.workunit.client.0.smithi123.stdout:7/524: fsync d0/f4 0 2024-02-20T08:05:37.628 INFO:tasks.workunit.client.0.smithi123.stdout:3/640: stat d0/dd/d48/f92 0 2024-02-20T08:05:37.631 INFO:tasks.workunit.client.0.smithi123.stdout:1/593: creat d3/db/d34/d74/da1/fd1 x:0 0 0 2024-02-20T08:05:37.634 INFO:tasks.workunit.client.0.smithi123.stdout:3/641: dread d0/d6/d1a/d1b/d1c/d21/d8e/fb2 [0,4194304] 0 2024-02-20T08:05:37.636 INFO:tasks.workunit.client.0.smithi123.stdout:3/642: write d0/f8c [765777,82123] 0 2024-02-20T08:05:37.639 INFO:tasks.workunit.client.0.smithi123.stdout:9/618: dwrite d6/d19/d1a/f5b [0,4194304] 0 2024-02-20T08:05:37.639 INFO:tasks.workunit.client.0.smithi123.stdout:7/525: creat d0/d6/dd/d52/d26/d7b/fb8 x:0 0 0 2024-02-20T08:05:37.646 INFO:tasks.workunit.client.0.smithi123.stdout:3/643: dwrite d0/d6/d1a/f12 [4194304,4194304] 0 2024-02-20T08:05:37.652 INFO:tasks.workunit.client.0.smithi123.stdout:5/607: dread d0/fc [0,4194304] 0 2024-02-20T08:05:37.656 INFO:tasks.workunit.client.0.smithi123.stdout:1/594: symlink d3/de/d14/d2c/d45/ld2 0 2024-02-20T08:05:37.659 INFO:tasks.workunit.client.0.smithi123.stdout:6/917: write d0/d3e/d40/d48/d7b/f7d [888698,63939] 0 2024-02-20T08:05:37.659 INFO:tasks.workunit.client.0.smithi123.stdout:6/918: chown d0/d3e/c8a 130858 1 2024-02-20T08:05:37.661 INFO:tasks.workunit.client.0.smithi123.stdout:5/608: symlink d0/d34/d48/d56/dbb/d27/d37/lc7 0 2024-02-20T08:05:37.662 INFO:tasks.workunit.client.0.smithi123.stdout:1/595: mknod d3/db/d34/cd3 0 2024-02-20T08:05:37.663 INFO:tasks.workunit.client.0.smithi123.stdout:9/619: dread d6/d19/d1a/d6d/f79 [0,4194304] 0 2024-02-20T08:05:37.664 INFO:tasks.workunit.client.0.smithi123.stdout:7/526: link d0/l11 d0/db/d38/d47/d4a/d59/lb9 0 2024-02-20T08:05:37.667 INFO:tasks.workunit.client.0.smithi123.stdout:6/919: dread - d0/fa1 zero size 2024-02-20T08:05:37.667 INFO:tasks.workunit.client.0.smithi123.stdout:9/620: chown d6/d19/d1a/d6d/d7e/lb8 4 1 2024-02-20T08:05:37.673 INFO:tasks.workunit.client.0.smithi123.stdout:0/753: dwrite d2/de/d1e/d1f/d74/fa8 [0,4194304] 0 2024-02-20T08:05:37.678 INFO:tasks.workunit.client.0.smithi123.stdout:1/596: dwrite d3/f42 [0,4194304] 0 2024-02-20T08:05:37.679 INFO:tasks.workunit.client.0.smithi123.stdout:3/644: dread d0/d6/d1a/f23 [4194304,4194304] 0 2024-02-20T08:05:37.680 INFO:tasks.workunit.client.0.smithi123.stdout:5/609: link d0/d34/d48/d4b/d51/l85 d0/d34/d48/d56/dbb/d27/d4e/d9b/lc8 0 2024-02-20T08:05:37.683 INFO:tasks.workunit.client.0.smithi123.stdout:7/527: dread d0/d6/dd/d52/d35/d9c/f36 [0,4194304] 0 2024-02-20T08:05:37.685 INFO:tasks.workunit.client.0.smithi123.stdout:9/621: symlink d6/d19/d1a/d2b/lc8 0 2024-02-20T08:05:37.686 INFO:tasks.workunit.client.0.smithi123.stdout:6/920: creat d0/d3e/d40/d48/d4a/d9c/f127 x:0 0 0 2024-02-20T08:05:37.687 INFO:tasks.workunit.client.0.smithi123.stdout:9/622: read d6/d19/d1a/d7c/f86 [406309,43802] 0 2024-02-20T08:05:37.688 INFO:tasks.workunit.client.0.smithi123.stdout:9/623: write d6/f14 [1312407,52091] 0 2024-02-20T08:05:37.692 INFO:tasks.workunit.client.0.smithi123.stdout:3/645: symlink d0/d6/d1a/d1b/d1c/d21/d8e/le2 0 2024-02-20T08:05:37.695 INFO:tasks.workunit.client.0.smithi123.stdout:7/528: rmdir d0/d6/dd/d52/d26 39 2024-02-20T08:05:37.698 INFO:tasks.workunit.client.0.smithi123.stdout:5/610: symlink d0/d34/d48/d56/dbb/lc9 0 2024-02-20T08:05:37.702 INFO:tasks.workunit.client.0.smithi123.stdout:7/529: dread d0/db/d38/d47/d4a/d5d/f8f [0,4194304] 0 2024-02-20T08:05:37.715 INFO:tasks.workunit.client.0.smithi123.stdout:8/583: sync 2024-02-20T08:05:37.715 INFO:tasks.workunit.client.0.smithi123.stdout:2/685: sync 2024-02-20T08:05:37.716 INFO:tasks.workunit.client.0.smithi123.stdout:4/623: sync 2024-02-20T08:05:37.716 INFO:tasks.workunit.client.0.smithi123.stdout:4/624: fsync d3/d2c/d43/d26/d2e/fbf 0 2024-02-20T08:05:37.719 INFO:tasks.workunit.client.0.smithi123.stdout:1/597: rmdir d3/de/d14/d2c/d45/d9d 39 2024-02-20T08:05:37.720 INFO:tasks.workunit.client.0.smithi123.stdout:2/686: dwrite d1a/d29/d42/d4e/f78 [0,4194304] 0 2024-02-20T08:05:37.724 INFO:tasks.workunit.client.0.smithi123.stdout:8/584: dread d6/f80 [0,4194304] 0 2024-02-20T08:05:37.726 INFO:tasks.workunit.client.0.smithi123.stdout:5/611: creat d0/d34/d48/d56/dbb/d27/d37/fca x:0 0 0 2024-02-20T08:05:37.726 INFO:tasks.workunit.client.0.smithi123.stdout:5/612: stat d0/d34/d48/d4b/f7d 0 2024-02-20T08:05:37.728 INFO:tasks.workunit.client.0.smithi123.stdout:7/530: chown d0/d6/dd/d52/d26/d9b/d61/db1 752 1 2024-02-20T08:05:37.730 INFO:tasks.workunit.client.0.smithi123.stdout:4/625: creat d3/d1e/fd1 x:0 0 0 2024-02-20T08:05:37.732 INFO:tasks.workunit.client.0.smithi123.stdout:0/754: getdents d2/dd/d4f/d61 0 2024-02-20T08:05:37.733 INFO:tasks.workunit.client.0.smithi123.stdout:5/613: dwrite d0/d34/d67/d80/d84/fa2 [0,4194304] 0 2024-02-20T08:05:37.734 INFO:tasks.workunit.client.0.smithi123.stdout:2/687: mknod d1a/d29/d42/d4e/dbc/ce4 0 2024-02-20T08:05:37.735 INFO:tasks.workunit.client.0.smithi123.stdout:3/646: mkdir d0/d6/d1a/d1b/de3 0 2024-02-20T08:05:37.735 INFO:tasks.workunit.client.0.smithi123.stdout:0/755: write d2/de/d1e/d1f/dcb/fcd [2309337,11206] 0 2024-02-20T08:05:37.741 INFO:tasks.workunit.client.0.smithi123.stdout:2/688: write d1a/d29/d42/d52/d98/fb6 [565899,57450] 0 2024-02-20T08:05:37.743 INFO:tasks.workunit.client.0.smithi123.stdout:5/614: symlink d0/d34/d48/d56/d4c/d43/lcb 0 2024-02-20T08:05:37.744 INFO:tasks.workunit.client.0.smithi123.stdout:6/921: getdents d0/d3e/d40/d48/daa 0 2024-02-20T08:05:37.745 INFO:tasks.workunit.client.0.smithi123.stdout:5/615: fsync d0/d34/d48/f53 0 2024-02-20T08:05:37.745 INFO:tasks.workunit.client.0.smithi123.stdout:4/626: mknod d3/cd2 0 2024-02-20T08:05:37.748 INFO:tasks.workunit.client.0.smithi123.stdout:2/689: mknod d1a/d29/d39/ce5 0 2024-02-20T08:05:37.749 INFO:tasks.workunit.client.0.smithi123.stdout:7/531: dwrite d0/db/d38/d47/d4a/d5d/f8f [0,4194304] 0 2024-02-20T08:05:37.752 INFO:tasks.workunit.client.0.smithi123.stdout:0/756: creat d2/d3/ffe x:0 0 0 2024-02-20T08:05:37.754 INFO:tasks.workunit.client.0.smithi123.stdout:6/922: mkdir d0/d3e/d40/d48/d4a/d128 0 2024-02-20T08:05:37.755 INFO:tasks.workunit.client.0.smithi123.stdout:8/585: link d6/d32/d95/c4c d6/d32/d95/db0/cc4 0 2024-02-20T08:05:37.756 INFO:tasks.workunit.client.0.smithi123.stdout:1/598: dread d3/de/d14/d2c/d4f/f57 [0,4194304] 0 2024-02-20T08:05:37.760 INFO:tasks.workunit.client.0.smithi123.stdout:4/627: rename d3/d2c/d43/d26/c65 to d3/d2c/d5a/d7e/cd3 0 2024-02-20T08:05:37.762 INFO:tasks.workunit.client.0.smithi123.stdout:4/628: stat d3/d18/c42 0 2024-02-20T08:05:37.763 INFO:tasks.workunit.client.0.smithi123.stdout:7/532: creat d0/d6/dd/d52/d26/d9b/fba x:0 0 0 2024-02-20T08:05:37.765 INFO:tasks.workunit.client.0.smithi123.stdout:3/647: dread d0/d6/d1a/d1b/db4/fc0 [0,4194304] 0 2024-02-20T08:05:37.765 INFO:tasks.workunit.client.0.smithi123.stdout:6/923: dwrite d0/d3e/d40/d90/d94/def/f109 [0,4194304] 0 2024-02-20T08:05:37.765 INFO:tasks.workunit.client.0.smithi123.stdout:4/629: read - d3/d18/d63/fcf zero size 2024-02-20T08:05:37.767 INFO:tasks.workunit.client.0.smithi123.stdout:2/690: creat d1a/dd4/fe6 x:0 0 0 2024-02-20T08:05:37.769 INFO:tasks.workunit.client.0.smithi123.stdout:6/924: stat d0/d3e/d40/d90/fe7 0 2024-02-20T08:05:37.770 INFO:tasks.workunit.client.0.smithi123.stdout:8/586: symlink d6/d32/d95/d7d/lc5 0 2024-02-20T08:05:37.773 INFO:tasks.workunit.client.0.smithi123.stdout:0/757: rename d2/de/feb to d2/de/fff 0 2024-02-20T08:05:37.774 INFO:tasks.workunit.client.0.smithi123.stdout:3/648: creat d0/d6/d1a/d4b/fe4 x:0 0 0 2024-02-20T08:05:37.775 INFO:tasks.workunit.client.0.smithi123.stdout:3/649: dread - d0/d6/d1a/d1b/d1c/fe1 zero size 2024-02-20T08:05:37.777 INFO:tasks.workunit.client.0.smithi123.stdout:3/650: read d0/d6/d1a/d4b/f93 [119270,19902] 0 2024-02-20T08:05:37.779 INFO:tasks.workunit.client.0.smithi123.stdout:0/758: symlink d2/de/dd9/l100 0 2024-02-20T08:05:37.780 INFO:tasks.workunit.client.0.smithi123.stdout:7/533: getdents d0/d6/dd/d52/d26/d9b/d9a 0 2024-02-20T08:05:37.787 INFO:tasks.workunit.client.0.smithi123.stdout:0/759: symlink d2/de/d1e/d1f/d74/l101 0 2024-02-20T08:05:37.789 INFO:tasks.workunit.client.0.smithi123.stdout:1/599: dread d3/de/fbd [0,4194304] 0 2024-02-20T08:05:37.790 INFO:tasks.workunit.client.0.smithi123.stdout:1/600: chown d3/de/d14/d2c/d45/f8f 217186254 1 2024-02-20T08:05:37.790 INFO:tasks.workunit.client.0.smithi123.stdout:6/925: link d0/d9f/l106 d0/d3e/d92/d56/d89/d73/l129 0 2024-02-20T08:05:37.791 INFO:tasks.workunit.client.0.smithi123.stdout:6/926: chown d0/d3e/d40/d48/d5d/dbf 1380548 1 2024-02-20T08:05:37.792 INFO:tasks.workunit.client.0.smithi123.stdout:2/691: creat d1a/d29/d42/fe7 x:0 0 0 2024-02-20T08:05:37.792 INFO:tasks.workunit.client.0.smithi123.stdout:6/927: dread - d0/d3e/d92/d56/d89/f10b zero size 2024-02-20T08:05:37.795 INFO:tasks.workunit.client.0.smithi123.stdout:0/760: creat d2/de/d1e/d1f/dc0/ddd/f102 x:0 0 0 2024-02-20T08:05:37.798 INFO:tasks.workunit.client.0.smithi123.stdout:7/534: fdatasync d0/d6/d7/f20 0 2024-02-20T08:05:37.800 INFO:tasks.workunit.client.0.smithi123.stdout:6/928: creat d0/d3e/d40/d48/d79/f12a x:0 0 0 2024-02-20T08:05:37.801 INFO:tasks.workunit.client.0.smithi123.stdout:2/692: mkdir d1a/d29/d42/d52/d98/da1/daa/de8 0 2024-02-20T08:05:37.802 INFO:tasks.workunit.client.0.smithi123.stdout:8/587: link d6/l61 d6/lc6 0 2024-02-20T08:05:37.804 INFO:tasks.workunit.client.0.smithi123.stdout:0/761: dwrite d2/d3/d37/fc5 [0,4194304] 0 2024-02-20T08:05:37.804 INFO:tasks.workunit.client.0.smithi123.stdout:2/693: stat d1a/d29/d42/lb7 0 2024-02-20T08:05:37.810 INFO:tasks.workunit.client.0.smithi123.stdout:6/929: unlink d0/d3e/d40/d90/d94/f112 0 2024-02-20T08:05:37.812 INFO:tasks.workunit.client.0.smithi123.stdout:4/630: dwrite d3/d2c/d43/d34/f55 [0,4194304] 0 2024-02-20T08:05:37.815 INFO:tasks.workunit.client.0.smithi123.stdout:3/651: dwrite d0/d6/d1a/d1b/d1c/d3b/f8a [0,4194304] 0 2024-02-20T08:05:37.816 INFO:tasks.workunit.client.0.smithi123.stdout:0/762: mknod d2/dd/d4f/d61/d68/c103 0 2024-02-20T08:05:37.817 INFO:tasks.workunit.client.0.smithi123.stdout:0/763: chown d2/dd/l2a 0 1 2024-02-20T08:05:37.821 INFO:tasks.workunit.client.0.smithi123.stdout:6/930: truncate d0/d38/fa6 4910741 0 2024-02-20T08:05:37.823 INFO:tasks.workunit.client.0.smithi123.stdout:7/535: rename d0/db/d21/d42/c3f to d0/db/d38/d47/d4a/cbb 0 2024-02-20T08:05:37.829 INFO:tasks.workunit.client.0.smithi123.stdout:8/588: dwrite d6/f3b [0,4194304] 0 2024-02-20T08:05:37.830 INFO:tasks.workunit.client.0.smithi123.stdout:7/536: mkdir d0/db/d38/d47/dbc 0 2024-02-20T08:05:37.833 INFO:tasks.workunit.client.0.smithi123.stdout:3/652: creat d0/dd/d48/d8d/dcf/fe5 x:0 0 0 2024-02-20T08:05:37.833 INFO:tasks.workunit.client.0.smithi123.stdout:7/537: truncate d0/d6/dd/f96 930731 0 2024-02-20T08:05:37.833 INFO:tasks.workunit.client.0.smithi123.stdout:0/764: symlink d2/dd/d4f/l104 0 2024-02-20T08:05:37.839 INFO:tasks.workunit.client.0.smithi123.stdout:4/631: link d3/c62 d3/d18/d7d/d8b/cd4 0 2024-02-20T08:05:37.841 INFO:tasks.workunit.client.0.smithi123.stdout:2/694: dread d1a/d29/f44 [0,4194304] 0 2024-02-20T08:05:37.841 INFO:tasks.workunit.client.0.smithi123.stdout:8/589: link d6/d32/d95/l41 d6/d32/d95/d7d/lc7 0 2024-02-20T08:05:37.841 INFO:tasks.workunit.client.0.smithi123.stdout:0/765: write d2/d3/d37/d5f/d8a/f8b [1861439,38338] 0 2024-02-20T08:05:37.846 INFO:tasks.workunit.client.0.smithi123.stdout:0/766: readlink d2/de/d1e/d1f/dc0/ddd/le2 0 2024-02-20T08:05:37.847 INFO:tasks.workunit.client.0.smithi123.stdout:7/538: dwrite d0/d23/f8a [0,4194304] 0 2024-02-20T08:05:37.848 INFO:tasks.workunit.client.0.smithi123.stdout:2/695: creat d1a/d29/d42/d80/da3/fe9 x:0 0 0 2024-02-20T08:05:37.848 INFO:tasks.workunit.client.0.smithi123.stdout:3/653: dwrite d0/d6/d1a/d1b/d9d/f6d [0,4194304] 0 2024-02-20T08:05:37.849 INFO:tasks.workunit.client.0.smithi123.stdout:2/696: stat d1a/d29/fcb 0 2024-02-20T08:05:37.850 INFO:tasks.workunit.client.0.smithi123.stdout:2/697: chown d1a 4 1 2024-02-20T08:05:37.858 INFO:tasks.workunit.client.0.smithi123.stdout:0/767: dread d2/de/d1e/d1f/dcb/fcd [0,4194304] 0 2024-02-20T08:05:37.859 INFO:tasks.workunit.client.0.smithi123.stdout:2/698: mknod d1a/d29/d42/d4e/cea 0 2024-02-20T08:05:37.859 INFO:tasks.workunit.client.0.smithi123.stdout:3/654: getdents d0/d6/d1a/d1b/d1c/d61/dd1/dda 0 2024-02-20T08:05:37.861 INFO:tasks.workunit.client.0.smithi123.stdout:0/768: mkdir d2/de/dc6/d105 0 2024-02-20T08:05:37.865 INFO:tasks.workunit.client.0.smithi123.stdout:2/699: rename d1a/d29/d5d/d8d to d1a/d29/d42/d52/d98/da1/deb 0 2024-02-20T08:05:37.866 INFO:tasks.workunit.client.0.smithi123.stdout:6/931: write d0/d3e/fb6 [1899046,122390] 0 2024-02-20T08:05:37.866 INFO:tasks.workunit.client.0.smithi123.stdout:0/769: creat d2/de/dd9/f106 x:0 0 0 2024-02-20T08:05:37.867 INFO:tasks.workunit.client.0.smithi123.stdout:7/539: rmdir d0/db/d38/d47 39 2024-02-20T08:05:37.868 INFO:tasks.workunit.client.0.smithi123.stdout:2/700: dread - d1a/d29/d42/d52/d98/da1/fb8 zero size 2024-02-20T08:05:37.869 INFO:tasks.workunit.client.0.smithi123.stdout:0/770: chown d2/dd/d4f/d61/d68/f6c 943 1 2024-02-20T08:05:37.869 INFO:tasks.workunit.client.0.smithi123.stdout:2/701: stat d1a/d29/d39/f5f 0 2024-02-20T08:05:37.870 INFO:tasks.workunit.client.0.smithi123.stdout:0/771: write d2/f8 [6993021,44169] 0 2024-02-20T08:05:37.871 INFO:tasks.workunit.client.0.smithi123.stdout:0/772: dread - d2/de/d1e/d1f/dc0/ddd/f102 zero size 2024-02-20T08:05:37.872 INFO:tasks.workunit.client.0.smithi123.stdout:6/932: link d0/f13 d0/d3e/d40/d48/daa/ddf/f12b 0 2024-02-20T08:05:37.873 INFO:tasks.workunit.client.0.smithi123.stdout:7/540: mknod d0/d6/dd/d52/d26/d9b/cbd 0 2024-02-20T08:05:37.877 INFO:tasks.workunit.client.0.smithi123.stdout:2/702: chown d1a/l33 27010 1 2024-02-20T08:05:37.880 INFO:tasks.workunit.client.0.smithi123.stdout:4/632: write d3/d2c/d43/f44 [4386644,47609] 0 2024-02-20T08:05:37.882 INFO:tasks.workunit.client.0.smithi123.stdout:7/541: symlink d0/d6/d7/d68/lbe 0 2024-02-20T08:05:37.883 INFO:tasks.workunit.client.0.smithi123.stdout:2/703: mknod d1a/d29/d42/d52/d98/cec 0 2024-02-20T08:05:37.883 INFO:tasks.workunit.client.0.smithi123.stdout:8/590: truncate d6/dbd/d5b/f77 1282109 0 2024-02-20T08:05:37.884 INFO:tasks.workunit.client.0.smithi123.stdout:2/704: write d1a/d29/d42/fd9 [817110,85256] 0 2024-02-20T08:05:37.885 INFO:tasks.workunit.client.0.smithi123.stdout:8/591: stat d6/d1c/d2c/db9/dc3 0 2024-02-20T08:05:37.885 INFO:tasks.workunit.client.0.smithi123.stdout:6/933: creat d0/d3e/d40/d48/d4a/d128/f12c x:0 0 0 2024-02-20T08:05:37.886 INFO:tasks.workunit.client.0.smithi123.stdout:8/592: fsync d6/dbd/d5b/fa6 0 2024-02-20T08:05:37.886 INFO:tasks.workunit.client.0.smithi123.stdout:4/633: symlink d3/d2c/d43/d26/d3e/d8a/ld5 0 2024-02-20T08:05:37.886 INFO:tasks.workunit.client.0.smithi123.stdout:6/934: stat d0/d3e/d40/d7f/f8f 0 2024-02-20T08:05:37.887 INFO:tasks.workunit.client.0.smithi123.stdout:8/593: chown d6/f3b 198319 1 2024-02-20T08:05:37.889 INFO:tasks.workunit.client.0.smithi123.stdout:4/634: read d3/d18/d63/f83 [57172,70173] 0 2024-02-20T08:05:37.890 INFO:tasks.workunit.client.0.smithi123.stdout:7/542: creat d0/db/fbf x:0 0 0 2024-02-20T08:05:37.891 INFO:tasks.workunit.client.0.smithi123.stdout:4/635: readlink d3/d18/d6c/l94 0 2024-02-20T08:05:37.891 INFO:tasks.workunit.client.0.smithi123.stdout:2/705: mkdir d1a/d29/d42/d80/da3/ded 0 2024-02-20T08:05:37.891 INFO:tasks.workunit.client.0.smithi123.stdout:3/655: dwrite d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:37.894 INFO:tasks.workunit.client.0.smithi123.stdout:6/935: write d0/d38/fa6 [4212761,36920] 0 2024-02-20T08:05:37.895 INFO:tasks.workunit.client.0.smithi123.stdout:8/594: creat d6/dbd/d7e/fc8 x:0 0 0 2024-02-20T08:05:37.899 INFO:tasks.workunit.client.0.smithi123.stdout:3/656: rmdir d0/d6/d1a/d1b/d57/dd0 39 2024-02-20T08:05:37.902 INFO:tasks.workunit.client.0.smithi123.stdout:3/657: chown d0/d6/d1a/d1b/d1c/d21/d8e/fb2 1036 1 2024-02-20T08:05:37.904 INFO:tasks.workunit.client.0.smithi123.stdout:8/595: fsync d6/d1c/d22/f6b 0 2024-02-20T08:05:37.904 INFO:tasks.workunit.client.0.smithi123.stdout:0/773: dwrite d2/dd/d4f/d7c/f8c [0,4194304] 0 2024-02-20T08:05:37.907 INFO:tasks.workunit.client.0.smithi123.stdout:4/636: creat d3/d2c/d43/d26/d2e/dcd/fd6 x:0 0 0 2024-02-20T08:05:37.907 INFO:tasks.workunit.client.0.smithi123.stdout:0/774: write d2/de/d1e/d1f/dc0/ff0 [158792,104655] 0 2024-02-20T08:05:37.910 INFO:tasks.workunit.client.0.smithi123.stdout:8/596: mknod d6/dbd/cc9 0 2024-02-20T08:05:37.911 INFO:tasks.workunit.client.0.smithi123.stdout:3/658: symlink d0/d6/d1a/d1b/d1c/d3b/d43/le6 0 2024-02-20T08:05:37.914 INFO:tasks.workunit.client.0.smithi123.stdout:7/543: link d0/d6/dd/d52/d26/d9b/d61/f9f d0/db/d21/d42/d5f/da2/fc0 0 2024-02-20T08:05:37.914 INFO:tasks.workunit.client.0.smithi123.stdout:4/637: dwrite d3/d2c/d5a/f92 [0,4194304] 0 2024-02-20T08:05:37.916 INFO:tasks.workunit.client.0.smithi123.stdout:0/775: mkdir d2/dd/d4f/da7/d107 0 2024-02-20T08:05:37.923 INFO:tasks.workunit.client.0.smithi123.stdout:0/776: creat d2/dd/d4f/d7c/d82/f108 x:0 0 0 2024-02-20T08:05:37.924 INFO:tasks.workunit.client.0.smithi123.stdout:0/777: write d2/f12 [2160241,93324] 0 2024-02-20T08:05:37.928 INFO:tasks.workunit.client.0.smithi123.stdout:8/597: creat d6/d1c/d2c/db9/dc3/fca x:0 0 0 2024-02-20T08:05:37.928 INFO:tasks.workunit.client.0.smithi123.stdout:4/638: mkdir d3/d18/d7d/d8b/d95/dd7 0 2024-02-20T08:05:37.931 INFO:tasks.workunit.client.0.smithi123.stdout:4/639: dread d3/d18/d7d/d87/f9a [4194304,4194304] 0 2024-02-20T08:05:37.933 INFO:tasks.workunit.client.0.smithi123.stdout:7/544: creat d0/db/d38/d47/d4a/d59/d5c/d79/fc1 x:0 0 0 2024-02-20T08:05:37.936 INFO:tasks.workunit.client.0.smithi123.stdout:6/936: write d0/d3e/d40/d90/fa4 [2756911,112392] 0 2024-02-20T08:05:37.937 INFO:tasks.workunit.client.0.smithi123.stdout:2/706: dread d1a/f50 [0,4194304] 0 2024-02-20T08:05:37.944 INFO:tasks.workunit.client.0.smithi123.stdout:2/707: dwrite d1a/d29/d5d/f7e [0,4194304] 0 2024-02-20T08:05:37.945 INFO:tasks.workunit.client.0.smithi123.stdout:2/708: dread - d1a/d29/d5d/d97/fb5 zero size 2024-02-20T08:05:37.948 INFO:tasks.workunit.client.0.smithi123.stdout:7/545: unlink d0/l8e 0 2024-02-20T08:05:37.951 INFO:tasks.workunit.client.0.smithi123.stdout:3/659: write d0/dd/d48/f92 [332444,73314] 0 2024-02-20T08:05:37.951 INFO:tasks.workunit.client.0.smithi123.stdout:0/778: link d2/de/d1e/d1f/f8e d2/de/d1e/d1f/d74/f109 0 2024-02-20T08:05:37.953 INFO:tasks.workunit.client.0.smithi123.stdout:3/660: readlink d0/d6/d1a/d62/d82/l99 0 2024-02-20T08:05:37.955 INFO:tasks.workunit.client.0.smithi123.stdout:7/546: creat d0/d6/dd/d52/d35/d9c/d70/fc2 x:0 0 0 2024-02-20T08:05:37.956 INFO:tasks.workunit.client.0.smithi123.stdout:0/779: creat d2/de/d1e/d1f/dcb/f10a x:0 0 0 2024-02-20T08:05:37.959 INFO:tasks.workunit.client.0.smithi123.stdout:6/937: rename d0/d3e/d92/d56/d57/f67 to d0/d3e/d92/d56/d57/d91/f12d 0 2024-02-20T08:05:37.961 INFO:tasks.workunit.client.0.smithi123.stdout:2/709: mknod d1a/d29/d42/d52/d98/da1/de3/cee 0 2024-02-20T08:05:37.963 INFO:tasks.workunit.client.0.smithi123.stdout:6/938: dread d0/d3e/d40/d48/f93 [0,4194304] 0 2024-02-20T08:05:37.965 INFO:tasks.workunit.client.0.smithi123.stdout:4/640: write d3/d2c/d5a/f6b [3241070,64162] 0 2024-02-20T08:05:37.967 INFO:tasks.workunit.client.0.smithi123.stdout:0/780: unlink d2/d3/d37/d5f/d8a/f8b 0 2024-02-20T08:05:37.967 INFO:tasks.workunit.client.0.smithi123.stdout:8/598: dwrite d6/d32/d95/d7d/f8a [0,4194304] 0 2024-02-20T08:05:37.972 INFO:tasks.workunit.client.0.smithi123.stdout:2/710: creat d1a/d29/d42/d52/d98/da1/daa/fef x:0 0 0 2024-02-20T08:05:37.973 INFO:tasks.workunit.client.0.smithi123.stdout:3/661: creat d0/d6/d1a/d1b/d57/dd0/daa/fe7 x:0 0 0 2024-02-20T08:05:37.974 INFO:tasks.workunit.client.0.smithi123.stdout:3/662: dread - d0/d6/d1a/d4b/fe4 zero size 2024-02-20T08:05:37.977 INFO:tasks.workunit.client.0.smithi123.stdout:6/939: dread - d0/d3e/d92/d56/d57/d91/d101/f103 zero size 2024-02-20T08:05:37.979 INFO:tasks.workunit.client.0.smithi123.stdout:4/641: mknod d3/d1e/d81/cd8 0 2024-02-20T08:05:37.982 INFO:tasks.workunit.client.0.smithi123.stdout:0/781: symlink d2/d54/l10b 0 2024-02-20T08:05:37.983 INFO:tasks.workunit.client.0.smithi123.stdout:8/599: mknod d6/d1c/d47/ccb 0 2024-02-20T08:05:37.984 INFO:tasks.workunit.client.0.smithi123.stdout:0/782: stat d2/dd/d4f/d61/d68 0 2024-02-20T08:05:37.987 INFO:tasks.workunit.client.0.smithi123.stdout:4/642: dwrite d3/d2c/d43/d26/d2e/dcd/fd6 [0,4194304] 0 2024-02-20T08:05:37.987 INFO:tasks.workunit.client.0.smithi123.stdout:3/663: creat d0/fe8 x:0 0 0 2024-02-20T08:05:37.989 INFO:tasks.workunit.client.0.smithi123.stdout:6/940: read - d0/d3e/d92/d56/d57/d91/fc6 zero size 2024-02-20T08:05:37.994 INFO:tasks.workunit.client.0.smithi123.stdout:0/783: rmdir d2/dd/d4f/d61/d81 39 2024-02-20T08:05:37.996 INFO:tasks.workunit.client.0.smithi123.stdout:6/941: symlink d0/d3e/d92/db3/l12e 0 2024-02-20T08:05:38.002 INFO:tasks.workunit.client.0.smithi123.stdout:0/784: dwrite d2/de/d1e/d84/f99 [0,4194304] 0 2024-02-20T08:05:38.003 INFO:tasks.workunit.client.0.smithi123.stdout:0/785: chown d2/dd/l2a 1 1 2024-02-20T08:05:38.009 INFO:tasks.workunit.client.0.smithi123.stdout:6/942: dwrite d0/d3e/d92/d56/d89/d73/d75/fb5 [0,4194304] 0 2024-02-20T08:05:38.012 INFO:tasks.workunit.client.0.smithi123.stdout:4/643: dread d3/d2c/d43/f44 [0,4194304] 0 2024-02-20T08:05:38.012 INFO:tasks.workunit.client.0.smithi123.stdout:2/711: dread d1a/f27 [0,4194304] 0 2024-02-20T08:05:38.013 INFO:tasks.workunit.client.0.smithi123.stdout:6/943: rmdir d0/d3e/d92/d56/dae 39 2024-02-20T08:05:38.014 INFO:tasks.workunit.client.0.smithi123.stdout:3/664: write d0/f53 [3313043,120477] 0 2024-02-20T08:05:38.017 INFO:tasks.workunit.client.0.smithi123.stdout:4/644: unlink d3/d2c/d43/d34/f58 0 2024-02-20T08:05:38.019 INFO:tasks.workunit.client.0.smithi123.stdout:4/645: chown d3/d2c/d43/f84 221386372 1 2024-02-20T08:05:38.019 INFO:tasks.workunit.client.0.smithi123.stdout:2/712: mkdir d1a/d29/d42/d73/df0 0 2024-02-20T08:05:38.021 INFO:tasks.workunit.client.0.smithi123.stdout:8/600: dwrite d6/d32/d95/d7d/dab/fb8 [0,4194304] 0 2024-02-20T08:05:38.021 INFO:tasks.workunit.client.0.smithi123.stdout:3/665: stat d0/d6/d1a/f39 0 2024-02-20T08:05:38.023 INFO:tasks.workunit.client.0.smithi123.stdout:3/666: write d0/d6/d1a/d1b/f6b [163430,49937] 0 2024-02-20T08:05:38.028 INFO:tasks.workunit.client.0.smithi123.stdout:2/713: unlink d1a/d4f/l9c 0 2024-02-20T08:05:38.028 INFO:tasks.workunit.client.0.smithi123.stdout:4/646: mkdir d3/d2c/d43/d26/d3e/da9/dd9 0 2024-02-20T08:05:38.030 INFO:tasks.workunit.client.0.smithi123.stdout:8/601: creat d6/d1c/d2c/db9/dc3/fcc x:0 0 0 2024-02-20T08:05:38.030 INFO:tasks.workunit.client.0.smithi123.stdout:4/647: chown d3/d2c/d43/d26/d3e/da9/fbb 131461634 1 2024-02-20T08:05:38.032 INFO:tasks.workunit.client.0.smithi123.stdout:3/667: rmdir d0/d6/d1a/d1b/d1c/d21 39 2024-02-20T08:05:38.034 INFO:tasks.workunit.client.0.smithi123.stdout:8/602: write d6/d32/d95/d7d/dab/fc1 [509391,37835] 0 2024-02-20T08:05:38.037 INFO:tasks.workunit.client.0.smithi123.stdout:4/648: rename d3/d18/d6c to d3/d97/dda 0 2024-02-20T08:05:38.041 INFO:tasks.workunit.client.0.smithi123.stdout:6/944: dwrite d0/d3e/d92/d56/d57/d91/fe8 [0,4194304] 0 2024-02-20T08:05:38.041 INFO:tasks.workunit.client.0.smithi123.stdout:3/668: fdatasync d0/d6/d1a/d1b/d57/dd0/f56 0 2024-02-20T08:05:38.043 INFO:tasks.workunit.client.0.smithi123.stdout:3/669: fdatasync d0/d6/d1a/d1b/d2a/f6f 0 2024-02-20T08:05:38.045 INFO:tasks.workunit.client.0.smithi123.stdout:8/603: rmdir d6/d1c/d22/d8c 39 2024-02-20T08:05:38.047 INFO:tasks.workunit.client.0.smithi123.stdout:4/649: dread d3/d2c/d43/d26/fa5 [0,4194304] 0 2024-02-20T08:05:38.050 INFO:tasks.workunit.client.0.smithi123.stdout:2/714: link d1a/d29/d42/f49 d1a/d4f/ff1 0 2024-02-20T08:05:38.054 INFO:tasks.workunit.client.0.smithi123.stdout:6/945: dwrite d0/d3e/d40/d48/d7b/de9/ff8 [0,4194304] 0 2024-02-20T08:05:38.057 INFO:tasks.workunit.client.0.smithi123.stdout:3/670: creat d0/d6/d1a/d1b/d1c/d3b/fe9 x:0 0 0 2024-02-20T08:05:38.057 INFO:tasks.workunit.client.0.smithi123.stdout:8/604: dwrite d6/dbd/f85 [0,4194304] 0 2024-02-20T08:05:38.059 INFO:tasks.workunit.client.0.smithi123.stdout:3/671: chown d0/d6/d1a/d1b/lb1 78296007 1 2024-02-20T08:05:38.060 INFO:tasks.workunit.client.0.smithi123.stdout:2/715: symlink d1a/d29/d5d/lf2 0 2024-02-20T08:05:38.062 INFO:tasks.workunit.client.0.smithi123.stdout:2/716: chown d1a/d29/d42/d52/d98/da1/deb/f9f 72 1 2024-02-20T08:05:38.062 INFO:tasks.workunit.client.0.smithi123.stdout:2/717: stat l4 0 2024-02-20T08:05:38.067 INFO:tasks.workunit.client.0.smithi123.stdout:3/672: rmdir d0/d6/d1a/d1b/d57 39 2024-02-20T08:05:38.069 INFO:tasks.workunit.client.0.smithi123.stdout:2/718: symlink d1a/d29/d42/dc8/lf3 0 2024-02-20T08:05:38.074 INFO:tasks.workunit.client.0.smithi123.stdout:6/946: dwrite d0/fe [4194304,4194304] 0 2024-02-20T08:05:38.074 INFO:tasks.workunit.client.0.smithi123.stdout:2/719: creat d1a/ff4 x:0 0 0 2024-02-20T08:05:38.078 INFO:tasks.workunit.client.0.smithi123.stdout:2/720: chown d1a/d29/d42/fda 1692265 1 2024-02-20T08:05:38.078 INFO:tasks.workunit.client.0.smithi123.stdout:8/605: dwrite d6/d1c/d22/d8c/f9a [0,4194304] 0 2024-02-20T08:05:38.079 INFO:tasks.workunit.client.0.smithi123.stdout:8/606: stat d6/d32/d95/d7d/dab 0 2024-02-20T08:05:38.084 INFO:tasks.workunit.client.0.smithi123.stdout:4/650: dread d3/d2c/f5d [0,4194304] 0 2024-02-20T08:05:38.084 INFO:tasks.workunit.client.0.smithi123.stdout:8/607: dread - d6/d1c/d2c/f79 zero size 2024-02-20T08:05:38.086 INFO:tasks.workunit.client.0.smithi123.stdout:4/651: mknod d3/d2c/d43/d34/cdb 0 2024-02-20T08:05:38.090 INFO:tasks.workunit.client.0.smithi123.stdout:4/652: mknod d3/d18/cdc 0 2024-02-20T08:05:38.093 INFO:tasks.workunit.client.0.smithi123.stdout:6/947: dwrite d0/f22 [0,4194304] 0 2024-02-20T08:05:38.098 INFO:tasks.workunit.client.0.smithi123.stdout:6/948: creat d0/d3e/d40/d48/d79/d100/f12f x:0 0 0 2024-02-20T08:05:38.099 INFO:tasks.workunit.client.0.smithi123.stdout:4/653: dwrite d3/d2c/d5a/fad [0,4194304] 0 2024-02-20T08:05:38.105 INFO:tasks.workunit.client.0.smithi123.stdout:8/608: write d6/dbd/d5b/f77 [1170922,12136] 0 2024-02-20T08:05:38.106 INFO:tasks.workunit.client.0.smithi123.stdout:6/949: dread d0/f51 [0,4194304] 0 2024-02-20T08:05:38.110 INFO:tasks.workunit.client.0.smithi123.stdout:4/654: dwrite d3/d1e/f7b [4194304,4194304] 0 2024-02-20T08:05:38.110 INFO:tasks.workunit.client.0.smithi123.stdout:8/609: chown d6/d32/d95/c78 93797093 1 2024-02-20T08:05:38.111 INFO:tasks.workunit.client.0.smithi123.stdout:2/721: dwrite d1a/d29/d39/f59 [0,4194304] 0 2024-02-20T08:05:38.112 INFO:tasks.workunit.client.0.smithi123.stdout:8/610: fdatasync d6/f3b 0 2024-02-20T08:05:38.114 INFO:tasks.workunit.client.0.smithi123.stdout:2/722: read d1a/d29/d5d/f7e [956283,16554] 0 2024-02-20T08:05:38.114 INFO:tasks.workunit.client.0.smithi123.stdout:6/950: creat d0/d3e/d92/f130 x:0 0 0 2024-02-20T08:05:38.121 INFO:tasks.workunit.client.0.smithi123.stdout:8/611: rename d6/d1c/d2c to d6/d1c/d22/d8c/dcd 0 2024-02-20T08:05:38.123 INFO:tasks.workunit.client.0.smithi123.stdout:4/655: symlink d3/d2c/d43/ldd 0 2024-02-20T08:05:38.124 INFO:tasks.workunit.client.0.smithi123.stdout:4/656: readlink d3/d2c/d43/d98/lc0 0 2024-02-20T08:05:38.125 INFO:tasks.workunit.client.0.smithi123.stdout:8/612: stat d6/c2b 0 2024-02-20T08:05:38.126 INFO:tasks.workunit.client.0.smithi123.stdout:6/951: creat d0/d3e/d40/f131 x:0 0 0 2024-02-20T08:05:38.126 INFO:tasks.workunit.client.0.smithi123.stdout:8/613: dread - d6/d1c/fbc zero size 2024-02-20T08:05:38.128 INFO:tasks.workunit.client.0.smithi123.stdout:4/657: symlink d3/d2c/d43/d26/d3e/lde 0 2024-02-20T08:05:38.132 INFO:tasks.workunit.client.0.smithi123.stdout:8/614: creat d6/dbd/d7e/d82/fce x:0 0 0 2024-02-20T08:05:38.137 INFO:tasks.workunit.client.0.smithi123.stdout:8/615: rename d6/d1c/d22/d8c/dcd/db9/dc3/fca to d6/d32/d95/d3f/fcf 0 2024-02-20T08:05:38.139 INFO:tasks.workunit.client.0.smithi123.stdout:8/616: dread - d6/d1c/d22/d8c/dcd/f79 zero size 2024-02-20T08:05:38.144 INFO:tasks.workunit.client.0.smithi123.stdout:6/952: dread d0/d3e/d40/d7f/fb9 [0,4194304] 0 2024-02-20T08:05:38.144 INFO:tasks.workunit.client.0.smithi123.stdout:8/617: rename d6/l18 to d6/d1c/d47/ld0 0 2024-02-20T08:05:38.146 INFO:tasks.workunit.client.0.smithi123.stdout:2/723: dread d1a/d29/d39/f5f [4194304,4194304] 0 2024-02-20T08:05:38.147 INFO:tasks.workunit.client.0.smithi123.stdout:6/953: symlink d0/d3e/d40/d48/daa/dab/l132 0 2024-02-20T08:05:38.149 INFO:tasks.workunit.client.0.smithi123.stdout:8/618: creat d6/dbd/d5b/d8f/d99/fd1 x:0 0 0 2024-02-20T08:05:38.149 INFO:tasks.workunit.client.0.smithi123.stdout:4/658: dread d3/ff [4194304,4194304] 0 2024-02-20T08:05:38.151 INFO:tasks.workunit.client.0.smithi123.stdout:4/659: readlink d3/d18/d63/lae 0 2024-02-20T08:05:38.151 INFO:tasks.workunit.client.0.smithi123.stdout:2/724: fsync d1a/d29/d42/d4e/f8c 0 2024-02-20T08:05:38.152 INFO:tasks.workunit.client.0.smithi123.stdout:6/954: dread d0/d38/f4f [0,4194304] 0 2024-02-20T08:05:38.152 INFO:tasks.workunit.client.0.smithi123.stdout:4/660: readlink d3/d18/d7d/d96/dbc/lce 0 2024-02-20T08:05:38.232 INFO:tasks.workunit.client.0.smithi123.stdout:8/619: mkdir d6/dbd/d5b/d8f/d99/dd2 0 2024-02-20T08:05:38.280 INFO:tasks.workunit.client.0.smithi123.stdout:8/620: mkdir d6/d1c/d22/d8c/dcd/db9/dc3/dd3 0 2024-02-20T08:05:38.287 INFO:tasks.workunit.client.0.smithi123.stdout:8/621: creat d6/d1c/d22/d8c/dcd/fd4 x:0 0 0 2024-02-20T08:05:38.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/661: write d3/d97/dda/db6/f9e [1042029,130297] 0 2024-02-20T08:05:38.293 INFO:tasks.workunit.client.0.smithi123.stdout:8/622: mkdir d6/d32/dd5 0 2024-02-20T08:05:38.294 INFO:tasks.workunit.client.0.smithi123.stdout:2/725: write d1a/f32 [4961472,41691] 0 2024-02-20T08:05:38.296 INFO:tasks.workunit.client.0.smithi123.stdout:6/955: getdents d0/d9f/df1/d10c 0 2024-02-20T08:05:38.296 INFO:tasks.workunit.client.0.smithi123.stdout:2/726: write d1a/d7f/f91 [781192,120526] 0 2024-02-20T08:05:38.297 INFO:tasks.workunit.client.0.smithi123.stdout:6/956: readlink d0/d3e/d40/l68 0 2024-02-20T08:05:38.297 INFO:tasks.workunit.client.0.smithi123.stdout:4/662: dread d3/d1e/f60 [0,4194304] 0 2024-02-20T08:05:38.305 INFO:tasks.workunit.client.0.smithi123.stdout:6/957: creat d0/d38/f133 x:0 0 0 2024-02-20T08:05:38.306 INFO:tasks.workunit.client.0.smithi123.stdout:4/663: mknod d3/d2c/d43/d98/cdf 0 2024-02-20T08:05:38.307 INFO:tasks.workunit.client.0.smithi123.stdout:2/727: dwrite d1a/f5c [0,4194304] 0 2024-02-20T08:05:38.307 INFO:tasks.workunit.client.0.smithi123.stdout:6/958: read d0/d3e/d40/d48/d5d/f62 [400130,1174] 0 2024-02-20T08:05:38.309 INFO:tasks.workunit.client.0.smithi123.stdout:6/959: dread - d0/d3e/d92/d56/d57/d91/d101/f103 zero size 2024-02-20T08:05:38.310 INFO:tasks.workunit.client.0.smithi123.stdout:6/960: readlink d0/d38/l76 0 2024-02-20T08:05:38.311 INFO:tasks.workunit.client.0.smithi123.stdout:6/961: fdatasync d0/d9f/df1/d10c/f11b 0 2024-02-20T08:05:38.314 INFO:tasks.workunit.client.0.smithi123.stdout:4/664: dwrite d3/d1e/f5b [0,4194304] 0 2024-02-20T08:05:38.316 INFO:tasks.workunit.client.0.smithi123.stdout:4/665: chown d3/d18/d63/lae 1111751047 1 2024-02-20T08:05:38.330 INFO:tasks.workunit.client.0.smithi123.stdout:8/623: truncate d6/d1c/d22/d8c/f9a 2404531 0 2024-02-20T08:05:38.331 INFO:tasks.workunit.client.0.smithi123.stdout:8/624: chown d6/dbd/d5b/d8f/d99/dd2 553536802 1 2024-02-20T08:05:38.332 INFO:tasks.workunit.client.0.smithi123.stdout:4/666: link d3/d1e/c71 d3/d2c/d43/d26/d3e/d8a/ce0 0 2024-02-20T08:05:38.332 INFO:tasks.workunit.client.0.smithi123.stdout:4/667: dread - d3/d1e/fc4 zero size 2024-02-20T08:05:38.334 INFO:tasks.workunit.client.0.smithi123.stdout:8/625: stat d6/l19 0 2024-02-20T08:05:38.336 INFO:tasks.workunit.client.0.smithi123.stdout:4/668: write d3/d2c/f5d [4404377,52601] 0 2024-02-20T08:05:38.339 INFO:tasks.workunit.client.0.smithi123.stdout:6/962: write d0/d3e/d40/d48/daa/ddf/fd6 [207207,4724] 0 2024-02-20T08:05:38.340 INFO:tasks.workunit.client.0.smithi123.stdout:4/669: creat d3/d18/d7d/d8b/d95/fe1 x:0 0 0 2024-02-20T08:05:38.342 INFO:tasks.workunit.client.0.smithi123.stdout:6/963: rmdir d0/d3e/d92/d56/d57/d91 39 2024-02-20T08:05:38.344 INFO:tasks.workunit.client.0.smithi123.stdout:4/670: creat d3/d1e/d81/fe2 x:0 0 0 2024-02-20T08:05:38.345 INFO:tasks.workunit.client.0.smithi123.stdout:4/671: chown d3/d1e/d81/fe2 0 1 2024-02-20T08:05:38.347 INFO:tasks.workunit.client.0.smithi123.stdout:4/672: readlink d3/l1a 0 2024-02-20T08:05:38.351 INFO:tasks.workunit.client.0.smithi123.stdout:4/673: readlink d3/d2c/l56 0 2024-02-20T08:05:38.354 INFO:tasks.workunit.client.0.smithi123.stdout:6/964: mkdir d0/d11d/d134 0 2024-02-20T08:05:38.355 INFO:tasks.workunit.client.0.smithi123.stdout:8/626: dread d6/dbd/f56 [0,4194304] 0 2024-02-20T08:05:38.355 INFO:tasks.workunit.client.0.smithi123.stdout:6/965: fsync d0/d3e/d40/d48/d5d/dbf/de3/f10a 0 2024-02-20T08:05:38.356 INFO:tasks.workunit.client.0.smithi123.stdout:4/674: write d3/d18/d7d/d87/f9a [3333633,13826] 0 2024-02-20T08:05:38.360 INFO:tasks.workunit.client.0.smithi123.stdout:6/966: mkdir d0/d3e/d40/d48/d4a/d135 0 2024-02-20T08:05:38.362 INFO:tasks.workunit.client.0.smithi123.stdout:4/675: rmdir d3/d18/d7d/d96/dbc 39 2024-02-20T08:05:38.368 INFO:tasks.workunit.client.0.smithi123.stdout:4/676: mkdir d3/d97/dda/de3 0 2024-02-20T08:05:38.369 INFO:tasks.workunit.client.0.smithi123.stdout:4/677: chown d3/d18/d7d/d87/f9a 2480 1 2024-02-20T08:05:38.374 INFO:tasks.workunit.client.0.smithi123.stdout:4/678: rmdir d3/d1e 39 2024-02-20T08:05:38.375 INFO:tasks.workunit.client.0.smithi123.stdout:8/627: dread d6/dbd/d5b/d8f/d98/f9b [0,4194304] 0 2024-02-20T08:05:38.377 INFO:tasks.workunit.client.0.smithi123.stdout:6/967: link d0/d3e/d40/d48/d4a/fad d0/d3e/d40/d90/d94/dc9/f136 0 2024-02-20T08:05:38.385 INFO:tasks.workunit.client.0.smithi123.stdout:8/628: unlink d6/dbd/d7e/fa3 0 2024-02-20T08:05:38.385 INFO:tasks.workunit.client.0.smithi123.stdout:8/629: chown d6/d1c/d22/d8c/dcd 8172286 1 2024-02-20T08:05:38.386 INFO:tasks.workunit.client.0.smithi123.stdout:4/679: mkdir d3/d1e/de4 0 2024-02-20T08:05:38.386 INFO:tasks.workunit.client.0.smithi123.stdout:8/630: truncate d6/dbd/fb5 352840 0 2024-02-20T08:05:38.409 INFO:tasks.workunit.client.0.smithi123.stdout:5/616: sync 2024-02-20T08:05:38.409 INFO:tasks.workunit.client.0.smithi123.stdout:9/624: sync 2024-02-20T08:05:38.414 INFO:tasks.workunit.client.0.smithi123.stdout:4/680: rmdir d3/d18/d7d/d96 39 2024-02-20T08:05:38.415 INFO:tasks.workunit.client.0.smithi123.stdout:9/625: dwrite d6/d19/d1a/d6d/d7e/fac [0,4194304] 0 2024-02-20T08:05:38.415 INFO:tasks.workunit.client.0.smithi123.stdout:4/681: write d3/d1e/fc4 [619996,17552] 0 2024-02-20T08:05:38.427 INFO:tasks.workunit.client.0.smithi123.stdout:5/617: mknod d0/d34/d67/d80/d84/ccc 0 2024-02-20T08:05:38.428 INFO:tasks.workunit.client.0.smithi123.stdout:9/626: write d6/dbc/fbe [875173,5290] 0 2024-02-20T08:05:38.475 INFO:tasks.workunit.client.0.smithi123.stdout:8/631: mknod d6/d1c/d22/d8c/da2/cd6 0 2024-02-20T08:05:38.483 INFO:tasks.workunit.client.0.smithi123.stdout:4/682: dwrite d3/d18/d63/fa6 [0,4194304] 0 2024-02-20T08:05:38.490 INFO:tasks.workunit.client.0.smithi123.stdout:9/627: getdents d6/d19/d1a/d2b/d65/d77/da5 0 2024-02-20T08:05:38.493 INFO:tasks.workunit.client.0.smithi123.stdout:4/683: mknod d3/d18/ce5 0 2024-02-20T08:05:38.502 INFO:tasks.workunit.client.0.smithi123.stdout:9/628: getdents d6/d2a/d27/d6f 0 2024-02-20T08:05:38.504 INFO:tasks.workunit.client.0.smithi123.stdout:9/629: fsync d6/d19/f34 0 2024-02-20T08:05:38.511 INFO:tasks.workunit.client.0.smithi123.stdout:9/630: dread d6/d2a/d27/f2f [0,4194304] 0 2024-02-20T08:05:38.512 INFO:tasks.workunit.client.0.smithi123.stdout:9/631: readlink d6/d19/d1a/d2b/lc8 0 2024-02-20T08:05:38.513 INFO:tasks.workunit.client.0.smithi123.stdout:4/684: dread d3/d2c/d43/d34/f4f [0,4194304] 0 2024-02-20T08:05:38.517 INFO:tasks.workunit.client.0.smithi123.stdout:9/632: mknod d6/d19/d1a/d2b/d65/d77/cc9 0 2024-02-20T08:05:38.523 INFO:tasks.workunit.client.0.smithi123.stdout:4/685: mkdir d3/d2c/d43/d26/d3e/da9/dd9/de6 0 2024-02-20T08:05:38.526 INFO:tasks.workunit.client.0.smithi123.stdout:5/618: truncate d0/d34/d48/d56/dbb/d27/d37/f92 151506 0 2024-02-20T08:05:38.528 INFO:tasks.workunit.client.0.smithi123.stdout:5/619: truncate d0/d34/d48/d56/dbb/d27/d37/fb7 4615478 0 2024-02-20T08:05:38.531 INFO:tasks.workunit.client.0.smithi123.stdout:5/620: mkdir d0/d34/d67/d80/dcd 0 2024-02-20T08:05:38.557 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:38 smithi123 ceph-mon[29383]: pgmap v38: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 258 op/s 2024-02-20T08:05:38.588 INFO:tasks.workunit.client.0.smithi123.stdout:6/968: creat d0/d3e/d40/d90/d94/f137 x:0 0 0 2024-02-20T08:05:38.594 INFO:tasks.workunit.client.0.smithi123.stdout:6/969: dwrite d0/d3e/d40/d48/daa/ddf/fd6 [0,4194304] 0 2024-02-20T08:05:38.630 INFO:tasks.workunit.client.0.smithi123.stdout:4/686: dwrite d3/d2c/d43/d26/fa5 [0,4194304] 0 2024-02-20T08:05:38.639 INFO:tasks.workunit.client.0.smithi123.stdout:4/687: link d3/d2c/d5a/fad d3/d2c/d43/d26/d3e/da9/dd9/fe7 0 2024-02-20T08:05:38.640 INFO:tasks.workunit.client.0.smithi123.stdout:4/688: rmdir d3/d18/d7d 39 2024-02-20T08:05:38.643 INFO:tasks.workunit.client.0.smithi123.stdout:4/689: unlink d3/d18/d63/lae 0 2024-02-20T08:05:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:38 smithi194 ceph-mon[37804]: pgmap v38: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 258 op/s 2024-02-20T08:05:38.647 INFO:tasks.workunit.client.0.smithi123.stdout:4/690: link d3/d2c/d43/l57 d3/d2c/d43/d26/d3e/le8 0 2024-02-20T08:05:38.662 INFO:tasks.workunit.client.0.smithi123.stdout:8/632: rmdir d6/dbd/d5b/d8f 39 2024-02-20T08:05:38.663 INFO:tasks.workunit.client.0.smithi123.stdout:4/691: dread d3/d18/f31 [0,4194304] 0 2024-02-20T08:05:38.664 INFO:tasks.workunit.client.0.smithi123.stdout:1/601: sync 2024-02-20T08:05:38.665 INFO:tasks.workunit.client.0.smithi123.stdout:4/692: chown d3/d18/d63/fab 639846050 1 2024-02-20T08:05:38.670 INFO:tasks.workunit.client.0.smithi123.stdout:1/602: dread d3/de/d14/d26/d2e/fc7 [0,4194304] 0 2024-02-20T08:05:38.670 INFO:tasks.workunit.client.0.smithi123.stdout:4/693: mkdir d3/d18/d7d/d96/de9 0 2024-02-20T08:05:38.672 INFO:tasks.workunit.client.0.smithi123.stdout:1/603: symlink d3/db/d41/ld4 0 2024-02-20T08:05:38.675 INFO:tasks.workunit.client.0.smithi123.stdout:4/694: link d3/d2c/d43/d26/d2e/fbf d3/d2c/d43/d26/d3e/d8a/fea 0 2024-02-20T08:05:38.676 INFO:tasks.workunit.client.0.smithi123.stdout:4/695: stat d3/d2c/d43/d26/d2e/c67 0 2024-02-20T08:05:38.680 INFO:tasks.workunit.client.0.smithi123.stdout:4/696: dwrite d3/d18/d7d/d87/f9a [4194304,4194304] 0 2024-02-20T08:05:38.749 INFO:tasks.workunit.client.0.smithi123.stdout:5/621: mkdir d0/d34/d48/d56/dce 0 2024-02-20T08:05:38.754 INFO:tasks.workunit.client.0.smithi123.stdout:5/622: dwrite d0/d34/d48/d4b/d51/f72 [0,4194304] 0 2024-02-20T08:05:38.756 INFO:tasks.workunit.client.0.smithi123.stdout:5/623: write d0/d34/d48/d56/fb1 [962855,88408] 0 2024-02-20T08:05:38.817 INFO:tasks.workunit.client.0.smithi123.stdout:3/673: sync 2024-02-20T08:05:38.817 INFO:tasks.workunit.client.0.smithi123.stdout:7/547: sync 2024-02-20T08:05:38.817 INFO:tasks.workunit.client.0.smithi123.stdout:0/786: sync 2024-02-20T08:05:38.817 INFO:tasks.workunit.client.0.smithi123.stdout:2/728: sync 2024-02-20T08:05:38.824 INFO:tasks.workunit.client.0.smithi123.stdout:5/624: mkdir d0/d34/d48/d56/dcf 0 2024-02-20T08:05:38.826 INFO:tasks.workunit.client.0.smithi123.stdout:0/787: creat d2/dd/d4f/d7c/da4/d28/daf/f10c x:0 0 0 2024-02-20T08:05:38.830 INFO:tasks.workunit.client.0.smithi123.stdout:6/970: write d0/f21 [4168251,49326] 0 2024-02-20T08:05:38.831 INFO:tasks.workunit.client.0.smithi123.stdout:7/548: link d0/d6/dd/d52/fac d0/d6/dd/d52/d26/d9b/d61/db1/fc3 0 2024-02-20T08:05:38.832 INFO:tasks.workunit.client.0.smithi123.stdout:6/971: write d0/d3e/d40/d48/d7b/fe0 [27184,18049] 0 2024-02-20T08:05:38.837 INFO:tasks.workunit.client.0.smithi123.stdout:7/549: creat d0/d6/dd/d52/d26/d9b/d61/db1/fc4 x:0 0 0 2024-02-20T08:05:38.839 INFO:tasks.workunit.client.0.smithi123.stdout:5/625: link d0/l5 d0/d34/d48/d4b/ld0 0 2024-02-20T08:05:38.845 INFO:tasks.workunit.client.0.smithi123.stdout:0/788: dread d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:38.846 INFO:tasks.workunit.client.0.smithi123.stdout:9/633: rename d6/d19/f9e to d6/d19/d1a/d2b/d65/d77/fca 0 2024-02-20T08:05:38.852 INFO:tasks.workunit.client.0.smithi123.stdout:0/789: creat d2/dd/d4f/d61/f10d x:0 0 0 2024-02-20T08:05:38.853 INFO:tasks.workunit.client.0.smithi123.stdout:0/790: chown d2/dd/d4f/d7c/da4/d28 1672222 1 2024-02-20T08:05:38.855 INFO:tasks.workunit.client.0.smithi123.stdout:9/634: link d6/d19/d1a/d2b/d28/d9a/f26 d6/d19/d1a/d7c/d81/fcb 0 2024-02-20T08:05:38.856 INFO:tasks.workunit.client.0.smithi123.stdout:4/697: rename d3/d1e/f7b to d3/d2c/feb 0 2024-02-20T08:05:38.857 INFO:tasks.workunit.client.0.smithi123.stdout:5/626: dread d0/f16 [0,4194304] 0 2024-02-20T08:05:38.862 INFO:tasks.workunit.client.0.smithi123.stdout:9/635: mkdir d6/d19/d1a/d6d/d7e/d80/dcc 0 2024-02-20T08:05:38.863 INFO:tasks.workunit.client.0.smithi123.stdout:4/698: dwrite d3/d1e/d81/fe2 [0,4194304] 0 2024-02-20T08:05:38.872 INFO:tasks.workunit.client.0.smithi123.stdout:9/636: read d6/d2a/f17 [7336021,8139] 0 2024-02-20T08:05:38.873 INFO:tasks.workunit.client.0.smithi123.stdout:4/699: creat d3/d2c/d43/d26/d2e/dcd/fec x:0 0 0 2024-02-20T08:05:38.874 INFO:tasks.workunit.client.0.smithi123.stdout:4/700: read d3/d2c/d43/d26/fa5 [2382049,70805] 0 2024-02-20T08:05:38.879 INFO:tasks.workunit.client.0.smithi123.stdout:3/674: rename d0/d6/d1a/d1b/d1c/d21/d8e/lbb to d0/d6/d1a/lea 0 2024-02-20T08:05:38.883 INFO:tasks.workunit.client.0.smithi123.stdout:4/701: symlink d3/d2c/d43/d26/d2e/led 0 2024-02-20T08:05:38.883 INFO:tasks.workunit.client.0.smithi123.stdout:8/633: write d6/d32/fa7 [82220,24240] 0 2024-02-20T08:05:38.884 INFO:tasks.workunit.client.0.smithi123.stdout:0/791: getdents d2/dd/d4f/d7c/da4/db6 0 2024-02-20T08:05:38.889 INFO:tasks.workunit.client.0.smithi123.stdout:4/702: rmdir d3/d2c/d43/d98 39 2024-02-20T08:05:38.890 INFO:tasks.workunit.client.0.smithi123.stdout:4/703: read d3/d2c/d43/d34/f4f [1092018,2742] 0 2024-02-20T08:05:38.895 INFO:tasks.workunit.client.0.smithi123.stdout:4/704: creat d3/d2c/d43/d26/d2e/fee x:0 0 0 2024-02-20T08:05:38.896 INFO:tasks.workunit.client.0.smithi123.stdout:8/634: mkdir d6/dbd/d5b/d8f/dd7 0 2024-02-20T08:05:38.898 INFO:tasks.workunit.client.0.smithi123.stdout:9/637: getdents d6/d19/d1a/d2b/d28/da0 0 2024-02-20T08:05:38.898 INFO:tasks.workunit.client.0.smithi123.stdout:9/638: chown d6/d19/f49 1494 1 2024-02-20T08:05:38.899 INFO:tasks.workunit.client.0.smithi123.stdout:0/792: symlink d2/d3/l10e 0 2024-02-20T08:05:38.903 INFO:tasks.workunit.client.0.smithi123.stdout:9/639: creat d6/d19/d1a/d7c/d81/fcd x:0 0 0 2024-02-20T08:05:38.904 INFO:tasks.workunit.client.0.smithi123.stdout:9/640: dread - d6/d2a/d27/d6f/fb9 zero size 2024-02-20T08:05:38.907 INFO:tasks.workunit.client.0.smithi123.stdout:7/550: write d0/db/f27 [134501,105209] 0 2024-02-20T08:05:38.908 INFO:tasks.workunit.client.0.smithi123.stdout:9/641: mkdir d6/d2a/d27/d3c/dce 0 2024-02-20T08:05:38.910 INFO:tasks.workunit.client.0.smithi123.stdout:4/705: getdents d3 0 2024-02-20T08:05:38.911 INFO:tasks.workunit.client.0.smithi123.stdout:0/793: getdents d2/de/d1e/d84 0 2024-02-20T08:05:38.912 INFO:tasks.workunit.client.0.smithi123.stdout:6/972: dwrite d0/d3e/d40/fdd [0,4194304] 0 2024-02-20T08:05:38.913 INFO:tasks.workunit.client.0.smithi123.stdout:7/551: chown d0/d6/dd/d52/d26/fa4 583397716 1 2024-02-20T08:05:38.913 INFO:tasks.workunit.client.0.smithi123.stdout:6/973: stat d0/d9f/f121 0 2024-02-20T08:05:38.917 INFO:tasks.workunit.client.0.smithi123.stdout:9/642: read d6/d2a/d27/f54 [1969760,59510] 0 2024-02-20T08:05:38.920 INFO:tasks.workunit.client.0.smithi123.stdout:4/706: rmdir d3/d18/d63 39 2024-02-20T08:05:38.925 INFO:tasks.workunit.client.0.smithi123.stdout:5/627: truncate d0/d34/d67/d80/d84/faa 2129065 0 2024-02-20T08:05:38.927 INFO:tasks.workunit.client.0.smithi123.stdout:9/643: fdatasync d6/d19/d1a/d2b/d28/f55 0 2024-02-20T08:05:38.931 INFO:tasks.workunit.client.0.smithi123.stdout:4/707: dread d3/f1b [0,4194304] 0 2024-02-20T08:05:38.933 INFO:tasks.workunit.client.0.smithi123.stdout:0/794: creat d2/d3/f10f x:0 0 0 2024-02-20T08:05:38.938 INFO:tasks.workunit.client.0.smithi123.stdout:6/974: dread d0/f31 [4194304,4194304] 0 2024-02-20T08:05:38.942 INFO:tasks.workunit.client.0.smithi123.stdout:4/708: symlink d3/d2c/d43/d34/lef 0 2024-02-20T08:05:38.944 INFO:tasks.workunit.client.0.smithi123.stdout:5/628: creat d0/d34/d67/d80/dcd/fd1 x:0 0 0 2024-02-20T08:05:38.944 INFO:tasks.workunit.client.0.smithi123.stdout:3/675: dwrite d0/d6/d1a/d1b/d1c/d61/f96 [0,4194304] 0 2024-02-20T08:05:38.948 INFO:tasks.workunit.client.0.smithi123.stdout:6/975: creat d0/d3e/d40/d48/d5d/dbf/f138 x:0 0 0 2024-02-20T08:05:38.950 INFO:tasks.workunit.client.0.smithi123.stdout:6/976: write d0/d3e/d40/d48/d79/f8b [870104,83117] 0 2024-02-20T08:05:38.956 INFO:tasks.workunit.client.0.smithi123.stdout:5/629: mkdir d0/d34/d48/d56/d4c/d43/dd2 0 2024-02-20T08:05:38.957 INFO:tasks.workunit.client.0.smithi123.stdout:7/552: write d0/f64 [1407573,14650] 0 2024-02-20T08:05:38.961 INFO:tasks.workunit.client.0.smithi123.stdout:4/709: unlink d3/d18/d63/fcf 0 2024-02-20T08:05:38.962 INFO:tasks.workunit.client.0.smithi123.stdout:6/977: truncate d0/d3e/d40/d48/daa/dab/fc0 5680628 0 2024-02-20T08:05:38.964 INFO:tasks.workunit.client.0.smithi123.stdout:3/676: symlink d0/d6/d1a/d1b/leb 0 2024-02-20T08:05:38.967 INFO:tasks.workunit.client.0.smithi123.stdout:7/553: read d0/d6/dd/d52/d26/d9b/d61/f82 [59067,126173] 0 2024-02-20T08:05:38.969 INFO:tasks.workunit.client.0.smithi123.stdout:9/644: write d6/f8d [315761,6408] 0 2024-02-20T08:05:38.970 INFO:tasks.workunit.client.0.smithi123.stdout:5/630: dread d0/d34/f66 [0,4194304] 0 2024-02-20T08:05:38.971 INFO:tasks.workunit.client.0.smithi123.stdout:6/978: fsync d0/d3e/d92/d56/d89/d73/fd5 0 2024-02-20T08:05:38.975 INFO:tasks.workunit.client.0.smithi123.stdout:0/795: truncate d2/dd/d4f/d7c/d82/f96 3233883 0 2024-02-20T08:05:38.975 INFO:tasks.workunit.client.0.smithi123.stdout:5/631: dread d0/d34/d48/d56/d25/f76 [0,4194304] 0 2024-02-20T08:05:38.976 INFO:tasks.workunit.client.0.smithi123.stdout:7/554: rename d0/db/d21/d42/d5f to d0/d23/dc5 0 2024-02-20T08:05:38.984 INFO:tasks.workunit.client.0.smithi123.stdout:3/677: mknod d0/dd/d48/d8d/dcf/cec 0 2024-02-20T08:05:38.984 INFO:tasks.workunit.client.0.smithi123.stdout:3/678: chown d0/d6/d1a 4496 1 2024-02-20T08:05:38.986 INFO:tasks.workunit.client.0.smithi123.stdout:0/796: mknod d2/dd/d4f/d7c/da4/db6/c110 0 2024-02-20T08:05:38.988 INFO:tasks.workunit.client.0.smithi123.stdout:5/632: creat d0/d34/d48/d56/dbb/d27/d4e/fd3 x:0 0 0 2024-02-20T08:05:38.989 INFO:tasks.workunit.client.0.smithi123.stdout:5/633: write d0/d34/d48/d56/d4c/f6b [696669,10736] 0 2024-02-20T08:05:38.990 INFO:tasks.workunit.client.0.smithi123.stdout:6/979: rename d0/f13 to d0/d3e/d40/d7f/f139 0 2024-02-20T08:05:38.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/555: symlink d0/db/lc6 0 2024-02-20T08:05:38.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/556: readlink d0/d6/dd/d52/d26/d9b/l17 0 2024-02-20T08:05:38.997 INFO:tasks.workunit.client.0.smithi123.stdout:9/645: write d6/f3f [1293474,31230] 0 2024-02-20T08:05:38.999 INFO:tasks.workunit.client.0.smithi123.stdout:0/797: mkdir d2/de/d111 0 2024-02-20T08:05:39.003 INFO:tasks.workunit.client.0.smithi123.stdout:5/634: rename d0/d34/d48/d56/d25/f29 to d0/d34/d48/d56/dbb/d27/d4e/fd4 0 2024-02-20T08:05:39.007 INFO:tasks.workunit.client.0.smithi123.stdout:4/710: getdents d3/d2c/d43/d34 0 2024-02-20T08:05:39.008 INFO:tasks.workunit.client.0.smithi123.stdout:9/646: fdatasync d6/d19/f4a 0 2024-02-20T08:05:39.011 INFO:tasks.workunit.client.0.smithi123.stdout:9/647: write d6/d19/d1a/d7c/d81/fcd [277891,41554] 0 2024-02-20T08:05:39.014 INFO:tasks.workunit.client.0.smithi123.stdout:0/798: rmdir d2/dd/d4f/d7c/d82 39 2024-02-20T08:05:39.014 INFO:tasks.workunit.client.0.smithi123.stdout:4/711: dwrite d3/d18/d7d/d87/f9a [4194304,4194304] 0 2024-02-20T08:05:39.016 INFO:tasks.workunit.client.0.smithi123.stdout:0/799: read d2/dd/d4f/d61/f7d [87743,114836] 0 2024-02-20T08:05:39.017 INFO:tasks.workunit.client.0.smithi123.stdout:0/800: write d2/dd/d4f/d61/f7d [279949,19318] 0 2024-02-20T08:05:39.024 INFO:tasks.workunit.client.0.smithi123.stdout:3/679: link d0/f8c d0/d6/d1a/d62/d82/fed 0 2024-02-20T08:05:39.025 INFO:tasks.workunit.client.0.smithi123.stdout:3/680: dread - d0/d6/d1a/d1b/d9d/fd3 zero size 2024-02-20T08:05:39.032 INFO:tasks.workunit.client.0.smithi123.stdout:3/681: dwrite d0/dd/d48/f92 [0,4194304] 0 2024-02-20T08:05:39.033 INFO:tasks.workunit.client.0.smithi123.stdout:0/801: symlink d2/de/dd9/l112 0 2024-02-20T08:05:39.034 INFO:tasks.workunit.client.0.smithi123.stdout:3/682: readlink d0/d6/d1a/d1b/leb 0 2024-02-20T08:05:39.036 INFO:tasks.workunit.client.0.smithi123.stdout:6/980: symlink d0/d3e/d40/d90/d102/l13a 0 2024-02-20T08:05:39.037 INFO:tasks.workunit.client.0.smithi123.stdout:9/648: mknod d6/d19/d1a/d2b/ccf 0 2024-02-20T08:05:39.042 INFO:tasks.workunit.client.0.smithi123.stdout:3/683: mkdir d0/d6/d1a/d1b/d2a/d86/dee 0 2024-02-20T08:05:39.043 INFO:tasks.workunit.client.0.smithi123.stdout:7/557: getdents d0/d6/dd/d52/d26/d9b/d61 0 2024-02-20T08:05:39.050 INFO:tasks.workunit.client.0.smithi123.stdout:5/635: getdents d0/d34/d67/d80/d84 0 2024-02-20T08:05:39.052 INFO:tasks.workunit.client.0.smithi123.stdout:0/802: mknod d2/dd/d4f/d7c/d82/c113 0 2024-02-20T08:05:39.056 INFO:tasks.workunit.client.0.smithi123.stdout:6/981: symlink d0/d3e/d92/d56/l13b 0 2024-02-20T08:05:39.065 INFO:tasks.workunit.client.0.smithi123.stdout:9/649: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/f62 [0,4194304] 0 2024-02-20T08:05:39.070 INFO:tasks.workunit.client.0.smithi123.stdout:0/803: dwrite d2/de/d1e/d1f/f25 [0,4194304] 0 2024-02-20T08:05:39.072 INFO:tasks.workunit.client.0.smithi123.stdout:0/804: stat d2/dd/d4f/d61/lc3 0 2024-02-20T08:05:39.072 INFO:tasks.workunit.client.0.smithi123.stdout:3/684: getdents d0/d6/d1a/d62 0 2024-02-20T08:05:39.073 INFO:tasks.workunit.client.0.smithi123.stdout:6/982: creat d0/d11d/d134/f13c x:0 0 0 2024-02-20T08:05:39.074 INFO:tasks.workunit.client.0.smithi123.stdout:5/636: link d0/d34/d48/d4b/d51/cb4 d0/d34/d48/cd5 0 2024-02-20T08:05:39.074 INFO:tasks.workunit.client.0.smithi123.stdout:9/650: dwrite d6/d19/d1a/f6a [0,4194304] 0 2024-02-20T08:05:39.076 INFO:tasks.workunit.client.0.smithi123.stdout:5/637: rename d0/d34/d48 to d0/d34/d48/d56/dbb/d27/d86/dd6 22 2024-02-20T08:05:39.084 INFO:tasks.workunit.client.0.smithi123.stdout:9/651: rename d6/d2a/c1d to d6/cd0 0 2024-02-20T08:05:39.086 INFO:tasks.workunit.client.0.smithi123.stdout:6/983: rmdir d0/d3e/d40/d48/d79/d100 39 2024-02-20T08:05:39.086 INFO:tasks.workunit.client.0.smithi123.stdout:5/638: truncate d0/d34/d48/d56/dbb/d27/d4e/f7f 637955 0 2024-02-20T08:05:39.086 INFO:tasks.workunit.client.0.smithi123.stdout:0/805: dwrite d2/de/d1e/d1f/fbf [0,4194304] 0 2024-02-20T08:05:39.088 INFO:tasks.workunit.client.0.smithi123.stdout:5/639: write d0/d34/d48/f6e [583051,5148] 0 2024-02-20T08:05:39.093 INFO:tasks.workunit.client.0.smithi123.stdout:5/640: chown d0/d34/d48/d4b/d51/f72 853296 1 2024-02-20T08:05:39.093 INFO:tasks.workunit.client.0.smithi123.stdout:6/984: unlink d0/l39 0 2024-02-20T08:05:39.096 INFO:tasks.workunit.client.0.smithi123.stdout:0/806: dwrite d2/f12 [0,4194304] 0 2024-02-20T08:05:39.098 INFO:tasks.workunit.client.0.smithi123.stdout:6/985: chown d0/d3e/d40/d48/daa/ddf/fd6 62028557 1 2024-02-20T08:05:39.099 INFO:tasks.workunit.client.0.smithi123.stdout:5/641: read d0/d34/d67/f71 [410590,1582] 0 2024-02-20T08:05:39.099 INFO:tasks.workunit.client.0.smithi123.stdout:9/652: link d6/ce d6/d19/d1a/d2b/d28/cd1 0 2024-02-20T08:05:39.101 INFO:tasks.workunit.client.0.smithi123.stdout:0/807: mknod d2/de/d1e/c114 0 2024-02-20T08:05:39.103 INFO:tasks.workunit.client.0.smithi123.stdout:9/653: rmdir d6/d19/d1a/d2b/d28/d9a/dae 39 2024-02-20T08:05:39.105 INFO:tasks.workunit.client.0.smithi123.stdout:6/986: mkdir d0/d3e/d92/d56/d57/d13d 0 2024-02-20T08:05:39.108 INFO:tasks.workunit.client.0.smithi123.stdout:0/808: getdents d2/d3/d37/d5f/d8a/dee 0 2024-02-20T08:05:39.111 INFO:tasks.workunit.client.0.smithi123.stdout:9/654: symlink d6/d19/d1a/d2b/d28/d9a/dae/ld2 0 2024-02-20T08:05:39.113 INFO:tasks.workunit.client.0.smithi123.stdout:5/642: dread d0/d34/d48/d4b/f4f [0,4194304] 0 2024-02-20T08:05:39.115 INFO:tasks.workunit.client.0.smithi123.stdout:0/809: unlink d2/d54/d78/fd8 0 2024-02-20T08:05:39.119 INFO:tasks.workunit.client.0.smithi123.stdout:9/655: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:39.120 INFO:tasks.workunit.client.0.smithi123.stdout:9/656: fsync d6/d19/d1a/d7c/d81/f97 0 2024-02-20T08:05:39.123 INFO:tasks.workunit.client.0.smithi123.stdout:1/604: sync 2024-02-20T08:05:39.124 INFO:tasks.workunit.client.0.smithi123.stdout:2/729: sync 2024-02-20T08:05:39.124 INFO:tasks.workunit.client.0.smithi123.stdout:1/605: readlink d3/de/d14/d26/d2e/d54/l3b 0 2024-02-20T08:05:39.125 INFO:tasks.workunit.client.0.smithi123.stdout:5/643: symlink d0/d34/d48/d56/dbb/d27/d37/ld7 0 2024-02-20T08:05:39.125 INFO:tasks.workunit.client.0.smithi123.stdout:1/606: chown d3/fc 31993 1 2024-02-20T08:05:39.127 INFO:tasks.workunit.client.0.smithi123.stdout:3/685: dread d0/d6/d1a/d1b/d1c/d21/d8e/f9a [0,4194304] 0 2024-02-20T08:05:39.132 INFO:tasks.workunit.client.0.smithi123.stdout:0/810: creat d2/dd/d4f/d61/d68/dfb/f115 x:0 0 0 2024-02-20T08:05:39.139 INFO:tasks.workunit.client.0.smithi123.stdout:1/607: rename d3/db/d7f/f97 to d3/db/d34/d74/d6f/d63/fd5 0 2024-02-20T08:05:39.139 INFO:tasks.workunit.client.0.smithi123.stdout:9/657: symlink d6/d19/d1a/d2b/ld3 0 2024-02-20T08:05:39.140 INFO:tasks.workunit.client.0.smithi123.stdout:6/987: dwrite d0/d3e/d40/d48/d4a/fad [0,4194304] 0 2024-02-20T08:05:39.141 INFO:tasks.workunit.client.0.smithi123.stdout:1/608: chown d3/de/d14/d26/d56/dbb 219842266 1 2024-02-20T08:05:39.142 INFO:tasks.workunit.client.0.smithi123.stdout:2/730: unlink d1a/c3f 0 2024-02-20T08:05:39.143 INFO:tasks.workunit.client.0.smithi123.stdout:5/644: symlink d0/d34/d48/d56/dbb/d27/d86/ld8 0 2024-02-20T08:05:39.145 INFO:tasks.workunit.client.0.smithi123.stdout:3/686: mkdir d0/d6/d1a/def 0 2024-02-20T08:05:39.146 INFO:tasks.workunit.client.0.smithi123.stdout:3/687: readlink d0/d6/d1a/d4b/d95/lbc 0 2024-02-20T08:05:39.151 INFO:tasks.workunit.client.0.smithi123.stdout:2/731: creat d1a/d29/d39/ff5 x:0 0 0 2024-02-20T08:05:39.154 INFO:tasks.workunit.client.0.smithi123.stdout:9/658: creat d6/d19/d1a/d6d/d7e/d80/fd4 x:0 0 0 2024-02-20T08:05:39.154 INFO:tasks.workunit.client.0.smithi123.stdout:3/688: dwrite d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:39.156 INFO:tasks.workunit.client.0.smithi123.stdout:0/811: fdatasync d2/de/d1e/d1f/f8e 0 2024-02-20T08:05:39.157 INFO:tasks.workunit.client.0.smithi123.stdout:9/659: chown d6/d2a/d27/d6f/d8b/cc3 30841 1 2024-02-20T08:05:39.159 INFO:tasks.workunit.client.0.smithi123.stdout:5/645: dread d0/d34/d48/d56/d25/f31 [0,4194304] 0 2024-02-20T08:05:39.161 INFO:tasks.workunit.client.0.smithi123.stdout:5/646: dread d0/d34/d48/d56/dbb/d27/d4e/f7f [0,4194304] 0 2024-02-20T08:05:39.161 INFO:tasks.workunit.client.0.smithi123.stdout:5/647: stat d0/d34/d48/d56 0 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.161+0000 7fda77226700 1 -- 172.21.15.123:0/3478112403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 msgr2=0x7fda700fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.161+0000 7fda77226700 1 --2- 172.21.15.123:0/3478112403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda700fcc40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fda5c004a50 tx=0x7fda5c00af40 comp rx=0 tx=0).stop 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 -- 172.21.15.123:0/3478112403 shutdown_connections 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 --2- 172.21.15.123:0/3478112403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda700fcc40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 --2- 172.21.15.123:0/3478112403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda700fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 -- 172.21.15.123:0/3478112403 >> 172.21.15.123:0/3478112403 conn(0x7fda700f6ca0 msgr2=0x7fda700f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 -- 172.21.15.123:0/3478112403 shutdown_connections 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.162+0000 7fda77226700 1 -- 172.21.15.123:0/3478112403 wait complete. 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.163+0000 7fda77226700 1 Processor -- start 2024-02-20T08:05:39.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.163+0000 7fda77226700 1 -- start start 2024-02-20T08:05:39.165 INFO:tasks.workunit.client.0.smithi123.stdout:2/732: mkdir d1a/d29/d42/dc8/df6 0 2024-02-20T08:05:39.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda77226700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda7010b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/648: read d0/d34/d48/d56/dbb/d27/d37/fb7 [3571736,1929] 0 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda77226700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda7010bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda77226700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7010c2b0 con 0x7fda700fc7f0 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda77226700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7010cb50 con 0x7fda700fb5e0 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda7010bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda7010bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53932/0 (socket says 172.21.15.123:53932) 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.164+0000 7fda6ffff700 1 -- 172.21.15.123:0/3932118991 learned_addr learned my addr 172.21.15.123:0/3932118991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.165+0000 7fda74fc2700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda7010b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.165+0000 7fda74fc2700 1 -- 172.21.15.123:0/3932118991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 msgr2=0x7fda7010bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.165+0000 7fda74fc2700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda7010bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.165+0000 7fda74fc2700 1 -- 172.21.15.123:0/3932118991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c005040 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.165+0000 7fda74fc2700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda7010b770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda700fc650 tx=0x7fda6400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.166+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda64004e90 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.166+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda6400f040 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.166+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda6400c980 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.166+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7010cdd0 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.166+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7010d310 con 0x7fda700fb5e0 2024-02-20T08:05:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.167+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda70105880 con 0x7fda700fb5e0 2024-02-20T08:05:39.169 INFO:tasks.workunit.client.0.smithi123.stdout:2/733: dread d1a/d29/d42/d4e/f8c [0,4194304] 0 2024-02-20T08:05:39.169 INFO:tasks.workunit.client.0.smithi123.stdout:2/734: stat d1a/d29/c3d 0 2024-02-20T08:05:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.168+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fda6400cae0 con 0x7fda700fb5e0 2024-02-20T08:05:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.168+0000 7fda6d7fa700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 0x7fda6006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.169+0000 7fda6ffff700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 0x7fda6006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.169+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fda6405b5e0 con 0x7fda700fb5e0 2024-02-20T08:05:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.169+0000 7fda6ffff700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 0x7fda6006d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda5c008b90 tx=0x7fda5c00af40 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:39.172 INFO:tasks.workunit.client.0.smithi123.stdout:6/988: creat d0/d3e/d40/d48/d79/f13e x:0 0 0 2024-02-20T08:05:39.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.174+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fda64053f70 con 0x7fda700fb5e0 2024-02-20T08:05:39.186 INFO:tasks.workunit.client.0.smithi123.stdout:0/812: creat d2/dd/d4f/d61/d81/f116 x:0 0 0 2024-02-20T08:05:39.190 INFO:tasks.workunit.client.0.smithi123.stdout:1/609: getdents d3/db 0 2024-02-20T08:05:39.193 INFO:tasks.workunit.client.0.smithi123.stdout:5/649: unlink d0/c54 0 2024-02-20T08:05:39.194 INFO:tasks.workunit.client.0.smithi123.stdout:3/689: truncate d0/d6/d1a/f6c 245649 0 2024-02-20T08:05:39.196 INFO:tasks.workunit.client.0.smithi123.stdout:0/813: creat d2/dd/d4f/d7c/da4/d28/f117 x:0 0 0 2024-02-20T08:05:39.197 INFO:tasks.workunit.client.0.smithi123.stdout:0/814: dread - d2/dd/d4f/d61/f10d zero size 2024-02-20T08:05:39.197 INFO:tasks.workunit.client.0.smithi123.stdout:6/989: write d0/d3e/d40/d48/daa/ddf/fd6 [5018400,40038] 0 2024-02-20T08:05:39.199 INFO:tasks.workunit.client.0.smithi123.stdout:9/660: creat d6/d19/d1a/d2b/d28/d9a/d3d/fd5 x:0 0 0 2024-02-20T08:05:39.201 INFO:tasks.workunit.client.0.smithi123.stdout:9/661: chown d6/d19/d1a/d7c/d81/f97 15 1 2024-02-20T08:05:39.201 INFO:tasks.workunit.client.0.smithi123.stdout:9/662: chown d6/d19/d1a/d7c 3 1 2024-02-20T08:05:39.202 INFO:tasks.workunit.client.0.smithi123.stdout:9/663: dread - d6/fbb zero size 2024-02-20T08:05:39.202 INFO:tasks.workunit.client.0.smithi123.stdout:3/690: creat d0/d6/d1a/d1b/db4/ff0 x:0 0 0 2024-02-20T08:05:39.203 INFO:tasks.workunit.client.0.smithi123.stdout:0/815: unlink d2/d3/d37/d5f/d8a/fa0 0 2024-02-20T08:05:39.205 INFO:tasks.workunit.client.0.smithi123.stdout:1/610: link d3/de/d14/d36/f3d d3/de/d14/d26/fd6 0 2024-02-20T08:05:39.206 INFO:tasks.workunit.client.0.smithi123.stdout:2/735: link d1a/c87 d1a/d29/d42/d73/d8f/cf7 0 2024-02-20T08:05:39.207 INFO:tasks.workunit.client.0.smithi123.stdout:6/990: dread d0/d3e/d92/d56/d89/d73/d75/f7e [0,4194304] 0 2024-02-20T08:05:39.207 INFO:tasks.workunit.client.0.smithi123.stdout:5/650: symlink d0/d34/d48/d56/dbb/d27/d4e/d91/ld9 0 2024-02-20T08:05:39.208 INFO:tasks.workunit.client.0.smithi123.stdout:9/664: chown d6/d19/d1a/d7c/lb2 1 1 2024-02-20T08:05:39.211 INFO:tasks.workunit.client.0.smithi123.stdout:3/691: unlink d0/d6/d1a/f39 0 2024-02-20T08:05:39.214 INFO:tasks.workunit.client.0.smithi123.stdout:0/816: rename d2/de/d1e/d1f/dcb/fcd to d2/dd/d4f/d7c/da4/d28/f118 0 2024-02-20T08:05:39.214 INFO:tasks.workunit.client.0.smithi123.stdout:6/991: dwrite d0/d3e/d92/d56/ffa [0,4194304] 0 2024-02-20T08:05:39.217 INFO:tasks.workunit.client.0.smithi123.stdout:8/635: sync 2024-02-20T08:05:39.217 INFO:tasks.workunit.client.0.smithi123.stdout:4/712: sync 2024-02-20T08:05:39.217 INFO:tasks.workunit.client.0.smithi123.stdout:4/713: write d3/d2c/d5a/f92 [2675861,2343] 0 2024-02-20T08:05:39.221 INFO:tasks.workunit.client.0.smithi123.stdout:5/651: chown d0/d34/d67/laf 31886 1 2024-02-20T08:05:39.223 INFO:tasks.workunit.client.0.smithi123.stdout:5/652: fdatasync d0/d34/d67/fbd 0 2024-02-20T08:05:39.225 INFO:tasks.workunit.client.0.smithi123.stdout:5/653: chown d0/fc 8430 1 2024-02-20T08:05:39.225 INFO:tasks.workunit.client.0.smithi123.stdout:8/636: dwrite d6/f3b [4194304,4194304] 0 2024-02-20T08:05:39.241 INFO:tasks.workunit.client.0.smithi123.stdout:3/692: mkdir d0/d6/d1a/def/df1 0 2024-02-20T08:05:39.244 INFO:tasks.workunit.client.0.smithi123.stdout:5/654: mkdir d0/d34/d67/dda 0 2024-02-20T08:05:39.247 INFO:tasks.workunit.client.0.smithi123.stdout:5/655: dread d0/d34/f66 [0,4194304] 0 2024-02-20T08:05:39.250 INFO:tasks.workunit.client.0.smithi123.stdout:2/736: rename d1a/f26 to d1a/d29/d42/d52/dcc/ff8 0 2024-02-20T08:05:39.251 INFO:tasks.workunit.client.0.smithi123.stdout:2/737: write d1a/d29/d42/fbd [416075,39410] 0 2024-02-20T08:05:39.258 INFO:tasks.workunit.client.0.smithi123.stdout:6/992: unlink d0/f28 0 2024-02-20T08:05:39.260 INFO:tasks.workunit.client.0.smithi123.stdout:6/993: read d0/d3e/d40/d48/d4a/fbe [2065319,38991] 0 2024-02-20T08:05:39.260 INFO:tasks.workunit.client.0.smithi123.stdout:5/656: dread d0/d34/d48/f61 [0,4194304] 0 2024-02-20T08:05:39.266 INFO:tasks.workunit.client.0.smithi123.stdout:7/558: sync 2024-02-20T08:05:39.268 INFO:tasks.workunit.client.0.smithi123.stdout:8/637: creat d6/d32/d95/db0/fd8 x:0 0 0 2024-02-20T08:05:39.270 INFO:tasks.workunit.client.0.smithi123.stdout:8/638: write d6/d1c/d22/d8c/dcd/f6a [2757239,111453] 0 2024-02-20T08:05:39.271 INFO:tasks.workunit.client.0.smithi123.stdout:9/665: dwrite d6/d2a/d9d/f73 [0,4194304] 0 2024-02-20T08:05:39.274 INFO:tasks.workunit.client.0.smithi123.stdout:0/817: rename d2/d3/l34 to d2/d3/d37/d9d/l119 0 2024-02-20T08:05:39.277 INFO:tasks.workunit.client.0.smithi123.stdout:0/818: dread - d2/de/dd9/ff1 zero size 2024-02-20T08:05:39.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/714: dwrite d3/d2c/d43/d26/d3e/f6d [0,4194304] 0 2024-02-20T08:05:39.309 INFO:tasks.workunit.client.0.smithi123.stdout:3/693: rename d0/d6/d1a/d1b/d1c/d21/d64/fc7 to d0/dd/ff2 0 2024-02-20T08:05:39.311 INFO:tasks.workunit.client.0.smithi123.stdout:0/819: symlink d2/dd/d4f/d7c/da4/d28/daf/l11a 0 2024-02-20T08:05:39.312 INFO:tasks.workunit.client.0.smithi123.stdout:2/738: mknod d1a/da5/cf9 0 2024-02-20T08:05:39.317 INFO:tasks.workunit.client.0.smithi123.stdout:6/994: unlink d0/d38/f3a 0 2024-02-20T08:05:39.317 INFO:tasks.workunit.client.0.smithi123.stdout:0/820: dread d2/de/d1e/f46 [0,4194304] 0 2024-02-20T08:05:39.321 INFO:tasks.workunit.client.0.smithi123.stdout:2/739: dwrite d1a/d29/d39/f59 [0,4194304] 0 2024-02-20T08:05:39.322 INFO:tasks.workunit.client.0.smithi123.stdout:5/657: fdatasync d0/d34/d48/d56/d25/f2d 0 2024-02-20T08:05:39.324 INFO:tasks.workunit.client.0.smithi123.stdout:4/715: mkdir d3/d97/df0 0 2024-02-20T08:05:39.327 INFO:tasks.workunit.client.0.smithi123.stdout:8/639: mknod d6/d32/dd5/cd9 0 2024-02-20T08:05:39.332 INFO:tasks.workunit.client.0.smithi123.stdout:3/694: dread d0/d6/d1a/d1b/d1c/f25 [0,4194304] 0 2024-02-20T08:05:39.333 INFO:tasks.workunit.client.0.smithi123.stdout:4/716: dwrite d3/d2c/d43/d26/f8e [0,4194304] 0 2024-02-20T08:05:39.335 INFO:tasks.workunit.client.0.smithi123.stdout:9/666: dwrite d6/f30 [0,4194304] 0 2024-02-20T08:05:39.337 INFO:tasks.workunit.client.0.smithi123.stdout:7/559: rename d0/d6/dd/d52/d35/d9c/d70/fa6 to d0/db/d38/d47/fc7 0 2024-02-20T08:05:39.339 INFO:tasks.workunit.client.0.smithi123.stdout:4/717: fdatasync d3/d2c/d43/d26/d2e/fee 0 2024-02-20T08:05:39.340 INFO:tasks.workunit.client.0.smithi123.stdout:7/560: chown d0/d6/dd/d52/d35/d9c/d70/fc2 689780 1 2024-02-20T08:05:39.350 INFO:tasks.workunit.client.0.smithi123.stdout:2/740: mkdir d1a/d29/d42/d52/d98/dd6/dfa 0 2024-02-20T08:05:39.352 INFO:tasks.workunit.client.0.smithi123.stdout:5/658: dread d0/d34/d48/d56/fb1 [0,4194304] 0 2024-02-20T08:05:39.355 INFO:tasks.workunit.client.0.smithi123.stdout:5/659: dread - d0/d34/d48/d56/d25/fba zero size 2024-02-20T08:05:39.355 INFO:tasks.workunit.client.0.smithi123.stdout:1/611: link d3/de/d14/d2c/d45/ld2 d3/de/d14/d26/d2e/d54/d5d/ld7 0 2024-02-20T08:05:39.356 INFO:tasks.workunit.client.0.smithi123.stdout:2/741: dread d1a/d29/d39/f59 [0,4194304] 0 2024-02-20T08:05:39.362 INFO:tasks.workunit.client.0.smithi123.stdout:5/660: dwrite d0/d34/d48/d56/d25/f3b [0,4194304] 0 2024-02-20T08:05:39.369 INFO:tasks.workunit.client.0.smithi123.stdout:3/695: dread d0/d6/d1a/d4b/f97 [0,4194304] 0 2024-02-20T08:05:39.369 INFO:tasks.workunit.client.0.smithi123.stdout:9/667: symlink d6/d19/d1a/d6d/ld6 0 2024-02-20T08:05:39.370 INFO:tasks.workunit.client.0.smithi123.stdout:9/668: truncate d6/fbb 716357 0 2024-02-20T08:05:39.381 INFO:tasks.workunit.client.0.smithi123.stdout:6/995: mknod d0/d3e/d92/d56/d57/d13d/c13f 0 2024-02-20T08:05:39.383 INFO:tasks.workunit.client.0.smithi123.stdout:0/821: creat d2/dd/d4f/da7/d107/f11b x:0 0 0 2024-02-20T08:05:39.394 INFO:tasks.workunit.client.0.smithi123.stdout:2/742: mkdir d1a/d29/d42/d73/dfb 0 2024-02-20T08:05:39.395 INFO:tasks.workunit.client.0.smithi123.stdout:7/561: write d0/d6/d7/f20 [2380784,48541] 0 2024-02-20T08:05:39.399 INFO:tasks.workunit.client.0.smithi123.stdout:4/718: dwrite d3/d2c/d43/d26/d3e/da9/fc8 [0,4194304] 0 2024-02-20T08:05:39.405 INFO:tasks.workunit.client.0.smithi123.stdout:8/640: rename d6/d32/d95/f3a to d6/d1c/d22/d8c/da2/fda 0 2024-02-20T08:05:39.411 INFO:tasks.workunit.client.0.smithi123.stdout:9/669: rmdir d6/d19/d1a/d2b/d65/d77/da2 39 2024-02-20T08:05:39.420 INFO:tasks.workunit.client.0.smithi123.stdout:0/822: creat d2/dd/d4f/d61/d68/f11c x:0 0 0 2024-02-20T08:05:39.420 INFO:tasks.workunit.client.0.smithi123.stdout:0/823: chown d2/dd/d4f/d7c/da4/d28 26846 1 2024-02-20T08:05:39.427 INFO:tasks.workunit.client.0.smithi123.stdout:3/696: write d0/dd/d48/fb0 [564176,5414] 0 2024-02-20T08:05:39.428 INFO:tasks.workunit.client.0.smithi123.stdout:3/697: fsync d0/d6/d1a/d1b/d1c/d61/f5f 0 2024-02-20T08:05:39.457 INFO:tasks.workunit.client.0.smithi123.stdout:2/743: write d1a/d29/fcb [265863,70864] 0 2024-02-20T08:05:39.464 INFO:tasks.workunit.client.0.smithi123.stdout:8/641: stat d6/d32/d95/l41 0 2024-02-20T08:05:39.467 INFO:tasks.workunit.client.0.smithi123.stdout:4/719: dwrite d3/d2c/d43/d26/d3e/da9/fb5 [0,4194304] 0 2024-02-20T08:05:39.471 INFO:tasks.workunit.client.0.smithi123.stdout:6/996: mkdir d0/d3e/d40/d48/d79/d100/d140 0 2024-02-20T08:05:39.472 INFO:tasks.workunit.client.0.smithi123.stdout:6/997: chown d0/d3e/d40/d48/daa/ddf/f12b 398778 1 2024-02-20T08:05:39.474 INFO:tasks.workunit.client.0.smithi123.stdout:6/998: write d0/d3e/d92/db3/fce [1783885,43689] 0 2024-02-20T08:05:39.474 INFO:tasks.workunit.client.0.smithi123.stdout:0/824: creat d2/dd/d4f/d7c/da4/d28/f11d x:0 0 0 2024-02-20T08:05:39.475 INFO:tasks.workunit.client.0.smithi123.stdout:6/999: chown d0/d3e/d92/d56/d89/d73/d75 51 1 2024-02-20T08:05:39.480 INFO:tasks.workunit.client.0.smithi123.stdout:0/825: dwrite d2/dd/d4f/d6a/fb4 [0,4194304] 0 2024-02-20T08:05:39.484 INFO:tasks.workunit.client.0.smithi123.stdout:7/562: creat d0/db/d38/d47/dbc/fc8 x:0 0 0 2024-02-20T08:05:39.490 INFO:tasks.workunit.client.0.smithi123.stdout:8/642: truncate d6/d1c/d47/f59 927459 0 2024-02-20T08:05:39.496 INFO:tasks.workunit.client.0.smithi123.stdout:3/698: mknod d0/d6/d1a/cf3 0 2024-02-20T08:05:39.496 INFO:tasks.workunit.client.0.smithi123.stdout:3/699: readlink d0/d6/d1a/d1b/leb 0 2024-02-20T08:05:39.498 INFO:tasks.workunit.client.0.smithi123.stdout:2/744: creat d1a/d29/d42/d52/d98/da1/daa/dd0/ffc x:0 0 0 2024-02-20T08:05:39.500 INFO:tasks.workunit.client.0.smithi123.stdout:0/826: mknod d2/de/dd9/c11e 0 2024-02-20T08:05:39.503 INFO:tasks.workunit.client.0.smithi123.stdout:5/661: link d0/d34/d48/d56/dbb/d60/l8c d0/d34/d48/d4b/d51/ldb 0 2024-02-20T08:05:39.505 INFO:tasks.workunit.client.0.smithi123.stdout:8/643: mknod d6/d1c/d22/d8c/dcd/cdb 0 2024-02-20T08:05:39.507 INFO:tasks.workunit.client.0.smithi123.stdout:3/700: mknod d0/d6/d32/cf4 0 2024-02-20T08:05:39.508 INFO:tasks.workunit.client.0.smithi123.stdout:3/701: chown d0/d6/d1a/f12 0 1 2024-02-20T08:05:39.511 INFO:tasks.workunit.client.0.smithi123.stdout:0/827: rename d2/d3/l8d to d2/dd/d4f/d7c/da4/d28/l11f 0 2024-02-20T08:05:39.515 INFO:tasks.workunit.client.0.smithi123.stdout:8/644: truncate d6/d32/d95/f2e 2417246 0 2024-02-20T08:05:39.516 INFO:tasks.workunit.client.0.smithi123.stdout:2/745: getdents d1a/d29/d42/d52/d98/da1/daa/de8 0 2024-02-20T08:05:39.519 INFO:tasks.workunit.client.0.smithi123.stdout:3/702: rename d0/d6/d1a/d1b/d1c/d61/f5f to d0/d6/d1a/d1b/d1c/d21/dd9/ff5 0 2024-02-20T08:05:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.520+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda7010d660 con 0x7fda6006b2e0 2024-02-20T08:05:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.522+0000 7fda6d7fa700 1 -- 172.21.15.123:0/3932118991 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fda7010d660 con 0x7fda6006b2e0 2024-02-20T08:05:39.522 INFO:tasks.workunit.client.0.smithi123.stdout:5/662: creat d0/d34/d48/d56/d4c/d43/fdc x:0 0 0 2024-02-20T08:05:39.523 INFO:tasks.workunit.client.0.smithi123.stdout:5/663: fdatasync d0/d34/d67/fbe 0 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 msgr2=0x7fda6006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 0x7fda6006d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda5c008b90 tx=0x7fda5c00af40 comp rx=0 tx=0).stop 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 msgr2=0x7fda7010b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda7010b770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda700fc650 tx=0x7fda6400b040 comp rx=0 tx=0).stop 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 shutdown_connections 2024-02-20T08:05:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fda6006b2e0 0x7fda6006d790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda700fb5e0 0x7fda7010b770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 --2- 172.21.15.123:0/3932118991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700fc7f0 0x7fda7010bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 >> 172.21.15.123:0/3932118991 conn(0x7fda700f6ca0 msgr2=0x7fda700f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 shutdown_connections 2024-02-20T08:05:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.525+0000 7fda77226700 1 -- 172.21.15.123:0/3932118991 wait complete. 2024-02-20T08:05:39.526 INFO:tasks.workunit.client.0.smithi123.stdout:2/746: unlink d1a/d29/l70 0 2024-02-20T08:05:39.529 INFO:tasks.workunit.client.0.smithi123.stdout:0/828: creat d2/dd/d4f/d7c/da4/db6/dfa/f120 x:0 0 0 2024-02-20T08:05:39.531 INFO:tasks.workunit.client.0.smithi123.stdout:2/747: creat d1a/d29/d5d/ffd x:0 0 0 2024-02-20T08:05:39.533 INFO:tasks.workunit.client.0.smithi123.stdout:5/664: mkdir d0/d34/d48/d56/d4c/d43/dd2/ddd 0 2024-02-20T08:05:39.538 INFO:tasks.workunit.client.0.smithi123.stdout:3/703: rmdir d0/d6/d1a/d1b/d2a/d86/dee 0 2024-02-20T08:05:39.539 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:05:39.540 INFO:tasks.workunit.client.0.smithi123.stdout:1/612: dwrite d3/db/d34/d74/f1e [0,4194304] 0 2024-02-20T08:05:39.542 INFO:tasks.workunit.client.0.smithi123.stdout:2/748: mkdir d1a/d29/d5d/d97/da9/dfe 0 2024-02-20T08:05:39.551 INFO:tasks.workunit.client.0.smithi123.stdout:2/749: unlink d1a/d29/c4d 0 2024-02-20T08:05:39.553 INFO:tasks.workunit.client.0.smithi123.stdout:3/704: unlink d0/f3f 0 2024-02-20T08:05:39.554 INFO:tasks.workunit.client.0.smithi123.stdout:9/670: dwrite d6/d19/d1a/d6d/f6e [0,4194304] 0 2024-02-20T08:05:39.557 INFO:tasks.workunit.client.0.smithi123.stdout:0/829: getdents d2/d3/d37/d9d 0 2024-02-20T08:05:39.562 INFO:tasks.workunit.client.0.smithi123.stdout:2/750: fsync d1a/d29/d42/d52/d98/da1/deb/f9f 0 2024-02-20T08:05:39.566 INFO:tasks.workunit.client.0.smithi123.stdout:0/830: truncate d2/d3/d37/d5f/f92 4536152 0 2024-02-20T08:05:39.567 INFO:tasks.workunit.client.0.smithi123.stdout:0/831: readlink d2/dd/d4f/l65 0 2024-02-20T08:05:39.567 INFO:tasks.workunit.client.0.smithi123.stdout:0/832: dread - d2/dd/fd4 zero size 2024-02-20T08:05:39.568 INFO:tasks.workunit.client.0.smithi123.stdout:9/671: mknod d6/d2a/d9d/d74/cd7 0 2024-02-20T08:05:39.569 INFO:tasks.workunit.client.0.smithi123.stdout:9/672: dread - d6/d19/d1a/d6d/d7e/d80/fd4 zero size 2024-02-20T08:05:39.573 INFO:tasks.workunit.client.0.smithi123.stdout:9/673: dread - d6/d2a/d9d/f96 zero size 2024-02-20T08:05:39.575 INFO:tasks.workunit.client.0.smithi123.stdout:9/674: chown d6/d19/d1a/d2b/ccf 494 1 2024-02-20T08:05:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 -- 172.21.15.123:0/3835844850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c81000c0 msgr2=0x7fa9c8102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/3835844850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c81000c0 0x7fa9c8102520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc004940 tx=0x7fa9bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 -- 172.21.15.123:0/3835844850 shutdown_connections 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/3835844850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c81000c0 0x7fa9c8102520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/3835844850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c8066c70 0x7fa9c80ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 -- 172.21.15.123:0/3835844850 >> 172.21.15.123:0/3835844850 conn(0x7fa9c80f7520 msgr2=0x7fa9c80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.664+0000 7fa9ccd38700 1 -- 172.21.15.123:0/3835844850 shutdown_connections 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 -- 172.21.15.123:0/3835844850 wait complete. 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 Processor -- start 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 -- start start 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c81000c0 0x7fa9c810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c810e410 con 0x7fa9c8066c70 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9ccd38700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c810ecb0 con 0x7fa9c81000c0 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9c659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9c659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53954/0 (socket says 172.21.15.123:53954) 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9c659c700 1 -- 172.21.15.123:0/2903227892 learned_addr learned my addr 172.21.15.123:0/2903227892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.665+0000 7fa9c5d9b700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c81000c0 0x7fa9c810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9c659c700 1 -- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c81000c0 msgr2=0x7fa9c810de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9c659c700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c81000c0 0x7fa9c810de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9c659c700 1 -- 172.21.15.123:0/2903227892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc005040 con 0x7fa9c8066c70 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9c659c700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800eb40 tx=0x7fa9b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b8007cc0 con 0x7fa9c8066c70 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c810ef30 con 0x7fa9c8066c70 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9b800f040 con 0x7fa9c8066c70 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b800ca10 con 0x7fa9c8066c70 2024-02-20T08:05:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.666+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c810f470 con 0x7fa9c8066c70 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.668+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fa9b800cb70 con 0x7fa9c8066c70 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.668+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c804bed0 con 0x7fa9c8066c70 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.668+0000 7fa9b6ffd700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 0x7fa9b006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.668+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa9b8089920 con 0x7fa9c8066c70 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.668+0000 7fa9c5d9b700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 0x7fa9b006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:39.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.669+0000 7fa9c5d9b700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 0x7fa9b006d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc013740 tx=0x7fa9bc009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:39.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:39.673+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa9b804f620 con 0x7fa9c8066c70 2024-02-20T08:05:39.688 INFO:tasks.workunit.client.0.smithi123.stdout:8/645: rmdir d6/d1c/d22/d8c/dcd 39 2024-02-20T08:05:39.688 INFO:tasks.workunit.client.0.smithi123.stdout:7/563: write d0/db/fa1 [1365414,43568] 0 2024-02-20T08:05:39.689 INFO:tasks.workunit.client.0.smithi123.stdout:8/646: fsync d6/fb 0 2024-02-20T08:05:39.690 INFO:tasks.workunit.client.0.smithi123.stdout:5/665: write d0/d34/d48/d56/dbb/d27/d37/fb7 [3213516,77559] 0 2024-02-20T08:05:39.690 INFO:tasks.workunit.client.0.smithi123.stdout:0/833: dwrite d2/de/fe8 [0,4194304] 0 2024-02-20T08:05:39.692 INFO:tasks.workunit.client.0.smithi123.stdout:7/564: stat d0/d6/dd/d52/d26/d9b/cbd 0 2024-02-20T08:05:39.692 INFO:tasks.workunit.client.0.smithi123.stdout:1/613: write d3/db/d34/d74/d6f/fba [1776276,94803] 0 2024-02-20T08:05:39.719 INFO:tasks.workunit.client.0.smithi123.stdout:7/565: stat d0/db/c75 0 2024-02-20T08:05:39.719 INFO:tasks.workunit.client.0.smithi123.stdout:9/675: write d6/d2a/d27/f2f [1161460,1063] 0 2024-02-20T08:05:39.722 INFO:tasks.workunit.client.0.smithi123.stdout:0/834: creat d2/d3/d37/d5f/f121 x:0 0 0 2024-02-20T08:05:39.723 INFO:tasks.workunit.client.0.smithi123.stdout:0/835: dread d2/d3/f9b [0,4194304] 0 2024-02-20T08:05:39.738 INFO:tasks.workunit.client.0.smithi123.stdout:3/705: getdents d0/dd/d48/d6a/d74 0 2024-02-20T08:05:39.742 INFO:tasks.workunit.client.0.smithi123.stdout:7/566: rmdir d0/d23/dc5 39 2024-02-20T08:05:39.745 INFO:tasks.workunit.client.0.smithi123.stdout:5/666: rename d0/d34/d48/d56/fb3 to d0/d34/d48/d4b/fde 0 2024-02-20T08:05:39.746 INFO:tasks.workunit.client.0.smithi123.stdout:9/676: truncate d6/d19/d1a/d7c/f7d 5356082 0 2024-02-20T08:05:39.746 INFO:tasks.workunit.client.0.smithi123.stdout:1/614: dwrite d3/de/d14/d26/fa4 [0,4194304] 0 2024-02-20T08:05:39.751 INFO:tasks.workunit.client.0.smithi123.stdout:8/647: write d6/f20 [2902729,43609] 0 2024-02-20T08:05:39.752 INFO:tasks.workunit.client.0.smithi123.stdout:7/567: mknod d0/db/d38/d47/d4a/d59/d5c/d79/cc9 0 2024-02-20T08:05:39.752 INFO:tasks.workunit.client.0.smithi123.stdout:8/648: dread - d6/d32/d95/fbb zero size 2024-02-20T08:05:39.753 INFO:tasks.workunit.client.0.smithi123.stdout:5/667: chown d0/d34/d48/d56/dbb/d27/l4a 25 1 2024-02-20T08:05:39.754 INFO:tasks.workunit.client.0.smithi123.stdout:1/615: fdatasync d3/db/d34/d74/f18 0 2024-02-20T08:05:39.757 INFO:tasks.workunit.client.0.smithi123.stdout:9/677: rename d6/d19/d1a/d2b/d28/d9a/c56 to d6/d2a/d27/d6f/cd8 0 2024-02-20T08:05:39.758 INFO:tasks.workunit.client.0.smithi123.stdout:8/649: symlink d6/d32/d95/d7d/ldc 0 2024-02-20T08:05:39.759 INFO:tasks.workunit.client.0.smithi123.stdout:8/650: chown d6/f74 418219699 1 2024-02-20T08:05:39.762 INFO:tasks.workunit.client.0.smithi123.stdout:0/836: creat d2/f122 x:0 0 0 2024-02-20T08:05:39.763 INFO:tasks.workunit.client.0.smithi123.stdout:3/706: link d0/d6/d1a/d1b/d9d/fe0 d0/d6/d1a/d1b/db4/ff6 0 2024-02-20T08:05:39.772 INFO:tasks.workunit.client.0.smithi123.stdout:8/651: dwrite d6/dbd/d5b/d8f/d98/f9b [0,4194304] 0 2024-02-20T08:05:39.779 INFO:tasks.workunit.client.0.smithi123.stdout:0/837: rename d2/f1c to d2/de/dc6/d105/f123 0 2024-02-20T08:05:39.781 INFO:tasks.workunit.client.0.smithi123.stdout:3/707: symlink d0/lf7 0 2024-02-20T08:05:39.784 INFO:tasks.workunit.client.0.smithi123.stdout:0/838: mknod d2/de/d1e/d1f/d74/c124 0 2024-02-20T08:05:39.784 INFO:tasks.workunit.client.0.smithi123.stdout:7/568: write d0/d6/dd/d52/d26/fa4 [2737376,40333] 0 2024-02-20T08:05:39.789 INFO:tasks.workunit.client.0.smithi123.stdout:0/839: mknod d2/de/dc6/d105/c125 0 2024-02-20T08:05:39.796 INFO:tasks.workunit.client.0.smithi123.stdout:0/840: rename d2/dd/d4f/d7c/da4/d28/f118 to d2/dd/d4f/d7c/d82/de4/f126 0 2024-02-20T08:05:39.797 INFO:tasks.workunit.client.0.smithi123.stdout:9/678: dwrite d6/d19/f44 [0,4194304] 0 2024-02-20T08:05:39.800 INFO:tasks.workunit.client.0.smithi123.stdout:5/668: dwrite d0/d34/d48/d56/f5e [0,4194304] 0 2024-02-20T08:05:39.800 INFO:tasks.workunit.client.0.smithi123.stdout:9/679: write d6/f3f [1642540,102073] 0 2024-02-20T08:05:39.802 INFO:tasks.workunit.client.0.smithi123.stdout:9/680: write d6/d19/d1a/d6d/d7e/d80/fd4 [883596,5106] 0 2024-02-20T08:05:39.804 INFO:tasks.workunit.client.0.smithi123.stdout:7/569: link d0/db/d38/f6a d0/db/d38/d47/d4a/d59/fca 0 2024-02-20T08:05:39.804 INFO:tasks.workunit.client.0.smithi123.stdout:3/708: getdents d0/d6/d1a/d1b/d57/dd0/daa/dde 0 2024-02-20T08:05:39.812 INFO:tasks.workunit.client.0.smithi123.stdout:5/669: truncate d0/d34/d48/d56/d3e/fc6 1047694 0 2024-02-20T08:05:39.817 INFO:tasks.workunit.client.0.smithi123.stdout:3/709: fdatasync d0/d6/d34/fad 0 2024-02-20T08:05:39.818 INFO:tasks.workunit.client.0.smithi123.stdout:0/841: symlink d2/de/d111/l127 0 2024-02-20T08:05:39.822 INFO:tasks.workunit.client.0.smithi123.stdout:7/570: readlink d0/d23/dc5/d4b/l60 0 2024-02-20T08:05:39.823 INFO:tasks.workunit.client.0.smithi123.stdout:7/571: readlink d0/d6/dd/d97/lb3 0 2024-02-20T08:05:39.825 INFO:tasks.workunit.client.0.smithi123.stdout:0/842: creat d2/d3/d37/d5f/d8a/dee/f128 x:0 0 0 2024-02-20T08:05:39.826 INFO:tasks.workunit.client.0.smithi123.stdout:0/843: chown d2/de/d1e/d1f/d5e/cfd 1 1 2024-02-20T08:05:39.828 INFO:tasks.workunit.client.0.smithi123.stdout:7/572: unlink d0/d6/dd/d52/d26/fa4 0 2024-02-20T08:05:39.830 INFO:tasks.workunit.client.0.smithi123.stdout:0/844: creat d2/d3/d37/f129 x:0 0 0 2024-02-20T08:05:39.832 INFO:tasks.workunit.client.0.smithi123.stdout:0/845: creat d2/dd/f12a x:0 0 0 2024-02-20T08:05:39.833 INFO:tasks.workunit.client.0.smithi123.stdout:9/681: write d6/d19/d1a/d7c/f86 [102151,108739] 0 2024-02-20T08:05:39.833 INFO:tasks.workunit.client.0.smithi123.stdout:7/573: mkdir d0/d6/dd/d52/dcb 0 2024-02-20T08:05:39.838 INFO:tasks.workunit.client.0.smithi123.stdout:3/710: write d0/d6/d1a/d1b/f54 [329986,72266] 0 2024-02-20T08:05:39.839 INFO:tasks.workunit.client.0.smithi123.stdout:0/846: symlink d2/dd/d4f/d61/d81/df5/l12b 0 2024-02-20T08:05:39.841 INFO:tasks.workunit.client.0.smithi123.stdout:0/847: chown d2/de/d1e/d1f 51672165 1 2024-02-20T08:05:39.843 INFO:tasks.workunit.client.0.smithi123.stdout:3/711: creat d0/d6/d1a/d1b/d57/dd0/ff8 x:0 0 0 2024-02-20T08:05:39.846 INFO:tasks.workunit.client.0.smithi123.stdout:5/670: dwrite d0/d34/d48/d56/dbb/d27/d37/f92 [0,4194304] 0 2024-02-20T08:05:39.850 INFO:tasks.workunit.client.0.smithi123.stdout:5/671: fdatasync d0/d34/f66 0 2024-02-20T08:05:39.853 INFO:tasks.workunit.client.0.smithi123.stdout:7/574: dread d0/f64 [0,4194304] 0 2024-02-20T08:05:39.853 INFO:tasks.workunit.client.0.smithi123.stdout:3/712: mknod d0/d6/d1a/d1b/cf9 0 2024-02-20T08:05:39.857 INFO:tasks.workunit.client.0.smithi123.stdout:9/682: truncate d6/d19/d1a/d2b/d28/d9a/d3d/f62 3886192 0 2024-02-20T08:05:39.858 INFO:tasks.workunit.client.0.smithi123.stdout:9/683: chown d6/d19/d1a/dc6 108369132 1 2024-02-20T08:05:39.859 INFO:tasks.workunit.client.0.smithi123.stdout:7/575: creat d0/d6/d29/fcc x:0 0 0 2024-02-20T08:05:39.861 INFO:tasks.workunit.client.0.smithi123.stdout:3/713: rename d0/d6/d1a/d1b/d1c/f3c to d0/d6/d1a/d1b/d1c/d20/ffa 0 2024-02-20T08:05:39.863 INFO:tasks.workunit.client.0.smithi123.stdout:3/714: chown d0/d6/d1a/d1b/d9d/l94 191 1 2024-02-20T08:05:39.869 INFO:tasks.workunit.client.0.smithi123.stdout:0/848: dread d2/f42 [0,4194304] 0 2024-02-20T08:05:39.869 INFO:tasks.workunit.client.0.smithi123.stdout:5/672: truncate d0/fad 972150 0 2024-02-20T08:05:39.873 INFO:tasks.workunit.client.0.smithi123.stdout:0/849: creat d2/d3/d37/d5f/d8a/f12c x:0 0 0 2024-02-20T08:05:39.874 INFO:tasks.workunit.client.0.smithi123.stdout:0/850: write d2/de/dd9/ff1 [477912,18324] 0 2024-02-20T08:05:39.875 INFO:tasks.workunit.client.0.smithi123.stdout:9/684: write d6/d19/d1a/f6a [4266104,36297] 0 2024-02-20T08:05:39.884 INFO:tasks.workunit.client.0.smithi123.stdout:7/576: dwrite d0/d6/dd/d52/f3b [0,4194304] 0 2024-02-20T08:05:39.885 INFO:tasks.workunit.client.0.smithi123.stdout:3/715: dwrite d0/d6/d1a/d1b/d1c/d21/d8e/f9a [0,4194304] 0 2024-02-20T08:05:39.887 INFO:tasks.workunit.client.0.smithi123.stdout:5/673: write d0/d34/d48/d56/d4c/d43/f90 [1111981,58783] 0 2024-02-20T08:05:39.889 INFO:tasks.workunit.client.0.smithi123.stdout:9/685: link d6/d19/d1a/d2b/c76 d6/d2a/d27/d6f/d8b/cd9 0 2024-02-20T08:05:39.891 INFO:tasks.workunit.client.0.smithi123.stdout:7/577: read d0/d6/d29/f6e [387498,24876] 0 2024-02-20T08:05:39.894 INFO:tasks.workunit.client.0.smithi123.stdout:7/578: write d0/d6/d7/f20 [2485474,12791] 0 2024-02-20T08:05:39.897 INFO:tasks.workunit.client.0.smithi123.stdout:5/674: write d0/d34/d48/d56/dbb/d27/d37/f8b [125456,67716] 0 2024-02-20T08:05:39.899 INFO:tasks.workunit.client.0.smithi123.stdout:9/686: creat d6/d19/d1a/dc6/fda x:0 0 0 2024-02-20T08:05:39.915 INFO:tasks.workunit.client.0.smithi123.stdout:3/716: truncate d0/f53 3623655 0 2024-02-20T08:05:39.917 INFO:tasks.workunit.client.0.smithi123.stdout:5/675: truncate d0/d34/d48/d56/d25/f2a 377282 0 2024-02-20T08:05:39.921 INFO:tasks.workunit.client.0.smithi123.stdout:3/717: stat d0/d6/d1a/d1b/d1c/d20/fb6 0 2024-02-20T08:05:39.922 INFO:tasks.workunit.client.0.smithi123.stdout:7/579: dwrite d0/d6/dd/d52/d26/d9b/d61/f82 [0,4194304] 0 2024-02-20T08:05:39.923 INFO:tasks.workunit.client.0.smithi123.stdout:9/687: dwrite d6/d2a/d27/fab [0,4194304] 0 2024-02-20T08:05:39.928 INFO:tasks.workunit.client.0.smithi123.stdout:9/688: chown d6/c3a 195597 1 2024-02-20T08:05:39.931 INFO:tasks.workunit.client.0.smithi123.stdout:3/718: symlink d0/d6/lfb 0 2024-02-20T08:05:39.938 INFO:tasks.workunit.client.0.smithi123.stdout:3/719: read d0/d6/d1a/d1b/f22 [5981090,111925] 0 2024-02-20T08:05:39.939 INFO:tasks.workunit.client.0.smithi123.stdout:7/580: link d0/db/d38/d47/d4a/faf d0/d6/dd/d52/d26/d9b/fcd 0 2024-02-20T08:05:39.940 INFO:tasks.workunit.client.0.smithi123.stdout:7/581: stat d0/d6/dd/d52/d35/d9c/c5a 0 2024-02-20T08:05:39.946 INFO:tasks.workunit.client.0.smithi123.stdout:9/689: link d6/d2a/d27/d6f/cd8 d6/d2a/d9d/d74/cdb 0 2024-02-20T08:05:39.951 INFO:tasks.workunit.client.0.smithi123.stdout:7/582: creat d0/d6/dd/d52/d26/fce x:0 0 0 2024-02-20T08:05:39.952 INFO:tasks.workunit.client.0.smithi123.stdout:9/690: dwrite d6/d19/f34 [4194304,4194304] 0 2024-02-20T08:05:39.961 INFO:tasks.workunit.client.0.smithi123.stdout:9/691: fsync d6/d19/d1a/d6d/d7e/fac 0 2024-02-20T08:05:39.961 INFO:tasks.workunit.client.0.smithi123.stdout:3/720: truncate d0/d6/d1a/d1b/d9d/f6d 964615 0 2024-02-20T08:05:39.963 INFO:tasks.workunit.client.0.smithi123.stdout:7/583: symlink d0/d6/dd/d52/d26/d9b/d9a/lcf 0 2024-02-20T08:05:39.964 INFO:tasks.workunit.client.0.smithi123.stdout:3/721: symlink d0/d6/d1a/d62/d82/lfc 0 2024-02-20T08:05:39.967 INFO:tasks.workunit.client.0.smithi123.stdout:7/584: creat d0/db/d38/d47/d4a/d59/d5c/fd0 x:0 0 0 2024-02-20T08:05:39.967 INFO:tasks.workunit.client.0.smithi123.stdout:3/722: truncate d0/d6/d1a/d4b/fe4 638912 0 2024-02-20T08:05:39.968 INFO:tasks.workunit.client.0.smithi123.stdout:3/723: dread - d0/d6/d1a/d1b/d57/dd0/ff8 zero size 2024-02-20T08:05:39.974 INFO:tasks.workunit.client.0.smithi123.stdout:7/585: dread d0/d6/dd/d52/d35/d9c/f36 [0,4194304] 0 2024-02-20T08:05:39.976 INFO:tasks.workunit.client.0.smithi123.stdout:5/676: dread d0/d34/d67/d80/fab [0,4194304] 0 2024-02-20T08:05:39.977 INFO:tasks.workunit.client.0.smithi123.stdout:5/677: fsync d0/d34/d48/d56/dbb/d27/d37/fca 0 2024-02-20T08:05:39.985 INFO:tasks.workunit.client.0.smithi123.stdout:9/692: dread d6/fb [4194304,4194304] 0 2024-02-20T08:05:39.991 INFO:tasks.workunit.client.0.smithi123.stdout:9/693: dwrite f5 [8388608,4194304] 0 2024-02-20T08:05:40.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.007+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9c8100d60 con 0x7fa9b006b2e0 2024-02-20T08:05:40.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.008+0000 7fa9b6ffd700 1 -- 172.21.15.123:0/2903227892 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa9c8100d60 con 0x7fa9b006b2e0 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 msgr2=0x7fa9b006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 0x7fa9b006d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc013740 tx=0x7fa9bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 msgr2=0x7fa9c810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800eb40 tx=0x7fa9b800b040 comp rx=0 tx=0).stop 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 shutdown_connections 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fa9b006b2e0 0x7fa9b006d790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9c8066c70 0x7fa9c810d8d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 --2- 172.21.15.123:0/2903227892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c81000c0 0x7fa9c810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 >> 172.21.15.123:0/2903227892 conn(0x7fa9c80f7520 msgr2=0x7fa9c80f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 shutdown_connections 2024-02-20T08:05:40.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.010+0000 7fa9ccd38700 1 -- 172.21.15.123:0/2903227892 wait complete. 2024-02-20T08:05:40.086 INFO:tasks.workunit.client.0.smithi123.stdout:3/724: rmdir d0/d6/d1a/d1b/d1c/d61/dd1 39 2024-02-20T08:05:40.087 INFO:tasks.workunit.client.0.smithi123.stdout:3/725: chown d0/d6/d1a/d1e/c6e 96 1 2024-02-20T08:05:40.095 INFO:tasks.workunit.client.0.smithi123.stdout:7/586: symlink d0/db/d38/ld1 0 2024-02-20T08:05:40.096 INFO:tasks.workunit.client.0.smithi123.stdout:7/587: fsync d0/d6/dd/d52/d26/d9b/fba 0 2024-02-20T08:05:40.097 INFO:tasks.workunit.client.0.smithi123.stdout:7/588: chown d0/f30 530 1 2024-02-20T08:05:40.100 INFO:tasks.workunit.client.0.smithi123.stdout:7/589: creat d0/d6/dd/d52/d35/fd2 x:0 0 0 2024-02-20T08:05:40.101 INFO:tasks.workunit.client.0.smithi123.stdout:7/590: readlink d0/d6/dd/d97/lb3 0 2024-02-20T08:05:40.105 INFO:tasks.workunit.client.0.smithi123.stdout:3/726: write d0/d6/d1a/d1b/d57/dd0/f56 [122526,28521] 0 2024-02-20T08:05:40.106 INFO:tasks.workunit.client.0.smithi123.stdout:5/678: dwrite d0/d34/d48/d56/dbb/d27/d4e/f52 [0,4194304] 0 2024-02-20T08:05:40.107 INFO:tasks.workunit.client.0.smithi123.stdout:7/591: dread d0/d6/d29/fb2 [0,4194304] 0 2024-02-20T08:05:40.111 INFO:tasks.workunit.client.0.smithi123.stdout:9/694: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:40.112 INFO:tasks.workunit.client.0.smithi123.stdout:5/679: mkdir d0/d34/d48/d56/d3e/ddf 0 2024-02-20T08:05:40.116 INFO:tasks.workunit.client.0.smithi123.stdout:5/680: readlink d0/d34/d48/d56/d3e/l68 0 2024-02-20T08:05:40.116 INFO:tasks.workunit.client.0.smithi123.stdout:7/592: dread d0/d6/dd/d52/d35/d9c/f36 [0,4194304] 0 2024-02-20T08:05:40.121 INFO:tasks.workunit.client.0.smithi123.stdout:7/593: creat d0/db/d38/d47/dbc/fd3 x:0 0 0 2024-02-20T08:05:40.125 INFO:tasks.workunit.client.0.smithi123.stdout:3/727: getdents d0/d6/d1a/d1b/db4 0 2024-02-20T08:05:40.128 INFO:tasks.workunit.client.0.smithi123.stdout:9/695: creat d6/d19/d1a/fdc x:0 0 0 2024-02-20T08:05:40.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 -- 172.21.15.123:0/2444258384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 msgr2=0x7f03180fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2444258384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f03180fc250 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0308004940 tx=0x7f0308009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 -- 172.21.15.123:0/2444258384 shutdown_connections 2024-02-20T08:05:40.129 INFO:tasks.workunit.client.0.smithi123.stdout:9/696: chown d6/f3f 0 1 2024-02-20T08:05:40.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2444258384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 0x7f03180fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2444258384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f03180fc250 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 -- 172.21.15.123:0/2444258384 >> 172.21.15.123:0/2444258384 conn(0x7f03180f7520 msgr2=0x7f03180f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.128+0000 7f031e2ea700 1 -- 172.21.15.123:0/2444258384 shutdown_connections 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.129+0000 7f031e2ea700 1 -- 172.21.15.123:0/2444258384 wait complete. 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.129+0000 7f031e2ea700 1 Processor -- start 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f031e2ea700 1 -- start start 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f031e2ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f031e2ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 0x7f031810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f031e2ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031810e3f0 con 0x7f03180fbe40 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f031e2ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031810ec90 con 0x7f03180fcfb0 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53960/0 (socket says 172.21.15.123:53960) 2024-02-20T08:05:40.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 -- 172.21.15.123:0/2703726166 learned_addr learned my addr 172.21.15.123:0/2703726166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f03177fe700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 0x7f031810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 -- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 msgr2=0x7f031810ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 0x7f031810ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 -- 172.21.15.123:0/2703726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308005040 con 0x7f03180fbe40 2024-02-20T08:05:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.130+0000 7f0317fff700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0308000c00 tx=0x7f0308009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.131+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0308021070 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.131+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030801c400 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.131+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030800e070 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.131+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031810ef10 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.131+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031810f330 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.132+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031804bed0 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.133+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f030801ca20 con 0x7f03180fbe40 2024-02-20T08:05:40.133 INFO:tasks.workunit.client.0.smithi123.stdout:7/594: mknod d0/d6/dd/d52/d35/d9c/cd4 0 2024-02-20T08:05:40.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.133+0000 7f0314ff9700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 0x7f0300071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.133+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f030808b060 con 0x7f03180fbe40 2024-02-20T08:05:40.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.133+0000 7f03177fe700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 0x7f0300071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.134+0000 7f03177fe700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 0x7f0300071ba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f030c004600 tx=0x7f030c00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:40.138 INFO:tasks.workunit.client.0.smithi123.stdout:7/595: symlink d0/d6/dd/ld5 0 2024-02-20T08:05:40.139 INFO:tasks.workunit.client.0.smithi123.stdout:4/720: sync 2024-02-20T08:05:40.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.138+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0308058be0 con 0x7f03180fbe40 2024-02-20T08:05:40.140 INFO:tasks.workunit.client.0.smithi123.stdout:3/728: mknod d0/db9/cfd 0 2024-02-20T08:05:40.142 INFO:tasks.workunit.client.0.smithi123.stdout:5/681: dwrite d0/d34/d48/d4b/f4f [0,4194304] 0 2024-02-20T08:05:40.143 INFO:tasks.workunit.client.0.smithi123.stdout:7/596: stat d0/d6/d7/c12 0 2024-02-20T08:05:40.144 INFO:tasks.workunit.client.0.smithi123.stdout:4/721: stat d3/d18/d7d/d8b/cd4 0 2024-02-20T08:05:40.147 INFO:tasks.workunit.client.0.smithi123.stdout:3/729: mkdir d0/dd/d48/d6a/d74/dfe 0 2024-02-20T08:05:40.148 INFO:tasks.workunit.client.0.smithi123.stdout:5/682: dread - d0/d34/d67/f7b zero size 2024-02-20T08:05:40.148 INFO:tasks.workunit.client.0.smithi123.stdout:9/697: dwrite d6/d19/d1a/d2b/f37 [4194304,4194304] 0 2024-02-20T08:05:40.149 INFO:tasks.workunit.client.0.smithi123.stdout:9/698: fdatasync d6/f30 0 2024-02-20T08:05:40.150 INFO:tasks.workunit.client.0.smithi123.stdout:9/699: dread - d6/d19/d1a/d2b/d28/d9a/d3d/fd5 zero size 2024-02-20T08:05:40.151 INFO:tasks.workunit.client.0.smithi123.stdout:9/700: chown d6/d2a/d9d/f96 476409 1 2024-02-20T08:05:40.156 INFO:tasks.workunit.client.0.smithi123.stdout:4/722: creat d3/d2c/d43/d26/d3e/da9/dd9/de6/ff1 x:0 0 0 2024-02-20T08:05:40.158 INFO:tasks.workunit.client.0.smithi123.stdout:9/701: mkdir d6/d19/d1a/d2b/d65/d77/da5/ddd 0 2024-02-20T08:05:40.159 INFO:tasks.workunit.client.0.smithi123.stdout:9/702: stat d6/d19/d1a/d2b/d28 0 2024-02-20T08:05:40.166 INFO:tasks.workunit.client.0.smithi123.stdout:9/703: dwrite d6/d19/d1a/d7c/f86 [0,4194304] 0 2024-02-20T08:05:40.167 INFO:tasks.workunit.client.0.smithi123.stdout:9/704: chown d6/d19/d1a/d31/c4d 0 1 2024-02-20T08:05:40.174 INFO:tasks.workunit.client.0.smithi123.stdout:9/705: read d6/d2a/d27/f2f [16622,82810] 0 2024-02-20T08:05:40.176 INFO:tasks.workunit.client.0.smithi123.stdout:5/683: write d0/f6a [1340515,50872] 0 2024-02-20T08:05:40.179 INFO:tasks.workunit.client.0.smithi123.stdout:4/723: write d3/d2c/f40 [3708067,57840] 0 2024-02-20T08:05:40.182 INFO:tasks.workunit.client.0.smithi123.stdout:9/706: write d6/d19/d1a/d2b/d28/d9a/d3d/f57 [1564490,9108] 0 2024-02-20T08:05:40.183 INFO:tasks.workunit.client.0.smithi123.stdout:3/730: dwrite d0/d6/d1a/d4b/fb5 [0,4194304] 0 2024-02-20T08:05:40.184 INFO:tasks.workunit.client.0.smithi123.stdout:7/597: dwrite d0/d6/d29/f6e [0,4194304] 0 2024-02-20T08:05:40.185 INFO:tasks.workunit.client.0.smithi123.stdout:3/731: readlink d0/lf7 0 2024-02-20T08:05:40.186 INFO:tasks.workunit.client.0.smithi123.stdout:4/724: fsync d3/d2c/f53 0 2024-02-20T08:05:40.188 INFO:tasks.workunit.client.0.smithi123.stdout:7/598: chown d0/d6/dd/d52/l81 124102 1 2024-02-20T08:05:40.191 INFO:tasks.workunit.client.0.smithi123.stdout:5/684: creat d0/d34/d48/d56/dbb/d27/d4e/d91/fe0 x:0 0 0 2024-02-20T08:05:40.192 INFO:tasks.workunit.client.0.smithi123.stdout:3/732: rmdir d0/d6/d1a/d4b/d95/d9f 39 2024-02-20T08:05:40.196 INFO:tasks.workunit.client.0.smithi123.stdout:4/725: dread - d3/fb7 zero size 2024-02-20T08:05:40.197 INFO:tasks.workunit.client.0.smithi123.stdout:4/726: write d3/d1e/fd1 [448995,82524] 0 2024-02-20T08:05:40.199 INFO:tasks.workunit.client.0.smithi123.stdout:4/727: truncate d3/d97/fbe 777651 0 2024-02-20T08:05:40.199 INFO:tasks.workunit.client.0.smithi123.stdout:4/728: read - d3/d18/d7d/d8b/f9d zero size 2024-02-20T08:05:40.200 INFO:tasks.workunit.client.0.smithi123.stdout:5/685: chown d0/d34/d67/d80/d84/faa 726189515 1 2024-02-20T08:05:40.201 INFO:tasks.workunit.client.0.smithi123.stdout:5/686: stat d0/d34/d48/d56/dbb/f88 0 2024-02-20T08:05:40.201 INFO:tasks.workunit.client.0.smithi123.stdout:3/733: creat d0/d6/d1a/d4b/fff x:0 0 0 2024-02-20T08:05:40.205 INFO:tasks.workunit.client.0.smithi123.stdout:4/729: truncate d3/fd 1935552 0 2024-02-20T08:05:40.210 INFO:tasks.workunit.client.0.smithi123.stdout:3/734: creat d0/d6/d1a/da1/f100 x:0 0 0 2024-02-20T08:05:40.212 INFO:tasks.workunit.client.0.smithi123.stdout:4/730: dwrite d3/d2c/d43/d26/d3e/da9/dd9/de6/ff1 [0,4194304] 0 2024-02-20T08:05:40.213 INFO:tasks.workunit.client.0.smithi123.stdout:5/687: creat d0/d34/fe1 x:0 0 0 2024-02-20T08:05:40.219 INFO:tasks.workunit.client.0.smithi123.stdout:3/735: fdatasync d0/d6/d1a/d1b/d1c/f25 0 2024-02-20T08:05:40.221 INFO:tasks.workunit.client.0.smithi123.stdout:7/599: dwrite d0/db/d38/d47/d4a/d59/fca [0,4194304] 0 2024-02-20T08:05:40.234 INFO:tasks.workunit.client.0.smithi123.stdout:7/600: rename d0/d6/dd/d52/dcb to d0/db/d38/d47/dd6 0 2024-02-20T08:05:40.236 INFO:tasks.workunit.client.0.smithi123.stdout:3/736: symlink d0/d6/d1a/d1b/d1c/d3b/d43/l101 0 2024-02-20T08:05:40.236 INFO:tasks.workunit.client.0.smithi123.stdout:3/737: dread - d0/d6/d1a/da1/f100 zero size 2024-02-20T08:05:40.237 INFO:tasks.workunit.client.0.smithi123.stdout:3/738: fdatasync d0/d6/d1a/d1b/f54 0 2024-02-20T08:05:40.238 INFO:tasks.workunit.client.0.smithi123.stdout:3/739: stat d0/d6/d1a/d4b/fb5 0 2024-02-20T08:05:40.291 INFO:tasks.workunit.client.0.smithi123.stdout:2/751: sync 2024-02-20T08:05:40.297 INFO:tasks.workunit.client.0.smithi123.stdout:4/731: dwrite d3/d2c/d43/d34/f7c [0,4194304] 0 2024-02-20T08:05:40.307 INFO:tasks.workunit.client.0.smithi123.stdout:5/688: getdents d0/d34/d48/d56/d4c 0 2024-02-20T08:05:40.312 INFO:tasks.workunit.client.0.smithi123.stdout:4/732: creat d3/d2c/d5a/d7e/ff2 x:0 0 0 2024-02-20T08:05:40.315 INFO:tasks.workunit.client.0.smithi123.stdout:7/601: write d0/db/d21/f67 [1051198,104282] 0 2024-02-20T08:05:40.315 INFO:tasks.workunit.client.0.smithi123.stdout:2/752: creat d1a/d29/d42/d52/d98/dd6/dfa/fff x:0 0 0 2024-02-20T08:05:40.316 INFO:tasks.workunit.client.0.smithi123.stdout:2/753: readlink d1a/d29/d42/d52/l5b 0 2024-02-20T08:05:40.317 INFO:tasks.workunit.client.0.smithi123.stdout:5/689: creat d0/d34/d67/d80/d84/fe2 x:0 0 0 2024-02-20T08:05:40.318 INFO:tasks.workunit.client.0.smithi123.stdout:5/690: chown d0/f8d 13725 1 2024-02-20T08:05:40.318 INFO:tasks.workunit.client.0.smithi123.stdout:4/733: rmdir d3/d2c/d43/d34 39 2024-02-20T08:05:40.321 INFO:tasks.workunit.client.0.smithi123.stdout:3/740: rename d0/d6/d1a/d1b/d2a/f3a to d0/dd/d48/f102 0 2024-02-20T08:05:40.324 INFO:tasks.workunit.client.0.smithi123.stdout:7/602: write d0/d6/dd/d52/d26/d7b/f7e [4461335,119984] 0 2024-02-20T08:05:40.324 INFO:tasks.workunit.client.0.smithi123.stdout:3/741: write d0/d6/d1a/d1b/d9d/fd3 [438230,64361] 0 2024-02-20T08:05:40.326 INFO:tasks.workunit.client.0.smithi123.stdout:5/691: dwrite d0/d34/f66 [4194304,4194304] 0 2024-02-20T08:05:40.327 INFO:tasks.workunit.client.0.smithi123.stdout:3/742: stat d0/d6/d1a/d4b/d95/lbc 0 2024-02-20T08:05:40.328 INFO:tasks.workunit.client.0.smithi123.stdout:2/754: rename d1a/f5c to d1a/d29/d42/d52/d98/da1/deb/dd1/f100 0 2024-02-20T08:05:40.328 INFO:tasks.workunit.client.0.smithi123.stdout:3/743: readlink d0/d6/d1a/d1b/leb 0 2024-02-20T08:05:40.329 INFO:tasks.workunit.client.0.smithi123.stdout:3/744: stat d0/d6/d1a/d1b/d1c/d21/d8e 0 2024-02-20T08:05:40.330 INFO:tasks.workunit.client.0.smithi123.stdout:7/603: rmdir d0/d6/d7 39 2024-02-20T08:05:40.333 INFO:tasks.workunit.client.0.smithi123.stdout:5/692: mknod d0/d34/d48/d56/d4c/ce3 0 2024-02-20T08:05:40.338 INFO:tasks.workunit.client.0.smithi123.stdout:3/745: read d0/d6/d1a/f6c [103101,70957] 0 2024-02-20T08:05:40.339 INFO:tasks.workunit.client.0.smithi123.stdout:5/693: dread d0/d34/d48/d4b/f4f [0,4194304] 0 2024-02-20T08:05:40.345 INFO:tasks.workunit.client.0.smithi123.stdout:3/746: readlink d0/d6/d1a/d1b/d2a/laf 0 2024-02-20T08:05:40.347 INFO:tasks.workunit.client.0.smithi123.stdout:3/747: write d0/d6/d1a/d1b/d1c/d21/d8e/f9a [906077,122637] 0 2024-02-20T08:05:40.351 INFO:tasks.workunit.client.0.smithi123.stdout:4/734: getdents d3/d2c/d5a/d7e 0 2024-02-20T08:05:40.352 INFO:tasks.workunit.client.0.smithi123.stdout:3/748: dread d0/d6/d1a/d1b/f22 [0,4194304] 0 2024-02-20T08:05:40.354 INFO:tasks.workunit.client.0.smithi123.stdout:2/755: dread d1a/d29/d42/dc8/fde [0,4194304] 0 2024-02-20T08:05:40.355 INFO:tasks.workunit.client.0.smithi123.stdout:2/756: chown f10 228591116 1 2024-02-20T08:05:40.356 INFO:tasks.workunit.client.0.smithi123.stdout:2/757: dread - d1a/d29/d39/ff5 zero size 2024-02-20T08:05:40.361 INFO:tasks.workunit.client.0.smithi123.stdout:3/749: chown d0/d6/d1a/d1b/d1c/d61/dd1 133867243 1 2024-02-20T08:05:40.361 INFO:tasks.workunit.client.0.smithi123.stdout:8/652: sync 2024-02-20T08:05:40.362 INFO:tasks.workunit.client.0.smithi123.stdout:1/616: sync 2024-02-20T08:05:40.362 INFO:tasks.workunit.client.0.smithi123.stdout:0/851: sync 2024-02-20T08:05:40.363 INFO:tasks.workunit.client.0.smithi123.stdout:0/852: chown d2/d3/d37/d5f/l9e 1453574 1 2024-02-20T08:05:40.366 INFO:tasks.workunit.client.0.smithi123.stdout:2/758: mknod d1a/d29/d42/d52/d98/dd6/dfa/c101 0 2024-02-20T08:05:40.369 INFO:tasks.workunit.client.0.smithi123.stdout:8/653: mkdir d6/d32/d95/ddd 0 2024-02-20T08:05:40.372 INFO:tasks.workunit.client.0.smithi123.stdout:3/750: rename d0/d6/d1a/d1b/d1c/d3b/l47 to d0/d6/d1a/d1b/db4/l103 0 2024-02-20T08:05:40.374 INFO:tasks.workunit.client.0.smithi123.stdout:5/694: getdents d0/d34/d48/d56/dbb 0 2024-02-20T08:05:40.376 INFO:tasks.workunit.client.0.smithi123.stdout:1/617: truncate d3/db/d34/f2b 1610560 0 2024-02-20T08:05:40.379 INFO:tasks.workunit.client.0.smithi123.stdout:0/853: read d2/dd/d4f/f91 [245270,118178] 0 2024-02-20T08:05:40.379 INFO:tasks.workunit.client.0.smithi123.stdout:0/854: chown d2/dd/d4f/d61/f7b 25 1 2024-02-20T08:05:40.381 INFO:tasks.workunit.client.0.smithi123.stdout:0/855: write d2/dd/d4f/d7c/f8c [3456739,20877] 0 2024-02-20T08:05:40.381 INFO:tasks.workunit.client.0.smithi123.stdout:2/759: readlink d1a/d29/d42/d80/da3/lac 0 2024-02-20T08:05:40.381 INFO:tasks.workunit.client.0.smithi123.stdout:7/604: write d0/d23/fa8 [856555,35189] 0 2024-02-20T08:05:40.383 INFO:tasks.workunit.client.0.smithi123.stdout:0/856: write d2/dd/f12a [641113,116868] 0 2024-02-20T08:05:40.384 INFO:tasks.workunit.client.0.smithi123.stdout:4/735: creat d3/d2c/d43/d26/ff3 x:0 0 0 2024-02-20T08:05:40.393 INFO:tasks.workunit.client.0.smithi123.stdout:3/751: symlink d0/d6/d1a/d1b/d1c/d21/d8e/l104 0 2024-02-20T08:05:40.395 INFO:tasks.workunit.client.0.smithi123.stdout:4/736: dwrite d3/d2c/d5a/f92 [0,4194304] 0 2024-02-20T08:05:40.401 INFO:tasks.workunit.client.0.smithi123.stdout:0/857: creat d2/dd5/f12d x:0 0 0 2024-02-20T08:05:40.404 INFO:tasks.workunit.client.0.smithi123.stdout:7/605: creat d0/db/d38/d47/d4a/d5d/fd7 x:0 0 0 2024-02-20T08:05:40.411 INFO:tasks.workunit.client.0.smithi123.stdout:8/654: write d6/d1c/f21 [4665358,69737] 0 2024-02-20T08:05:40.417 INFO:tasks.workunit.client.0.smithi123.stdout:1/618: write d3/de/d14/d2c/d4f/f57 [2497794,22647] 0 2024-02-20T08:05:40.421 INFO:tasks.workunit.client.0.smithi123.stdout:9/707: sync 2024-02-20T08:05:40.453 INFO:tasks.workunit.client.0.smithi123.stdout:3/752: creat d0/dd/d48/d8d/dcf/f105 x:0 0 0 2024-02-20T08:05:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.453+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f031810fac0 con 0x7f030006f6f0 2024-02-20T08:05:40.459 INFO:tasks.workunit.client.0.smithi123.stdout:0/858: creat d2/de/d1e/d1f/f12e x:0 0 0 2024-02-20T08:05:40.460 INFO:tasks.workunit.client.0.smithi123.stdout:0/859: write d2/dd/d4f/d7c/da4/ff6 [319547,72149] 0 2024-02-20T08:05:40.462 INFO:tasks.workunit.client.0.smithi123.stdout:0/860: write d2/de/d1e/d1f/d74/fa8 [3104096,30251] 0 2024-02-20T08:05:40.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.463+0000 7f0314ff9700 1 -- 172.21.15.123:0/2703726166 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f031810fac0 con 0x7f030006f6f0 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 starting - - - - 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (9m) 54s ago 9m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (8m) 64s ago 8m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (7m) 54s ago 8m 85.0M - 9.4.7 954c08fa6188 2e3351c41db0 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (3m) 54s ago 3m 11.3M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (3m) 54s ago 3m 71.5M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (3m) 64s ago 3m 14.3M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (3m) 64s ago 3m 12.0M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:9283 running (10m) 54s ago 10m 338M - 17.2.7-521-gc80e7168 10b0c032c913 6ebbbfc0693b 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (81s) 64s ago 7m 488M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 915e6082ff57 2024-02-20T08:05:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (10m) 54s ago 10m 50.2M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (7m) 64s ago 7m 39.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 starting - - - - 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 64s ago 8m 17.1M - 1.5.0 0da6a335fe13 b243ddfe6b62 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (7m) 54s ago 7m 52.7M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (6m) 54s ago 6m 53.8M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (6m) 54s ago 6m 50.6M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (5m) 64s ago 5m 55.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (5m) 64s ago 5m 51.0M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (4m) 64s ago 4m 49.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:05:40.465 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (7m) 54s ago 8m 60.1M - 2.43.0 a07b618ecd1d 3c15ce4695f5 2024-02-20T08:05:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.466+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 msgr2=0x7f0300071ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.466+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 0x7f0300071ba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f030c004600 tx=0x7f030c00b040 comp rx=0 tx=0).stop 2024-02-20T08:05:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.466+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 msgr2=0x7f031810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.466+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0308000c00 tx=0x7f0308009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 shutdown_connections 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f030006f6f0 0x7f0300071ba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03180fbe40 0x7f031810d8b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 --2- 172.21.15.123:0/2703726166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03180fcfb0 0x7f031810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 >> 172.21.15.123:0/2703726166 conn(0x7f03180f7520 msgr2=0x7f0318065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 shutdown_connections 2024-02-20T08:05:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.467+0000 7f031e2ea700 1 -- 172.21.15.123:0/2703726166 wait complete. 2024-02-20T08:05:40.470 INFO:tasks.workunit.client.0.smithi123.stdout:0/861: dwrite d2/dd/d4f/d61/d68/dfb/f115 [0,4194304] 0 2024-02-20T08:05:40.473 INFO:tasks.workunit.client.0.smithi123.stdout:5/695: link d0/d34/d67/d80/fab d0/d34/d48/d56/dce/fe4 0 2024-02-20T08:05:40.475 INFO:tasks.workunit.client.0.smithi123.stdout:3/753: creat d0/d6/d1a/d62/f106 x:0 0 0 2024-02-20T08:05:40.479 INFO:tasks.workunit.client.0.smithi123.stdout:1/619: dread d3/db/d41/f5e [0,4194304] 0 2024-02-20T08:05:40.479 INFO:tasks.workunit.client.0.smithi123.stdout:2/760: creat d1a/d29/d42/f102 x:0 0 0 2024-02-20T08:05:40.481 INFO:tasks.workunit.client.0.smithi123.stdout:2/761: fsync d1a/d29/d42/d52/d98/dd6/fd7 0 2024-02-20T08:05:40.481 INFO:tasks.workunit.client.0.smithi123.stdout:2/762: chown lf 162179069 1 2024-02-20T08:05:40.487 INFO:tasks.workunit.client.0.smithi123.stdout:9/708: mknod d6/d19/d1a/d2b/d65/d77/cde 0 2024-02-20T08:05:40.490 INFO:tasks.workunit.client.0.smithi123.stdout:0/862: creat d2/d54/dac/f12f x:0 0 0 2024-02-20T08:05:40.491 INFO:tasks.workunit.client.0.smithi123.stdout:0/863: dread - d2/d3/d37/d5f/f121 zero size 2024-02-20T08:05:40.496 INFO:tasks.workunit.client.0.smithi123.stdout:4/737: creat d3/d2c/ff4 x:0 0 0 2024-02-20T08:05:40.496 INFO:tasks.workunit.client.0.smithi123.stdout:0/864: dwrite d2/de/d1e/fb0 [0,4194304] 0 2024-02-20T08:05:40.500 INFO:tasks.workunit.client.0.smithi123.stdout:2/763: unlink d1a/ff4 0 2024-02-20T08:05:40.502 INFO:tasks.workunit.client.0.smithi123.stdout:8/655: creat d6/dbd/d5b/d8f/d98/fde x:0 0 0 2024-02-20T08:05:40.504 INFO:tasks.workunit.client.0.smithi123.stdout:9/709: rmdir d6/d19/d1a/d2b/d28 39 2024-02-20T08:05:40.507 INFO:tasks.workunit.client.0.smithi123.stdout:9/710: dread d6/f12 [0,4194304] 0 2024-02-20T08:05:40.509 INFO:tasks.workunit.client.0.smithi123.stdout:8/656: dread d6/dbd/d5b/f77 [0,4194304] 0 2024-02-20T08:05:40.510 INFO:tasks.workunit.client.0.smithi123.stdout:8/657: chown d6/d1c/d22/c3e 502720928 1 2024-02-20T08:05:40.513 INFO:tasks.workunit.client.0.smithi123.stdout:1/620: mknod d3/de/d14/d2c/d4f/dcc/cd8 0 2024-02-20T08:05:40.514 INFO:tasks.workunit.client.0.smithi123.stdout:1/621: chown d3/db/d34/d74/l12 0 1 2024-02-20T08:05:40.516 INFO:tasks.workunit.client.0.smithi123.stdout:2/764: creat d1a/d29/d5d/d97/da9/f103 x:0 0 0 2024-02-20T08:05:40.521 INFO:tasks.workunit.client.0.smithi123.stdout:9/711: mkdir d6/d19/ddf 0 2024-02-20T08:05:40.523 INFO:tasks.workunit.client.0.smithi123.stdout:7/606: write d0/f37 [4060173,499] 0 2024-02-20T08:05:40.529 INFO:tasks.workunit.client.0.smithi123.stdout:2/765: unlink d1a/d29/f44 0 2024-02-20T08:05:40.536 INFO:tasks.workunit.client.0.smithi123.stdout:3/754: getdents d0/d6/d1a/d1b/d1c/d61 0 2024-02-20T08:05:40.537 INFO:tasks.workunit.client.0.smithi123.stdout:3/755: dread - d0/d6/d1a/d4b/fff zero size 2024-02-20T08:05:40.540 INFO:tasks.workunit.client.0.smithi123.stdout:4/738: rename c2 to d3/d18/cf5 0 2024-02-20T08:05:40.543 INFO:tasks.workunit.client.0.smithi123.stdout:2/766: fsync d1a/d29/d42/dbb/fdb 0 2024-02-20T08:05:40.544 INFO:tasks.workunit.client.0.smithi123.stdout:9/712: rmdir d6/d19/d1a/d2b/d28 39 2024-02-20T08:05:40.546 INFO:tasks.workunit.client.0.smithi123.stdout:5/696: link d0/d34/d48/d56/lb6 d0/d34/le5 0 2024-02-20T08:05:40.548 INFO:tasks.workunit.client.0.smithi123.stdout:9/713: dread d6/dbc/fbe [0,4194304] 0 2024-02-20T08:05:40.552 INFO:tasks.workunit.client.0.smithi123.stdout:0/865: rename d2/de/d1e/d1f/f77 to d2/d3/d37/d5f/d8a/dee/f130 0 2024-02-20T08:05:40.554 INFO:tasks.workunit.client.0.smithi123.stdout:4/739: creat d3/d18/d7d/d8b/d95/ff6 x:0 0 0 2024-02-20T08:05:40.555 INFO:tasks.workunit.client.0.smithi123.stdout:2/767: stat d1a/c57 0 2024-02-20T08:05:40.560 INFO:tasks.workunit.client.0.smithi123.stdout:3/756: truncate d0/f53 3698506 0 2024-02-20T08:05:40.562 INFO:tasks.workunit.client.0.smithi123.stdout:3/757: write d0/d6/d1a/da1/f100 [889096,29175] 0 2024-02-20T08:05:40.565 INFO:tasks.workunit.client.0.smithi123.stdout:7/607: mknod d0/d6/d7/cd8 0 2024-02-20T08:05:40.569 INFO:tasks.workunit.client.0.smithi123.stdout:4/740: rename d3/d2c/d5a/f6b to d3/d2c/d43/d26/d3e/ff7 0 2024-02-20T08:05:40.578 INFO:tasks.workunit.client.0.smithi123.stdout:3/758: mkdir d0/dd/d48/d6a/d107 0 2024-02-20T08:05:40.578 INFO:tasks.workunit.client.0.smithi123.stdout:1/622: dwrite d3/de/d14/d36/fb6 [0,4194304] 0 2024-02-20T08:05:40.582 INFO:tasks.workunit.client.0.smithi123.stdout:2/768: dread d1a/d4f/f53 [0,4194304] 0 2024-02-20T08:05:40.582 INFO:tasks.workunit.client.0.smithi123.stdout:2/769: chown f17 1827 1 2024-02-20T08:05:40.585 INFO:tasks.workunit.client.0.smithi123.stdout:7/608: rename d0/db/d38/d47 to d0/d6/dd/d52/d35/d9c/d70/dd9 0 2024-02-20T08:05:40.590 INFO:tasks.workunit.client.0.smithi123.stdout:1/623: dread - d3/de/d14/d2c/d45/f4d zero size 2024-02-20T08:05:40.594 INFO:tasks.workunit.client.0.smithi123.stdout:3/759: rename d0/d6/d1a/d1b/d57/dd0/ff8 to d0/dd/d48/d6a/f108 0 2024-02-20T08:05:40.595 INFO:tasks.workunit.client.0.smithi123.stdout:3/760: write d0/d6/d1a/d1b/d57/dd0/fce [826792,113894] 0 2024-02-20T08:05:40.597 INFO:tasks.workunit.client.0.smithi123.stdout:3/761: write d0/d6/d1a/d1b/d1c/d61/f96 [4789362,49103] 0 2024-02-20T08:05:40.603 INFO:tasks.workunit.client.0.smithi123.stdout:1/624: creat d3/de/d14/d26/d2e/d54/d9f/fd9 x:0 0 0 2024-02-20T08:05:40.606 INFO:tasks.workunit.client.0.smithi123.stdout:2/770: dread f5 [4194304,4194304] 0 2024-02-20T08:05:40.608 INFO:tasks.workunit.client.0.smithi123.stdout:3/762: creat d0/d6/d1a/d1b/d1c/d21/d64/f109 x:0 0 0 2024-02-20T08:05:40.609 INFO:tasks.workunit.client.0.smithi123.stdout:1/625: mknod d3/de/d14/d26/d2e/d54/d9f/dbe/cda 0 2024-02-20T08:05:40.609 INFO:tasks.workunit.client.0.smithi123.stdout:3/763: stat d0/d6/d1a/d1b/d2a/d86/c7b 0 2024-02-20T08:05:40.611 INFO:tasks.workunit.client.0.smithi123.stdout:2/771: chown d1a/d29/d42/d4e/c93 29192757 1 2024-02-20T08:05:40.615 INFO:tasks.workunit.client.0.smithi123.stdout:5/697: dwrite d0/f19 [4194304,4194304] 0 2024-02-20T08:05:40.618 INFO:tasks.workunit.client.0.smithi123.stdout:3/764: mknod d0/dd/d48/c10a 0 2024-02-20T08:05:40.621 INFO:tasks.workunit.client.0.smithi123.stdout:9/714: dwrite d6/d2a/d27/f54 [0,4194304] 0 2024-02-20T08:05:40.622 INFO:tasks.workunit.client.0.smithi123.stdout:2/772: mknod d1a/d29/c104 0 2024-02-20T08:05:40.623 INFO:tasks.workunit.client.0.smithi123.stdout:9/715: write d6/d19/d1a/f6a [1701083,25366] 0 2024-02-20T08:05:40.625 INFO:tasks.workunit.client.0.smithi123.stdout:9/716: write d6/d19/d1a/d6d/f6e [1844517,95615] 0 2024-02-20T08:05:40.628 INFO:tasks.workunit.client.0.smithi123.stdout:2/773: truncate d1a/d29/d42/d52/d98/da1/fb8 579292 0 2024-02-20T08:05:40.629 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:40 smithi123 ceph-mon[29383]: pgmap v39: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 165 MiB/s wr, 408 op/s 2024-02-20T08:05:40.629 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:40 smithi123 ceph-mon[29383]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:40.630 INFO:tasks.workunit.client.0.smithi123.stdout:3/765: dread d0/d6/d1a/d4b/f97 [0,4194304] 0 2024-02-20T08:05:40.636 INFO:tasks.workunit.client.0.smithi123.stdout:2/774: dwrite d1a/d7f/f91 [0,4194304] 0 2024-02-20T08:05:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 -- 172.21.15.123:0/49441313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c098070 msgr2=0x7fd17c09a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 --2- 172.21.15.123:0/49441313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c098070 0x7fd17c09a450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd178004940 tx=0x7fd178009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 -- 172.21.15.123:0/49441313 shutdown_connections 2024-02-20T08:05:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 --2- 172.21.15.123:0/49441313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c098070 0x7fd17c09a450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 --2- 172.21.15.123:0/49441313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c095750 0x7fd17c097b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.638+0000 7fd1895df700 1 -- 172.21.15.123:0/49441313 >> 172.21.15.123:0/49441313 conn(0x7fd17c08f1d0 msgr2=0x7fd17c091600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.639+0000 7fd1895df700 1 -- 172.21.15.123:0/49441313 shutdown_connections 2024-02-20T08:05:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.639+0000 7fd1895df700 1 -- 172.21.15.123:0/49441313 wait complete. 2024-02-20T08:05:40.640 INFO:tasks.workunit.client.0.smithi123.stdout:3/766: mknod d0/dd/c10b 0 2024-02-20T08:05:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.640+0000 7fd1895df700 1 Processor -- start 2024-02-20T08:05:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.640+0000 7fd1895df700 1 -- start start 2024-02-20T08:05:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.640+0000 7fd1895df700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c095750 0x7fd17c0a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1895df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1895df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0a5f70 con 0x7fd17c098070 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1895df700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0a60e0 con 0x7fd17c095750 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1827fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1827fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53984/0 (socket says 172.21.15.123:53984) 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd182ffd700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c095750 0x7fd17c0a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1827fc700 1 -- 172.21.15.123:0/1418704953 learned_addr learned my addr 172.21.15.123:0/1418704953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1827fc700 1 -- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c095750 msgr2=0x7fd17c0a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.641+0000 7fd1827fc700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c095750 0x7fd17c0a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd1827fc700 1 -- 172.21.15.123:0/1418704953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178005040 con 0x7fd17c098070 2024-02-20T08:05:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd1827fc700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:40 smithi194 ceph-mon[37804]: pgmap v39: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 165 MiB/s wr, 408 op/s 2024-02-20T08:05:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:40 smithi194 ceph-mon[37804]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17800e040 con 0x7fd17c098070 2024-02-20T08:05:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd178004290 con 0x7fd17c098070 2024-02-20T08:05:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c0aab30 con 0x7fd17c098070 2024-02-20T08:05:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17801c3f0 con 0x7fd17c098070 2024-02-20T08:05:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.642+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c0ab0f0 con 0x7fd17c098070 2024-02-20T08:05:40.645 INFO:tasks.workunit.client.0.smithi123.stdout:2/775: read d1a/d29/d42/d52/f7c [76282,100345] 0 2024-02-20T08:05:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.644+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1700052e0 con 0x7fd17c098070 2024-02-20T08:05:40.646 INFO:tasks.workunit.client.0.smithi123.stdout:3/767: rmdir d0/d6/d1a/d62/d82 39 2024-02-20T08:05:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.645+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7fd17800bcc0 con 0x7fd17c098070 2024-02-20T08:05:40.647 INFO:tasks.workunit.client.0.smithi123.stdout:3/768: stat d0/d6/f2e 0 2024-02-20T08:05:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.646+0000 7fd16b7fe700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 0x7fd16c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.646+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd17808b130 con 0x7fd17c098070 2024-02-20T08:05:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.646+0000 7fd182ffd700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 0x7fd16c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:40.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.647+0000 7fd182ffd700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 0x7fd16c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd174009fd0 tx=0x7fd17400b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:40.648 INFO:tasks.workunit.client.0.smithi123.stdout:7/609: write d0/d6/d29/fb2 [1746111,70800] 0 2024-02-20T08:05:40.649 INFO:tasks.workunit.client.0.smithi123.stdout:4/741: truncate d3/d2c/d43/d26/d3e/da9/fb5 2936576 0 2024-02-20T08:05:40.652 INFO:tasks.workunit.client.0.smithi123.stdout:2/776: rmdir d1a/d29/d42/d52/d98/da1/deb 39 2024-02-20T08:05:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:40.653+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd178058ca0 con 0x7fd17c098070 2024-02-20T08:05:40.654 INFO:tasks.workunit.client.0.smithi123.stdout:7/610: mknod d0/d6/dd/d52/d26/d9b/d61/cda 0 2024-02-20T08:05:40.658 INFO:tasks.workunit.client.0.smithi123.stdout:7/611: mknod d0/d6/dd/d52/d35/d9c/d70/cdb 0 2024-02-20T08:05:40.658 INFO:tasks.workunit.client.0.smithi123.stdout:1/626: write d3/f70 [807678,79784] 0 2024-02-20T08:05:40.663 INFO:tasks.workunit.client.0.smithi123.stdout:3/769: creat d0/d6/d1a/d4b/d95/f10c x:0 0 0 2024-02-20T08:05:40.665 INFO:tasks.workunit.client.0.smithi123.stdout:5/698: write d0/d34/d48/d56/dbb/f2c [307432,73087] 0 2024-02-20T08:05:40.667 INFO:tasks.workunit.client.0.smithi123.stdout:1/627: dwrite d3/d47/fa0 [0,4194304] 0 2024-02-20T08:05:40.669 INFO:tasks.workunit.client.0.smithi123.stdout:7/612: creat d0/d6/dd/fdc x:0 0 0 2024-02-20T08:05:40.677 INFO:tasks.workunit.client.0.smithi123.stdout:9/717: dwrite d6/d19/d1a/d7c/fa8 [0,4194304] 0 2024-02-20T08:05:40.681 INFO:tasks.workunit.client.0.smithi123.stdout:7/613: dwrite d0/d23/f8a [0,4194304] 0 2024-02-20T08:05:40.682 INFO:tasks.workunit.client.0.smithi123.stdout:4/742: getdents d3/d2c/d43/d26/d3e/da9/dd9/de6 0 2024-02-20T08:05:40.689 INFO:tasks.workunit.client.0.smithi123.stdout:9/718: dwrite d6/d19/f44 [0,4194304] 0 2024-02-20T08:05:40.694 INFO:tasks.workunit.client.0.smithi123.stdout:2/777: truncate d1a/d29/d42/dc8/fde 1516025 0 2024-02-20T08:05:40.696 INFO:tasks.workunit.client.0.smithi123.stdout:2/778: read d1a/d29/d42/d52/fb0 [1767930,32778] 0 2024-02-20T08:05:40.698 INFO:tasks.workunit.client.0.smithi123.stdout:7/614: rename d0/d23 to d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd 0 2024-02-20T08:05:40.700 INFO:tasks.workunit.client.0.smithi123.stdout:9/719: mknod d6/d2a/d27/d6f/d8b/d98/ce0 0 2024-02-20T08:05:40.704 INFO:tasks.workunit.client.0.smithi123.stdout:4/743: fsync d3/d2c/d43/d34/f93 0 2024-02-20T08:05:40.706 INFO:tasks.workunit.client.0.smithi123.stdout:2/779: truncate d1a/f9a 1029768 0 2024-02-20T08:05:40.706 INFO:tasks.workunit.client.0.smithi123.stdout:9/720: dread d6/d2a/d27/f54 [0,4194304] 0 2024-02-20T08:05:40.709 INFO:tasks.workunit.client.0.smithi123.stdout:3/770: dread d0/dd/f8 [0,4194304] 0 2024-02-20T08:05:40.710 INFO:tasks.workunit.client.0.smithi123.stdout:3/771: fdatasync d0/d6/d1a/d1b/db4/fc6 0 2024-02-20T08:05:40.712 INFO:tasks.workunit.client.0.smithi123.stdout:3/772: fsync d0/d6/d1a/d1b/d1c/d3b/d43/d68/f8b 0 2024-02-20T08:05:40.742 INFO:tasks.workunit.client.0.smithi123.stdout:1/628: dwrite d3/de/d14/d26/f73 [0,4194304] 0 2024-02-20T08:05:40.743 INFO:tasks.workunit.client.0.smithi123.stdout:1/629: chown d3/db/d34/d74/d6f/d63/lcb 7183378 1 2024-02-20T08:05:40.746 INFO:tasks.workunit.client.0.smithi123.stdout:4/744: mknod d3/d2c/d43/d26/d3e/da9/dd9/cf8 0 2024-02-20T08:05:40.749 INFO:tasks.workunit.client.0.smithi123.stdout:7/615: symlink d0/lde 0 2024-02-20T08:05:40.750 INFO:tasks.workunit.client.0.smithi123.stdout:7/616: stat d0/d6/dd/d52/f51 0 2024-02-20T08:05:40.751 INFO:tasks.workunit.client.0.smithi123.stdout:7/617: fdatasync d0/d6/d29/fcc 0 2024-02-20T08:05:40.757 INFO:tasks.workunit.client.0.smithi123.stdout:1/630: creat d3/de/d14/d26/d2e/d54/fdb x:0 0 0 2024-02-20T08:05:40.759 INFO:tasks.workunit.client.0.smithi123.stdout:4/745: fsync d3/d2c/feb 0 2024-02-20T08:05:40.765 INFO:tasks.workunit.client.0.smithi123.stdout:1/631: chown d3/db/d34/d74/ccf 5111 1 2024-02-20T08:05:40.784 INFO:tasks.workunit.client.0.smithi123.stdout:2/780: getdents d1a/d29/d42/dbb 0 2024-02-20T08:05:40.785 INFO:tasks.workunit.client.0.smithi123.stdout:1/632: dread - d3/db/d34/d74/f9b zero size 2024-02-20T08:05:40.785 INFO:tasks.workunit.client.0.smithi123.stdout:9/721: write d6/d19/d1a/d2b/d28/d9a/d3d/f62 [3169932,59039] 0 2024-02-20T08:05:40.785 INFO:tasks.workunit.client.0.smithi123.stdout:3/773: write d0/d6/d1a/d1b/d1c/d20/f40 [1553612,73969] 0 2024-02-20T08:05:40.790 INFO:tasks.workunit.client.0.smithi123.stdout:2/781: creat d1a/d29/d42/d52/d98/dd6/f105 x:0 0 0 2024-02-20T08:05:40.791 INFO:tasks.workunit.client.0.smithi123.stdout:7/618: dwrite d0/f4 [0,4194304] 0 2024-02-20T08:05:40.791 INFO:tasks.workunit.client.0.smithi123.stdout:2/782: readlink d1a/d29/l38 0 2024-02-20T08:05:40.791 INFO:tasks.workunit.client.0.smithi123.stdout:1/633: creat d3/de/d14/d2c/d4f/dcc/fdc x:0 0 0 2024-02-20T08:05:40.792 INFO:tasks.workunit.client.0.smithi123.stdout:9/722: truncate d6/d19/d1a/dc6/fda 253582 0 2024-02-20T08:05:40.795 INFO:tasks.workunit.client.0.smithi123.stdout:9/723: mkdir d6/d2a/d27/d6f/d8b/de1 0 2024-02-20T08:05:40.799 INFO:tasks.workunit.client.0.smithi123.stdout:7/619: creat d0/fdf x:0 0 0 2024-02-20T08:05:40.801 INFO:tasks.workunit.client.0.smithi123.stdout:7/620: write d0/d6/dd/d97/fad [1219679,84045] 0 2024-02-20T08:05:40.802 INFO:tasks.workunit.client.0.smithi123.stdout:9/724: creat d6/d19/d1a/d6d/d7e/fe2 x:0 0 0 2024-02-20T08:05:40.807 INFO:tasks.workunit.client.0.smithi123.stdout:1/634: link d3/db/d34/f92 d3/de/d14/d26/d2e/d54/d5d/fdd 0 2024-02-20T08:05:40.811 INFO:tasks.workunit.client.0.smithi123.stdout:3/774: dread d0/d6/d1a/f15 [0,4194304] 0 2024-02-20T08:05:40.811 INFO:tasks.workunit.client.0.smithi123.stdout:9/725: creat d6/d2a/d27/d6f/d8b/fe3 x:0 0 0 2024-02-20T08:05:40.812 INFO:tasks.workunit.client.0.smithi123.stdout:7/621: truncate d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/f92 343967 0 2024-02-20T08:05:40.813 INFO:tasks.workunit.client.0.smithi123.stdout:1/635: dread d3/de/d14/d26/d2e/d54/d5d/fdd [0,4194304] 0 2024-02-20T08:05:40.814 INFO:tasks.workunit.client.0.smithi123.stdout:7/622: read d0/f37 [2915183,31552] 0 2024-02-20T08:05:40.815 INFO:tasks.workunit.client.0.smithi123.stdout:9/726: rmdir d6/d19/d1a/d2b/d28/d9a/dae 39 2024-02-20T08:05:40.821 INFO:tasks.workunit.client.0.smithi123.stdout:2/783: write d1a/f2f [7112476,27337] 0 2024-02-20T08:05:40.830 INFO:tasks.workunit.client.0.smithi123.stdout:7/623: rename d0/d6/dd/d52/d26/l78 to d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/le0 0 2024-02-20T08:05:40.831 INFO:tasks.workunit.client.0.smithi123.stdout:9/727: dread d6/f58 [0,4194304] 0 2024-02-20T08:05:40.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/728: chown d6/f12 235777 1 2024-02-20T08:05:40.833 INFO:tasks.workunit.client.0.smithi123.stdout:3/775: write d0/d6/d1a/d1b/d1c/d21/d8e/fb2 [58252,21736] 0 2024-02-20T08:05:40.835 INFO:tasks.workunit.client.0.smithi123.stdout:9/729: fdatasync d6/d2a/d9d/f96 0 2024-02-20T08:05:40.836 INFO:tasks.workunit.client.0.smithi123.stdout:9/730: fsync d6/d19/d1a/d6d/d7e/fe2 0 2024-02-20T08:05:40.838 INFO:tasks.workunit.client.0.smithi123.stdout:9/731: read d6/d19/d1a/d31/f46 [4711363,57395] 0 2024-02-20T08:05:40.840 INFO:tasks.workunit.client.0.smithi123.stdout:7/624: creat d0/d6/dd/d52/d35/d9c/fe1 x:0 0 0 2024-02-20T08:05:40.842 INFO:tasks.workunit.client.0.smithi123.stdout:7/625: truncate d0/f2f 5163319 0 2024-02-20T08:05:40.842 INFO:tasks.workunit.client.0.smithi123.stdout:9/732: dread d6/d19/d1a/d2b/d28/d9a/f68 [0,4194304] 0 2024-02-20T08:05:40.844 INFO:tasks.workunit.client.0.smithi123.stdout:9/733: write d6/d19/f34 [6869148,110087] 0 2024-02-20T08:05:40.846 INFO:tasks.workunit.client.0.smithi123.stdout:2/784: dwrite d1a/d29/d42/d73/fa6 [0,4194304] 0 2024-02-20T08:05:40.847 INFO:tasks.workunit.client.0.smithi123.stdout:3/776: creat d0/f10d x:0 0 0 2024-02-20T08:05:40.849 INFO:tasks.workunit.client.0.smithi123.stdout:7/626: fdatasync d0/f7f 0 2024-02-20T08:05:40.850 INFO:tasks.workunit.client.0.smithi123.stdout:7/627: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d 2776 1 2024-02-20T08:05:40.855 INFO:tasks.workunit.client.0.smithi123.stdout:9/734: mkdir d6/d19/d1a/d2b/d28/d9a/d3d/d32/de4 0 2024-02-20T08:05:40.857 INFO:tasks.workunit.client.0.smithi123.stdout:3/777: mkdir d0/d6/d1a/d1b/d2a/d86/d10e 0 2024-02-20T08:05:40.862 INFO:tasks.workunit.client.0.smithi123.stdout:2/785: mknod d1a/d29/c106 0 2024-02-20T08:05:40.864 INFO:tasks.workunit.client.0.smithi123.stdout:3/778: creat d0/d6/d1a/d1b/d1c/d61/f10f x:0 0 0 2024-02-20T08:05:40.870 INFO:tasks.workunit.client.0.smithi123.stdout:3/779: rename d0/d6/d1a/d1b/d1c/d3b/c51 to d0/dd/d48/d6a/d74/c110 0 2024-02-20T08:05:40.870 INFO:tasks.workunit.client.0.smithi123.stdout:3/780: fsync d0/d6/d1a/d1b/d57/dd0/daa/fab 0 2024-02-20T08:05:40.872 INFO:tasks.workunit.client.0.smithi123.stdout:3/781: chown d0/d6/d1a/d4b/d95 11986594 1 2024-02-20T08:05:40.872 INFO:tasks.workunit.client.0.smithi123.stdout:9/735: creat d6/d19/d1a/d2b/d28/d9a/d3d/fe5 x:0 0 0 2024-02-20T08:05:40.876 INFO:tasks.workunit.client.0.smithi123.stdout:2/786: link d1a/f28 d1a/d29/d42/d52/d98/da1/daa/dd0/f107 0 2024-02-20T08:05:40.878 INFO:tasks.workunit.client.0.smithi123.stdout:7/628: dwrite d0/f30 [0,4194304] 0 2024-02-20T08:05:40.879 INFO:tasks.workunit.client.0.smithi123.stdout:9/736: rename d6/d19/d1a/d7f/f67 to d6/d19/ddf/fe6 0 2024-02-20T08:05:40.881 INFO:tasks.workunit.client.0.smithi123.stdout:7/629: chown d0/d6/dd/d52/d35/d9c 76837 1 2024-02-20T08:05:40.881 INFO:tasks.workunit.client.0.smithi123.stdout:3/782: dwrite d0/d6/d1a/d1b/d9d/fd3 [0,4194304] 0 2024-02-20T08:05:40.886 INFO:tasks.workunit.client.0.smithi123.stdout:7/630: dread d0/f64 [0,4194304] 0 2024-02-20T08:05:40.891 INFO:tasks.workunit.client.0.smithi123.stdout:7/631: readlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/l60 0 2024-02-20T08:05:40.891 INFO:tasks.workunit.client.0.smithi123.stdout:2/787: dwrite d1a/d29/f82 [0,4194304] 0 2024-02-20T08:05:40.897 INFO:tasks.workunit.client.0.smithi123.stdout:7/632: rmdir d0/d6/dd/d97 39 2024-02-20T08:05:40.900 INFO:tasks.workunit.client.0.smithi123.stdout:3/783: getdents d0 0 2024-02-20T08:05:40.902 INFO:tasks.workunit.client.0.smithi123.stdout:7/633: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/c32 0 2024-02-20T08:05:40.905 INFO:tasks.workunit.client.0.smithi123.stdout:9/737: dwrite d6/d2a/f59 [0,4194304] 0 2024-02-20T08:05:40.908 INFO:tasks.workunit.client.0.smithi123.stdout:3/784: symlink d0/d6/d1a/d1b/l111 0 2024-02-20T08:05:40.910 INFO:tasks.workunit.client.0.smithi123.stdout:9/738: creat d6/d2a/d27/d3c/dce/fe7 x:0 0 0 2024-02-20T08:05:40.912 INFO:tasks.workunit.client.0.smithi123.stdout:3/785: write d0/d6/d1a/d1b/d1c/d3b/d43/d68/fdd [916549,63175] 0 2024-02-20T08:05:40.913 INFO:tasks.workunit.client.0.smithi123.stdout:7/634: dwrite d0/f64 [0,4194304] 0 2024-02-20T08:05:40.916 INFO:tasks.workunit.client.0.smithi123.stdout:3/786: readlink d0/d6/d1a/d1b/db4/l103 0 2024-02-20T08:05:40.922 INFO:tasks.workunit.client.0.smithi123.stdout:3/787: dread d0/d6/d1a/d4b/f93 [0,4194304] 0 2024-02-20T08:05:40.923 INFO:tasks.workunit.client.0.smithi123.stdout:9/739: dread d6/d19/d1a/d7f/f5d [0,4194304] 0 2024-02-20T08:05:40.925 INFO:tasks.workunit.client.0.smithi123.stdout:9/740: stat d6/d19/d1a/d2b/d28/d9a 0 2024-02-20T08:05:40.928 INFO:tasks.workunit.client.0.smithi123.stdout:7/635: dread d0/d6/dd/d52/d26/d9b/d61/f9f [0,4194304] 0 2024-02-20T08:05:40.930 INFO:tasks.workunit.client.0.smithi123.stdout:3/788: dwrite d0/d6/d1a/d1b/d1c/d20/f40 [0,4194304] 0 2024-02-20T08:05:40.934 INFO:tasks.workunit.client.0.smithi123.stdout:3/789: creat d0/d6/d1a/d62/d82/da2/f112 x:0 0 0 2024-02-20T08:05:40.942 INFO:tasks.workunit.client.0.smithi123.stdout:3/790: getdents d0/d6/d1a/d1b/db4 0 2024-02-20T08:05:40.945 INFO:tasks.workunit.client.0.smithi123.stdout:7/636: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/f6d [0,4194304] 0 2024-02-20T08:05:40.950 INFO:tasks.workunit.client.0.smithi123.stdout:7/637: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/fe2 x:0 0 0 2024-02-20T08:05:40.952 INFO:tasks.workunit.client.0.smithi123.stdout:7/638: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/le3 0 2024-02-20T08:05:40.953 INFO:tasks.workunit.client.0.smithi123.stdout:3/791: read d0/d6/d1a/d1b/d1c/f4f [734513,89041] 0 2024-02-20T08:05:40.960 INFO:tasks.workunit.client.0.smithi123.stdout:3/792: rename d0/d6/d1a/d4b/f93 to d0/d6/d1a/d1b/d2a/d86/f113 0 2024-02-20T08:05:40.962 INFO:tasks.workunit.client.0.smithi123.stdout:3/793: read d0/f53 [3401823,24020] 0 2024-02-20T08:05:40.967 INFO:tasks.workunit.client.0.smithi123.stdout:7/639: write d0/d6/dd/d52/d26/d9b/d61/db1/fc3 [1818753,123901] 0 2024-02-20T08:05:40.968 INFO:tasks.workunit.client.0.smithi123.stdout:3/794: getdents d0/d6/d34 0 2024-02-20T08:05:40.972 INFO:tasks.workunit.client.0.smithi123.stdout:7/640: mknod d0/db/ce4 0 2024-02-20T08:05:40.974 INFO:tasks.workunit.client.0.smithi123.stdout:3/795: dwrite d0/f24 [4194304,4194304] 0 2024-02-20T08:05:40.981 INFO:tasks.workunit.client.0.smithi123.stdout:7/641: rmdir d0 39 2024-02-20T08:05:40.983 INFO:tasks.workunit.client.0.smithi123.stdout:7/642: readlink d0/d6/dd/d52/lb5 0 2024-02-20T08:05:40.986 INFO:tasks.workunit.client.0.smithi123.stdout:7/643: mknod d0/d6/dd/d52/d26/d9b/d61/ce5 0 2024-02-20T08:05:40.986 INFO:tasks.workunit.client.0.smithi123.stdout:7/644: fsync d0/f4 0 2024-02-20T08:05:40.991 INFO:tasks.workunit.client.0.smithi123.stdout:7/645: link d0/d6/dd/d52/fac d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/fe6 0 2024-02-20T08:05:40.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/646: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a 528594784 1 2024-02-20T08:05:40.993 INFO:tasks.workunit.client.0.smithi123.stdout:7/647: creat d0/d6/dd/d52/d26/d7b/fe7 x:0 0 0 2024-02-20T08:05:40.995 INFO:tasks.workunit.client.0.smithi123.stdout:7/648: truncate d0/d6/f53 215416 0 2024-02-20T08:05:40.996 INFO:tasks.workunit.client.0.smithi123.stdout:7/649: truncate d0/d6/dd/f96 1376910 0 2024-02-20T08:05:41.006 INFO:tasks.workunit.client.0.smithi123.stdout:7/650: write d0/d6/d7/f16 [22732,82251] 0 2024-02-20T08:05:41.007 INFO:tasks.workunit.client.0.smithi123.stdout:7/651: write d0/f30 [2521580,124120] 0 2024-02-20T08:05:41.012 INFO:tasks.workunit.client.0.smithi123.stdout:7/652: write d0/f40 [1357477,78686] 0 2024-02-20T08:05:41.014 INFO:tasks.workunit.client.0.smithi123.stdout:7/653: mkdir d0/db/de8 0 2024-02-20T08:05:41.018 INFO:tasks.workunit.client.0.smithi123.stdout:7/654: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca [0,4194304] 0 2024-02-20T08:05:41.021 INFO:tasks.workunit.client.0.smithi123.stdout:7/655: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca [0,4194304] 0 2024-02-20T08:05:41.022 INFO:tasks.workunit.client.0.smithi123.stdout:7/656: dread d0/d6/dd/f65 [0,4194304] 0 2024-02-20T08:05:41.028 INFO:tasks.workunit.client.0.smithi123.stdout:7/657: dwrite d0/d6/dd/d52/d26/d9b/d61/db1/fb6 [0,4194304] 0 2024-02-20T08:05:41.030 INFO:tasks.workunit.client.0.smithi123.stdout:7/658: read - d0/d6/dd/d52/d35/d9c/d70/dd9/fa3 zero size 2024-02-20T08:05:41.031 INFO:tasks.workunit.client.0.smithi123.stdout:7/659: read - d0/d6/d29/fcc zero size 2024-02-20T08:05:41.032 INFO:tasks.workunit.client.0.smithi123.stdout:7/660: fdatasync d0/d6/f57 0 2024-02-20T08:05:41.036 INFO:tasks.workunit.client.0.smithi123.stdout:7/661: creat d0/db/d38/fe9 x:0 0 0 2024-02-20T08:05:41.037 INFO:tasks.workunit.client.0.smithi123.stdout:7/662: symlink d0/db/lea 0 2024-02-20T08:05:41.039 INFO:tasks.workunit.client.0.smithi123.stdout:7/663: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/f90 [3012896,126655] 0 2024-02-20T08:05:41.042 INFO:tasks.workunit.client.0.smithi123.stdout:7/664: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/fc0 [0,4194304] 0 2024-02-20T08:05:41.044 INFO:tasks.workunit.client.0.smithi123.stdout:7/665: creat d0/d6/dd/d52/d26/d7b/feb x:0 0 0 2024-02-20T08:05:41.044 INFO:tasks.workunit.client.0.smithi123.stdout:7/666: readlink d0/l34 0 2024-02-20T08:05:41.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.092+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd170005860 con 0x7fd17c098070 2024-02-20T08:05:41.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.093+0000 7fd16b7fe700 1 -- 172.21.15.123:0/1418704953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fd178058830 con 0x7fd17c098070 2024-02-20T08:05:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:05:41.095 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 13, 2024-02-20T08:05:41.096 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:05:41.096 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:05:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:05:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 msgr2=0x7fd16c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 0x7fd16c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd174009fd0 tx=0x7fd17400b040 comp rx=0 tx=0).stop 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 msgr2=0x7fd17c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 shutdown_connections 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fd16c06b2e0 0x7fd16c06d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd17c095750 0x7fd17c0a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 --2- 172.21.15.123:0/1418704953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c098070 0x7fd17c0a5970 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 >> 172.21.15.123:0/1418704953 conn(0x7fd17c08f1d0 msgr2=0x7fd17c0915b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 shutdown_connections 2024-02-20T08:05:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.095+0000 7fd1895df700 1 -- 172.21.15.123:0/1418704953 wait complete. 2024-02-20T08:05:41.121 INFO:tasks.workunit.client.0.smithi123.stdout:8/658: sync 2024-02-20T08:05:41.123 INFO:tasks.workunit.client.0.smithi123.stdout:7/667: fdatasync d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/fd7 0 2024-02-20T08:05:41.126 INFO:tasks.workunit.client.0.smithi123.stdout:7/668: fsync d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/fe6 0 2024-02-20T08:05:41.128 INFO:tasks.workunit.client.0.smithi123.stdout:7/669: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/fc8 zero size 2024-02-20T08:05:41.128 INFO:tasks.workunit.client.0.smithi123.stdout:7/670: readlink d0/db/d38/ld1 0 2024-02-20T08:05:41.129 INFO:tasks.workunit.client.0.smithi123.stdout:7/671: chown d0/d6/dd/d52/d35/d9c/d70/fc2 3467 1 2024-02-20T08:05:41.133 INFO:tasks.workunit.client.0.smithi123.stdout:7/672: getdents d0/d6 0 2024-02-20T08:05:41.142 INFO:tasks.workunit.client.0.smithi123.stdout:8/659: dread d6/d1c/d22/d8c/dcd/f6a [0,4194304] 0 2024-02-20T08:05:41.143 INFO:tasks.workunit.client.0.smithi123.stdout:8/660: chown d6/d32/d95/f57 26 1 2024-02-20T08:05:41.147 INFO:tasks.workunit.client.0.smithi123.stdout:8/661: mknod d6/d1c/d22/d8c/dcd/db9/dc3/dd3/cdf 0 2024-02-20T08:05:41.150 INFO:tasks.workunit.client.0.smithi123.stdout:8/662: mkdir d6/d32/dd5/de0 0 2024-02-20T08:05:41.153 INFO:tasks.workunit.client.0.smithi123.stdout:8/663: creat d6/d32/fe1 x:0 0 0 2024-02-20T08:05:41.163 INFO:tasks.workunit.client.0.smithi123.stdout:7/673: dwrite d0/d6/dd/d52/d26/d9b/d61/db1/fc3 [0,4194304] 0 2024-02-20T08:05:41.168 INFO:tasks.workunit.client.0.smithi123.stdout:8/664: dread d6/fb [0,4194304] 0 2024-02-20T08:05:41.169 INFO:tasks.workunit.client.0.smithi123.stdout:8/665: stat d6/dbd/d7e/d82 0 2024-02-20T08:05:41.169 INFO:tasks.workunit.client.0.smithi123.stdout:8/666: fdatasync d6/d1c/fbc 0 2024-02-20T08:05:41.173 INFO:tasks.workunit.client.0.smithi123.stdout:8/667: creat d6/d32/fe2 x:0 0 0 2024-02-20T08:05:41.174 INFO:tasks.workunit.client.0.smithi123.stdout:7/674: getdents d0/d6/dd/d52/d35/d9c/d70/dd9 0 2024-02-20T08:05:41.174 INFO:tasks.workunit.client.0.smithi123.stdout:8/668: truncate d6/d32/d95/f57 5038398 0 2024-02-20T08:05:41.177 INFO:tasks.workunit.client.0.smithi123.stdout:8/669: mknod d6/dbd/ce3 0 2024-02-20T08:05:41.178 INFO:tasks.workunit.client.0.smithi123.stdout:8/670: fdatasync d6/d32/fe1 0 2024-02-20T08:05:41.180 INFO:tasks.workunit.client.0.smithi123.stdout:7/675: getdents d0/d6/dd/d97 0 2024-02-20T08:05:41.182 INFO:tasks.workunit.client.0.smithi123.stdout:8/671: creat d6/d1c/fe4 x:0 0 0 2024-02-20T08:05:41.184 INFO:tasks.workunit.client.0.smithi123.stdout:7/676: dread d0/d6/dd/d52/fac [0,4194304] 0 2024-02-20T08:05:41.189 INFO:tasks.workunit.client.0.smithi123.stdout:7/677: rename d0/d6/d29/f6e to d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fec 0 2024-02-20T08:05:41.192 INFO:tasks.workunit.client.0.smithi123.stdout:7/678: symlink d0/d6/d9d/led 0 2024-02-20T08:05:41.195 INFO:tasks.workunit.client.0.smithi123.stdout:7/679: symlink d0/db/de8/lee 0 2024-02-20T08:05:41.195 INFO:tasks.workunit.client.0.smithi123.stdout:8/672: write d6/d1c/d22/d8c/dcd/f51 [842630,26770] 0 2024-02-20T08:05:41.200 INFO:tasks.workunit.client.0.smithi123.stdout:7/680: creat d0/d6/dd/d52/d26/d7b/fef x:0 0 0 2024-02-20T08:05:41.202 INFO:tasks.workunit.client.0.smithi123.stdout:7/681: mkdir d0/d6/d29/df0 0 2024-02-20T08:05:41.203 INFO:tasks.workunit.client.0.smithi123.stdout:8/673: dwrite d6/d1c/d22/d8c/dcd/f44 [0,4194304] 0 2024-02-20T08:05:41.203 INFO:tasks.workunit.client.0.smithi123.stdout:7/682: fdatasync d0/d6/f31 0 2024-02-20T08:05:41.205 INFO:tasks.workunit.client.0.smithi123.stdout:7/683: write d0/d6/dd/d97/fad [1813795,128172] 0 2024-02-20T08:05:41.209 INFO:tasks.workunit.client.0.smithi123.stdout:7/684: creat d0/ff1 x:0 0 0 2024-02-20T08:05:41.214 INFO:tasks.workunit.client.0.smithi123.stdout:7/685: rename d0/db/d21/d42/c1c to d0/d6/cf2 0 2024-02-20T08:05:41.222 INFO:tasks.workunit.client.0.smithi123.stdout:8/674: dwrite d6/dbd/f7c [0,4194304] 0 2024-02-20T08:05:41.223 INFO:tasks.workunit.client.0.smithi123.stdout:8/675: stat d6/d32/f4a 0 2024-02-20T08:05:41.224 INFO:tasks.workunit.client.0.smithi123.stdout:8/676: chown d6/d32/d95/d3f 54253406 1 2024-02-20T08:05:41.225 INFO:tasks.workunit.client.0.smithi123.stdout:8/677: write d6/d1c/d22/d8c/dcd/f51 [8902110,110118] 0 2024-02-20T08:05:41.228 INFO:tasks.workunit.client.0.smithi123.stdout:7/686: chown d0/d6/dd/d52/d26/d9b/l17 13 1 2024-02-20T08:05:41.231 INFO:tasks.workunit.client.0.smithi123.stdout:8/678: symlink d6/dbd/d5b/d8f/dd7/le5 0 2024-02-20T08:05:41.232 INFO:tasks.workunit.client.0.smithi123.stdout:8/679: truncate d6/d32/fe1 997697 0 2024-02-20T08:05:41.235 INFO:tasks.workunit.client.0.smithi123.stdout:7/687: creat d0/d6/ff3 x:0 0 0 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 -- 172.21.15.123:0/2619970070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 msgr2=0x7f20940fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 --2- 172.21.15.123:0/2619970070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f20940fc250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2084004940 tx=0x7f2084009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 -- 172.21.15.123:0/2619970070 shutdown_connections 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 --2- 172.21.15.123:0/2619970070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f20940fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 --2- 172.21.15.123:0/2619970070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f20940fc250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.238+0000 7f209aa12700 1 -- 172.21.15.123:0/2619970070 >> 172.21.15.123:0/2619970070 conn(0x7f20940f74e0 msgr2=0x7f20940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:41.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.239+0000 7f209aa12700 1 -- 172.21.15.123:0/2619970070 shutdown_connections 2024-02-20T08:05:41.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.239+0000 7f209aa12700 1 -- 172.21.15.123:0/2619970070 wait complete. 2024-02-20T08:05:41.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.239+0000 7f209aa12700 1 Processor -- start 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.239+0000 7f209aa12700 1 -- start start 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f209aa12700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f209aa12700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f2094112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f209aa12700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20940664c0 con 0x7f20940fbe40 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f209aa12700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094066600 con 0x7f20940fcfb0 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f2093fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f2093fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54012/0 (socket says 172.21.15.123:54012) 2024-02-20T08:05:41.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f2093fff700 1 -- 172.21.15.123:0/1849568550 learned_addr learned my addr 172.21.15.123:0/1849568550 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f20937fe700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f2094112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f20937fe700 1 -- 172.21.15.123:0/1849568550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 msgr2=0x7f2094110590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f20937fe700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f20937fe700 1 -- 172.21.15.123:0/1849568550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088005040 con 0x7f20940fcfb0 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f2093fff700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f20937fe700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f2094112ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20880094a0 tx=0x7f2088009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.240+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208800e600 con 0x7f20940fcfb0 2024-02-20T08:05:41.243 INFO:tasks.workunit.client.0.smithi123.stdout:8/680: creat d6/fe6 x:0 0 0 2024-02-20T08:05:41.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.241+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084005040 con 0x7f20940fcfb0 2024-02-20T08:05:41.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.241+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2094113490 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.241+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f208800f040 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.241+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2088013c30 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.242+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209404bed0 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.243+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 89018+0+0 (secure 0 0 0) 0x7f208800e760 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.243+0000 7f2090ff9700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 0x7f207c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.243+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2088089eb0 con 0x7f20940fcfb0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.243+0000 7f2093fff700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 0x7f207c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:05:41.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.244+0000 7f2093fff700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 0x7f207c06d7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f208400b0d0 tx=0x7f2084009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:05:41.247 INFO:tasks.workunit.client.0.smithi123.stdout:8/681: mknod d6/dbd/d5b/d8f/d98/ce7 0 2024-02-20T08:05:41.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.247+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2088053f50 con 0x7f20940fcfb0 2024-02-20T08:05:41.254 INFO:tasks.workunit.client.0.smithi123.stdout:7/688: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/f2b [0,4194304] 0 2024-02-20T08:05:41.258 INFO:tasks.workunit.client.0.smithi123.stdout:7/689: rmdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5 39 2024-02-20T08:05:41.261 INFO:tasks.workunit.client.0.smithi123.stdout:7/690: dread d0/db/d38/f6a [0,4194304] 0 2024-02-20T08:05:41.263 INFO:tasks.workunit.client.0.smithi123.stdout:7/691: truncate d0/db/d38/fe9 383430 0 2024-02-20T08:05:41.268 INFO:tasks.workunit.client.0.smithi123.stdout:7/692: mkdir d0/df4 0 2024-02-20T08:05:41.274 INFO:tasks.workunit.client.0.smithi123.stdout:8/682: write d6/dbd/d5b/d8f/faf [308183,43258] 0 2024-02-20T08:05:41.275 INFO:tasks.workunit.client.0.smithi123.stdout:8/683: dread - d6/fe6 zero size 2024-02-20T08:05:41.276 INFO:tasks.workunit.client.0.smithi123.stdout:7/693: creat d0/d6/dd/ff5 x:0 0 0 2024-02-20T08:05:41.279 INFO:tasks.workunit.client.0.smithi123.stdout:8/684: dread d6/dbd/f7c [0,4194304] 0 2024-02-20T08:05:41.279 INFO:tasks.workunit.client.0.smithi123.stdout:7/694: write d0/d6/dd/d52/d35/d9c/d70/dd9/fc7 [736754,94745] 0 2024-02-20T08:05:41.281 INFO:tasks.workunit.client.0.smithi123.stdout:8/685: dread - d6/d32/d95/d3f/f89 zero size 2024-02-20T08:05:41.284 INFO:tasks.workunit.client.0.smithi123.stdout:0/866: sync 2024-02-20T08:05:41.285 INFO:tasks.workunit.client.0.smithi123.stdout:0/867: read - d2/dd/d4f/d7c/da4/d28/fd7 zero size 2024-02-20T08:05:41.285 INFO:tasks.workunit.client.0.smithi123.stdout:8/686: creat d6/d32/d95/d3f/fe8 x:0 0 0 2024-02-20T08:05:41.289 INFO:tasks.workunit.client.0.smithi123.stdout:0/868: mknod d2/dd/d4f/d61/d81/df5/c131 0 2024-02-20T08:05:41.292 INFO:tasks.workunit.client.0.smithi123.stdout:8/687: dwrite d6/dbd/d5b/d8f/d98/f9b [0,4194304] 0 2024-02-20T08:05:41.293 INFO:tasks.workunit.client.0.smithi123.stdout:0/869: mkdir d2/d54/dac/d132 0 2024-02-20T08:05:41.298 INFO:tasks.workunit.client.0.smithi123.stdout:8/688: creat d6/d32/d95/d7d/fe9 x:0 0 0 2024-02-20T08:05:41.300 INFO:tasks.workunit.client.0.smithi123.stdout:0/870: dread - d2/dd/fbb zero size 2024-02-20T08:05:41.302 INFO:tasks.workunit.client.0.smithi123.stdout:8/689: truncate d6/d1c/f6f 1501636 0 2024-02-20T08:05:41.306 INFO:tasks.workunit.client.0.smithi123.stdout:8/690: creat d6/d32/d95/d7d/dab/fea x:0 0 0 2024-02-20T08:05:41.307 INFO:tasks.workunit.client.0.smithi123.stdout:8/691: dread - d6/d1c/fe4 zero size 2024-02-20T08:05:41.309 INFO:tasks.workunit.client.0.smithi123.stdout:0/871: dread d2/dd/d4f/fad [0,4194304] 0 2024-02-20T08:05:41.314 INFO:tasks.workunit.client.0.smithi123.stdout:8/692: dwrite d6/d32/d95/db0/fd8 [0,4194304] 0 2024-02-20T08:05:41.318 INFO:tasks.workunit.client.0.smithi123.stdout:8/693: rmdir d6/d1c/d22/d8c/dcd/db9/dc3/dd3 39 2024-02-20T08:05:41.322 INFO:tasks.workunit.client.0.smithi123.stdout:8/694: rename d6/f1b to d6/d1c/d22/d8c/da2/feb 0 2024-02-20T08:05:41.328 INFO:tasks.workunit.client.0.smithi123.stdout:8/695: dwrite d6/d1c/d22/f6b [0,4194304] 0 2024-02-20T08:05:41.334 INFO:tasks.workunit.client.0.smithi123.stdout:7/695: truncate d0/d6/dd/d52/fac 1166762 0 2024-02-20T08:05:41.339 INFO:tasks.workunit.client.0.smithi123.stdout:0/872: rmdir d2/d54/dac 39 2024-02-20T08:05:41.340 INFO:tasks.workunit.client.0.smithi123.stdout:7/696: dwrite d0/d6/dd/d52/f51 [0,4194304] 0 2024-02-20T08:05:41.350 INFO:tasks.workunit.client.0.smithi123.stdout:7/697: getdents d0/db/de8 0 2024-02-20T08:05:41.351 INFO:tasks.workunit.client.0.smithi123.stdout:7/698: truncate d0/db/d38/f43 4931740 0 2024-02-20T08:05:41.358 INFO:tasks.workunit.client.0.smithi123.stdout:7/699: dwrite d0/db/d38/f6a [4194304,4194304] 0 2024-02-20T08:05:41.363 INFO:tasks.workunit.client.0.smithi123.stdout:8/696: dwrite d6/fd [0,4194304] 0 2024-02-20T08:05:41.365 INFO:tasks.workunit.client.0.smithi123.stdout:8/697: readlink d6/d32/d95/d3f/l94 0 2024-02-20T08:05:41.365 INFO:tasks.workunit.client.0.smithi123.stdout:7/700: creat d0/d6/dd/d52/d26/d7b/ff6 x:0 0 0 2024-02-20T08:05:41.372 INFO:tasks.workunit.client.0.smithi123.stdout:0/873: dwrite d2/de/d1e/f35 [0,4194304] 0 2024-02-20T08:05:41.374 INFO:tasks.workunit.client.0.smithi123.stdout:0/874: read d2/d3/d37/fc5 [4041867,24915] 0 2024-02-20T08:05:41.380 INFO:tasks.workunit.client.0.smithi123.stdout:0/875: link d2/de/d1e/d1f/d5e/f7a d2/d3/d37/d5f/f133 0 2024-02-20T08:05:41.382 INFO:tasks.workunit.client.0.smithi123.stdout:0/876: write d2/d54/d78/ff7 [549385,117000] 0 2024-02-20T08:05:41.386 INFO:tasks.workunit.client.0.smithi123.stdout:0/877: mkdir d2/d3/d37/d134 0 2024-02-20T08:05:41.387 INFO:tasks.workunit.client.0.smithi123.stdout:7/701: getdents d0/d6/dd/d52/d26/d7b 0 2024-02-20T08:05:41.390 INFO:tasks.workunit.client.0.smithi123.stdout:0/878: fsync d2/d3/d37/d5f/d8a/dee/f130 0 2024-02-20T08:05:41.391 INFO:tasks.workunit.client.0.smithi123.stdout:7/702: mkdir d0/d6/dd/d52/d26/d9b/d61/df7 0 2024-02-20T08:05:41.398 INFO:tasks.workunit.client.0.smithi123.stdout:0/879: unlink d2/dd/d4f/fad 0 2024-02-20T08:05:41.436 INFO:tasks.workunit.client.0.smithi123.stdout:0/880: rmdir d2/dd/d4f/d61 39 2024-02-20T08:05:41.437 INFO:tasks.workunit.client.0.smithi123.stdout:7/703: creat d0/d6/dd/d52/ff8 x:0 0 0 2024-02-20T08:05:41.439 INFO:tasks.workunit.client.0.smithi123.stdout:0/881: read - d2/d54/fa5 zero size 2024-02-20T08:05:41.440 INFO:tasks.workunit.client.0.smithi123.stdout:0/882: fdatasync d2/dd/d4f/da7/d107/f11b 0 2024-02-20T08:05:41.467 INFO:tasks.workunit.client.0.smithi123.stdout:7/704: rmdir d0/d6/dd 39 2024-02-20T08:05:41.470 INFO:tasks.workunit.client.0.smithi123.stdout:7/705: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/fd3 zero size 2024-02-20T08:05:41.471 INFO:tasks.workunit.client.0.smithi123.stdout:7/706: chown d0/db/d38/f43 125229 1 2024-02-20T08:05:41.471 INFO:tasks.workunit.client.0.smithi123.stdout:0/883: write d2/de/d1e/d1f/f8e [1867227,56060] 0 2024-02-20T08:05:41.473 INFO:tasks.workunit.client.0.smithi123.stdout:0/884: mknod d2/de/d1e/d1f/dc0/ddd/c135 0 2024-02-20T08:05:41.474 INFO:tasks.workunit.client.0.smithi123.stdout:0/885: dread - d2/d3/d37/d5f/f121 zero size 2024-02-20T08:05:41.474 INFO:tasks.workunit.client.0.smithi123.stdout:7/707: creat d0/d6/dd/d52/d35/d9c/d70/dd9/dd6/ff9 x:0 0 0 2024-02-20T08:05:41.477 INFO:tasks.workunit.client.0.smithi123.stdout:7/708: unlink d0/lde 0 2024-02-20T08:05:41.479 INFO:tasks.workunit.client.0.smithi123.stdout:0/886: rename d2/d3/c4c to d2/d3/d37/d5f/d8a/dee/c136 0 2024-02-20T08:05:41.481 INFO:tasks.workunit.client.0.smithi123.stdout:0/887: readlink d2/l5a 0 2024-02-20T08:05:41.487 INFO:tasks.workunit.client.0.smithi123.stdout:5/699: sync 2024-02-20T08:05:41.487 INFO:tasks.workunit.client.0.smithi123.stdout:0/888: dwrite d2/d54/d78/ff7 [0,4194304] 0 2024-02-20T08:05:41.490 INFO:tasks.workunit.client.0.smithi123.stdout:0/889: mkdir d2/de/d1e/d1f/d137 0 2024-02-20T08:05:41.492 INFO:tasks.workunit.client.0.smithi123.stdout:5/700: symlink d0/d34/d48/d56/d4c/d43/le6 0 2024-02-20T08:05:41.496 INFO:tasks.workunit.client.0.smithi123.stdout:5/701: chown d0/d34/d48/d56/dcf 453227 1 2024-02-20T08:05:41.498 INFO:tasks.workunit.client.0.smithi123.stdout:0/890: creat d2/dd/d4f/d61/d81/df5/f138 x:0 0 0 2024-02-20T08:05:41.505 INFO:tasks.workunit.client.0.smithi123.stdout:7/709: truncate d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f8a 1141323 0 2024-02-20T08:05:41.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:41 smithi123 ceph-mon[29383]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:41.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:41 smithi123 ceph-mon[29383]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:41.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:41 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1418704953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:05:41.508 INFO:tasks.workunit.client.0.smithi123.stdout:7/710: symlink d0/d6/dd/d52/d26/d9b/d61/db1/lfa 0 2024-02-20T08:05:41.511 INFO:tasks.workunit.client.0.smithi123.stdout:7/711: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/fa8 [393253,15789] 0 2024-02-20T08:05:41.511 INFO:tasks.workunit.client.0.smithi123.stdout:7/712: stat d0/f4 0 2024-02-20T08:05:41.514 INFO:tasks.workunit.client.0.smithi123.stdout:0/891: truncate d2/d54/d78/ff7 2013471 0 2024-02-20T08:05:41.518 INFO:tasks.workunit.client.0.smithi123.stdout:7/713: rmdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b 39 2024-02-20T08:05:41.520 INFO:tasks.workunit.client.0.smithi123.stdout:5/702: dread d0/f11 [4194304,4194304] 0 2024-02-20T08:05:41.522 INFO:tasks.workunit.client.0.smithi123.stdout:0/892: rename d2/c38 to d2/d3/d37/d5f/d8a/dee/c139 0 2024-02-20T08:05:41.523 INFO:tasks.workunit.client.0.smithi123.stdout:5/703: symlink d0/d34/d48/d56/dbb/d27/d4e/le7 0 2024-02-20T08:05:41.524 INFO:tasks.workunit.client.0.smithi123.stdout:5/704: read - d0/d34/d67/d80/d84/fe2 zero size 2024-02-20T08:05:41.526 INFO:tasks.workunit.client.0.smithi123.stdout:0/893: rmdir d2/de/d1e/d84 39 2024-02-20T08:05:41.533 INFO:tasks.workunit.client.0.smithi123.stdout:7/714: write d0/d6/dd/d52/d35/d9c/d70/fae [62101,1029] 0 2024-02-20T08:05:41.534 INFO:tasks.workunit.client.0.smithi123.stdout:5/705: rmdir d0/d34/d48/d4b/db8 0 2024-02-20T08:05:41.536 INFO:tasks.workunit.client.0.smithi123.stdout:5/706: write d0/d34/d48/d4b/f7d [2491628,89207] 0 2024-02-20T08:05:41.537 INFO:tasks.workunit.client.0.smithi123.stdout:0/894: creat d2/dd/d4f/d7c/f13a x:0 0 0 2024-02-20T08:05:41.537 INFO:tasks.workunit.client.0.smithi123.stdout:5/707: chown d0/d34/d48/f53 0 1 2024-02-20T08:05:41.545 INFO:tasks.workunit.client.0.smithi123.stdout:7/715: rename d0/d6/dd/d52/d26/d9b/d61/f88 to d0/d6/dd/d52/d35/d9c/ffb 0 2024-02-20T08:05:41.548 INFO:tasks.workunit.client.0.smithi123.stdout:4/746: sync 2024-02-20T08:05:41.548 INFO:tasks.workunit.client.0.smithi123.stdout:1/636: sync 2024-02-20T08:05:41.550 INFO:tasks.workunit.client.0.smithi123.stdout:7/716: dread d0/db/d38/f6a [4194304,4194304] 0 2024-02-20T08:05:41.551 INFO:tasks.workunit.client.0.smithi123.stdout:5/708: write d0/d34/d48/d56/dce/fe4 [2167990,74138] 0 2024-02-20T08:05:41.551 INFO:tasks.workunit.client.0.smithi123.stdout:7/717: stat d0/d6/dd/d52/d26/d7b/feb 0 2024-02-20T08:05:41.555 INFO:tasks.workunit.client.0.smithi123.stdout:5/709: truncate d0/d34/d48/d56/dbb/d27/d4e/fd3 379009 0 2024-02-20T08:05:41.557 INFO:tasks.workunit.client.0.smithi123.stdout:0/895: truncate d2/de/d1e/d1f/fbf 3195089 0 2024-02-20T08:05:41.558 INFO:tasks.workunit.client.0.smithi123.stdout:1/637: creat d3/de/d14/d26/d56/fde x:0 0 0 2024-02-20T08:05:41.559 INFO:tasks.workunit.client.0.smithi123.stdout:4/747: truncate d3/d2c/d43/d26/d3e/da9/fb5 2894282 0 2024-02-20T08:05:41.560 INFO:tasks.workunit.client.0.smithi123.stdout:4/748: dread - d3/d18/d7d/d8b/d95/ff6 zero size 2024-02-20T08:05:41.561 INFO:tasks.workunit.client.0.smithi123.stdout:5/710: rename d0/d34/d48/d56/d3e/l82 to d0/d34/d48/d56/d4c/d43/dd2/ddd/le8 0 2024-02-20T08:05:41.566 INFO:tasks.workunit.client.0.smithi123.stdout:0/896: rename d2/de/d1e/d1f/dc0/ddd/c135 to d2/de/d1e/d1f/d74/dec/c13b 0 2024-02-20T08:05:41.569 INFO:tasks.workunit.client.0.smithi123.stdout:5/711: mknod d0/d34/d48/d56/d25/ce9 0 2024-02-20T08:05:41.619 INFO:tasks.workunit.client.0.smithi123.stdout:5/712: chown d0/d34/d48/d56/dbb/c1c 0 1 2024-02-20T08:05:41.619 INFO:tasks.workunit.client.0.smithi123.stdout:7/718: dwrite d0/d6/d7/f4e [0,4194304] 0 2024-02-20T08:05:41.619 INFO:tasks.workunit.client.0.smithi123.stdout:7/719: write d0/d6/dd/d52/d26/d9b/fcd [1441185,68780] 0 2024-02-20T08:05:41.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.581+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2094101990 con 0x7f207c06b330 2024-02-20T08:05:41.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.583+0000 7f2090ff9700 1 -- 172.21.15.123:0/1849568550 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2094101990 con 0x7f207c06b330 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "1/2 daemons upgraded", 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:05:41.620 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:05:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.586+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 msgr2=0x7f207c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.586+0000 7f209aa12700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 0x7f207c06d7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f208400b0d0 tx=0x7f2084009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.586+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 msgr2=0x7f2094112ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:05:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.586+0000 7f209aa12700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f2094112ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20880094a0 tx=0x7f2088009e30 comp rx=0 tx=0).stop 2024-02-20T08:05:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 shutdown_connections 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f207c06b330 0x7f207c06d7e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20940fbe40 0x7f2094110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 --2- 172.21.15.123:0/1849568550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20940fcfb0 0x7f2094112ae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 >> 172.21.15.123:0/1849568550 conn(0x7f20940f74e0 msgr2=0x7f2094100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 shutdown_connections 2024-02-20T08:05:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:05:41.587+0000 7f209aa12700 1 -- 172.21.15.123:0/1849568550 wait complete. 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:7/720: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/fd0 [0,4194304] 0 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:7/721: write d0/d6/dd/d52/d35/d9c/d70/fae [830714,10526] 0 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:4/749: getdents d3/d97/dda/db6 0 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:0/897: creat d2/d54/dac/d132/f13c x:0 0 0 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:0/898: chown d2/d3/d37/d5f 91 1 2024-02-20T08:05:41.624 INFO:tasks.workunit.client.0.smithi123.stdout:1/638: link d3/f10 d3/fdf 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:5/713: dwrite d0/fa9 [0,4194304] 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:5/714: fsync d0/f11 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:4/750: creat d3/d18/ff9 x:0 0 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:4/751: chown d3/f4d 1141490 1 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:8/698: sync 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:2/788: sync 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:9/741: sync 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:3/796: sync 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:2/789: chown d1a/d29/d42/d80/da3/fe9 13946280 1 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:1/639: truncate d3/de/d14/d2c/d4f/f64 1149789 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:1/640: dread - d3/d47/f9c zero size 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:3/797: dread d0/f24 [4194304,4194304] 0 2024-02-20T08:05:41.625 INFO:tasks.workunit.client.0.smithi123.stdout:9/742: dread d6/f8d [0,4194304] 0 2024-02-20T08:05:41.626 INFO:tasks.workunit.client.0.smithi123.stdout:2/790: dwrite d1a/d29/fcb [0,4194304] 0 2024-02-20T08:05:41.626 INFO:tasks.workunit.client.0.smithi123.stdout:8/699: symlink d6/dbd/d7e/lec 0 2024-02-20T08:05:41.626 INFO:tasks.workunit.client.0.smithi123.stdout:0/899: link d2/dd/d4f/d7c/da4/d28/daf/l11a d2/de/dc6/l13d 0 2024-02-20T08:05:41.626 INFO:tasks.workunit.client.0.smithi123.stdout:7/722: truncate d0/d6/dd/d52/d26/d9b/d61/db1/fb6 1747045 0 2024-02-20T08:05:41.626 INFO:tasks.workunit.client.0.smithi123.stdout:8/700: write d6/d32/fe2 [746073,28577] 0 2024-02-20T08:05:41.628 INFO:tasks.workunit.client.0.smithi123.stdout:3/798: dwrite d0/d6/d1a/d1b/d2a/f6f [4194304,4194304] 0 2024-02-20T08:05:41.629 INFO:tasks.workunit.client.0.smithi123.stdout:0/900: write d2/de/d1e/d1f/d74/f109 [1070544,42039] 0 2024-02-20T08:05:41.632 INFO:tasks.workunit.client.0.smithi123.stdout:0/901: write d2/de/d1e/d1f/d74/f109 [951175,129208] 0 2024-02-20T08:05:41.632 INFO:tasks.workunit.client.0.smithi123.stdout:1/641: symlink d3/d47/le0 0 2024-02-20T08:05:41.633 INFO:tasks.workunit.client.0.smithi123.stdout:3/799: readlink d0/d6/d1a/d1b/d1c/d3b/d43/lae 0 2024-02-20T08:05:41.637 INFO:tasks.workunit.client.0.smithi123.stdout:5/715: write d0/d34/d48/d56/dbb/f88 [279701,118589] 0 2024-02-20T08:05:41.637 INFO:tasks.workunit.client.0.smithi123.stdout:4/752: symlink d3/dcb/lfa 0 2024-02-20T08:05:41.642 INFO:tasks.workunit.client.0.smithi123.stdout:9/743: rename d6/d2a/d27/d3c/caa to d6/d19/d1a/d6d/d7e/ce8 0 2024-02-20T08:05:41.644 INFO:tasks.workunit.client.0.smithi123.stdout:3/800: dwrite d0/d6/d1a/d1b/d57/dd0/daa/fe7 [0,4194304] 0 2024-02-20T08:05:41.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:41 smithi194 ceph-mon[37804]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:41.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:41 smithi194 ceph-mon[37804]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:41.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:41 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1418704953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:05:41.647 INFO:tasks.workunit.client.0.smithi123.stdout:8/701: unlink d6/dbd/f56 0 2024-02-20T08:05:41.650 INFO:tasks.workunit.client.0.smithi123.stdout:1/642: rmdir d3/de/d14/d2c/d4f/dcc 39 2024-02-20T08:05:41.651 INFO:tasks.workunit.client.0.smithi123.stdout:1/643: chown d3/de/d14/d26/d2e/d54/caa 108 1 2024-02-20T08:05:41.652 INFO:tasks.workunit.client.0.smithi123.stdout:0/902: mkdir d2/dd/d4f/d61/d68/dfb/d13e 0 2024-02-20T08:05:41.654 INFO:tasks.workunit.client.0.smithi123.stdout:4/753: mknod d3/d2c/d43/d34/cfb 0 2024-02-20T08:05:41.655 INFO:tasks.workunit.client.0.smithi123.stdout:4/754: fsync d3/d97/dda/db6/f9e 0 2024-02-20T08:05:41.656 INFO:tasks.workunit.client.0.smithi123.stdout:4/755: dread - d3/d18/d7d/d8b/d95/fe1 zero size 2024-02-20T08:05:41.658 INFO:tasks.workunit.client.0.smithi123.stdout:9/744: creat d6/d2a/d27/d6f/d8b/d98/fe9 x:0 0 0 2024-02-20T08:05:41.658 INFO:tasks.workunit.client.0.smithi123.stdout:3/801: symlink d0/d6/d1a/d1b/d1c/d21/dd9/l114 0 2024-02-20T08:05:41.660 INFO:tasks.workunit.client.0.smithi123.stdout:7/723: write d0/db/fbf [3760,1850] 0 2024-02-20T08:05:41.661 INFO:tasks.workunit.client.0.smithi123.stdout:7/724: readlink d0/db/lea 0 2024-02-20T08:05:41.662 INFO:tasks.workunit.client.0.smithi123.stdout:8/702: creat d6/dbd/d5b/d8f/dd7/fed x:0 0 0 2024-02-20T08:05:41.663 INFO:tasks.workunit.client.0.smithi123.stdout:1/644: mknod d3/de/d14/d26/d2e/d54/d9f/ce1 0 2024-02-20T08:05:41.669 INFO:tasks.workunit.client.0.smithi123.stdout:0/903: dwrite d2/de/d1e/d1f/dc0/ddd/fde [0,4194304] 0 2024-02-20T08:05:41.671 INFO:tasks.workunit.client.0.smithi123.stdout:9/745: rmdir d6/d2a/d9d 39 2024-02-20T08:05:41.673 INFO:tasks.workunit.client.0.smithi123.stdout:2/791: link d1a/d29/d5d/c75 d1a/d29/d42/d4e/c108 0 2024-02-20T08:05:41.676 INFO:tasks.workunit.client.0.smithi123.stdout:7/725: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b 0 2024-02-20T08:05:41.679 INFO:tasks.workunit.client.0.smithi123.stdout:8/703: truncate d6/d1c/d22/f48 7024000 0 2024-02-20T08:05:41.680 INFO:tasks.workunit.client.0.smithi123.stdout:7/726: dread d0/db/f27 [0,4194304] 0 2024-02-20T08:05:41.682 INFO:tasks.workunit.client.0.smithi123.stdout:1/645: rename d3/db/d34/d74/d6f/d63/ca5 to d3/db/d7d/ce2 0 2024-02-20T08:05:41.686 INFO:tasks.workunit.client.0.smithi123.stdout:4/756: creat d3/d97/df0/ffc x:0 0 0 2024-02-20T08:05:41.690 INFO:tasks.workunit.client.0.smithi123.stdout:8/704: read - d6/d32/fb2 zero size 2024-02-20T08:05:41.691 INFO:tasks.workunit.client.0.smithi123.stdout:3/802: write d0/d6/d1a/d1b/d1c/d21/f29 [3608618,85541] 0 2024-02-20T08:05:41.692 INFO:tasks.workunit.client.0.smithi123.stdout:7/727: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/ffc x:0 0 0 2024-02-20T08:05:41.694 INFO:tasks.workunit.client.0.smithi123.stdout:2/792: rename d1a/d29/c48 to d1a/d29/d42/d52/d98/dd6/c109 0 2024-02-20T08:05:41.696 INFO:tasks.workunit.client.0.smithi123.stdout:5/716: getdents d0/d34/d48/d56/d4c/d43 0 2024-02-20T08:05:41.707 INFO:tasks.workunit.client.0.smithi123.stdout:2/793: symlink d1a/d29/d42/d4e/l10a 0 2024-02-20T08:05:41.707 INFO:tasks.workunit.client.0.smithi123.stdout:1/646: write d3/de/d14/d26/d2e/d54/d5d/f99 [792798,12489] 0 2024-02-20T08:05:41.708 INFO:tasks.workunit.client.0.smithi123.stdout:2/794: fdatasync d1a/d29/d5d/d97/fb5 0 2024-02-20T08:05:41.709 INFO:tasks.workunit.client.0.smithi123.stdout:0/904: link d2/de/d1e/d1f/dc0/ddd/fea d2/de/d1e/d1f/dcb/f13f 0 2024-02-20T08:05:41.709 INFO:tasks.workunit.client.0.smithi123.stdout:2/795: chown d1a/d29 59238 1 2024-02-20T08:05:41.710 INFO:tasks.workunit.client.0.smithi123.stdout:0/905: write d2/de/d1e/d1f/f12e [847565,80146] 0 2024-02-20T08:05:41.711 INFO:tasks.workunit.client.0.smithi123.stdout:9/746: creat d6/d19/d1a/d2b/d28/d9a/d3d/fea x:0 0 0 2024-02-20T08:05:41.714 INFO:tasks.workunit.client.0.smithi123.stdout:8/705: fdatasync d6/f1a 0 2024-02-20T08:05:41.716 INFO:tasks.workunit.client.0.smithi123.stdout:7/728: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f72 [4194304,4194304] 0 2024-02-20T08:05:41.718 INFO:tasks.workunit.client.0.smithi123.stdout:7/729: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/fd7 [938068,45853] 0 2024-02-20T08:05:41.723 INFO:tasks.workunit.client.0.smithi123.stdout:0/906: truncate d2/dd/d4f/d61/f7d 114824 0 2024-02-20T08:05:41.728 INFO:tasks.workunit.client.0.smithi123.stdout:1/647: dwrite d3/de/d14/d36/d59/f89 [0,4194304] 0 2024-02-20T08:05:41.728 INFO:tasks.workunit.client.0.smithi123.stdout:2/796: read d1a/d29/d42/d52/d98/da1/deb/dd1/f100 [1292497,47876] 0 2024-02-20T08:05:41.730 INFO:tasks.workunit.client.0.smithi123.stdout:7/730: dwrite d0/d6/dd/d52/f3b [0,4194304] 0 2024-02-20T08:05:41.731 INFO:tasks.workunit.client.0.smithi123.stdout:3/803: rename d0/d6/d1a/d1b to d0/d6/d1a/d62/d115 0 2024-02-20T08:05:41.734 INFO:tasks.workunit.client.0.smithi123.stdout:7/731: stat d0/d6/dd/d52/l24 0 2024-02-20T08:05:41.738 INFO:tasks.workunit.client.0.smithi123.stdout:7/732: write d0/d6/dd/d52/d35/d9c/fe1 [30478,122402] 0 2024-02-20T08:05:41.738 INFO:tasks.workunit.client.0.smithi123.stdout:7/733: readlink d0/d6/dd/d52/l3e 0 2024-02-20T08:05:41.739 INFO:tasks.workunit.client.0.smithi123.stdout:4/757: getdents d3/d2c/d43/d26/d3e 0 2024-02-20T08:05:41.742 INFO:tasks.workunit.client.0.smithi123.stdout:9/747: creat d6/d19/d1a/d6d/d7e/d80/dcc/feb x:0 0 0 2024-02-20T08:05:41.745 INFO:tasks.workunit.client.0.smithi123.stdout:0/907: creat d2/dd/d4f/d61/d81/f140 x:0 0 0 2024-02-20T08:05:41.745 INFO:tasks.workunit.client.0.smithi123.stdout:2/797: rmdir d1a/d29/d42/d52/d98/dd6/dfa 39 2024-02-20T08:05:41.746 INFO:tasks.workunit.client.0.smithi123.stdout:0/908: chown d2/dd/d4f/d61/d68 2656117 1 2024-02-20T08:05:41.747 INFO:tasks.workunit.client.0.smithi123.stdout:5/717: rename d0/d34/d48/d56/dbb/d27/d4e/cc5 to d0/d34/d48/d56/dbb/d27/d4e/d91/cea 0 2024-02-20T08:05:41.748 INFO:tasks.workunit.client.0.smithi123.stdout:1/648: truncate d3/de/d14/d2c/d45/f8f 876438 0 2024-02-20T08:05:41.749 INFO:tasks.workunit.client.0.smithi123.stdout:1/649: chown d3/de/d14/l69 69 1 2024-02-20T08:05:41.750 INFO:tasks.workunit.client.0.smithi123.stdout:7/734: mkdir d0/db/de8/dfd 0 2024-02-20T08:05:41.751 INFO:tasks.workunit.client.0.smithi123.stdout:7/735: dread - d0/d6/ff3 zero size 2024-02-20T08:05:41.752 INFO:tasks.workunit.client.0.smithi123.stdout:4/758: chown d3/d2c/d43/d26/d3e/le8 3 1 2024-02-20T08:05:41.753 INFO:tasks.workunit.client.0.smithi123.stdout:5/718: dread d0/f19 [4194304,4194304] 0 2024-02-20T08:05:41.753 INFO:tasks.workunit.client.0.smithi123.stdout:9/748: fdatasync d6/d2a/d9d/f73 0 2024-02-20T08:05:41.756 INFO:tasks.workunit.client.0.smithi123.stdout:0/909: unlink d2/de/c16 0 2024-02-20T08:05:41.757 INFO:tasks.workunit.client.0.smithi123.stdout:0/910: readlink d2/de/d1e/d1f/dc0/ddd/le1 0 2024-02-20T08:05:41.761 INFO:tasks.workunit.client.0.smithi123.stdout:8/706: getdents d6/d32 0 2024-02-20T08:05:41.764 INFO:tasks.workunit.client.0.smithi123.stdout:3/804: dread d0/d6/d1a/d62/d115/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:41.771 INFO:tasks.workunit.client.0.smithi123.stdout:7/736: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/lfe 0 2024-02-20T08:05:41.772 INFO:tasks.workunit.client.0.smithi123.stdout:8/707: creat d6/d1c/d47/fee x:0 0 0 2024-02-20T08:05:41.775 INFO:tasks.workunit.client.0.smithi123.stdout:3/805: rename d0/d6/d32/cf4 to d0/d6/d1a/d4b/c116 0 2024-02-20T08:05:41.777 INFO:tasks.workunit.client.0.smithi123.stdout:0/911: dwrite d2/d54/d78/ff7 [0,4194304] 0 2024-02-20T08:05:41.777 INFO:tasks.workunit.client.0.smithi123.stdout:5/719: creat d0/d34/d48/d56/feb x:0 0 0 2024-02-20T08:05:41.779 INFO:tasks.workunit.client.0.smithi123.stdout:8/708: creat d6/d32/d95/fef x:0 0 0 2024-02-20T08:05:41.780 INFO:tasks.workunit.client.0.smithi123.stdout:4/759: link d3/d2c/d43/ldd d3/d2c/d43/lfd 0 2024-02-20T08:05:41.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/749: dwrite d6/d19/d1a/d31/f8f [0,4194304] 0 2024-02-20T08:05:41.786 INFO:tasks.workunit.client.0.smithi123.stdout:1/650: dwrite d3/db/d34/d74/fb8 [0,4194304] 0 2024-02-20T08:05:41.794 INFO:tasks.workunit.client.0.smithi123.stdout:8/709: dwrite d6/d32/d95/f38 [4194304,4194304] 0 2024-02-20T08:05:41.795 INFO:tasks.workunit.client.0.smithi123.stdout:5/720: symlink d0/d34/d48/lec 0 2024-02-20T08:05:41.797 INFO:tasks.workunit.client.0.smithi123.stdout:4/760: mknod d3/d18/d7d/d8b/d95/cfe 0 2024-02-20T08:05:41.802 INFO:tasks.workunit.client.0.smithi123.stdout:7/737: truncate d0/d6/d7/f4e 3220115 0 2024-02-20T08:05:41.804 INFO:tasks.workunit.client.0.smithi123.stdout:8/710: creat d6/dbd/d5b/d8f/ff0 x:0 0 0 2024-02-20T08:05:41.805 INFO:tasks.workunit.client.0.smithi123.stdout:0/912: dread d2/de/d1e/d1f/dc0/ff0 [0,4194304] 0 2024-02-20T08:05:41.806 INFO:tasks.workunit.client.0.smithi123.stdout:5/721: mkdir d0/d34/d48/d56/dbb/d27/d37/ded 0 2024-02-20T08:05:41.807 INFO:tasks.workunit.client.0.smithi123.stdout:8/711: truncate d6/dbd/d5b/d8f/ff0 420551 0 2024-02-20T08:05:41.808 INFO:tasks.workunit.client.0.smithi123.stdout:3/806: write d0/d6/d1a/d62/d115/d1c/d3b/d43/fcc [833922,584] 0 2024-02-20T08:05:41.811 INFO:tasks.workunit.client.0.smithi123.stdout:7/738: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca [0,4194304] 0 2024-02-20T08:05:41.813 INFO:tasks.workunit.client.0.smithi123.stdout:9/750: write d6/d19/d1a/d31/f75 [345155,52163] 0 2024-02-20T08:05:41.817 INFO:tasks.workunit.client.0.smithi123.stdout:3/807: dwrite d0/d6/d1a/d4b/fe4 [0,4194304] 0 2024-02-20T08:05:41.819 INFO:tasks.workunit.client.0.smithi123.stdout:7/739: creat d0/db/de8/fff x:0 0 0 2024-02-20T08:05:41.820 INFO:tasks.workunit.client.0.smithi123.stdout:4/761: rename d3/d2c/f40 to d3/d2c/d43/fff 0 2024-02-20T08:05:41.827 INFO:tasks.workunit.client.0.smithi123.stdout:7/740: creat d0/db/f100 x:0 0 0 2024-02-20T08:05:41.829 INFO:tasks.workunit.client.0.smithi123.stdout:8/712: rename d6/dbd/d5b/c5f to d6/d1c/d22/d8c/dcd/db9/cf1 0 2024-02-20T08:05:41.831 INFO:tasks.workunit.client.0.smithi123.stdout:4/762: mknod d3/d1e/d81/c100 0 2024-02-20T08:05:41.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/751: mknod d6/d2a/d27/d6f/d8b/de1/cec 0 2024-02-20T08:05:41.832 INFO:tasks.workunit.client.0.smithi123.stdout:5/722: write d0/fad [716404,41012] 0 2024-02-20T08:05:41.833 INFO:tasks.workunit.client.0.smithi123.stdout:3/808: rmdir d0/d6/d1a/d62/d115/d1c/d61 39 2024-02-20T08:05:41.834 INFO:tasks.workunit.client.0.smithi123.stdout:3/809: stat d0/d6/d34/fbe 0 2024-02-20T08:05:41.835 INFO:tasks.workunit.client.0.smithi123.stdout:0/913: truncate d2/de/d1e/f85 3296964 0 2024-02-20T08:05:41.836 INFO:tasks.workunit.client.0.smithi123.stdout:8/713: truncate d6/d32/fb4 602800 0 2024-02-20T08:05:41.838 INFO:tasks.workunit.client.0.smithi123.stdout:4/763: symlink d3/l101 0 2024-02-20T08:05:41.839 INFO:tasks.workunit.client.0.smithi123.stdout:5/723: symlink d0/d34/d67/lee 0 2024-02-20T08:05:41.845 INFO:tasks.workunit.client.0.smithi123.stdout:0/914: truncate d2/dd/fbb 334036 0 2024-02-20T08:05:41.846 INFO:tasks.workunit.client.0.smithi123.stdout:8/714: mknod d6/d32/d95/d3f/cf2 0 2024-02-20T08:05:41.847 INFO:tasks.workunit.client.0.smithi123.stdout:0/915: chown d2/de/d1e/d1f/dc0/ddd/le1 26797944 1 2024-02-20T08:05:41.849 INFO:tasks.workunit.client.0.smithi123.stdout:8/715: truncate d6/d1c/fe4 736744 0 2024-02-20T08:05:41.851 INFO:tasks.workunit.client.0.smithi123.stdout:3/810: dwrite d0/d6/d1a/d62/d115/d1c/d21/f29 [0,4194304] 0 2024-02-20T08:05:41.853 INFO:tasks.workunit.client.0.smithi123.stdout:9/752: link d6/d19/d1a/d31/f8f d6/d2a/d27/d3c/fed 0 2024-02-20T08:05:41.859 INFO:tasks.workunit.client.0.smithi123.stdout:5/724: creat d0/d34/d67/dda/fef x:0 0 0 2024-02-20T08:05:41.861 INFO:tasks.workunit.client.0.smithi123.stdout:0/916: mknod d2/dd/d4f/d7c/da4/db6/dfa/c141 0 2024-02-20T08:05:41.862 INFO:tasks.workunit.client.0.smithi123.stdout:7/741: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/fe6 [8993,23719] 0 2024-02-20T08:05:41.865 INFO:tasks.workunit.client.0.smithi123.stdout:8/716: unlink d6/d32/d95/f67 0 2024-02-20T08:05:41.865 INFO:tasks.workunit.client.0.smithi123.stdout:0/917: dread d2/dd/d4f/d7c/da4/ff6 [0,4194304] 0 2024-02-20T08:05:41.869 INFO:tasks.workunit.client.0.smithi123.stdout:9/753: symlink d6/d2a/d27/d3c/lee 0 2024-02-20T08:05:41.873 INFO:tasks.workunit.client.0.smithi123.stdout:4/764: chown d3/d2c/d43/d34/f7c 578903 1 2024-02-20T08:05:41.875 INFO:tasks.workunit.client.0.smithi123.stdout:7/742: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/d101 0 2024-02-20T08:05:41.877 INFO:tasks.workunit.client.0.smithi123.stdout:3/811: fsync d0/d6/d1a/d62/d115/d2a/d86/f113 0 2024-02-20T08:05:41.883 INFO:tasks.workunit.client.0.smithi123.stdout:4/765: write d3/d1e/fd1 [1161069,56125] 0 2024-02-20T08:05:41.889 INFO:tasks.workunit.client.0.smithi123.stdout:3/812: write d0/d6/d1a/d4b/f97 [4771005,127189] 0 2024-02-20T08:05:41.892 INFO:tasks.workunit.client.0.smithi123.stdout:4/766: symlink d3/d1e/d81/l102 0 2024-02-20T08:05:41.894 INFO:tasks.workunit.client.0.smithi123.stdout:4/767: write d3/d1e/f5b [1933807,38347] 0 2024-02-20T08:05:41.895 INFO:tasks.workunit.client.0.smithi123.stdout:9/754: creat d6/d19/d1a/d7c/fef x:0 0 0 2024-02-20T08:05:41.897 INFO:tasks.workunit.client.0.smithi123.stdout:9/755: stat d6/d19/d1a/d6d/d7e/d80/dcc 0 2024-02-20T08:05:41.898 INFO:tasks.workunit.client.0.smithi123.stdout:9/756: dread - d6/d19/d1a/d6d/d7e/fe2 zero size 2024-02-20T08:05:41.900 INFO:tasks.workunit.client.0.smithi123.stdout:7/743: rename d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/fa8 to d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/f102 0 2024-02-20T08:05:41.903 INFO:tasks.workunit.client.0.smithi123.stdout:7/744: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/fe6 [2163129,82527] 0 2024-02-20T08:05:41.903 INFO:tasks.workunit.client.0.smithi123.stdout:8/717: getdents d6/dbd/d5b/d8f 0 2024-02-20T08:05:41.906 INFO:tasks.workunit.client.0.smithi123.stdout:3/813: mknod d0/d6/d1a/d62/d115/c117 0 2024-02-20T08:05:41.909 INFO:tasks.workunit.client.0.smithi123.stdout:7/745: unlink d0/d6/dd/f96 0 2024-02-20T08:05:41.911 INFO:tasks.workunit.client.0.smithi123.stdout:4/768: mkdir d3/d2c/d5a/d103 0 2024-02-20T08:05:41.912 INFO:tasks.workunit.client.0.smithi123.stdout:3/814: dwrite d0/d6/d1a/d4b/d95/f10c [0,4194304] 0 2024-02-20T08:05:41.914 INFO:tasks.workunit.client.0.smithi123.stdout:8/718: creat d6/dbd/d5b/d8f/d99/dd2/ff3 x:0 0 0 2024-02-20T08:05:41.916 INFO:tasks.workunit.client.0.smithi123.stdout:4/769: read d3/d2c/d43/d26/d3e/da9/fc8 [1329386,3937] 0 2024-02-20T08:05:41.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/719: read d6/d32/d95/d7d/dab/fb8 [1461828,22756] 0 2024-02-20T08:05:41.926 INFO:tasks.workunit.client.0.smithi123.stdout:4/770: dwrite d3/d2c/d43/d26/f8f [0,4194304] 0 2024-02-20T08:05:41.928 INFO:tasks.workunit.client.0.smithi123.stdout:3/815: dread d0/d6/d1a/d62/d115/f22 [4194304,4194304] 0 2024-02-20T08:05:41.929 INFO:tasks.workunit.client.0.smithi123.stdout:3/816: fdatasync d0/d6/d1a/d4b/fe4 0 2024-02-20T08:05:41.932 INFO:tasks.workunit.client.0.smithi123.stdout:7/746: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f103 x:0 0 0 2024-02-20T08:05:41.936 INFO:tasks.workunit.client.0.smithi123.stdout:4/771: rmdir d3/d2c/d43/d26/d3e/da9/dd9/de6 39 2024-02-20T08:05:41.940 INFO:tasks.workunit.client.0.smithi123.stdout:7/747: mknod d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/d79/c104 0 2024-02-20T08:05:41.942 INFO:tasks.workunit.client.0.smithi123.stdout:8/720: dwrite d6/dbd/f7c [0,4194304] 0 2024-02-20T08:05:41.945 INFO:tasks.workunit.client.0.smithi123.stdout:4/772: rename d3/d2c/d43/d26/d2e/l6f to d3/l104 0 2024-02-20T08:05:41.948 INFO:tasks.workunit.client.0.smithi123.stdout:7/748: read d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f8f [3373078,99210] 0 2024-02-20T08:05:41.952 INFO:tasks.workunit.client.0.smithi123.stdout:7/749: dread d0/d6/dd/d52/d35/d9c/f56 [0,4194304] 0 2024-02-20T08:05:41.953 INFO:tasks.workunit.client.0.smithi123.stdout:8/721: creat d6/dbd/d5b/ff4 x:0 0 0 2024-02-20T08:05:41.955 INFO:tasks.workunit.client.0.smithi123.stdout:4/773: fsync d3/d2c/d43/d26/d2e/f39 0 2024-02-20T08:05:41.957 INFO:tasks.workunit.client.0.smithi123.stdout:7/750: dread d0/f64 [0,4194304] 0 2024-02-20T08:05:41.959 INFO:tasks.workunit.client.0.smithi123.stdout:3/817: dread d0/d6/d1a/d62/d115/f30 [0,4194304] 0 2024-02-20T08:05:41.959 INFO:tasks.workunit.client.0.smithi123.stdout:3/818: readlink d0/dd/d48/l59 0 2024-02-20T08:05:41.978 INFO:tasks.workunit.client.0.smithi123.stdout:4/774: creat d3/d18/f105 x:0 0 0 2024-02-20T08:05:41.978 INFO:tasks.workunit.client.0.smithi123.stdout:4/775: dread - d3/d2c/d5a/d7e/ff2 zero size 2024-02-20T08:05:41.980 INFO:tasks.workunit.client.0.smithi123.stdout:4/776: truncate d3/d2c/d43/d26/d3e/d8a/fea 996404 0 2024-02-20T08:05:41.981 INFO:tasks.workunit.client.0.smithi123.stdout:7/751: write d0/f7f [62703,121558] 0 2024-02-20T08:05:41.981 INFO:tasks.workunit.client.0.smithi123.stdout:3/819: write d0/d6/d1a/d62/d115/f30 [7201788,73030] 0 2024-02-20T08:05:41.981 INFO:tasks.workunit.client.0.smithi123.stdout:4/777: chown d3/d97/dda 1571 1 2024-02-20T08:05:41.984 INFO:tasks.workunit.client.0.smithi123.stdout:4/778: truncate d3/d2c/ff4 920117 0 2024-02-20T08:05:41.985 INFO:tasks.workunit.client.0.smithi123.stdout:3/820: creat d0/d6/d1a/d62/d115/db4/f118 x:0 0 0 2024-02-20T08:05:41.986 INFO:tasks.workunit.client.0.smithi123.stdout:4/779: write d3/d2c/d5a/f92 [3456275,13004] 0 2024-02-20T08:05:41.989 INFO:tasks.workunit.client.0.smithi123.stdout:7/752: dwrite d0/db/de8/fff [0,4194304] 0 2024-02-20T08:05:41.991 INFO:tasks.workunit.client.0.smithi123.stdout:7/753: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/fc0 203905 1 2024-02-20T08:05:41.995 INFO:tasks.workunit.client.0.smithi123.stdout:3/821: getdents d0/d6/d1a/d62/d115/d2a 0 2024-02-20T08:05:41.995 INFO:tasks.workunit.client.0.smithi123.stdout:3/822: readlink d0/dd/d48/l5d 0 2024-02-20T08:05:41.997 INFO:tasks.workunit.client.0.smithi123.stdout:7/754: creat d0/d6/dd/d52/d35/d9c/d70/dd9/f105 x:0 0 0 2024-02-20T08:05:42.000 INFO:tasks.workunit.client.0.smithi123.stdout:3/823: link d0/f8c d0/d6/d1a/d1e/f119 0 2024-02-20T08:05:42.001 INFO:tasks.workunit.client.0.smithi123.stdout:3/824: chown d0/la3 54919 1 2024-02-20T08:05:42.001 INFO:tasks.workunit.client.0.smithi123.stdout:7/755: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/l106 0 2024-02-20T08:05:42.003 INFO:tasks.workunit.client.0.smithi123.stdout:3/825: symlink d0/d6/d1a/d62/d115/db4/l11a 0 2024-02-20T08:05:42.003 INFO:tasks.workunit.client.0.smithi123.stdout:7/756: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/fd0 [3391953,82847] 0 2024-02-20T08:05:42.004 INFO:tasks.workunit.client.0.smithi123.stdout:3/826: chown d0/dd/d48/d8d/dcf/f105 795 1 2024-02-20T08:05:42.007 INFO:tasks.workunit.client.0.smithi123.stdout:7/757: truncate d0/d6/dd/d52/d35/f74 519497 0 2024-02-20T08:05:42.009 INFO:tasks.workunit.client.0.smithi123.stdout:3/827: creat d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f11b x:0 0 0 2024-02-20T08:05:42.011 INFO:tasks.workunit.client.0.smithi123.stdout:7/758: truncate d0/d6/dd/d52/d26/d7b/feb 1007449 0 2024-02-20T08:05:42.014 INFO:tasks.workunit.client.0.smithi123.stdout:3/828: mknod d0/d6/d1a/d62/d82/da2/c11c 0 2024-02-20T08:05:42.016 INFO:tasks.workunit.client.0.smithi123.stdout:7/759: mkdir d0/db/d21/d42/d107 0 2024-02-20T08:05:42.018 INFO:tasks.workunit.client.0.smithi123.stdout:7/760: stat d0/d6/dd/d52/d35/d9c/c54 0 2024-02-20T08:05:42.020 INFO:tasks.workunit.client.0.smithi123.stdout:7/761: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/l108 0 2024-02-20T08:05:42.021 INFO:tasks.workunit.client.0.smithi123.stdout:7/762: rmdir d0/d6/dd/d52/d35 39 2024-02-20T08:05:42.026 INFO:tasks.workunit.client.0.smithi123.stdout:7/763: rename d0/db/de8/dfd to d0/d6/dd/d109 0 2024-02-20T08:05:42.029 INFO:tasks.workunit.client.0.smithi123.stdout:7/764: truncate d0/d6/dd/d52/d35/d9c/fe1 415712 0 2024-02-20T08:05:42.031 INFO:tasks.workunit.client.0.smithi123.stdout:7/765: creat d0/d6/dd/d52/d26/f10a x:0 0 0 2024-02-20T08:05:42.032 INFO:tasks.workunit.client.0.smithi123.stdout:7/766: dread - d0/d6/dd/d52/d26/d7b/fa5 zero size 2024-02-20T08:05:42.034 INFO:tasks.workunit.client.0.smithi123.stdout:7/767: creat d0/db/f10b x:0 0 0 2024-02-20T08:05:42.038 INFO:tasks.workunit.client.0.smithi123.stdout:7/768: dread d0/d6/dd/d52/d35/d9c/d70/dd9/fc7 [0,4194304] 0 2024-02-20T08:05:42.039 INFO:tasks.workunit.client.0.smithi123.stdout:7/769: write d0/d6/d7/f20 [2767363,119723] 0 2024-02-20T08:05:42.042 INFO:tasks.workunit.client.0.smithi123.stdout:7/770: mkdir d0/d6/dd/d10c 0 2024-02-20T08:05:42.044 INFO:tasks.workunit.client.0.smithi123.stdout:7/771: symlink d0/db/d38/l10d 0 2024-02-20T08:05:42.045 INFO:tasks.workunit.client.0.smithi123.stdout:7/772: fdatasync d0/db/fa1 0 2024-02-20T08:05:42.046 INFO:tasks.workunit.client.0.smithi123.stdout:7/773: chown d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/l108 909191 1 2024-02-20T08:05:42.050 INFO:tasks.workunit.client.0.smithi123.stdout:7/774: rename d0/d6/dd/d52/l24 to d0/db/d21/l10e 0 2024-02-20T08:05:42.052 INFO:tasks.workunit.client.0.smithi123.stdout:7/775: chown d0/d6/l66 264 1 2024-02-20T08:05:42.058 INFO:tasks.workunit.client.0.smithi123.stdout:7/776: dwrite d0/db/fa1 [0,4194304] 0 2024-02-20T08:05:42.077 INFO:tasks.workunit.client.0.smithi123.stdout:7/777: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fec [0,4194304] 0 2024-02-20T08:05:42.083 INFO:tasks.workunit.client.0.smithi123.stdout:7/778: rename d0/d6/dd/d52/d35/d9c/d70/dd9/dd6 to d0/d6/dd/d52/d10f 0 2024-02-20T08:05:42.088 INFO:tasks.workunit.client.0.smithi123.stdout:7/779: unlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/d79/fc1 0 2024-02-20T08:05:42.095 INFO:tasks.workunit.client.0.smithi123.stdout:7/780: rename d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/fc0 to d0/d6/dd/d52/d35/f110 0 2024-02-20T08:05:42.099 INFO:tasks.workunit.client.0.smithi123.stdout:7/781: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d73/f111 x:0 0 0 2024-02-20T08:05:42.100 INFO:tasks.workunit.client.0.smithi123.stdout:7/782: chown d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/l108 13335926 1 2024-02-20T08:05:42.114 INFO:tasks.workunit.client.0.smithi123.stdout:7/783: dread d0/f4 [4194304,4194304] 0 2024-02-20T08:05:42.116 INFO:tasks.workunit.client.0.smithi123.stdout:7/784: symlink d0/d6/dd/d52/d26/d9b/d61/l112 0 2024-02-20T08:05:42.117 INFO:tasks.workunit.client.0.smithi123.stdout:7/785: write d0/d6/dd/d52/f51 [954014,35461] 0 2024-02-20T08:05:42.118 INFO:tasks.workunit.client.0.smithi123.stdout:7/786: write d0/db/de8/fff [40605,41652] 0 2024-02-20T08:05:42.122 INFO:tasks.workunit.client.0.smithi123.stdout:7/787: mkdir d0/db/d113 0 2024-02-20T08:05:42.130 INFO:tasks.workunit.client.0.smithi123.stdout:7/788: getdents d0/d6/dd/d52/d35/d9c/d70/dd9 0 2024-02-20T08:05:42.132 INFO:tasks.workunit.client.0.smithi123.stdout:7/789: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/l7c 953087 1 2024-02-20T08:05:42.146 INFO:tasks.workunit.client.0.smithi123.stdout:7/790: dwrite d0/f5 [0,4194304] 0 2024-02-20T08:05:42.152 INFO:tasks.workunit.client.0.smithi123.stdout:7/791: rename d0/db/de8/lee to d0/d6/dd/d52/d26/l114 0 2024-02-20T08:05:42.164 INFO:tasks.workunit.client.0.smithi123.stdout:7/792: write d0/d6/dd/f65 [1027149,128431] 0 2024-02-20T08:05:42.167 INFO:tasks.workunit.client.0.smithi123.stdout:7/793: dread - d0/d6/dd/d52/d35/d9c/fa7 zero size 2024-02-20T08:05:42.170 INFO:tasks.workunit.client.0.smithi123.stdout:7/794: creat d0/d6/dd/d52/d26/d9b/f115 x:0 0 0 2024-02-20T08:05:42.176 INFO:tasks.workunit.client.0.smithi123.stdout:7/795: truncate d0/db/de8/fff 2334879 0 2024-02-20T08:05:42.180 INFO:tasks.workunit.client.0.smithi123.stdout:7/796: link d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca d0/d6/dd/d97/f116 0 2024-02-20T08:05:42.182 INFO:tasks.workunit.client.0.smithi123.stdout:7/797: mknod d0/df4/c117 0 2024-02-20T08:05:42.185 INFO:tasks.workunit.client.0.smithi123.stdout:7/798: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/lb9 147051 1 2024-02-20T08:05:42.188 INFO:tasks.workunit.client.0.smithi123.stdout:7/799: creat d0/d6/dd/d52/d35/d9c/f118 x:0 0 0 2024-02-20T08:05:42.190 INFO:tasks.workunit.client.0.smithi123.stdout:7/800: mkdir d0/db/d113/d119 0 2024-02-20T08:05:42.194 INFO:tasks.workunit.client.0.smithi123.stdout:7/801: getdents d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2 0 2024-02-20T08:05:42.197 INFO:tasks.workunit.client.0.smithi123.stdout:7/802: unlink d0/d6/d7/d68/lbe 0 2024-02-20T08:05:42.204 INFO:tasks.workunit.client.0.smithi123.stdout:7/803: getdents d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d73 0 2024-02-20T08:05:42.210 INFO:tasks.workunit.client.0.smithi123.stdout:7/804: dwrite d0/d6/dd/d52/d26/fce [0,4194304] 0 2024-02-20T08:05:42.214 INFO:tasks.workunit.client.0.smithi123.stdout:7/805: rename d0/db/d21/c8c to d0/d6/dd/d52/d35/c11a 0 2024-02-20T08:05:42.234 INFO:tasks.workunit.client.0.smithi123.stdout:7/806: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f4f [0,4194304] 0 2024-02-20T08:05:42.238 INFO:tasks.workunit.client.0.smithi123.stdout:7/807: unlink d0/d6/cb0 0 2024-02-20T08:05:42.240 INFO:tasks.workunit.client.0.smithi123.stdout:7/808: symlink d0/l11b 0 2024-02-20T08:05:42.243 INFO:tasks.workunit.client.0.smithi123.stdout:7/809: symlink d0/db/d38/l11c 0 2024-02-20T08:05:42.245 INFO:tasks.workunit.client.0.smithi123.stdout:7/810: truncate d0/d6/dd/d52/d35/f110 1310896 0 2024-02-20T08:05:42.249 INFO:tasks.workunit.client.0.smithi123.stdout:7/811: creat d0/db/d38/f11d x:0 0 0 2024-02-20T08:05:42.252 INFO:tasks.workunit.client.0.smithi123.stdout:7/812: rename d0/d6/dd/d52/d35/d9c/d70/cdb to d0/df4/c11e 0 2024-02-20T08:05:42.254 INFO:tasks.workunit.client.0.smithi123.stdout:7/813: dread d0/db/fbf [0,4194304] 0 2024-02-20T08:05:42.256 INFO:tasks.workunit.client.0.smithi123.stdout:7/814: write d0/d6/dd/d52/d35/d9c/d70/dd9/f105 [686028,67334] 0 2024-02-20T08:05:42.257 INFO:tasks.workunit.client.0.smithi123.stdout:7/815: write d0/d6/dd/d52/d10f/ff9 [609060,93228] 0 2024-02-20T08:05:42.260 INFO:tasks.workunit.client.0.smithi123.stdout:7/816: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f 0 2024-02-20T08:05:42.263 INFO:tasks.workunit.client.0.smithi123.stdout:7/817: mknod d0/d6/dd/d52/d35/d9c/c120 0 2024-02-20T08:05:42.268 INFO:tasks.workunit.client.0.smithi123.stdout:7/818: dwrite d0/d6/dd/d52/d26/d7b/f7e [0,4194304] 0 2024-02-20T08:05:42.272 INFO:tasks.workunit.client.0.smithi123.stdout:7/819: mknod d0/d6/d29/df0/c121 0 2024-02-20T08:05:42.273 INFO:tasks.workunit.client.0.smithi123.stdout:7/820: write d0/db/f10b [1004518,39233] 0 2024-02-20T08:05:42.275 INFO:tasks.workunit.client.0.smithi123.stdout:7/821: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d 208560 1 2024-02-20T08:05:42.276 INFO:tasks.workunit.client.0.smithi123.stdout:7/822: write d0/d6/d29/fb2 [1039452,92780] 0 2024-02-20T08:05:42.302 INFO:tasks.workunit.client.0.smithi123.stdout:7/823: dread d0/d6/f57 [0,4194304] 0 2024-02-20T08:05:42.326 INFO:tasks.workunit.client.0.smithi123.stdout:7/824: dread d0/d6/dd/d52/d26/d9b/d61/f82 [0,4194304] 0 2024-02-20T08:05:42.345 INFO:tasks.workunit.client.0.smithi123.stdout:7/825: getdents d0/d6/d29/df0 0 2024-02-20T08:05:42.347 INFO:tasks.workunit.client.0.smithi123.stdout:7/826: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f103 [659699,81887] 0 2024-02-20T08:05:42.348 INFO:tasks.workunit.client.0.smithi123.stdout:7/827: chown d0/d6/dd/d52/d26/fce 76 1 2024-02-20T08:05:42.349 INFO:tasks.workunit.client.0.smithi123.stdout:7/828: write d0/d6/dd/d52/d26/d7b/fef [398448,27279] 0 2024-02-20T08:05:42.350 INFO:tasks.workunit.client.0.smithi123.stdout:7/829: stat d0/db/d38/l10d 0 2024-02-20T08:05:42.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:42 smithi194 ceph-mon[37804]: pgmap v40: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 112 MiB/s wr, 283 op/s 2024-02-20T08:05:42.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:42 smithi194 ceph-mon[37804]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:42.736 INFO:tasks.workunit.client.0.smithi123.stdout:1/651: sync 2024-02-20T08:05:42.737 INFO:tasks.workunit.client.0.smithi123.stdout:0/918: sync 2024-02-20T08:05:42.737 INFO:tasks.workunit.client.0.smithi123.stdout:2/798: sync 2024-02-20T08:05:42.737 INFO:tasks.workunit.client.0.smithi123.stdout:5/725: sync 2024-02-20T08:05:42.739 INFO:tasks.workunit.client.0.smithi123.stdout:5/726: read d0/d34/d48/d4b/d51/f72 [943250,102950] 0 2024-02-20T08:05:42.739 INFO:tasks.workunit.client.0.smithi123.stdout:1/652: rmdir d3/de/d14/d2c/d4f 39 2024-02-20T08:05:42.744 INFO:tasks.workunit.client.0.smithi123.stdout:2/799: symlink d1a/d29/l10b 0 2024-02-20T08:05:42.744 INFO:tasks.workunit.client.0.smithi123.stdout:0/919: dwrite d2/dd/d4f/d7c/da4/d28/fd7 [0,4194304] 0 2024-02-20T08:05:42.750 INFO:tasks.workunit.client.0.smithi123.stdout:2/800: readlink d1a/d29/d42/d4e/dbc/le1 0 2024-02-20T08:05:42.754 INFO:tasks.workunit.client.0.smithi123.stdout:1/653: mkdir d3/de/d14/d26/de3 0 2024-02-20T08:05:42.757 INFO:tasks.workunit.client.0.smithi123.stdout:2/801: creat d1a/d29/d5d/d97/da9/f10c x:0 0 0 2024-02-20T08:05:42.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:42 smithi123 ceph-mon[29383]: pgmap v40: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 112 MiB/s wr, 283 op/s 2024-02-20T08:05:42.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:42 smithi123 ceph-mon[29383]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:05:42.758 INFO:tasks.workunit.client.0.smithi123.stdout:2/802: write d1a/d29/d42/f45 [2057669,67860] 0 2024-02-20T08:05:42.763 INFO:tasks.workunit.client.0.smithi123.stdout:1/654: dread d3/de/d14/d26/d2e/d54/d5d/f99 [0,4194304] 0 2024-02-20T08:05:42.777 INFO:tasks.workunit.client.0.smithi123.stdout:1/655: dread d3/db/d41/f5e [0,4194304] 0 2024-02-20T08:05:42.779 INFO:tasks.workunit.client.0.smithi123.stdout:1/656: symlink d3/de/d14/d26/d2e/d54/d9f/le4 0 2024-02-20T08:05:42.781 INFO:tasks.workunit.client.0.smithi123.stdout:9/757: sync 2024-02-20T08:05:42.781 INFO:tasks.workunit.client.0.smithi123.stdout:8/722: sync 2024-02-20T08:05:42.782 INFO:tasks.workunit.client.0.smithi123.stdout:9/758: chown d6/d2a/d9d/f73 35 1 2024-02-20T08:05:42.782 INFO:tasks.workunit.client.0.smithi123.stdout:1/657: truncate d3/f10 1821455 0 2024-02-20T08:05:42.783 INFO:tasks.workunit.client.0.smithi123.stdout:8/723: creat d6/dbd/d5b/d8f/d99/dd2/ff5 x:0 0 0 2024-02-20T08:05:42.784 INFO:tasks.workunit.client.0.smithi123.stdout:9/759: read d6/d2a/d9d/f73 [2866140,111197] 0 2024-02-20T08:05:42.785 INFO:tasks.workunit.client.0.smithi123.stdout:1/658: truncate d3/de/d14/d36/f78 5004339 0 2024-02-20T08:05:42.787 INFO:tasks.workunit.client.0.smithi123.stdout:8/724: mkdir d6/d1c/d47/df6 0 2024-02-20T08:05:42.787 INFO:tasks.workunit.client.0.smithi123.stdout:8/725: chown d6/d32/d95/d7d/f8a 853 1 2024-02-20T08:05:42.788 INFO:tasks.workunit.client.0.smithi123.stdout:9/760: symlink d6/dbc/lf0 0 2024-02-20T08:05:42.789 INFO:tasks.workunit.client.0.smithi123.stdout:8/726: write d6/d32/fe2 [953123,6853] 0 2024-02-20T08:05:42.789 INFO:tasks.workunit.client.0.smithi123.stdout:1/659: mkdir d3/db/d41/de5 0 2024-02-20T08:05:42.790 INFO:tasks.workunit.client.0.smithi123.stdout:8/727: write d6/fe6 [468553,118145] 0 2024-02-20T08:05:42.793 INFO:tasks.workunit.client.0.smithi123.stdout:1/660: creat d3/de/d14/d36/fe6 x:0 0 0 2024-02-20T08:05:42.797 INFO:tasks.workunit.client.0.smithi123.stdout:9/761: getdents d6/d19/d1a/d6d/d7e/d80 0 2024-02-20T08:05:42.839 INFO:tasks.workunit.client.0.smithi123.stdout:5/727: truncate d0/d34/d48/d56/dbb/d27/d37/f8b 282600 0 2024-02-20T08:05:42.841 INFO:tasks.workunit.client.0.smithi123.stdout:2/803: write d1a/d29/f35 [4065768,90683] 0 2024-02-20T08:05:42.843 INFO:tasks.workunit.client.0.smithi123.stdout:0/920: dwrite d2/de/d1e/d1f/f20 [4194304,4194304] 0 2024-02-20T08:05:42.846 INFO:tasks.workunit.client.0.smithi123.stdout:0/921: write d2/d54/dac/f12f [935310,13506] 0 2024-02-20T08:05:42.850 INFO:tasks.workunit.client.0.smithi123.stdout:5/728: dwrite d0/d34/d48/d56/d4c/d43/f90 [4194304,4194304] 0 2024-02-20T08:05:42.855 INFO:tasks.workunit.client.0.smithi123.stdout:5/729: mkdir d0/d34/d48/d56/d4c/df0 0 2024-02-20T08:05:42.863 INFO:tasks.workunit.client.0.smithi123.stdout:5/730: fdatasync d0/d34/d48/d4b/f4f 0 2024-02-20T08:05:42.865 INFO:tasks.workunit.client.0.smithi123.stdout:0/922: dread d2/dd/f2f [0,4194304] 0 2024-02-20T08:05:42.867 INFO:tasks.workunit.client.0.smithi123.stdout:0/923: write d2/d3/d37/fc5 [2517786,111430] 0 2024-02-20T08:05:42.869 INFO:tasks.workunit.client.0.smithi123.stdout:0/924: write d2/de/d1e/d1f/d74/fa8 [3230088,63327] 0 2024-02-20T08:05:42.877 INFO:tasks.workunit.client.0.smithi123.stdout:0/925: dwrite d2/de/d1e/d1f/dc0/ddd/f102 [0,4194304] 0 2024-02-20T08:05:42.885 INFO:tasks.workunit.client.0.smithi123.stdout:0/926: creat d2/dd/d4f/d7c/da4/d28/f142 x:0 0 0 2024-02-20T08:05:42.885 INFO:tasks.workunit.client.0.smithi123.stdout:2/804: dwrite f15 [4194304,4194304] 0 2024-02-20T08:05:42.885 INFO:tasks.workunit.client.0.smithi123.stdout:1/661: dwrite d3/f10 [0,4194304] 0 2024-02-20T08:05:42.887 INFO:tasks.workunit.client.0.smithi123.stdout:2/805: chown d1a/d29/d42/d52/f7c 1160610 1 2024-02-20T08:05:42.896 INFO:tasks.workunit.client.0.smithi123.stdout:1/662: mkdir d3/de/d14/d26/d56/de7 0 2024-02-20T08:05:42.896 INFO:tasks.workunit.client.0.smithi123.stdout:1/663: chown d3/fab 796045 1 2024-02-20T08:05:42.897 INFO:tasks.workunit.client.0.smithi123.stdout:2/806: mkdir d1a/d29/d42/d52/d98/dd6/dfa/d10d 0 2024-02-20T08:05:42.900 INFO:tasks.workunit.client.0.smithi123.stdout:2/807: write d1a/d29/d42/d52/d98/da1/daa/dd0/ffc [470336,33414] 0 2024-02-20T08:05:42.902 INFO:tasks.workunit.client.0.smithi123.stdout:1/664: link d3/de/d14/d26/d2e/d54/d9f/le4 d3/le8 0 2024-02-20T08:05:42.903 INFO:tasks.workunit.client.0.smithi123.stdout:2/808: link f15 d1a/da5/f10e 0 2024-02-20T08:05:42.903 INFO:tasks.workunit.client.0.smithi123.stdout:2/809: readlink d1a/d29/l2c 0 2024-02-20T08:05:42.904 INFO:tasks.workunit.client.0.smithi123.stdout:1/665: symlink d3/de/d14/d26/d2e/d54/d5d/le9 0 2024-02-20T08:05:42.905 INFO:tasks.workunit.client.0.smithi123.stdout:2/810: creat d1a/d29/d5d/f10f x:0 0 0 2024-02-20T08:05:42.906 INFO:tasks.workunit.client.0.smithi123.stdout:2/811: readlink d1a/l6e 0 2024-02-20T08:05:42.910 INFO:tasks.workunit.client.0.smithi123.stdout:1/666: truncate d3/de/d14/d2c/d4f/f64 1985829 0 2024-02-20T08:05:42.911 INFO:tasks.workunit.client.0.smithi123.stdout:0/927: dwrite d2/de/d1e/d1f/dcb/f13f [0,4194304] 0 2024-02-20T08:05:42.911 INFO:tasks.workunit.client.0.smithi123.stdout:2/812: getdents d1a/d29/d42/dc8 0 2024-02-20T08:05:42.914 INFO:tasks.workunit.client.0.smithi123.stdout:0/928: unlink d2/de/f17 0 2024-02-20T08:05:42.917 INFO:tasks.workunit.client.0.smithi123.stdout:1/667: mknod d3/db/d34/d74/d6f/d63/cea 0 2024-02-20T08:05:42.919 INFO:tasks.workunit.client.0.smithi123.stdout:2/813: creat d1a/d29/d42/d52/d98/da1/deb/dd1/f110 x:0 0 0 2024-02-20T08:05:42.920 INFO:tasks.workunit.client.0.smithi123.stdout:1/668: truncate d3/f17 1545894 0 2024-02-20T08:05:42.922 INFO:tasks.workunit.client.0.smithi123.stdout:1/669: truncate d3/d47/f9c 879072 0 2024-02-20T08:05:42.926 INFO:tasks.workunit.client.0.smithi123.stdout:7/830: sync 2024-02-20T08:05:42.926 INFO:tasks.workunit.client.0.smithi123.stdout:4/780: sync 2024-02-20T08:05:42.926 INFO:tasks.workunit.client.0.smithi123.stdout:3/829: sync 2024-02-20T08:05:42.929 INFO:tasks.workunit.client.0.smithi123.stdout:3/830: dread - d0/d6/d1a/d62/d115/d1c/d21/d8e/fcb zero size 2024-02-20T08:05:42.937 INFO:tasks.workunit.client.0.smithi123.stdout:3/831: rename d0/d6/d1a/d62/d115/d57/dd0/daa/cc3 to d0/dd/d48/d8d/dcf/c11d 0 2024-02-20T08:05:42.939 INFO:tasks.workunit.client.0.smithi123.stdout:4/781: getdents d3/d97/dda 0 2024-02-20T08:05:42.940 INFO:tasks.workunit.client.0.smithi123.stdout:0/929: truncate d2/de/d1e/d1f/d74/fa8 1815380 0 2024-02-20T08:05:42.941 INFO:tasks.workunit.client.0.smithi123.stdout:1/670: write d3/db/d34/db4/fc4 [512327,3846] 0 2024-02-20T08:05:42.943 INFO:tasks.workunit.client.0.smithi123.stdout:7/831: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/f2b [2053513,76494] 0 2024-02-20T08:05:42.944 INFO:tasks.workunit.client.0.smithi123.stdout:0/930: mknod d2/dd/c143 0 2024-02-20T08:05:42.945 INFO:tasks.workunit.client.0.smithi123.stdout:4/782: mknod d3/d2c/c106 0 2024-02-20T08:05:42.957 INFO:tasks.workunit.client.0.smithi123.stdout:1/671: mkdir d3/de/d14/d26/d2e/deb 0 2024-02-20T08:05:42.959 INFO:tasks.workunit.client.0.smithi123.stdout:7/832: write d0/db/fbf [3390,79944] 0 2024-02-20T08:05:42.959 INFO:tasks.workunit.client.0.smithi123.stdout:4/783: readlink d3/d2c/d43/d26/l85 0 2024-02-20T08:05:42.959 INFO:tasks.workunit.client.0.smithi123.stdout:0/931: creat d2/de/d1e/d1f/d74/dec/f144 x:0 0 0 2024-02-20T08:05:42.960 INFO:tasks.workunit.client.0.smithi123.stdout:0/932: readlink d2/dd/d4f/lb9 0 2024-02-20T08:05:42.961 INFO:tasks.workunit.client.0.smithi123.stdout:1/672: unlink d3/f10 0 2024-02-20T08:05:42.962 INFO:tasks.workunit.client.0.smithi123.stdout:4/784: dread - d3/f99 zero size 2024-02-20T08:05:42.966 INFO:tasks.workunit.client.0.smithi123.stdout:1/673: unlink d3/de/d14/d26/d2e/d54/d5d/le9 0 2024-02-20T08:05:42.976 INFO:tasks.workunit.client.0.smithi123.stdout:4/785: dread d3/d2c/feb [4194304,4194304] 0 2024-02-20T08:05:42.977 INFO:tasks.workunit.client.0.smithi123.stdout:7/833: getdents d0/d6 0 2024-02-20T08:05:42.984 INFO:tasks.workunit.client.0.smithi123.stdout:7/834: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/ffc [0,4194304] 0 2024-02-20T08:05:42.991 INFO:tasks.workunit.client.0.smithi123.stdout:0/933: dwrite d2/de/f51 [0,4194304] 0 2024-02-20T08:05:42.993 INFO:tasks.workunit.client.0.smithi123.stdout:7/835: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/d122 0 2024-02-20T08:05:42.996 INFO:tasks.workunit.client.0.smithi123.stdout:1/674: write d3/db/d7f/fb0 [156594,93930] 0 2024-02-20T08:05:42.999 INFO:tasks.workunit.client.0.smithi123.stdout:0/934: unlink d2/de/d1e/d1f/d74/c124 0 2024-02-20T08:05:43.001 INFO:tasks.workunit.client.0.smithi123.stdout:4/786: write d3/d2c/d43/d26/d2e/fb8 [3951927,6711] 0 2024-02-20T08:05:43.004 INFO:tasks.workunit.client.0.smithi123.stdout:0/935: mknod d2/d3/d37/d9d/c145 0 2024-02-20T08:05:43.017 INFO:tasks.workunit.client.0.smithi123.stdout:0/936: write d2/dd/d4f/d7c/da4/db6/fce [109311,106370] 0 2024-02-20T08:05:43.019 INFO:tasks.workunit.client.0.smithi123.stdout:1/675: mkdir d3/de/d14/d2c/d45/dec 0 2024-02-20T08:05:43.021 INFO:tasks.workunit.client.0.smithi123.stdout:0/937: rmdir d2/d54/d78 39 2024-02-20T08:05:43.021 INFO:tasks.workunit.client.0.smithi123.stdout:7/836: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/f92 [0,4194304] 0 2024-02-20T08:05:43.023 INFO:tasks.workunit.client.0.smithi123.stdout:4/787: dwrite d3/d18/f31 [0,4194304] 0 2024-02-20T08:05:43.028 INFO:tasks.workunit.client.0.smithi123.stdout:4/788: mkdir d3/d2c/d43/d34/d107 0 2024-02-20T08:05:43.029 INFO:tasks.workunit.client.0.smithi123.stdout:1/676: creat d3/de/d14/d26/d2e/fed x:0 0 0 2024-02-20T08:05:43.029 INFO:tasks.workunit.client.0.smithi123.stdout:7/837: getdents d0/db/d113/d119 0 2024-02-20T08:05:43.031 INFO:tasks.workunit.client.0.smithi123.stdout:7/838: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca 0 2024-02-20T08:05:43.032 INFO:tasks.workunit.client.0.smithi123.stdout:4/789: symlink d3/d2c/d43/d26/d3e/da9/dd9/l108 0 2024-02-20T08:05:43.034 INFO:tasks.workunit.client.0.smithi123.stdout:1/677: mknod d3/db/d41/cee 0 2024-02-20T08:05:43.035 INFO:tasks.workunit.client.0.smithi123.stdout:1/678: readlink d3/de/d14/d36/l85 0 2024-02-20T08:05:43.036 INFO:tasks.workunit.client.0.smithi123.stdout:7/839: creat d0/db/d21/f123 x:0 0 0 2024-02-20T08:05:43.039 INFO:tasks.workunit.client.0.smithi123.stdout:1/679: creat d3/fef x:0 0 0 2024-02-20T08:05:43.040 INFO:tasks.workunit.client.0.smithi123.stdout:4/790: dwrite d3/d97/dda/db6/f9e [0,4194304] 0 2024-02-20T08:05:43.042 INFO:tasks.workunit.client.0.smithi123.stdout:4/791: dread d3/d2c/ff4 [0,4194304] 0 2024-02-20T08:05:43.043 INFO:tasks.workunit.client.0.smithi123.stdout:7/840: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d124 0 2024-02-20T08:05:43.047 INFO:tasks.workunit.client.0.smithi123.stdout:7/841: chown d0/d6/dd/d52/d26/fce 1069006 1 2024-02-20T08:05:43.048 INFO:tasks.workunit.client.0.smithi123.stdout:1/680: dwrite d3/db/d34/d74/f1e [0,4194304] 0 2024-02-20T08:05:43.056 INFO:tasks.workunit.client.0.smithi123.stdout:7/842: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/fd0 [0,4194304] 0 2024-02-20T08:05:43.057 INFO:tasks.workunit.client.0.smithi123.stdout:7/843: write d0/db/d21/f123 [590931,11364] 0 2024-02-20T08:05:43.058 INFO:tasks.workunit.client.0.smithi123.stdout:1/681: symlink d3/de/d14/d2c/d4f/lf0 0 2024-02-20T08:05:43.059 INFO:tasks.workunit.client.0.smithi123.stdout:4/792: link d3/f28 d3/d18/d7d/d8b/d95/f109 0 2024-02-20T08:05:43.060 INFO:tasks.workunit.client.0.smithi123.stdout:7/844: write d0/d6/dd/d52/d26/f10a [53713,116462] 0 2024-02-20T08:05:43.062 INFO:tasks.workunit.client.0.smithi123.stdout:1/682: truncate d3/de/d14/d2c/d4f/f57 4246537 0 2024-02-20T08:05:43.062 INFO:tasks.workunit.client.0.smithi123.stdout:0/938: dread d2/dd/d4f/d61/d68/f6c [0,4194304] 0 2024-02-20T08:05:43.064 INFO:tasks.workunit.client.0.smithi123.stdout:4/793: unlink d3/d18/d7d/d8b/la7 0 2024-02-20T08:05:43.068 INFO:tasks.workunit.client.0.smithi123.stdout:0/939: mkdir d2/dd/d4f/d7c/da4/db6/d146 0 2024-02-20T08:05:43.070 INFO:tasks.workunit.client.0.smithi123.stdout:4/794: write d3/d2c/ff4 [1738531,122430] 0 2024-02-20T08:05:43.073 INFO:tasks.workunit.client.0.smithi123.stdout:7/845: rename d0/db/d21/l10e to d0/d6/dd/d52/d10f/l125 0 2024-02-20T08:05:43.074 INFO:tasks.workunit.client.0.smithi123.stdout:1/683: symlink d3/de/d14/d2c/lf1 0 2024-02-20T08:05:43.077 INFO:tasks.workunit.client.0.smithi123.stdout:0/940: mkdir d2/dd/d4f/d7c/da4/d28/d147 0 2024-02-20T08:05:43.078 INFO:tasks.workunit.client.0.smithi123.stdout:4/795: mkdir d3/d2c/d43/d26/d3e/d8a/d10a 0 2024-02-20T08:05:43.078 INFO:tasks.workunit.client.0.smithi123.stdout:0/941: chown d2/dd/d4f/d7c/d82/ff8 290 1 2024-02-20T08:05:43.079 INFO:tasks.workunit.client.0.smithi123.stdout:7/846: rmdir d0/db/d21/d42 39 2024-02-20T08:05:43.087 INFO:tasks.workunit.client.0.smithi123.stdout:4/796: fsync d3/ff 0 2024-02-20T08:05:43.088 INFO:tasks.workunit.client.0.smithi123.stdout:7/847: symlink d0/d6/dd/d52/d26/d9b/d61/df7/l126 0 2024-02-20T08:05:43.089 INFO:tasks.workunit.client.0.smithi123.stdout:7/848: read - d0/d6/dd/d52/d35/fd2 zero size 2024-02-20T08:05:43.091 INFO:tasks.workunit.client.0.smithi123.stdout:1/684: dread d3/db/d34/d74/d6f/fba [0,4194304] 0 2024-02-20T08:05:43.092 INFO:tasks.workunit.client.0.smithi123.stdout:1/685: dread - d3/db/d34/d74/da1/fd1 zero size 2024-02-20T08:05:43.096 INFO:tasks.workunit.client.0.smithi123.stdout:0/942: getdents d2/dd/d4f/da7/d107 0 2024-02-20T08:05:43.099 INFO:tasks.workunit.client.0.smithi123.stdout:7/849: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f72 [4194304,4194304] 0 2024-02-20T08:05:43.100 INFO:tasks.workunit.client.0.smithi123.stdout:4/797: creat d3/d2c/d43/d26/f10b x:0 0 0 2024-02-20T08:05:43.101 INFO:tasks.workunit.client.0.smithi123.stdout:7/850: fsync d0/d6/dd/d52/f3b 0 2024-02-20T08:05:43.105 INFO:tasks.workunit.client.0.smithi123.stdout:1/686: creat d3/de/d14/d26/d56/de7/ff2 x:0 0 0 2024-02-20T08:05:43.108 INFO:tasks.workunit.client.0.smithi123.stdout:4/798: mknod d3/d2c/d43/d26/d3e/c10c 0 2024-02-20T08:05:43.110 INFO:tasks.workunit.client.0.smithi123.stdout:1/687: creat d3/de/d14/d26/d56/de7/ff3 x:0 0 0 2024-02-20T08:05:43.113 INFO:tasks.workunit.client.0.smithi123.stdout:4/799: unlink d3/d2c/d43/d34/cdb 0 2024-02-20T08:05:43.114 INFO:tasks.workunit.client.0.smithi123.stdout:1/688: mkdir d3/de/d14/d26/d2e/d54/d5d/df4 0 2024-02-20T08:05:43.116 INFO:tasks.workunit.client.0.smithi123.stdout:7/851: creat d0/d6/dd/d52/d26/f127 x:0 0 0 2024-02-20T08:05:43.116 INFO:tasks.workunit.client.0.smithi123.stdout:0/943: dwrite d2/dd/d4f/f91 [0,4194304] 0 2024-02-20T08:05:43.120 INFO:tasks.workunit.client.0.smithi123.stdout:7/852: rmdir d0/d6/dd/d52/d35/d9c/d70/dd9/dbc 39 2024-02-20T08:05:43.120 INFO:tasks.workunit.client.0.smithi123.stdout:4/800: creat d3/d1e/d81/f10d x:0 0 0 2024-02-20T08:05:43.120 INFO:tasks.workunit.client.0.smithi123.stdout:1/689: dread d3/db/f7e [0,4194304] 0 2024-02-20T08:05:43.123 INFO:tasks.workunit.client.0.smithi123.stdout:1/690: readlink d3/le8 0 2024-02-20T08:05:43.127 INFO:tasks.workunit.client.0.smithi123.stdout:7/853: mkdir d0/d6/dd/d52/d26/d7b/d128 0 2024-02-20T08:05:43.131 INFO:tasks.workunit.client.0.smithi123.stdout:4/801: symlink d3/d18/d7d/d8b/d95/dd7/l10e 0 2024-02-20T08:05:43.131 INFO:tasks.workunit.client.0.smithi123.stdout:4/802: stat d3/d1e/fc4 0 2024-02-20T08:05:43.132 INFO:tasks.workunit.client.0.smithi123.stdout:7/854: mknod d0/d6/d7/d68/c129 0 2024-02-20T08:05:43.133 INFO:tasks.workunit.client.0.smithi123.stdout:1/691: getdents d3/de/d14/d26/d2e/d54/d5d/df4 0 2024-02-20T08:05:43.133 INFO:tasks.workunit.client.0.smithi123.stdout:7/855: chown d0/db/lea 52216 1 2024-02-20T08:05:43.135 INFO:tasks.workunit.client.0.smithi123.stdout:4/803: mknod d3/d1e/d81/c10f 0 2024-02-20T08:05:43.136 INFO:tasks.workunit.client.0.smithi123.stdout:4/804: fsync d3/d1e/d81/f10d 0 2024-02-20T08:05:43.139 INFO:tasks.workunit.client.0.smithi123.stdout:0/944: truncate d2/de/d1e/d1f/dc0/ddd/fea 2228954 0 2024-02-20T08:05:43.140 INFO:tasks.workunit.client.0.smithi123.stdout:7/856: dwrite d0/fdf [0,4194304] 0 2024-02-20T08:05:43.141 INFO:tasks.workunit.client.0.smithi123.stdout:0/945: chown d2/dd/d4f/d7c/da4/f45 530156307 1 2024-02-20T08:05:43.141 INFO:tasks.workunit.client.0.smithi123.stdout:4/805: mkdir d3/d2c/d43/d34/d110 0 2024-02-20T08:05:43.144 INFO:tasks.workunit.client.0.smithi123.stdout:4/806: mkdir d3/d97/d111 0 2024-02-20T08:05:43.149 INFO:tasks.workunit.client.0.smithi123.stdout:0/946: dwrite d2/dd/d4f/d61/d81/df5/f138 [0,4194304] 0 2024-02-20T08:05:43.151 INFO:tasks.workunit.client.0.smithi123.stdout:1/692: dwrite d3/de/d14/d2c/d4f/fc6 [0,4194304] 0 2024-02-20T08:05:43.173 INFO:tasks.workunit.client.0.smithi123.stdout:0/947: truncate d2/de/d1e/d1f/d74/f109 979235 0 2024-02-20T08:05:43.178 INFO:tasks.workunit.client.0.smithi123.stdout:0/948: getdents d2/dd5 0 2024-02-20T08:05:43.179 INFO:tasks.workunit.client.0.smithi123.stdout:0/949: chown d2/dd/d4f/f91 6969826 1 2024-02-20T08:05:43.182 INFO:tasks.workunit.client.0.smithi123.stdout:0/950: mkdir d2/de/dd9/d148 0 2024-02-20T08:05:43.183 INFO:tasks.workunit.client.0.smithi123.stdout:1/693: dread d3/de/d14/d36/f78 [0,4194304] 0 2024-02-20T08:05:43.188 INFO:tasks.workunit.client.0.smithi123.stdout:0/951: mknod d2/dd/d4f/d61/d68/dfb/d13e/c149 0 2024-02-20T08:05:43.188 INFO:tasks.workunit.client.0.smithi123.stdout:0/952: fsync d2/dd/d4f/d6a/fb4 0 2024-02-20T08:05:43.192 INFO:tasks.workunit.client.0.smithi123.stdout:1/694: write d3/db/f21 [1516046,9752] 0 2024-02-20T08:05:43.193 INFO:tasks.workunit.client.0.smithi123.stdout:0/953: dread d2/de/d1e/d1f/dcb/fd0 [0,4194304] 0 2024-02-20T08:05:43.195 INFO:tasks.workunit.client.0.smithi123.stdout:1/695: read d3/de/d14/d26/fa4 [3349865,21804] 0 2024-02-20T08:05:43.200 INFO:tasks.workunit.client.0.smithi123.stdout:1/696: truncate d3/f1d 4130151 0 2024-02-20T08:05:43.203 INFO:tasks.workunit.client.0.smithi123.stdout:1/697: write d3/db/fc1 [1956611,112007] 0 2024-02-20T08:05:43.204 INFO:tasks.workunit.client.0.smithi123.stdout:0/954: getdents d2/de/d1e/d1f/dc0 0 2024-02-20T08:05:43.205 INFO:tasks.workunit.client.0.smithi123.stdout:1/698: read d3/de/d14/d26/d2e/d54/d5d/f99 [7558,25769] 0 2024-02-20T08:05:43.209 INFO:tasks.workunit.client.0.smithi123.stdout:0/955: mkdir d2/de/d1e/d84/d14a 0 2024-02-20T08:05:43.216 INFO:tasks.workunit.client.0.smithi123.stdout:1/699: dwrite d3/de/d14/d2c/d4f/fc9 [0,4194304] 0 2024-02-20T08:05:43.222 INFO:tasks.workunit.client.0.smithi123.stdout:0/956: dwrite d2/de/d1e/d84/f99 [4194304,4194304] 0 2024-02-20T08:05:43.224 INFO:tasks.workunit.client.0.smithi123.stdout:0/957: write d2/dd/f12a [1461906,100116] 0 2024-02-20T08:05:43.225 INFO:tasks.workunit.client.0.smithi123.stdout:1/700: dwrite d3/de/d14/d2c/d4f/fc6 [0,4194304] 0 2024-02-20T08:05:43.232 INFO:tasks.workunit.client.0.smithi123.stdout:1/701: rename d3/de/d14/d26/d2e/d54/d5d/fdd to d3/de/d14/d2c/d4f/ff5 0 2024-02-20T08:05:43.236 INFO:tasks.workunit.client.0.smithi123.stdout:1/702: creat d3/de/d14/d2c/d45/d9d/ff6 x:0 0 0 2024-02-20T08:05:43.251 INFO:tasks.workunit.client.0.smithi123.stdout:0/958: truncate d2/f12 2204292 0 2024-02-20T08:05:43.256 INFO:tasks.workunit.client.0.smithi123.stdout:8/728: sync 2024-02-20T08:05:43.258 INFO:tasks.workunit.client.0.smithi123.stdout:8/729: stat d6/d32/d95/c4c 0 2024-02-20T08:05:43.275 INFO:tasks.workunit.client.0.smithi123.stdout:8/730: dread d6/d1c/d22/d8c/dcd/f44 [0,4194304] 0 2024-02-20T08:05:43.279 INFO:tasks.workunit.client.0.smithi123.stdout:8/731: truncate d6/d32/fb4 970039 0 2024-02-20T08:05:43.281 INFO:tasks.workunit.client.0.smithi123.stdout:8/732: mknod d6/dbd/d5b/d8f/cf7 0 2024-02-20T08:05:43.329 INFO:tasks.workunit.client.0.smithi123.stdout:8/733: getdents d6/dbd/d7e 0 2024-02-20T08:05:43.334 INFO:tasks.workunit.client.0.smithi123.stdout:8/734: link d6/d32/d95/l41 d6/d32/d95/d7d/lf8 0 2024-02-20T08:05:43.337 INFO:tasks.workunit.client.0.smithi123.stdout:8/735: creat d6/d1c/ff9 x:0 0 0 2024-02-20T08:05:43.339 INFO:tasks.workunit.client.0.smithi123.stdout:8/736: symlink d6/dbd/d5b/d8f/d99/dd2/lfa 0 2024-02-20T08:05:43.343 INFO:tasks.workunit.client.0.smithi123.stdout:8/737: getdents d6/d32/d95/db0 0 2024-02-20T08:05:43.346 INFO:tasks.workunit.client.0.smithi123.stdout:8/738: mkdir d6/dbd/d5b/d8f/d99/dfb 0 2024-02-20T08:05:43.349 INFO:tasks.workunit.client.0.smithi123.stdout:8/739: mknod d6/d32/d95/cfc 0 2024-02-20T08:05:43.488 INFO:tasks.workunit.client.0.smithi123.stdout:9/762: sync 2024-02-20T08:05:43.489 INFO:tasks.workunit.client.0.smithi123.stdout:9/763: write d6/d19/d1a/d6d/d7e/fac [426005,92192] 0 2024-02-20T08:05:43.490 INFO:tasks.workunit.client.0.smithi123.stdout:9/764: chown d6/d2a/f17 1465811 1 2024-02-20T08:05:43.505 INFO:tasks.workunit.client.0.smithi123.stdout:9/765: dread d6/d19/d1a/d31/f8f [0,4194304] 0 2024-02-20T08:05:43.506 INFO:tasks.workunit.client.0.smithi123.stdout:9/766: fdatasync d6/d19/d1a/d31/f75 0 2024-02-20T08:05:43.507 INFO:tasks.workunit.client.0.smithi123.stdout:9/767: chown d6/d19/d1a/f6a 0 1 2024-02-20T08:05:43.564 INFO:tasks.workunit.client.0.smithi123.stdout:5/731: sync 2024-02-20T08:05:43.580 INFO:tasks.workunit.client.0.smithi123.stdout:5/732: creat d0/ff1 x:0 0 0 2024-02-20T08:05:43.583 INFO:tasks.workunit.client.0.smithi123.stdout:5/733: mknod d0/d34/d67/d80/d84/cf2 0 2024-02-20T08:05:43.586 INFO:tasks.workunit.client.0.smithi123.stdout:5/734: creat d0/d34/d48/d56/d3e/ddf/ff3 x:0 0 0 2024-02-20T08:05:43.591 INFO:tasks.workunit.client.0.smithi123.stdout:5/735: getdents d0/d34/d48/d56/dbb/d27/d4e/d91 0 2024-02-20T08:05:43.593 INFO:tasks.workunit.client.0.smithi123.stdout:5/736: chown d0/d34/d48/d56/d4c/d43/f90 10595 1 2024-02-20T08:05:43.614 INFO:tasks.workunit.client.0.smithi123.stdout:3/832: sync 2024-02-20T08:05:43.614 INFO:tasks.workunit.client.0.smithi123.stdout:0/959: sync 2024-02-20T08:05:43.614 INFO:tasks.workunit.client.0.smithi123.stdout:1/703: sync 2024-02-20T08:05:43.614 INFO:tasks.workunit.client.0.smithi123.stdout:4/807: sync 2024-02-20T08:05:43.615 INFO:tasks.workunit.client.0.smithi123.stdout:7/857: sync 2024-02-20T08:05:43.615 INFO:tasks.workunit.client.0.smithi123.stdout:2/814: sync 2024-02-20T08:05:43.615 INFO:tasks.workunit.client.0.smithi123.stdout:8/740: sync 2024-02-20T08:05:43.616 INFO:tasks.workunit.client.0.smithi123.stdout:2/815: chown d1a/d29/d42/d4e/c93 6580406 1 2024-02-20T08:05:43.618 INFO:tasks.workunit.client.0.smithi123.stdout:7/858: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f72 [9157595,114248] 0 2024-02-20T08:05:43.618 INFO:tasks.workunit.client.0.smithi123.stdout:2/816: stat d1a/d29/d5d/lf2 0 2024-02-20T08:05:43.622 INFO:tasks.workunit.client.0.smithi123.stdout:0/960: dread d2/de/d1e/d84/f99 [4194304,4194304] 0 2024-02-20T08:05:43.623 INFO:tasks.workunit.client.0.smithi123.stdout:3/833: creat d0/d6/d1a/d62/d115/d9d/f11e x:0 0 0 2024-02-20T08:05:43.624 INFO:tasks.workunit.client.0.smithi123.stdout:1/704: dread d3/db/f4e [0,4194304] 0 2024-02-20T08:05:43.629 INFO:tasks.workunit.client.0.smithi123.stdout:2/817: mkdir d1a/d29/d42/d73/d8f/d111 0 2024-02-20T08:05:43.631 INFO:tasks.workunit.client.0.smithi123.stdout:0/961: mkdir d2/dd/d4f/d61/d68/dfb/d14b 0 2024-02-20T08:05:43.635 INFO:tasks.workunit.client.0.smithi123.stdout:7/859: creat d0/db/d21/d42/f12a x:0 0 0 2024-02-20T08:05:43.637 INFO:tasks.workunit.client.0.smithi123.stdout:3/834: mknod d0/dd/d48/d6a/d107/c11f 0 2024-02-20T08:05:43.640 INFO:tasks.workunit.client.0.smithi123.stdout:0/962: rename d2/de/d1e/l62 to d2/dd/d4f/d7c/da4/l14c 0 2024-02-20T08:05:43.641 INFO:tasks.workunit.client.0.smithi123.stdout:1/705: symlink d3/de/d14/d26/lf7 0 2024-02-20T08:05:43.644 INFO:tasks.workunit.client.0.smithi123.stdout:7/860: rmdir d0/d6/d7/d68 39 2024-02-20T08:05:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:43 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:43.655 INFO:tasks.workunit.client.0.smithi123.stdout:7/861: rename d0/db/d113 to d0/d6/dd/d52/d35/d9c/d70/dd9/d12b 0 2024-02-20T08:05:43.657 INFO:tasks.workunit.client.0.smithi123.stdout:3/835: getdents d0/d6/d1a/d4b 0 2024-02-20T08:05:43.660 INFO:tasks.workunit.client.0.smithi123.stdout:0/963: dread d2/f8 [0,4194304] 0 2024-02-20T08:05:43.661 INFO:tasks.workunit.client.0.smithi123.stdout:7/862: symlink d0/d6/dd/d10c/l12c 0 2024-02-20T08:05:43.662 INFO:tasks.workunit.client.0.smithi123.stdout:9/768: dwrite d6/d19/d1a/d2b/d65/d77/fca [0,4194304] 0 2024-02-20T08:05:43.664 INFO:tasks.workunit.client.0.smithi123.stdout:7/863: write d0/d6/d7/f16 [1025056,103324] 0 2024-02-20T08:05:43.665 INFO:tasks.workunit.client.0.smithi123.stdout:9/769: dread - d6/d19/d1a/d2b/d28/d9a/d3d/fa7 zero size 2024-02-20T08:05:43.669 INFO:tasks.workunit.client.0.smithi123.stdout:7/864: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/f102 0 2024-02-20T08:05:43.671 INFO:tasks.workunit.client.0.smithi123.stdout:3/836: rename d0/d6/d1a/d62/d115/d1c/d20/fb6 to d0/d6/d1a/d62/d115/d1c/d21/dd9/f120 0 2024-02-20T08:05:43.675 INFO:tasks.workunit.client.0.smithi123.stdout:7/865: rename d0/d6/dd/d52/l3e to d0/d6/dd/d52/d26/d7b/l12d 0 2024-02-20T08:05:43.676 INFO:tasks.workunit.client.0.smithi123.stdout:9/770: getdents d6/d19/d1a/d2b/d65/d77/da5/ddd 0 2024-02-20T08:05:43.679 INFO:tasks.workunit.client.0.smithi123.stdout:5/737: dwrite d0/f9d [0,4194304] 0 2024-02-20T08:05:43.680 INFO:tasks.workunit.client.0.smithi123.stdout:3/837: dwrite d0/f10d [0,4194304] 0 2024-02-20T08:05:43.682 INFO:tasks.workunit.client.0.smithi123.stdout:7/866: fdatasync d0/d6/dd/d52/d26/d9b/d61/f82 0 2024-02-20T08:05:43.684 INFO:tasks.workunit.client.0.smithi123.stdout:9/771: symlink d6/d2a/lf1 0 2024-02-20T08:05:43.688 INFO:tasks.workunit.client.0.smithi123.stdout:9/772: symlink d6/lf2 0 2024-02-20T08:05:43.689 INFO:tasks.workunit.client.0.smithi123.stdout:4/808: write d3/f99 [494604,122296] 0 2024-02-20T08:05:43.691 INFO:tasks.workunit.client.0.smithi123.stdout:9/773: dread - d6/d2a/d27/d3c/dce/fe7 zero size 2024-02-20T08:05:43.697 INFO:tasks.workunit.client.0.smithi123.stdout:4/809: dread d3/d18/f31 [0,4194304] 0 2024-02-20T08:05:43.699 INFO:tasks.workunit.client.0.smithi123.stdout:5/738: getdents d0/d34/d48/d56/d4c/d43/dd2 0 2024-02-20T08:05:43.700 INFO:tasks.workunit.client.0.smithi123.stdout:3/838: dwrite d0/d6/d1a/d62/d115/d1c/d61/f96 [0,4194304] 0 2024-02-20T08:05:43.706 INFO:tasks.workunit.client.0.smithi123.stdout:7/867: creat d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f/f12e x:0 0 0 2024-02-20T08:05:43.708 INFO:tasks.workunit.client.0.smithi123.stdout:8/741: dwrite d6/d1c/d47/f59 [0,4194304] 0 2024-02-20T08:05:43.709 INFO:tasks.workunit.client.0.smithi123.stdout:4/810: unlink d3/d18/d7d/d8b/d95/dd7/l10e 0 2024-02-20T08:05:43.713 INFO:tasks.workunit.client.0.smithi123.stdout:5/739: creat d0/d34/d67/dda/ff4 x:0 0 0 2024-02-20T08:05:43.715 INFO:tasks.workunit.client.0.smithi123.stdout:8/742: chown d6/l91 26369349 1 2024-02-20T08:05:43.718 INFO:tasks.workunit.client.0.smithi123.stdout:9/774: rmdir d6/d19/d1a/d2b/d65/d77/da5/ddd 0 2024-02-20T08:05:43.721 INFO:tasks.workunit.client.0.smithi123.stdout:5/740: readlink d0/l5 0 2024-02-20T08:05:43.722 INFO:tasks.workunit.client.0.smithi123.stdout:3/839: getdents d0/d6/d1a/d62/d115/d2a/d86/d10e 0 2024-02-20T08:05:43.722 INFO:tasks.workunit.client.0.smithi123.stdout:1/706: write d3/de/d14/d26/d2e/d54/fa7 [4383494,49099] 0 2024-02-20T08:05:43.722 INFO:tasks.workunit.client.0.smithi123.stdout:4/811: rmdir d3/d2c/d43/d26 39 2024-02-20T08:05:43.723 INFO:tasks.workunit.client.0.smithi123.stdout:2/818: dwrite d1a/d29/d42/d52/d98/fc0 [0,4194304] 0 2024-02-20T08:05:43.724 INFO:tasks.workunit.client.0.smithi123.stdout:7/868: dwrite d0/d6/ff3 [0,4194304] 0 2024-02-20T08:05:43.726 INFO:tasks.workunit.client.0.smithi123.stdout:8/743: truncate d6/dbd/d5b/d8f/d98/f9b 8943709 0 2024-02-20T08:05:43.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/775: mknod d6/d19/d1a/d2b/d28/d9a/d3d/d32/cf3 0 2024-02-20T08:05:43.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:43 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:43.792 INFO:tasks.workunit.client.0.smithi123.stdout:7/869: rename d0/l11b to d0/d6/dd/d52/d26/d9b/d9a/l12f 0 2024-02-20T08:05:43.799 INFO:tasks.workunit.client.0.smithi123.stdout:0/964: dwrite d2/de/d1e/d1f/dcb/f10a [0,4194304] 0 2024-02-20T08:05:43.800 INFO:tasks.workunit.client.0.smithi123.stdout:8/744: rename d6/dbd/d7e/fc8 to d6/d32/d95/d7d/ffd 0 2024-02-20T08:05:43.800 INFO:tasks.workunit.client.0.smithi123.stdout:5/741: write d0/d34/d48/d56/d25/f5f [966574,113926] 0 2024-02-20T08:05:43.803 INFO:tasks.workunit.client.0.smithi123.stdout:4/812: dwrite d3/d18/f23 [4194304,4194304] 0 2024-02-20T08:05:43.804 INFO:tasks.workunit.client.0.smithi123.stdout:8/745: write d6/d1c/d22/f6b [3890130,103265] 0 2024-02-20T08:05:43.808 INFO:tasks.workunit.client.0.smithi123.stdout:9/776: dwrite d6/d2a/d27/f2f [0,4194304] 0 2024-02-20T08:05:43.811 INFO:tasks.workunit.client.0.smithi123.stdout:3/840: dread d0/d6/d1a/d1e/f42 [0,4194304] 0 2024-02-20T08:05:43.811 INFO:tasks.workunit.client.0.smithi123.stdout:5/742: fdatasync d0/d34/d48/d56/dbb/d27/d37/fca 0 2024-02-20T08:05:43.812 INFO:tasks.workunit.client.0.smithi123.stdout:8/746: write d6/fb [4547171,84257] 0 2024-02-20T08:05:43.814 INFO:tasks.workunit.client.0.smithi123.stdout:5/743: fdatasync d0/d34/d67/fbe 0 2024-02-20T08:05:43.815 INFO:tasks.workunit.client.0.smithi123.stdout:7/870: mknod d0/d6/dd/d52/d35/d9c/c130 0 2024-02-20T08:05:43.816 INFO:tasks.workunit.client.0.smithi123.stdout:4/813: read d3/ff [5614006,64597] 0 2024-02-20T08:05:43.818 INFO:tasks.workunit.client.0.smithi123.stdout:1/707: rename d3/de/d14/d26/d2e/d54/fdb to d3/de/d14/d2c/d4f/ff8 0 2024-02-20T08:05:43.821 INFO:tasks.workunit.client.0.smithi123.stdout:3/841: mkdir d0/d6/d1a/d62/d115/d1c/d3b/d43/d121 0 2024-02-20T08:05:43.823 INFO:tasks.workunit.client.0.smithi123.stdout:9/777: mkdir d6/d19/d1a/d6d/d7e/d80/dcc/df4 0 2024-02-20T08:05:43.824 INFO:tasks.workunit.client.0.smithi123.stdout:7/871: dwrite d0/db/f10b [0,4194304] 0 2024-02-20T08:05:43.834 INFO:tasks.workunit.client.0.smithi123.stdout:7/872: dwrite d0/d6/dd/d52/d26/d7b/ff6 [0,4194304] 0 2024-02-20T08:05:43.841 INFO:tasks.workunit.client.0.smithi123.stdout:1/708: creat d3/db/d41/de5/ff9 x:0 0 0 2024-02-20T08:05:43.844 INFO:tasks.workunit.client.0.smithi123.stdout:4/814: dread d3/d2c/d43/d26/d2e/f7f [0,4194304] 0 2024-02-20T08:05:43.845 INFO:tasks.workunit.client.0.smithi123.stdout:0/965: write d2/dd/d4f/d7c/d82/f108 [692029,40913] 0 2024-02-20T08:05:43.853 INFO:tasks.workunit.client.0.smithi123.stdout:3/842: write d0/d6/d1a/d62/d115/d1c/d3b/fcd [1326532,32373] 0 2024-02-20T08:05:43.855 INFO:tasks.workunit.client.0.smithi123.stdout:1/709: symlink d3/de/d14/d2c/d4f/dcc/lfa 0 2024-02-20T08:05:43.857 INFO:tasks.workunit.client.0.smithi123.stdout:9/778: dread d6/d19/d1a/d6d/f6e [0,4194304] 0 2024-02-20T08:05:43.857 INFO:tasks.workunit.client.0.smithi123.stdout:5/744: dwrite d0/d34/d48/d56/dbb/d27/d4e/d9b/fb5 [0,4194304] 0 2024-02-20T08:05:43.858 INFO:tasks.workunit.client.0.smithi123.stdout:0/966: dwrite d2/de/d1e/d1f/d74/dec/f144 [0,4194304] 0 2024-02-20T08:05:43.860 INFO:tasks.workunit.client.0.smithi123.stdout:4/815: mknod d3/d2c/d43/d26/d3e/d8a/d10a/c112 0 2024-02-20T08:05:43.864 INFO:tasks.workunit.client.0.smithi123.stdout:0/967: chown d2/dd/d4f/l65 207 1 2024-02-20T08:05:43.866 INFO:tasks.workunit.client.0.smithi123.stdout:4/816: stat d3/d2c/d43/d26/d2e/fee 0 2024-02-20T08:05:43.866 INFO:tasks.workunit.client.0.smithi123.stdout:3/843: rename d0/d6/d1a/d62/d115/db4/l11a to d0/d6/d1a/d62/d115/de3/l122 0 2024-02-20T08:05:43.870 INFO:tasks.workunit.client.0.smithi123.stdout:4/817: stat d3/d2c/d43/d26/d3e/ff7 0 2024-02-20T08:05:43.871 INFO:tasks.workunit.client.0.smithi123.stdout:1/710: truncate d3/de/d14/d26/d2e/f77 631358 0 2024-02-20T08:05:43.872 INFO:tasks.workunit.client.0.smithi123.stdout:9/779: dwrite d6/d19/f34 [0,4194304] 0 2024-02-20T08:05:43.873 INFO:tasks.workunit.client.0.smithi123.stdout:7/873: dwrite d0/db/de8/fff [0,4194304] 0 2024-02-20T08:05:43.873 INFO:tasks.workunit.client.0.smithi123.stdout:3/844: unlink d0/d6/d1a/d1e/c6e 0 2024-02-20T08:05:43.874 INFO:tasks.workunit.client.0.smithi123.stdout:5/745: dread d0/d34/d48/d56/d4c/d43/f90 [4194304,4194304] 0 2024-02-20T08:05:43.876 INFO:tasks.workunit.client.0.smithi123.stdout:1/711: mkdir d3/de/dfb 0 2024-02-20T08:05:43.878 INFO:tasks.workunit.client.0.smithi123.stdout:4/818: fdatasync d3/f1b 0 2024-02-20T08:05:43.882 INFO:tasks.workunit.client.0.smithi123.stdout:4/819: fdatasync d3/d2c/d43/d34/f3b 0 2024-02-20T08:05:43.882 INFO:tasks.workunit.client.0.smithi123.stdout:7/874: creat d0/df4/f131 x:0 0 0 2024-02-20T08:05:43.886 INFO:tasks.workunit.client.0.smithi123.stdout:9/780: creat d6/d2a/ff5 x:0 0 0 2024-02-20T08:05:43.886 INFO:tasks.workunit.client.0.smithi123.stdout:5/746: dwrite d0/f8d [0,4194304] 0 2024-02-20T08:05:43.888 INFO:tasks.workunit.client.0.smithi123.stdout:1/712: read d3/f42 [174597,40593] 0 2024-02-20T08:05:43.889 INFO:tasks.workunit.client.0.smithi123.stdout:7/875: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d73/f111 zero size 2024-02-20T08:05:43.892 INFO:tasks.workunit.client.0.smithi123.stdout:4/820: rename d3/f1b to d3/d2c/d43/d98/f113 0 2024-02-20T08:05:43.894 INFO:tasks.workunit.client.0.smithi123.stdout:4/821: truncate d3/d1e/d81/f10d 675448 0 2024-02-20T08:05:43.895 INFO:tasks.workunit.client.0.smithi123.stdout:1/713: symlink d3/db/lfc 0 2024-02-20T08:05:43.896 INFO:tasks.workunit.client.0.smithi123.stdout:5/747: mknod d0/d34/d48/d56/d4c/df0/cf5 0 2024-02-20T08:05:43.897 INFO:tasks.workunit.client.0.smithi123.stdout:5/748: chown d0/f6a 237 1 2024-02-20T08:05:43.899 INFO:tasks.workunit.client.0.smithi123.stdout:0/968: dread d2/de/d1e/d84/f99 [0,4194304] 0 2024-02-20T08:05:43.908 INFO:tasks.workunit.client.0.smithi123.stdout:9/781: link d6/f12 d6/d19/d1a/d6d/d7e/d80/dcc/df4/ff6 0 2024-02-20T08:05:43.910 INFO:tasks.workunit.client.0.smithi123.stdout:1/714: dwrite d3/de/d14/d26/f73 [4194304,4194304] 0 2024-02-20T08:05:43.913 INFO:tasks.workunit.client.0.smithi123.stdout:3/845: dwrite d0/d6/d1a/d1e/fd7 [0,4194304] 0 2024-02-20T08:05:43.913 INFO:tasks.workunit.client.0.smithi123.stdout:9/782: write d6/d2a/d27/d6f/fb9 [161902,107333] 0 2024-02-20T08:05:43.914 INFO:tasks.workunit.client.0.smithi123.stdout:9/783: stat d6/f30 0 2024-02-20T08:05:43.916 INFO:tasks.workunit.client.0.smithi123.stdout:5/749: mknod d0/d34/d48/d56/cf6 0 2024-02-20T08:05:43.916 INFO:tasks.workunit.client.0.smithi123.stdout:3/846: readlink d0/d6/d1a/d1e/l70 0 2024-02-20T08:05:43.922 INFO:tasks.workunit.client.0.smithi123.stdout:0/969: creat d2/dd/d4f/d61/d68/dfb/d14b/f14d x:0 0 0 2024-02-20T08:05:43.922 INFO:tasks.workunit.client.0.smithi123.stdout:3/847: chown d0/d6/d1a/d62/d115/l111 1 1 2024-02-20T08:05:43.926 INFO:tasks.workunit.client.0.smithi123.stdout:7/876: link d0/l1a d0/db/d38/l132 0 2024-02-20T08:05:43.926 INFO:tasks.workunit.client.0.smithi123.stdout:5/750: mkdir d0/d34/d48/d56/d3e/ddf/df7 0 2024-02-20T08:05:43.927 INFO:tasks.workunit.client.0.smithi123.stdout:3/848: readlink d0/d6/d1a/d62/d82/lfc 0 2024-02-20T08:05:43.929 INFO:tasks.workunit.client.0.smithi123.stdout:5/751: chown d0/d34/d48/d56/d3e/fc6 6 1 2024-02-20T08:05:43.932 INFO:tasks.workunit.client.0.smithi123.stdout:5/752: write d0/f9d [4548237,71641] 0 2024-02-20T08:05:43.932 INFO:tasks.workunit.client.0.smithi123.stdout:4/822: dread d3/d1e/f2d [4194304,4194304] 0 2024-02-20T08:05:43.935 INFO:tasks.workunit.client.0.smithi123.stdout:7/877: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f72 [4194304,4194304] 0 2024-02-20T08:05:43.935 INFO:tasks.workunit.client.0.smithi123.stdout:0/970: unlink d2/dd/d4f/d61/d81/df5/c131 0 2024-02-20T08:05:43.937 INFO:tasks.workunit.client.0.smithi123.stdout:3/849: mknod d0/d6/d32/c123 0 2024-02-20T08:05:43.939 INFO:tasks.workunit.client.0.smithi123.stdout:4/823: dread d3/d18/f23 [4194304,4194304] 0 2024-02-20T08:05:43.940 INFO:tasks.workunit.client.0.smithi123.stdout:5/753: creat d0/d34/d48/d56/dbb/d27/d4e/d91/ff8 x:0 0 0 2024-02-20T08:05:43.942 INFO:tasks.workunit.client.0.smithi123.stdout:9/784: creat d6/d19/d1a/d2b/d28/d9a/d3d/ff7 x:0 0 0 2024-02-20T08:05:43.944 INFO:tasks.workunit.client.0.smithi123.stdout:0/971: unlink d2/de/d1e/d1f/l26 0 2024-02-20T08:05:43.949 INFO:tasks.workunit.client.0.smithi123.stdout:4/824: read d3/d2c/d5a/d7e/f82 [58590,104738] 0 2024-02-20T08:05:43.951 INFO:tasks.workunit.client.0.smithi123.stdout:0/972: dread - d2/dd/d4f/d61/d68/fe5 zero size 2024-02-20T08:05:43.952 INFO:tasks.workunit.client.0.smithi123.stdout:4/825: write d3/d18/d63/fa6 [83058,89312] 0 2024-02-20T08:05:43.954 INFO:tasks.workunit.client.0.smithi123.stdout:0/973: write d2/dd/d4f/d7c/da4/d28/fd7 [2441577,112979] 0 2024-02-20T08:05:43.955 INFO:tasks.workunit.client.0.smithi123.stdout:9/785: rename d6/d19/d1a/d2b/d28/d9a/f68 to d6/d19/d1a/d7c/ff8 0 2024-02-20T08:05:43.957 INFO:tasks.workunit.client.0.smithi123.stdout:1/715: dwrite d3/db/d34/d74/d6f/fce [0,4194304] 0 2024-02-20T08:05:43.958 INFO:tasks.workunit.client.0.smithi123.stdout:9/786: write d6/d19/d1a/d6d/d7e/fe2 [15360,54744] 0 2024-02-20T08:05:43.963 INFO:tasks.workunit.client.0.smithi123.stdout:9/787: symlink d6/d2a/d9d/lf9 0 2024-02-20T08:05:43.967 INFO:tasks.workunit.client.0.smithi123.stdout:9/788: creat d6/d2a/d27/ffa x:0 0 0 2024-02-20T08:05:43.971 INFO:tasks.workunit.client.0.smithi123.stdout:9/789: creat d6/dbc/ffb x:0 0 0 2024-02-20T08:05:43.975 INFO:tasks.workunit.client.0.smithi123.stdout:4/826: dread d3/f4d [0,4194304] 0 2024-02-20T08:05:43.977 INFO:tasks.workunit.client.0.smithi123.stdout:3/850: dwrite d0/d6/d1a/f2f [0,4194304] 0 2024-02-20T08:05:43.977 INFO:tasks.workunit.client.0.smithi123.stdout:5/754: dwrite d0/d34/d48/d56/dbb/d27/f63 [0,4194304] 0 2024-02-20T08:05:43.982 INFO:tasks.workunit.client.0.smithi123.stdout:4/827: creat d3/d18/d7d/d8b/d95/f114 x:0 0 0 2024-02-20T08:05:43.985 INFO:tasks.workunit.client.0.smithi123.stdout:4/828: dread - d3/d18/d7d/d8b/d95/ff6 zero size 2024-02-20T08:05:43.986 INFO:tasks.workunit.client.0.smithi123.stdout:9/790: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/fea [0,4194304] 0 2024-02-20T08:05:43.987 INFO:tasks.workunit.client.0.smithi123.stdout:3/851: creat d0/d6/d1a/def/df1/f124 x:0 0 0 2024-02-20T08:05:43.990 INFO:tasks.workunit.client.0.smithi123.stdout:3/852: unlink d0/d6/lfb 0 2024-02-20T08:05:43.990 INFO:tasks.workunit.client.0.smithi123.stdout:0/974: write d2/dd/d4f/d6a/f7f [745809,16546] 0 2024-02-20T08:05:43.991 INFO:tasks.workunit.client.0.smithi123.stdout:1/716: write d3/de/d14/fc3 [277649,32353] 0 2024-02-20T08:05:43.995 INFO:tasks.workunit.client.0.smithi123.stdout:5/755: dwrite d0/d34/d48/d56/d4c/d43/f90 [0,4194304] 0 2024-02-20T08:05:43.997 INFO:tasks.workunit.client.0.smithi123.stdout:3/853: rename d0/d6/d1a/d4b/fc4 to d0/d6/d32/f125 0 2024-02-20T08:05:43.998 INFO:tasks.workunit.client.0.smithi123.stdout:0/975: dread d2/de/d1e/d1f/dcb/f13f [0,4194304] 0 2024-02-20T08:05:44.000 INFO:tasks.workunit.client.0.smithi123.stdout:3/854: chown d0/d6/d34/fbe 1583 1 2024-02-20T08:05:44.002 INFO:tasks.workunit.client.0.smithi123.stdout:1/717: read d3/de/d14/d2c/d4f/ff5 [223240,57215] 0 2024-02-20T08:05:44.002 INFO:tasks.workunit.client.0.smithi123.stdout:0/976: fsync d2/dd/d4f/d61/d68/f6b 0 2024-02-20T08:05:44.004 INFO:tasks.workunit.client.0.smithi123.stdout:3/855: creat d0/d6/d1a/d62/d115/d1c/d3b/d43/f126 x:0 0 0 2024-02-20T08:05:44.008 INFO:tasks.workunit.client.0.smithi123.stdout:3/856: creat d0/d6/d1a/d62/d115/d1c/d3b/f127 x:0 0 0 2024-02-20T08:05:44.010 INFO:tasks.workunit.client.0.smithi123.stdout:3/857: truncate d0/dd/d48/d6a/f108 909547 0 2024-02-20T08:05:44.012 INFO:tasks.workunit.client.0.smithi123.stdout:0/977: getdents d2/de 0 2024-02-20T08:05:44.020 INFO:tasks.workunit.client.0.smithi123.stdout:3/858: dwrite d0/d6/d1a/def/df1/f124 [0,4194304] 0 2024-02-20T08:05:44.021 INFO:tasks.workunit.client.0.smithi123.stdout:0/978: dwrite d2/dd/d4f/d7c/f8c [0,4194304] 0 2024-02-20T08:05:44.022 INFO:tasks.workunit.client.0.smithi123.stdout:5/756: write d0/d34/d48/d56/dbb/f1e [5641175,23750] 0 2024-02-20T08:05:44.029 INFO:tasks.workunit.client.0.smithi123.stdout:5/757: mknod d0/d34/d48/d56/dcf/cf9 0 2024-02-20T08:05:44.031 INFO:tasks.workunit.client.0.smithi123.stdout:1/718: dwrite d3/db/d34/d74/d6f/f83 [0,4194304] 0 2024-02-20T08:05:44.034 INFO:tasks.workunit.client.0.smithi123.stdout:5/758: mknod d0/d34/d48/d56/d4c/d43/cfa 0 2024-02-20T08:05:44.036 INFO:tasks.workunit.client.0.smithi123.stdout:4/829: dread d3/ff [0,4194304] 0 2024-02-20T08:05:44.041 INFO:tasks.workunit.client.0.smithi123.stdout:5/759: unlink d0/d34/d48/d56/dbb/d27/d4e/fd4 0 2024-02-20T08:05:44.045 INFO:tasks.workunit.client.0.smithi123.stdout:1/719: getdents d3/de/d14/d26/d56/de7 0 2024-02-20T08:05:44.050 INFO:tasks.workunit.client.0.smithi123.stdout:1/720: chown d3/de/d14/d2c/d45/d9d/ff6 141328 1 2024-02-20T08:05:44.050 INFO:tasks.workunit.client.0.smithi123.stdout:0/979: dwrite d2/f15 [0,4194304] 0 2024-02-20T08:05:44.052 INFO:tasks.workunit.client.0.smithi123.stdout:5/760: dwrite d0/d34/d48/d56/feb [0,4194304] 0 2024-02-20T08:05:44.055 INFO:tasks.workunit.client.0.smithi123.stdout:4/830: link d3/c62 d3/d2c/d43/d26/d3e/d8a/d10a/c115 0 2024-02-20T08:05:44.058 INFO:tasks.workunit.client.0.smithi123.stdout:3/859: dread d0/d6/d1a/d62/d115/d1c/d21/dd9/ff5 [0,4194304] 0 2024-02-20T08:05:44.060 INFO:tasks.workunit.client.0.smithi123.stdout:3/860: readlink d0/dd/d48/d6a/d74/l81 0 2024-02-20T08:05:44.063 INFO:tasks.workunit.client.0.smithi123.stdout:0/980: rmdir d2/d3 39 2024-02-20T08:05:44.073 INFO:tasks.workunit.client.0.smithi123.stdout:4/831: truncate d3/d2c/d43/d26/d3e/da9/fb5 2256725 0 2024-02-20T08:05:44.073 INFO:tasks.workunit.client.0.smithi123.stdout:4/832: fsync d3/d18/d7d/d87/f9a 0 2024-02-20T08:05:44.074 INFO:tasks.workunit.client.0.smithi123.stdout:3/861: link d0/d6/d1a/d62/d115/d57/dd0/daa/fab d0/d6/d1a/d62/d115/d2a/f128 0 2024-02-20T08:05:44.078 INFO:tasks.workunit.client.0.smithi123.stdout:5/761: creat d0/d34/d48/d56/ffb x:0 0 0 2024-02-20T08:05:44.083 INFO:tasks.workunit.client.0.smithi123.stdout:3/862: rmdir d0/dd/d48/d8d/dcf 39 2024-02-20T08:05:44.087 INFO:tasks.workunit.client.0.smithi123.stdout:0/981: truncate d2/dd/d4f/d61/d81/df5/f138 2680412 0 2024-02-20T08:05:44.088 INFO:tasks.workunit.client.0.smithi123.stdout:1/721: dread d3/de/d14/d26/fd6 [0,4194304] 0 2024-02-20T08:05:44.089 INFO:tasks.workunit.client.0.smithi123.stdout:4/833: creat d3/d1e/de4/f116 x:0 0 0 2024-02-20T08:05:44.090 INFO:tasks.workunit.client.0.smithi123.stdout:3/863: rename d0/d6/d1a/d62/d115/d1c/d21/d8e/c9c to d0/d6/d1a/d62/d115/d1c/d3b/d43/c129 0 2024-02-20T08:05:44.093 INFO:tasks.workunit.client.0.smithi123.stdout:1/722: fsync d3/db/d34/d74/f11 0 2024-02-20T08:05:44.095 INFO:tasks.workunit.client.0.smithi123.stdout:5/762: write d0/d34/d48/f61 [3927225,89323] 0 2024-02-20T08:05:44.097 INFO:tasks.workunit.client.0.smithi123.stdout:0/982: rename d2/dd/d4f/l65 to d2/dd/d4f/d7c/da4/d28/daf/l14e 0 2024-02-20T08:05:44.098 INFO:tasks.workunit.client.0.smithi123.stdout:3/864: fsync d0/d6/d1a/d62/d115/d57/dd0/daa/fab 0 2024-02-20T08:05:44.104 INFO:tasks.workunit.client.0.smithi123.stdout:5/763: mknod d0/d34/d48/d56/dbb/d27/d4e/d91/cfc 0 2024-02-20T08:05:44.105 INFO:tasks.workunit.client.0.smithi123.stdout:4/834: write d3/d2c/d5a/d7e/f82 [517061,65556] 0 2024-02-20T08:05:44.107 INFO:tasks.workunit.client.0.smithi123.stdout:1/723: rename d3/de/d14 to d3/db/d34/d74/d6f/d63/dfd 0 2024-02-20T08:05:44.108 INFO:tasks.workunit.client.0.smithi123.stdout:5/764: dread d0/d34/d48/d56/d4c/d43/f90 [0,4194304] 0 2024-02-20T08:05:44.139 INFO:tasks.workunit.client.0.smithi123.stdout:0/983: creat d2/de/d1e/d1f/d5e/f14f x:0 0 0 2024-02-20T08:05:44.142 INFO:tasks.workunit.client.0.smithi123.stdout:3/865: rmdir d0/d6/d1a/d62/d115/d1c/d3b/d43 39 2024-02-20T08:05:44.223 INFO:tasks.workunit.client.0.smithi123.stdout:1/724: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/fd6 [0,4194304] 0 2024-02-20T08:05:44.223 INFO:tasks.workunit.client.0.smithi123.stdout:0/984: truncate d2/d3/f10f 346820 0 2024-02-20T08:05:44.225 INFO:tasks.workunit.client.0.smithi123.stdout:1/725: chown d3/db/d34/d74/d6f/d63/dfd/d26/d56/de7/ff2 564 1 2024-02-20T08:05:44.225 INFO:tasks.workunit.client.0.smithi123.stdout:0/985: truncate d2/de/d1e/d1f/f12e 1904127 0 2024-02-20T08:05:44.228 INFO:tasks.workunit.client.0.smithi123.stdout:3/866: rename d0/d6/d1a/d4b/fe4 to d0/dd/d48/d6a/d74/f12a 0 2024-02-20T08:05:44.232 INFO:tasks.workunit.client.0.smithi123.stdout:4/835: dwrite d3/d97/dda/fc6 [0,4194304] 0 2024-02-20T08:05:44.235 INFO:tasks.workunit.client.0.smithi123.stdout:5/765: link d0/d34/d48/d56/d25/ce9 d0/d34/d48/d56/d3e/ddf/df7/cfd 0 2024-02-20T08:05:44.238 INFO:tasks.workunit.client.0.smithi123.stdout:1/726: mkdir d3/db/d41/de5/dfe 0 2024-02-20T08:05:44.241 INFO:tasks.workunit.client.0.smithi123.stdout:4/836: dwrite d3/d97/dda/db6/f9e [0,4194304] 0 2024-02-20T08:05:44.245 INFO:tasks.workunit.client.0.smithi123.stdout:1/727: creat d3/db/d34/d74/d6f/fff x:0 0 0 2024-02-20T08:05:44.250 INFO:tasks.workunit.client.0.smithi123.stdout:4/837: dwrite d3/d18/d63/fa6 [0,4194304] 0 2024-02-20T08:05:44.257 INFO:tasks.workunit.client.0.smithi123.stdout:5/766: rename d0/d34/c39 to d0/d34/d48/d56/cfe 0 2024-02-20T08:05:44.257 INFO:tasks.workunit.client.0.smithi123.stdout:3/867: dread d0/d6/d1a/d1e/f119 [0,4194304] 0 2024-02-20T08:05:44.258 INFO:tasks.workunit.client.0.smithi123.stdout:5/767: dread - d0/d34/fe1 zero size 2024-02-20T08:05:44.259 INFO:tasks.workunit.client.0.smithi123.stdout:5/768: write d0/d34/d48/f61 [4431696,122239] 0 2024-02-20T08:05:44.262 INFO:tasks.workunit.client.0.smithi123.stdout:1/728: dread d3/de/f8d [0,4194304] 0 2024-02-20T08:05:44.266 INFO:tasks.workunit.client.0.smithi123.stdout:3/868: rename d0/d6/d1a/d4b/fb5 to d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f12b 0 2024-02-20T08:05:44.272 INFO:tasks.workunit.client.0.smithi123.stdout:3/869: rename d0/d6/d1a/d62/d115/d1c/d21/d8e/f9a to d0/d6/d1a/d62/d115/d9d/f12c 0 2024-02-20T08:05:44.274 INFO:tasks.workunit.client.0.smithi123.stdout:3/870: write d0/d6/d34/fad [4761516,127733] 0 2024-02-20T08:05:44.280 INFO:tasks.workunit.client.0.smithi123.stdout:3/871: read - d0/d6/d1a/d62/d115/d1c/d3b/d43/f126 zero size 2024-02-20T08:05:44.281 INFO:tasks.workunit.client.0.smithi123.stdout:3/872: chown d0/d6/d1a/d62/d115/d57/la4 12 1 2024-02-20T08:05:44.284 INFO:tasks.workunit.client.0.smithi123.stdout:4/838: dread d3/d2c/d43/fff [0,4194304] 0 2024-02-20T08:05:44.288 INFO:tasks.workunit.client.0.smithi123.stdout:3/873: dwrite d0/d6/d1a/d62/d115/d2a/f6f [0,4194304] 0 2024-02-20T08:05:44.288 INFO:tasks.workunit.client.0.smithi123.stdout:1/729: dread d3/db/d34/d74/d6f/d63/dfd/d36/fa8 [0,4194304] 0 2024-02-20T08:05:44.289 INFO:tasks.workunit.client.0.smithi123.stdout:4/839: write d3/d18/f23 [3817206,103862] 0 2024-02-20T08:05:44.290 INFO:tasks.workunit.client.0.smithi123.stdout:4/840: fsync d3/d18/d7d/d8b/d95/ff6 0 2024-02-20T08:05:44.291 INFO:tasks.workunit.client.0.smithi123.stdout:4/841: stat d3/d2c/d43/d26/d3e 0 2024-02-20T08:05:44.292 INFO:tasks.workunit.client.0.smithi123.stdout:3/874: chown d0/d6/d1a/d62/d115/d1c/d21/d8e 33108959 1 2024-02-20T08:05:44.293 INFO:tasks.workunit.client.0.smithi123.stdout:5/769: write d0/d34/d48/d56/fc0 [1178594,24940] 0 2024-02-20T08:05:44.300 INFO:tasks.workunit.client.0.smithi123.stdout:3/875: dwrite d0/d6/d1a/d62/d115/f30 [0,4194304] 0 2024-02-20T08:05:44.302 INFO:tasks.workunit.client.0.smithi123.stdout:5/770: creat d0/d34/d48/d4b/fff x:0 0 0 2024-02-20T08:05:44.303 INFO:tasks.workunit.client.0.smithi123.stdout:1/730: creat d3/db/d34/d74/d6f/d63/dfd/d2c/f100 x:0 0 0 2024-02-20T08:05:44.305 INFO:tasks.workunit.client.0.smithi123.stdout:1/731: chown d3/db/d34/d74/d6f/d63/dfd/d26/d56 61438 1 2024-02-20T08:05:44.307 INFO:tasks.workunit.client.0.smithi123.stdout:3/876: chown d0/d6/d1a/d4b/d95/d9f 3502751 1 2024-02-20T08:05:44.309 INFO:tasks.workunit.client.0.smithi123.stdout:5/771: mkdir d0/d34/d67/d80/d100 0 2024-02-20T08:05:44.313 INFO:tasks.workunit.client.0.smithi123.stdout:1/732: symlink d3/db/d34/d74/d6f/d63/dfd/d2c/d45/dec/l101 0 2024-02-20T08:05:44.316 INFO:tasks.workunit.client.0.smithi123.stdout:1/733: creat d3/db/d41/de5/dfe/f102 x:0 0 0 2024-02-20T08:05:44.322 INFO:tasks.workunit.client.0.smithi123.stdout:1/734: dwrite d3/db/d34/d74/d6f/d63/dfd/d36/fa8 [4194304,4194304] 0 2024-02-20T08:05:44.350 INFO:tasks.workunit.client.0.smithi123.stdout:4/842: truncate d3/d2c/d43/d26/d2e/fb8 2937896 0 2024-02-20T08:05:44.354 INFO:tasks.workunit.client.0.smithi123.stdout:4/843: mknod d3/d2c/d43/c117 0 2024-02-20T08:05:44.369 INFO:tasks.workunit.client.0.smithi123.stdout:1/735: write d3/fab [847046,112890] 0 2024-02-20T08:05:44.371 INFO:tasks.workunit.client.0.smithi123.stdout:1/736: symlink d3/de/dfb/l103 0 2024-02-20T08:05:44.373 INFO:tasks.workunit.client.0.smithi123.stdout:1/737: mkdir d3/db/d34/d74/d6f/d63/d104 0 2024-02-20T08:05:44.374 INFO:tasks.workunit.client.0.smithi123.stdout:1/738: dread - d3/db/d34/d74/d6f/d63/dfd/d26/d56/fde zero size 2024-02-20T08:05:44.376 INFO:tasks.workunit.client.0.smithi123.stdout:1/739: creat d3/db/d34/d74/d6f/f105 x:0 0 0 2024-02-20T08:05:44.377 INFO:tasks.workunit.client.0.smithi123.stdout:1/740: write d3/db/d34/d74/d6f/d63/dfd/d36/fb6 [1126260,90331] 0 2024-02-20T08:05:44.378 INFO:tasks.workunit.client.0.smithi123.stdout:1/741: dread - d3/d47/f7c zero size 2024-02-20T08:05:44.379 INFO:tasks.workunit.client.0.smithi123.stdout:1/742: dread - d3/fef zero size 2024-02-20T08:05:44.383 INFO:tasks.workunit.client.0.smithi123.stdout:1/743: rename d3/d47/f66 to d3/db/d34/d74/d6f/d63/dfd/f106 0 2024-02-20T08:05:44.384 INFO:tasks.workunit.client.0.smithi123.stdout:1/744: chown d3/db/d34/d74/d6f/d63/dfd/l69 1 1 2024-02-20T08:05:44.386 INFO:tasks.workunit.client.0.smithi123.stdout:1/745: write d3/db/d7f/fb0 [696058,18455] 0 2024-02-20T08:05:44.391 INFO:tasks.workunit.client.0.smithi123.stdout:1/746: mkdir d3/db/d34/d74/d6f/d63/dfd/d2c/d107 0 2024-02-20T08:05:44.392 INFO:tasks.workunit.client.0.smithi123.stdout:1/747: readlink d3/db/d34/d74/d6f/d63/dfd/d2c/d45/l75 0 2024-02-20T08:05:44.395 INFO:tasks.workunit.client.0.smithi123.stdout:1/748: mknod d3/db/d34/d74/d6f/d63/dfd/d26/de3/c108 0 2024-02-20T08:05:44.403 INFO:tasks.workunit.client.0.smithi123.stdout:1/749: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/d56/fde [0,4194304] 0 2024-02-20T08:05:44.407 INFO:tasks.workunit.client.0.smithi123.stdout:1/750: creat d3/f109 x:0 0 0 2024-02-20T08:05:44.414 INFO:tasks.workunit.client.0.smithi123.stdout:1/751: creat d3/db/d34/d74/da1/f10a x:0 0 0 2024-02-20T08:05:44.441 INFO:tasks.workunit.client.0.smithi123.stdout:2/819: sync 2024-02-20T08:05:44.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/820: chown d1a/d29/d39/c40 1 1 2024-02-20T08:05:44.442 INFO:tasks.workunit.client.0.smithi123.stdout:2/821: readlink d1a/d29/d42/l47 0 2024-02-20T08:05:44.443 INFO:tasks.workunit.client.0.smithi123.stdout:2/822: chown d1a/d29/d5d/d97/da9 117 1 2024-02-20T08:05:44.469 INFO:tasks.workunit.client.0.smithi123.stdout:1/752: write d3/db/d41/f4b [4890808,4684] 0 2024-02-20T08:05:44.471 INFO:tasks.workunit.client.0.smithi123.stdout:2/823: write d1a/d29/d42/fb1 [255820,121532] 0 2024-02-20T08:05:44.475 INFO:tasks.workunit.client.0.smithi123.stdout:1/753: truncate d3/db/d34/d74/d6f/d63/dfd/d2c/d45/f8f 509449 0 2024-02-20T08:05:44.478 INFO:tasks.workunit.client.0.smithi123.stdout:1/754: fsync d3/f3e 0 2024-02-20T08:05:44.482 INFO:tasks.workunit.client.0.smithi123.stdout:1/755: link d3/db/d34/d74/d6f/fba d3/d47/f10b 0 2024-02-20T08:05:44.482 INFO:tasks.workunit.client.0.smithi123.stdout:2/824: write d1a/d29/d42/f72 [1295811,114529] 0 2024-02-20T08:05:44.485 INFO:tasks.workunit.client.0.smithi123.stdout:1/756: chown d3/db/d34/d74/d6f/d63/dfd/d26/f81 471800 1 2024-02-20T08:05:44.488 INFO:tasks.workunit.client.0.smithi123.stdout:1/757: rename d3/db/d34/d74/d6f/d63/dfd/l69 to d3/db/d7f/l10c 0 2024-02-20T08:05:44.491 INFO:tasks.workunit.client.0.smithi123.stdout:1/758: fdatasync d3/db/d34/d74/d6f/d63/dfd/d2c/d4f/ff8 0 2024-02-20T08:05:44.493 INFO:tasks.workunit.client.0.smithi123.stdout:1/759: write d3/db/d34/d74/d6f/d63/dfd/d26/d56/fde [3317910,21221] 0 2024-02-20T08:05:44.496 INFO:tasks.workunit.client.0.smithi123.stdout:1/760: mkdir d3/db/d34/d74/d6f/d63/dfd/d26/d56/d10d 0 2024-02-20T08:05:44.498 INFO:tasks.workunit.client.0.smithi123.stdout:2/825: dread d1a/d4f/ff1 [0,4194304] 0 2024-02-20T08:05:44.499 INFO:tasks.workunit.client.0.smithi123.stdout:1/761: creat d3/db/d34/d74/d6f/d63/dfd/d26/d56/f10e x:0 0 0 2024-02-20T08:05:44.502 INFO:tasks.workunit.client.0.smithi123.stdout:2/826: rename d1a/d29/d42/d4e/l54 to d1a/d29/d42/d73/l112 0 2024-02-20T08:05:44.502 INFO:tasks.workunit.client.0.smithi123.stdout:2/827: stat f17 0 2024-02-20T08:05:44.503 INFO:tasks.workunit.client.0.smithi123.stdout:2/828: write f15 [7472739,101213] 0 2024-02-20T08:05:44.504 INFO:tasks.workunit.client.0.smithi123.stdout:1/762: fdatasync d3/db/d34/f2b 0 2024-02-20T08:05:44.506 INFO:tasks.workunit.client.0.smithi123.stdout:2/829: mknod d1a/d7f/c113 0 2024-02-20T08:05:44.510 INFO:tasks.workunit.client.0.smithi123.stdout:2/830: dread d1a/d29/d42/d80/fa4 [0,4194304] 0 2024-02-20T08:05:44.516 INFO:tasks.workunit.client.0.smithi123.stdout:2/831: write d1a/d29/d42/f49 [4173069,55656] 0 2024-02-20T08:05:44.519 INFO:tasks.workunit.client.0.smithi123.stdout:1/763: dread d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/fa7 [0,4194304] 0 2024-02-20T08:05:44.520 INFO:tasks.workunit.client.0.smithi123.stdout:2/832: mkdir d1a/d29/d5d/d97/da9/d114 0 2024-02-20T08:05:44.521 INFO:tasks.workunit.client.0.smithi123.stdout:2/833: dread - d1a/d29/d42/d52/d98/dd6/fd7 zero size 2024-02-20T08:05:44.523 INFO:tasks.workunit.client.0.smithi123.stdout:1/764: rename d3/db/c20 to d3/db/d7f/c10f 0 2024-02-20T08:05:44.526 INFO:tasks.workunit.client.0.smithi123.stdout:2/834: mkdir d1a/d29/d5d/d97/da9/dfe/d115 0 2024-02-20T08:05:44.527 INFO:tasks.workunit.client.0.smithi123.stdout:1/765: creat d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/df4/f110 x:0 0 0 2024-02-20T08:05:44.530 INFO:tasks.workunit.client.0.smithi123.stdout:1/766: symlink d3/db/d34/d74/d6f/d63/dfd/d26/d56/l111 0 2024-02-20T08:05:44.541 INFO:tasks.workunit.client.0.smithi123.stdout:2/835: dwrite d1a/d29/d5d/f9b [0,4194304] 0 2024-02-20T08:05:44.543 INFO:tasks.workunit.client.0.smithi123.stdout:1/767: dwrite d3/d47/f10b [0,4194304] 0 2024-02-20T08:05:44.543 INFO:tasks.workunit.client.0.smithi123.stdout:1/768: readlink d3/d47/le0 0 2024-02-20T08:05:44.549 INFO:tasks.workunit.client.0.smithi123.stdout:1/769: rename d3/db/d34/d74/f1e to d3/db/d7f/f112 0 2024-02-20T08:05:44.549 INFO:tasks.workunit.client.0.smithi123.stdout:2/836: dwrite d1a/d29/f82 [0,4194304] 0 2024-02-20T08:05:44.552 INFO:tasks.workunit.client.0.smithi123.stdout:2/837: mknod d1a/d29/d42/d80/c116 0 2024-02-20T08:05:44.555 INFO:tasks.workunit.client.0.smithi123.stdout:1/770: rename d3/db/d34/d74/d6f/d63/dfd/d26/f73 to d3/db/d41/de5/dfe/f113 0 2024-02-20T08:05:44.558 INFO:tasks.workunit.client.0.smithi123.stdout:2/838: creat d1a/d29/d42/d52/d98/da1/daa/de8/f117 x:0 0 0 2024-02-20T08:05:44.559 INFO:tasks.workunit.client.0.smithi123.stdout:1/771: creat d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f/f114 x:0 0 0 2024-02-20T08:05:44.560 INFO:tasks.workunit.client.0.smithi123.stdout:1/772: chown d3/db/d41/f4b 12 1 2024-02-20T08:05:44.561 INFO:tasks.workunit.client.0.smithi123.stdout:2/839: dread - d1a/d29/d42/d4e/fa8 zero size 2024-02-20T08:05:44.578 INFO:tasks.workunit.client.0.smithi123.stdout:1/773: dread d3/db/d41/f5e [0,4194304] 0 2024-02-20T08:05:44.581 INFO:tasks.workunit.client.0.smithi123.stdout:1/774: mknod d3/db/d34/d74/d6f/d63/dfd/c115 0 2024-02-20T08:05:44.584 INFO:tasks.workunit.client.0.smithi123.stdout:1/775: getdents d3/db/d34/d74/d6f/d63/dfd/d2c/d45/dec 0 2024-02-20T08:05:44.586 INFO:tasks.workunit.client.0.smithi123.stdout:1/776: creat d3/db/d34/d74/d6f/d63/dfd/d36/d59/f116 x:0 0 0 2024-02-20T08:05:44.587 INFO:tasks.workunit.client.0.smithi123.stdout:1/777: write d3/db/d7f/fb0 [615207,5203] 0 2024-02-20T08:05:44.590 INFO:tasks.workunit.client.0.smithi123.stdout:2/840: write d1a/fb2 [31704,63010] 0 2024-02-20T08:05:44.595 INFO:tasks.workunit.client.0.smithi123.stdout:2/841: dwrite f15 [4194304,4194304] 0 2024-02-20T08:05:44.595 INFO:tasks.workunit.client.0.smithi123.stdout:2/842: fdatasync d1a/d29/d5d/f9b 0 2024-02-20T08:05:44.597 INFO:tasks.workunit.client.0.smithi123.stdout:2/843: symlink d1a/d29/d42/d4e/dbc/l118 0 2024-02-20T08:05:44.601 INFO:tasks.workunit.client.0.smithi123.stdout:2/844: creat d1a/d29/d5d/d97/da9/dfe/f119 x:0 0 0 2024-02-20T08:05:44.603 INFO:tasks.workunit.client.0.smithi123.stdout:2/845: write d1a/d29/d42/d52/d98/da1/daa/dd0/ffc [372788,104529] 0 2024-02-20T08:05:44.607 INFO:tasks.workunit.client.0.smithi123.stdout:2/846: creat d1a/da5/dd2/f11a x:0 0 0 2024-02-20T08:05:44.609 INFO:tasks.workunit.client.0.smithi123.stdout:2/847: mknod d1a/d29/d5d/d97/da9/d114/c11b 0 2024-02-20T08:05:44.611 INFO:tasks.workunit.client.0.smithi123.stdout:2/848: read - d1a/d29/d5d/f71 zero size 2024-02-20T08:05:44.613 INFO:tasks.workunit.client.0.smithi123.stdout:2/849: mknod d1a/d29/d42/d52/dcc/c11c 0 2024-02-20T08:05:44.613 INFO:tasks.workunit.client.0.smithi123.stdout:2/850: stat d1a/d29/d42/d52/d98/da1/deb 0 2024-02-20T08:05:44.616 INFO:tasks.workunit.client.0.smithi123.stdout:2/851: fdatasync d1a/d29/d42/d52/dcc/ff8 0 2024-02-20T08:05:44.617 INFO:tasks.workunit.client.0.smithi123.stdout:2/852: write d1a/d29/d42/f102 [422559,95719] 0 2024-02-20T08:05:44.618 INFO:tasks.workunit.client.0.smithi123.stdout:2/853: write d1a/d29/d42/d52/d98/dd6/dfa/fff [49924,102910] 0 2024-02-20T08:05:44.620 INFO:tasks.workunit.client.0.smithi123.stdout:2/854: mknod d1a/d4f/c11d 0 2024-02-20T08:05:44.623 INFO:tasks.workunit.client.0.smithi123.stdout:2/855: creat d1a/da5/f11e x:0 0 0 2024-02-20T08:05:44.625 INFO:tasks.workunit.client.0.smithi123.stdout:2/856: unlink d1a/d29/d42/d52/c7a 0 2024-02-20T08:05:44.630 INFO:tasks.workunit.client.0.smithi123.stdout:2/857: link d1a/d29/d42/d4e/c108 d1a/d29/d42/d73/c11f 0 2024-02-20T08:05:44.635 INFO:tasks.workunit.client.0.smithi123.stdout:2/858: rename d1a/l1b to d1a/d29/d42/d80/da3/l120 0 2024-02-20T08:05:44.636 INFO:tasks.workunit.client.0.smithi123.stdout:2/859: creat d1a/d29/d42/d80/da3/f121 x:0 0 0 2024-02-20T08:05:44.638 INFO:tasks.workunit.client.0.smithi123.stdout:2/860: mkdir d1a/d29/d42/d73/d8f/d122 0 2024-02-20T08:05:44.640 INFO:tasks.workunit.client.0.smithi123.stdout:2/861: mknod d1a/d29/d42/d73/d8f/c123 0 2024-02-20T08:05:44.640 INFO:tasks.workunit.client.0.smithi123.stdout:2/862: truncate d1a/d29/d39/ff5 754304 0 2024-02-20T08:05:44.642 INFO:tasks.workunit.client.0.smithi123.stdout:2/863: creat d1a/d29/d42/d4e/f124 x:0 0 0 2024-02-20T08:05:44.642 INFO:tasks.workunit.client.0.smithi123.stdout:2/864: readlink d1a/d4f/l66 0 2024-02-20T08:05:44.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:44 smithi194 ceph-mon[37804]: pgmap v41: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 150 MiB/s wr, 405 op/s 2024-02-20T08:05:44.644 INFO:tasks.workunit.client.0.smithi123.stdout:2/865: mkdir d1a/d125 0 2024-02-20T08:05:44.662 INFO:tasks.workunit.client.0.smithi123.stdout:8/747: sync 2024-02-20T08:05:44.662 INFO:tasks.workunit.client.0.smithi123.stdout:7/878: sync 2024-02-20T08:05:44.664 INFO:tasks.workunit.client.0.smithi123.stdout:8/748: mknod d6/d32/dd5/cfe 0 2024-02-20T08:05:44.666 INFO:tasks.workunit.client.0.smithi123.stdout:8/749: mkdir d6/d32/d95/d7d/dff 0 2024-02-20T08:05:44.667 INFO:tasks.workunit.client.0.smithi123.stdout:7/879: truncate d0/d6/dd/d52/d35/f74 969932 0 2024-02-20T08:05:44.667 INFO:tasks.workunit.client.0.smithi123.stdout:8/750: chown d6/d1c/d22/c66 28688 1 2024-02-20T08:05:44.668 INFO:tasks.workunit.client.0.smithi123.stdout:8/751: stat d6/d1c/d22/d8c/dcd/cdb 0 2024-02-20T08:05:44.669 INFO:tasks.workunit.client.0.smithi123.stdout:8/752: fsync d6/d32/fe2 0 2024-02-20T08:05:44.669 INFO:tasks.workunit.client.0.smithi123.stdout:8/753: fsync d6/d32/d95/f57 0 2024-02-20T08:05:44.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:44 smithi123 ceph-mon[29383]: pgmap v41: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 150 MiB/s wr, 405 op/s 2024-02-20T08:05:44.771 INFO:tasks.workunit.client.0.smithi123.stdout:7/880: creat d0/d6/d7/d68/f133 x:0 0 0 2024-02-20T08:05:44.772 INFO:tasks.workunit.client.0.smithi123.stdout:7/881: dread - d0/d6/dd/d52/ff8 zero size 2024-02-20T08:05:44.772 INFO:tasks.workunit.client.0.smithi123.stdout:8/754: write d6/dbd/d5b/d8f/ff0 [887431,116788] 0 2024-02-20T08:05:44.773 INFO:tasks.workunit.client.0.smithi123.stdout:8/755: rename d6/d1c to d6/d1c/d47/d100 22 2024-02-20T08:05:44.775 INFO:tasks.workunit.client.0.smithi123.stdout:7/882: creat d0/d6/dd/d52/d26/d9b/f134 x:0 0 0 2024-02-20T08:05:44.776 INFO:tasks.workunit.client.0.smithi123.stdout:7/883: chown d0/d6/dd/d10c 31 1 2024-02-20T08:05:44.777 INFO:tasks.workunit.client.0.smithi123.stdout:7/884: readlink d0/d6/dd/d52/d26/d9b/d9a/lcf 0 2024-02-20T08:05:44.778 INFO:tasks.workunit.client.0.smithi123.stdout:8/756: link d6/d32/d95/fef d6/dbd/d7e/f101 0 2024-02-20T08:05:44.780 INFO:tasks.workunit.client.0.smithi123.stdout:8/757: write d6/f2f [3866599,113052] 0 2024-02-20T08:05:44.782 INFO:tasks.workunit.client.0.smithi123.stdout:8/758: chown d6/d32/d95/c30 318040249 1 2024-02-20T08:05:44.782 INFO:tasks.workunit.client.0.smithi123.stdout:7/885: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d124/f135 x:0 0 0 2024-02-20T08:05:44.782 INFO:tasks.workunit.client.0.smithi123.stdout:8/759: fdatasync d6/dbd/d5b/d8f/d99/dd2/ff5 0 2024-02-20T08:05:44.783 INFO:tasks.workunit.client.0.smithi123.stdout:7/886: truncate d0/db/f10b 4823570 0 2024-02-20T08:05:44.784 INFO:tasks.workunit.client.0.smithi123.stdout:8/760: write d6/d1c/f21 [2424486,26868] 0 2024-02-20T08:05:44.788 INFO:tasks.workunit.client.0.smithi123.stdout:7/887: truncate d0/d6/dd/d52/d26/d9b/d61/f82 869857 0 2024-02-20T08:05:44.790 INFO:tasks.workunit.client.0.smithi123.stdout:7/888: truncate d0/f37 3755035 0 2024-02-20T08:05:44.791 INFO:tasks.workunit.client.0.smithi123.stdout:8/761: link d6/d32/d95/c31 d6/dbd/d5b/d8f/dd7/c102 0 2024-02-20T08:05:44.796 INFO:tasks.workunit.client.0.smithi123.stdout:8/762: truncate d6/d32/d95/f2e 518465 0 2024-02-20T08:05:44.798 INFO:tasks.workunit.client.0.smithi123.stdout:7/889: link d0/db/d38/f43 d0/d6/dd/f136 0 2024-02-20T08:05:44.799 INFO:tasks.workunit.client.0.smithi123.stdout:7/890: write d0/d6/dd/fdc [190563,127878] 0 2024-02-20T08:05:44.800 INFO:tasks.workunit.client.0.smithi123.stdout:9/791: sync 2024-02-20T08:05:44.801 INFO:tasks.workunit.client.0.smithi123.stdout:9/792: chown d6/d2a/d9d/c7a 13846104 1 2024-02-20T08:05:44.802 INFO:tasks.workunit.client.0.smithi123.stdout:9/793: stat d6/d19/d1a/d2b/d28/d9a/f26 0 2024-02-20T08:05:44.803 INFO:tasks.workunit.client.0.smithi123.stdout:7/891: symlink d0/db/d21/d42/d107/l137 0 2024-02-20T08:05:44.807 INFO:tasks.workunit.client.0.smithi123.stdout:9/794: mknod d6/d2a/cfc 0 2024-02-20T08:05:44.809 INFO:tasks.workunit.client.0.smithi123.stdout:9/795: chown d6/d19/d1a/d7c/f7d 1554 1 2024-02-20T08:05:44.811 INFO:tasks.workunit.client.0.smithi123.stdout:9/796: rename d6/f30 to d6/ffd 0 2024-02-20T08:05:44.811 INFO:tasks.workunit.client.0.smithi123.stdout:9/797: fsync d6/d19/d1a/f6a 0 2024-02-20T08:05:44.817 INFO:tasks.workunit.client.0.smithi123.stdout:9/798: dwrite d6/d19/d1a/d6d/d7e/d80/fd4 [0,4194304] 0 2024-02-20T08:05:44.820 INFO:tasks.workunit.client.0.smithi123.stdout:9/799: read d6/d19/d1a/d2b/d28/d9a/d3d/f62 [2796651,38295] 0 2024-02-20T08:05:44.842 INFO:tasks.workunit.client.0.smithi123.stdout:8/763: write d6/f15 [4772746,60626] 0 2024-02-20T08:05:44.844 INFO:tasks.workunit.client.0.smithi123.stdout:8/764: symlink d6/d1c/d47/l103 0 2024-02-20T08:05:44.849 INFO:tasks.workunit.client.0.smithi123.stdout:8/765: link d6/d32/d95/d7d/ldc d6/dbd/d5b/d8f/l104 0 2024-02-20T08:05:44.850 INFO:tasks.workunit.client.0.smithi123.stdout:8/766: fsync d6/d32/d95/db0/fd8 0 2024-02-20T08:05:44.851 INFO:tasks.workunit.client.0.smithi123.stdout:8/767: dread - d6/d32/d95/fbb zero size 2024-02-20T08:05:44.852 INFO:tasks.workunit.client.0.smithi123.stdout:8/768: dread - d6/fa8 zero size 2024-02-20T08:05:44.852 INFO:tasks.workunit.client.0.smithi123.stdout:8/769: chown d6/dbd/d5b/fa6 266042311 1 2024-02-20T08:05:44.853 INFO:tasks.workunit.client.0.smithi123.stdout:9/800: write d6/d19/d1a/d2b/d28/d9a/f26 [3426741,1949] 0 2024-02-20T08:05:44.855 INFO:tasks.workunit.client.0.smithi123.stdout:8/770: write d6/d1c/d22/d8c/da2/feb [4873578,124985] 0 2024-02-20T08:05:44.868 INFO:tasks.workunit.client.0.smithi123.stdout:9/801: dread d6/d19/d1a/d6d/d7e/fac [0,4194304] 0 2024-02-20T08:05:44.869 INFO:tasks.workunit.client.0.smithi123.stdout:8/771: write d6/dbd/fb5 [538828,20544] 0 2024-02-20T08:05:44.874 INFO:tasks.workunit.client.0.smithi123.stdout:9/802: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/fd5 [0,4194304] 0 2024-02-20T08:05:44.876 INFO:tasks.workunit.client.0.smithi123.stdout:9/803: write d6/fb [3896710,39588] 0 2024-02-20T08:05:44.881 INFO:tasks.workunit.client.0.smithi123.stdout:9/804: creat d6/d19/d1a/d2b/d65/d77/da5/ffe x:0 0 0 2024-02-20T08:05:44.884 INFO:tasks.workunit.client.0.smithi123.stdout:8/772: dread d6/fc [0,4194304] 0 2024-02-20T08:05:44.885 INFO:tasks.workunit.client.0.smithi123.stdout:9/805: rename d6/d19/d1a/d31/l88 to d6/d19/d1a/d6d/d7e/d80/lff 0 2024-02-20T08:05:44.891 INFO:tasks.workunit.client.0.smithi123.stdout:9/806: dwrite d6/d19/d1a/d2b/d28/d9a/f26 [0,4194304] 0 2024-02-20T08:05:44.895 INFO:tasks.workunit.client.0.smithi123.stdout:9/807: creat d6/d19/d1a/d2b/f100 x:0 0 0 2024-02-20T08:05:44.903 INFO:tasks.workunit.client.0.smithi123.stdout:9/808: write d6/d2a/d27/d3c/fed [4230841,12790] 0 2024-02-20T08:05:44.903 INFO:tasks.workunit.client.0.smithi123.stdout:8/773: dwrite d6/dbd/d5b/fa6 [0,4194304] 0 2024-02-20T08:05:44.905 INFO:tasks.workunit.client.0.smithi123.stdout:9/809: truncate d6/d2a/ff5 954986 0 2024-02-20T08:05:44.906 INFO:tasks.workunit.client.0.smithi123.stdout:9/810: readlink d6/d19/d1a/d6d/ld6 0 2024-02-20T08:05:44.906 INFO:tasks.workunit.client.0.smithi123.stdout:8/774: getdents d6/d1c/d47/df6 0 2024-02-20T08:05:44.909 INFO:tasks.workunit.client.0.smithi123.stdout:8/775: chown d6/dbd/d7e/d82/la5 691 1 2024-02-20T08:05:44.912 INFO:tasks.workunit.client.0.smithi123.stdout:8/776: symlink d6/dbd/d5b/d8f/dd7/l105 0 2024-02-20T08:05:44.914 INFO:tasks.workunit.client.0.smithi123.stdout:9/811: truncate d6/d19/d1a/d7c/fa8 1444534 0 2024-02-20T08:05:44.916 INFO:tasks.workunit.client.0.smithi123.stdout:8/777: truncate d6/d1c/d22/d8c/dcd/db9/dc3/fcc 849296 0 2024-02-20T08:05:44.918 INFO:tasks.workunit.client.0.smithi123.stdout:8/778: stat d6/d32/d95/c31 0 2024-02-20T08:05:44.921 INFO:tasks.workunit.client.0.smithi123.stdout:8/779: readlink d6/d1c/d47/ld0 0 2024-02-20T08:05:44.921 INFO:tasks.workunit.client.0.smithi123.stdout:9/812: dwrite d6/dbc/ffb [0,4194304] 0 2024-02-20T08:05:44.922 INFO:tasks.workunit.client.0.smithi123.stdout:9/813: read - d6/d19/d1a/d2b/f100 zero size 2024-02-20T08:05:44.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/780: fsync d6/d32/d95/d7d/fe9 0 2024-02-20T08:05:44.927 INFO:tasks.workunit.client.0.smithi123.stdout:9/814: fsync d6/d19/d1a/d6d/d7e/fac 0 2024-02-20T08:05:44.929 INFO:tasks.workunit.client.0.smithi123.stdout:9/815: truncate d6/d19/d1a/d6d/d7e/d80/fd4 5009474 0 2024-02-20T08:05:44.930 INFO:tasks.workunit.client.0.smithi123.stdout:9/816: mkdir d6/d19/d1a/d2b/d28/d101 0 2024-02-20T08:05:44.931 INFO:tasks.workunit.client.0.smithi123.stdout:9/817: stat d6/d19/d1a/d2b/d65/d77/da5 0 2024-02-20T08:05:44.948 INFO:tasks.workunit.client.0.smithi123.stdout:8/781: dread d6/f15 [0,4194304] 0 2024-02-20T08:05:44.951 INFO:tasks.workunit.client.0.smithi123.stdout:8/782: rename d6/dbd/d7e/d82/l88 to d6/d1c/d22/d8c/da2/l106 0 2024-02-20T08:05:44.953 INFO:tasks.workunit.client.0.smithi123.stdout:8/783: symlink d6/d1c/d22/d8c/l107 0 2024-02-20T08:05:44.953 INFO:tasks.workunit.client.0.smithi123.stdout:8/784: chown d6/dbd/d5b/l9c 4 1 2024-02-20T08:05:44.954 INFO:tasks.workunit.client.0.smithi123.stdout:9/818: dread d6/ffd [0,4194304] 0 2024-02-20T08:05:44.955 INFO:tasks.workunit.client.0.smithi123.stdout:8/785: truncate d6/dbd/d5b/d8f/dd7/fed 656073 0 2024-02-20T08:05:44.962 INFO:tasks.workunit.client.0.smithi123.stdout:9/819: dwrite d6/d2a/d27/d3c/dce/fe7 [0,4194304] 0 2024-02-20T08:05:44.964 INFO:tasks.workunit.client.0.smithi123.stdout:9/820: write d6/d19/d1a/d31/f75 [1289355,60531] 0 2024-02-20T08:05:44.965 INFO:tasks.workunit.client.0.smithi123.stdout:9/821: write d6/d19/d1a/d2b/d28/d9a/f26 [2489076,17207] 0 2024-02-20T08:05:44.971 INFO:tasks.workunit.client.0.smithi123.stdout:9/822: dwrite d6/f8d [0,4194304] 0 2024-02-20T08:05:44.978 INFO:tasks.workunit.client.0.smithi123.stdout:8/786: dwrite d6/fa8 [0,4194304] 0 2024-02-20T08:05:45.011 INFO:tasks.workunit.client.0.smithi123.stdout:0/986: sync 2024-02-20T08:05:45.012 INFO:tasks.workunit.client.0.smithi123.stdout:8/787: mkdir d6/dbd/d7e/d82/d108 0 2024-02-20T08:05:45.013 INFO:tasks.workunit.client.0.smithi123.stdout:8/788: chown d6/d32/d95/db0/fd8 54806955 1 2024-02-20T08:05:45.013 INFO:tasks.workunit.client.0.smithi123.stdout:8/789: fdatasync d6/d32/d95/f38 0 2024-02-20T08:05:45.014 INFO:tasks.workunit.client.0.smithi123.stdout:0/987: unlink d2/de/c4d 0 2024-02-20T08:05:45.017 INFO:tasks.workunit.client.0.smithi123.stdout:8/790: read d6/f71 [441487,21421] 0 2024-02-20T08:05:45.021 INFO:tasks.workunit.client.0.smithi123.stdout:9/823: dwrite d6/d19/d1a/f5b [0,4194304] 0 2024-02-20T08:05:45.023 INFO:tasks.workunit.client.0.smithi123.stdout:8/791: creat d6/dbd/d5b/d8f/d98/f109 x:0 0 0 2024-02-20T08:05:45.026 INFO:tasks.workunit.client.0.smithi123.stdout:9/824: read d6/d19/d1a/d7c/fa8 [346233,64993] 0 2024-02-20T08:05:45.026 INFO:tasks.workunit.client.0.smithi123.stdout:8/792: chown d6/l61 3 1 2024-02-20T08:05:45.029 INFO:tasks.workunit.client.0.smithi123.stdout:8/793: rmdir d6/d32/d95 39 2024-02-20T08:05:45.030 INFO:tasks.workunit.client.0.smithi123.stdout:0/988: dwrite d2/dd/fdf [0,4194304] 0 2024-02-20T08:05:45.032 INFO:tasks.workunit.client.0.smithi123.stdout:0/989: write d2/dd/d4f/d6a/fb4 [1915835,39871] 0 2024-02-20T08:05:45.032 INFO:tasks.workunit.client.0.smithi123.stdout:8/794: mkdir d6/d1c/d47/d10a 0 2024-02-20T08:05:45.037 INFO:tasks.workunit.client.0.smithi123.stdout:8/795: truncate d6/d32/fe2 39255 0 2024-02-20T08:05:45.038 INFO:tasks.workunit.client.0.smithi123.stdout:0/990: truncate d2/dd/d4f/d61/d68/f6c 2819226 0 2024-02-20T08:05:45.040 INFO:tasks.workunit.client.0.smithi123.stdout:9/825: dread d6/d19/ddf/fe6 [0,4194304] 0 2024-02-20T08:05:45.041 INFO:tasks.workunit.client.0.smithi123.stdout:8/796: symlink d6/d32/d95/d7d/l10b 0 2024-02-20T08:05:45.042 INFO:tasks.workunit.client.0.smithi123.stdout:0/991: rmdir d2/d54/d78 39 2024-02-20T08:05:45.045 INFO:tasks.workunit.client.0.smithi123.stdout:0/992: symlink d2/dd/d4f/da7/d107/l150 0 2024-02-20T08:05:45.046 INFO:tasks.workunit.client.0.smithi123.stdout:9/826: fdatasync d6/f12 0 2024-02-20T08:05:45.048 INFO:tasks.workunit.client.0.smithi123.stdout:9/827: write d6/d19/d1a/d2b/f37 [6371388,64769] 0 2024-02-20T08:05:45.049 INFO:tasks.workunit.client.0.smithi123.stdout:9/828: write d6/d19/d1a/d2b/f100 [787188,89138] 0 2024-02-20T08:05:45.052 INFO:tasks.workunit.client.0.smithi123.stdout:9/829: write d6/d19/d1a/d2b/d65/d77/da5/ffe [414422,17849] 0 2024-02-20T08:05:45.053 INFO:tasks.workunit.client.0.smithi123.stdout:9/830: readlink d6/d19/d1a/d7c/lb2 0 2024-02-20T08:05:45.053 INFO:tasks.workunit.client.0.smithi123.stdout:0/993: dwrite d2/d3/d37/d5f/f133 [0,4194304] 0 2024-02-20T08:05:45.057 INFO:tasks.workunit.client.0.smithi123.stdout:0/994: creat d2/de/d1e/d1f/f151 x:0 0 0 2024-02-20T08:05:45.061 INFO:tasks.workunit.client.0.smithi123.stdout:0/995: dread d2/dd/fbb [0,4194304] 0 2024-02-20T08:05:45.062 INFO:tasks.workunit.client.0.smithi123.stdout:0/996: fdatasync d2/d3/d37/d5f/d8a/f12c 0 2024-02-20T08:05:45.072 INFO:tasks.workunit.client.0.smithi123.stdout:8/797: dwrite d6/dbd/d7e/d82/fce [0,4194304] 0 2024-02-20T08:05:45.082 INFO:tasks.workunit.client.0.smithi123.stdout:0/997: dwrite d2/dd/d4f/d7c/ffc [0,4194304] 0 2024-02-20T08:05:45.087 INFO:tasks.workunit.client.0.smithi123.stdout:9/831: dread d6/d19/d1a/d7c/f7d [0,4194304] 0 2024-02-20T08:05:45.087 INFO:tasks.workunit.client.0.smithi123.stdout:8/798: dwrite d6/d32/d95/d7d/f8a [4194304,4194304] 0 2024-02-20T08:05:45.088 INFO:tasks.workunit.client.0.smithi123.stdout:0/998: creat d2/d54/dac/d132/f152 x:0 0 0 2024-02-20T08:05:45.093 INFO:tasks.workunit.client.0.smithi123.stdout:9/832: dread d6/d2a/d27/f5a [0,4194304] 0 2024-02-20T08:05:45.095 INFO:tasks.workunit.client.0.smithi123.stdout:0/999: chown d2/d3/d37/d5f/c93 790 1 2024-02-20T08:05:45.096 INFO:tasks.workunit.client.0.smithi123.stdout:8/799: unlink d6/cf 0 2024-02-20T08:05:45.099 INFO:tasks.workunit.client.0.smithi123.stdout:9/833: getdents d6/d19/d1a/d2b/d65 0 2024-02-20T08:05:45.101 INFO:tasks.workunit.client.0.smithi123.stdout:9/834: creat d6/d19/f102 x:0 0 0 2024-02-20T08:05:45.103 INFO:tasks.workunit.client.0.smithi123.stdout:9/835: creat d6/d2a/d27/d6f/d8b/f103 x:0 0 0 2024-02-20T08:05:45.105 INFO:tasks.workunit.client.0.smithi123.stdout:9/836: mknod d6/d2a/d27/d3c/c104 0 2024-02-20T08:05:45.108 INFO:tasks.workunit.client.0.smithi123.stdout:8/800: dread d6/d1c/d22/d8c/dcd/f44 [0,4194304] 0 2024-02-20T08:05:45.109 INFO:tasks.workunit.client.0.smithi123.stdout:9/837: rename d6/d19/d1a/d31/lc0 to d6/d19/d1a/dc6/l105 0 2024-02-20T08:05:45.109 INFO:tasks.workunit.client.0.smithi123.stdout:9/838: fsync d6/d19/d1a/d31/f75 0 2024-02-20T08:05:45.112 INFO:tasks.workunit.client.0.smithi123.stdout:9/839: symlink d6/d2a/d27/d6f/d8b/l106 0 2024-02-20T08:05:45.113 INFO:tasks.workunit.client.0.smithi123.stdout:8/801: link d6/d32/l36 d6/dbd/d7e/d82/l10c 0 2024-02-20T08:05:45.116 INFO:tasks.workunit.client.0.smithi123.stdout:9/840: dread d6/d19/d1a/d7c/d81/f97 [0,4194304] 0 2024-02-20T08:05:45.116 INFO:tasks.workunit.client.0.smithi123.stdout:8/802: unlink d6/dbd/d5b/d8f/d98/f9b 0 2024-02-20T08:05:45.117 INFO:tasks.workunit.client.0.smithi123.stdout:9/841: readlink d6/d19/d1a/d2b/d28/d9a/d3d/l87 0 2024-02-20T08:05:45.120 INFO:tasks.workunit.client.0.smithi123.stdout:8/803: creat d6/dbd/f10d x:0 0 0 2024-02-20T08:05:45.123 INFO:tasks.workunit.client.0.smithi123.stdout:8/804: symlink d6/d1c/d47/df6/l10e 0 2024-02-20T08:05:45.124 INFO:tasks.workunit.client.0.smithi123.stdout:9/842: dwrite d6/d19/d1a/d31/f75 [0,4194304] 0 2024-02-20T08:05:45.125 INFO:tasks.workunit.client.0.smithi123.stdout:8/805: readlink d6/d1c/d22/d8c/dcd/l96 0 2024-02-20T08:05:45.129 INFO:tasks.workunit.client.0.smithi123.stdout:9/843: truncate d6/d19/d1a/d6d/d7e/d80/dcc/df4/ff6 1409787 0 2024-02-20T08:05:45.135 INFO:tasks.workunit.client.0.smithi123.stdout:8/806: truncate d6/d32/d95/f38 3714710 0 2024-02-20T08:05:45.150 INFO:tasks.workunit.client.0.smithi123.stdout:9/844: dwrite d6/f12 [0,4194304] 0 2024-02-20T08:05:45.153 INFO:tasks.workunit.client.0.smithi123.stdout:9/845: rmdir d6 39 2024-02-20T08:05:45.164 INFO:tasks.workunit.client.0.smithi123.stdout:9/846: symlink d6/d19/d1a/d31/l107 0 2024-02-20T08:05:45.165 INFO:tasks.workunit.client.0.smithi123.stdout:8/807: rmdir d6/d32/d95/d3f 39 2024-02-20T08:05:45.165 INFO:tasks.workunit.client.0.smithi123.stdout:9/847: write d6/d2a/d27/d6f/fb9 [874913,2477] 0 2024-02-20T08:05:45.168 INFO:tasks.workunit.client.0.smithi123.stdout:8/808: symlink d6/dbd/d7e/l10f 0 2024-02-20T08:05:45.169 INFO:tasks.workunit.client.0.smithi123.stdout:8/809: stat d6/d1c/d22/l6d 0 2024-02-20T08:05:45.172 INFO:tasks.workunit.client.0.smithi123.stdout:9/848: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/f57 [4194304,4194304] 0 2024-02-20T08:05:45.176 INFO:tasks.workunit.client.0.smithi123.stdout:8/810: rename d6/dbd/d5b/d8f/dd7/l105 to d6/dbd/d5b/d8f/l110 0 2024-02-20T08:05:45.177 INFO:tasks.workunit.client.0.smithi123.stdout:9/849: dread d6/d2a/d27/d3c/dce/fe7 [0,4194304] 0 2024-02-20T08:05:45.178 INFO:tasks.workunit.client.0.smithi123.stdout:8/811: truncate d6/d1c/d22/d8c/dcd/f75 4115804 0 2024-02-20T08:05:45.179 INFO:tasks.workunit.client.0.smithi123.stdout:8/812: readlink d6/l50 0 2024-02-20T08:05:45.183 INFO:tasks.workunit.client.0.smithi123.stdout:9/850: creat d6/d19/d1a/d2b/d28/d9a/dae/f108 x:0 0 0 2024-02-20T08:05:45.189 INFO:tasks.workunit.client.0.smithi123.stdout:9/851: dread d6/d19/d1a/d31/f75 [0,4194304] 0 2024-02-20T08:05:45.190 INFO:tasks.workunit.client.0.smithi123.stdout:8/813: dwrite d6/d32/d95/d7d/dab/fea [0,4194304] 0 2024-02-20T08:05:45.191 INFO:tasks.workunit.client.0.smithi123.stdout:9/852: chown d6/d19/d1a/d2b/d28/d9a/d3d/f57 114645 1 2024-02-20T08:05:45.195 INFO:tasks.workunit.client.0.smithi123.stdout:8/814: creat d6/d32/d95/d7d/f111 x:0 0 0 2024-02-20T08:05:45.195 INFO:tasks.workunit.client.0.smithi123.stdout:9/853: symlink d6/d19/d1a/d6d/d7e/d80/l109 0 2024-02-20T08:05:45.197 INFO:tasks.workunit.client.0.smithi123.stdout:8/815: truncate d6/dbd/d5b/d8f/d98/f109 61422 0 2024-02-20T08:05:45.201 INFO:tasks.workunit.client.0.smithi123.stdout:9/854: rmdir d6/d19/d1a/d2b/d28/d9a/dae 39 2024-02-20T08:05:45.206 INFO:tasks.workunit.client.0.smithi123.stdout:8/816: symlink d6/d32/d95/ddd/l112 0 2024-02-20T08:05:45.209 INFO:tasks.workunit.client.0.smithi123.stdout:9/855: mknod d6/d19/d1a/d2b/d28/d9a/dae/c10a 0 2024-02-20T08:05:45.210 INFO:tasks.workunit.client.0.smithi123.stdout:8/817: fdatasync d6/d32/d95/d7d/dab/fc0 0 2024-02-20T08:05:45.213 INFO:tasks.workunit.client.0.smithi123.stdout:8/818: creat d6/d1c/d22/d8c/dcd/f113 x:0 0 0 2024-02-20T08:05:45.217 INFO:tasks.workunit.client.0.smithi123.stdout:9/856: dwrite d6/d2a/d27/d6f/d8b/fe3 [0,4194304] 0 2024-02-20T08:05:45.222 INFO:tasks.workunit.client.0.smithi123.stdout:3/877: sync 2024-02-20T08:05:45.222 INFO:tasks.workunit.client.0.smithi123.stdout:5/772: sync 2024-02-20T08:05:45.225 INFO:tasks.workunit.client.0.smithi123.stdout:8/819: dwrite d6/dbd/d5b/d8f/dd7/fed [0,4194304] 0 2024-02-20T08:05:45.226 INFO:tasks.workunit.client.0.smithi123.stdout:3/878: fsync d0/dd/ff2 0 2024-02-20T08:05:45.228 INFO:tasks.workunit.client.0.smithi123.stdout:9/857: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:45.230 INFO:tasks.workunit.client.0.smithi123.stdout:3/879: chown d0/d6/d1a/d62/d115/d2a/d86/l91 189159 1 2024-02-20T08:05:45.230 INFO:tasks.workunit.client.0.smithi123.stdout:5/773: rename d0/d34/d48/d56/d4c/f45 to d0/f101 0 2024-02-20T08:05:45.232 INFO:tasks.workunit.client.0.smithi123.stdout:3/880: readlink d0/d6/d1a/d62/d115/d1c/d3b/d43/le6 0 2024-02-20T08:05:45.239 INFO:tasks.workunit.client.0.smithi123.stdout:3/881: dwrite d0/f10d [4194304,4194304] 0 2024-02-20T08:05:45.241 INFO:tasks.workunit.client.0.smithi123.stdout:8/820: unlink d6/d32/fe1 0 2024-02-20T08:05:45.241 INFO:tasks.workunit.client.0.smithi123.stdout:9/858: mkdir d6/d19/d1a/d31/d10b 0 2024-02-20T08:05:45.245 INFO:tasks.workunit.client.0.smithi123.stdout:3/882: chown d0/d6/d1a/d62/d115/d9d/cdc 593 1 2024-02-20T08:05:45.248 INFO:tasks.workunit.client.0.smithi123.stdout:3/883: truncate d0/d6/d1a/d62/d115/d9d/fe0 8781 0 2024-02-20T08:05:45.253 INFO:tasks.workunit.client.0.smithi123.stdout:3/884: chown d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f12b 99764 1 2024-02-20T08:05:45.256 INFO:tasks.workunit.client.0.smithi123.stdout:8/821: dwrite d6/f15 [0,4194304] 0 2024-02-20T08:05:45.260 INFO:tasks.workunit.client.0.smithi123.stdout:9/859: dwrite d6/d19/d1a/d31/f75 [0,4194304] 0 2024-02-20T08:05:45.262 INFO:tasks.workunit.client.0.smithi123.stdout:5/774: dread d0/f11 [0,4194304] 0 2024-02-20T08:05:45.264 INFO:tasks.workunit.client.0.smithi123.stdout:8/822: creat d6/dbd/d5b/d8f/d99/dfb/f114 x:0 0 0 2024-02-20T08:05:45.268 INFO:tasks.workunit.client.0.smithi123.stdout:9/860: fdatasync d6/dbc/fbe 0 2024-02-20T08:05:45.270 INFO:tasks.workunit.client.0.smithi123.stdout:5/775: dread - d0/d34/d67/d80/d84/fc3 zero size 2024-02-20T08:05:45.278 INFO:tasks.workunit.client.0.smithi123.stdout:1/778: sync 2024-02-20T08:05:45.279 INFO:tasks.workunit.client.0.smithi123.stdout:7/892: sync 2024-02-20T08:05:45.279 INFO:tasks.workunit.client.0.smithi123.stdout:4/844: sync 2024-02-20T08:05:45.279 INFO:tasks.workunit.client.0.smithi123.stdout:2/866: sync 2024-02-20T08:05:45.282 INFO:tasks.workunit.client.0.smithi123.stdout:1/779: fdatasync d3/db/d34/d74/d6f/d63/dfd/d26/fd6 0 2024-02-20T08:05:45.284 INFO:tasks.workunit.client.0.smithi123.stdout:3/885: link d0/d6/d34/c7d d0/d6/d1a/d62/d115/d57/c12d 0 2024-02-20T08:05:45.288 INFO:tasks.workunit.client.0.smithi123.stdout:7/893: dwrite d0/d6/dd/d52/d26/f10a [0,4194304] 0 2024-02-20T08:05:45.291 INFO:tasks.workunit.client.0.smithi123.stdout:7/894: dread d0/d6/dd/d52/d26/d7b/feb [0,4194304] 0 2024-02-20T08:05:45.304 INFO:tasks.workunit.client.0.smithi123.stdout:1/780: truncate d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/f9e 813498 0 2024-02-20T08:05:45.308 INFO:tasks.workunit.client.0.smithi123.stdout:8/823: write d6/f6e [1042160,81983] 0 2024-02-20T08:05:45.308 INFO:tasks.workunit.client.0.smithi123.stdout:2/867: dread f10 [0,4194304] 0 2024-02-20T08:05:45.311 INFO:tasks.workunit.client.0.smithi123.stdout:4/845: dread d3/d18/f19 [0,4194304] 0 2024-02-20T08:05:45.317 INFO:tasks.workunit.client.0.smithi123.stdout:9/861: link d6/dbc/lf0 d6/d19/d1a/d2b/d28/d9a/d3d/l10c 0 2024-02-20T08:05:45.318 INFO:tasks.workunit.client.0.smithi123.stdout:5/776: write d0/d34/d48/d56/d25/f2d [2140586,90769] 0 2024-02-20T08:05:45.318 INFO:tasks.workunit.client.0.smithi123.stdout:9/862: chown d6/d19/d1a/d2b/ld3 198 1 2024-02-20T08:05:45.324 INFO:tasks.workunit.client.0.smithi123.stdout:7/895: mkdir d0/d6/dd/d52/d138 0 2024-02-20T08:05:45.332 INFO:tasks.workunit.client.0.smithi123.stdout:9/863: rmdir d6/d19/d1a/d2b/d28/d9a/dae 39 2024-02-20T08:05:45.334 INFO:tasks.workunit.client.0.smithi123.stdout:5/777: readlink d0/d34/d48/d56/dbb/d27/l57 0 2024-02-20T08:05:45.338 INFO:tasks.workunit.client.0.smithi123.stdout:7/896: rename d0/db/d21/d42 to d0/d6/d9d/d139 0 2024-02-20T08:05:45.340 INFO:tasks.workunit.client.0.smithi123.stdout:2/868: creat d1a/d29/d42/d73/df0/f126 x:0 0 0 2024-02-20T08:05:45.343 INFO:tasks.workunit.client.0.smithi123.stdout:3/886: write d0/d6/d32/f125 [145524,125583] 0 2024-02-20T08:05:45.344 INFO:tasks.workunit.client.0.smithi123.stdout:2/869: dread f10 [0,4194304] 0 2024-02-20T08:05:45.346 INFO:tasks.workunit.client.0.smithi123.stdout:1/781: write d3/db/d34/f1b [5158250,86720] 0 2024-02-20T08:05:45.348 INFO:tasks.workunit.client.0.smithi123.stdout:3/887: write d0/d6/d1a/da1/f100 [645100,17940] 0 2024-02-20T08:05:45.351 INFO:tasks.workunit.client.0.smithi123.stdout:8/824: dwrite d6/d32/d95/d3f/fcf [0,4194304] 0 2024-02-20T08:05:45.351 INFO:tasks.workunit.client.0.smithi123.stdout:5/778: creat d0/d34/d48/d56/d4c/d43/dd2/ddd/f102 x:0 0 0 2024-02-20T08:05:45.353 INFO:tasks.workunit.client.0.smithi123.stdout:5/779: write d0/d34/d48/d56/dbb/f1e [2214966,2956] 0 2024-02-20T08:05:45.354 INFO:tasks.workunit.client.0.smithi123.stdout:7/897: write d0/d6/dd/d52/d35/d9c/f56 [1683803,61160] 0 2024-02-20T08:05:45.355 INFO:tasks.workunit.client.0.smithi123.stdout:5/780: chown d0/d34/d48/d56/dbb/d60/l79 5582 1 2024-02-20T08:05:45.356 INFO:tasks.workunit.client.0.smithi123.stdout:7/898: dread d0/db/d38/fe9 [0,4194304] 0 2024-02-20T08:05:45.368 INFO:tasks.workunit.client.0.smithi123.stdout:3/888: creat d0/d6/d1a/d62/d115/d1c/d3b/d43/f12e x:0 0 0 2024-02-20T08:05:45.370 INFO:tasks.workunit.client.0.smithi123.stdout:8/825: fsync d6/d32/d95/d7d/dab/fc1 0 2024-02-20T08:05:45.379 INFO:tasks.workunit.client.0.smithi123.stdout:4/846: dwrite d3/d18/d7d/d8b/d95/f109 [0,4194304] 0 2024-02-20T08:05:45.380 INFO:tasks.workunit.client.0.smithi123.stdout:4/847: chown d3/d2c/d43/d26/d2e/fee 41 1 2024-02-20T08:05:45.381 INFO:tasks.workunit.client.0.smithi123.stdout:4/848: chown d3/d18/f23 105024544 1 2024-02-20T08:05:45.384 INFO:tasks.workunit.client.0.smithi123.stdout:7/899: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/d13a 0 2024-02-20T08:05:45.388 INFO:tasks.workunit.client.0.smithi123.stdout:3/889: mknod d0/dd/c12f 0 2024-02-20T08:05:45.389 INFO:tasks.workunit.client.0.smithi123.stdout:9/864: truncate d6/d19/d1a/d2b/d28/d9a/f26 3079074 0 2024-02-20T08:05:45.400 INFO:tasks.workunit.client.0.smithi123.stdout:4/849: creat d3/d1e/f118 x:0 0 0 2024-02-20T08:05:45.404 INFO:tasks.workunit.client.0.smithi123.stdout:2/870: write d1a/f2e [3032751,3019] 0 2024-02-20T08:05:45.406 INFO:tasks.workunit.client.0.smithi123.stdout:5/781: dwrite d0/d34/d67/d80/dcd/fd1 [0,4194304] 0 2024-02-20T08:05:45.407 INFO:tasks.workunit.client.0.smithi123.stdout:9/865: mkdir d6/d2a/d27/d6f/d10d 0 2024-02-20T08:05:45.409 INFO:tasks.workunit.client.0.smithi123.stdout:3/890: dread d0/dd/d48/d6a/d74/f12a [0,4194304] 0 2024-02-20T08:05:45.420 INFO:tasks.workunit.client.0.smithi123.stdout:7/900: mkdir d0/d6/dd/d52/d35/d9c/d13b 0 2024-02-20T08:05:45.420 INFO:tasks.workunit.client.0.smithi123.stdout:1/782: link d3/db/d7f/c10f d3/db/d7f/c117 0 2024-02-20T08:05:45.421 INFO:tasks.workunit.client.0.smithi123.stdout:7/901: dread - d0/db/f100 zero size 2024-02-20T08:05:45.421 INFO:tasks.workunit.client.0.smithi123.stdout:2/871: fsync d1a/d29/d42/d52/d98/da1/daa/fd3 0 2024-02-20T08:05:45.425 INFO:tasks.workunit.client.0.smithi123.stdout:2/872: chown d1a/d29/d42/fbd 60680031 1 2024-02-20T08:05:45.426 INFO:tasks.workunit.client.0.smithi123.stdout:8/826: dwrite d6/f80 [0,4194304] 0 2024-02-20T08:05:45.428 INFO:tasks.workunit.client.0.smithi123.stdout:5/782: rename d0/d34/d67/d80/dcd/fd1 to d0/d34/d48/d56/d3e/ddf/f103 0 2024-02-20T08:05:45.441 INFO:tasks.workunit.client.0.smithi123.stdout:3/891: dread d0/dd/f8 [0,4194304] 0 2024-02-20T08:05:45.445 INFO:tasks.workunit.client.0.smithi123.stdout:4/850: dread d3/d18/f32 [0,4194304] 0 2024-02-20T08:05:45.474 INFO:tasks.workunit.client.0.smithi123.stdout:7/902: mknod d0/d6/d9d/d139/c13c 0 2024-02-20T08:05:45.476 INFO:tasks.workunit.client.0.smithi123.stdout:2/873: dread - d1a/fc5 zero size 2024-02-20T08:05:45.478 INFO:tasks.workunit.client.0.smithi123.stdout:5/783: symlink d0/d34/d48/d56/dbb/d27/d37/l104 0 2024-02-20T08:05:45.489 INFO:tasks.workunit.client.0.smithi123.stdout:8/827: dread d6/dbd/f85 [4194304,4194304] 0 2024-02-20T08:05:45.490 INFO:tasks.workunit.client.0.smithi123.stdout:5/784: rmdir d0/d34/d48/d56/d3e 39 2024-02-20T08:05:45.494 INFO:tasks.workunit.client.0.smithi123.stdout:9/866: getdents d6/d19/d1a/d6d 0 2024-02-20T08:05:45.496 INFO:tasks.workunit.client.0.smithi123.stdout:1/783: creat d3/db/d34/d74/d6f/d63/dfd/d2c/d45/f118 x:0 0 0 2024-02-20T08:05:45.498 INFO:tasks.workunit.client.0.smithi123.stdout:7/903: symlink d0/d6/dd/d52/d138/l13d 0 2024-02-20T08:05:45.498 INFO:tasks.workunit.client.0.smithi123.stdout:7/904: write d0/f5 [4587440,71948] 0 2024-02-20T08:05:45.499 INFO:tasks.workunit.client.0.smithi123.stdout:4/851: link d3/d18/f51 d3/d18/d7d/d8b/d95/f119 0 2024-02-20T08:05:45.500 INFO:tasks.workunit.client.0.smithi123.stdout:4/852: fsync d3/d2c/d5a/f92 0 2024-02-20T08:05:45.501 INFO:tasks.workunit.client.0.smithi123.stdout:7/905: write d0/d6/dd/d52/d10f/ff9 [206908,116885] 0 2024-02-20T08:05:45.501 INFO:tasks.workunit.client.0.smithi123.stdout:9/867: mkdir d6/d19/d1a/d7c/d81/d10e 0 2024-02-20T08:05:45.503 INFO:tasks.workunit.client.0.smithi123.stdout:1/784: chown d3/fc 1064074491 1 2024-02-20T08:05:45.513 INFO:tasks.workunit.client.0.smithi123.stdout:1/785: rename d3/db/d34/f94 to d3/db/d7f/f119 0 2024-02-20T08:05:45.513 INFO:tasks.workunit.client.0.smithi123.stdout:5/785: dread d0/f19 [4194304,4194304] 0 2024-02-20T08:05:45.515 INFO:tasks.workunit.client.0.smithi123.stdout:4/853: creat d3/dcb/f11a x:0 0 0 2024-02-20T08:05:45.515 INFO:tasks.workunit.client.0.smithi123.stdout:1/786: write d3/db/d34/d74/d6f/d63/dfd/d36/fa8 [7416411,85936] 0 2024-02-20T08:05:45.516 INFO:tasks.workunit.client.0.smithi123.stdout:4/854: fsync d3/d97/dda/db6/f9e 0 2024-02-20T08:05:45.517 INFO:tasks.workunit.client.0.smithi123.stdout:1/787: read - d3/db/d41/de5/ff9 zero size 2024-02-20T08:05:45.519 INFO:tasks.workunit.client.0.smithi123.stdout:9/868: link f5 d6/d2a/d27/d3c/dce/f10f 0 2024-02-20T08:05:45.520 INFO:tasks.workunit.client.0.smithi123.stdout:5/786: truncate d0/fc 3107046 0 2024-02-20T08:05:45.526 INFO:tasks.workunit.client.0.smithi123.stdout:9/869: write d6/d19/d1a/d2b/d28/d9a/d3d/fa7 [31159,55512] 0 2024-02-20T08:05:45.527 INFO:tasks.workunit.client.0.smithi123.stdout:5/787: rmdir d0/d34/d48/d56/dbb/d27/d4e/d91 39 2024-02-20T08:05:45.528 INFO:tasks.workunit.client.0.smithi123.stdout:5/788: write d0/d34/d48/d56/d4c/f6b [4063664,77167] 0 2024-02-20T08:05:45.537 INFO:tasks.workunit.client.0.smithi123.stdout:4/855: rename d3/d18/cf5 to d3/d18/d7d/d96/dbc/c11b 0 2024-02-20T08:05:45.541 INFO:tasks.workunit.client.0.smithi123.stdout:4/856: creat d3/d2c/d43/d26/d3e/f11c x:0 0 0 2024-02-20T08:05:45.542 INFO:tasks.workunit.client.0.smithi123.stdout:4/857: stat d3/d1e/c80 0 2024-02-20T08:05:45.543 INFO:tasks.workunit.client.0.smithi123.stdout:1/788: getdents d3/db/d34/d74/d6f/d63/dfd 0 2024-02-20T08:05:45.544 INFO:tasks.workunit.client.0.smithi123.stdout:9/870: dread d6/d19/d1a/d2b/d28/f64 [0,4194304] 0 2024-02-20T08:05:45.545 INFO:tasks.workunit.client.0.smithi123.stdout:4/858: creat d3/d97/df0/f11d x:0 0 0 2024-02-20T08:05:45.546 INFO:tasks.workunit.client.0.smithi123.stdout:9/871: chown d6/d19/d1a/d6d/d7e/d80/fd4 847066387 1 2024-02-20T08:05:45.554 INFO:tasks.workunit.client.0.smithi123.stdout:9/872: mkdir d6/d19/d1a/d31/d10b/d110 0 2024-02-20T08:05:45.556 INFO:tasks.workunit.client.0.smithi123.stdout:9/873: mkdir d6/d19/d1a/d31/d111 0 2024-02-20T08:05:45.558 INFO:tasks.workunit.client.0.smithi123.stdout:9/874: truncate d6/d19/d1a/d2b/d28/d9a/d3d/fa7 655754 0 2024-02-20T08:05:45.561 INFO:tasks.workunit.client.0.smithi123.stdout:9/875: symlink d6/d2a/l112 0 2024-02-20T08:05:45.564 INFO:tasks.workunit.client.0.smithi123.stdout:2/874: truncate d1a/d29/d42/d52/d98/da1/daa/fd3 113268 0 2024-02-20T08:05:45.566 INFO:tasks.workunit.client.0.smithi123.stdout:9/876: dwrite d6/d19/f102 [0,4194304] 0 2024-02-20T08:05:45.568 INFO:tasks.workunit.client.0.smithi123.stdout:2/875: creat d1a/d29/d42/d4e/f127 x:0 0 0 2024-02-20T08:05:45.568 INFO:tasks.workunit.client.0.smithi123.stdout:3/892: fsync d0/dd/d48/d6a/f108 0 2024-02-20T08:05:45.569 INFO:tasks.workunit.client.0.smithi123.stdout:2/876: chown d1a/d29/d42/d73/d8f 7000857 1 2024-02-20T08:05:45.570 INFO:tasks.workunit.client.0.smithi123.stdout:3/893: write d0/d6/d1a/d4b/d95/f10c [4006349,103877] 0 2024-02-20T08:05:45.571 INFO:tasks.workunit.client.0.smithi123.stdout:9/877: truncate d6/d19/d1a/fdc 162632 0 2024-02-20T08:05:45.576 INFO:tasks.workunit.client.0.smithi123.stdout:3/894: fdatasync d0/d6/d1a/d62/d115/d1c/d3b/f8a 0 2024-02-20T08:05:45.580 INFO:tasks.workunit.client.0.smithi123.stdout:3/895: mknod d0/d6/d32/c130 0 2024-02-20T08:05:45.584 INFO:tasks.workunit.client.0.smithi123.stdout:3/896: fsync d0/d6/d1a/d62/d115/d1c/d20/ffa 0 2024-02-20T08:05:45.587 INFO:tasks.workunit.client.0.smithi123.stdout:7/906: write d0/d6/dd/d52/d35/f74 [561554,51425] 0 2024-02-20T08:05:45.593 INFO:tasks.workunit.client.0.smithi123.stdout:5/789: unlink d0/f19 0 2024-02-20T08:05:45.598 INFO:tasks.workunit.client.0.smithi123.stdout:2/877: dread d1a/d29/d42/f49 [0,4194304] 0 2024-02-20T08:05:45.599 INFO:tasks.workunit.client.0.smithi123.stdout:7/907: link d0/d6/dd/d52/d26/d9b/f134 d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f13e 0 2024-02-20T08:05:45.599 INFO:tasks.workunit.client.0.smithi123.stdout:2/878: chown d1a/d7f/fd5 984 1 2024-02-20T08:05:45.600 INFO:tasks.workunit.client.0.smithi123.stdout:5/790: dwrite d0/d34/d48/d56/dce/fe4 [0,4194304] 0 2024-02-20T08:05:45.607 INFO:tasks.workunit.client.0.smithi123.stdout:7/908: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d73/f13f x:0 0 0 2024-02-20T08:05:45.615 INFO:tasks.workunit.client.0.smithi123.stdout:5/791: getdents d0/d34 0 2024-02-20T08:05:45.616 INFO:tasks.workunit.client.0.smithi123.stdout:1/789: dwrite d3/db/f4e [0,4194304] 0 2024-02-20T08:05:45.618 INFO:tasks.workunit.client.0.smithi123.stdout:4/859: dwrite d3/d2c/d43/d26/d3e/da9/fc8 [0,4194304] 0 2024-02-20T08:05:45.619 INFO:tasks.workunit.client.0.smithi123.stdout:4/860: chown d3/d18/f31 328347 1 2024-02-20T08:05:45.623 INFO:tasks.workunit.client.0.smithi123.stdout:2/879: dread d1a/fb2 [0,4194304] 0 2024-02-20T08:05:45.625 INFO:tasks.workunit.client.0.smithi123.stdout:2/880: chown d1a/d29/d39 73420509 1 2024-02-20T08:05:45.626 INFO:tasks.workunit.client.0.smithi123.stdout:5/792: dwrite d0/d34/d67/d80/d84/fe2 [0,4194304] 0 2024-02-20T08:05:45.629 INFO:tasks.workunit.client.0.smithi123.stdout:2/881: dread - d1a/d29/d42/d52/d98/dd6/f105 zero size 2024-02-20T08:05:45.631 INFO:tasks.workunit.client.0.smithi123.stdout:2/882: fdatasync d1a/d29/d42/d52/d98/fc0 0 2024-02-20T08:05:45.631 INFO:tasks.workunit.client.0.smithi123.stdout:4/861: dwrite d3/d2c/d43/fff [0,4194304] 0 2024-02-20T08:05:45.633 INFO:tasks.workunit.client.0.smithi123.stdout:2/883: chown d1a/d29/d42/d4e/f124 13558428 1 2024-02-20T08:05:45.633 INFO:tasks.workunit.client.0.smithi123.stdout:1/790: dread d3/db/d34/f2b [0,4194304] 0 2024-02-20T08:05:45.634 INFO:tasks.workunit.client.0.smithi123.stdout:2/884: chown d1a/d29/d42/d4e 1019929 1 2024-02-20T08:05:45.635 INFO:tasks.workunit.client.0.smithi123.stdout:2/885: chown d1a/l33 6810 1 2024-02-20T08:05:45.636 INFO:tasks.workunit.client.0.smithi123.stdout:1/791: truncate d3/d47/f10b 4408373 0 2024-02-20T08:05:45.640 INFO:tasks.workunit.client.0.smithi123.stdout:3/897: write d0/d6/d32/f33 [282123,17688] 0 2024-02-20T08:05:45.643 INFO:tasks.workunit.client.0.smithi123.stdout:3/898: dread d0/dd/d48/d6a/f108 [0,4194304] 0 2024-02-20T08:05:45.644 INFO:tasks.workunit.client.0.smithi123.stdout:5/793: truncate d0/d34/d48/d56/d3e/f41 816540 0 2024-02-20T08:05:45.653 INFO:tasks.workunit.client.0.smithi123.stdout:3/899: fsync d0/d6/d1a/d62/d115/f83 0 2024-02-20T08:05:45.654 INFO:tasks.workunit.client.0.smithi123.stdout:3/900: chown d0/d6/d1a/d62/d115/d1c/d21/d8e 0 1 2024-02-20T08:05:45.655 INFO:tasks.workunit.client.0.smithi123.stdout:3/901: chown d0/d6/d1a/d62/d115/d9d/f11e 2017 1 2024-02-20T08:05:45.656 INFO:tasks.workunit.client.0.smithi123.stdout:1/792: link d3/db/d34/f1b d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/f11a 0 2024-02-20T08:05:45.657 INFO:tasks.workunit.client.0.smithi123.stdout:7/909: write d0/d6/dd/d52/d26/d7b/fa5 [37574,53665] 0 2024-02-20T08:05:45.661 INFO:tasks.workunit.client.0.smithi123.stdout:3/902: readlink d0/d6/d1a/d62/d115/de3/l122 0 2024-02-20T08:05:45.667 INFO:tasks.workunit.client.0.smithi123.stdout:2/886: dread d1a/d29/d42/d52/d98/fc0 [0,4194304] 0 2024-02-20T08:05:45.668 INFO:tasks.workunit.client.0.smithi123.stdout:2/887: chown d1a/d29/d42/d52/f56 16222 1 2024-02-20T08:05:45.670 INFO:tasks.workunit.client.0.smithi123.stdout:1/793: symlink d3/db/d34/d74/d6f/d63/dfd/d26/d56/d10d/l11b 0 2024-02-20T08:05:45.671 INFO:tasks.workunit.client.0.smithi123.stdout:5/794: getdents d0/d34/d48/d56/dce 0 2024-02-20T08:05:45.672 INFO:tasks.workunit.client.0.smithi123.stdout:4/862: write d3/d2c/d43/d34/f55 [2821435,10090] 0 2024-02-20T08:05:45.674 INFO:tasks.workunit.client.0.smithi123.stdout:5/795: write d0/d34/d48/d56/dbb/d27/d4e/f7f [155292,68611] 0 2024-02-20T08:05:45.675 INFO:tasks.workunit.client.0.smithi123.stdout:5/796: dread - d0/d34/d48/d56/d3e/ddf/ff3 zero size 2024-02-20T08:05:45.677 INFO:tasks.workunit.client.0.smithi123.stdout:3/903: mkdir d0/d6/d1a/d62/d115/d1c/d61/dd1/d131 0 2024-02-20T08:05:45.678 INFO:tasks.workunit.client.0.smithi123.stdout:3/904: write d0/d6/d1a/d62/d115/d1c/d21/f29 [5085769,43516] 0 2024-02-20T08:05:45.714 INFO:tasks.workunit.client.0.smithi123.stdout:1/794: unlink d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/df4/f110 0 2024-02-20T08:05:45.750 INFO:tasks.workunit.client.0.smithi123.stdout:3/905: mkdir d0/d6/d1a/d62/d82/da2/d132 0 2024-02-20T08:05:45.751 INFO:tasks.workunit.client.0.smithi123.stdout:7/910: truncate d0/fdf 1055884 0 2024-02-20T08:05:45.760 INFO:tasks.workunit.client.0.smithi123.stdout:4/863: write d3/d2c/d43/f84 [953561,63189] 0 2024-02-20T08:05:45.765 INFO:tasks.workunit.client.0.smithi123.stdout:7/911: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/d79/f140 x:0 0 0 2024-02-20T08:05:45.768 INFO:tasks.workunit.client.0.smithi123.stdout:3/906: rmdir d0/d6/d1a/d62/d82/da2 39 2024-02-20T08:05:45.769 INFO:tasks.workunit.client.0.smithi123.stdout:2/888: dwrite d1a/f28 [0,4194304] 0 2024-02-20T08:05:45.770 INFO:tasks.workunit.client.0.smithi123.stdout:2/889: readlink d1a/d4f/l99 0 2024-02-20T08:05:45.771 INFO:tasks.workunit.client.0.smithi123.stdout:2/890: readlink d1a/d29/d42/d73/lc3 0 2024-02-20T08:05:45.772 INFO:tasks.workunit.client.0.smithi123.stdout:5/797: getdents d0/d34/d48/d4b/d51 0 2024-02-20T08:05:45.777 INFO:tasks.workunit.client.0.smithi123.stdout:1/795: getdents d3/db/d34/d74/d6f 0 2024-02-20T08:05:45.782 INFO:tasks.workunit.client.0.smithi123.stdout:3/907: dwrite d0/d6/d1a/d62/d115/d1c/d3b/d43/fcc [0,4194304] 0 2024-02-20T08:05:45.785 INFO:tasks.workunit.client.0.smithi123.stdout:2/891: rename d1a/d29/d39/f65 to d1a/d29/d42/d73/df0/f128 0 2024-02-20T08:05:45.786 INFO:tasks.workunit.client.0.smithi123.stdout:7/912: dwrite d0/f64 [0,4194304] 0 2024-02-20T08:05:45.790 INFO:tasks.workunit.client.0.smithi123.stdout:3/908: mkdir d0/d6/d1a/d62/d115/d1c/d21/dd9/d133 0 2024-02-20T08:05:45.791 INFO:tasks.workunit.client.0.smithi123.stdout:2/892: dread - d1a/d29/d5d/d97/da9/dfe/f119 zero size 2024-02-20T08:05:45.793 INFO:tasks.workunit.client.0.smithi123.stdout:5/798: dwrite d0/d34/d48/d56/dbb/d27/d4e/d9b/fa0 [0,4194304] 0 2024-02-20T08:05:45.796 INFO:tasks.workunit.client.0.smithi123.stdout:3/909: chown d0/d6/d1a/d62/d115/d1c/d3b/fcd 490839463 1 2024-02-20T08:05:45.796 INFO:tasks.workunit.client.0.smithi123.stdout:1/796: write d3/db/d34/d74/d6f/d63/dfd/d26/d56/fb7 [112802,90372] 0 2024-02-20T08:05:45.797 INFO:tasks.workunit.client.0.smithi123.stdout:2/893: fsync d1a/d7f/fd5 0 2024-02-20T08:05:45.800 INFO:tasks.workunit.client.0.smithi123.stdout:3/910: chown d0/lf7 1786846 1 2024-02-20T08:05:45.801 INFO:tasks.workunit.client.0.smithi123.stdout:4/864: dread d3/d18/f31 [0,4194304] 0 2024-02-20T08:05:45.805 INFO:tasks.workunit.client.0.smithi123.stdout:7/913: rename d0/db/d38/l10d to d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d124/l141 0 2024-02-20T08:05:45.813 INFO:tasks.workunit.client.0.smithi123.stdout:4/865: dread d3/d97/fbe [0,4194304] 0 2024-02-20T08:05:45.813 INFO:tasks.workunit.client.0.smithi123.stdout:4/866: stat d3/d18/c42 0 2024-02-20T08:05:45.815 INFO:tasks.workunit.client.0.smithi123.stdout:2/894: rename d1a/d29/d42/d73/f8b to d1a/d29/d42/d80/da3/ded/f129 0 2024-02-20T08:05:45.817 INFO:tasks.workunit.client.0.smithi123.stdout:7/914: mknod d0/df4/c142 0 2024-02-20T08:05:45.825 INFO:tasks.workunit.client.0.smithi123.stdout:3/911: creat d0/d6/d1a/d62/d115/d1c/f134 x:0 0 0 2024-02-20T08:05:45.827 INFO:tasks.workunit.client.0.smithi123.stdout:2/895: symlink d1a/d125/l12a 0 2024-02-20T08:05:45.828 INFO:tasks.workunit.client.0.smithi123.stdout:5/799: dwrite d0/d34/d48/f6e [0,4194304] 0 2024-02-20T08:05:45.830 INFO:tasks.workunit.client.0.smithi123.stdout:1/797: dwrite d3/db/d34/d74/d6f/d63/dfd/d2c/f65 [0,4194304] 0 2024-02-20T08:05:45.836 INFO:tasks.workunit.client.0.smithi123.stdout:3/912: symlink d0/d6/d1a/d62/d115/d1c/d21/d8e/l135 0 2024-02-20T08:05:45.836 INFO:tasks.workunit.client.0.smithi123.stdout:7/915: link d0/d6/d7/d68/c129 d0/d6/dd/d52/d35/d9c/d70/dd9/d12b/c143 0 2024-02-20T08:05:45.837 INFO:tasks.workunit.client.0.smithi123.stdout:3/913: chown d0/d6/d1a/d62/d115/d1c/d61 15561003 1 2024-02-20T08:05:45.838 INFO:tasks.workunit.client.0.smithi123.stdout:3/914: chown d0/d6/d1a/d62/d115/d1c/d61 2007959 1 2024-02-20T08:05:45.839 INFO:tasks.workunit.client.0.smithi123.stdout:5/800: creat d0/d34/d48/d56/dbb/f105 x:0 0 0 2024-02-20T08:05:45.841 INFO:tasks.workunit.client.0.smithi123.stdout:4/867: getdents d3/d2c/d43/d26/d3e/da9 0 2024-02-20T08:05:45.851 INFO:tasks.workunit.client.0.smithi123.stdout:4/868: dread d3/d2c/d43/f84 [0,4194304] 0 2024-02-20T08:05:45.851 INFO:tasks.workunit.client.0.smithi123.stdout:7/916: dread d0/d6/d7/f20 [0,4194304] 0 2024-02-20T08:05:45.851 INFO:tasks.workunit.client.0.smithi123.stdout:5/801: creat d0/f106 x:0 0 0 2024-02-20T08:05:45.851 INFO:tasks.workunit.client.0.smithi123.stdout:2/896: write d1a/d29/d5d/d97/faf [5047065,11218] 0 2024-02-20T08:05:45.851 INFO:tasks.workunit.client.0.smithi123.stdout:4/869: readlink d3/d97/dda/l74 0 2024-02-20T08:05:45.853 INFO:tasks.workunit.client.0.smithi123.stdout:2/897: dread - d1a/d29/d42/d52/d98/dd6/fd7 zero size 2024-02-20T08:05:45.853 INFO:tasks.workunit.client.0.smithi123.stdout:3/915: unlink d0/d6/d1a/d62/d115/d1c/d3b/d43/f50 0 2024-02-20T08:05:45.854 INFO:tasks.workunit.client.0.smithi123.stdout:4/870: write d3/d18/f105 [962687,56882] 0 2024-02-20T08:05:45.855 INFO:tasks.workunit.client.0.smithi123.stdout:1/798: mkdir d3/db/d34/d74/d6f/d63/dfd/d2c/d11c 0 2024-02-20T08:05:45.856 INFO:tasks.workunit.client.0.smithi123.stdout:3/916: truncate d0/d6/d32/f125 333268 0 2024-02-20T08:05:45.858 INFO:tasks.workunit.client.0.smithi123.stdout:4/871: fsync d3/d2c/d5a/d7e/f82 0 2024-02-20T08:05:45.858 INFO:tasks.workunit.client.0.smithi123.stdout:1/799: chown d3/db/d34/d74/d6f/d63/dfd/d36/d59/f116 8873 1 2024-02-20T08:05:45.861 INFO:tasks.workunit.client.0.smithi123.stdout:2/898: unlink d1a/f2f 0 2024-02-20T08:05:45.862 INFO:tasks.workunit.client.0.smithi123.stdout:2/899: write d1a/d29/d42/d4e/f124 [763932,94129] 0 2024-02-20T08:05:45.865 INFO:tasks.workunit.client.0.smithi123.stdout:3/917: symlink d0/d6/d1a/d62/d115/d1c/d20/l136 0 2024-02-20T08:05:45.866 INFO:tasks.workunit.client.0.smithi123.stdout:7/917: getdents d0/d6/dd/d52/d35/d9c/d70/dd9/d12b/d119 0 2024-02-20T08:05:45.905 INFO:tasks.workunit.client.0.smithi123.stdout:7/918: symlink d0/d6/dd/d52/d26/d9b/d61/l144 0 2024-02-20T08:05:45.905 INFO:tasks.workunit.client.0.smithi123.stdout:3/918: creat d0/d6/d1a/d62/d115/d57/dd0/daa/f137 x:0 0 0 2024-02-20T08:05:45.906 INFO:tasks.workunit.client.0.smithi123.stdout:1/800: unlink d3/d47/f9c 0 2024-02-20T08:05:45.906 INFO:tasks.workunit.client.0.smithi123.stdout:2/900: mknod d1a/d29/c12b 0 2024-02-20T08:05:45.908 INFO:tasks.workunit.client.0.smithi123.stdout:7/919: read d0/d6/dd/d52/d35/d9c/d70/fae [762578,47985] 0 2024-02-20T08:05:45.908 INFO:tasks.workunit.client.0.smithi123.stdout:3/919: read d0/d6/d1a/d62/d115/d1c/d3b/f8a [1346558,101276] 0 2024-02-20T08:05:45.909 INFO:tasks.workunit.client.0.smithi123.stdout:5/802: creat d0/d34/d48/d56/dbb/d27/d4e/f107 x:0 0 0 2024-02-20T08:05:46.028 INFO:tasks.workunit.client.0.smithi123.stdout:8/828: sync 2024-02-20T08:05:46.032 INFO:tasks.workunit.client.0.smithi123.stdout:7/920: dread d0/db/f27 [0,4194304] 0 2024-02-20T08:05:46.034 INFO:tasks.workunit.client.0.smithi123.stdout:7/921: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/fe6 [287069,107428] 0 2024-02-20T08:05:46.122 INFO:tasks.workunit.client.0.smithi123.stdout:1/801: link d3/de/f60 d3/db/d41/de5/dfe/f11d 0 2024-02-20T08:05:46.125 INFO:tasks.workunit.client.0.smithi123.stdout:3/920: rename d0/dd/d48/d8d/dcf/cec to d0/d6/d1a/d62/d82/da2/c138 0 2024-02-20T08:05:46.126 INFO:tasks.workunit.client.0.smithi123.stdout:8/829: rmdir d6/d1c/d22/d8c/dcd/db9/dc3/dd3 39 2024-02-20T08:05:46.127 INFO:tasks.workunit.client.0.smithi123.stdout:7/922: mkdir d0/d6/dd/d52/d26/d9b/d61/d145 0 2024-02-20T08:05:46.135 INFO:tasks.workunit.client.0.smithi123.stdout:1/802: rename d3/db/f7e to d3/db/d34/d74/d6f/d63/dfd/d2c/d4f/dcc/f11e 0 2024-02-20T08:05:46.136 INFO:tasks.workunit.client.0.smithi123.stdout:7/923: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/l146 0 2024-02-20T08:05:46.140 INFO:tasks.workunit.client.0.smithi123.stdout:7/924: rmdir d0/d6/dd/d97 39 2024-02-20T08:05:46.141 INFO:tasks.workunit.client.0.smithi123.stdout:3/921: dread d0/d6/d1a/d62/d115/f22 [0,4194304] 0 2024-02-20T08:05:46.142 INFO:tasks.workunit.client.0.smithi123.stdout:3/922: stat d0/lc 0 2024-02-20T08:05:46.147 INFO:tasks.workunit.client.0.smithi123.stdout:3/923: mknod d0/d6/d1a/d62/d82/da2/c139 0 2024-02-20T08:05:46.149 INFO:tasks.workunit.client.0.smithi123.stdout:1/803: getdents d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f 0 2024-02-20T08:05:46.156 INFO:tasks.workunit.client.0.smithi123.stdout:9/878: sync 2024-02-20T08:05:46.157 INFO:tasks.workunit.client.0.smithi123.stdout:9/879: chown d6/d19/d1a/d7c/d81 79 1 2024-02-20T08:05:46.161 INFO:tasks.workunit.client.0.smithi123.stdout:9/880: creat d6/d2a/f113 x:0 0 0 2024-02-20T08:05:46.165 INFO:tasks.workunit.client.0.smithi123.stdout:5/803: truncate d0/d34/d48/d56/d4c/f6b 3053157 0 2024-02-20T08:05:46.165 INFO:tasks.workunit.client.0.smithi123.stdout:3/924: dread d0/f8c [0,4194304] 0 2024-02-20T08:05:46.166 INFO:tasks.workunit.client.0.smithi123.stdout:5/804: readlink d0/d34/d48/d56/d25/l5c 0 2024-02-20T08:05:46.166 INFO:tasks.workunit.client.0.smithi123.stdout:9/881: mknod d6/d2a/d27/c114 0 2024-02-20T08:05:46.171 INFO:tasks.workunit.client.0.smithi123.stdout:9/882: mknod d6/d19/d1a/d2b/d28/da0/c115 0 2024-02-20T08:05:46.172 INFO:tasks.workunit.client.0.smithi123.stdout:3/925: truncate d0/d6/d1a/d62/d115/d1c/d21/d8e/fcb 502364 0 2024-02-20T08:05:46.174 INFO:tasks.workunit.client.0.smithi123.stdout:3/926: dread - d0/d6/d1a/d62/d115/d57/dd0/daa/f137 zero size 2024-02-20T08:05:46.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/805: truncate d0/d34/d48/d56/d3e/f41 1545952 0 2024-02-20T08:05:46.177 INFO:tasks.workunit.client.0.smithi123.stdout:9/883: creat d6/d2a/d27/d6f/d8b/d98/f116 x:0 0 0 2024-02-20T08:05:46.178 INFO:tasks.workunit.client.0.smithi123.stdout:9/884: chown d6/d19/d1a/d6d/d7e 283 1 2024-02-20T08:05:46.178 INFO:tasks.workunit.client.0.smithi123.stdout:9/885: chown d6/d19/d1a/d6d/d7e/d80 7514351 1 2024-02-20T08:05:46.180 INFO:tasks.workunit.client.0.smithi123.stdout:5/806: mkdir d0/d34/d48/d56/dbb/d27/d4e/d9b/d108 0 2024-02-20T08:05:46.184 INFO:tasks.workunit.client.0.smithi123.stdout:5/807: rmdir d0/d34/d48/d56/d4c/d43/dd2/ddd 39 2024-02-20T08:05:46.184 INFO:tasks.workunit.client.0.smithi123.stdout:7/925: dwrite d0/db/d38/f6a [4194304,4194304] 0 2024-02-20T08:05:46.187 INFO:tasks.workunit.client.0.smithi123.stdout:1/804: write d3/db/d34/d74/d6f/d63/dfd/d26/f81 [2323398,62548] 0 2024-02-20T08:05:46.188 INFO:tasks.workunit.client.0.smithi123.stdout:7/926: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/fd3 zero size 2024-02-20T08:05:46.189 INFO:tasks.workunit.client.0.smithi123.stdout:9/886: symlink d6/d19/d1a/d2b/d65/d77/l117 0 2024-02-20T08:05:46.193 INFO:tasks.workunit.client.0.smithi123.stdout:1/805: stat d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f/f114 0 2024-02-20T08:05:46.196 INFO:tasks.workunit.client.0.smithi123.stdout:9/887: mknod d6/dbc/c118 0 2024-02-20T08:05:46.197 INFO:tasks.workunit.client.0.smithi123.stdout:1/806: mkdir d3/de/d11f 0 2024-02-20T08:05:46.198 INFO:tasks.workunit.client.0.smithi123.stdout:3/927: dread d0/dd/d48/f71 [4194304,4194304] 0 2024-02-20T08:05:46.204 INFO:tasks.workunit.client.0.smithi123.stdout:9/888: dread d6/d19/d1a/d7c/d81/f97 [0,4194304] 0 2024-02-20T08:05:46.206 INFO:tasks.workunit.client.0.smithi123.stdout:7/927: truncate d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f8f 4367561 0 2024-02-20T08:05:46.206 INFO:tasks.workunit.client.0.smithi123.stdout:1/807: dread - d3/db/d34/db4/fc0 zero size 2024-02-20T08:05:46.207 INFO:tasks.workunit.client.0.smithi123.stdout:3/928: symlink d0/d6/d1a/d4b/d95/d9f/l13a 0 2024-02-20T08:05:46.208 INFO:tasks.workunit.client.0.smithi123.stdout:9/889: dread d6/d2a/d27/f5a [0,4194304] 0 2024-02-20T08:05:46.209 INFO:tasks.workunit.client.0.smithi123.stdout:3/929: fsync d0/d6/d1a/da1/f100 0 2024-02-20T08:05:46.212 INFO:tasks.workunit.client.0.smithi123.stdout:7/928: write d0/d6/dd/d97/fad [1670832,50391] 0 2024-02-20T08:05:46.215 INFO:tasks.workunit.client.0.smithi123.stdout:5/808: write d0/d34/d48/d56/d25/f3b [5235461,125197] 0 2024-02-20T08:05:46.218 INFO:tasks.workunit.client.0.smithi123.stdout:7/929: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/d79 3002 1 2024-02-20T08:05:46.219 INFO:tasks.workunit.client.0.smithi123.stdout:1/808: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/d56/de7/ff2 [0,4194304] 0 2024-02-20T08:05:46.221 INFO:tasks.workunit.client.0.smithi123.stdout:9/890: rename d6/d19/d1a/d7c/fa8 to d6/d19/f119 0 2024-02-20T08:05:46.224 INFO:tasks.workunit.client.0.smithi123.stdout:3/930: dwrite d0/d6/d1a/f23 [0,4194304] 0 2024-02-20T08:05:46.226 INFO:tasks.workunit.client.0.smithi123.stdout:3/931: chown d0/d6/d1a/d62/d115/d1c/d3b/d43/fcc 220 1 2024-02-20T08:05:46.228 INFO:tasks.workunit.client.0.smithi123.stdout:1/809: mkdir d3/db/d41/de5/d120 0 2024-02-20T08:05:46.232 INFO:tasks.workunit.client.0.smithi123.stdout:1/810: read d3/db/d34/f92 [176700,48989] 0 2024-02-20T08:05:46.236 INFO:tasks.workunit.client.0.smithi123.stdout:7/930: link d0/d6/dd/d52/d26/d7b/fef d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f/f147 0 2024-02-20T08:05:46.244 INFO:tasks.workunit.client.0.smithi123.stdout:7/931: dwrite d0/db/d38/f11d [0,4194304] 0 2024-02-20T08:05:46.244 INFO:tasks.workunit.client.0.smithi123.stdout:1/811: read d3/db/f38 [2110591,102030] 0 2024-02-20T08:05:46.246 INFO:tasks.workunit.client.0.smithi123.stdout:3/932: rename d0/d6/d32/fd5 to d0/d6/d1a/f13b 0 2024-02-20T08:05:46.246 INFO:tasks.workunit.client.0.smithi123.stdout:7/932: fsync d0/db/de8/fff 0 2024-02-20T08:05:46.258 INFO:tasks.workunit.client.0.smithi123.stdout:5/809: dread d0/d34/d48/d56/dbb/d27/d4e/f52 [0,4194304] 0 2024-02-20T08:05:46.258 INFO:tasks.workunit.client.0.smithi123.stdout:4/872: sync 2024-02-20T08:05:46.258 INFO:tasks.workunit.client.0.smithi123.stdout:7/933: dread d0/db/d38/fe9 [0,4194304] 0 2024-02-20T08:05:46.260 INFO:tasks.workunit.client.0.smithi123.stdout:7/934: write d0/d6/dd/d52/d35/d9c/f36 [1604083,106895] 0 2024-02-20T08:05:46.264 INFO:tasks.workunit.client.0.smithi123.stdout:9/891: link d6/d19/d1a/d2b/d28/l40 d6/d19/d1a/d7c/d81/l11a 0 2024-02-20T08:05:46.268 INFO:tasks.workunit.client.0.smithi123.stdout:1/812: symlink d3/db/d34/d74/d6f/d63/dfd/d26/l121 0 2024-02-20T08:05:46.276 INFO:tasks.workunit.client.0.smithi123.stdout:3/933: dwrite d0/d6/d1a/d62/d115/d1c/d21/fa7 [0,4194304] 0 2024-02-20T08:05:46.278 INFO:tasks.workunit.client.0.smithi123.stdout:1/813: fsync d3/db/d34/d74/d6f/d63/dfd/d26/fa4 0 2024-02-20T08:05:46.283 INFO:tasks.workunit.client.0.smithi123.stdout:7/935: mknod d0/d6/dd/d52/d26/d9b/d61/d145/c148 0 2024-02-20T08:05:46.283 INFO:tasks.workunit.client.0.smithi123.stdout:4/873: dread d3/fd [0,4194304] 0 2024-02-20T08:05:46.285 INFO:tasks.workunit.client.0.smithi123.stdout:9/892: mknod d6/d19/d1a/d2b/c11b 0 2024-02-20T08:05:46.288 INFO:tasks.workunit.client.0.smithi123.stdout:3/934: dwrite d0/dd/d48/d6a/f108 [0,4194304] 0 2024-02-20T08:05:46.289 INFO:tasks.workunit.client.0.smithi123.stdout:1/814: mkdir d3/db/d34/d74/da1/d122 0 2024-02-20T08:05:46.292 INFO:tasks.workunit.client.0.smithi123.stdout:7/936: dread d0/d6/dd/d52/d26/d7b/feb [0,4194304] 0 2024-02-20T08:05:46.295 INFO:tasks.workunit.client.0.smithi123.stdout:4/874: unlink d3/d2c/d43/f50 0 2024-02-20T08:05:46.300 INFO:tasks.workunit.client.0.smithi123.stdout:9/893: symlink d6/d2a/d27/d3c/l11c 0 2024-02-20T08:05:46.302 INFO:tasks.workunit.client.0.smithi123.stdout:3/935: creat d0/d6/d1a/d62/d115/d1c/d21/d64/f13c x:0 0 0 2024-02-20T08:05:46.304 INFO:tasks.workunit.client.0.smithi123.stdout:3/936: dread d0/d6/d1a/d62/d115/db4/ff6 [0,4194304] 0 2024-02-20T08:05:46.310 INFO:tasks.workunit.client.0.smithi123.stdout:7/937: truncate d0/d6/dd/d52/d26/d9b/d61/f7a 669989 0 2024-02-20T08:05:46.314 INFO:tasks.workunit.client.0.smithi123.stdout:9/894: stat d6/d19/d1a/d2b/d28/d9a/dae/cb5 0 2024-02-20T08:05:46.318 INFO:tasks.workunit.client.0.smithi123.stdout:9/895: read d6/ffd [1687046,117796] 0 2024-02-20T08:05:46.325 INFO:tasks.workunit.client.0.smithi123.stdout:9/896: dwrite d6/fb [0,4194304] 0 2024-02-20T08:05:46.325 INFO:tasks.workunit.client.0.smithi123.stdout:3/937: rename d0/d6/d1a/d62/d82/lfc to d0/d6/d1a/d62/d115/d9d/l13d 0 2024-02-20T08:05:46.331 INFO:tasks.workunit.client.0.smithi123.stdout:1/815: creat d3/db/d34/d74/d6f/d63/dfd/d26/d2e/deb/f123 x:0 0 0 2024-02-20T08:05:46.332 INFO:tasks.workunit.client.0.smithi123.stdout:7/938: readlink d0/d6/dd/d52/d10f/l125 0 2024-02-20T08:05:46.337 INFO:tasks.workunit.client.0.smithi123.stdout:4/875: mkdir d3/d18/d11e 0 2024-02-20T08:05:46.338 INFO:tasks.workunit.client.0.smithi123.stdout:4/876: truncate d3/d18/d7d/d8b/d95/f114 503385 0 2024-02-20T08:05:46.341 INFO:tasks.workunit.client.0.smithi123.stdout:9/897: rmdir d6/d2a/d27/d6f/d8b 39 2024-02-20T08:05:46.349 INFO:tasks.workunit.client.0.smithi123.stdout:1/816: creat d3/db/d41/de5/dfe/f124 x:0 0 0 2024-02-20T08:05:46.349 INFO:tasks.workunit.client.0.smithi123.stdout:1/817: readlink d3/db/d34/d74/l25 0 2024-02-20T08:05:46.350 INFO:tasks.workunit.client.0.smithi123.stdout:7/939: dread - d0/d6/dd/d52/d26/d9b/fba zero size 2024-02-20T08:05:46.353 INFO:tasks.workunit.client.0.smithi123.stdout:7/940: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/l77 3 1 2024-02-20T08:05:46.361 INFO:tasks.workunit.client.0.smithi123.stdout:1/818: unlink d3/db/d34/d74/d6f/d63/dfd/d2c/d45/d9d/ff6 0 2024-02-20T08:05:46.361 INFO:tasks.workunit.client.0.smithi123.stdout:1/819: readlink d3/le8 0 2024-02-20T08:05:46.371 INFO:tasks.workunit.client.0.smithi123.stdout:3/938: dwrite d0/d6/d1a/f3d [0,4194304] 0 2024-02-20T08:05:46.378 INFO:tasks.workunit.client.0.smithi123.stdout:7/941: mknod d0/d6/dd/d52/d26/d7b/d128/c149 0 2024-02-20T08:05:46.383 INFO:tasks.workunit.client.0.smithi123.stdout:9/898: write d6/d19/d1a/d2b/d65/d77/da2/fbd [529548,77900] 0 2024-02-20T08:05:46.386 INFO:tasks.workunit.client.0.smithi123.stdout:1/820: mkdir d3/db/d34/d74/da1/d122/d125 0 2024-02-20T08:05:46.386 INFO:tasks.workunit.client.0.smithi123.stdout:7/942: dread d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f/f147 [0,4194304] 0 2024-02-20T08:05:46.388 INFO:tasks.workunit.client.0.smithi123.stdout:4/877: dwrite d3/d18/d7d/d8b/d95/f119 [0,4194304] 0 2024-02-20T08:05:46.390 INFO:tasks.workunit.client.0.smithi123.stdout:7/943: chown d0/d6/dd/d52/d35/d9c/c5a 313837578 1 2024-02-20T08:05:46.392 INFO:tasks.workunit.client.0.smithi123.stdout:9/899: mknod d6/d19/d1a/d31/c11d 0 2024-02-20T08:05:46.392 INFO:tasks.workunit.client.0.smithi123.stdout:9/900: chown d6/d2a/f59 0 1 2024-02-20T08:05:46.394 INFO:tasks.workunit.client.0.smithi123.stdout:3/939: symlink d0/d6/d1a/d62/d115/d1c/d61/l13e 0 2024-02-20T08:05:46.402 INFO:tasks.workunit.client.0.smithi123.stdout:2/901: sync 2024-02-20T08:05:46.403 INFO:tasks.workunit.client.0.smithi123.stdout:7/944: mknod d0/d6/dd/d52/d35/c14a 0 2024-02-20T08:05:46.405 INFO:tasks.workunit.client.0.smithi123.stdout:7/945: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f/f12e zero size 2024-02-20T08:05:46.406 INFO:tasks.workunit.client.0.smithi123.stdout:9/901: mknod d6/d19/d1a/d6d/c11e 0 2024-02-20T08:05:46.408 INFO:tasks.workunit.client.0.smithi123.stdout:3/940: creat d0/d6/d1a/def/df1/f13f x:0 0 0 2024-02-20T08:05:46.412 INFO:tasks.workunit.client.0.smithi123.stdout:3/941: truncate d0/dd/ff2 1443671 0 2024-02-20T08:05:46.417 INFO:tasks.workunit.client.0.smithi123.stdout:1/821: rename d3/db/d34/d74/d6f/c88 to d3/db/c126 0 2024-02-20T08:05:46.421 INFO:tasks.workunit.client.0.smithi123.stdout:4/878: mknod d3/d2c/d43/d26/d2e/dcd/c11f 0 2024-02-20T08:05:46.421 INFO:tasks.workunit.client.0.smithi123.stdout:5/810: sync 2024-02-20T08:05:46.421 INFO:tasks.workunit.client.0.smithi123.stdout:8/830: sync 2024-02-20T08:05:46.429 INFO:tasks.workunit.client.0.smithi123.stdout:1/822: dread d3/db/d34/f2b [0,4194304] 0 2024-02-20T08:05:46.431 INFO:tasks.workunit.client.0.smithi123.stdout:5/811: chown d0/d34/d48/d56/dbb/d27/d37/la7 2411338 1 2024-02-20T08:05:46.433 INFO:tasks.workunit.client.0.smithi123.stdout:7/946: dread d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f4f [0,4194304] 0 2024-02-20T08:05:46.435 INFO:tasks.workunit.client.0.smithi123.stdout:5/812: chown d0/d34/d48/d56/d4c/d43/cfa 3436441 1 2024-02-20T08:05:46.437 INFO:tasks.workunit.client.0.smithi123.stdout:5/813: fdatasync d0/d34/d48/d56/dbb/f105 0 2024-02-20T08:05:46.437 INFO:tasks.workunit.client.0.smithi123.stdout:9/902: dread d6/d2a/d27/d6f/d8b/fe3 [0,4194304] 0 2024-02-20T08:05:46.440 INFO:tasks.workunit.client.0.smithi123.stdout:2/902: dread d1a/d29/d42/d4e/f78 [0,4194304] 0 2024-02-20T08:05:46.501 INFO:tasks.workunit.client.0.smithi123.stdout:5/814: mkdir d0/d34/d48/d56/d3e/ddf/d109 0 2024-02-20T08:05:46.502 INFO:tasks.workunit.client.0.smithi123.stdout:2/903: truncate d1a/d29/d42/d4e/fa8 735505 0 2024-02-20T08:05:46.504 INFO:tasks.workunit.client.0.smithi123.stdout:3/942: link d0/d6/d1a/d62/d115/db4/fc0 d0/d6/d1a/d62/d115/d1c/d3b/d43/f140 0 2024-02-20T08:05:46.504 INFO:tasks.workunit.client.0.smithi123.stdout:9/903: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/fe5 [0,4194304] 0 2024-02-20T08:05:46.506 INFO:tasks.workunit.client.0.smithi123.stdout:2/904: truncate d1a/d29/d5d/d97/da9/dfe/f119 449029 0 2024-02-20T08:05:46.507 INFO:tasks.workunit.client.0.smithi123.stdout:8/831: mkdir d6/d32/dd5/de0/d115 0 2024-02-20T08:05:46.510 INFO:tasks.workunit.client.0.smithi123.stdout:4/879: rename d3/d2c/f54 to d3/d2c/d43/d34/d110/f120 0 2024-02-20T08:05:46.512 INFO:tasks.workunit.client.0.smithi123.stdout:1/823: creat d3/db/d34/d74/d6f/d63/dfd/d2c/d107/f127 x:0 0 0 2024-02-20T08:05:46.519 INFO:tasks.workunit.client.0.smithi123.stdout:5/815: creat d0/d34/d48/d56/d4c/df0/f10a x:0 0 0 2024-02-20T08:05:46.519 INFO:tasks.workunit.client.0.smithi123.stdout:5/816: dread - d0/d34/d48/d56/ffb zero size 2024-02-20T08:05:46.520 INFO:tasks.workunit.client.0.smithi123.stdout:5/817: dread - d0/d34/d67/fbe zero size 2024-02-20T08:05:46.521 INFO:tasks.workunit.client.0.smithi123.stdout:3/943: rmdir d0/d6/d1a/d62/d115/d1c/d61 39 2024-02-20T08:05:46.522 INFO:tasks.workunit.client.0.smithi123.stdout:9/904: mkdir d6/d19/d1a/d2b/d28/d11f 0 2024-02-20T08:05:46.524 INFO:tasks.workunit.client.0.smithi123.stdout:2/905: creat d1a/d29/d42/d73/d8f/f12c x:0 0 0 2024-02-20T08:05:46.526 INFO:tasks.workunit.client.0.smithi123.stdout:8/832: creat d6/dbd/d5b/d8f/d99/dd2/f116 x:0 0 0 2024-02-20T08:05:46.529 INFO:tasks.workunit.client.0.smithi123.stdout:4/880: rmdir d3/d97/dda 39 2024-02-20T08:05:46.530 INFO:tasks.workunit.client.0.smithi123.stdout:1/824: fdatasync d3/d47/fa0 0 2024-02-20T08:05:46.533 INFO:tasks.workunit.client.0.smithi123.stdout:5/818: mknod d0/d34/d67/d80/dcd/c10b 0 2024-02-20T08:05:46.538 INFO:tasks.workunit.client.0.smithi123.stdout:9/905: creat d6/d19/d1a/d2b/d65/f120 x:0 0 0 2024-02-20T08:05:46.548 INFO:tasks.workunit.client.0.smithi123.stdout:8/833: mkdir d6/d1c/d47/d10a/d117 0 2024-02-20T08:05:46.549 INFO:tasks.workunit.client.0.smithi123.stdout:4/881: mknod d3/c121 0 2024-02-20T08:05:46.550 INFO:tasks.workunit.client.0.smithi123.stdout:4/882: chown d3/d18/d7d/ca3 333348708 1 2024-02-20T08:05:46.555 INFO:tasks.workunit.client.0.smithi123.stdout:9/906: unlink d6/d19/d1a/d7c/d81/l11a 0 2024-02-20T08:05:46.562 INFO:tasks.workunit.client.0.smithi123.stdout:5/819: rmdir d0/d34/d67/d80/d100 0 2024-02-20T08:05:46.564 INFO:tasks.workunit.client.0.smithi123.stdout:9/907: mknod d6/d19/d1a/d6d/d7e/c121 0 2024-02-20T08:05:46.565 INFO:tasks.workunit.client.0.smithi123.stdout:8/834: truncate d6/d32/d95/f5d 701313 0 2024-02-20T08:05:46.567 INFO:tasks.workunit.client.0.smithi123.stdout:1/825: getdents d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/df4 0 2024-02-20T08:05:46.567 INFO:tasks.workunit.client.0.smithi123.stdout:1/826: stat d3/db/d41/de5/d120 0 2024-02-20T08:05:46.569 INFO:tasks.workunit.client.0.smithi123.stdout:4/883: symlink d3/d2c/d43/d26/d3e/da9/dd9/de6/l122 0 2024-02-20T08:05:46.570 INFO:tasks.workunit.client.0.smithi123.stdout:5/820: fdatasync d0/d34/d48/d56/d3e/fc6 0 2024-02-20T08:05:46.572 INFO:tasks.workunit.client.0.smithi123.stdout:5/821: write d0/d34/d48/d56/dbb/d27/d4e/f107 [960674,122731] 0 2024-02-20T08:05:46.573 INFO:tasks.workunit.client.0.smithi123.stdout:5/822: chown d0/d34/d48/d56/d4c/ce3 1 1 2024-02-20T08:05:46.574 INFO:tasks.workunit.client.0.smithi123.stdout:8/835: creat d6/dbd/d7e/d82/f118 x:0 0 0 2024-02-20T08:05:46.576 INFO:tasks.workunit.client.0.smithi123.stdout:4/884: creat d3/d2c/d43/d26/d3e/f123 x:0 0 0 2024-02-20T08:05:46.579 INFO:tasks.workunit.client.0.smithi123.stdout:5/823: mknod d0/d34/d48/d56/dcf/c10c 0 2024-02-20T08:05:46.579 INFO:tasks.workunit.client.0.smithi123.stdout:5/824: stat d0/d34/d48/d4b/d51 0 2024-02-20T08:05:46.582 INFO:tasks.workunit.client.0.smithi123.stdout:4/885: chown d3/d97/dda/fcc 319835 1 2024-02-20T08:05:46.594 INFO:tasks.workunit.client.0.smithi123.stdout:3/944: rmdir d0/d6/d1a/d62/d115/d1c 39 2024-02-20T08:05:46.596 INFO:tasks.workunit.client.0.smithi123.stdout:5/825: dread d0/d34/d48/d56/dbb/f2c [0,4194304] 0 2024-02-20T08:05:46.598 INFO:tasks.workunit.client.0.smithi123.stdout:3/945: rename d0/dd/d48/d8d/dcf/fe5 to d0/d6/d1a/d62/d82/da2/f141 0 2024-02-20T08:05:46.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:46 smithi123 ceph-mon[29383]: pgmap v42: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 112 MiB/s wr, 364 op/s 2024-02-20T08:05:46.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:46 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:46.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:46 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:46.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:46 smithi123 ceph-mon[29383]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T08:05:46.603 INFO:tasks.workunit.client.0.smithi123.stdout:5/826: dwrite d0/d34/d48/d56/dbb/d27/d4e/d9b/fa0 [4194304,4194304] 0 2024-02-20T08:05:46.604 INFO:tasks.workunit.client.0.smithi123.stdout:4/886: dread d3/d2c/d43/d26/d3e/da9/dd9/fe7 [0,4194304] 0 2024-02-20T08:05:46.607 INFO:tasks.workunit.client.0.smithi123.stdout:5/827: creat d0/d34/d67/d80/d84/f10d x:0 0 0 2024-02-20T08:05:46.609 INFO:tasks.workunit.client.0.smithi123.stdout:4/887: symlink d3/d2c/d43/d26/d3e/d8a/d10a/l124 0 2024-02-20T08:05:46.613 INFO:tasks.workunit.client.0.smithi123.stdout:4/888: symlink d3/d97/d111/l125 0 2024-02-20T08:05:46.615 INFO:tasks.workunit.client.0.smithi123.stdout:5/828: dwrite d0/d34/d67/dda/ff4 [0,4194304] 0 2024-02-20T08:05:46.615 INFO:tasks.workunit.client.0.smithi123.stdout:4/889: fdatasync d3/d2c/d43/d34/f3b 0 2024-02-20T08:05:46.615 INFO:tasks.workunit.client.0.smithi123.stdout:7/947: write d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f8f [1749109,111433] 0 2024-02-20T08:05:46.622 INFO:tasks.workunit.client.0.smithi123.stdout:9/908: getdents d6/d19/d1a/d2b/d28 0 2024-02-20T08:05:46.629 INFO:tasks.workunit.client.0.smithi123.stdout:5/829: dwrite d0/d34/d48/d56/d25/f2a [0,4194304] 0 2024-02-20T08:05:46.629 INFO:tasks.workunit.client.0.smithi123.stdout:9/909: unlink d6/d19/d1a/d2b/d28/da0/lb3 0 2024-02-20T08:05:46.629 INFO:tasks.workunit.client.0.smithi123.stdout:7/948: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d5d/f8f [0,4194304] 0 2024-02-20T08:05:46.631 INFO:tasks.workunit.client.0.smithi123.stdout:9/910: dread - d6/d19/d1a/d2b/d28/d9a/d3d/ff7 zero size 2024-02-20T08:05:46.633 INFO:tasks.workunit.client.0.smithi123.stdout:9/911: write d6/d19/f102 [3587829,100357] 0 2024-02-20T08:05:46.635 INFO:tasks.workunit.client.0.smithi123.stdout:9/912: write d6/d19/d1a/d2b/f100 [1233589,67972] 0 2024-02-20T08:05:46.635 INFO:tasks.workunit.client.0.smithi123.stdout:3/946: dread d0/d6/f2e [0,4194304] 0 2024-02-20T08:05:46.636 INFO:tasks.workunit.client.0.smithi123.stdout:9/913: fdatasync d6/d2a/d27/d6f/fb9 0 2024-02-20T08:05:46.637 INFO:tasks.workunit.client.0.smithi123.stdout:7/949: chown d0/fdf 4253318 1 2024-02-20T08:05:46.643 INFO:tasks.workunit.client.0.smithi123.stdout:3/947: rmdir d0/d6/d1a/d62/d115/d57/dd0 39 2024-02-20T08:05:46.644 INFO:tasks.workunit.client.0.smithi123.stdout:2/906: truncate d1a/fb2 1366075 0 2024-02-20T08:05:46.645 INFO:tasks.workunit.client.0.smithi123.stdout:2/907: fsync f15 0 2024-02-20T08:05:46.645 INFO:tasks.workunit.client.0.smithi123.stdout:9/914: rmdir d6/d19/d1a/d6d/d7e 39 2024-02-20T08:05:46.646 INFO:tasks.workunit.client.0.smithi123.stdout:2/908: chown d1a/d29/d42/d80 46945 1 2024-02-20T08:05:46.737 INFO:tasks.workunit.client.0.smithi123.stdout:7/950: creat d0/d6/dd/d52/d138/f14b x:0 0 0 2024-02-20T08:05:46.738 INFO:tasks.workunit.client.0.smithi123.stdout:3/948: symlink d0/d6/d1a/d62/d115/d2a/d86/l142 0 2024-02-20T08:05:46.738 INFO:tasks.workunit.client.0.smithi123.stdout:5/830: creat d0/d34/d48/d56/f10e x:0 0 0 2024-02-20T08:05:46.739 INFO:tasks.workunit.client.0.smithi123.stdout:1/827: write d3/db/d34/d74/f18 [4741314,10754] 0 2024-02-20T08:05:46.739 INFO:tasks.workunit.client.0.smithi123.stdout:8/836: write d6/dbd/f85 [1133533,26786] 0 2024-02-20T08:05:46.742 INFO:tasks.workunit.client.0.smithi123.stdout:9/915: symlink d6/d19/d1a/d31/d111/l122 0 2024-02-20T08:05:46.744 INFO:tasks.workunit.client.0.smithi123.stdout:3/949: dread d0/dd/ff2 [0,4194304] 0 2024-02-20T08:05:46.746 INFO:tasks.workunit.client.0.smithi123.stdout:7/951: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/ffc [0,4194304] 0 2024-02-20T08:05:46.748 INFO:tasks.workunit.client.0.smithi123.stdout:7/952: dread d0/d6/dd/f136 [4194304,4194304] 0 2024-02-20T08:05:46.782 INFO:tasks.workunit.client.0.smithi123.stdout:9/916: dread d6/d19/d1a/d6d/d7e/fac [0,4194304] 0 2024-02-20T08:05:46.783 INFO:tasks.workunit.client.0.smithi123.stdout:9/917: write d6/d19/d1a/d2b/d28/d9a/d3d/fa7 [989138,116455] 0 2024-02-20T08:05:46.784 INFO:tasks.workunit.client.0.smithi123.stdout:7/953: link d0/db/d21/f123 d0/d6/d7/f14c 0 2024-02-20T08:05:46.786 INFO:tasks.workunit.client.0.smithi123.stdout:1/828: link d3/de/l3c d3/db/d34/d74/d6f/d63/dfd/d2c/d45/l128 0 2024-02-20T08:05:46.788 INFO:tasks.workunit.client.0.smithi123.stdout:3/950: link d0/d6/d1a/f15 d0/d6/f143 0 2024-02-20T08:05:46.793 INFO:tasks.workunit.client.0.smithi123.stdout:1/829: mkdir d3/db/d34/d74/d6f/d63/dfd/d26/de3/d129 0 2024-02-20T08:05:46.795 INFO:tasks.workunit.client.0.smithi123.stdout:3/951: stat d0/d6/d1a/d62/d115/d57/dd0/daa 0 2024-02-20T08:05:46.801 INFO:tasks.workunit.client.0.smithi123.stdout:7/954: creat d0/d6/d7/f14d x:0 0 0 2024-02-20T08:05:46.805 INFO:tasks.workunit.client.0.smithi123.stdout:3/952: fsync d0/d6/d1a/d62/d115/d1c/d20/f40 0 2024-02-20T08:05:46.812 INFO:tasks.workunit.client.0.smithi123.stdout:8/837: dwrite d6/dbd/d5b/d8f/faf [0,4194304] 0 2024-02-20T08:05:46.812 INFO:tasks.workunit.client.0.smithi123.stdout:3/953: write d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f12b [2088574,65001] 0 2024-02-20T08:05:46.815 INFO:tasks.workunit.client.0.smithi123.stdout:2/909: dwrite d1a/f41 [0,4194304] 0 2024-02-20T08:05:46.821 INFO:tasks.workunit.client.0.smithi123.stdout:7/955: getdents d0/d6/dd/d52/d138 0 2024-02-20T08:05:46.823 INFO:tasks.workunit.client.0.smithi123.stdout:3/954: symlink d0/d6/d1a/d62/d115/d1c/d21/dd9/l144 0 2024-02-20T08:05:46.826 INFO:tasks.workunit.client.0.smithi123.stdout:2/910: truncate d1a/d29/fcf 1666626 0 2024-02-20T08:05:46.828 INFO:tasks.workunit.client.0.smithi123.stdout:8/838: fdatasync d6/dbd/d5b/f7f 0 2024-02-20T08:05:46.833 INFO:tasks.workunit.client.0.smithi123.stdout:3/955: unlink d0/d6/d1a/d62/d82/da2/f112 0 2024-02-20T08:05:46.835 INFO:tasks.workunit.client.0.smithi123.stdout:9/918: dwrite d6/d19/d1a/d7f/f5d [0,4194304] 0 2024-02-20T08:05:46.836 INFO:tasks.workunit.client.0.smithi123.stdout:9/919: chown d6/d19/d1a/d2b/d28/d9a/d3d/d32/l39 1575 1 2024-02-20T08:05:46.839 INFO:tasks.workunit.client.0.smithi123.stdout:1/830: write d3/de/f84 [1133172,23496] 0 2024-02-20T08:05:46.841 INFO:tasks.workunit.client.0.smithi123.stdout:3/956: fdatasync d0/f24 0 2024-02-20T08:05:46.847 INFO:tasks.workunit.client.0.smithi123.stdout:3/957: dwrite d0/dd/d48/d6a/f108 [0,4194304] 0 2024-02-20T08:05:46.849 INFO:tasks.workunit.client.0.smithi123.stdout:1/831: mkdir d3/de/dfb/d12a 0 2024-02-20T08:05:46.852 INFO:tasks.workunit.client.0.smithi123.stdout:2/911: link d1a/d29/d39/f59 d1a/d29/d42/d52/d98/dd6/dfa/d10d/f12d 0 2024-02-20T08:05:46.853 INFO:tasks.workunit.client.0.smithi123.stdout:9/920: mknod d6/d19/d1a/d2b/d28/d9a/c123 0 2024-02-20T08:05:46.854 INFO:tasks.workunit.client.0.smithi123.stdout:9/921: stat d6/d19/d1a/d31/c82 0 2024-02-20T08:05:46.856 INFO:tasks.workunit.client.0.smithi123.stdout:7/956: write d0/d6/dd/f136 [60781,130568] 0 2024-02-20T08:05:46.859 INFO:tasks.workunit.client.0.smithi123.stdout:1/832: mknod d3/db/d7f/c12b 0 2024-02-20T08:05:46.861 INFO:tasks.workunit.client.0.smithi123.stdout:8/839: getdents d6/d32/dd5 0 2024-02-20T08:05:46.863 INFO:tasks.workunit.client.0.smithi123.stdout:3/958: mknod d0/d6/d1a/d62/d115/d1c/c145 0 2024-02-20T08:05:46.866 INFO:tasks.workunit.client.0.smithi123.stdout:1/833: truncate d3/de/f5a 824190 0 2024-02-20T08:05:46.867 INFO:tasks.workunit.client.0.smithi123.stdout:8/840: creat d6/d1c/d47/f119 x:0 0 0 2024-02-20T08:05:46.869 INFO:tasks.workunit.client.0.smithi123.stdout:3/959: mknod d0/d6/d1a/d62/d115/de3/c146 0 2024-02-20T08:05:46.872 INFO:tasks.workunit.client.0.smithi123.stdout:8/841: symlink d6/d32/d95/d3f/l11a 0 2024-02-20T08:05:46.876 INFO:tasks.workunit.client.0.smithi123.stdout:2/912: getdents d1a/d29/d42/d52 0 2024-02-20T08:05:46.877 INFO:tasks.workunit.client.0.smithi123.stdout:9/922: getdents d6/d19/d1a/d6d/d7e/d80 0 2024-02-20T08:05:46.881 INFO:tasks.workunit.client.0.smithi123.stdout:9/923: symlink d6/d19/d1a/d2b/d28/d9a/d3d/d32/l124 0 2024-02-20T08:05:46.883 INFO:tasks.workunit.client.0.smithi123.stdout:9/924: dread d6/d2a/ff5 [0,4194304] 0 2024-02-20T08:05:46.886 INFO:tasks.workunit.client.0.smithi123.stdout:9/925: mkdir d6/d2a/d27/d6f/d8b/de1/d125 0 2024-02-20T08:05:46.889 INFO:tasks.workunit.client.0.smithi123.stdout:1/834: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f/fd9 [0,4194304] 0 2024-02-20T08:05:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:46 smithi194 ceph-mon[37804]: pgmap v42: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 112 MiB/s wr, 364 op/s 2024-02-20T08:05:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:46 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:46 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:46 smithi194 ceph-mon[37804]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T08:05:46.894 INFO:tasks.workunit.client.0.smithi123.stdout:9/926: dread d6/d19/d1a/d2b/d65/d77/da5/ffe [0,4194304] 0 2024-02-20T08:05:46.895 INFO:tasks.workunit.client.0.smithi123.stdout:1/835: readlink d3/db/d34/d74/d6f/d63/dfd/d2c/d45/ld2 0 2024-02-20T08:05:46.896 INFO:tasks.workunit.client.0.smithi123.stdout:8/842: dread d6/f3b [4194304,4194304] 0 2024-02-20T08:05:46.899 INFO:tasks.workunit.client.0.smithi123.stdout:1/836: fsync d3/db/d34/d74/d6f/fff 0 2024-02-20T08:05:46.899 INFO:tasks.workunit.client.0.smithi123.stdout:2/913: dwrite d1a/d29/d42/d80/fa4 [0,4194304] 0 2024-02-20T08:05:46.901 INFO:tasks.workunit.client.0.smithi123.stdout:2/914: chown d1a/d29/d42/d52/d98/da1/de3/cee 459883340 1 2024-02-20T08:05:46.903 INFO:tasks.workunit.client.0.smithi123.stdout:9/927: rename d6/d2a/d27/d3c/lee to d6/d19/d1a/d6d/d7e/d80/l126 0 2024-02-20T08:05:46.905 INFO:tasks.workunit.client.0.smithi123.stdout:9/928: fdatasync d6/d19/d1a/d2b/d65/d77/fca 0 2024-02-20T08:05:46.907 INFO:tasks.workunit.client.0.smithi123.stdout:2/915: write d1a/d4f/ff1 [4291690,67671] 0 2024-02-20T08:05:46.910 INFO:tasks.workunit.client.0.smithi123.stdout:1/837: dwrite d3/db/d34/d74/d6f/fce [0,4194304] 0 2024-02-20T08:05:46.913 INFO:tasks.workunit.client.0.smithi123.stdout:2/916: symlink d1a/d29/d5d/d97/da9/d114/l12e 0 2024-02-20T08:05:46.916 INFO:tasks.workunit.client.0.smithi123.stdout:1/838: mkdir d3/db/d34/d74/da1/d12c 0 2024-02-20T08:05:46.920 INFO:tasks.workunit.client.0.smithi123.stdout:1/839: mkdir d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/d12d 0 2024-02-20T08:05:46.927 INFO:tasks.workunit.client.0.smithi123.stdout:1/840: getdents d3/db/d41/de5 0 2024-02-20T08:05:46.928 INFO:tasks.workunit.client.0.smithi123.stdout:8/843: dread d6/d32/d95/db0/fd8 [0,4194304] 0 2024-02-20T08:05:46.931 INFO:tasks.workunit.client.0.smithi123.stdout:1/841: creat d3/db/d34/d74/d6f/d63/dfd/d2c/d4f/f12e x:0 0 0 2024-02-20T08:05:46.932 INFO:tasks.workunit.client.0.smithi123.stdout:1/842: fdatasync d3/db/d34/d74/d6f/d63/dfd/d26/d2e/fc7 0 2024-02-20T08:05:46.934 INFO:tasks.workunit.client.0.smithi123.stdout:1/843: truncate d3/db/d41/de5/dfe/f124 1016734 0 2024-02-20T08:05:46.937 INFO:tasks.workunit.client.0.smithi123.stdout:8/844: creat d6/dbd/d5b/f11b x:0 0 0 2024-02-20T08:05:46.939 INFO:tasks.workunit.client.0.smithi123.stdout:1/844: unlink d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d5d/f99 0 2024-02-20T08:05:46.940 INFO:tasks.workunit.client.0.smithi123.stdout:9/929: dread d6/d19/d1a/d6d/f79 [0,4194304] 0 2024-02-20T08:05:46.943 INFO:tasks.workunit.client.0.smithi123.stdout:1/845: creat d3/db/d34/d74/d6f/d63/dfd/d26/de3/f12f x:0 0 0 2024-02-20T08:05:46.944 INFO:tasks.workunit.client.0.smithi123.stdout:1/846: chown d3/d47/le0 9 1 2024-02-20T08:05:46.946 INFO:tasks.workunit.client.0.smithi123.stdout:9/930: creat d6/d2a/d27/d6f/d10d/f127 x:0 0 0 2024-02-20T08:05:46.948 INFO:tasks.workunit.client.0.smithi123.stdout:1/847: mkdir d3/db/d34/d74/d6f/d63/dfd/d26/d130 0 2024-02-20T08:05:46.949 INFO:tasks.workunit.client.0.smithi123.stdout:1/848: stat d3/db/d34/d74/d6f/d63/dfd/d26/d2e 0 2024-02-20T08:05:46.954 INFO:tasks.workunit.client.0.smithi123.stdout:8/845: dwrite d6/d32/fb4 [0,4194304] 0 2024-02-20T08:05:46.955 INFO:tasks.workunit.client.0.smithi123.stdout:1/849: link d3/db/d34/d74/d6f/d63/dfd/d26/d56/f10e d3/db/d41/de5/d120/f131 0 2024-02-20T08:05:46.962 INFO:tasks.workunit.client.0.smithi123.stdout:8/846: creat d6/d1c/f11c x:0 0 0 2024-02-20T08:05:46.963 INFO:tasks.workunit.client.0.smithi123.stdout:8/847: rmdir d6/d1c/d22/d8c/dcd/db9 39 2024-02-20T08:05:46.966 INFO:tasks.workunit.client.0.smithi123.stdout:1/850: link d3/fc2 d3/db/d34/d74/d6f/d63/d104/f132 0 2024-02-20T08:05:46.966 INFO:tasks.workunit.client.0.smithi123.stdout:1/851: chown d3/db/d41 3803 1 2024-02-20T08:05:46.969 INFO:tasks.workunit.client.0.smithi123.stdout:9/931: dread d6/d19/d1a/d2b/d28/d9a/f3b [0,4194304] 0 2024-02-20T08:05:46.974 INFO:tasks.workunit.client.0.smithi123.stdout:9/932: mknod d6/d19/d1a/d2b/d65/d77/c128 0 2024-02-20T08:05:46.977 INFO:tasks.workunit.client.0.smithi123.stdout:8/848: write d6/d32/d95/f7a [969907,11540] 0 2024-02-20T08:05:46.979 INFO:tasks.workunit.client.0.smithi123.stdout:8/849: truncate d6/dbd/d5b/d8f/d99/dd2/f116 1003545 0 2024-02-20T08:05:46.981 INFO:tasks.workunit.client.0.smithi123.stdout:8/850: symlink d6/dbd/d7e/d82/d108/l11d 0 2024-02-20T08:05:46.981 INFO:tasks.workunit.client.0.smithi123.stdout:8/851: fdatasync d6/d1c/d47/f59 0 2024-02-20T08:05:46.984 INFO:tasks.workunit.client.0.smithi123.stdout:8/852: creat d6/d1c/d47/f11e x:0 0 0 2024-02-20T08:05:46.986 INFO:tasks.workunit.client.0.smithi123.stdout:8/853: creat d6/dbd/d7e/d82/d108/f11f x:0 0 0 2024-02-20T08:05:46.987 INFO:tasks.workunit.client.0.smithi123.stdout:8/854: mknod d6/d1c/d47/c120 0 2024-02-20T08:05:46.989 INFO:tasks.workunit.client.0.smithi123.stdout:8/855: dread - d6/d1c/fbc zero size 2024-02-20T08:05:46.991 INFO:tasks.workunit.client.0.smithi123.stdout:8/856: unlink d6/l91 0 2024-02-20T08:05:46.993 INFO:tasks.workunit.client.0.smithi123.stdout:8/857: read d6/f80 [3238389,67574] 0 2024-02-20T08:05:46.994 INFO:tasks.workunit.client.0.smithi123.stdout:8/858: stat d6/l17 0 2024-02-20T08:05:46.997 INFO:tasks.workunit.client.0.smithi123.stdout:8/859: mknod d6/c121 0 2024-02-20T08:05:47.539 INFO:tasks.workunit.client.0.smithi123.stdout:4/890: sync 2024-02-20T08:05:47.539 INFO:tasks.workunit.client.0.smithi123.stdout:7/957: sync 2024-02-20T08:05:47.539 INFO:tasks.workunit.client.0.smithi123.stdout:5/831: sync 2024-02-20T08:05:47.539 INFO:tasks.workunit.client.0.smithi123.stdout:5/832: chown d0/d34/d67/d80/d84 5 1 2024-02-20T08:05:47.540 INFO:tasks.workunit.client.0.smithi123.stdout:7/958: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/c32 0 2024-02-20T08:05:47.544 INFO:tasks.workunit.client.0.smithi123.stdout:4/891: rename d3/d18/d7d/d8b/d95/dd7 to d3/d97/d111/d126 0 2024-02-20T08:05:47.546 INFO:tasks.workunit.client.0.smithi123.stdout:5/833: dwrite d0/d34/d67/d80/fab [0,4194304] 0 2024-02-20T08:05:47.548 INFO:tasks.workunit.client.0.smithi123.stdout:4/892: rename d3/d18/d7d/d96/de9 to d3/d18/d63/d127 0 2024-02-20T08:05:47.549 INFO:tasks.workunit.client.0.smithi123.stdout:4/893: chown d3/d97/dda/db6/ld0 1 1 2024-02-20T08:05:47.551 INFO:tasks.workunit.client.0.smithi123.stdout:4/894: getdents d3/d2c/d43/d34/d110 0 2024-02-20T08:05:47.553 INFO:tasks.workunit.client.0.smithi123.stdout:4/895: chown d3/d97/dda/db6/f9e 5391928 1 2024-02-20T08:05:47.554 INFO:tasks.workunit.client.0.smithi123.stdout:7/959: dread d0/db/d21/f67 [0,4194304] 0 2024-02-20T08:05:47.555 INFO:tasks.workunit.client.0.smithi123.stdout:7/960: read d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f4f [892810,18815] 0 2024-02-20T08:05:47.557 INFO:tasks.workunit.client.0.smithi123.stdout:7/961: chown d0/d6/dd/d52/d26/d9b/d61/cda 1 1 2024-02-20T08:05:47.561 INFO:tasks.workunit.client.0.smithi123.stdout:7/962: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/f14e x:0 0 0 2024-02-20T08:05:47.564 INFO:tasks.workunit.client.0.smithi123.stdout:7/963: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/l14f 0 2024-02-20T08:05:47.566 INFO:tasks.workunit.client.0.smithi123.stdout:7/964: dread - d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d124/f135 zero size 2024-02-20T08:05:47.572 INFO:tasks.workunit.client.0.smithi123.stdout:3/960: sync 2024-02-20T08:05:47.572 INFO:tasks.workunit.client.0.smithi123.stdout:2/917: sync 2024-02-20T08:05:47.575 INFO:tasks.workunit.client.0.smithi123.stdout:3/961: mknod d0/d6/d34/c147 0 2024-02-20T08:05:47.576 INFO:tasks.workunit.client.0.smithi123.stdout:3/962: chown d0/d6/d1a/d62/d115/d1c/d20/l136 15651434 1 2024-02-20T08:05:47.594 INFO:tasks.workunit.client.0.smithi123.stdout:3/963: dread d0/dd/f38 [0,4194304] 0 2024-02-20T08:05:47.596 INFO:tasks.workunit.client.0.smithi123.stdout:3/964: write d0/dd/d48/d6a/d74/f12a [3915093,129178] 0 2024-02-20T08:05:47.599 INFO:tasks.workunit.client.0.smithi123.stdout:3/965: truncate d0/d6/d1a/d62/d115/d1c/d3b/f127 18786 0 2024-02-20T08:05:47.599 INFO:tasks.workunit.client.0.smithi123.stdout:3/966: readlink d0/lc 0 2024-02-20T08:05:47.600 INFO:tasks.workunit.client.0.smithi123.stdout:3/967: stat d0/dd/d48/d6a 0 2024-02-20T08:05:47.612 INFO:tasks.workunit.client.0.smithi123.stdout:3/968: dread d0/d6/d1a/f2f [0,4194304] 0 2024-02-20T08:05:47.615 INFO:tasks.workunit.client.0.smithi123.stdout:3/969: rename d0/dd/d48/d8d to d0/d6/d1a/da1/d148 0 2024-02-20T08:05:47.693 INFO:tasks.workunit.client.0.smithi123.stdout:8/860: sync 2024-02-20T08:05:47.693 INFO:tasks.workunit.client.0.smithi123.stdout:9/933: sync 2024-02-20T08:05:47.693 INFO:tasks.workunit.client.0.smithi123.stdout:1/852: sync 2024-02-20T08:05:47.694 INFO:tasks.workunit.client.0.smithi123.stdout:1/853: chown d3/db/d34/d74/da1/d122/d125 3348780 1 2024-02-20T08:05:47.694 INFO:tasks.workunit.client.0.smithi123.stdout:8/861: write d6/d1c/d47/f11e [602403,2511] 0 2024-02-20T08:05:47.695 INFO:tasks.workunit.client.0.smithi123.stdout:9/934: chown d6/d19/d1a/d2b/d65/d77/fca 1148507 1 2024-02-20T08:05:47.696 INFO:tasks.workunit.client.0.smithi123.stdout:8/862: stat d6/d32/d95/f57 0 2024-02-20T08:05:47.699 INFO:tasks.workunit.client.0.smithi123.stdout:1/854: truncate d3/db/d34/d74/f1a 4958712 0 2024-02-20T08:05:47.701 INFO:tasks.workunit.client.0.smithi123.stdout:1/855: creat d3/db/d34/db4/f133 x:0 0 0 2024-02-20T08:05:47.703 INFO:tasks.workunit.client.0.smithi123.stdout:8/863: creat d6/d1c/f122 x:0 0 0 2024-02-20T08:05:47.704 INFO:tasks.workunit.client.0.smithi123.stdout:1/856: rmdir d3/db/d34/d74/d6f/d63/dfd/d2c/d4f 39 2024-02-20T08:05:47.707 INFO:tasks.workunit.client.0.smithi123.stdout:8/864: mknod d6/d1c/d47/df6/c123 0 2024-02-20T08:05:47.708 INFO:tasks.workunit.client.0.smithi123.stdout:8/865: dread - d6/d32/fb2 zero size 2024-02-20T08:05:47.711 INFO:tasks.workunit.client.0.smithi123.stdout:9/935: dread d6/d19/d1a/d2b/d28/d9a/f26 [0,4194304] 0 2024-02-20T08:05:47.716 INFO:tasks.workunit.client.0.smithi123.stdout:9/936: getdents d6/d19/d1a/dc6 0 2024-02-20T08:05:47.717 INFO:tasks.workunit.client.0.smithi123.stdout:9/937: chown d6/d19/d1a/d2b/d28/d9a/d3d/fea 6922845 1 2024-02-20T08:05:47.722 INFO:tasks.workunit.client.0.smithi123.stdout:9/938: dwrite d6/d19/d1a/d2b/d28/d9a/d3d/f57 [4194304,4194304] 0 2024-02-20T08:05:47.724 INFO:tasks.workunit.client.0.smithi123.stdout:9/939: write d6/d19/d1a/d2b/d65/d77/fca [634980,89915] 0 2024-02-20T08:05:47.724 INFO:tasks.workunit.client.0.smithi123.stdout:5/834: write d0/d34/d48/d56/d4c/d43/fdc [648008,56130] 0 2024-02-20T08:05:47.727 INFO:tasks.workunit.client.0.smithi123.stdout:9/940: creat d6/d19/d1a/d7c/d81/f129 x:0 0 0 2024-02-20T08:05:47.729 INFO:tasks.workunit.client.0.smithi123.stdout:9/941: fsync d6/d19/d1a/d2b/f100 0 2024-02-20T08:05:47.734 INFO:tasks.workunit.client.0.smithi123.stdout:4/896: sync 2024-02-20T08:05:47.735 INFO:tasks.workunit.client.0.smithi123.stdout:5/835: dwrite d0/d34/d48/d56/dbb/d27/d37/fca [0,4194304] 0 2024-02-20T08:05:47.736 INFO:tasks.workunit.client.0.smithi123.stdout:9/942: symlink d6/d19/d1a/d2b/d28/d9a/d3d/d32/l12a 0 2024-02-20T08:05:47.737 INFO:tasks.workunit.client.0.smithi123.stdout:9/943: stat d6/d2a/lf1 0 2024-02-20T08:05:47.739 INFO:tasks.workunit.client.0.smithi123.stdout:7/965: dwrite d0/f3d [0,4194304] 0 2024-02-20T08:05:47.739 INFO:tasks.workunit.client.0.smithi123.stdout:2/918: truncate d1a/d29/d5d/d97/da9/dfe/f119 162069 0 2024-02-20T08:05:47.741 INFO:tasks.workunit.client.0.smithi123.stdout:4/897: rmdir d3/d18/d7d/d8b/d95 39 2024-02-20T08:05:47.742 INFO:tasks.workunit.client.0.smithi123.stdout:9/944: unlink d6/fa 0 2024-02-20T08:05:47.744 INFO:tasks.workunit.client.0.smithi123.stdout:5/836: rmdir d0/d34/d48/d56/dbb 39 2024-02-20T08:05:47.747 INFO:tasks.workunit.client.0.smithi123.stdout:5/837: write d0/d34/d48/d56/d25/f2d [5126639,14755] 0 2024-02-20T08:05:47.747 INFO:tasks.workunit.client.0.smithi123.stdout:2/919: rmdir d1a/d29/d42/d52/d98/da1/daa/de8 39 2024-02-20T08:05:47.749 INFO:tasks.workunit.client.0.smithi123.stdout:9/945: mkdir d6/d19/d1a/d7f/d12b 0 2024-02-20T08:05:47.755 INFO:tasks.workunit.client.0.smithi123.stdout:5/838: dread d0/d34/d48/d56/d3e/f41 [0,4194304] 0 2024-02-20T08:05:47.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:47 smithi123 ceph-mon[29383]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T08:05:47.781 INFO:tasks.workunit.client.0.smithi123.stdout:4/898: mknod d3/d97/c128 0 2024-02-20T08:05:47.781 INFO:tasks.workunit.client.0.smithi123.stdout:3/970: rename d0/dd/d48 to d0/d6/d1a/d62/d115/d1c/d21/d8e/d149 0 2024-02-20T08:05:47.781 INFO:tasks.workunit.client.0.smithi123.stdout:9/946: symlink d6/d19/d1a/d2b/d28/d9a/d3d/d32/l12c 0 2024-02-20T08:05:47.782 INFO:tasks.workunit.client.0.smithi123.stdout:8/866: write d6/d1c/d22/d8c/dcd/f6a [4494632,70761] 0 2024-02-20T08:05:47.784 INFO:tasks.workunit.client.0.smithi123.stdout:5/839: rmdir d0/d34 39 2024-02-20T08:05:47.784 INFO:tasks.workunit.client.0.smithi123.stdout:9/947: dread - d6/d2a/d27/d6f/d8b/d98/f116 zero size 2024-02-20T08:05:47.784 INFO:tasks.workunit.client.0.smithi123.stdout:3/971: chown d0/d6/d1a/d62/d115/d57/la4 419 1 2024-02-20T08:05:47.785 INFO:tasks.workunit.client.0.smithi123.stdout:3/972: chown d0/d6/d34/fbe 1 1 2024-02-20T08:05:47.786 INFO:tasks.workunit.client.0.smithi123.stdout:9/948: chown d6/d19/d1a/d2b/d28/c89 23025 1 2024-02-20T08:05:47.786 INFO:tasks.workunit.client.0.smithi123.stdout:2/920: write d1a/d29/d42/f4a [2981583,106506] 0 2024-02-20T08:05:47.789 INFO:tasks.workunit.client.0.smithi123.stdout:5/840: stat d0/d34/d67/d80/d84/ca4 0 2024-02-20T08:05:47.795 INFO:tasks.workunit.client.0.smithi123.stdout:9/949: creat d6/d19/d1a/d31/d10b/f12d x:0 0 0 2024-02-20T08:05:47.797 INFO:tasks.workunit.client.0.smithi123.stdout:2/921: chown d1a/d29/d42/d52/d98/dd6/c109 37402 1 2024-02-20T08:05:47.800 INFO:tasks.workunit.client.0.smithi123.stdout:1/857: rename d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f/dbe to d3/db/d34/d74/d6f/d63/dfd/d2c/d45/d134 0 2024-02-20T08:05:47.801 INFO:tasks.workunit.client.0.smithi123.stdout:1/858: write d3/db/d34/d74/d6f/d63/dfd/d36/f78 [8846787,27870] 0 2024-02-20T08:05:47.804 INFO:tasks.workunit.client.0.smithi123.stdout:1/859: write d3/db/d34/d74/d6f/d63/dfd/d26/fd6 [9286028,64983] 0 2024-02-20T08:05:47.806 INFO:tasks.workunit.client.0.smithi123.stdout:4/899: dread d3/d2c/d43/d34/f55 [0,4194304] 0 2024-02-20T08:05:47.807 INFO:tasks.workunit.client.0.smithi123.stdout:4/900: chown d3/d2c/d43/d34 111743754 1 2024-02-20T08:05:47.809 INFO:tasks.workunit.client.0.smithi123.stdout:2/922: fdatasync d1a/d7f/fd5 0 2024-02-20T08:05:47.809 INFO:tasks.workunit.client.0.smithi123.stdout:4/901: dread - d3/d2c/d43/d26/d3e/da9/fbb zero size 2024-02-20T08:05:47.811 INFO:tasks.workunit.client.0.smithi123.stdout:3/973: dwrite d0/f8c [0,4194304] 0 2024-02-20T08:05:47.814 INFO:tasks.workunit.client.0.smithi123.stdout:8/867: truncate d6/d32/d95/d3f/fcf 3619623 0 2024-02-20T08:05:47.816 INFO:tasks.workunit.client.0.smithi123.stdout:1/860: symlink d3/db/d41/de5/l135 0 2024-02-20T08:05:47.821 INFO:tasks.workunit.client.0.smithi123.stdout:2/923: creat d1a/da5/dd2/f12f x:0 0 0 2024-02-20T08:05:47.823 INFO:tasks.workunit.client.0.smithi123.stdout:9/950: dwrite d6/dbc/fbe [0,4194304] 0 2024-02-20T08:05:47.825 INFO:tasks.workunit.client.0.smithi123.stdout:9/951: stat d6/d19/d1a/d2b/d28/d9a/c18 0 2024-02-20T08:05:47.832 INFO:tasks.workunit.client.0.smithi123.stdout:9/952: dwrite d6/d19/d1a/d2b/d65/d77/fca [0,4194304] 0 2024-02-20T08:05:47.834 INFO:tasks.workunit.client.0.smithi123.stdout:9/953: read d6/d19/d1a/d2b/d28/d9a/f3b [4112688,546] 0 2024-02-20T08:05:47.838 INFO:tasks.workunit.client.0.smithi123.stdout:2/924: mkdir d1a/d29/d39/d130 0 2024-02-20T08:05:47.839 INFO:tasks.workunit.client.0.smithi123.stdout:4/902: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:47.839 INFO:tasks.workunit.client.0.smithi123.stdout:3/974: fdatasync d0/d6/d1a/d62/d82/da2/f141 0 2024-02-20T08:05:47.845 INFO:tasks.workunit.client.0.smithi123.stdout:5/841: link d0/d34/d48/d56/dbb/d27/d4e/d9b/lc8 d0/d34/d67/d80/l10f 0 2024-02-20T08:05:47.847 INFO:tasks.workunit.client.0.smithi123.stdout:8/868: dwrite d6/dbd/d5b/ff4 [0,4194304] 0 2024-02-20T08:05:47.852 INFO:tasks.workunit.client.0.smithi123.stdout:1/861: write d3/de/f60 [999012,74357] 0 2024-02-20T08:05:47.853 INFO:tasks.workunit.client.0.smithi123.stdout:2/925: truncate d1a/d29/d42/d80/da3/fd8 657595 0 2024-02-20T08:05:47.859 INFO:tasks.workunit.client.0.smithi123.stdout:9/954: dwrite d6/d19/f4a [0,4194304] 0 2024-02-20T08:05:47.859 INFO:tasks.workunit.client.0.smithi123.stdout:2/926: creat d1a/d29/d42/d52/d98/f131 x:0 0 0 2024-02-20T08:05:47.861 INFO:tasks.workunit.client.0.smithi123.stdout:3/975: creat d0/d6/f14a x:0 0 0 2024-02-20T08:05:47.862 INFO:tasks.workunit.client.0.smithi123.stdout:8/869: link d6/d32/d95/d3f/l9d d6/d32/d95/db0/l124 0 2024-02-20T08:05:47.869 INFO:tasks.workunit.client.0.smithi123.stdout:9/955: mknod d6/d19/d1a/d31/d10b/c12e 0 2024-02-20T08:05:47.871 INFO:tasks.workunit.client.0.smithi123.stdout:3/976: rename d0/dd/c10b to d0/d6/d32/c14b 0 2024-02-20T08:05:47.871 INFO:tasks.workunit.client.0.smithi123.stdout:1/862: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/d56/de7/ff2 [0,4194304] 0 2024-02-20T08:05:47.872 INFO:tasks.workunit.client.0.smithi123.stdout:9/956: write d6/fb [3792340,22513] 0 2024-02-20T08:05:47.873 INFO:tasks.workunit.client.0.smithi123.stdout:2/927: dwrite d1a/d29/d5d/d97/faf [0,4194304] 0 2024-02-20T08:05:47.875 INFO:tasks.workunit.client.0.smithi123.stdout:8/870: creat d6/dbd/d5b/d8f/d98/f125 x:0 0 0 2024-02-20T08:05:47.875 INFO:tasks.workunit.client.0.smithi123.stdout:1/863: chown d3/db/d41/de5/dfe/f11d 1012484 1 2024-02-20T08:05:47.876 INFO:tasks.workunit.client.0.smithi123.stdout:9/957: creat d6/d19/d1a/d2b/d65/d77/da5/f12f x:0 0 0 2024-02-20T08:05:47.876 INFO:tasks.workunit.client.0.smithi123.stdout:8/871: dread - d6/dbd/d5b/f11b zero size 2024-02-20T08:05:47.877 INFO:tasks.workunit.client.0.smithi123.stdout:2/928: creat d1a/d29/d42/d80/da3/f132 x:0 0 0 2024-02-20T08:05:47.878 INFO:tasks.workunit.client.0.smithi123.stdout:3/977: mknod d0/d6/d1a/d62/d115/d1c/c14c 0 2024-02-20T08:05:47.881 INFO:tasks.workunit.client.0.smithi123.stdout:1/864: chown d3/db/fc1 636179707 1 2024-02-20T08:05:47.882 INFO:tasks.workunit.client.0.smithi123.stdout:1/865: chown d3/db/d34/d74/f9b 0 1 2024-02-20T08:05:47.883 INFO:tasks.workunit.client.0.smithi123.stdout:2/929: rename l12 to d1a/d29/d42/d73/dfb/l133 0 2024-02-20T08:05:47.884 INFO:tasks.workunit.client.0.smithi123.stdout:5/842: write d0/d34/d48/d4b/f7d [3172429,107841] 0 2024-02-20T08:05:47.885 INFO:tasks.workunit.client.0.smithi123.stdout:9/958: symlink d6/d19/d1a/d7c/d81/d10e/l130 0 2024-02-20T08:05:47.887 INFO:tasks.workunit.client.0.smithi123.stdout:2/930: readlink d1a/d29/d42/d80/da3/lac 0 2024-02-20T08:05:47.889 INFO:tasks.workunit.client.0.smithi123.stdout:3/978: dread - d0/d6/d1a/da1/d148/dcf/f105 zero size 2024-02-20T08:05:47.892 INFO:tasks.workunit.client.0.smithi123.stdout:8/872: creat d6/d1c/d22/f126 x:0 0 0 2024-02-20T08:05:47.893 INFO:tasks.workunit.client.0.smithi123.stdout:1/866: dwrite d3/db/d41/de5/dfe/f102 [0,4194304] 0 2024-02-20T08:05:47.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:47 smithi194 ceph-mon[37804]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T08:05:47.896 INFO:tasks.workunit.client.0.smithi123.stdout:2/931: mknod d1a/d29/d42/d80/da3/c134 0 2024-02-20T08:05:47.900 INFO:tasks.workunit.client.0.smithi123.stdout:4/903: dread d3/d2c/d43/f44 [0,4194304] 0 2024-02-20T08:05:47.906 INFO:tasks.workunit.client.0.smithi123.stdout:2/932: dread d1a/d29/d42/d52/d98/fb6 [0,4194304] 0 2024-02-20T08:05:47.919 INFO:tasks.workunit.client.0.smithi123.stdout:9/959: write d6/d19/d1a/d2b/d28/d9a/f26 [2733180,24138] 0 2024-02-20T08:05:47.922 INFO:tasks.workunit.client.0.smithi123.stdout:1/867: write d3/db/d34/d74/d6f/d63/dfd/d2c/d45/f95 [419685,101152] 0 2024-02-20T08:05:47.923 INFO:tasks.workunit.client.0.smithi123.stdout:5/843: truncate d0/d34/d48/d56/d25/f5f 430006 0 2024-02-20T08:05:47.923 INFO:tasks.workunit.client.0.smithi123.stdout:8/873: truncate d6/d1c/d22/d8c/dcd/f6a 3508936 0 2024-02-20T08:05:47.926 INFO:tasks.workunit.client.0.smithi123.stdout:2/933: write f10 [2125281,108655] 0 2024-02-20T08:05:47.929 INFO:tasks.workunit.client.0.smithi123.stdout:5/844: creat d0/d34/d48/d56/dcf/f110 x:0 0 0 2024-02-20T08:05:47.931 INFO:tasks.workunit.client.0.smithi123.stdout:3/979: dwrite d0/d6/d1a/d4b/f97 [4194304,4194304] 0 2024-02-20T08:05:47.933 INFO:tasks.workunit.client.0.smithi123.stdout:8/874: creat d6/d32/dd5/de0/d115/f127 x:0 0 0 2024-02-20T08:05:47.934 INFO:tasks.workunit.client.0.smithi123.stdout:2/934: fdatasync d1a/d29/d42/fbd 0 2024-02-20T08:05:47.936 INFO:tasks.workunit.client.0.smithi123.stdout:9/960: dwrite d6/d19/d1a/d7c/d81/f97 [0,4194304] 0 2024-02-20T08:05:47.937 INFO:tasks.workunit.client.0.smithi123.stdout:4/904: dwrite d3/d2c/d43/d26/d2e/dcd/fd6 [4194304,4194304] 0 2024-02-20T08:05:47.937 INFO:tasks.workunit.client.0.smithi123.stdout:5/845: dread - d0/d34/d67/fbd zero size 2024-02-20T08:05:47.938 INFO:tasks.workunit.client.0.smithi123.stdout:3/980: write d0/d6/d1a/d1e/fd7 [3774131,116833] 0 2024-02-20T08:05:47.940 INFO:tasks.workunit.client.0.smithi123.stdout:2/935: dread - d1a/d29/d42/d73/d8f/f12c zero size 2024-02-20T08:05:47.941 INFO:tasks.workunit.client.0.smithi123.stdout:5/846: readlink d0/d34/d48/d4b/d51/l85 0 2024-02-20T08:05:47.941 INFO:tasks.workunit.client.0.smithi123.stdout:8/875: truncate d6/dbd/d5b/d8f/d98/f109 1010413 0 2024-02-20T08:05:47.945 INFO:tasks.workunit.client.0.smithi123.stdout:9/961: creat d6/d19/ddf/f131 x:0 0 0 2024-02-20T08:05:47.953 INFO:tasks.workunit.client.0.smithi123.stdout:4/905: mkdir d3/d2c/d43/d26/d3e/da9/dd9/de6/d129 0 2024-02-20T08:05:47.955 INFO:tasks.workunit.client.0.smithi123.stdout:4/906: chown d3/d2c/d43/lca 20 1 2024-02-20T08:05:47.955 INFO:tasks.workunit.client.0.smithi123.stdout:1/868: write d3/db/d34/d74/d6f/d63/dfd/d26/d2e/f77 [1483117,28943] 0 2024-02-20T08:05:47.958 INFO:tasks.workunit.client.0.smithi123.stdout:8/876: symlink d6/dbd/d5b/l128 0 2024-02-20T08:05:47.962 INFO:tasks.workunit.client.0.smithi123.stdout:7/966: sync 2024-02-20T08:05:47.965 INFO:tasks.workunit.client.0.smithi123.stdout:7/967: fsync d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/da2/ffc 0 2024-02-20T08:05:47.966 INFO:tasks.workunit.client.0.smithi123.stdout:8/877: dwrite d6/d32/d95/d7d/dab/fc0 [0,4194304] 0 2024-02-20T08:05:47.969 INFO:tasks.workunit.client.0.smithi123.stdout:7/968: creat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/f150 x:0 0 0 2024-02-20T08:05:47.971 INFO:tasks.workunit.client.0.smithi123.stdout:8/878: link d6/dbd/cc9 d6/dbd/d7e/d82/c129 0 2024-02-20T08:05:47.973 INFO:tasks.workunit.client.0.smithi123.stdout:2/936: write d1a/dd4/fe6 [287492,37291] 0 2024-02-20T08:05:47.973 INFO:tasks.workunit.client.0.smithi123.stdout:8/879: mknod d6/d32/dd5/de0/c12a 0 2024-02-20T08:05:47.974 INFO:tasks.workunit.client.0.smithi123.stdout:3/981: write d0/d6/d1a/d62/f106 [103337,119580] 0 2024-02-20T08:05:47.976 INFO:tasks.workunit.client.0.smithi123.stdout:7/969: symlink d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/d101/l151 0 2024-02-20T08:05:47.978 INFO:tasks.workunit.client.0.smithi123.stdout:2/937: symlink d1a/d29/d42/dbb/l135 0 2024-02-20T08:05:47.978 INFO:tasks.workunit.client.0.smithi123.stdout:9/962: write d6/d19/d1a/d2b/d28/d9a/f70 [189525,53413] 0 2024-02-20T08:05:47.982 INFO:tasks.workunit.client.0.smithi123.stdout:5/847: dread d0/d34/d48/d56/dbb/d27/d4e/d9b/fb5 [0,4194304] 0 2024-02-20T08:05:47.983 INFO:tasks.workunit.client.0.smithi123.stdout:4/907: write d3/d2c/d43/d26/d3e/da9/dd9/fe7 [2457773,82931] 0 2024-02-20T08:05:47.986 INFO:tasks.workunit.client.0.smithi123.stdout:1/869: write d3/db/d7f/f119 [816560,78475] 0 2024-02-20T08:05:47.986 INFO:tasks.workunit.client.0.smithi123.stdout:9/963: creat d6/d19/d1a/d2b/d65/d77/da5/f132 x:0 0 0 2024-02-20T08:05:47.987 INFO:tasks.workunit.client.0.smithi123.stdout:9/964: chown d6/d19/d1a/d7f/d12b 7331 1 2024-02-20T08:05:47.988 INFO:tasks.workunit.client.0.smithi123.stdout:9/965: fsync d6/d2a/d27/d3c/fed 0 2024-02-20T08:05:47.989 INFO:tasks.workunit.client.0.smithi123.stdout:7/970: unlink d0/d6/dd/d52/d35/d9c/d70/dd9/d12b/c143 0 2024-02-20T08:05:47.991 INFO:tasks.workunit.client.0.smithi123.stdout:7/971: stat d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/f103 0 2024-02-20T08:05:47.992 INFO:tasks.workunit.client.0.smithi123.stdout:7/972: dread - d0/d6/dd/d52/d138/f14b zero size 2024-02-20T08:05:47.995 INFO:tasks.workunit.client.0.smithi123.stdout:8/880: creat d6/d1c/d22/d8c/dcd/db9/dc3/dd3/f12b x:0 0 0 2024-02-20T08:05:47.997 INFO:tasks.workunit.client.0.smithi123.stdout:8/881: truncate d6/d1c/d47/f119 74170 0 2024-02-20T08:05:47.998 INFO:tasks.workunit.client.0.smithi123.stdout:2/938: write d1a/d29/d42/d52/f56 [68181,27157] 0 2024-02-20T08:05:47.999 INFO:tasks.workunit.client.0.smithi123.stdout:4/908: creat d3/d97/dda/de3/f12a x:0 0 0 2024-02-20T08:05:48.003 INFO:tasks.workunit.client.0.smithi123.stdout:5/848: dread d0/d34/d48/d56/dbb/d27/f63 [0,4194304] 0 2024-02-20T08:05:48.003 INFO:tasks.workunit.client.0.smithi123.stdout:7/973: symlink d0/d6/dd/d52/d138/l152 0 2024-02-20T08:05:48.004 INFO:tasks.workunit.client.0.smithi123.stdout:3/982: dwrite d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f11b [0,4194304] 0 2024-02-20T08:05:48.004 INFO:tasks.workunit.client.0.smithi123.stdout:1/870: mknod d3/db/d41/de5/d120/c136 0 2024-02-20T08:05:48.005 INFO:tasks.workunit.client.0.smithi123.stdout:5/849: read - d0/d34/d48/d4b/fff zero size 2024-02-20T08:05:48.007 INFO:tasks.workunit.client.0.smithi123.stdout:8/882: creat d6/dbd/f12c x:0 0 0 2024-02-20T08:05:48.009 INFO:tasks.workunit.client.0.smithi123.stdout:2/939: creat d1a/d29/d42/d80/da3/ded/f136 x:0 0 0 2024-02-20T08:05:48.016 INFO:tasks.workunit.client.0.smithi123.stdout:8/883: mkdir d6/d1c/d47/d10a/d12d 0 2024-02-20T08:05:48.020 INFO:tasks.workunit.client.0.smithi123.stdout:9/966: truncate d6/d19/d1a/f5b 1954158 0 2024-02-20T08:05:48.021 INFO:tasks.workunit.client.0.smithi123.stdout:1/871: mkdir d3/db/d34/d74/d6f/d63/d104/d137 0 2024-02-20T08:05:48.022 INFO:tasks.workunit.client.0.smithi123.stdout:1/872: fsync d3/d47/fa0 0 2024-02-20T08:05:48.026 INFO:tasks.workunit.client.0.smithi123.stdout:2/940: rename d1a/d29/fcf to d1a/d29/d42/d52/dcc/f137 0 2024-02-20T08:05:48.026 INFO:tasks.workunit.client.0.smithi123.stdout:8/884: read d6/d1c/d22/d8c/dcd/f6a [20062,86755] 0 2024-02-20T08:05:48.026 INFO:tasks.workunit.client.0.smithi123.stdout:7/974: write d0/db/fa1 [3931573,67265] 0 2024-02-20T08:05:48.027 INFO:tasks.workunit.client.0.smithi123.stdout:3/983: creat d0/d6/d1a/d62/d82/f14d x:0 0 0 2024-02-20T08:05:48.028 INFO:tasks.workunit.client.0.smithi123.stdout:2/941: stat d1a/d29/d5d/ffd 0 2024-02-20T08:05:48.030 INFO:tasks.workunit.client.0.smithi123.stdout:9/967: chown d6/d19/d1a/d2b/d28/d9a/d3d/d32/ca3 8931 1 2024-02-20T08:05:48.031 INFO:tasks.workunit.client.0.smithi123.stdout:4/909: dwrite d3/d18/d63/f83 [0,4194304] 0 2024-02-20T08:05:48.031 INFO:tasks.workunit.client.0.smithi123.stdout:5/850: creat d0/d34/d48/d56/d4c/d43/dd2/f111 x:0 0 0 2024-02-20T08:05:48.034 INFO:tasks.workunit.client.0.smithi123.stdout:3/984: mkdir d0/d6/d1a/def/d14e 0 2024-02-20T08:05:48.034 INFO:tasks.workunit.client.0.smithi123.stdout:4/910: write d3/d1e/d81/f10d [873697,62013] 0 2024-02-20T08:05:48.035 INFO:tasks.workunit.client.0.smithi123.stdout:5/851: chown d0/d34/d67/d80/d84/cf2 576186 1 2024-02-20T08:05:48.036 INFO:tasks.workunit.client.0.smithi123.stdout:5/852: chown d0/d34/d67/d80/d84/cf2 214 1 2024-02-20T08:05:48.042 INFO:tasks.workunit.client.0.smithi123.stdout:5/853: mknod d0/d34/d48/d56/d25/c112 0 2024-02-20T08:05:48.043 INFO:tasks.workunit.client.0.smithi123.stdout:8/885: dwrite d6/d1c/ff9 [0,4194304] 0 2024-02-20T08:05:48.045 INFO:tasks.workunit.client.0.smithi123.stdout:2/942: rename d1a/d29/d39/f3a to d1a/f138 0 2024-02-20T08:05:48.051 INFO:tasks.workunit.client.0.smithi123.stdout:1/873: dread d3/db/d34/d74/d6f/d63/dfd/d26/fd6 [4194304,4194304] 0 2024-02-20T08:05:48.051 INFO:tasks.workunit.client.0.smithi123.stdout:5/854: dread - d0/d34/d48/d56/d4c/d43/dd2/ddd/f102 zero size 2024-02-20T08:05:48.051 INFO:tasks.workunit.client.0.smithi123.stdout:8/886: dwrite d6/d32/d95/f7a [0,4194304] 0 2024-02-20T08:05:48.053 INFO:tasks.workunit.client.0.smithi123.stdout:3/985: getdents d0/d6/d1a/da1/d148/dcf 0 2024-02-20T08:05:48.054 INFO:tasks.workunit.client.0.smithi123.stdout:5/855: stat d0/d34/d67/d80/dcd/c10b 0 2024-02-20T08:05:48.056 INFO:tasks.workunit.client.0.smithi123.stdout:2/943: mknod d1a/d29/d5d/d97/c139 0 2024-02-20T08:05:48.057 INFO:tasks.workunit.client.0.smithi123.stdout:1/874: symlink d3/d47/l138 0 2024-02-20T08:05:48.060 INFO:tasks.workunit.client.0.smithi123.stdout:4/911: rename d3/d2c/ff4 to d3/d2c/d43/d34/d110/f12b 0 2024-02-20T08:05:48.061 INFO:tasks.workunit.client.0.smithi123.stdout:8/887: mknod d6/d32/dd5/c12e 0 2024-02-20T08:05:48.067 INFO:tasks.workunit.client.0.smithi123.stdout:3/986: unlink d0/d6/d1a/d62/d115/d1c/d21/d64/f13c 0 2024-02-20T08:05:48.072 INFO:tasks.workunit.client.0.smithi123.stdout:3/987: dread d0/d6/d1a/d62/d115/d1c/d21/f29 [4194304,4194304] 0 2024-02-20T08:05:48.073 INFO:tasks.workunit.client.0.smithi123.stdout:1/875: dread d3/db/d34/d74/d6f/f83 [0,4194304] 0 2024-02-20T08:05:48.073 INFO:tasks.workunit.client.0.smithi123.stdout:4/912: rmdir d3/d18/d7d/d96/dbc 39 2024-02-20T08:05:48.074 INFO:tasks.workunit.client.0.smithi123.stdout:7/975: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/f5b [4194304,4194304] 0 2024-02-20T08:05:48.076 INFO:tasks.workunit.client.0.smithi123.stdout:8/888: mknod d6/d1c/d47/df6/c12f 0 2024-02-20T08:05:48.078 INFO:tasks.workunit.client.0.smithi123.stdout:7/976: read d0/d6/dd/fdc [264135,118051] 0 2024-02-20T08:05:48.078 INFO:tasks.workunit.client.0.smithi123.stdout:8/889: chown d6/d32/dd5/de0 7141934 1 2024-02-20T08:05:48.081 INFO:tasks.workunit.client.0.smithi123.stdout:7/977: fdatasync d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/f14e 0 2024-02-20T08:05:48.082 INFO:tasks.workunit.client.0.smithi123.stdout:7/978: write d0/d6/dd/d52/d26/d7b/ff6 [2657888,79956] 0 2024-02-20T08:05:48.083 INFO:tasks.workunit.client.0.smithi123.stdout:7/979: chown d0/db/f100 19048 1 2024-02-20T08:05:48.085 INFO:tasks.workunit.client.0.smithi123.stdout:3/988: rename d0/d6/d1a/d62/d115/d1c/f4f to d0/d6/d1a/def/f14f 0 2024-02-20T08:05:48.086 INFO:tasks.workunit.client.0.smithi123.stdout:5/856: write d0/d34/d67/d80/d84/fc3 [428252,51658] 0 2024-02-20T08:05:48.089 INFO:tasks.workunit.client.0.smithi123.stdout:1/876: unlink d3/db/d34/d74/d6f/d63/dfd/d2c/fb5 0 2024-02-20T08:05:48.089 INFO:tasks.workunit.client.0.smithi123.stdout:3/989: read d0/d6/d1a/d62/d115/d1c/d21/d8e/d149/d6a/d74/f12a [1778525,107323] 0 2024-02-20T08:05:48.092 INFO:tasks.workunit.client.0.smithi123.stdout:8/890: symlink d6/dbd/d5b/d8f/l130 0 2024-02-20T08:05:48.093 INFO:tasks.workunit.client.0.smithi123.stdout:8/891: fsync d6/dbd/d7e/d82/f118 0 2024-02-20T08:05:48.094 INFO:tasks.workunit.client.0.smithi123.stdout:4/913: mkdir d3/d2c/d12c 0 2024-02-20T08:05:48.095 INFO:tasks.workunit.client.0.smithi123.stdout:1/877: dwrite d3/db/d34/db4/fc4 [0,4194304] 0 2024-02-20T08:05:48.101 INFO:tasks.workunit.client.0.smithi123.stdout:3/990: symlink d0/d6/d34/l150 0 2024-02-20T08:05:48.103 INFO:tasks.workunit.client.0.smithi123.stdout:5/857: read d0/d34/d48/d56/d25/f8e [334201,38487] 0 2024-02-20T08:05:48.103 INFO:tasks.workunit.client.0.smithi123.stdout:2/944: getdents d1a/d29/d42/d4e/dbc 0 2024-02-20T08:05:48.104 INFO:tasks.workunit.client.0.smithi123.stdout:7/980: getdents d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/ddd/dc5/d4b/d13a 0 2024-02-20T08:05:48.110 INFO:tasks.workunit.client.0.smithi123.stdout:1/878: chown d3/db/d34/d74/d6f/d63/dfd/d2c/d4f/fac 389360 1 2024-02-20T08:05:48.111 INFO:tasks.workunit.client.0.smithi123.stdout:4/914: mkdir d3/d2c/d5a/d103/d12d 0 2024-02-20T08:05:48.111 INFO:tasks.workunit.client.0.smithi123.stdout:3/991: dwrite d0/d6/d34/fad [4194304,4194304] 0 2024-02-20T08:05:48.113 INFO:tasks.workunit.client.0.smithi123.stdout:1/879: readlink d3/db/d34/d74/d6f/d63/dfd/d36/l85 0 2024-02-20T08:05:48.116 INFO:tasks.workunit.client.0.smithi123.stdout:4/915: creat d3/dcb/f12e x:0 0 0 2024-02-20T08:05:48.118 INFO:tasks.workunit.client.0.smithi123.stdout:3/992: unlink d0/dd/ff2 0 2024-02-20T08:05:48.120 INFO:tasks.workunit.client.0.smithi123.stdout:5/858: rename d0/d34/d48/d56/d4c/d43/dd2/ddd to d0/d34/d48/d56/dbb/d27/d4e/d91/d113 0 2024-02-20T08:05:48.122 INFO:tasks.workunit.client.0.smithi123.stdout:4/916: mkdir d3/d97/d111/d126/d12f 0 2024-02-20T08:05:48.122 INFO:tasks.workunit.client.0.smithi123.stdout:7/981: getdents d0/d6/dd/d52/d35/d9c/d70/dd9/d12b 0 2024-02-20T08:05:48.122 INFO:tasks.workunit.client.0.smithi123.stdout:5/859: chown d0/d34/d67/d80/d84/ccc 16 1 2024-02-20T08:05:48.126 INFO:tasks.workunit.client.0.smithi123.stdout:5/860: creat d0/d34/d48/d56/dce/f114 x:0 0 0 2024-02-20T08:05:48.127 INFO:tasks.workunit.client.0.smithi123.stdout:4/917: mknod d3/d2c/c130 0 2024-02-20T08:05:48.128 INFO:tasks.workunit.client.0.smithi123.stdout:4/918: chown d3/d2c/d43/d34/d110 3787 1 2024-02-20T08:05:48.130 INFO:tasks.workunit.client.0.smithi123.stdout:3/993: dread d0/d6/d1a/d62/d115/f54 [0,4194304] 0 2024-02-20T08:05:48.131 INFO:tasks.workunit.client.0.smithi123.stdout:3/994: stat d0/db9 0 2024-02-20T08:05:48.132 INFO:tasks.workunit.client.0.smithi123.stdout:2/945: dread d1a/d29/d39/f5f [4194304,4194304] 0 2024-02-20T08:05:48.136 INFO:tasks.workunit.client.0.smithi123.stdout:2/946: read f5 [5904742,63397] 0 2024-02-20T08:05:48.137 INFO:tasks.workunit.client.0.smithi123.stdout:3/995: mknod d0/d6/d1a/d62/d115/d1c/d21/dd9/c151 0 2024-02-20T08:05:48.138 INFO:tasks.workunit.client.0.smithi123.stdout:2/947: stat d1a/d29/c104 0 2024-02-20T08:05:48.140 INFO:tasks.workunit.client.0.smithi123.stdout:4/919: rename d3/d18/d7d/d96/dbc/c11b to d3/d2c/d43/d26/d3e/da9/dd9/c131 0 2024-02-20T08:05:48.142 INFO:tasks.workunit.client.0.smithi123.stdout:2/948: unlink d1a/d29/d42/lb7 0 2024-02-20T08:05:48.142 INFO:tasks.workunit.client.0.smithi123.stdout:7/982: dread d0/d6/dd/f136 [0,4194304] 0 2024-02-20T08:05:48.145 INFO:tasks.workunit.client.0.smithi123.stdout:5/861: dread d0/d34/d48/d56/dbb/d27/d37/f92 [0,4194304] 0 2024-02-20T08:05:48.146 INFO:tasks.workunit.client.0.smithi123.stdout:2/949: readlink d1a/d29/d42/d73/l112 0 2024-02-20T08:05:48.146 INFO:tasks.workunit.client.0.smithi123.stdout:1/880: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:48.147 INFO:tasks.workunit.client.0.smithi123.stdout:7/983: creat d0/d6/d9d/f153 x:0 0 0 2024-02-20T08:05:48.148 INFO:tasks.workunit.client.0.smithi123.stdout:7/984: chown d0/d6/dd/d52/d35/d9c 29 1 2024-02-20T08:05:48.149 INFO:tasks.workunit.client.0.smithi123.stdout:2/950: read d1a/d29/d42/d52/d98/da1/daa/dd0/ffc [173292,39652] 0 2024-02-20T08:05:48.150 INFO:tasks.workunit.client.0.smithi123.stdout:4/920: rename d3/d2c/l89 to d3/d97/d111/d126/l132 0 2024-02-20T08:05:48.152 INFO:tasks.workunit.client.0.smithi123.stdout:3/996: getdents d0/d6/d1a/d62/d115/d1c/d61/dd1/dda 0 2024-02-20T08:05:48.152 INFO:tasks.workunit.client.0.smithi123.stdout:4/921: write d3/d2c/d43/d26/d3e/f6d [466965,44938] 0 2024-02-20T08:05:48.153 INFO:tasks.workunit.client.0.smithi123.stdout:3/997: readlink d0/d6/d1a/d62/d115/lb1 0 2024-02-20T08:05:48.155 INFO:tasks.workunit.client.0.smithi123.stdout:7/985: unlink d0/d6/f53 0 2024-02-20T08:05:48.155 INFO:tasks.workunit.client.0.smithi123.stdout:3/998: fdatasync d0/d6/d1a/d62/d115/d57/dd0/daa/dde/f11b 0 2024-02-20T08:05:48.157 INFO:tasks.workunit.client.0.smithi123.stdout:3/999: write d0/d6/d1a/d62/d115/d1c/d3b/d43/f12e [644778,65530] 0 2024-02-20T08:05:48.159 INFO:tasks.workunit.client.0.smithi123.stdout:5/862: rename d0/d34/ca3 to d0/d34/d48/d56/dbb/d27/d86/c115 0 2024-02-20T08:05:48.159 INFO:tasks.workunit.client.0.smithi123.stdout:2/951: mkdir d1a/d29/d42/d80/da3/ded/d13a 0 2024-02-20T08:05:48.165 INFO:tasks.workunit.client.0.smithi123.stdout:4/922: dread d3/d97/dda/fc6 [0,4194304] 0 2024-02-20T08:05:48.169 INFO:tasks.workunit.client.0.smithi123.stdout:2/952: unlink d1a/d29/c74 0 2024-02-20T08:05:48.171 INFO:tasks.workunit.client.0.smithi123.stdout:4/923: dwrite d3/d2c/d5a/fad [0,4194304] 0 2024-02-20T08:05:48.177 INFO:tasks.workunit.client.0.smithi123.stdout:2/953: mknod d1a/d29/d42/d52/d98/da1/c13b 0 2024-02-20T08:05:48.179 INFO:tasks.workunit.client.0.smithi123.stdout:4/924: creat d3/d97/f133 x:0 0 0 2024-02-20T08:05:48.180 INFO:tasks.workunit.client.0.smithi123.stdout:2/954: mkdir d1a/d29/d42/dc8/d13c 0 2024-02-20T08:05:48.192 INFO:tasks.workunit.client.0.smithi123.stdout:1/881: dwrite d3/db/d34/d74/f51 [0,4194304] 0 2024-02-20T08:05:48.193 INFO:tasks.workunit.client.0.smithi123.stdout:1/882: stat d3/db/d34/db4 0 2024-02-20T08:05:48.198 INFO:tasks.workunit.client.0.smithi123.stdout:1/883: symlink d3/db/d41/de5/dfe/l139 0 2024-02-20T08:05:48.199 INFO:tasks.workunit.client.0.smithi123.stdout:4/925: dread d3/d18/f23 [0,4194304] 0 2024-02-20T08:05:48.201 INFO:tasks.workunit.client.0.smithi123.stdout:7/986: rmdir d0/d6/dd/d52/d26/d9b/d61/d145 39 2024-02-20T08:05:48.204 INFO:tasks.workunit.client.0.smithi123.stdout:4/926: write d3/d18/f19 [4145657,77093] 0 2024-02-20T08:05:48.212 INFO:tasks.workunit.client.0.smithi123.stdout:2/955: write f5 [2053480,114311] 0 2024-02-20T08:05:48.215 INFO:tasks.workunit.client.0.smithi123.stdout:5/863: rename d0/d34/d48/d56/dbb/d27/d4e/d91/d113 to d0/d34/d48/d116 0 2024-02-20T08:05:48.220 INFO:tasks.workunit.client.0.smithi123.stdout:4/927: dread d3/d2c/d43/d26/d2e/dcd/fd6 [0,4194304] 0 2024-02-20T08:05:48.220 INFO:tasks.workunit.client.0.smithi123.stdout:5/864: mknod d0/d34/d48/d56/dcf/c117 0 2024-02-20T08:05:48.222 INFO:tasks.workunit.client.0.smithi123.stdout:5/865: chown d0/d34/d48/d56/d25/f8e 10 1 2024-02-20T08:05:48.222 INFO:tasks.workunit.client.0.smithi123.stdout:7/987: link d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/d5c/d79/c104 d0/d6/dd/d52/d26/d9b/d61/db1/c154 0 2024-02-20T08:05:48.226 INFO:tasks.workunit.client.0.smithi123.stdout:7/988: fdatasync d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/fca 0 2024-02-20T08:05:48.227 INFO:tasks.workunit.client.0.smithi123.stdout:2/956: link d1a/d29/d42/d4e/c61 d1a/d29/d42/d73/d8f/c13d 0 2024-02-20T08:05:48.227 INFO:tasks.workunit.client.0.smithi123.stdout:1/884: dwrite d3/db/d34/d74/d6f/d63/dfd/d36/d59/f82 [0,4194304] 0 2024-02-20T08:05:48.228 INFO:tasks.workunit.client.0.smithi123.stdout:5/866: write d0/d34/d48/d56/d3e/ddf/f103 [1805029,54641] 0 2024-02-20T08:05:48.230 INFO:tasks.workunit.client.0.smithi123.stdout:1/885: fdatasync d3/db/fc1 0 2024-02-20T08:05:48.235 INFO:tasks.workunit.client.0.smithi123.stdout:7/989: chown d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/cbb 1410620 1 2024-02-20T08:05:48.236 INFO:tasks.workunit.client.0.smithi123.stdout:7/990: write d0/db/f100 [889188,95905] 0 2024-02-20T08:05:48.236 INFO:tasks.workunit.client.0.smithi123.stdout:4/928: link d3/d1e/d81/fe2 d3/d18/d63/d127/f134 0 2024-02-20T08:05:48.242 INFO:tasks.workunit.client.0.smithi123.stdout:7/991: readlink d0/d6/l48 0 2024-02-20T08:05:48.244 INFO:tasks.workunit.client.0.smithi123.stdout:5/867: getdents d0/d34/d48/d56/d4c/d43/dd2 0 2024-02-20T08:05:48.247 INFO:tasks.workunit.client.0.smithi123.stdout:7/992: rename d0/d6/dd/d52/d26/d9b/d61/df7/l126 to d0/d6/dd/d52/d35/d9c/d70/l155 0 2024-02-20T08:05:48.247 INFO:tasks.workunit.client.0.smithi123.stdout:5/868: mknod d0/d34/d48/d56/dce/c118 0 2024-02-20T08:05:48.249 INFO:tasks.workunit.client.0.smithi123.stdout:2/957: write d1a/d29/d42/d52/d98/da1/deb/dd1/f100 [2425071,126375] 0 2024-02-20T08:05:48.251 INFO:tasks.workunit.client.0.smithi123.stdout:1/886: write d3/db/d34/d74/d6f/d63/dfd/d26/d56/f10e [381050,44590] 0 2024-02-20T08:05:48.251 INFO:tasks.workunit.client.0.smithi123.stdout:5/869: chown d0/d34/d67/laf 1 1 2024-02-20T08:05:48.253 INFO:tasks.workunit.client.0.smithi123.stdout:5/870: stat d0/d34/d48/d4b/ld0 0 2024-02-20T08:05:48.255 INFO:tasks.workunit.client.0.smithi123.stdout:5/871: rmdir d0/d34/d48/d116 39 2024-02-20T08:05:48.256 INFO:tasks.workunit.client.0.smithi123.stdout:5/872: chown d0/d34/d48/d56/dcf/c117 10868 1 2024-02-20T08:05:48.259 INFO:tasks.workunit.client.0.smithi123.stdout:2/958: write d1a/d29/d42/d80/da3/fa2 [3058119,17521] 0 2024-02-20T08:05:48.262 INFO:tasks.workunit.client.0.smithi123.stdout:7/993: link d0/d6/f31 d0/d6/d9d/d139/f156 0 2024-02-20T08:05:48.268 INFO:tasks.workunit.client.0.smithi123.stdout:1/887: dwrite d3/db/d34/d74/f9b [0,4194304] 0 2024-02-20T08:05:48.272 INFO:tasks.workunit.client.0.smithi123.stdout:5/873: dwrite d0/d34/d48/d56/dbb/f2c [0,4194304] 0 2024-02-20T08:05:48.275 INFO:tasks.workunit.client.0.smithi123.stdout:2/959: dread d1a/d4f/f53 [0,4194304] 0 2024-02-20T08:05:48.276 INFO:tasks.workunit.client.0.smithi123.stdout:1/888: truncate d3/de/f13 3782748 0 2024-02-20T08:05:48.277 INFO:tasks.workunit.client.0.smithi123.stdout:7/994: dwrite d0/d6/dd/d52/d26/fce [4194304,4194304] 0 2024-02-20T08:05:48.281 INFO:tasks.workunit.client.0.smithi123.stdout:5/874: unlink d0/d34/d48/d56/c4d 0 2024-02-20T08:05:48.286 INFO:tasks.workunit.client.0.smithi123.stdout:1/889: creat d3/db/d34/f13a x:0 0 0 2024-02-20T08:05:48.288 INFO:tasks.workunit.client.0.smithi123.stdout:5/875: fsync d0/d34/d48/d56/dbb/d27/d4e/d9b/fb5 0 2024-02-20T08:05:48.288 INFO:tasks.workunit.client.0.smithi123.stdout:7/995: dwrite d0/d6/dd/d52/d35/d9c/d70/dd9/d4a/d59/f150 [0,4194304] 0 2024-02-20T08:05:48.294 INFO:tasks.workunit.client.0.smithi123.stdout:7/996: mkdir d0/d6/dd/d52/d35/d9c/d70/dd9/dbc/d11f/d157 0 2024-02-20T08:05:48.297 INFO:tasks.workunit.client.0.smithi123.stdout:1/890: dwrite d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/fa7 [4194304,4194304] 0 2024-02-20T08:05:48.300 INFO:tasks.workunit.client.0.smithi123.stdout:7/997: truncate d0/d6/dd/fb4 554870 0 2024-02-20T08:05:48.304 INFO:tasks.workunit.client.0.smithi123.stdout:1/891: mknod d3/db/d34/c13b 0 2024-02-20T08:05:48.308 INFO:tasks.workunit.client.0.smithi123.stdout:2/960: dread d1a/d29/d42/d52/d98/da1/daa/dd0/f107 [0,4194304] 0 2024-02-20T08:05:48.309 INFO:tasks.workunit.client.0.smithi123.stdout:5/876: rename d0/d34/d48/d56/dbb/d60/l8c to d0/l119 0 2024-02-20T08:05:48.314 INFO:tasks.workunit.client.0.smithi123.stdout:1/892: rename d3/db/d34/d74/d6f/d63/dfd/d2c/d11c to d3/de/dfb/d13c 0 2024-02-20T08:05:48.316 INFO:tasks.workunit.client.0.smithi123.stdout:5/877: fdatasync d0/d34/d48/d56/d25/f31 0 2024-02-20T08:05:48.321 INFO:tasks.workunit.client.0.smithi123.stdout:1/893: symlink d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/l13d 0 2024-02-20T08:05:48.329 INFO:tasks.workunit.client.0.smithi123.stdout:2/961: creat d1a/d29/d42/d52/d98/da1/f13e x:0 0 0 2024-02-20T08:05:48.333 INFO:tasks.workunit.client.0.smithi123.stdout:1/894: creat d3/db/d34/d74/d6f/d63/dfd/d26/d2e/d54/d9f/f13e x:0 0 0 2024-02-20T08:05:48.334 INFO:tasks.workunit.client.0.smithi123.stdout:1/895: write d3/f109 [743293,88091] 0 2024-02-20T08:05:48.338 INFO:tasks.workunit.client.0.smithi123.stdout:5/878: unlink d0/d34/d48/d56/d25/f5f 0 2024-02-20T08:05:48.339 INFO:tasks.workunit.client.0.smithi123.stdout:5/879: dread - d0/d34/d67/fbd zero size 2024-02-20T08:05:48.341 INFO:tasks.workunit.client.0.smithi123.stdout:5/880: write d0/d34/d48/d56/d25/f2d [364764,92222] 0 2024-02-20T08:05:48.343 INFO:tasks.workunit.client.0.smithi123.stdout:1/896: symlink d3/de/dfb/l13f 0 2024-02-20T08:05:48.346 INFO:tasks.workunit.client.0.smithi123.stdout:2/962: mknod d1a/d29/d42/d52/d98/dd6/c13f 0 2024-02-20T08:05:48.347 INFO:tasks.workunit.client.0.smithi123.stdout:7/998: dread d0/d6/dd/d52/d35/d9c/d70/fae [0,4194304] 0 2024-02-20T08:05:48.351 INFO:tasks.workunit.client.0.smithi123.stdout:1/897: unlink d3/db/d34/d74/d6f/d63/dfd/d2c/d4f/dcc/cd8 0 2024-02-20T08:05:48.356 INFO:tasks.workunit.client.0.smithi123.stdout:5/881: mknod d0/d34/d48/d56/d3e/ddf/df7/c11a 0 2024-02-20T08:05:48.358 INFO:tasks.workunit.client.0.smithi123.stdout:2/963: mkdir d1a/d29/d42/d73/d140 0 2024-02-20T08:05:48.363 INFO:tasks.workunit.client.0.smithi123.stdout:2/964: mkdir d1a/d29/d5d/d141 0 2024-02-20T08:05:48.364 INFO:tasks.workunit.client.0.smithi123.stdout:5/882: mknod d0/d34/d48/d116/c11b 0 2024-02-20T08:05:48.371 INFO:tasks.workunit.client.0.smithi123.stdout:7/999: link d0/fdf d0/d6/d29/f158 0 2024-02-20T08:05:48.373 INFO:tasks.workunit.client.0.smithi123.stdout:5/883: dread d0/d34/d48/f53 [0,4194304] 0 2024-02-20T08:05:48.374 INFO:tasks.workunit.client.0.smithi123.stdout:1/898: dread d3/db/d34/d74/d6f/d63/f72 [0,4194304] 0 2024-02-20T08:05:48.379 INFO:tasks.workunit.client.0.smithi123.stdout:1/899: creat d3/db/d34/d74/d6f/d63/dfd/d2c/d45/d9d/f140 x:0 0 0 2024-02-20T08:05:48.380 INFO:tasks.workunit.client.0.smithi123.stdout:5/884: creat d0/d34/d48/d56/d3e/ddf/d109/f11c x:0 0 0 2024-02-20T08:05:48.386 INFO:tasks.workunit.client.0.smithi123.stdout:5/885: fdatasync d0/f11 0 2024-02-20T08:05:48.391 INFO:tasks.workunit.client.0.smithi123.stdout:5/886: rmdir d0/d34/d48/d56/d3e 39 2024-02-20T08:05:48.392 INFO:tasks.workunit.client.0.smithi123.stdout:5/887: mknod d0/d34/d48/d4b/d51/c11d 0 2024-02-20T08:05:48.395 INFO:tasks.workunit.client.0.smithi123.stdout:5/888: truncate d0/d34/d48/d56/d4c/d43/dd2/f111 488647 0 2024-02-20T08:05:48.395 INFO:tasks.workunit.client.0.smithi123.stdout:5/889: write d0/ff1 [444953,108950] 0 2024-02-20T08:05:48.400 INFO:tasks.workunit.client.0.smithi123.stdout:5/890: mkdir d0/d34/d48/d11e 0 2024-02-20T08:05:48.411 INFO:tasks.workunit.client.0.smithi123.stdout:2/965: write d1a/f1d [2248628,128777] 0 2024-02-20T08:05:48.412 INFO:tasks.workunit.client.0.smithi123.stdout:2/966: write d1a/d29/d42/d52/d98/f9d [2970123,31396] 0 2024-02-20T08:05:48.416 INFO:tasks.workunit.client.0.smithi123.stdout:5/891: dread d0/fa9 [0,4194304] 0 2024-02-20T08:05:48.417 INFO:tasks.workunit.client.0.smithi123.stdout:2/967: stat d1a/d29/d39/f59 0 2024-02-20T08:05:48.417 INFO:tasks.workunit.client.0.smithi123.stdout:5/892: write d0/d34/d67/d80/fab [66740,70032] 0 2024-02-20T08:05:48.420 INFO:tasks.workunit.client.0.smithi123.stdout:1/900: rename d3/db/d34/d74/d6f/d63 to d3/de/dfb/d12a/d141 0 2024-02-20T08:05:48.424 INFO:tasks.workunit.client.0.smithi123.stdout:5/893: dwrite d0/d34/d48/d56/dce/f114 [0,4194304] 0 2024-02-20T08:05:48.426 INFO:tasks.workunit.client.0.smithi123.stdout:1/901: mknod d3/de/dfb/d12a/d141/dfd/d2c/d107/c142 0 2024-02-20T08:05:48.428 INFO:tasks.workunit.client.0.smithi123.stdout:2/968: rename d1a/c1c to d1a/d29/d42/d80/da3/c142 0 2024-02-20T08:05:48.571 INFO:tasks.workunit.client.0.smithi123.stdout:1/902: rmdir d3/de/dfb/d13c 0 2024-02-20T08:05:48.574 INFO:tasks.workunit.client.0.smithi123.stdout:1/903: symlink d3/db/d34/d74/l143 0 2024-02-20T08:05:48.578 INFO:tasks.workunit.client.0.smithi123.stdout:1/904: dread d3/de/dfb/d12a/d141/dfd/d26/d56/f10e [0,4194304] 0 2024-02-20T08:05:48.585 INFO:tasks.workunit.client.0.smithi123.stdout:8/892: sync 2024-02-20T08:05:48.586 INFO:tasks.workunit.client.0.smithi123.stdout:9/968: sync 2024-02-20T08:05:48.593 INFO:tasks.workunit.client.0.smithi123.stdout:9/969: dwrite d6/d19/d1a/d2b/d65/f120 [0,4194304] 0 2024-02-20T08:05:48.594 INFO:tasks.workunit.client.0.smithi123.stdout:8/893: mkdir d6/d1c/d22/d8c/da2/d131 0 2024-02-20T08:05:48.594 INFO:tasks.workunit.client.0.smithi123.stdout:9/970: dread - d6/d19/d1a/d2b/d65/d77/da5/f132 zero size 2024-02-20T08:05:48.600 INFO:tasks.workunit.client.0.smithi123.stdout:1/905: getdents d3/db/d34/d74/d6f 0 2024-02-20T08:05:48.603 INFO:tasks.workunit.client.0.smithi123.stdout:9/971: creat d6/d19/ddf/f133 x:0 0 0 2024-02-20T08:05:48.603 INFO:tasks.workunit.client.0.smithi123.stdout:1/906: truncate d3/de/dfb/d12a/d141/dfd/d2c/d4f/ff8 591231 0 2024-02-20T08:05:48.604 INFO:tasks.workunit.client.0.smithi123.stdout:9/972: chown d6/d2a/d27/d6f/d10d/f127 320862 1 2024-02-20T08:05:48.607 INFO:tasks.workunit.client.0.smithi123.stdout:9/973: fdatasync f5 0 2024-02-20T08:05:48.612 INFO:tasks.workunit.client.0.smithi123.stdout:9/974: mkdir d6/d2a/d27/d6f/d8b/de1/d134 0 2024-02-20T08:05:48.619 INFO:tasks.workunit.client.0.smithi123.stdout:9/975: truncate d6/d19/d1a/d7c/f86 1660216 0 2024-02-20T08:05:48.620 INFO:tasks.workunit.client.0.smithi123.stdout:9/976: fdatasync d6/d19/d1a/d6d/d7e/fac 0 2024-02-20T08:05:48.675 INFO:tasks.workunit.client.0.smithi123.stdout:2/969: dwrite d1a/d29/d42/d4e/f78 [0,4194304] 0 2024-02-20T08:05:48.682 INFO:tasks.workunit.client.0.smithi123.stdout:2/970: link d1a/d29/l2c d1a/d29/d42/d4e/dbc/l143 0 2024-02-20T08:05:48.689 INFO:tasks.workunit.client.0.smithi123.stdout:2/971: dwrite d1a/d4f/ff1 [4194304,4194304] 0 2024-02-20T08:05:48.694 INFO:tasks.workunit.client.0.smithi123.stdout:5/894: creat d0/d34/d67/f11f x:0 0 0 2024-02-20T08:05:48.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:48 smithi123 ceph-mon[29383]: pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 104 MiB/s wr, 309 op/s 2024-02-20T08:05:48.830 INFO:tasks.workunit.client.0.smithi123.stdout:4/929: sync 2024-02-20T08:05:48.869 INFO:tasks.workunit.client.0.smithi123.stdout:1/907: truncate d3/de/dfb/d12a/d141/dfd/d36/f3d 4726943 0 2024-02-20T08:05:48.870 INFO:tasks.workunit.client.0.smithi123.stdout:1/908: write d3/de/dfb/d12a/d141/dfd/d2c/d45/f95 [569462,96970] 0 2024-02-20T08:05:48.875 INFO:tasks.workunit.client.0.smithi123.stdout:1/909: truncate d3/de/dfb/d12a/d141/dfd/d26/d2e/fed 698843 0 2024-02-20T08:05:48.876 INFO:tasks.workunit.client.0.smithi123.stdout:1/910: stat d3/de/dfb/d12a/d141/dfd/d2c/d45/dec 0 2024-02-20T08:05:48.878 INFO:tasks.workunit.client.0.smithi123.stdout:1/911: getdents d3/de/dfb/d12a/d141/dfd/d2c/d45/dec 0 2024-02-20T08:05:48.882 INFO:tasks.workunit.client.0.smithi123.stdout:1/912: mknod d3/de/dfb/d12a/d141/dfd/d2c/d4f/c144 0 2024-02-20T08:05:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:48 smithi194 ceph-mon[37804]: pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 104 MiB/s wr, 309 op/s 2024-02-20T08:05:48.910 INFO:tasks.workunit.client.0.smithi123.stdout:5/895: write d0/f101 [3227119,129289] 0 2024-02-20T08:05:48.913 INFO:tasks.workunit.client.0.smithi123.stdout:5/896: symlink d0/d34/d48/d56/dcf/l120 0 2024-02-20T08:05:48.919 INFO:tasks.workunit.client.0.smithi123.stdout:5/897: rename d0/d34/d48/d56/d4c/f6b to d0/d34/d48/d56/dbb/d27/d4e/d91/f121 0 2024-02-20T08:05:48.922 INFO:tasks.workunit.client.0.smithi123.stdout:5/898: rename d0/d34/d67/dda/fef to d0/d34/d48/f122 0 2024-02-20T08:05:48.924 INFO:tasks.workunit.client.0.smithi123.stdout:5/899: truncate d0/d34/d48/d56/d25/fc1 809977 0 2024-02-20T08:05:48.934 INFO:tasks.workunit.client.0.smithi123.stdout:4/930: write d3/d2c/feb [6018586,5723] 0 2024-02-20T08:05:48.935 INFO:tasks.workunit.client.0.smithi123.stdout:4/931: chown d3/d1e/d81/c100 888675 1 2024-02-20T08:05:48.939 INFO:tasks.workunit.client.0.smithi123.stdout:4/932: mkdir d3/d18/d7d/d135 0 2024-02-20T08:05:48.949 INFO:tasks.workunit.client.0.smithi123.stdout:1/913: dwrite d3/f48 [0,4194304] 0 2024-02-20T08:05:48.952 INFO:tasks.workunit.client.0.smithi123.stdout:5/900: rmdir d0/d34/d48/d56/dbb/d27/d4e 39 2024-02-20T08:05:48.952 INFO:tasks.workunit.client.0.smithi123.stdout:5/901: chown d0/d34/d48/d56/fb1 0 1 2024-02-20T08:05:48.956 INFO:tasks.workunit.client.0.smithi123.stdout:5/902: rmdir d0/d34/d67 39 2024-02-20T08:05:48.965 INFO:tasks.workunit.client.0.smithi123.stdout:4/933: write d3/d1e/d81/fe2 [2279811,101267] 0 2024-02-20T08:05:48.967 INFO:tasks.workunit.client.0.smithi123.stdout:4/934: stat d3/d2c/d43/fff 0 2024-02-20T08:05:48.968 INFO:tasks.workunit.client.0.smithi123.stdout:5/903: truncate d0/ff1 137193 0 2024-02-20T08:05:48.969 INFO:tasks.workunit.client.0.smithi123.stdout:4/935: mknod d3/d18/d7d/d8b/c136 0 2024-02-20T08:05:48.971 INFO:tasks.workunit.client.0.smithi123.stdout:4/936: dread - d3/fb7 zero size 2024-02-20T08:05:48.971 INFO:tasks.workunit.client.0.smithi123.stdout:5/904: fsync d0/f8d 0 2024-02-20T08:05:48.983 INFO:tasks.workunit.client.0.smithi123.stdout:5/905: symlink d0/d34/d48/d56/dbb/d27/d4e/l123 0 2024-02-20T08:05:48.985 INFO:tasks.workunit.client.0.smithi123.stdout:4/937: dwrite d3/d1e/fc4 [0,4194304] 0 2024-02-20T08:05:48.989 INFO:tasks.workunit.client.0.smithi123.stdout:4/938: creat d3/d2c/d43/d26/d2e/f137 x:0 0 0 2024-02-20T08:05:48.992 INFO:tasks.workunit.client.0.smithi123.stdout:4/939: mkdir d3/d18/d63/d127/d138 0 2024-02-20T08:05:48.998 INFO:tasks.workunit.client.0.smithi123.stdout:4/940: rename d3/d97/f133 to d3/d18/d7d/d8b/d95/f139 0 2024-02-20T08:05:48.998 INFO:tasks.workunit.client.0.smithi123.stdout:5/906: link d0/d34/c77 d0/d34/d67/d80/c124 0 2024-02-20T08:05:49.000 INFO:tasks.workunit.client.0.smithi123.stdout:4/941: symlink d3/d2c/l13a 0 2024-02-20T08:05:49.002 INFO:tasks.workunit.client.0.smithi123.stdout:5/907: creat d0/d34/d48/d56/dbb/d27/d86/f125 x:0 0 0 2024-02-20T08:05:49.005 INFO:tasks.workunit.client.0.smithi123.stdout:4/942: creat d3/d18/f13b x:0 0 0 2024-02-20T08:05:49.008 INFO:tasks.workunit.client.0.smithi123.stdout:4/943: mkdir d3/d2c/d43/d26/d3e/d13c 0 2024-02-20T08:05:49.011 INFO:tasks.workunit.client.0.smithi123.stdout:4/944: dread d3/fd [0,4194304] 0 2024-02-20T08:05:49.015 INFO:tasks.workunit.client.0.smithi123.stdout:4/945: unlink d3/d2c/d43/d26/d2e/dcd/fd6 0 2024-02-20T08:05:49.017 INFO:tasks.workunit.client.0.smithi123.stdout:4/946: fdatasync d3/d2c/d43/d26/d2e/f52 0 2024-02-20T08:05:49.021 INFO:tasks.workunit.client.0.smithi123.stdout:4/947: symlink d3/d2c/d43/d26/d3e/da9/l13d 0 2024-02-20T08:05:49.024 INFO:tasks.workunit.client.0.smithi123.stdout:4/948: symlink d3/d18/d7d/d96/l13e 0 2024-02-20T08:05:49.027 INFO:tasks.workunit.client.0.smithi123.stdout:5/908: dwrite d0/d34/d48/d56/dbb/d27/d37/f8b [0,4194304] 0 2024-02-20T08:05:49.029 INFO:tasks.workunit.client.0.smithi123.stdout:5/909: write d0/d34/d48/d56/d25/f3b [971851,102879] 0 2024-02-20T08:05:49.036 INFO:tasks.workunit.client.0.smithi123.stdout:4/949: getdents d3/d2c/d43/d26/d3e/d8a/d10a 0 2024-02-20T08:05:49.038 INFO:tasks.workunit.client.0.smithi123.stdout:5/910: creat d0/d34/f126 x:0 0 0 2024-02-20T08:05:49.041 INFO:tasks.workunit.client.0.smithi123.stdout:5/911: creat d0/d34/d67/d80/dcd/f127 x:0 0 0 2024-02-20T08:05:49.043 INFO:tasks.workunit.client.0.smithi123.stdout:5/912: read - d0/d34/d48/d56/dbb/d27/d4e/d91/fe0 zero size 2024-02-20T08:05:49.047 INFO:tasks.workunit.client.0.smithi123.stdout:5/913: dread d0/d34/d48/d56/dbb/d27/d4e/d9b/fb5 [0,4194304] 0 2024-02-20T08:05:49.050 INFO:tasks.workunit.client.0.smithi123.stdout:5/914: mknod d0/d34/d48/d56/d3e/c128 0 2024-02-20T08:05:49.053 INFO:tasks.workunit.client.0.smithi123.stdout:4/950: dread d3/d18/f32 [0,4194304] 0 2024-02-20T08:05:49.055 INFO:tasks.workunit.client.0.smithi123.stdout:4/951: fsync d3/d97/fbe 0 2024-02-20T08:05:49.055 INFO:tasks.workunit.client.0.smithi123.stdout:5/915: dread d0/d34/d48/d56/dbb/d27/d4e/f7f [0,4194304] 0 2024-02-20T08:05:49.057 INFO:tasks.workunit.client.0.smithi123.stdout:5/916: stat d0/d34/d48/d56/d25/ca5 0 2024-02-20T08:05:49.059 INFO:tasks.workunit.client.0.smithi123.stdout:5/917: unlink d0/d34/d48/d56/dce/f114 0 2024-02-20T08:05:49.065 INFO:tasks.workunit.client.0.smithi123.stdout:5/918: rename d0/d34/d48/d56/d3e/ddf/df7/cfd to d0/d34/d48/d56/dce/c129 0 2024-02-20T08:05:49.066 INFO:tasks.workunit.client.0.smithi123.stdout:4/952: dread d3/f4d [0,4194304] 0 2024-02-20T08:05:49.068 INFO:tasks.workunit.client.0.smithi123.stdout:5/919: symlink d0/d34/d67/d80/l12a 0 2024-02-20T08:05:49.070 INFO:tasks.workunit.client.0.smithi123.stdout:4/953: chown d3/d2c/d43/d26/d3e/d8a/ce0 1210992358 1 2024-02-20T08:05:49.074 INFO:tasks.workunit.client.0.smithi123.stdout:4/954: getdents d3 0 2024-02-20T08:05:49.074 INFO:tasks.workunit.client.0.smithi123.stdout:4/955: stat d3/l101 0 2024-02-20T08:05:49.083 INFO:tasks.workunit.client.0.smithi123.stdout:5/920: dread d0/d34/d48/d56/d3e/ddf/f103 [0,4194304] 0 2024-02-20T08:05:49.084 INFO:tasks.workunit.client.0.smithi123.stdout:5/921: write d0/d34/d67/d80/d84/f10d [117586,83076] 0 2024-02-20T08:05:49.088 INFO:tasks.workunit.client.0.smithi123.stdout:5/922: creat d0/d34/d48/d56/d3e/f12b x:0 0 0 2024-02-20T08:05:49.089 INFO:tasks.workunit.client.0.smithi123.stdout:4/956: dwrite d3/d2c/d5a/d7e/ff2 [0,4194304] 0 2024-02-20T08:05:49.096 INFO:tasks.workunit.client.0.smithi123.stdout:5/923: dread d0/d34/d48/d56/dbb/f2c [0,4194304] 0 2024-02-20T08:05:49.099 INFO:tasks.workunit.client.0.smithi123.stdout:4/957: dwrite d3/d18/d63/d127/f134 [0,4194304] 0 2024-02-20T08:05:49.100 INFO:tasks.workunit.client.0.smithi123.stdout:5/924: mkdir d0/d34/d48/d56/dcf/d12c 0 2024-02-20T08:05:49.102 INFO:tasks.workunit.client.0.smithi123.stdout:5/925: fdatasync d0/d34/d48/d56/f10e 0 2024-02-20T08:05:49.105 INFO:tasks.workunit.client.0.smithi123.stdout:5/926: creat d0/d34/d48/d56/dbb/d27/d37/f12d x:0 0 0 2024-02-20T08:05:49.106 INFO:tasks.workunit.client.0.smithi123.stdout:4/958: write d3/d2c/d43/d26/d2e/f39 [511462,60527] 0 2024-02-20T08:05:49.108 INFO:tasks.workunit.client.0.smithi123.stdout:5/927: mknod d0/d34/d48/d56/dbb/d27/d4e/d9b/d108/c12e 0 2024-02-20T08:05:49.109 INFO:tasks.workunit.client.0.smithi123.stdout:5/928: readlink d0/d34/d48/d56/d25/l70 0 2024-02-20T08:05:49.109 INFO:tasks.workunit.client.0.smithi123.stdout:4/959: mknod d3/c13f 0 2024-02-20T08:05:49.110 INFO:tasks.workunit.client.0.smithi123.stdout:5/929: dread - d0/d34/d48/d56/dbb/d27/d4e/d91/fe0 zero size 2024-02-20T08:05:49.111 INFO:tasks.workunit.client.0.smithi123.stdout:5/930: chown d0/d34/d67/dda 66917 1 2024-02-20T08:05:49.115 INFO:tasks.workunit.client.0.smithi123.stdout:5/931: getdents d0/d34/d48/d56/d4c 0 2024-02-20T08:05:49.123 INFO:tasks.workunit.client.0.smithi123.stdout:8/894: sync 2024-02-20T08:05:49.126 INFO:tasks.workunit.client.0.smithi123.stdout:5/932: dwrite d0/d34/f66 [8388608,4194304] 0 2024-02-20T08:05:49.128 INFO:tasks.workunit.client.0.smithi123.stdout:5/933: chown d0/d34/d48/d56/cf6 375 1 2024-02-20T08:05:49.128 INFO:tasks.workunit.client.0.smithi123.stdout:8/895: getdents d6/d32/d95/db0 0 2024-02-20T08:05:49.129 INFO:tasks.workunit.client.0.smithi123.stdout:8/896: chown d6/d1c/d22/d8c/dcd/db9/dc3 738 1 2024-02-20T08:05:49.132 INFO:tasks.workunit.client.0.smithi123.stdout:5/934: creat d0/d34/d48/d56/d4c/f12f x:0 0 0 2024-02-20T08:05:49.136 INFO:tasks.workunit.client.0.smithi123.stdout:5/935: rmdir d0/d34/d48/d56/d3e 39 2024-02-20T08:05:49.138 INFO:tasks.workunit.client.0.smithi123.stdout:5/936: chown d0/d34/d48/d56/d3e/ddf/ff3 2000552556 1 2024-02-20T08:05:49.139 INFO:tasks.workunit.client.0.smithi123.stdout:5/937: getdents d0/d34/d48/d56/dcf/d12c 0 2024-02-20T08:05:49.140 INFO:tasks.workunit.client.0.smithi123.stdout:5/938: chown d0/d34/d48/d4b/f7d 10 1 2024-02-20T08:05:49.146 INFO:tasks.workunit.client.0.smithi123.stdout:4/960: dread d3/d2c/d43/d26/f8f [0,4194304] 0 2024-02-20T08:05:49.149 INFO:tasks.workunit.client.0.smithi123.stdout:8/897: dwrite d6/d1c/d22/d8c/dcd/f6a [0,4194304] 0 2024-02-20T08:05:49.151 INFO:tasks.workunit.client.0.smithi123.stdout:5/939: dwrite d0/f6a [0,4194304] 0 2024-02-20T08:05:49.155 INFO:tasks.workunit.client.0.smithi123.stdout:4/961: dread d3/d18/d63/f83 [0,4194304] 0 2024-02-20T08:05:49.158 INFO:tasks.workunit.client.0.smithi123.stdout:8/898: mknod d6/c132 0 2024-02-20T08:05:49.163 INFO:tasks.workunit.client.0.smithi123.stdout:8/899: truncate d6/d32/d95/fbb 524274 0 2024-02-20T08:05:49.164 INFO:tasks.workunit.client.0.smithi123.stdout:4/962: creat d3/d2c/d5a/d103/d12d/f140 x:0 0 0 2024-02-20T08:05:49.167 INFO:tasks.workunit.client.0.smithi123.stdout:8/900: symlink d6/d1c/d47/d10a/d12d/l133 0 2024-02-20T08:05:49.167 INFO:tasks.workunit.client.0.smithi123.stdout:5/940: dwrite d0/d34/d48/d56/dbb/d27/d4e/f52 [0,4194304] 0 2024-02-20T08:05:49.170 INFO:tasks.workunit.client.0.smithi123.stdout:8/901: mknod d6/d32/dd5/de0/d115/c134 0 2024-02-20T08:05:49.172 INFO:tasks.workunit.client.0.smithi123.stdout:5/941: write d0/d34/d48/d56/d3e/ddf/f103 [160796,85804] 0 2024-02-20T08:05:49.173 INFO:tasks.workunit.client.0.smithi123.stdout:4/963: getdents d3/d2c/d43/d26/d3e 0 2024-02-20T08:05:49.175 INFO:tasks.workunit.client.0.smithi123.stdout:8/902: creat d6/d32/d95/ddd/f135 x:0 0 0 2024-02-20T08:05:49.176 INFO:tasks.workunit.client.0.smithi123.stdout:5/942: unlink d0/lb0 0 2024-02-20T08:05:49.182 INFO:tasks.workunit.client.0.smithi123.stdout:4/964: link d3/d2c/d43/d26/d3e/d8a/ld5 d3/d97/d111/d126/l141 0 2024-02-20T08:05:49.197 INFO:tasks.workunit.client.0.smithi123.stdout:8/903: dread d6/fb [0,4194304] 0 2024-02-20T08:05:49.199 INFO:tasks.workunit.client.0.smithi123.stdout:8/904: fdatasync d6/dbd/d5b/d8f/d99/dd2/f116 0 2024-02-20T08:05:49.199 INFO:tasks.workunit.client.0.smithi123.stdout:4/965: dread d3/d2c/d5a/f92 [0,4194304] 0 2024-02-20T08:05:49.201 INFO:tasks.workunit.client.0.smithi123.stdout:5/943: dread d0/d34/d48/f61 [0,4194304] 0 2024-02-20T08:05:49.202 INFO:tasks.workunit.client.0.smithi123.stdout:8/905: mkdir d6/dbd/d7e/d136 0 2024-02-20T08:05:49.204 INFO:tasks.workunit.client.0.smithi123.stdout:4/966: rename d3/d2c/d43/d26/cb1 to d3/d97/d111/d126/d12f/c142 0 2024-02-20T08:05:49.206 INFO:tasks.workunit.client.0.smithi123.stdout:4/967: truncate d3/d2c/d5a/d103/d12d/f140 193517 0 2024-02-20T08:05:49.206 INFO:tasks.workunit.client.0.smithi123.stdout:5/944: dwrite d0/f9d [0,4194304] 0 2024-02-20T08:05:49.209 INFO:tasks.workunit.client.0.smithi123.stdout:8/906: dread d6/dbd/d5b/f7f [0,4194304] 0 2024-02-20T08:05:49.210 INFO:tasks.workunit.client.0.smithi123.stdout:8/907: fsync d6/dbd/d5b/d8f/d99/dfb/f114 0 2024-02-20T08:05:49.212 INFO:tasks.workunit.client.0.smithi123.stdout:4/968: rename d3/d97/dda/db6/f9e to d3/d2c/d5a/d103/d12d/f143 0 2024-02-20T08:05:49.215 INFO:tasks.workunit.client.0.smithi123.stdout:4/969: dread - d3/d2c/d43/d26/f10b zero size 2024-02-20T08:05:49.216 INFO:tasks.workunit.client.0.smithi123.stdout:5/945: dwrite d0/d34/d48/d56/dbb/d27/d4e/f7f [0,4194304] 0 2024-02-20T08:05:49.220 INFO:tasks.workunit.client.0.smithi123.stdout:4/970: symlink d3/d2c/d43/d34/l144 0 2024-02-20T08:05:49.225 INFO:tasks.workunit.client.0.smithi123.stdout:4/971: dread d3/d2c/d43/d26/d3e/da9/dd9/fe7 [0,4194304] 0 2024-02-20T08:05:49.230 INFO:tasks.workunit.client.0.smithi123.stdout:4/972: dwrite d3/d2c/feb [0,4194304] 0 2024-02-20T08:05:49.244 INFO:tasks.workunit.client.0.smithi123.stdout:4/973: write d3/d97/fbe [1716780,120053] 0 2024-02-20T08:05:49.245 INFO:tasks.workunit.client.0.smithi123.stdout:4/974: fsync d3/d2c/d43/d26/d2e/f137 0 2024-02-20T08:05:49.253 INFO:tasks.workunit.client.0.smithi123.stdout:4/975: dwrite d3/d2c/d43/f75 [0,4194304] 0 2024-02-20T08:05:49.253 INFO:tasks.workunit.client.0.smithi123.stdout:4/976: readlink d3/d2c/d43/l57 0 2024-02-20T08:05:49.255 INFO:tasks.workunit.client.0.smithi123.stdout:4/977: write d3/d97/df0/f11d [567837,116628] 0 2024-02-20T08:05:49.260 INFO:tasks.workunit.client.0.smithi123.stdout:4/978: rename d3/d18/d63/fa6 to d3/d2c/d43/d34/d110/f145 0 2024-02-20T08:05:49.262 INFO:tasks.workunit.client.0.smithi123.stdout:4/979: unlink d3/d2c/d43/d34/f55 0 2024-02-20T08:05:49.268 INFO:tasks.workunit.client.0.smithi123.stdout:4/980: dwrite d3/fd [0,4194304] 0 2024-02-20T08:05:49.272 INFO:tasks.workunit.client.0.smithi123.stdout:4/981: chown d3/d1e/d81/cd8 1 1 2024-02-20T08:05:49.273 INFO:tasks.workunit.client.0.smithi123.stdout:4/982: creat d3/d2c/d43/d26/d3e/d13c/f146 x:0 0 0 2024-02-20T08:05:49.275 INFO:tasks.workunit.client.0.smithi123.stdout:4/983: mknod d3/d18/d7d/d87/c147 0 2024-02-20T08:05:49.277 INFO:tasks.workunit.client.0.smithi123.stdout:4/984: mkdir d3/d18/d63/d148 0 2024-02-20T08:05:49.279 INFO:tasks.workunit.client.0.smithi123.stdout:4/985: creat d3/d18/d63/f149 x:0 0 0 2024-02-20T08:05:49.280 INFO:tasks.workunit.client.0.smithi123.stdout:4/986: write d3/f28 [4152613,42853] 0 2024-02-20T08:05:49.283 INFO:tasks.workunit.client.0.smithi123.stdout:4/987: fdatasync d3/d2c/d43/d26/d2e/f7f 0 2024-02-20T08:05:49.284 INFO:tasks.workunit.client.0.smithi123.stdout:4/988: chown d3/d18/f19 1 1 2024-02-20T08:05:49.302 INFO:tasks.workunit.client.0.smithi123.stdout:4/989: write d3/d18/d7d/d8b/d95/fe1 [589942,37039] 0 2024-02-20T08:05:49.305 INFO:tasks.workunit.client.0.smithi123.stdout:4/990: symlink d3/d18/d7d/d135/l14a 0 2024-02-20T08:05:49.306 INFO:tasks.workunit.client.0.smithi123.stdout:4/991: truncate d3/d97/df0/f11d 799505 0 2024-02-20T08:05:49.308 INFO:tasks.workunit.client.0.smithi123.stdout:4/992: read d3/d2c/d43/d34/d110/f12b [278263,9351] 0 2024-02-20T08:05:49.312 INFO:tasks.workunit.client.0.smithi123.stdout:4/993: dread d3/d97/df0/f11d [0,4194304] 0 2024-02-20T08:05:49.312 INFO:tasks.workunit.client.0.smithi123.stdout:4/994: chown d3/d2c/d43/d26/d2e 8114 1 2024-02-20T08:05:49.386 INFO:tasks.workunit.client.0.smithi123.stdout:1/914: sync 2024-02-20T08:05:49.386 INFO:tasks.workunit.client.0.smithi123.stdout:9/977: sync 2024-02-20T08:05:49.386 INFO:tasks.workunit.client.0.smithi123.stdout:2/972: sync 2024-02-20T08:05:49.389 INFO:tasks.workunit.client.0.smithi123.stdout:1/915: unlink d3/de/dfb/d12a/d141/dfd/d36/l85 0 2024-02-20T08:05:49.389 INFO:tasks.workunit.client.0.smithi123.stdout:1/916: stat d3/de/l2f 0 2024-02-20T08:05:49.390 INFO:tasks.workunit.client.0.smithi123.stdout:9/978: rename d6/d2a/f17 to d6/d2a/d27/d6f/d8b/de1/f135 0 2024-02-20T08:05:49.391 INFO:tasks.workunit.client.0.smithi123.stdout:2/973: mknod d1a/d29/d42/d52/d98/dd6/c144 0 2024-02-20T08:05:49.392 INFO:tasks.workunit.client.0.smithi123.stdout:1/917: chown d3/de/dfb/d12a/d141/dfd/d2c/d45/f8f 13923757 1 2024-02-20T08:05:49.396 INFO:tasks.workunit.client.0.smithi123.stdout:9/979: rmdir d6/d19/d1a/d6d/d7e/d80/dcc 39 2024-02-20T08:05:49.396 INFO:tasks.workunit.client.0.smithi123.stdout:1/918: fdatasync d3/db/d7f/f112 0 2024-02-20T08:05:49.400 INFO:tasks.workunit.client.0.smithi123.stdout:2/974: rename l4 to d1a/l145 0 2024-02-20T08:05:49.402 INFO:tasks.workunit.client.0.smithi123.stdout:9/980: creat d6/d19/d1a/d2b/d28/d11f/f136 x:0 0 0 2024-02-20T08:05:49.404 INFO:tasks.workunit.client.0.smithi123.stdout:9/981: chown d6/d19/d1a/d2b/d28/d11f/f136 527654917 1 2024-02-20T08:05:49.405 INFO:tasks.workunit.client.0.smithi123.stdout:1/919: rename d3/de/dfb/d12a/d141/dfd/d2c/d107/c142 to d3/de/dfb/d12a/d141/d104/c145 0 2024-02-20T08:05:49.407 INFO:tasks.workunit.client.0.smithi123.stdout:2/975: dwrite d1a/d29/d42/d80/da3/f121 [0,4194304] 0 2024-02-20T08:05:49.410 INFO:tasks.workunit.client.0.smithi123.stdout:9/982: creat d6/d2a/d27/d6f/d8b/de1/f137 x:0 0 0 2024-02-20T08:05:49.411 INFO:tasks.workunit.client.0.smithi123.stdout:9/983: chown d6/d19/d1a/d2b/d28/d9a/d3d/d32/ca3 1142971505 1 2024-02-20T08:05:49.413 INFO:tasks.workunit.client.0.smithi123.stdout:2/976: stat d1a/c2a 0 2024-02-20T08:05:49.415 INFO:tasks.workunit.client.0.smithi123.stdout:1/920: mknod d3/db/d7d/c146 0 2024-02-20T08:05:49.419 INFO:tasks.workunit.client.0.smithi123.stdout:2/977: dwrite d1a/d29/d42/d52/f56 [0,4194304] 0 2024-02-20T08:05:49.419 INFO:tasks.workunit.client.0.smithi123.stdout:1/921: creat d3/f147 x:0 0 0 2024-02-20T08:05:49.423 INFO:tasks.workunit.client.0.smithi123.stdout:2/978: unlink d1a/d29/d42/d52/d98/f9d 0 2024-02-20T08:05:49.425 INFO:tasks.workunit.client.0.smithi123.stdout:2/979: read d1a/d29/d42/fb1 [69645,12606] 0 2024-02-20T08:05:49.426 INFO:tasks.workunit.client.0.smithi123.stdout:2/980: dread - d1a/fc5 zero size 2024-02-20T08:05:49.434 INFO:tasks.workunit.client.0.smithi123.stdout:2/981: getdents d1a/d29/d5d/d141 0 2024-02-20T08:05:49.436 INFO:tasks.workunit.client.0.smithi123.stdout:9/984: dread d6/d2a/d27/f54 [0,4194304] 0 2024-02-20T08:05:49.516 INFO:tasks.workunit.client.0.smithi123.stdout:2/982: write f17 [765553,78112] 0 2024-02-20T08:05:49.518 INFO:tasks.workunit.client.0.smithi123.stdout:1/922: dwrite d3/de/dfb/d12a/d141/dfd/d2c/d4f/fc6 [0,4194304] 0 2024-02-20T08:05:49.518 INFO:tasks.workunit.client.0.smithi123.stdout:2/983: truncate d1a/da5/f11e 310380 0 2024-02-20T08:05:49.524 INFO:tasks.workunit.client.0.smithi123.stdout:1/923: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:49.529 INFO:tasks.workunit.client.0.smithi123.stdout:1/924: creat d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/f148 x:0 0 0 2024-02-20T08:05:49.529 INFO:tasks.workunit.client.0.smithi123.stdout:2/984: link d1a/d29/d39/f59 d1a/d29/d42/d52/d98/dd6/f146 0 2024-02-20T08:05:49.535 INFO:tasks.workunit.client.0.smithi123.stdout:1/925: dwrite d3/de/dfb/d12a/d141/dfd/d2c/f65 [0,4194304] 0 2024-02-20T08:05:49.542 INFO:tasks.workunit.client.0.smithi123.stdout:1/926: dwrite d3/d47/f10b [0,4194304] 0 2024-02-20T08:05:49.548 INFO:tasks.workunit.client.0.smithi123.stdout:1/927: mkdir d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/d12d/d149 0 2024-02-20T08:05:49.555 INFO:tasks.workunit.client.0.smithi123.stdout:1/928: rename d3/de/dfb/d12a/d141/dfd/d2c/d4f/dcc/f11e to d3/de/dfb/d12a/d141/dfd/d26/de3/f14a 0 2024-02-20T08:05:49.559 INFO:tasks.workunit.client.0.smithi123.stdout:9/985: write d6/d19/d1a/d2b/d28/f64 [5075524,76060] 0 2024-02-20T08:05:49.561 INFO:tasks.workunit.client.0.smithi123.stdout:9/986: chown d6/d2a/l8c 195644 1 2024-02-20T08:05:49.564 INFO:tasks.workunit.client.0.smithi123.stdout:9/987: symlink d6/d19/d1a/dc6/l138 0 2024-02-20T08:05:49.567 INFO:tasks.workunit.client.0.smithi123.stdout:1/929: dread d3/db/d34/f2b [0,4194304] 0 2024-02-20T08:05:49.571 INFO:tasks.workunit.client.0.smithi123.stdout:9/988: getdents d6/d19/d1a/d2b/d65 0 2024-02-20T08:05:49.574 INFO:tasks.workunit.client.0.smithi123.stdout:2/985: write d1a/d29/d5d/d97/fb5 [413168,28030] 0 2024-02-20T08:05:49.575 INFO:tasks.workunit.client.0.smithi123.stdout:2/986: chown d1a/d29/d42/d52/d98/da1/daa/dd0/ffc 28391548 1 2024-02-20T08:05:49.577 INFO:tasks.workunit.client.0.smithi123.stdout:9/989: creat d6/d2a/d27/d6f/d8b/de1/d125/f139 x:0 0 0 2024-02-20T08:05:49.577 INFO:tasks.workunit.client.0.smithi123.stdout:2/987: dread - d1a/d29/d5d/ffd zero size 2024-02-20T08:05:49.578 INFO:tasks.workunit.client.0.smithi123.stdout:2/988: chown d1a/d29/d42/d80/da3/fe9 1620452 1 2024-02-20T08:05:49.579 INFO:tasks.workunit.client.0.smithi123.stdout:9/990: rmdir d6/d2a/d27/d3c 39 2024-02-20T08:05:49.580 INFO:tasks.workunit.client.0.smithi123.stdout:9/991: dread - d6/d19/d1a/d2b/d28/f55 zero size 2024-02-20T08:05:49.583 INFO:tasks.workunit.client.0.smithi123.stdout:2/989: creat d1a/d29/d42/d80/f147 x:0 0 0 2024-02-20T08:05:49.584 INFO:tasks.workunit.client.0.smithi123.stdout:2/990: fdatasync d1a/d29/d39/ff5 0 2024-02-20T08:05:49.587 INFO:tasks.workunit.client.0.smithi123.stdout:1/930: dwrite d3/db/d34/db4/fc0 [0,4194304] 0 2024-02-20T08:05:49.592 INFO:tasks.workunit.client.0.smithi123.stdout:1/931: truncate d3/de/f13 2883923 0 2024-02-20T08:05:49.595 INFO:tasks.workunit.client.0.smithi123.stdout:2/991: rmdir d1a/d29/d42/d52/d98/da1/daa/de8 39 2024-02-20T08:05:49.595 INFO:tasks.workunit.client.0.smithi123.stdout:9/992: truncate d6/d2a/d27/f54 705497 0 2024-02-20T08:05:49.596 INFO:tasks.workunit.client.0.smithi123.stdout:1/932: read d3/de/dfb/d12a/d141/dfd/d2c/d45/f95 [314854,130237] 0 2024-02-20T08:05:49.597 INFO:tasks.workunit.client.0.smithi123.stdout:2/992: mkdir d1a/d29/d5d/d97/da9/d148 0 2024-02-20T08:05:49.599 INFO:tasks.workunit.client.0.smithi123.stdout:9/993: mkdir d6/d19/d1a/d2b/d13a 0 2024-02-20T08:05:49.600 INFO:tasks.workunit.client.0.smithi123.stdout:2/993: creat d1a/d29/d5d/d97/f149 x:0 0 0 2024-02-20T08:05:49.602 INFO:tasks.workunit.client.0.smithi123.stdout:1/933: mkdir d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/d12d/d14b 0 2024-02-20T08:05:49.606 INFO:tasks.workunit.client.0.smithi123.stdout:2/994: dwrite d1a/f41 [0,4194304] 0 2024-02-20T08:05:49.607 INFO:tasks.workunit.client.0.smithi123.stdout:1/934: rename d3/db/d41/de5 to d3/d47/d14c 0 2024-02-20T08:05:49.628 INFO:tasks.workunit.client.0.smithi123.stdout:1/935: dread d3/de/f13 [0,4194304] 0 2024-02-20T08:05:49.628 INFO:tasks.workunit.client.0.smithi123.stdout:2/995: dread d1a/d29/fcb [0,4194304] 0 2024-02-20T08:05:49.631 INFO:tasks.workunit.client.0.smithi123.stdout:1/936: dread d3/f109 [0,4194304] 0 2024-02-20T08:05:49.635 INFO:tasks.workunit.client.0.smithi123.stdout:2/996: getdents d1a/d29/d39 0 2024-02-20T08:05:49.636 INFO:tasks.workunit.client.0.smithi123.stdout:1/937: creat d3/f14d x:0 0 0 2024-02-20T08:05:49.637 INFO:tasks.workunit.client.0.smithi123.stdout:1/938: readlink d3/db/d34/lb3 0 2024-02-20T08:05:49.639 INFO:tasks.workunit.client.0.smithi123.stdout:2/997: creat d1a/d29/d42/d4e/dbc/f14a x:0 0 0 2024-02-20T08:05:49.643 INFO:tasks.workunit.client.0.smithi123.stdout:2/998: stat d1a/d29/d42/d73/dfb/l133 0 2024-02-20T08:05:49.644 INFO:tasks.workunit.client.0.smithi123.stdout:1/939: dwrite d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/fa7 [0,4194304] 0 2024-02-20T08:05:49.645 INFO:tasks.workunit.client.0.smithi123.stdout:1/940: read d3/f109 [761995,25108] 0 2024-02-20T08:05:49.645 INFO:tasks.workunit.client.0.smithi123.stdout:2/999: write d1a/d29/d42/d52/f56 [2146468,92090] 0 2024-02-20T08:05:49.649 INFO:tasks.workunit.client.0.smithi123.stdout:1/941: creat d3/db/d34/d74/da1/d122/f14e x:0 0 0 2024-02-20T08:05:49.651 INFO:tasks.workunit.client.0.smithi123.stdout:1/942: read - d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d9f/f114 zero size 2024-02-20T08:05:49.655 INFO:tasks.workunit.client.0.smithi123.stdout:1/943: link d3/de/dfb/d12a/d141/dfd/d2c/d45/d9d/lb9 d3/d47/d14c/d120/l14f 0 2024-02-20T08:05:49.656 INFO:tasks.workunit.client.0.smithi123.stdout:1/944: rmdir d3/de/dfb/d12a/d141/dfd 39 2024-02-20T08:05:49.679 INFO:tasks.workunit.client.0.smithi123.stdout:1/945: dread d3/d47/d14c/dfe/f113 [4194304,4194304] 0 2024-02-20T08:05:49.681 INFO:tasks.workunit.client.0.smithi123.stdout:1/946: dread - d3/de/dfb/d12a/d141/dfd/d26/de3/f12f zero size 2024-02-20T08:05:49.685 INFO:tasks.workunit.client.0.smithi123.stdout:1/947: getdents d3/d47/d14c/dfe 0 2024-02-20T08:05:49.697 INFO:tasks.workunit.client.0.smithi123.stdout:1/948: truncate d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/fa7 4147327 0 2024-02-20T08:05:49.699 INFO:tasks.workunit.client.0.smithi123.stdout:1/949: fdatasync d3/de/dfb/d12a/d141/dfd/d26/fa4 0 2024-02-20T08:05:49.702 INFO:tasks.workunit.client.0.smithi123.stdout:1/950: chown d3/db/c28 119 1 2024-02-20T08:05:49.703 INFO:tasks.workunit.client.0.smithi123.stdout:1/951: fsync d3/de/dfb/d12a/d141/dfd/d2c/d4f/fc6 0 2024-02-20T08:05:49.709 INFO:tasks.workunit.client.0.smithi123.stdout:1/952: link d3/db/d41/l49 d3/de/dfb/d12a/d141/dfd/d2c/d107/l150 0 2024-02-20T08:05:49.912 INFO:tasks.workunit.client.0.smithi123.stdout:8/908: sync 2024-02-20T08:05:49.914 INFO:tasks.workunit.client.0.smithi123.stdout:8/909: mknod d6/d32/d95/d7d/dab/c137 0 2024-02-20T08:05:49.914 INFO:tasks.workunit.client.0.smithi123.stdout:8/910: fdatasync d6/d1c/f11c 0 2024-02-20T08:05:49.916 INFO:tasks.workunit.client.0.smithi123.stdout:8/911: creat d6/dbd/d5b/d8f/dd7/f138 x:0 0 0 2024-02-20T08:05:49.917 INFO:tasks.workunit.client.0.smithi123.stdout:8/912: creat d6/d32/d95/ddd/f139 x:0 0 0 2024-02-20T08:05:49.943 INFO:tasks.workunit.client.0.smithi123.stdout:5/946: sync 2024-02-20T08:05:49.943 INFO:tasks.workunit.client.0.smithi123.stdout:4/995: sync 2024-02-20T08:05:49.943 INFO:tasks.workunit.client.0.smithi123.stdout:9/994: sync 2024-02-20T08:05:49.944 INFO:tasks.workunit.client.0.smithi123.stdout:4/996: fdatasync d3/d2c/d43/d26/d3e/ff7 0 2024-02-20T08:05:49.945 INFO:tasks.workunit.client.0.smithi123.stdout:5/947: write d0/d34/d48/d56/d3e/ddf/ff3 [501707,106938] 0 2024-02-20T08:05:49.947 INFO:tasks.workunit.client.0.smithi123.stdout:9/995: unlink d6/d2a/d27/d6f/d8b/fe3 0 2024-02-20T08:05:49.947 INFO:tasks.workunit.client.0.smithi123.stdout:5/948: write d0/d34/d48/d56/d3e/ddf/f103 [1053427,87319] 0 2024-02-20T08:05:49.951 INFO:tasks.workunit.client.0.smithi123.stdout:4/997: link d3/d18/f31 d3/d2c/d43/d26/d3e/da9/dd9/de6/d129/f14b 0 2024-02-20T08:05:49.952 INFO:tasks.workunit.client.0.smithi123.stdout:9/996: stat d6/d19/d1a/d6d/d7e/d80/dcc/df4 0 2024-02-20T08:05:49.952 INFO:tasks.workunit.client.0.smithi123.stdout:4/998: stat d3/d1e/d81/f10d 0 2024-02-20T08:05:49.953 INFO:tasks.workunit.client.0.smithi123.stdout:9/997: truncate f5 5666045 0 2024-02-20T08:05:49.954 INFO:tasks.workunit.client.0.smithi123.stdout:9/998: fsync d6/fb 0 2024-02-20T08:05:49.955 INFO:tasks.workunit.client.0.smithi123.stdout:4/999: creat d3/d2c/d43/d98/f14c x:0 0 0 2024-02-20T08:05:49.958 INFO:tasks.workunit.client.0.smithi123.stdout:9/999: rename d6/d19/d1a/d7c/d81/fcd to d6/d19/d1a/d2b/d13a/f13b 0 2024-02-20T08:05:49.964 INFO:tasks.workunit.client.0.smithi123.stdout:5/949: dread d0/d34/d48/f6e [0,4194304] 0 2024-02-20T08:05:49.966 INFO:tasks.workunit.client.0.smithi123.stdout:5/950: getdents d0/d34/d48/d56/d4c/d43/dd2 0 2024-02-20T08:05:49.967 INFO:tasks.workunit.client.0.smithi123.stdout:5/951: chown d0/d34/d48/d56/dbb/d27/d86/f125 124 1 2024-02-20T08:05:49.973 INFO:tasks.workunit.client.0.smithi123.stdout:5/952: dwrite d0/d34/d48/d56/d3e/ddf/f103 [0,4194304] 0 2024-02-20T08:05:49.979 INFO:tasks.workunit.client.0.smithi123.stdout:5/953: getdents d0/d34/d48/d56/d4c/d43 0 2024-02-20T08:05:49.980 INFO:tasks.workunit.client.0.smithi123.stdout:5/954: readlink d0/d34/d48/d56/d3e/l5b 0 2024-02-20T08:05:49.986 INFO:tasks.workunit.client.0.smithi123.stdout:5/955: rename d0/d34/d48/d56/dbb/d27/d37 to d0/d34/d48/d56/d4c/d43/dd2/d130 0 2024-02-20T08:05:50.036 INFO:tasks.workunit.client.0.smithi123.stdout:5/956: write d0/d34/d48/d56/f5e [24840,12368] 0 2024-02-20T08:05:50.040 INFO:tasks.workunit.client.0.smithi123.stdout:5/957: creat d0/d34/d48/d11e/f131 x:0 0 0 2024-02-20T08:05:50.044 INFO:tasks.workunit.client.0.smithi123.stdout:5/958: getdents d0/d34/d48/d56/dbb/d27/d4e/d9b 0 2024-02-20T08:05:50.050 INFO:tasks.workunit.client.0.smithi123.stdout:5/959: dwrite d0/f6a [4194304,4194304] 0 2024-02-20T08:05:50.052 INFO:tasks.workunit.client.0.smithi123.stdout:5/960: write d0/d34/d67/d80/d84/fc3 [1116731,3119] 0 2024-02-20T08:05:50.056 INFO:tasks.workunit.client.0.smithi123.stdout:1/953: sync 2024-02-20T08:05:50.056 INFO:tasks.workunit.client.0.smithi123.stdout:5/961: read d0/d34/d48/d56/dbb/f81 [281151,45963] 0 2024-02-20T08:05:50.058 INFO:tasks.workunit.client.0.smithi123.stdout:1/954: creat d3/d47/d14c/d120/f151 x:0 0 0 2024-02-20T08:05:50.059 INFO:tasks.workunit.client.0.smithi123.stdout:5/962: truncate d0/d34/d48/d56/d4c/d43/dd2/f111 755226 0 2024-02-20T08:05:50.060 INFO:tasks.workunit.client.0.smithi123.stdout:1/955: symlink d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/d12d/l152 0 2024-02-20T08:05:50.061 INFO:tasks.workunit.client.0.smithi123.stdout:1/956: chown d3/de/d11f 18323647 1 2024-02-20T08:05:50.061 INFO:tasks.workunit.client.0.smithi123.stdout:1/957: chown d3/de/dfb/d12a/d141/dfd/d2c/d45/d134/cda 19 1 2024-02-20T08:05:50.062 INFO:tasks.workunit.client.0.smithi123.stdout:1/958: chown d3/f42 5456 1 2024-02-20T08:05:50.078 INFO:tasks.workunit.client.0.smithi123.stdout:1/959: dread d3/de/dfb/d12a/d141/fd5 [0,4194304] 0 2024-02-20T08:05:50.079 INFO:tasks.workunit.client.0.smithi123.stdout:1/960: chown d3/de/dfb/d12a/d141/dfd/d2c/d45/f4d 2516481 1 2024-02-20T08:05:50.083 INFO:tasks.workunit.client.0.smithi123.stdout:1/961: truncate d3/de/dfb/d12a/d141/dfd/d26/d2e/fed 155031 0 2024-02-20T08:05:50.088 INFO:tasks.workunit.client.0.smithi123.stdout:1/962: rmdir d3/d47/d14c/d120 39 2024-02-20T08:05:50.090 INFO:tasks.workunit.client.0.smithi123.stdout:1/963: fsync d3/db/d34/d74/da1/f10a 0 2024-02-20T08:05:50.095 INFO:tasks.workunit.client.0.smithi123.stdout:1/964: rename d3/de/dfb/d12a/d141/dfd/d26/d56/l8b to d3/db/d34/d74/da1/d12c/l153 0 2024-02-20T08:05:50.100 INFO:tasks.workunit.client.0.smithi123.stdout:1/965: mkdir d3/de/dfb/d12a/d141/dfd/d26/d56/dbb/d154 0 2024-02-20T08:05:50.104 INFO:tasks.workunit.client.0.smithi123.stdout:1/966: creat d3/de/dfb/d12a/d141/dfd/d2c/d45/dec/f155 x:0 0 0 2024-02-20T08:05:50.106 INFO:tasks.workunit.client.0.smithi123.stdout:1/967: getdents d3/de/d11f 0 2024-02-20T08:05:50.111 INFO:tasks.workunit.client.0.smithi123.stdout:1/968: getdents d3 0 2024-02-20T08:05:50.112 INFO:tasks.workunit.client.0.smithi123.stdout:1/969: readlink d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/d12d/l152 0 2024-02-20T08:05:50.116 INFO:tasks.workunit.client.0.smithi123.stdout:1/970: creat d3/d47/d14c/d120/f156 x:0 0 0 2024-02-20T08:05:50.118 INFO:tasks.workunit.client.0.smithi123.stdout:1/971: mkdir d3/de/dfb/d12a/d141/dfd/d26/d2e/d157 0 2024-02-20T08:05:50.120 INFO:tasks.workunit.client.0.smithi123.stdout:1/972: creat d3/de/dfb/d12a/d141/dfd/f158 x:0 0 0 2024-02-20T08:05:50.151 INFO:tasks.workunit.client.0.smithi123.stdout:1/973: dread d3/de/dfb/d12a/d141/dfd/d26/d56/de7/ff2 [0,4194304] 0 2024-02-20T08:05:50.161 INFO:tasks.workunit.client.0.smithi123.stdout:1/974: write d3/de/dfb/d12a/d141/dfd/d26/fa6 [266391,112323] 0 2024-02-20T08:05:50.164 INFO:tasks.workunit.client.0.smithi123.stdout:1/975: symlink d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d/df4/l159 0 2024-02-20T08:05:50.170 INFO:tasks.workunit.client.0.smithi123.stdout:1/976: truncate d3/de/f60 960581 0 2024-02-20T08:05:50.173 INFO:tasks.workunit.client.0.smithi123.stdout:1/977: rmdir d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/d5d 39 2024-02-20T08:05:50.175 INFO:tasks.workunit.client.0.smithi123.stdout:1/978: fdatasync d3/de/dfb/d12a/d141/dfd/d2c/d107/f127 0 2024-02-20T08:05:50.180 INFO:tasks.workunit.client.0.smithi123.stdout:1/979: link d3/de/dfb/d12a/d141/dfd/f158 d3/de/dfb/d12a/d141/dfd/d26/d56/f15a 0 2024-02-20T08:05:50.182 INFO:tasks.workunit.client.0.smithi123.stdout:1/980: unlink d3/f109 0 2024-02-20T08:05:50.188 INFO:tasks.workunit.client.0.smithi123.stdout:8/913: sync 2024-02-20T08:05:50.190 INFO:tasks.workunit.client.0.smithi123.stdout:8/914: fdatasync d6/d1c/d22/f48 0 2024-02-20T08:05:50.194 INFO:tasks.workunit.client.0.smithi123.stdout:8/915: creat d6/d32/d95/d7d/dab/f13a x:0 0 0 2024-02-20T08:05:50.195 INFO:tasks.workunit.client.0.smithi123.stdout:1/981: link d3/de/dfb/d12a/d141/dfd/d2c/d45/l75 d3/de/dfb/d12a/d141/dfd/d2c/l15b 0 2024-02-20T08:05:50.196 INFO:tasks.workunit.client.0.smithi123.stdout:8/916: readlink d6/d32/d95/l54 0 2024-02-20T08:05:50.202 INFO:tasks.workunit.client.0.smithi123.stdout:1/982: dwrite d3/d47/f10b [0,4194304] 0 2024-02-20T08:05:50.202 INFO:tasks.workunit.client.0.smithi123.stdout:8/917: write d6/f71 [968891,129566] 0 2024-02-20T08:05:50.204 INFO:tasks.workunit.client.0.smithi123.stdout:1/983: write d3/db/d34/db4/fc0 [705878,60424] 0 2024-02-20T08:05:50.207 INFO:tasks.workunit.client.0.smithi123.stdout:8/918: creat d6/d1c/d22/d8c/da2/d131/f13b x:0 0 0 2024-02-20T08:05:50.208 INFO:tasks.workunit.client.0.smithi123.stdout:1/984: fsync d3/f48 0 2024-02-20T08:05:50.208 INFO:tasks.workunit.client.0.smithi123.stdout:5/963: sync 2024-02-20T08:05:50.212 INFO:tasks.workunit.client.0.smithi123.stdout:5/964: creat d0/d34/d48/d56/d3e/ddf/f132 x:0 0 0 2024-02-20T08:05:50.217 INFO:tasks.workunit.client.0.smithi123.stdout:8/919: write d6/d1c/d22/d8c/dcd/fd4 [382348,57061] 0 2024-02-20T08:05:50.221 INFO:tasks.workunit.client.0.smithi123.stdout:8/920: creat d6/dbd/d5b/d8f/d99/dfb/f13c x:0 0 0 2024-02-20T08:05:50.222 INFO:tasks.workunit.client.0.smithi123.stdout:5/965: creat d0/d34/d48/d56/dbb/d27/d4e/f133 x:0 0 0 2024-02-20T08:05:50.223 INFO:tasks.workunit.client.0.smithi123.stdout:1/985: dwrite d3/f1d [0,4194304] 0 2024-02-20T08:05:50.229 INFO:tasks.workunit.client.0.smithi123.stdout:1/986: dread d3/de/dfb/d12a/d141/dfd/d26/d2e/f40 [0,4194304] 0 2024-02-20T08:05:50.233 INFO:tasks.workunit.client.0.smithi123.stdout:1/987: mknod d3/de/dfb/d12a/d141/d104/c15c 0 2024-02-20T08:05:50.233 INFO:tasks.workunit.client.0.smithi123.stdout:5/966: dwrite d0/d34/d48/d56/dbb/d60/f7c [0,4194304] 0 2024-02-20T08:05:50.241 INFO:tasks.workunit.client.0.smithi123.stdout:1/988: truncate d3/de/dfb/d12a/d141/dfd/d26/d2e/fc7 3130093 0 2024-02-20T08:05:50.246 INFO:tasks.workunit.client.0.smithi123.stdout:1/989: dwrite d3/d47/d14c/dfe/f113 [4194304,4194304] 0 2024-02-20T08:05:50.254 INFO:tasks.workunit.client.0.smithi123.stdout:5/967: truncate d0/d34/d48/d56/dbb/d27/d4e/f52 1898055 0 2024-02-20T08:05:50.255 INFO:tasks.workunit.client.0.smithi123.stdout:1/990: write d3/f17 [1967948,31551] 0 2024-02-20T08:05:50.256 INFO:tasks.workunit.client.0.smithi123.stdout:1/991: stat d3/d47/d14c/d120 0 2024-02-20T08:05:50.263 INFO:tasks.workunit.client.0.smithi123.stdout:1/992: dwrite d3/d47/d14c/dfe/f113 [8388608,4194304] 0 2024-02-20T08:05:50.273 INFO:tasks.workunit.client.0.smithi123.stdout:5/968: dread d0/d34/d48/d4b/f7d [0,4194304] 0 2024-02-20T08:05:50.274 INFO:tasks.workunit.client.0.smithi123.stdout:5/969: fsync d0/d34/d48/d56/dcf/f110 0 2024-02-20T08:05:50.276 INFO:tasks.workunit.client.0.smithi123.stdout:5/970: mkdir d0/d34/d48/d56/d3e/d134 0 2024-02-20T08:05:50.278 INFO:tasks.workunit.client.0.smithi123.stdout:5/971: creat d0/d34/d48/d56/d3e/f135 x:0 0 0 2024-02-20T08:05:50.279 INFO:tasks.workunit.client.0.smithi123.stdout:5/972: dread - d0/d34/d48/d56/d3e/ddf/f132 zero size 2024-02-20T08:05:50.280 INFO:tasks.workunit.client.0.smithi123.stdout:5/973: stat d0/d34/d48/d56/d4c/l49 0 2024-02-20T08:05:50.291 INFO:tasks.workunit.client.0.smithi123.stdout:5/974: dread d0/f11 [4194304,4194304] 0 2024-02-20T08:05:50.297 INFO:tasks.workunit.client.0.smithi123.stdout:5/975: dwrite d0/f101 [4194304,4194304] 0 2024-02-20T08:05:50.300 INFO:tasks.workunit.client.0.smithi123.stdout:5/976: symlink d0/d34/d48/d56/dbb/d27/d4e/d91/l136 0 2024-02-20T08:05:50.561 INFO:tasks.workunit.client.0.smithi123.stdout:1/993: sync 2024-02-20T08:05:50.561 INFO:tasks.workunit.client.0.smithi123.stdout:8/921: sync 2024-02-20T08:05:50.561 INFO:tasks.workunit.client.0.smithi123.stdout:5/977: sync 2024-02-20T08:05:50.569 INFO:tasks.workunit.client.0.smithi123.stdout:8/922: dwrite d6/d1c/d22/d8c/dcd/db9/dc3/dd3/f12b [0,4194304] 0 2024-02-20T08:05:50.569 INFO:tasks.workunit.client.0.smithi123.stdout:1/994: dread d3/f70 [0,4194304] 0 2024-02-20T08:05:50.570 INFO:tasks.workunit.client.0.smithi123.stdout:8/923: readlink d6/d32/d95/d3f/l40 0 2024-02-20T08:05:50.576 INFO:tasks.workunit.client.0.smithi123.stdout:1/995: getdents d3/de/dfb/d12a/d141/dfd/d26/d56/de7 0 2024-02-20T08:05:50.582 INFO:tasks.workunit.client.0.smithi123.stdout:8/924: rmdir d6/d1c/d47/d10a/d117 0 2024-02-20T08:05:50.588 INFO:tasks.workunit.client.0.smithi123.stdout:1/996: getdents d3/de/dfb/d12a/d141/dfd/d26/d2e/deb 0 2024-02-20T08:05:50.589 INFO:tasks.workunit.client.0.smithi123.stdout:8/925: link d6/d32/d95/d7d/dab/fb8 d6/d32/d95/d7d/dff/f13d 0 2024-02-20T08:05:50.590 INFO:tasks.workunit.client.0.smithi123.stdout:1/997: write d3/f147 [457049,62181] 0 2024-02-20T08:05:50.591 INFO:tasks.workunit.client.0.smithi123.stdout:8/926: truncate d6/d32/d95/db0/fd8 4373470 0 2024-02-20T08:05:50.593 INFO:tasks.workunit.client.0.smithi123.stdout:8/927: creat d6/d32/d95/d7d/f13e x:0 0 0 2024-02-20T08:05:50.603 INFO:tasks.workunit.client.0.smithi123.stdout:1/998: link d3/db/d34/d74/lb2 d3/de/dfb/d12a/d141/dfd/d26/d2e/d54/l15d 0 2024-02-20T08:05:50.606 INFO:tasks.workunit.client.0.smithi123.stdout:1/999: creat d3/de/dfb/d12a/d141/dfd/f15e x:0 0 0 2024-02-20T08:05:50.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:50 smithi194 ceph-mon[37804]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 150 MiB/s wr, 459 op/s 2024-02-20T08:05:50.714 INFO:tasks.workunit.client.0.smithi123.stdout:5/978: dwrite d0/d34/d48/d4b/f89 [0,4194304] 0 2024-02-20T08:05:50.720 INFO:tasks.workunit.client.0.smithi123.stdout:5/979: link d0/d34/d48/d4b/d51/c11d d0/d34/d48/d56/dbb/d27/d86/c137 0 2024-02-20T08:05:50.723 INFO:tasks.workunit.client.0.smithi123.stdout:5/980: write d0/d34/d48/d56/dce/fe4 [1507749,63130] 0 2024-02-20T08:05:50.726 INFO:tasks.workunit.client.0.smithi123.stdout:8/928: dwrite d6/dbd/f87 [0,4194304] 0 2024-02-20T08:05:50.728 INFO:tasks.workunit.client.0.smithi123.stdout:8/929: dread - d6/dbd/d5b/d8f/d98/f125 zero size 2024-02-20T08:05:50.736 INFO:tasks.workunit.client.0.smithi123.stdout:5/981: link d0/d34/d48/d56/d4c/d43/dd2/d130/l58 d0/d34/d48/d4b/l138 0 2024-02-20T08:05:50.737 INFO:tasks.workunit.client.0.smithi123.stdout:5/982: fsync d0/d34/d48/d56/d3e/ddf/d109/f11c 0 2024-02-20T08:05:50.737 INFO:tasks.workunit.client.0.smithi123.stdout:5/983: fsync d0/f106 0 2024-02-20T08:05:50.741 INFO:tasks.workunit.client.0.smithi123.stdout:5/984: dread d0/d34/d48/d56/d4c/d43/dd2/d130/f8b [0,4194304] 0 2024-02-20T08:05:50.754 INFO:tasks.workunit.client.0.smithi123.stdout:8/930: dwrite d6/dbd/d5b/d8f/dd7/fed [0,4194304] 0 2024-02-20T08:05:50.757 INFO:tasks.workunit.client.0.smithi123.stdout:8/931: creat d6/d1c/d22/d8c/da2/d131/f13f x:0 0 0 2024-02-20T08:05:50.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:50 smithi123 ceph-mon[29383]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 150 MiB/s wr, 459 op/s 2024-02-20T08:05:50.760 INFO:tasks.workunit.client.0.smithi123.stdout:8/932: readlink d6/d32/d95/l76 0 2024-02-20T08:05:50.763 INFO:tasks.workunit.client.0.smithi123.stdout:8/933: truncate d6/dbd/f10d 400264 0 2024-02-20T08:05:50.763 INFO:tasks.workunit.client.0.smithi123.stdout:8/934: dread - d6/dbd/f12c zero size 2024-02-20T08:05:50.766 INFO:tasks.workunit.client.0.smithi123.stdout:8/935: creat d6/dbd/d7e/d136/f140 x:0 0 0 2024-02-20T08:05:50.767 INFO:tasks.workunit.client.0.smithi123.stdout:8/936: dread d6/dbd/d5b/f7f [0,4194304] 0 2024-02-20T08:05:50.770 INFO:tasks.workunit.client.0.smithi123.stdout:8/937: truncate d6/d32/d95/f38 3827813 0 2024-02-20T08:05:50.772 INFO:tasks.workunit.client.0.smithi123.stdout:8/938: creat d6/d1c/d22/d8c/dcd/db9/f141 x:0 0 0 2024-02-20T08:05:50.777 INFO:tasks.workunit.client.0.smithi123.stdout:8/939: dwrite d6/dbd/d5b/d8f/dd7/f138 [0,4194304] 0 2024-02-20T08:05:50.779 INFO:tasks.workunit.client.0.smithi123.stdout:8/940: write d6/dbd/d5b/d8f/d98/f125 [748973,105707] 0 2024-02-20T08:05:50.781 INFO:tasks.workunit.client.0.smithi123.stdout:8/941: dread d6/dbd/d5b/d8f/d99/dd2/f116 [0,4194304] 0 2024-02-20T08:05:50.792 INFO:tasks.workunit.client.0.smithi123.stdout:8/942: dwrite d6/fc [0,4194304] 0 2024-02-20T08:05:50.797 INFO:tasks.workunit.client.0.smithi123.stdout:8/943: rename d6/d32/d95/l76 to d6/d32/d95/ddd/l142 0 2024-02-20T08:05:50.799 INFO:tasks.workunit.client.0.smithi123.stdout:8/944: mknod d6/d1c/d47/df6/c143 0 2024-02-20T08:05:50.820 INFO:tasks.workunit.client.0.smithi123.stdout:8/945: dread d6/d1c/d22/f6b [0,4194304] 0 2024-02-20T08:05:50.834 INFO:tasks.workunit.client.0.smithi123.stdout:8/946: dwrite d6/fb3 [0,4194304] 0 2024-02-20T08:05:50.859 INFO:tasks.workunit.client.0.smithi123.stdout:8/947: fsync d6/fb3 0 2024-02-20T08:05:50.864 INFO:tasks.workunit.client.0.smithi123.stdout:8/948: write d6/fe6 [931873,35939] 0 2024-02-20T08:05:50.870 INFO:tasks.workunit.client.0.smithi123.stdout:8/949: dwrite d6/d32/d95/f7a [0,4194304] 0 2024-02-20T08:05:50.872 INFO:tasks.workunit.client.0.smithi123.stdout:8/950: fdatasync d6/f15 0 2024-02-20T08:05:50.876 INFO:tasks.workunit.client.0.smithi123.stdout:8/951: dread d6/d32/f4a [0,4194304] 0 2024-02-20T08:05:50.880 INFO:tasks.workunit.client.0.smithi123.stdout:8/952: getdents d6/d1c/d22/d8c/dcd/db9 0 2024-02-20T08:05:50.884 INFO:tasks.workunit.client.0.smithi123.stdout:8/953: rename d6/d32/d95/d7d/dab/fb8 to d6/d1c/d47/f144 0 2024-02-20T08:05:50.914 INFO:tasks.workunit.client.0.smithi123.stdout:8/954: dread d6/d1c/ff9 [0,4194304] 0 2024-02-20T08:05:50.916 INFO:tasks.workunit.client.0.smithi123.stdout:8/955: unlink d6/dbd/d7e/d82/f86 0 2024-02-20T08:05:50.917 INFO:tasks.workunit.client.0.smithi123.stdout:8/956: write d6/dbd/d5b/d8f/dd7/f138 [4969490,110929] 0 2024-02-20T08:05:50.938 INFO:tasks.workunit.client.0.smithi123.stdout:8/957: dread d6/f15 [0,4194304] 0 2024-02-20T08:05:50.938 INFO:tasks.workunit.client.0.smithi123.stdout:8/958: chown d6/dbd/f85 45 1 2024-02-20T08:05:50.939 INFO:tasks.workunit.client.0.smithi123.stdout:8/959: chown d6/d32/d95/d7d/f111 37152 1 2024-02-20T08:05:51.111 INFO:tasks.workunit.client.0.smithi123.stdout:5/985: sync 2024-02-20T08:05:51.114 INFO:tasks.workunit.client.0.smithi123.stdout:5/986: creat d0/d34/d48/d56/d3e/f139 x:0 0 0 2024-02-20T08:05:51.116 INFO:tasks.workunit.client.0.smithi123.stdout:5/987: mknod d0/d34/d67/d80/d84/c13a 0 2024-02-20T08:05:51.118 INFO:tasks.workunit.client.0.smithi123.stdout:5/988: mkdir d0/d34/d48/d56/dbb/d27/d4e/d91/d13b 0 2024-02-20T08:05:51.120 INFO:tasks.workunit.client.0.smithi123.stdout:5/989: rmdir d0/d34/d48/d56/dbb/d60 39 2024-02-20T08:05:51.131 INFO:tasks.workunit.client.0.smithi123.stdout:5/990: dread d0/d34/f66 [0,4194304] 0 2024-02-20T08:05:51.161 INFO:tasks.workunit.client.0.smithi123.stdout:5/991: dwrite d0/d34/d67/f71 [0,4194304] 0 2024-02-20T08:05:51.164 INFO:tasks.workunit.client.0.smithi123.stdout:5/992: creat d0/d34/d48/d56/dbb/d27/d4e/d9b/f13c x:0 0 0 2024-02-20T08:05:51.166 INFO:tasks.workunit.client.0.smithi123.stdout:5/993: mknod d0/d34/d48/d56/dbb/d27/d86/c13d 0 2024-02-20T08:05:51.169 INFO:tasks.workunit.client.0.smithi123.stdout:5/994: truncate d0/d34/d48/d56/d4c/d43/dd2/d130/fb7 3982326 0 2024-02-20T08:05:51.170 INFO:tasks.workunit.client.0.smithi123.stdout:5/995: read d0/d34/d48/d56/d25/f3b [468595,35920] 0 2024-02-20T08:05:51.172 INFO:tasks.workunit.client.0.smithi123.stdout:5/996: truncate d0/f11 2405290 0 2024-02-20T08:05:51.174 INFO:tasks.workunit.client.0.smithi123.stdout:5/997: mkdir d0/d34/d67/d80/d84/d13e 0 2024-02-20T08:05:51.175 INFO:tasks.workunit.client.0.smithi123.stdout:5/998: rename d0/d34/d48/d56/d3e to d0/d34/d48/d56/d3e/d134/d13f 22 2024-02-20T08:05:51.175 INFO:tasks.workunit.client.0.smithi123.stdout:8/960: sync 2024-02-20T08:05:51.176 INFO:tasks.workunit.client.0.smithi123.stdout:5/999: truncate d0/d34/d67/d80/dcd/f127 531448 0 2024-02-20T08:05:51.181 INFO:tasks.workunit.client.0.smithi123.stdout:8/961: dwrite d6/d1c/ff9 [0,4194304] 0 2024-02-20T08:05:51.183 INFO:tasks.workunit.client.0.smithi123.stdout:8/962: chown d6/d1c/d22/d8c/dcd/l96 20152745 1 2024-02-20T08:05:51.188 INFO:tasks.workunit.client.0.smithi123.stdout:8/963: dread d6/d1c/d22/d8c/dcd/db9/dc3/dd3/f12b [0,4194304] 0 2024-02-20T08:05:51.189 INFO:tasks.workunit.client.0.smithi123.stdout:8/964: stat d6/d32/d95/d3f/l40 0 2024-02-20T08:05:51.190 INFO:tasks.workunit.client.0.smithi123.stdout:8/965: stat d6/d32/d95/d7d/dff 0 2024-02-20T08:05:51.193 INFO:tasks.workunit.client.0.smithi123.stdout:8/966: creat d6/d1c/d22/d8c/dcd/db9/f145 x:0 0 0 2024-02-20T08:05:51.196 INFO:tasks.workunit.client.0.smithi123.stdout:8/967: rename d6/f71 to d6/d32/d95/ddd/f146 0 2024-02-20T08:05:51.206 INFO:tasks.workunit.client.0.smithi123.stdout:8/968: dread d6/f6e [0,4194304] 0 2024-02-20T08:05:51.210 INFO:tasks.workunit.client.0.smithi123.stdout:8/969: rename d6/d32/l72 to d6/d32/d95/d7d/l147 0 2024-02-20T08:05:51.214 INFO:tasks.workunit.client.0.smithi123.stdout:8/970: rename d6/d1c/d22/c3e to d6/d32/c148 0 2024-02-20T08:05:51.436 INFO:tasks.workunit.client.0.smithi123.stdout:8/971: sync 2024-02-20T08:05:51.438 INFO:tasks.workunit.client.0.smithi123.stdout:8/972: mknod d6/dbd/d5b/d8f/dd7/c149 0 2024-02-20T08:05:51.535 INFO:tasks.workunit.client.0.smithi123.stdout:8/973: write d6/d32/d95/d7d/dab/fc1 [339595,19047] 0 2024-02-20T08:05:51.539 INFO:tasks.workunit.client.0.smithi123.stdout:8/974: rename d6/dbd/d5b/d8f/d99/cc2 to d6/dbd/d7e/d82/d108/c14a 0 2024-02-20T08:05:51.541 INFO:tasks.workunit.client.0.smithi123.stdout:8/975: mkdir d6/dbd/d7e/d82/d14b 0 2024-02-20T08:05:51.545 INFO:tasks.workunit.client.0.smithi123.stdout:8/976: getdents d6/d1c/d47 0 2024-02-20T08:05:51.547 INFO:tasks.workunit.client.0.smithi123.stdout:8/977: truncate d6/fd 2397030 0 2024-02-20T08:05:51.549 INFO:tasks.workunit.client.0.smithi123.stdout:8/978: chown d6/f20 7108346 1 2024-02-20T08:05:51.552 INFO:tasks.workunit.client.0.smithi123.stdout:8/979: rename d6/dbd/d5b/d8f/d99/ca4 to d6/d1c/d22/d8c/da2/d131/c14c 0 2024-02-20T08:05:51.823 INFO:tasks.workunit.client.0.smithi123.stdout:8/980: sync 2024-02-20T08:05:51.824 INFO:tasks.workunit.client.0.smithi123.stdout:8/981: symlink d6/d32/d95/db0/l14d 0 2024-02-20T08:05:51.826 INFO:tasks.workunit.client.0.smithi123.stdout:8/982: readlink d6/dbd/d5b/d8f/l104 0 2024-02-20T08:05:51.826 INFO:tasks.workunit.client.0.smithi123.stdout:8/983: fsync d6/dbd/d5b/d8f/d99/dd2/f116 0 2024-02-20T08:05:51.827 INFO:tasks.workunit.client.0.smithi123.stdout:8/984: rmdir d6/dbd/d5b/d8f/d99 39 2024-02-20T08:05:51.829 INFO:tasks.workunit.client.0.smithi123.stdout:8/985: creat d6/d1c/d47/df6/f14e x:0 0 0 2024-02-20T08:05:51.847 INFO:tasks.workunit.client.0.smithi123.stdout:8/986: dread d6/d1c/d22/d8c/da2/fda [0,4194304] 0 2024-02-20T08:05:51.855 INFO:tasks.workunit.client.0.smithi123.stdout:8/987: dwrite d6/d1c/d22/d8c/dcd/db9/dc3/dd3/f12b [0,4194304] 0 2024-02-20T08:05:51.855 INFO:tasks.workunit.client.0.smithi123.stdout:8/988: write d6/d32/d95/ddd/f146 [441184,129991] 0 2024-02-20T08:05:51.858 INFO:tasks.workunit.client.0.smithi123.stdout:8/989: readlink d6/d32/d95/l41 0 2024-02-20T08:05:51.863 INFO:tasks.workunit.client.0.smithi123.stdout:8/990: getdents d6/d32/dd5/de0 0 2024-02-20T08:05:51.866 INFO:tasks.workunit.client.0.smithi123.stdout:8/991: mkdir d6/dbd/d5b/d8f/dd7/d14f 0 2024-02-20T08:05:51.868 INFO:tasks.workunit.client.0.smithi123.stdout:8/992: mkdir d6/dbd/d7e/d82/d108/d150 0 2024-02-20T08:05:51.882 INFO:tasks.workunit.client.0.smithi123.stdout:8/993: dread d6/d1c/d22/f48 [4194304,4194304] 0 2024-02-20T08:05:51.886 INFO:tasks.workunit.client.0.smithi123.stdout:8/994: getdents d6/d1c/d22/d8c/dcd/db9/dc3 0 2024-02-20T08:05:51.886 INFO:tasks.workunit.client.0.smithi123.stdout:8/995: chown d6/d1c/d47/c120 0 1 2024-02-20T08:05:52.031 INFO:tasks.workunit.client.0.smithi123.stdout:8/996: sync 2024-02-20T08:05:52.101 INFO:tasks.workunit.client.0.smithi123.stdout:8/997: dwrite d6/dbd/fb5 [0,4194304] 0 2024-02-20T08:05:52.103 INFO:tasks.workunit.client.0.smithi123.stdout:8/998: write d6/d32/fb7 [123900,128246] 0 2024-02-20T08:05:52.106 INFO:tasks.workunit.client.0.smithi123.stdout:8/999: mknod d6/d32/dd5/de0/d115/c151 0 2024-02-20T08:05:52.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -rf -- ./tmp.VtSYbyQ1AP 2024-02-20T08:05:52.506 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:52 smithi123 ceph-mon[29383]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 44 MiB/s rd, 92 MiB/s wr, 309 op/s 2024-02-20T08:05:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:52 smithi194 ceph-mon[37804]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 44 MiB/s rd, 92 MiB/s wr, 309 op/s 2024-02-20T08:05:54.648 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:54 smithi123 ceph-mon[29383]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 111 MiB/s wr, 490 op/s 2024-02-20T08:05:54.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:54 smithi194 ceph-mon[37804]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 111 MiB/s wr, 490 op/s 2024-02-20T08:05:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:55 smithi123 ceph-mon[29383]: pgmap v47: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 74 MiB/s wr, 368 op/s 2024-02-20T08:05:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:55 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:55 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:55 smithi194 ceph-mon[37804]: pgmap v47: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 74 MiB/s wr, 368 op/s 2024-02-20T08:05:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:55 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:56.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:55 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:56 smithi194 ceph-mon[37804]: Reconfiguring node-exporter.smithi194 (dependencies changed)... 2024-02-20T08:05:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:56 smithi194 ceph-mon[37804]: Reconfiguring daemon node-exporter.smithi194 on smithi194 2024-02-20T08:05:57.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:56 smithi123 ceph-mon[29383]: Reconfiguring node-exporter.smithi194 (dependencies changed)... 2024-02-20T08:05:57.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:56 smithi123 ceph-mon[29383]: Reconfiguring daemon node-exporter.smithi194 on smithi194 2024-02-20T08:05:57.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:57 smithi194 ceph-mon[37804]: pgmap v48: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 65 MiB/s wr, 331 op/s 2024-02-20T08:05:57.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:57 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:58.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:57 smithi123 ceph-mon[29383]: pgmap v48: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 65 MiB/s wr, 331 op/s 2024-02-20T08:05:58.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:57 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:05:58.296 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-20T08:05:58.300 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-20T08:05:58.300 INFO:tasks.workunit.client.1.smithi194.stderr:+ make 2024-02-20T08:05:58.336 INFO:tasks.workunit.client.1.smithi194.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-20T08:05:58.924 INFO:tasks.workunit.client.1.smithi194.stderr:++ readlink -f fsstress 2024-02-20T08:05:58.926 INFO:tasks.workunit.client.1.smithi194.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-20T08:05:58.926 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2024-02-20T08:05:58.928 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-20T08:05:58.929 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2024-02-20T08:05:58.929 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-20T08:05:58.929 INFO:tasks.workunit.client.1.smithi194.stderr:++ mktemp -d -p . 2024-02-20T08:05:58.930 INFO:tasks.workunit.client.1.smithi194.stderr:+ T=./tmp.AvWxpkCAlz 2024-02-20T08:05:58.931 INFO:tasks.workunit.client.1.smithi194.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.AvWxpkCAlz -l 1 -n 1000 -p 10 -v 2024-02-20T08:05:58.934 INFO:tasks.workunit.client.1.smithi194.stdout:seed = 1708792106 2024-02-20T08:05:58.938 INFO:tasks.workunit.client.1.smithi194.stdout:0/0: chown . 776842 1 2024-02-20T08:05:58.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/0: fsync - no filename 2024-02-20T08:05:58.942 INFO:tasks.workunit.client.1.smithi194.stdout:0/1: symlink l0 0 2024-02-20T08:05:58.943 INFO:tasks.workunit.client.1.smithi194.stdout:0/2: truncate - no filename 2024-02-20T08:05:58.946 INFO:tasks.workunit.client.1.smithi194.stdout:3/0: stat - no entries 2024-02-20T08:05:58.946 INFO:tasks.workunit.client.1.smithi194.stdout:3/1: write - no filename 2024-02-20T08:05:58.946 INFO:tasks.workunit.client.1.smithi194.stdout:3/2: fdatasync - no filename 2024-02-20T08:05:58.946 INFO:tasks.workunit.client.1.smithi194.stdout:3/3: dwrite - no filename 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:3/4: dwrite - no filename 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/1: mkdir d0 0 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/2: fsync - no filename 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/3: dread - no filename 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/4: fsync - no filename 2024-02-20T08:05:58.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/5: unlink - no file 2024-02-20T08:05:58.948 INFO:tasks.workunit.client.1.smithi194.stdout:2/0: creat f0 x:0 0 0 2024-02-20T08:05:58.949 INFO:tasks.workunit.client.1.smithi194.stdout:2/1: dread - f0 zero size 2024-02-20T08:05:58.949 INFO:tasks.workunit.client.1.smithi194.stdout:4/0: unlink - no file 2024-02-20T08:05:58.952 INFO:tasks.workunit.client.1.smithi194.stdout:2/2: rename f0 to f1 0 2024-02-20T08:05:58.952 INFO:tasks.workunit.client.1.smithi194.stdout:2/3: chown f1 24480765 1 2024-02-20T08:05:58.953 INFO:tasks.workunit.client.1.smithi194.stdout:3/5: getdents . 0 2024-02-20T08:05:58.953 INFO:tasks.workunit.client.1.smithi194.stdout:3/6: dwrite - no filename 2024-02-20T08:05:58.953 INFO:tasks.workunit.client.1.smithi194.stdout:3/7: rename - no filename 2024-02-20T08:05:58.953 INFO:tasks.workunit.client.1.smithi194.stdout:2/4: read - f1 zero size 2024-02-20T08:05:58.956 INFO:tasks.workunit.client.1.smithi194.stdout:2/5: write f1 [700611,56832] 0 2024-02-20T08:05:58.957 INFO:tasks.workunit.client.1.smithi194.stdout:4/1: mkdir d0 0 2024-02-20T08:05:58.957 INFO:tasks.workunit.client.1.smithi194.stdout:4/2: dread - no filename 2024-02-20T08:05:58.957 INFO:tasks.workunit.client.1.smithi194.stdout:4/3: dread - no filename 2024-02-20T08:05:58.958 INFO:tasks.workunit.client.1.smithi194.stdout:6/0: dread - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/1: dwrite - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/2: rename - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/3: write - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/4: dwrite - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/5: dwrite - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/6: read - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/7: dwrite - no filename 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/8: chown . 5689761 1 2024-02-20T08:05:58.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/9: truncate - no filename 2024-02-20T08:05:58.960 INFO:tasks.workunit.client.1.smithi194.stdout:1/6: rmdir d0 0 2024-02-20T08:05:58.960 INFO:tasks.workunit.client.1.smithi194.stdout:3/8: symlink l0 0 2024-02-20T08:05:58.960 INFO:tasks.workunit.client.1.smithi194.stdout:3/9: rmdir - no directory 2024-02-20T08:05:58.961 INFO:tasks.workunit.client.1.smithi194.stdout:2/6: mknod c2 0 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/0: symlink l0 0 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/1: dwrite - no filename 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/2: write - no filename 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/3: stat l0 0 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/4: write - no filename 2024-02-20T08:05:58.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/5: rmdir - no directory 2024-02-20T08:05:58.964 INFO:tasks.workunit.client.1.smithi194.stdout:1/7: creat f1 x:0 0 0 2024-02-20T08:05:58.965 INFO:tasks.workunit.client.1.smithi194.stdout:1/8: chown f1 15 1 2024-02-20T08:05:58.965 INFO:tasks.workunit.client.1.smithi194.stdout:3/10: creat f1 x:0 0 0 2024-02-20T08:05:58.966 INFO:tasks.workunit.client.1.smithi194.stdout:3/11: write f1 [27270,23748] 0 2024-02-20T08:05:58.966 INFO:tasks.workunit.client.1.smithi194.stdout:4/4: creat d0/f1 x:0 0 0 2024-02-20T08:05:58.968 INFO:tasks.workunit.client.1.smithi194.stdout:3/12: dread f1 [0,4194304] 0 2024-02-20T08:05:58.969 INFO:tasks.workunit.client.1.smithi194.stdout:3/13: chown f1 20 1 2024-02-20T08:05:58.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/10: creat f0 x:0 0 0 2024-02-20T08:05:58.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/11: dread - f0 zero size 2024-02-20T08:05:58.970 INFO:tasks.workunit.client.1.smithi194.stdout:6/12: write f0 [213931,15501] 0 2024-02-20T08:05:58.971 INFO:tasks.workunit.client.1.smithi194.stdout:8/0: dwrite - no filename 2024-02-20T08:05:58.972 INFO:tasks.workunit.client.1.smithi194.stdout:1/9: unlink f1 0 2024-02-20T08:05:58.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/10: write - no filename 2024-02-20T08:05:58.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/11: write - no filename 2024-02-20T08:05:58.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/12: dwrite - no filename 2024-02-20T08:05:58.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/13: fdatasync - no filename 2024-02-20T08:05:58.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/14: symlink l2 0 2024-02-20T08:05:58.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/13: dwrite f0 [0,4194304] 0 2024-02-20T08:05:58.978 INFO:tasks.workunit.client.1.smithi194.stdout:6/14: read f0 [1922481,105668] 0 2024-02-20T08:05:58.978 INFO:tasks.workunit.client.1.smithi194.stdout:7/0: getdents . 0 2024-02-20T08:05:58.978 INFO:tasks.workunit.client.1.smithi194.stdout:7/1: rename - no filename 2024-02-20T08:05:58.979 INFO:tasks.workunit.client.1.smithi194.stdout:7/2: read - no filename 2024-02-20T08:05:58.979 INFO:tasks.workunit.client.1.smithi194.stdout:7/3: dread - no filename 2024-02-20T08:05:58.980 INFO:tasks.workunit.client.1.smithi194.stdout:1/14: mkdir d2 0 2024-02-20T08:05:58.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/1: creat f0 x:0 0 0 2024-02-20T08:05:58.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/15: rename f0 to f1 0 2024-02-20T08:05:58.984 INFO:tasks.workunit.client.1.smithi194.stdout:7/4: mknod c0 0 2024-02-20T08:05:58.985 INFO:tasks.workunit.client.1.smithi194.stdout:9/0: creat f0 x:0 0 0 2024-02-20T08:05:58.985 INFO:tasks.workunit.client.1.smithi194.stdout:1/15: symlink d2/l3 0 2024-02-20T08:05:58.986 INFO:tasks.workunit.client.1.smithi194.stdout:1/16: write - no filename 2024-02-20T08:05:58.986 INFO:tasks.workunit.client.1.smithi194.stdout:1/17: truncate - no filename 2024-02-20T08:05:58.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/2: creat f1 x:0 0 0 2024-02-20T08:05:58.986 INFO:tasks.workunit.client.1.smithi194.stdout:9/1: write f0 [457584,106176] 0 2024-02-20T08:05:58.987 INFO:tasks.workunit.client.1.smithi194.stdout:7/5: rename c0 to c1 0 2024-02-20T08:05:58.987 INFO:tasks.workunit.client.1.smithi194.stdout:9/2: write f0 [448174,23887] 0 2024-02-20T08:05:58.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/18: unlink d2/l3 0 2024-02-20T08:05:58.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/19: truncate - no filename 2024-02-20T08:05:58.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/20: dwrite - no filename 2024-02-20T08:05:58.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/21: chown d2 189 1 2024-02-20T08:05:58.989 INFO:tasks.workunit.client.1.smithi194.stdout:9/3: unlink f0 0 2024-02-20T08:05:58.991 INFO:tasks.workunit.client.1.smithi194.stdout:1/22: creat d2/f4 x:0 0 0 2024-02-20T08:05:58.991 INFO:tasks.workunit.client.1.smithi194.stdout:9/4: creat f1 x:0 0 0 2024-02-20T08:05:58.992 INFO:tasks.workunit.client.1.smithi194.stdout:9/5: chown f1 817379372 1 2024-02-20T08:05:58.992 INFO:tasks.workunit.client.1.smithi194.stdout:9/6: dread - f1 zero size 2024-02-20T08:05:58.995 INFO:tasks.workunit.client.1.smithi194.stdout:8/3: dwrite f0 [0,4194304] 0 2024-02-20T08:05:58.995 INFO:tasks.workunit.client.1.smithi194.stdout:9/7: chown f1 4033 1 2024-02-20T08:05:58.996 INFO:tasks.workunit.client.1.smithi194.stdout:8/4: chown f0 818 1 2024-02-20T08:05:58.997 INFO:tasks.workunit.client.1.smithi194.stdout:9/8: write f1 [777854,91383] 0 2024-02-20T08:05:58.999 INFO:tasks.workunit.client.1.smithi194.stdout:8/5: write f1 [716435,104099] 0 2024-02-20T08:05:59.000 INFO:tasks.workunit.client.1.smithi194.stdout:8/6: chown f1 970839730 1 2024-02-20T08:05:59.001 INFO:tasks.workunit.client.1.smithi194.stdout:1/23: dwrite d2/f4 [0,4194304] 0 2024-02-20T08:05:59.003 INFO:tasks.workunit.client.1.smithi194.stdout:1/24: creat d2/f5 x:0 0 0 2024-02-20T08:05:59.004 INFO:tasks.workunit.client.1.smithi194.stdout:1/25: truncate d2/f4 4563005 0 2024-02-20T08:05:59.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/9: dwrite f1 [0,4194304] 0 2024-02-20T08:05:59.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/10: rmdir - no directory 2024-02-20T08:05:59.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/11: read f1 [630994,82856] 0 2024-02-20T08:05:59.008 INFO:tasks.workunit.client.1.smithi194.stdout:1/26: symlink d2/l6 0 2024-02-20T08:05:59.008 INFO:tasks.workunit.client.1.smithi194.stdout:9/12: chown f1 386984 1 2024-02-20T08:05:59.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/13: chown f1 1 1 2024-02-20T08:05:59.011 INFO:tasks.workunit.client.1.smithi194.stdout:1/27: rename d2/f4 to d2/f7 0 2024-02-20T08:05:59.012 INFO:tasks.workunit.client.1.smithi194.stdout:9/14: dread f1 [0,4194304] 0 2024-02-20T08:05:59.015 INFO:tasks.workunit.client.1.smithi194.stdout:1/28: mkdir d2/d8 0 2024-02-20T08:05:59.016 INFO:tasks.workunit.client.1.smithi194.stdout:9/15: rename f1 to f2 0 2024-02-20T08:05:59.016 INFO:tasks.workunit.client.1.smithi194.stdout:9/16: truncate f2 4319074 0 2024-02-20T08:05:59.016 INFO:tasks.workunit.client.1.smithi194.stdout:1/29: write d2/f7 [380870,93604] 0 2024-02-20T08:05:59.016 INFO:tasks.workunit.client.1.smithi194.stdout:1/30: readlink d2/l6 0 2024-02-20T08:05:59.018 INFO:tasks.workunit.client.1.smithi194.stdout:1/31: creat d2/f9 x:0 0 0 2024-02-20T08:05:59.021 INFO:tasks.workunit.client.1.smithi194.stdout:1/32: dread d2/f7 [0,4194304] 0 2024-02-20T08:05:59.024 INFO:tasks.workunit.client.1.smithi194.stdout:1/33: symlink d2/d8/la 0 2024-02-20T08:05:59.026 INFO:tasks.workunit.client.1.smithi194.stdout:1/34: truncate d2/f9 823961 0 2024-02-20T08:05:59.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/7: getdents . 0 2024-02-20T08:05:59.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/8: rmdir - no directory 2024-02-20T08:05:59.032 INFO:tasks.workunit.client.1.smithi194.stdout:5/6: getdents . 0 2024-02-20T08:05:59.033 INFO:tasks.workunit.client.1.smithi194.stdout:5/7: dread - no filename 2024-02-20T08:05:59.036 INFO:tasks.workunit.client.1.smithi194.stdout:2/9: mknod c3 0 2024-02-20T08:05:59.037 INFO:tasks.workunit.client.1.smithi194.stdout:5/8: rename l0 to l1 0 2024-02-20T08:05:59.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/7: fdatasync f1 0 2024-02-20T08:05:59.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/35: dwrite d2/f5 [0,4194304] 0 2024-02-20T08:05:59.040 INFO:tasks.workunit.client.1.smithi194.stdout:5/9: symlink l2 0 2024-02-20T08:05:59.040 INFO:tasks.workunit.client.1.smithi194.stdout:5/10: dread - no filename 2024-02-20T08:05:59.042 INFO:tasks.workunit.client.1.smithi194.stdout:1/36: dread d2/f9 [0,4194304] 0 2024-02-20T08:05:59.043 INFO:tasks.workunit.client.1.smithi194.stdout:8/8: dread f1 [0,4194304] 0 2024-02-20T08:05:59.046 INFO:tasks.workunit.client.1.smithi194.stdout:9/17: fdatasync f2 0 2024-02-20T08:05:59.048 INFO:tasks.workunit.client.1.smithi194.stdout:9/18: write f2 [1933654,2399] 0 2024-02-20T08:05:59.049 INFO:tasks.workunit.client.1.smithi194.stdout:8/9: mkdir d2 0 2024-02-20T08:05:59.050 INFO:tasks.workunit.client.1.smithi194.stdout:1/37: dwrite d2/f5 [0,4194304] 0 2024-02-20T08:05:59.051 INFO:tasks.workunit.client.1.smithi194.stdout:1/38: write d2/f5 [549027,3728] 0 2024-02-20T08:05:59.052 INFO:tasks.workunit.client.1.smithi194.stdout:6/16: rename f1 to f2 0 2024-02-20T08:05:59.052 INFO:tasks.workunit.client.1.smithi194.stdout:6/17: rmdir - no directory 2024-02-20T08:05:59.053 INFO:tasks.workunit.client.1.smithi194.stdout:9/19: dread f2 [0,4194304] 0 2024-02-20T08:05:59.055 INFO:tasks.workunit.client.1.smithi194.stdout:1/39: dread d2/f5 [0,4194304] 0 2024-02-20T08:05:59.057 INFO:tasks.workunit.client.1.smithi194.stdout:9/20: dread f2 [0,4194304] 0 2024-02-20T08:05:59.060 INFO:tasks.workunit.client.1.smithi194.stdout:1/40: dread d2/f5 [0,4194304] 0 2024-02-20T08:05:59.061 INFO:tasks.workunit.client.1.smithi194.stdout:8/10: symlink d2/l3 0 2024-02-20T08:05:59.063 INFO:tasks.workunit.client.1.smithi194.stdout:7/6: unlink c1 0 2024-02-20T08:05:59.064 INFO:tasks.workunit.client.1.smithi194.stdout:9/21: dread f2 [0,4194304] 0 2024-02-20T08:05:59.065 INFO:tasks.workunit.client.1.smithi194.stdout:1/41: creat d2/d8/fb x:0 0 0 2024-02-20T08:05:59.066 INFO:tasks.workunit.client.1.smithi194.stdout:7/7: symlink l2 0 2024-02-20T08:05:59.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/18: dwrite f2 [0,4194304] 0 2024-02-20T08:05:59.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/8: creat f3 x:0 0 0 2024-02-20T08:05:59.070 INFO:tasks.workunit.client.1.smithi194.stdout:1/42: mkdir d2/d8/dc 0 2024-02-20T08:05:59.072 INFO:tasks.workunit.client.1.smithi194.stdout:8/11: dread f0 [0,4194304] 0 2024-02-20T08:05:59.075 INFO:tasks.workunit.client.1.smithi194.stdout:2/10: getdents . 0 2024-02-20T08:05:59.075 INFO:tasks.workunit.client.1.smithi194.stdout:9/22: dread f2 [0,4194304] 0 2024-02-20T08:05:59.076 INFO:tasks.workunit.client.1.smithi194.stdout:8/12: chown f1 98 1 2024-02-20T08:05:59.077 INFO:tasks.workunit.client.1.smithi194.stdout:5/11: readlink l1 0 2024-02-20T08:05:59.078 INFO:tasks.workunit.client.1.smithi194.stdout:7/9: symlink l4 0 2024-02-20T08:05:59.078 INFO:tasks.workunit.client.1.smithi194.stdout:1/43: mknod d2/d8/cd 0 2024-02-20T08:05:59.079 INFO:tasks.workunit.client.1.smithi194.stdout:7/10: read - f3 zero size 2024-02-20T08:05:59.080 INFO:tasks.workunit.client.1.smithi194.stdout:9/23: creat f3 x:0 0 0 2024-02-20T08:05:59.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/11: symlink l4 0 2024-02-20T08:05:59.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/12: write f1 [1115755,3869] 0 2024-02-20T08:05:59.085 INFO:tasks.workunit.client.1.smithi194.stdout:6/19: dwrite f2 [0,4194304] 0 2024-02-20T08:05:59.085 INFO:tasks.workunit.client.1.smithi194.stdout:8/13: mknod d2/c4 0 2024-02-20T08:05:59.085 INFO:tasks.workunit.client.1.smithi194.stdout:5/12: creat f3 x:0 0 0 2024-02-20T08:05:59.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/14: rmdir d2 39 2024-02-20T08:05:59.093 INFO:tasks.workunit.client.1.smithi194.stdout:1/44: symlink d2/d8/dc/le 0 2024-02-20T08:05:59.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/24: dwrite f3 [0,4194304] 0 2024-02-20T08:05:59.099 INFO:tasks.workunit.client.1.smithi194.stdout:2/13: dread f1 [0,4194304] 0 2024-02-20T08:05:59.099 INFO:tasks.workunit.client.1.smithi194.stdout:5/13: dwrite f3 [0,4194304] 0 2024-02-20T08:05:59.100 INFO:tasks.workunit.client.1.smithi194.stdout:5/14: write f3 [3107979,114602] 0 2024-02-20T08:05:59.101 INFO:tasks.workunit.client.1.smithi194.stdout:1/45: dread d2/f9 [0,4194304] 0 2024-02-20T08:05:59.101 INFO:tasks.workunit.client.1.smithi194.stdout:1/46: stat d2 0 2024-02-20T08:05:59.102 INFO:tasks.workunit.client.1.smithi194.stdout:9/25: write f2 [1228313,130526] 0 2024-02-20T08:05:59.103 INFO:tasks.workunit.client.1.smithi194.stdout:8/15: mknod d2/c5 0 2024-02-20T08:05:59.106 INFO:tasks.workunit.client.1.smithi194.stdout:9/26: dread f3 [0,4194304] 0 2024-02-20T08:05:59.109 INFO:tasks.workunit.client.1.smithi194.stdout:2/14: creat f5 x:0 0 0 2024-02-20T08:05:59.114 INFO:tasks.workunit.client.1.smithi194.stdout:7/11: getdents . 0 2024-02-20T08:05:59.115 INFO:tasks.workunit.client.1.smithi194.stdout:7/12: truncate f3 855442 0 2024-02-20T08:05:59.115 INFO:tasks.workunit.client.1.smithi194.stdout:5/15: mkdir d4 0 2024-02-20T08:05:59.118 INFO:tasks.workunit.client.1.smithi194.stdout:1/47: mkdir d2/d8/df 0 2024-02-20T08:05:59.121 INFO:tasks.workunit.client.1.smithi194.stdout:8/16: mkdir d2/d6 0 2024-02-20T08:05:59.123 INFO:tasks.workunit.client.1.smithi194.stdout:7/13: dwrite f3 [0,4194304] 0 2024-02-20T08:05:59.125 INFO:tasks.workunit.client.1.smithi194.stdout:2/15: creat f6 x:0 0 0 2024-02-20T08:05:59.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/20: truncate f2 2680234 0 2024-02-20T08:05:59.130 INFO:tasks.workunit.client.1.smithi194.stdout:1/48: fsync d2/f7 0 2024-02-20T08:05:59.130 INFO:tasks.workunit.client.1.smithi194.stdout:1/49: chown d2/f9 5 1 2024-02-20T08:05:59.138 INFO:tasks.workunit.client.1.smithi194.stdout:2/16: creat f7 x:0 0 0 2024-02-20T08:05:59.143 INFO:tasks.workunit.client.1.smithi194.stdout:6/21: mknod c3 0 2024-02-20T08:05:59.144 INFO:tasks.workunit.client.1.smithi194.stdout:1/50: mknod d2/d8/dc/c10 0 2024-02-20T08:05:59.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/16: truncate f3 1126478 0 2024-02-20T08:05:59.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/17: chown l1 6 1 2024-02-20T08:05:59.159 INFO:tasks.workunit.client.1.smithi194.stdout:7/14: truncate f3 1034417 0 2024-02-20T08:05:59.161 INFO:tasks.workunit.client.1.smithi194.stdout:6/22: write f2 [2053035,31296] 0 2024-02-20T08:05:59.161 INFO:tasks.workunit.client.1.smithi194.stdout:6/23: readlink - no filename 2024-02-20T08:05:59.162 INFO:tasks.workunit.client.1.smithi194.stdout:9/27: getdents . 0 2024-02-20T08:05:59.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/51: creat d2/d8/f11 x:0 0 0 2024-02-20T08:05:59.164 INFO:tasks.workunit.client.1.smithi194.stdout:1/52: chown d2/d8/la 4 1 2024-02-20T08:05:59.164 INFO:tasks.workunit.client.1.smithi194.stdout:8/17: rmdir d2/d6 0 2024-02-20T08:05:59.164 INFO:tasks.workunit.client.1.smithi194.stdout:2/17: dwrite f1 [0,4194304] 0 2024-02-20T08:05:59.165 INFO:tasks.workunit.client.1.smithi194.stdout:1/53: chown d2/d8/dc 2 1 2024-02-20T08:05:59.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/15: creat f5 x:0 0 0 2024-02-20T08:05:59.170 INFO:tasks.workunit.client.1.smithi194.stdout:9/28: mkdir d4 0 2024-02-20T08:05:59.170 INFO:tasks.workunit.client.1.smithi194.stdout:2/18: symlink l8 0 2024-02-20T08:05:59.176 INFO:tasks.workunit.client.1.smithi194.stdout:1/54: unlink d2/l6 0 2024-02-20T08:05:59.177 INFO:tasks.workunit.client.1.smithi194.stdout:2/19: dwrite f7 [0,4194304] 0 2024-02-20T08:05:59.179 INFO:tasks.workunit.client.1.smithi194.stdout:7/16: dread f3 [0,4194304] 0 2024-02-20T08:05:59.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/29: rename f2 to d4/f5 0 2024-02-20T08:05:59.184 INFO:tasks.workunit.client.1.smithi194.stdout:9/30: rename d4 to d4/d6 22 2024-02-20T08:05:59.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/18: truncate f1 654123 0 2024-02-20T08:05:59.186 INFO:tasks.workunit.client.1.smithi194.stdout:5/18: write f3 [1835476,73900] 0 2024-02-20T08:05:59.186 INFO:tasks.workunit.client.1.smithi194.stdout:1/55: dwrite d2/f7 [0,4194304] 0 2024-02-20T08:05:59.187 INFO:tasks.workunit.client.1.smithi194.stdout:2/20: mknod c9 0 2024-02-20T08:05:59.188 INFO:tasks.workunit.client.1.smithi194.stdout:6/24: link c3 c4 0 2024-02-20T08:05:59.190 INFO:tasks.workunit.client.1.smithi194.stdout:7/17: mknod c6 0 2024-02-20T08:05:59.191 INFO:tasks.workunit.client.1.smithi194.stdout:7/18: truncate f5 835981 0 2024-02-20T08:05:59.193 INFO:tasks.workunit.client.1.smithi194.stdout:8/19: mknod d2/c7 0 2024-02-20T08:05:59.194 INFO:tasks.workunit.client.1.smithi194.stdout:5/19: fdatasync f3 0 2024-02-20T08:05:59.194 INFO:tasks.workunit.client.1.smithi194.stdout:1/56: mkdir d2/d8/d12 0 2024-02-20T08:05:59.196 INFO:tasks.workunit.client.1.smithi194.stdout:6/25: creat f5 x:0 0 0 2024-02-20T08:05:59.199 INFO:tasks.workunit.client.1.smithi194.stdout:7/19: rename c6 to c7 0 2024-02-20T08:05:59.201 INFO:tasks.workunit.client.1.smithi194.stdout:1/57: rename d2/f5 to d2/f13 0 2024-02-20T08:05:59.201 INFO:tasks.workunit.client.1.smithi194.stdout:9/31: dwrite d4/f5 [0,4194304] 0 2024-02-20T08:05:59.204 INFO:tasks.workunit.client.1.smithi194.stdout:7/20: creat f8 x:0 0 0 2024-02-20T08:05:59.205 INFO:tasks.workunit.client.1.smithi194.stdout:9/32: fdatasync f3 0 2024-02-20T08:05:59.207 INFO:tasks.workunit.client.1.smithi194.stdout:7/21: symlink l9 0 2024-02-20T08:05:59.208 INFO:tasks.workunit.client.1.smithi194.stdout:6/26: dwrite f2 [0,4194304] 0 2024-02-20T08:05:59.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/21: dwrite f7 [4194304,4194304] 0 2024-02-20T08:05:59.209 INFO:tasks.workunit.client.1.smithi194.stdout:6/27: dread - f5 zero size 2024-02-20T08:05:59.211 INFO:tasks.workunit.client.1.smithi194.stdout:7/22: mknod ca 0 2024-02-20T08:05:59.213 INFO:tasks.workunit.client.1.smithi194.stdout:9/33: dread f3 [0,4194304] 0 2024-02-20T08:05:59.213 INFO:tasks.workunit.client.1.smithi194.stdout:9/34: stat f3 0 2024-02-20T08:05:59.214 INFO:tasks.workunit.client.1.smithi194.stdout:6/28: creat f6 x:0 0 0 2024-02-20T08:05:59.214 INFO:tasks.workunit.client.1.smithi194.stdout:6/29: dread - f5 zero size 2024-02-20T08:05:59.216 INFO:tasks.workunit.client.1.smithi194.stdout:2/22: rename f6 to fa 0 2024-02-20T08:05:59.224 INFO:tasks.workunit.client.1.smithi194.stdout:9/35: mkdir d4/d7 0 2024-02-20T08:05:59.224 INFO:tasks.workunit.client.1.smithi194.stdout:8/20: write f1 [1038543,48729] 0 2024-02-20T08:05:59.224 INFO:tasks.workunit.client.1.smithi194.stdout:9/36: chown d4/d7 155935948 1 2024-02-20T08:05:59.227 INFO:tasks.workunit.client.1.smithi194.stdout:2/23: symlink lb 0 2024-02-20T08:05:59.229 INFO:tasks.workunit.client.1.smithi194.stdout:8/21: write f0 [1102779,53077] 0 2024-02-20T08:05:59.231 INFO:tasks.workunit.client.1.smithi194.stdout:9/37: rename f3 to d4/d7/f8 0 2024-02-20T08:05:59.232 INFO:tasks.workunit.client.1.smithi194.stdout:6/30: rename c4 to c7 0 2024-02-20T08:05:59.232 INFO:tasks.workunit.client.1.smithi194.stdout:6/31: rmdir - no directory 2024-02-20T08:05:59.234 INFO:tasks.workunit.client.1.smithi194.stdout:7/23: link ca cb 0 2024-02-20T08:05:59.236 INFO:tasks.workunit.client.1.smithi194.stdout:8/22: unlink f0 0 2024-02-20T08:05:59.238 INFO:tasks.workunit.client.1.smithi194.stdout:6/32: dwrite f5 [0,4194304] 0 2024-02-20T08:05:59.239 INFO:tasks.workunit.client.1.smithi194.stdout:2/24: link f5 fc 0 2024-02-20T08:05:59.239 INFO:tasks.workunit.client.1.smithi194.stdout:6/33: read f2 [9078,125715] 0 2024-02-20T08:05:59.246 INFO:tasks.workunit.client.1.smithi194.stdout:6/34: rename f6 to f8 0 2024-02-20T08:05:59.246 INFO:tasks.workunit.client.1.smithi194.stdout:2/25: dwrite f7 [8388608,4194304] 0 2024-02-20T08:05:59.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/26: unlink l8 0 2024-02-20T08:05:59.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/27: read - fc zero size 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: mgrmap e25: smithi194.pvhorj(active, since 90s), standbys: smithi123.kwyrtl 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:05:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:05:59.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:58 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:05:59.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/28: write f5 [568643,110593] 0 2024-02-20T08:05:59.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/29: truncate fc 1513309 0 2024-02-20T08:05:59.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/30: mknod cd 0 2024-02-20T08:05:59.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/31: fsync fc 0 2024-02-20T08:05:59.269 INFO:tasks.workunit.client.1.smithi194.stdout:9/38: truncate d4/d7/f8 1909279 0 2024-02-20T08:05:59.270 INFO:tasks.workunit.client.1.smithi194.stdout:9/39: write d4/f5 [3330344,76383] 0 2024-02-20T08:05:59.270 INFO:tasks.workunit.client.1.smithi194.stdout:9/40: readlink - no filename 2024-02-20T08:05:59.271 INFO:tasks.workunit.client.1.smithi194.stdout:9/41: rename d4 to d4/d9 22 2024-02-20T08:05:59.276 INFO:tasks.workunit.client.1.smithi194.stdout:6/35: truncate f2 2668767 0 2024-02-20T08:05:59.281 INFO:tasks.workunit.client.1.smithi194.stdout:6/36: write f8 [324066,128934] 0 2024-02-20T08:05:59.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/32: getdents . 0 2024-02-20T08:05:59.296 INFO:tasks.workunit.client.1.smithi194.stdout:6/37: fsync f2 0 2024-02-20T08:05:59.298 INFO:tasks.workunit.client.1.smithi194.stdout:9/42: dwrite d4/d7/f8 [0,4194304] 0 2024-02-20T08:05:59.299 INFO:tasks.workunit.client.1.smithi194.stdout:2/33: rename fa to fe 0 2024-02-20T08:05:59.303 INFO:tasks.workunit.client.1.smithi194.stdout:6/38: symlink l9 0 2024-02-20T08:05:59.306 INFO:tasks.workunit.client.1.smithi194.stdout:9/43: dwrite d4/f5 [4194304,4194304] 0 2024-02-20T08:05:59.309 INFO:tasks.workunit.client.1.smithi194.stdout:2/34: mkdir df 0 2024-02-20T08:05:59.310 INFO:tasks.workunit.client.1.smithi194.stdout:2/35: fdatasync f5 0 2024-02-20T08:05:59.311 INFO:tasks.workunit.client.1.smithi194.stdout:6/39: chown c3 967 1 2024-02-20T08:05:59.311 INFO:tasks.workunit.client.1.smithi194.stdout:2/36: fdatasync f7 0 2024-02-20T08:05:59.315 INFO:tasks.workunit.client.1.smithi194.stdout:9/44: dwrite d4/f5 [0,4194304] 0 2024-02-20T08:05:59.317 INFO:tasks.workunit.client.1.smithi194.stdout:9/45: write d4/d7/f8 [880355,68584] 0 2024-02-20T08:05:59.317 INFO:tasks.workunit.client.1.smithi194.stdout:6/40: rename f5 to fa 0 2024-02-20T08:05:59.317 INFO:tasks.workunit.client.1.smithi194.stdout:9/46: rename d4 to d4/d7/da 22 2024-02-20T08:05:59.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/47: dwrite d4/f5 [4194304,4194304] 0 2024-02-20T08:05:59.324 INFO:tasks.workunit.client.1.smithi194.stdout:6/41: rename c7 to cb 0 2024-02-20T08:05:59.325 INFO:tasks.workunit.client.1.smithi194.stdout:9/48: chown d4/d7 210585139 1 2024-02-20T08:05:59.325 INFO:tasks.workunit.client.1.smithi194.stdout:9/49: stat d4/d7 0 2024-02-20T08:05:59.326 INFO:tasks.workunit.client.1.smithi194.stdout:9/50: write d4/d7/f8 [2096143,73129] 0 2024-02-20T08:05:59.330 INFO:tasks.workunit.client.1.smithi194.stdout:2/37: truncate fc 488635 0 2024-02-20T08:05:59.333 INFO:tasks.workunit.client.1.smithi194.stdout:6/42: creat fc x:0 0 0 2024-02-20T08:05:59.333 INFO:tasks.workunit.client.1.smithi194.stdout:6/43: read - fc zero size 2024-02-20T08:05:59.335 INFO:tasks.workunit.client.1.smithi194.stdout:9/51: symlink d4/lb 0 2024-02-20T08:05:59.335 INFO:tasks.workunit.client.1.smithi194.stdout:6/44: dread f2 [0,4194304] 0 2024-02-20T08:05:59.338 INFO:tasks.workunit.client.1.smithi194.stdout:9/52: rmdir d4 39 2024-02-20T08:05:59.339 INFO:tasks.workunit.client.1.smithi194.stdout:2/38: mknod df/c10 0 2024-02-20T08:05:59.354 INFO:tasks.workunit.client.1.smithi194.stdout:9/53: dwrite d4/d7/f8 [0,4194304] 0 2024-02-20T08:05:59.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/54: dread d4/f5 [0,4194304] 0 2024-02-20T08:05:59.360 INFO:tasks.workunit.client.1.smithi194.stdout:2/39: write f5 [1213039,10462] 0 2024-02-20T08:05:59.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/40: creat df/f11 x:0 0 0 2024-02-20T08:05:59.364 INFO:tasks.workunit.client.1.smithi194.stdout:6/45: truncate fa 951045 0 2024-02-20T08:05:59.365 INFO:tasks.workunit.client.1.smithi194.stdout:2/41: fdatasync f1 0 2024-02-20T08:05:59.365 INFO:tasks.workunit.client.1.smithi194.stdout:6/46: fdatasync f2 0 2024-02-20T08:05:59.365 INFO:tasks.workunit.client.1.smithi194.stdout:2/42: stat cd 0 2024-02-20T08:05:59.370 INFO:tasks.workunit.client.1.smithi194.stdout:6/47: creat fd x:0 0 0 2024-02-20T08:05:59.371 INFO:tasks.workunit.client.1.smithi194.stdout:2/43: creat df/f12 x:0 0 0 2024-02-20T08:05:59.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/48: rename fc to fe 0 2024-02-20T08:05:59.376 INFO:tasks.workunit.client.1.smithi194.stdout:2/44: dwrite f7 [8388608,4194304] 0 2024-02-20T08:05:59.376 INFO:tasks.workunit.client.1.smithi194.stdout:6/49: dread f8 [0,4194304] 0 2024-02-20T08:05:59.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/45: mknod df/c13 0 2024-02-20T08:05:59.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/46: chown fe 23370 1 2024-02-20T08:05:59.381 INFO:tasks.workunit.client.1.smithi194.stdout:6/50: mkdir df 0 2024-02-20T08:05:59.381 INFO:tasks.workunit.client.1.smithi194.stdout:6/51: readlink l9 0 2024-02-20T08:05:59.382 INFO:tasks.workunit.client.1.smithi194.stdout:6/52: rename df to df/d10 22 2024-02-20T08:05:59.386 INFO:tasks.workunit.client.1.smithi194.stdout:2/47: mkdir df/d14 0 2024-02-20T08:05:59.388 INFO:tasks.workunit.client.1.smithi194.stdout:2/48: dread f1 [0,4194304] 0 2024-02-20T08:05:59.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/49: chown fc 901656 1 2024-02-20T08:05:59.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/50: chown df/d14 35313 1 2024-02-20T08:05:59.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/53: creat df/f11 x:0 0 0 2024-02-20T08:05:59.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/54: rename df to df/d12 22 2024-02-20T08:05:59.392 INFO:tasks.workunit.client.1.smithi194.stdout:9/55: truncate d4/f5 6291032 0 2024-02-20T08:05:59.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/51: symlink df/l15 0 2024-02-20T08:05:59.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/52: readlink df/l15 0 2024-02-20T08:05:59.394 INFO:tasks.workunit.client.1.smithi194.stdout:6/55: fsync f8 0 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: mgrmap e25: smithi194.pvhorj(active, since 90s), standbys: smithi123.kwyrtl 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:05:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:58 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:05:59.433 INFO:tasks.workunit.client.1.smithi194.stdout:9/56: dread d4/f5 [4194304,4194304] 0 2024-02-20T08:05:59.433 INFO:tasks.workunit.client.1.smithi194.stdout:9/57: readlink d4/lb 0 2024-02-20T08:05:59.616 INFO:tasks.workunit.client.1.smithi194.stdout:2/53: creat df/d14/f16 x:0 0 0 2024-02-20T08:05:59.619 INFO:tasks.workunit.client.1.smithi194.stdout:6/56: rename fa to df/f13 0 2024-02-20T08:05:59.620 INFO:tasks.workunit.client.1.smithi194.stdout:6/57: write f2 [253766,78289] 0 2024-02-20T08:05:59.622 INFO:tasks.workunit.client.1.smithi194.stdout:2/54: dwrite df/d14/f16 [0,4194304] 0 2024-02-20T08:05:59.622 INFO:tasks.workunit.client.1.smithi194.stdout:2/55: read - fe zero size 2024-02-20T08:05:59.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/56: chown df/f11 9 1 2024-02-20T08:05:59.624 INFO:tasks.workunit.client.1.smithi194.stdout:2/57: write f1 [1835886,1542] 0 2024-02-20T08:05:59.625 INFO:tasks.workunit.client.1.smithi194.stdout:9/58: link d4/f5 d4/d7/fc 0 2024-02-20T08:05:59.629 INFO:tasks.workunit.client.1.smithi194.stdout:6/58: unlink l9 0 2024-02-20T08:05:59.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/59: dread d4/d7/fc [0,4194304] 0 2024-02-20T08:05:59.630 INFO:tasks.workunit.client.1.smithi194.stdout:2/58: symlink df/d14/l17 0 2024-02-20T08:05:59.633 INFO:tasks.workunit.client.1.smithi194.stdout:6/59: creat df/f14 x:0 0 0 2024-02-20T08:05:59.634 INFO:tasks.workunit.client.1.smithi194.stdout:6/60: rename df to df/d15 22 2024-02-20T08:05:59.634 INFO:tasks.workunit.client.1.smithi194.stdout:9/60: mknod d4/d7/cd 0 2024-02-20T08:05:59.636 INFO:tasks.workunit.client.1.smithi194.stdout:2/59: dwrite f7 [4194304,4194304] 0 2024-02-20T08:05:59.636 INFO:tasks.workunit.client.1.smithi194.stdout:6/61: creat df/f16 x:0 0 0 2024-02-20T08:05:59.638 INFO:tasks.workunit.client.1.smithi194.stdout:9/61: mkdir d4/de 0 2024-02-20T08:05:59.638 INFO:tasks.workunit.client.1.smithi194.stdout:6/62: dread f8 [0,4194304] 0 2024-02-20T08:05:59.642 INFO:tasks.workunit.client.1.smithi194.stdout:9/62: write d4/d7/fc [6060664,83904] 0 2024-02-20T08:05:59.644 INFO:tasks.workunit.client.1.smithi194.stdout:9/63: stat d4/lb 0 2024-02-20T08:05:59.645 INFO:tasks.workunit.client.1.smithi194.stdout:2/60: dwrite df/d14/f16 [0,4194304] 0 2024-02-20T08:05:59.647 INFO:tasks.workunit.client.1.smithi194.stdout:2/61: chown df/c10 901726 1 2024-02-20T08:05:59.647 INFO:tasks.workunit.client.1.smithi194.stdout:6/63: dwrite fd [0,4194304] 0 2024-02-20T08:05:59.651 INFO:tasks.workunit.client.1.smithi194.stdout:2/62: creat df/d14/f18 x:0 0 0 2024-02-20T08:05:59.656 INFO:tasks.workunit.client.1.smithi194.stdout:2/63: mkdir df/d14/d19 0 2024-02-20T08:05:59.656 INFO:tasks.workunit.client.1.smithi194.stdout:6/64: dwrite df/f14 [0,4194304] 0 2024-02-20T08:05:59.657 INFO:tasks.workunit.client.1.smithi194.stdout:2/64: chown df/f11 745 1 2024-02-20T08:05:59.663 INFO:tasks.workunit.client.1.smithi194.stdout:2/65: unlink f1 0 2024-02-20T08:05:59.663 INFO:tasks.workunit.client.1.smithi194.stdout:2/66: dread - fe zero size 2024-02-20T08:05:59.668 INFO:tasks.workunit.client.1.smithi194.stdout:2/67: unlink f7 0 2024-02-20T08:05:59.751 INFO:tasks.workunit.client.1.smithi194.stdout:6/65: dwrite df/f13 [0,4194304] 0 2024-02-20T08:05:59.753 INFO:tasks.workunit.client.1.smithi194.stdout:6/66: mkdir df/d17 0 2024-02-20T08:05:59.762 INFO:tasks.workunit.client.1.smithi194.stdout:6/67: dwrite fe [0,4194304] 0 2024-02-20T08:05:59.763 INFO:tasks.workunit.client.1.smithi194.stdout:6/68: truncate df/f11 543311 0 2024-02-20T08:05:59.766 INFO:tasks.workunit.client.1.smithi194.stdout:6/69: mkdir df/d18 0 2024-02-20T08:05:59.771 INFO:tasks.workunit.client.1.smithi194.stdout:6/70: mkdir df/d18/d19 0 2024-02-20T08:05:59.776 INFO:tasks.workunit.client.1.smithi194.stdout:6/71: dwrite fd [0,4194304] 0 2024-02-20T08:05:59.781 INFO:tasks.workunit.client.1.smithi194.stdout:6/72: link f2 df/d18/d19/f1a 0 2024-02-20T08:05:59.782 INFO:tasks.workunit.client.1.smithi194.stdout:6/73: truncate df/f11 1021357 0 2024-02-20T08:05:59.787 INFO:tasks.workunit.client.1.smithi194.stdout:6/74: link df/f16 df/d18/f1b 0 2024-02-20T08:05:59.787 INFO:tasks.workunit.client.1.smithi194.stdout:6/75: write fd [3913361,1548] 0 2024-02-20T08:05:59.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/76: write df/d18/d19/f1a [396280,76205] 0 2024-02-20T08:05:59.801 INFO:tasks.workunit.client.1.smithi194.stdout:6/77: creat df/f1c x:0 0 0 2024-02-20T08:05:59.802 INFO:tasks.workunit.client.1.smithi194.stdout:6/78: read fd [1445156,75696] 0 2024-02-20T08:05:59.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/79: rmdir df/d17 0 2024-02-20T08:05:59.810 INFO:tasks.workunit.client.1.smithi194.stdout:6/80: write f2 [3285657,123962] 0 2024-02-20T08:05:59.810 INFO:tasks.workunit.client.1.smithi194.stdout:6/81: readlink - no filename 2024-02-20T08:05:59.814 INFO:tasks.workunit.client.1.smithi194.stdout:6/82: unlink df/f16 0 2024-02-20T08:05:59.816 INFO:tasks.workunit.client.1.smithi194.stdout:6/83: dread df/f14 [0,4194304] 0 2024-02-20T08:05:59.818 INFO:tasks.workunit.client.1.smithi194.stdout:6/84: mkdir df/d18/d19/d1d 0 2024-02-20T08:05:59.818 INFO:tasks.workunit.client.1.smithi194.stdout:6/85: chown df/f11 12496303 1 2024-02-20T08:05:59.819 INFO:tasks.workunit.client.1.smithi194.stdout:6/86: read - df/d18/f1b zero size 2024-02-20T08:05:59.819 INFO:tasks.workunit.client.1.smithi194.stdout:6/87: readlink - no filename 2024-02-20T08:05:59.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/88: mkdir df/d1e 0 2024-02-20T08:05:59.822 INFO:tasks.workunit.client.1.smithi194.stdout:6/89: symlink df/d1e/l1f 0 2024-02-20T08:05:59.825 INFO:tasks.workunit.client.1.smithi194.stdout:6/90: dread df/f14 [0,4194304] 0 2024-02-20T08:05:59.825 INFO:tasks.workunit.client.1.smithi194.stdout:6/91: chown df 7 1 2024-02-20T08:05:59.832 INFO:tasks.workunit.client.1.smithi194.stdout:6/92: dwrite df/f14 [4194304,4194304] 0 2024-02-20T08:05:59.832 INFO:tasks.workunit.client.1.smithi194.stdout:6/93: chown df/f11 89 1 2024-02-20T08:05:59.832 INFO:tasks.workunit.client.1.smithi194.stdout:6/94: read f8 [115218,62427] 0 2024-02-20T08:05:59.833 INFO:tasks.workunit.client.1.smithi194.stdout:6/95: write f8 [100832,35035] 0 2024-02-20T08:05:59.865 INFO:tasks.workunit.client.1.smithi194.stdout:6/96: fdatasync fd 0 2024-02-20T08:05:59.867 INFO:tasks.workunit.client.1.smithi194.stdout:6/97: dread df/f11 [0,4194304] 0 2024-02-20T08:05:59.878 INFO:tasks.workunit.client.1.smithi194.stdout:6/98: truncate fe 2088062 0 2024-02-20T08:05:59.882 INFO:tasks.workunit.client.1.smithi194.stdout:6/99: link df/d1e/l1f df/d1e/l20 0 2024-02-20T08:05:59.882 INFO:tasks.workunit.client.1.smithi194.stdout:6/100: fsync fd 0 2024-02-20T08:05:59.895 INFO:tasks.workunit.client.1.smithi194.stdout:6/101: dwrite fe [0,4194304] 0 2024-02-20T08:05:59.902 INFO:tasks.workunit.client.1.smithi194.stdout:6/102: mknod df/d18/c21 0 2024-02-20T08:05:59.915 INFO:tasks.workunit.client.1.smithi194.stdout:6/103: rename df/f11 to df/d18/d19/f22 0 2024-02-20T08:05:59.915 INFO:tasks.workunit.client.1.smithi194.stdout:6/104: read f8 [317756,7420] 0 2024-02-20T08:05:59.922 INFO:tasks.workunit.client.1.smithi194.stdout:6/105: getdents df/d1e 0 2024-02-20T08:05:59.927 INFO:tasks.workunit.client.1.smithi194.stdout:6/106: link df/d18/f1b df/d18/d19/d1d/f23 0 2024-02-20T08:05:59.928 INFO:tasks.workunit.client.1.smithi194.stdout:6/107: truncate df/d18/d19/f1a 4252743 0 2024-02-20T08:05:59.931 INFO:tasks.workunit.client.1.smithi194.stdout:6/108: symlink df/d18/d19/d1d/l24 0 2024-02-20T08:05:59.931 INFO:tasks.workunit.client.1.smithi194.stdout:6/109: fsync f2 0 2024-02-20T08:05:59.933 INFO:tasks.workunit.client.1.smithi194.stdout:6/110: mknod df/c25 0 2024-02-20T08:05:59.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/111: mknod df/d18/d19/d1d/c26 0 2024-02-20T08:05:59.935 INFO:tasks.workunit.client.1.smithi194.stdout:6/112: read df/f14 [3794986,61866] 0 2024-02-20T08:05:59.957 INFO:tasks.workunit.client.1.smithi194.stdout:6/113: write df/d18/d19/d1d/f23 [674767,114504] 0 2024-02-20T08:05:59.958 INFO:tasks.workunit.client.1.smithi194.stdout:6/114: write fd [5158595,62428] 0 2024-02-20T08:05:59.962 INFO:tasks.workunit.client.1.smithi194.stdout:6/115: symlink df/d18/d19/d1d/l27 0 2024-02-20T08:05:59.962 INFO:tasks.workunit.client.1.smithi194.stdout:6/116: readlink df/d18/d19/d1d/l24 0 2024-02-20T08:05:59.965 INFO:tasks.workunit.client.1.smithi194.stdout:6/117: dread df/d18/f1b [0,4194304] 0 2024-02-20T08:05:59.965 INFO:tasks.workunit.client.1.smithi194.stdout:6/118: read df/d18/f1b [546301,61756] 0 2024-02-20T08:05:59.967 INFO:tasks.workunit.client.1.smithi194.stdout:6/119: rmdir df/d18/d19/d1d 39 2024-02-20T08:05:59.971 INFO:tasks.workunit.client.1.smithi194.stdout:6/120: rename df/d1e to df/d18/d19/d1d/d28 0 2024-02-20T08:05:59.974 INFO:tasks.workunit.client.1.smithi194.stdout:6/121: rename df/d18/f1b to df/d18/d19/f29 0 2024-02-20T08:05:59.986 INFO:tasks.workunit.client.1.smithi194.stdout:6/122: truncate df/d18/d19/d1d/f23 1638228 0 2024-02-20T08:05:59.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/123: symlink df/l2a 0 2024-02-20T08:05:59.990 INFO:tasks.workunit.client.1.smithi194.stdout:6/124: dread df/f14 [0,4194304] 0 2024-02-20T08:05:59.991 INFO:tasks.workunit.client.1.smithi194.stdout:6/125: stat df/d18/d19/d1d/c26 0 2024-02-20T08:05:59.992 INFO:tasks.workunit.client.1.smithi194.stdout:6/126: write fe [4274787,103010] 0 2024-02-20T08:05:59.999 INFO:tasks.workunit.client.1.smithi194.stdout:6/127: dwrite df/d18/d19/f29 [0,4194304] 0 2024-02-20T08:06:00.001 INFO:tasks.workunit.client.1.smithi194.stdout:6/128: mkdir df/d18/d19/d1d/d28/d2b 0 2024-02-20T08:06:00.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/129: creat df/d18/d19/f2c x:0 0 0 2024-02-20T08:06:00.012 INFO:tasks.workunit.client.1.smithi194.stdout:6/130: creat df/d18/d19/d1d/d28/f2d x:0 0 0 2024-02-20T08:06:00.014 INFO:tasks.workunit.client.1.smithi194.stdout:6/131: creat df/d18/d19/d1d/d28/d2b/f2e x:0 0 0 2024-02-20T08:06:00.016 INFO:tasks.workunit.client.1.smithi194.stdout:6/132: symlink df/d18/d19/l2f 0 2024-02-20T08:06:00.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/133: dwrite df/d18/d19/f29 [0,4194304] 0 2024-02-20T08:06:00.022 INFO:tasks.workunit.client.1.smithi194.stdout:6/134: rename df/d18 to df/d18/d19/d1d/d30 22 2024-02-20T08:06:00.025 INFO:tasks.workunit.client.1.smithi194.stdout:6/135: creat df/d18/d19/d1d/f31 x:0 0 0 2024-02-20T08:06:00.031 INFO:tasks.workunit.client.1.smithi194.stdout:6/136: getdents df/d18/d19/d1d/d28 0 2024-02-20T08:06:00.035 INFO:tasks.workunit.client.1.smithi194.stdout:6/137: truncate df/d18/d19/f22 1669768 0 2024-02-20T08:06:00.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/138: mknod df/d18/c32 0 2024-02-20T08:06:00.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/139: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:00.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/140: fsync fe 0 2024-02-20T08:06:00.045 INFO:tasks.workunit.client.1.smithi194.stdout:6/141: read df/d18/d19/f29 [463995,105563] 0 2024-02-20T08:06:00.057 INFO:tasks.workunit.client.1.smithi194.stdout:6/142: link df/d18/d19/f22 df/d18/f33 0 2024-02-20T08:06:00.063 INFO:tasks.workunit.client.1.smithi194.stdout:6/143: truncate fe 1984705 0 2024-02-20T08:06:00.064 INFO:tasks.workunit.client.1.smithi194.stdout:6/144: read df/d18/d19/d1d/f23 [1723778,75048] 0 2024-02-20T08:06:00.065 INFO:tasks.workunit.client.1.smithi194.stdout:6/145: fdatasync df/f1c 0 2024-02-20T08:06:00.065 INFO:tasks.workunit.client.1.smithi194.stdout:6/146: readlink df/d18/d19/d1d/l27 0 2024-02-20T08:06:00.068 INFO:tasks.workunit.client.1.smithi194.stdout:6/147: rename df/d18/d19/l2f to df/d18/d19/d1d/d28/d2b/l34 0 2024-02-20T08:06:00.071 INFO:tasks.workunit.client.1.smithi194.stdout:6/148: rmdir df/d18/d19/d1d/d28 39 2024-02-20T08:06:00.074 INFO:tasks.workunit.client.1.smithi194.stdout:6/149: read df/d18/f33 [309682,164] 0 2024-02-20T08:06:00.076 INFO:tasks.workunit.client.1.smithi194.stdout:6/150: rename df/d18/d19 to df/d18/d19/d1d/d35 22 2024-02-20T08:06:00.081 INFO:tasks.workunit.client.1.smithi194.stdout:6/151: link fd df/d18/d19/d1d/f36 0 2024-02-20T08:06:00.086 INFO:tasks.workunit.client.1.smithi194.stdout:6/152: mknod df/d18/c37 0 2024-02-20T08:06:00.089 INFO:tasks.workunit.client.1.smithi194.stdout:6/153: mknod df/d18/d19/d1d/d28/c38 0 2024-02-20T08:06:00.090 INFO:tasks.workunit.client.1.smithi194.stdout:6/154: write df/d18/d19/f1a [1958551,29556] 0 2024-02-20T08:06:00.092 INFO:tasks.workunit.client.1.smithi194.stdout:6/155: symlink df/d18/d19/d1d/d28/d2b/l39 0 2024-02-20T08:06:00.095 INFO:tasks.workunit.client.1.smithi194.stdout:6/156: dread f2 [0,4194304] 0 2024-02-20T08:06:00.095 INFO:tasks.workunit.client.1.smithi194.stdout:6/157: stat fd 0 2024-02-20T08:06:00.097 INFO:tasks.workunit.client.1.smithi194.stdout:6/158: write df/d18/d19/f29 [144457,42470] 0 2024-02-20T08:06:00.100 INFO:tasks.workunit.client.1.smithi194.stdout:6/159: symlink df/d18/d19/d1d/l3a 0 2024-02-20T08:06:00.101 INFO:tasks.workunit.client.1.smithi194.stdout:6/160: chown df/d18/c21 40475897 1 2024-02-20T08:06:00.101 INFO:tasks.workunit.client.1.smithi194.stdout:6/161: fdatasync df/d18/d19/d1d/d28/f2d 0 2024-02-20T08:06:00.102 INFO:tasks.workunit.client.1.smithi194.stdout:6/162: write df/f13 [3368147,108605] 0 2024-02-20T08:06:00.108 INFO:tasks.workunit.client.1.smithi194.stdout:6/163: dwrite df/d18/d19/d1d/f31 [0,4194304] 0 2024-02-20T08:06:00.114 INFO:tasks.workunit.client.1.smithi194.stdout:6/164: unlink df/d18/d19/d1d/d28/l1f 0 2024-02-20T08:06:00.116 INFO:tasks.workunit.client.1.smithi194.stdout:6/165: write df/d18/d19/f1a [4792813,122009] 0 2024-02-20T08:06:00.119 INFO:tasks.workunit.client.1.smithi194.stdout:6/166: dread df/f14 [0,4194304] 0 2024-02-20T08:06:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:06:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:06:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:06:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: Upgrade: Need to upgrade myself (mgr.smithi194.pvhorj) 2024-02-20T08:06:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: Upgrade: Need to upgrade myself (mgr.smithi194.pvhorj) 2024-02-20T08:06:00.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:05:59 smithi123 ceph-mon[29383]: pgmap v49: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 36 MiB/s rd, 67 MiB/s wr, 448 op/s 2024-02-20T08:06:00.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:06:00.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:06:00.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:06:00.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: Upgrade: Need to upgrade myself (mgr.smithi194.pvhorj) 2024-02-20T08:06:00.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: Upgrade: Need to upgrade myself (mgr.smithi194.pvhorj) 2024-02-20T08:06:00.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:05:59 smithi194 ceph-mon[37804]: pgmap v49: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 36 MiB/s rd, 67 MiB/s wr, 448 op/s 2024-02-20T08:06:00.594 INFO:tasks.workunit.client.1.smithi194.stdout:0/3: sync 2024-02-20T08:06:00.594 INFO:tasks.workunit.client.1.smithi194.stdout:0/4: chown l0 15541 1 2024-02-20T08:06:00.594 INFO:tasks.workunit.client.1.smithi194.stdout:0/5: chown l0 1510929 1 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:3/15: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:7/24: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:5/20: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:4/5: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:1/58: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:2/68: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:9/64: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:8/23: sync 2024-02-20T08:06:00.624 INFO:tasks.workunit.client.1.smithi194.stdout:6/167: sync 2024-02-20T08:06:00.625 INFO:tasks.workunit.client.1.smithi194.stdout:7/25: fsync f8 0 2024-02-20T08:06:00.625 INFO:tasks.workunit.client.1.smithi194.stdout:2/69: fdatasync df/f11 0 2024-02-20T08:06:00.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/24: write f1 [1504440,22691] 0 2024-02-20T08:06:00.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/25: chown d2/c5 2 1 2024-02-20T08:06:00.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/6: symlink l1 0 2024-02-20T08:06:00.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/7: dwrite - no filename 2024-02-20T08:06:00.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/8: read - no filename 2024-02-20T08:06:00.666 INFO:tasks.workunit.client.1.smithi194.stdout:3/16: dread f1 [0,4194304] 0 2024-02-20T08:06:00.667 INFO:tasks.workunit.client.1.smithi194.stdout:3/17: dread f1 [0,4194304] 0 2024-02-20T08:06:00.669 INFO:tasks.workunit.client.1.smithi194.stdout:4/6: mkdir d0/d2 0 2024-02-20T08:06:00.669 INFO:tasks.workunit.client.1.smithi194.stdout:4/7: chown d0 16901276 1 2024-02-20T08:06:00.671 INFO:tasks.workunit.client.1.smithi194.stdout:1/59: creat d2/d8/dc/f14 x:0 0 0 2024-02-20T08:06:00.673 INFO:tasks.workunit.client.1.smithi194.stdout:2/70: unlink df/d14/f16 0 2024-02-20T08:06:00.673 INFO:tasks.workunit.client.1.smithi194.stdout:1/60: dread d2/f9 [0,4194304] 0 2024-02-20T08:06:00.674 INFO:tasks.workunit.client.1.smithi194.stdout:2/71: truncate df/f11 368374 0 2024-02-20T08:06:00.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/61: readlink d2/d8/dc/le 0 2024-02-20T08:06:00.674 INFO:tasks.workunit.client.1.smithi194.stdout:8/26: rename d2/c4 to d2/c8 0 2024-02-20T08:06:00.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/26: dwrite f3 [0,4194304] 0 2024-02-20T08:06:00.676 INFO:tasks.workunit.client.1.smithi194.stdout:9/65: symlink d4/d7/lf 0 2024-02-20T08:06:00.677 INFO:tasks.workunit.client.1.smithi194.stdout:9/66: write d4/d7/f8 [2823247,39139] 0 2024-02-20T08:06:00.677 INFO:tasks.workunit.client.1.smithi194.stdout:0/9: unlink l1 0 2024-02-20T08:06:00.677 INFO:tasks.workunit.client.1.smithi194.stdout:0/10: dread - no filename 2024-02-20T08:06:00.677 INFO:tasks.workunit.client.1.smithi194.stdout:0/11: readlink l0 0 2024-02-20T08:06:00.685 INFO:tasks.workunit.client.1.smithi194.stdout:5/21: creat d4/f5 x:0 0 0 2024-02-20T08:06:00.686 INFO:tasks.workunit.client.1.smithi194.stdout:5/22: write d4/f5 [968279,121027] 0 2024-02-20T08:06:00.686 INFO:tasks.workunit.client.1.smithi194.stdout:2/72: mknod df/c1a 0 2024-02-20T08:06:00.687 INFO:tasks.workunit.client.1.smithi194.stdout:8/27: creat d2/f9 x:0 0 0 2024-02-20T08:06:00.687 INFO:tasks.workunit.client.1.smithi194.stdout:2/73: dread df/f11 [0,4194304] 0 2024-02-20T08:06:00.689 INFO:tasks.workunit.client.1.smithi194.stdout:0/12: symlink l2 0 2024-02-20T08:06:00.690 INFO:tasks.workunit.client.1.smithi194.stdout:0/13: dread - no filename 2024-02-20T08:06:00.692 INFO:tasks.workunit.client.1.smithi194.stdout:9/67: rename d4/lb to d4/d7/l10 0 2024-02-20T08:06:00.692 INFO:tasks.workunit.client.1.smithi194.stdout:4/8: getdents d0/d2 0 2024-02-20T08:06:00.693 INFO:tasks.workunit.client.1.smithi194.stdout:9/68: chown d4/d7/f8 20474391 1 2024-02-20T08:06:00.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/28: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.694 INFO:tasks.workunit.client.1.smithi194.stdout:8/29: dread - d2/f9 zero size 2024-02-20T08:06:00.694 INFO:tasks.workunit.client.1.smithi194.stdout:8/30: chown d2/c5 1605 1 2024-02-20T08:06:00.695 INFO:tasks.workunit.client.1.smithi194.stdout:5/23: mkdir d4/d6 0 2024-02-20T08:06:00.695 INFO:tasks.workunit.client.1.smithi194.stdout:8/31: chown d2 16187655 1 2024-02-20T08:06:00.696 INFO:tasks.workunit.client.1.smithi194.stdout:8/32: truncate d2/f9 942160 0 2024-02-20T08:06:00.696 INFO:tasks.workunit.client.1.smithi194.stdout:5/24: truncate d4/f5 1766545 0 2024-02-20T08:06:00.696 INFO:tasks.workunit.client.1.smithi194.stdout:1/62: symlink d2/d8/d12/l15 0 2024-02-20T08:06:00.697 INFO:tasks.workunit.client.1.smithi194.stdout:8/33: truncate d2/f9 1967626 0 2024-02-20T08:06:00.698 INFO:tasks.workunit.client.1.smithi194.stdout:8/34: write f1 [236114,81415] 0 2024-02-20T08:06:00.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/74: unlink c3 0 2024-02-20T08:06:00.700 INFO:tasks.workunit.client.1.smithi194.stdout:2/75: truncate fe 481468 0 2024-02-20T08:06:00.701 INFO:tasks.workunit.client.1.smithi194.stdout:2/76: chown df/c1a 705384 1 2024-02-20T08:06:00.701 INFO:tasks.workunit.client.1.smithi194.stdout:2/77: readlink lb 0 2024-02-20T08:06:00.701 INFO:tasks.workunit.client.1.smithi194.stdout:2/78: chown fc 5743404 1 2024-02-20T08:06:00.702 INFO:tasks.workunit.client.1.smithi194.stdout:0/14: rename l0 to l3 0 2024-02-20T08:06:00.702 INFO:tasks.workunit.client.1.smithi194.stdout:2/79: dread fe [0,4194304] 0 2024-02-20T08:06:00.702 INFO:tasks.workunit.client.1.smithi194.stdout:2/80: dread - df/d14/f18 zero size 2024-02-20T08:06:00.703 INFO:tasks.workunit.client.1.smithi194.stdout:4/9: unlink d0/f1 0 2024-02-20T08:06:00.703 INFO:tasks.workunit.client.1.smithi194.stdout:4/10: dread - no filename 2024-02-20T08:06:00.705 INFO:tasks.workunit.client.1.smithi194.stdout:9/69: creat d4/d7/f11 x:0 0 0 2024-02-20T08:06:00.708 INFO:tasks.workunit.client.1.smithi194.stdout:2/81: dread f5 [0,4194304] 0 2024-02-20T08:06:00.709 INFO:tasks.workunit.client.1.smithi194.stdout:8/35: creat d2/fa x:0 0 0 2024-02-20T08:06:00.710 INFO:tasks.workunit.client.1.smithi194.stdout:7/27: link l9 lc 0 2024-02-20T08:06:00.714 INFO:tasks.workunit.client.1.smithi194.stdout:8/36: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.715 INFO:tasks.workunit.client.1.smithi194.stdout:8/37: truncate d2/fa 576985 0 2024-02-20T08:06:00.718 INFO:tasks.workunit.client.1.smithi194.stdout:4/11: creat d0/f3 x:0 0 0 2024-02-20T08:06:00.719 INFO:tasks.workunit.client.1.smithi194.stdout:9/70: creat d4/f12 x:0 0 0 2024-02-20T08:06:00.719 INFO:tasks.workunit.client.1.smithi194.stdout:5/25: mknod d4/d6/c7 0 2024-02-20T08:06:00.720 INFO:tasks.workunit.client.1.smithi194.stdout:9/71: readlink d4/d7/lf 0 2024-02-20T08:06:00.721 INFO:tasks.workunit.client.1.smithi194.stdout:9/72: rename d4/d7 to d4/d7/d13 22 2024-02-20T08:06:00.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/63: mknod d2/d8/df/c16 0 2024-02-20T08:06:00.722 INFO:tasks.workunit.client.1.smithi194.stdout:2/82: mknod df/d14/c1b 0 2024-02-20T08:06:00.722 INFO:tasks.workunit.client.1.smithi194.stdout:1/64: write d2/f7 [2756966,72243] 0 2024-02-20T08:06:00.723 INFO:tasks.workunit.client.1.smithi194.stdout:5/26: read d4/f5 [1008780,113473] 0 2024-02-20T08:06:00.723 INFO:tasks.workunit.client.1.smithi194.stdout:5/27: chown d4/d6 14123 1 2024-02-20T08:06:00.727 INFO:tasks.workunit.client.1.smithi194.stdout:5/28: dread d4/f5 [0,4194304] 0 2024-02-20T08:06:00.728 INFO:tasks.workunit.client.1.smithi194.stdout:8/38: mknod d2/cb 0 2024-02-20T08:06:00.728 INFO:tasks.workunit.client.1.smithi194.stdout:5/29: write f3 [1884482,55589] 0 2024-02-20T08:06:00.728 INFO:tasks.workunit.client.1.smithi194.stdout:8/39: chown d2/c5 2335 1 2024-02-20T08:06:00.731 INFO:tasks.workunit.client.1.smithi194.stdout:5/30: dread d4/f5 [0,4194304] 0 2024-02-20T08:06:00.731 INFO:tasks.workunit.client.1.smithi194.stdout:5/31: chown d4 37515 1 2024-02-20T08:06:00.733 INFO:tasks.workunit.client.1.smithi194.stdout:5/32: write f3 [2651948,12174] 0 2024-02-20T08:06:00.735 INFO:tasks.workunit.client.1.smithi194.stdout:8/40: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.736 INFO:tasks.workunit.client.1.smithi194.stdout:8/41: write d2/f9 [211086,76774] 0 2024-02-20T08:06:00.738 INFO:tasks.workunit.client.1.smithi194.stdout:2/83: fsync fc 0 2024-02-20T08:06:00.738 INFO:tasks.workunit.client.1.smithi194.stdout:1/65: symlink d2/d8/d12/l17 0 2024-02-20T08:06:00.739 INFO:tasks.workunit.client.1.smithi194.stdout:2/84: chown l4 41 1 2024-02-20T08:06:00.740 INFO:tasks.workunit.client.1.smithi194.stdout:1/66: chown d2/d8/d12/l15 1 1 2024-02-20T08:06:00.741 INFO:tasks.workunit.client.1.smithi194.stdout:5/33: dwrite f3 [0,4194304] 0 2024-02-20T08:06:00.741 INFO:tasks.workunit.client.1.smithi194.stdout:7/28: chown lc 1631326 1 2024-02-20T08:06:00.742 INFO:tasks.workunit.client.1.smithi194.stdout:7/29: fdatasync f5 0 2024-02-20T08:06:00.743 INFO:tasks.workunit.client.1.smithi194.stdout:1/67: write d2/d8/f11 [445902,40986] 0 2024-02-20T08:06:00.745 INFO:tasks.workunit.client.1.smithi194.stdout:4/12: link d0/f3 d0/d2/f4 0 2024-02-20T08:06:00.750 INFO:tasks.workunit.client.1.smithi194.stdout:7/30: dwrite f3 [4194304,4194304] 0 2024-02-20T08:06:00.750 INFO:tasks.workunit.client.1.smithi194.stdout:7/31: fdatasync f5 0 2024-02-20T08:06:00.751 INFO:tasks.workunit.client.1.smithi194.stdout:7/32: write f5 [314865,106050] 0 2024-02-20T08:06:00.752 INFO:tasks.workunit.client.1.smithi194.stdout:8/42: unlink d2/l3 0 2024-02-20T08:06:00.757 INFO:tasks.workunit.client.1.smithi194.stdout:5/34: read d4/f5 [989850,28621] 0 2024-02-20T08:06:00.759 INFO:tasks.workunit.client.1.smithi194.stdout:1/68: fdatasync d2/f13 0 2024-02-20T08:06:00.760 INFO:tasks.workunit.client.1.smithi194.stdout:2/85: symlink df/d14/d19/l1c 0 2024-02-20T08:06:00.762 INFO:tasks.workunit.client.1.smithi194.stdout:5/35: mknod d4/c8 0 2024-02-20T08:06:00.763 INFO:tasks.workunit.client.1.smithi194.stdout:8/43: dwrite d2/f9 [0,4194304] 0 2024-02-20T08:06:00.765 INFO:tasks.workunit.client.1.smithi194.stdout:7/33: link f5 fd 0 2024-02-20T08:06:00.766 INFO:tasks.workunit.client.1.smithi194.stdout:2/86: creat df/d14/f1d x:0 0 0 2024-02-20T08:06:00.767 INFO:tasks.workunit.client.1.smithi194.stdout:7/34: read - f8 zero size 2024-02-20T08:06:00.767 INFO:tasks.workunit.client.1.smithi194.stdout:7/35: rmdir - no directory 2024-02-20T08:06:00.767 INFO:tasks.workunit.client.1.smithi194.stdout:5/36: creat d4/f9 x:0 0 0 2024-02-20T08:06:00.768 INFO:tasks.workunit.client.1.smithi194.stdout:2/87: dread - df/d14/f1d zero size 2024-02-20T08:06:00.768 INFO:tasks.workunit.client.1.smithi194.stdout:5/37: chown d4/d6 285 1 2024-02-20T08:06:00.769 INFO:tasks.workunit.client.1.smithi194.stdout:1/69: dwrite d2/d8/fb [0,4194304] 0 2024-02-20T08:06:00.772 INFO:tasks.workunit.client.1.smithi194.stdout:7/36: write fd [1641714,73691] 0 2024-02-20T08:06:00.777 INFO:tasks.workunit.client.1.smithi194.stdout:5/38: write d4/f5 [2223615,39595] 0 2024-02-20T08:06:00.779 INFO:tasks.workunit.client.1.smithi194.stdout:5/39: truncate f3 4927550 0 2024-02-20T08:06:00.783 INFO:tasks.workunit.client.1.smithi194.stdout:2/88: dwrite fe [0,4194304] 0 2024-02-20T08:06:00.784 INFO:tasks.workunit.client.1.smithi194.stdout:2/89: read f5 [951844,120889] 0 2024-02-20T08:06:00.785 INFO:tasks.workunit.client.1.smithi194.stdout:1/70: link d2/d8/d12/l15 d2/d8/df/l18 0 2024-02-20T08:06:00.786 INFO:tasks.workunit.client.1.smithi194.stdout:2/90: dread fc [0,4194304] 0 2024-02-20T08:06:00.786 INFO:tasks.workunit.client.1.smithi194.stdout:1/71: readlink d2/d8/dc/le 0 2024-02-20T08:06:00.787 INFO:tasks.workunit.client.1.smithi194.stdout:2/91: write fe [520471,106926] 0 2024-02-20T08:06:00.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/72: truncate d2/d8/fb 4899022 0 2024-02-20T08:06:00.789 INFO:tasks.workunit.client.1.smithi194.stdout:2/92: dread fc [0,4194304] 0 2024-02-20T08:06:00.791 INFO:tasks.workunit.client.1.smithi194.stdout:7/37: dread f5 [0,4194304] 0 2024-02-20T08:06:00.791 INFO:tasks.workunit.client.1.smithi194.stdout:7/38: rmdir - no directory 2024-02-20T08:06:00.791 INFO:tasks.workunit.client.1.smithi194.stdout:7/39: write f8 [586599,34563] 0 2024-02-20T08:06:00.792 INFO:tasks.workunit.client.1.smithi194.stdout:1/73: dread d2/d8/fb [0,4194304] 0 2024-02-20T08:06:00.793 INFO:tasks.workunit.client.1.smithi194.stdout:2/93: symlink df/d14/d19/l1e 0 2024-02-20T08:06:00.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/74: readlink d2/d8/dc/le 0 2024-02-20T08:06:00.796 INFO:tasks.workunit.client.1.smithi194.stdout:2/94: creat df/d14/d19/f1f x:0 0 0 2024-02-20T08:06:00.798 INFO:tasks.workunit.client.1.smithi194.stdout:1/75: dread d2/f13 [0,4194304] 0 2024-02-20T08:06:00.799 INFO:tasks.workunit.client.1.smithi194.stdout:7/40: dread f8 [0,4194304] 0 2024-02-20T08:06:00.799 INFO:tasks.workunit.client.1.smithi194.stdout:2/95: creat df/d14/d19/f20 x:0 0 0 2024-02-20T08:06:00.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/41: creat fe x:0 0 0 2024-02-20T08:06:00.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/42: stat fe 0 2024-02-20T08:06:00.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/43: mknod cf 0 2024-02-20T08:06:00.808 INFO:tasks.workunit.client.1.smithi194.stdout:6/168: truncate df/d18/d19/d1d/f31 4089062 0 2024-02-20T08:06:00.808 INFO:tasks.workunit.client.1.smithi194.stdout:5/40: fsync d4/f5 0 2024-02-20T08:06:00.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/41: write d4/f5 [3159073,28556] 0 2024-02-20T08:06:00.813 INFO:tasks.workunit.client.1.smithi194.stdout:7/44: dwrite fe [0,4194304] 0 2024-02-20T08:06:00.813 INFO:tasks.workunit.client.1.smithi194.stdout:6/169: dread f8 [0,4194304] 0 2024-02-20T08:06:00.814 INFO:tasks.workunit.client.1.smithi194.stdout:0/15: getdents . 0 2024-02-20T08:06:00.815 INFO:tasks.workunit.client.1.smithi194.stdout:0/16: dwrite - no filename 2024-02-20T08:06:00.815 INFO:tasks.workunit.client.1.smithi194.stdout:0/17: dread - no filename 2024-02-20T08:06:00.816 INFO:tasks.workunit.client.1.smithi194.stdout:3/18: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.817 INFO:tasks.workunit.client.1.smithi194.stdout:0/18: chown l2 169 1 2024-02-20T08:06:00.817 INFO:tasks.workunit.client.1.smithi194.stdout:5/42: creat d4/d6/fa x:0 0 0 2024-02-20T08:06:00.819 INFO:tasks.workunit.client.1.smithi194.stdout:5/43: dread - d4/f9 zero size 2024-02-20T08:06:00.819 INFO:tasks.workunit.client.1.smithi194.stdout:7/45: dread fd [0,4194304] 0 2024-02-20T08:06:00.820 INFO:tasks.workunit.client.1.smithi194.stdout:7/46: read f3 [5000673,70756] 0 2024-02-20T08:06:00.822 INFO:tasks.workunit.client.1.smithi194.stdout:0/19: symlink l4 0 2024-02-20T08:06:00.823 INFO:tasks.workunit.client.1.smithi194.stdout:6/170: dread df/d18/d19/f29 [0,4194304] 0 2024-02-20T08:06:00.825 INFO:tasks.workunit.client.1.smithi194.stdout:3/19: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.827 INFO:tasks.workunit.client.1.smithi194.stdout:7/47: write fd [915224,37834] 0 2024-02-20T08:06:00.830 INFO:tasks.workunit.client.1.smithi194.stdout:6/171: dread fd [0,4194304] 0 2024-02-20T08:06:00.832 INFO:tasks.workunit.client.1.smithi194.stdout:3/20: dread f1 [0,4194304] 0 2024-02-20T08:06:00.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/48: rename cf to c10 0 2024-02-20T08:06:00.840 INFO:tasks.workunit.client.1.smithi194.stdout:6/172: unlink df/f1c 0 2024-02-20T08:06:00.841 INFO:tasks.workunit.client.1.smithi194.stdout:6/173: write df/d18/d19/f1a [244921,97103] 0 2024-02-20T08:06:00.844 INFO:tasks.workunit.client.1.smithi194.stdout:7/49: mkdir d11 0 2024-02-20T08:06:00.849 INFO:tasks.workunit.client.1.smithi194.stdout:3/21: dwrite f1 [0,4194304] 0 2024-02-20T08:06:00.849 INFO:tasks.workunit.client.1.smithi194.stdout:9/73: truncate d4/f5 1890453 0 2024-02-20T08:06:00.850 INFO:tasks.workunit.client.1.smithi194.stdout:3/22: write f1 [166651,108138] 0 2024-02-20T08:06:00.850 INFO:tasks.workunit.client.1.smithi194.stdout:6/174: fdatasync df/d18/d19/d1d/f31 0 2024-02-20T08:06:00.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/50: dwrite fe [0,4194304] 0 2024-02-20T08:06:00.853 INFO:tasks.workunit.client.1.smithi194.stdout:7/51: chown fd 867801169 1 2024-02-20T08:06:00.856 INFO:tasks.workunit.client.1.smithi194.stdout:8/44: getdents d2 0 2024-02-20T08:06:00.859 INFO:tasks.workunit.client.1.smithi194.stdout:8/45: write f1 [3289791,96180] 0 2024-02-20T08:06:00.863 INFO:tasks.workunit.client.1.smithi194.stdout:8/46: dwrite d2/f9 [0,4194304] 0 2024-02-20T08:06:00.864 INFO:tasks.workunit.client.1.smithi194.stdout:3/23: creat f3 x:0 0 0 2024-02-20T08:06:00.868 INFO:tasks.workunit.client.1.smithi194.stdout:3/24: dread f1 [0,4194304] 0 2024-02-20T08:06:00.868 INFO:tasks.workunit.client.1.smithi194.stdout:3/25: dread - f3 zero size 2024-02-20T08:06:00.869 INFO:tasks.workunit.client.1.smithi194.stdout:3/26: dread - f3 zero size 2024-02-20T08:06:00.875 INFO:tasks.workunit.client.1.smithi194.stdout:8/47: mknod d2/cc 0 2024-02-20T08:06:00.875 INFO:tasks.workunit.client.1.smithi194.stdout:1/76: write d2/d8/fb [4336908,88791] 0 2024-02-20T08:06:00.879 INFO:tasks.workunit.client.1.smithi194.stdout:7/52: creat d11/f12 x:0 0 0 2024-02-20T08:06:00.885 INFO:tasks.workunit.client.1.smithi194.stdout:3/27: rename f1 to f4 0 2024-02-20T08:06:00.888 INFO:tasks.workunit.client.1.smithi194.stdout:4/13: sync 2024-02-20T08:06:00.888 INFO:tasks.workunit.client.1.smithi194.stdout:2/96: rmdir df/d14 39 2024-02-20T08:06:00.889 INFO:tasks.workunit.client.1.smithi194.stdout:4/14: read - d0/f3 zero size 2024-02-20T08:06:00.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/28: write f4 [1752163,107318] 0 2024-02-20T08:06:00.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/29: dread f4 [0,4194304] 0 2024-02-20T08:06:00.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/30: dread - f3 zero size 2024-02-20T08:06:00.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/31: readlink l0 0 2024-02-20T08:06:00.896 INFO:tasks.workunit.client.1.smithi194.stdout:1/77: getdents d2/d8 0 2024-02-20T08:06:00.897 INFO:tasks.workunit.client.1.smithi194.stdout:4/15: mknod d0/d2/c5 0 2024-02-20T08:06:00.899 INFO:tasks.workunit.client.1.smithi194.stdout:2/97: dwrite df/d14/d19/f1f [0,4194304] 0 2024-02-20T08:06:00.899 INFO:tasks.workunit.client.1.smithi194.stdout:3/32: mkdir d5 0 2024-02-20T08:06:00.900 INFO:tasks.workunit.client.1.smithi194.stdout:2/98: write f5 [189997,121858] 0 2024-02-20T08:06:00.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/99: stat df/d14/d19/f1f 0 2024-02-20T08:06:00.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/100: fdatasync fe 0 2024-02-20T08:06:00.901 INFO:tasks.workunit.client.1.smithi194.stdout:5/44: truncate f3 4541417 0 2024-02-20T08:06:00.902 INFO:tasks.workunit.client.1.smithi194.stdout:2/101: write df/d14/f1d [303076,90011] 0 2024-02-20T08:06:00.903 INFO:tasks.workunit.client.1.smithi194.stdout:4/16: rmdir d0/d2 39 2024-02-20T08:06:00.904 INFO:tasks.workunit.client.1.smithi194.stdout:2/102: dread - df/d14/d19/f20 zero size 2024-02-20T08:06:00.909 INFO:tasks.workunit.client.1.smithi194.stdout:2/103: fsync df/d14/f1d 0 2024-02-20T08:06:00.909 INFO:tasks.workunit.client.1.smithi194.stdout:4/17: fdatasync d0/f3 0 2024-02-20T08:06:00.909 INFO:tasks.workunit.client.1.smithi194.stdout:5/45: dwrite d4/d6/fa [0,4194304] 0 2024-02-20T08:06:00.911 INFO:tasks.workunit.client.1.smithi194.stdout:5/46: write d4/f5 [783776,8539] 0 2024-02-20T08:06:00.911 INFO:tasks.workunit.client.1.smithi194.stdout:3/33: link f4 d5/f6 0 2024-02-20T08:06:00.913 INFO:tasks.workunit.client.1.smithi194.stdout:9/74: rmdir d4 39 2024-02-20T08:06:00.913 INFO:tasks.workunit.client.1.smithi194.stdout:5/47: read - d4/f9 zero size 2024-02-20T08:06:00.915 INFO:tasks.workunit.client.1.smithi194.stdout:2/104: dwrite df/f12 [0,4194304] 0 2024-02-20T08:06:00.915 INFO:tasks.workunit.client.1.smithi194.stdout:5/48: truncate d4/f5 3282429 0 2024-02-20T08:06:00.916 INFO:tasks.workunit.client.1.smithi194.stdout:5/49: chown d4/c8 1702567865 1 2024-02-20T08:06:00.917 INFO:tasks.workunit.client.1.smithi194.stdout:5/50: fsync d4/f9 0 2024-02-20T08:06:00.918 INFO:tasks.workunit.client.1.smithi194.stdout:4/18: dread - d0/d2/f4 zero size 2024-02-20T08:06:00.922 INFO:tasks.workunit.client.1.smithi194.stdout:6/175: write f8 [1204334,32896] 0 2024-02-20T08:06:00.922 INFO:tasks.workunit.client.1.smithi194.stdout:5/51: read d4/f5 [2922632,98741] 0 2024-02-20T08:06:00.929 INFO:tasks.workunit.client.1.smithi194.stdout:5/52: rmdir d4 39 2024-02-20T08:06:00.929 INFO:tasks.workunit.client.1.smithi194.stdout:5/53: readlink l1 0 2024-02-20T08:06:00.929 INFO:tasks.workunit.client.1.smithi194.stdout:5/54: chown l1 54 1 2024-02-20T08:06:00.934 INFO:tasks.workunit.client.1.smithi194.stdout:8/48: truncate f1 3802414 0 2024-02-20T08:06:00.934 INFO:tasks.workunit.client.1.smithi194.stdout:8/49: truncate d2/fa 988123 0 2024-02-20T08:06:00.936 INFO:tasks.workunit.client.1.smithi194.stdout:4/19: mknod d0/c6 0 2024-02-20T08:06:00.939 INFO:tasks.workunit.client.1.smithi194.stdout:9/75: mknod d4/de/c14 0 2024-02-20T08:06:00.942 INFO:tasks.workunit.client.1.smithi194.stdout:2/105: creat df/f21 x:0 0 0 2024-02-20T08:06:00.944 INFO:tasks.workunit.client.1.smithi194.stdout:8/50: creat d2/fd x:0 0 0 2024-02-20T08:06:00.946 INFO:tasks.workunit.client.1.smithi194.stdout:4/20: unlink d0/c6 0 2024-02-20T08:06:00.947 INFO:tasks.workunit.client.1.smithi194.stdout:1/78: truncate d2/f7 3425295 0 2024-02-20T08:06:00.948 INFO:tasks.workunit.client.1.smithi194.stdout:0/20: sync 2024-02-20T08:06:00.949 INFO:tasks.workunit.client.1.smithi194.stdout:5/55: write d4/f5 [4145856,116310] 0 2024-02-20T08:06:00.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/21: dwrite - no filename 2024-02-20T08:06:00.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/22: readlink l4 0 2024-02-20T08:06:00.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/23: rmdir - no directory 2024-02-20T08:06:00.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/24: dwrite - no filename 2024-02-20T08:06:00.951 INFO:tasks.workunit.client.1.smithi194.stdout:6/176: symlink df/d18/d19/d1d/d28/l3b 0 2024-02-20T08:06:00.951 INFO:tasks.workunit.client.1.smithi194.stdout:3/34: getdents d5 0 2024-02-20T08:06:00.952 INFO:tasks.workunit.client.1.smithi194.stdout:2/106: creat df/d14/f22 x:0 0 0 2024-02-20T08:06:00.953 INFO:tasks.workunit.client.1.smithi194.stdout:8/51: mknod d2/ce 0 2024-02-20T08:06:00.954 INFO:tasks.workunit.client.1.smithi194.stdout:4/21: fsync d0/f3 0 2024-02-20T08:06:00.957 INFO:tasks.workunit.client.1.smithi194.stdout:5/56: dwrite d4/d6/fa [0,4194304] 0 2024-02-20T08:06:00.958 INFO:tasks.workunit.client.1.smithi194.stdout:0/25: rename l3 to l5 0 2024-02-20T08:06:00.958 INFO:tasks.workunit.client.1.smithi194.stdout:5/57: readlink l2 0 2024-02-20T08:06:00.960 INFO:tasks.workunit.client.1.smithi194.stdout:3/35: dread d5/f6 [0,4194304] 0 2024-02-20T08:06:00.961 INFO:tasks.workunit.client.1.smithi194.stdout:6/177: creat df/f3c x:0 0 0 2024-02-20T08:06:00.964 INFO:tasks.workunit.client.1.smithi194.stdout:8/52: dread d2/f9 [0,4194304] 0 2024-02-20T08:06:00.964 INFO:tasks.workunit.client.1.smithi194.stdout:2/107: dwrite fe [0,4194304] 0 2024-02-20T08:06:00.965 INFO:tasks.workunit.client.1.smithi194.stdout:8/53: truncate d2/fd 299020 0 2024-02-20T08:06:00.965 INFO:tasks.workunit.client.1.smithi194.stdout:8/54: readlink - no filename 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/26: unlink l2 0 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/27: dread - no filename 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/28: write - no filename 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/29: truncate - no filename 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/30: rmdir - no directory 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/31: readlink l4 0 2024-02-20T08:06:00.972 INFO:tasks.workunit.client.1.smithi194.stdout:2/108: dwrite df/d14/f18 [0,4194304] 0 2024-02-20T08:06:00.973 INFO:tasks.workunit.client.1.smithi194.stdout:2/109: fdatasync df/f21 0 2024-02-20T08:06:00.977 INFO:tasks.workunit.client.1.smithi194.stdout:1/79: dread d2/f7 [0,4194304] 0 2024-02-20T08:06:00.983 INFO:tasks.workunit.client.1.smithi194.stdout:9/76: getdents d4 0 2024-02-20T08:06:00.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/55: rename d2/c5 to d2/cf 0 2024-02-20T08:06:00.990 INFO:tasks.workunit.client.1.smithi194.stdout:7/53: sync 2024-02-20T08:06:00.990 INFO:tasks.workunit.client.1.smithi194.stdout:7/54: read f8 [394841,92163] 0 2024-02-20T08:06:00.993 INFO:tasks.workunit.client.1.smithi194.stdout:3/36: write f4 [3753947,36966] 0 2024-02-20T08:06:00.995 INFO:tasks.workunit.client.1.smithi194.stdout:0/32: mkdir d6 0 2024-02-20T08:06:01.002 INFO:tasks.workunit.client.1.smithi194.stdout:1/80: creat d2/d8/dc/f19 x:0 0 0 2024-02-20T08:06:01.005 INFO:tasks.workunit.client.1.smithi194.stdout:6/178: write df/d18/f33 [1863909,54159] 0 2024-02-20T08:06:01.005 INFO:tasks.workunit.client.1.smithi194.stdout:9/77: creat d4/d7/f15 x:0 0 0 2024-02-20T08:06:01.006 INFO:tasks.workunit.client.1.smithi194.stdout:9/78: chown d4 163 1 2024-02-20T08:06:01.009 INFO:tasks.workunit.client.1.smithi194.stdout:4/22: rename d0/d2/c5 to d0/c7 0 2024-02-20T08:06:01.009 INFO:tasks.workunit.client.1.smithi194.stdout:4/23: read - d0/d2/f4 zero size 2024-02-20T08:06:01.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/24: fsync d0/f3 0 2024-02-20T08:06:01.010 INFO:tasks.workunit.client.1.smithi194.stdout:2/110: write df/d14/f18 [4334038,41567] 0 2024-02-20T08:06:01.012 INFO:tasks.workunit.client.1.smithi194.stdout:7/55: mkdir d11/d13 0 2024-02-20T08:06:01.014 INFO:tasks.workunit.client.1.smithi194.stdout:3/37: mknod d5/c7 0 2024-02-20T08:06:01.015 INFO:tasks.workunit.client.1.smithi194.stdout:1/81: mkdir d2/d1a 0 2024-02-20T08:06:01.016 INFO:tasks.workunit.client.1.smithi194.stdout:7/56: dread fd [0,4194304] 0 2024-02-20T08:06:01.017 INFO:tasks.workunit.client.1.smithi194.stdout:2/111: dwrite f5 [0,4194304] 0 2024-02-20T08:06:01.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/25: symlink d0/d2/l8 0 2024-02-20T08:06:01.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/26: dread - d0/d2/f4 zero size 2024-02-20T08:06:01.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/38: dread d5/f6 [0,4194304] 0 2024-02-20T08:06:01.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/27: truncate d0/d2/f4 462202 0 2024-02-20T08:06:01.022 INFO:tasks.workunit.client.1.smithi194.stdout:0/33: symlink d6/l7 0 2024-02-20T08:06:01.023 INFO:tasks.workunit.client.1.smithi194.stdout:5/58: dread f3 [0,4194304] 0 2024-02-20T08:06:01.024 INFO:tasks.workunit.client.1.smithi194.stdout:6/179: rmdir df/d18/d19/d1d/d28 39 2024-02-20T08:06:01.024 INFO:tasks.workunit.client.1.smithi194.stdout:5/59: chown l2 3679239 1 2024-02-20T08:06:01.027 INFO:tasks.workunit.client.1.smithi194.stdout:5/60: dread d4/d6/fa [0,4194304] 0 2024-02-20T08:06:01.028 INFO:tasks.workunit.client.1.smithi194.stdout:2/112: unlink df/d14/d19/f1f 0 2024-02-20T08:06:01.031 INFO:tasks.workunit.client.1.smithi194.stdout:9/79: truncate d4/d7/fc 791500 0 2024-02-20T08:06:01.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/80: read - d4/d7/f15 zero size 2024-02-20T08:06:01.034 INFO:tasks.workunit.client.1.smithi194.stdout:3/39: creat d5/f8 x:0 0 0 2024-02-20T08:06:01.034 INFO:tasks.workunit.client.1.smithi194.stdout:5/61: dwrite d4/d6/fa [4194304,4194304] 0 2024-02-20T08:06:01.035 INFO:tasks.workunit.client.1.smithi194.stdout:4/28: mkdir d0/d2/d9 0 2024-02-20T08:06:01.035 INFO:tasks.workunit.client.1.smithi194.stdout:2/113: dread fc [0,4194304] 0 2024-02-20T08:06:01.036 INFO:tasks.workunit.client.1.smithi194.stdout:0/34: mkdir d6/d8 0 2024-02-20T08:06:01.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/40: dwrite d5/f8 [0,4194304] 0 2024-02-20T08:06:01.050 INFO:tasks.workunit.client.1.smithi194.stdout:8/56: getdents d2 0 2024-02-20T08:06:01.051 INFO:tasks.workunit.client.1.smithi194.stdout:8/57: write d2/fa [1123302,650] 0 2024-02-20T08:06:01.052 INFO:tasks.workunit.client.1.smithi194.stdout:8/58: dread d2/fd [0,4194304] 0 2024-02-20T08:06:01.056 INFO:tasks.workunit.client.1.smithi194.stdout:5/62: creat d4/fb x:0 0 0 2024-02-20T08:06:01.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/29: mknod d0/d2/ca 0 2024-02-20T08:06:01.057 INFO:tasks.workunit.client.1.smithi194.stdout:4/30: chown d0/d2 1252 1 2024-02-20T08:06:01.060 INFO:tasks.workunit.client.1.smithi194.stdout:0/35: creat d6/f9 x:0 0 0 2024-02-20T08:06:01.064 INFO:tasks.workunit.client.1.smithi194.stdout:2/114: rename df/d14/f18 to df/d14/d19/f23 0 2024-02-20T08:06:01.064 INFO:tasks.workunit.client.1.smithi194.stdout:0/36: write d6/f9 [1028987,36208] 0 2024-02-20T08:06:01.094 INFO:tasks.workunit.client.1.smithi194.stdout:3/41: rmdir d5 39 2024-02-20T08:06:01.094 INFO:tasks.workunit.client.1.smithi194.stdout:2/115: chown df/d14/d19/l1e 23354 1 2024-02-20T08:06:01.094 INFO:tasks.workunit.client.1.smithi194.stdout:7/57: rmdir d11/d13 0 2024-02-20T08:06:01.095 INFO:tasks.workunit.client.1.smithi194.stdout:6/180: readlink df/d18/d19/d1d/d28/l20 0 2024-02-20T08:06:01.096 INFO:tasks.workunit.client.1.smithi194.stdout:5/63: unlink d4/f5 0 2024-02-20T08:06:01.097 INFO:tasks.workunit.client.1.smithi194.stdout:4/31: dwrite d0/d2/f4 [0,4194304] 0 2024-02-20T08:06:01.097 INFO:tasks.workunit.client.1.smithi194.stdout:4/32: chown d0 3 1 2024-02-20T08:06:01.098 INFO:tasks.workunit.client.1.smithi194.stdout:6/181: rmdir df 39 2024-02-20T08:06:01.107 INFO:tasks.workunit.client.1.smithi194.stdout:5/64: dwrite d4/f9 [0,4194304] 0 2024-02-20T08:06:01.108 INFO:tasks.workunit.client.1.smithi194.stdout:5/65: chown d4/f9 3598088 1 2024-02-20T08:06:01.108 INFO:tasks.workunit.client.1.smithi194.stdout:5/66: readlink l1 0 2024-02-20T08:06:01.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/33: dwrite d0/d2/f4 [0,4194304] 0 2024-02-20T08:06:01.112 INFO:tasks.workunit.client.1.smithi194.stdout:0/37: unlink d6/f9 0 2024-02-20T08:06:01.112 INFO:tasks.workunit.client.1.smithi194.stdout:0/38: dread - no filename 2024-02-20T08:06:01.114 INFO:tasks.workunit.client.1.smithi194.stdout:3/42: rename l2 to d5/l9 0 2024-02-20T08:06:01.116 INFO:tasks.workunit.client.1.smithi194.stdout:0/39: rename d6 to d6/da 22 2024-02-20T08:06:01.119 INFO:tasks.workunit.client.1.smithi194.stdout:4/34: dwrite d0/f3 [0,4194304] 0 2024-02-20T08:06:01.122 INFO:tasks.workunit.client.1.smithi194.stdout:5/67: creat d4/fc x:0 0 0 2024-02-20T08:06:01.124 INFO:tasks.workunit.client.1.smithi194.stdout:3/43: creat d5/fa x:0 0 0 2024-02-20T08:06:01.124 INFO:tasks.workunit.client.1.smithi194.stdout:1/82: sync 2024-02-20T08:06:01.126 INFO:tasks.workunit.client.1.smithi194.stdout:0/40: unlink d6/l7 0 2024-02-20T08:06:01.126 INFO:tasks.workunit.client.1.smithi194.stdout:0/41: truncate - no filename 2024-02-20T08:06:01.127 INFO:tasks.workunit.client.1.smithi194.stdout:9/81: dread d4/d7/fc [0,4194304] 0 2024-02-20T08:06:01.127 INFO:tasks.workunit.client.1.smithi194.stdout:7/58: link fd d11/f14 0 2024-02-20T08:06:01.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/59: stat l4 0 2024-02-20T08:06:01.131 INFO:tasks.workunit.client.1.smithi194.stdout:9/82: write d4/d7/f11 [1046270,7638] 0 2024-02-20T08:06:01.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/35: dwrite d0/d2/f4 [4194304,4194304] 0 2024-02-20T08:06:01.132 INFO:tasks.workunit.client.1.smithi194.stdout:5/68: dread f3 [0,4194304] 0 2024-02-20T08:06:01.134 INFO:tasks.workunit.client.1.smithi194.stdout:6/182: getdents df/d18/d19/d1d/d28 0 2024-02-20T08:06:01.134 INFO:tasks.workunit.client.1.smithi194.stdout:6/183: stat df/d18/d19/d1d 0 2024-02-20T08:06:01.136 INFO:tasks.workunit.client.1.smithi194.stdout:0/42: creat d6/d8/fb x:0 0 0 2024-02-20T08:06:01.137 INFO:tasks.workunit.client.1.smithi194.stdout:3/44: link f4 d5/fb 0 2024-02-20T08:06:01.138 INFO:tasks.workunit.client.1.smithi194.stdout:3/45: rename d5 to d5/dc 22 2024-02-20T08:06:01.146 INFO:tasks.workunit.client.1.smithi194.stdout:5/69: mkdir d4/d6/dd 0 2024-02-20T08:06:01.148 INFO:tasks.workunit.client.1.smithi194.stdout:7/60: fdatasync d11/f14 0 2024-02-20T08:06:01.148 INFO:tasks.workunit.client.1.smithi194.stdout:6/184: symlink df/d18/d19/d1d/d28/d2b/l3d 0 2024-02-20T08:06:01.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/185: readlink df/d18/d19/d1d/d28/d2b/l39 0 2024-02-20T08:06:01.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/70: dread f3 [0,4194304] 0 2024-02-20T08:06:01.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/71: dwrite d4/fc [0,4194304] 0 2024-02-20T08:06:01.157 INFO:tasks.workunit.client.1.smithi194.stdout:5/72: write d4/fc [2796006,30536] 0 2024-02-20T08:06:01.158 INFO:tasks.workunit.client.1.smithi194.stdout:5/73: stat f3 0 2024-02-20T08:06:01.158 INFO:tasks.workunit.client.1.smithi194.stdout:7/61: write f8 [494138,87232] 0 2024-02-20T08:06:01.158 INFO:tasks.workunit.client.1.smithi194.stdout:7/62: chown f5 27697 1 2024-02-20T08:06:01.161 INFO:tasks.workunit.client.1.smithi194.stdout:0/43: fsync d6/d8/fb 0 2024-02-20T08:06:01.161 INFO:tasks.workunit.client.1.smithi194.stdout:3/46: chown d5/fb 124673 1 2024-02-20T08:06:01.161 INFO:tasks.workunit.client.1.smithi194.stdout:5/74: dread d4/f9 [0,4194304] 0 2024-02-20T08:06:01.163 INFO:tasks.workunit.client.1.smithi194.stdout:6/186: unlink df/d18/d19/d1d/d28/c38 0 2024-02-20T08:06:01.166 INFO:tasks.workunit.client.1.smithi194.stdout:4/36: rmdir d0/d2/d9 0 2024-02-20T08:06:01.168 INFO:tasks.workunit.client.1.smithi194.stdout:9/83: dwrite d4/d7/fc [0,4194304] 0 2024-02-20T08:06:01.174 INFO:tasks.workunit.client.1.smithi194.stdout:7/63: mkdir d11/d15 0 2024-02-20T08:06:01.175 INFO:tasks.workunit.client.1.smithi194.stdout:0/44: creat d6/fc x:0 0 0 2024-02-20T08:06:01.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/75: rename d4/d6/c7 to d4/d6/dd/ce 0 2024-02-20T08:06:01.181 INFO:tasks.workunit.client.1.smithi194.stdout:5/76: write d4/fb [230356,11631] 0 2024-02-20T08:06:01.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/59: sync 2024-02-20T08:06:01.187 INFO:tasks.workunit.client.1.smithi194.stdout:4/37: rmdir d0/d2 39 2024-02-20T08:06:01.188 INFO:tasks.workunit.client.1.smithi194.stdout:9/84: creat d4/de/f16 x:0 0 0 2024-02-20T08:06:01.191 INFO:tasks.workunit.client.1.smithi194.stdout:7/64: mknod d11/c16 0 2024-02-20T08:06:01.191 INFO:tasks.workunit.client.1.smithi194.stdout:3/47: write d5/fb [1156931,39840] 0 2024-02-20T08:06:01.194 INFO:tasks.workunit.client.1.smithi194.stdout:0/45: creat d6/fd x:0 0 0 2024-02-20T08:06:01.196 INFO:tasks.workunit.client.1.smithi194.stdout:5/77: write d4/d6/fa [4457489,33899] 0 2024-02-20T08:06:01.198 INFO:tasks.workunit.client.1.smithi194.stdout:4/38: fsync d0/d2/f4 0 2024-02-20T08:06:01.199 INFO:tasks.workunit.client.1.smithi194.stdout:3/48: dwrite f4 [0,4194304] 0 2024-02-20T08:06:01.199 INFO:tasks.workunit.client.1.smithi194.stdout:4/39: readlink d0/d2/l8 0 2024-02-20T08:06:01.200 INFO:tasks.workunit.client.1.smithi194.stdout:0/46: rename d6/fd to d6/fe 0 2024-02-20T08:06:01.201 INFO:tasks.workunit.client.1.smithi194.stdout:0/47: dread - d6/d8/fb zero size 2024-02-20T08:06:01.202 INFO:tasks.workunit.client.1.smithi194.stdout:6/187: creat df/d18/d19/d1d/d28/d2b/f3e x:0 0 0 2024-02-20T08:06:01.204 INFO:tasks.workunit.client.1.smithi194.stdout:3/49: dread d5/f6 [0,4194304] 0 2024-02-20T08:06:01.204 INFO:tasks.workunit.client.1.smithi194.stdout:6/188: chown df/d18/d19/d1d/f36 110088 1 2024-02-20T08:06:01.204 INFO:tasks.workunit.client.1.smithi194.stdout:4/40: dread d0/f3 [0,4194304] 0 2024-02-20T08:06:01.205 INFO:tasks.workunit.client.1.smithi194.stdout:5/78: symlink d4/d6/dd/lf 0 2024-02-20T08:06:01.207 INFO:tasks.workunit.client.1.smithi194.stdout:3/50: write d5/f6 [4430782,105321] 0 2024-02-20T08:06:01.207 INFO:tasks.workunit.client.1.smithi194.stdout:5/79: stat d4/d6/fa 0 2024-02-20T08:06:01.207 INFO:tasks.workunit.client.1.smithi194.stdout:9/85: rename d4/d7/l10 to d4/l17 0 2024-02-20T08:06:01.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/116: sync 2024-02-20T08:06:01.209 INFO:tasks.workunit.client.1.smithi194.stdout:1/83: sync 2024-02-20T08:06:01.210 INFO:tasks.workunit.client.1.smithi194.stdout:1/84: stat d2/d8/la 0 2024-02-20T08:06:01.211 INFO:tasks.workunit.client.1.smithi194.stdout:7/65: symlink d11/d15/l17 0 2024-02-20T08:06:01.212 INFO:tasks.workunit.client.1.smithi194.stdout:0/48: dwrite d6/fc [0,4194304] 0 2024-02-20T08:06:01.215 INFO:tasks.workunit.client.1.smithi194.stdout:8/60: write f1 [1396322,118550] 0 2024-02-20T08:06:01.216 INFO:tasks.workunit.client.1.smithi194.stdout:4/41: creat d0/d2/fb x:0 0 0 2024-02-20T08:06:01.218 INFO:tasks.workunit.client.1.smithi194.stdout:3/51: mknod d5/cd 0 2024-02-20T08:06:01.220 INFO:tasks.workunit.client.1.smithi194.stdout:2/117: write fc [907500,51220] 0 2024-02-20T08:06:01.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/66: fsync f5 0 2024-02-20T08:06:01.221 INFO:tasks.workunit.client.1.smithi194.stdout:3/52: write d5/f8 [3233033,58214] 0 2024-02-20T08:06:01.223 INFO:tasks.workunit.client.1.smithi194.stdout:2/118: readlink df/l15 0 2024-02-20T08:06:01.223 INFO:tasks.workunit.client.1.smithi194.stdout:7/67: fdatasync f8 0 2024-02-20T08:06:01.223 INFO:tasks.workunit.client.1.smithi194.stdout:1/85: dwrite d2/d8/dc/f14 [0,4194304] 0 2024-02-20T08:06:01.225 INFO:tasks.workunit.client.1.smithi194.stdout:3/53: chown d5/c7 9488998 1 2024-02-20T08:06:01.226 INFO:tasks.workunit.client.1.smithi194.stdout:6/189: mknod df/d18/d19/d1d/c3f 0 2024-02-20T08:06:01.227 INFO:tasks.workunit.client.1.smithi194.stdout:8/61: dread f1 [0,4194304] 0 2024-02-20T08:06:01.227 INFO:tasks.workunit.client.1.smithi194.stdout:6/190: chown df/d18/d19/f29 497 1 2024-02-20T08:06:01.232 INFO:tasks.workunit.client.1.smithi194.stdout:0/49: write d6/fc [5110611,19285] 0 2024-02-20T08:06:01.239 INFO:tasks.workunit.client.1.smithi194.stdout:2/119: mkdir df/d14/d24 0 2024-02-20T08:06:01.240 INFO:tasks.workunit.client.1.smithi194.stdout:1/86: rmdir d2/d8 39 2024-02-20T08:06:01.241 INFO:tasks.workunit.client.1.smithi194.stdout:7/68: symlink d11/l18 0 2024-02-20T08:06:01.242 INFO:tasks.workunit.client.1.smithi194.stdout:3/54: rename f3 to d5/fe 0 2024-02-20T08:06:01.243 INFO:tasks.workunit.client.1.smithi194.stdout:5/80: truncate d4/fc 4143680 0 2024-02-20T08:06:01.244 INFO:tasks.workunit.client.1.smithi194.stdout:8/62: fdatasync d2/f9 0 2024-02-20T08:06:01.244 INFO:tasks.workunit.client.1.smithi194.stdout:5/81: chown l1 58 1 2024-02-20T08:06:01.244 INFO:tasks.workunit.client.1.smithi194.stdout:8/63: chown f1 233 1 2024-02-20T08:06:01.247 INFO:tasks.workunit.client.1.smithi194.stdout:9/86: link d4/de/c14 d4/c18 0 2024-02-20T08:06:01.248 INFO:tasks.workunit.client.1.smithi194.stdout:9/87: truncate d4/d7/f15 343558 0 2024-02-20T08:06:01.252 INFO:tasks.workunit.client.1.smithi194.stdout:2/120: rmdir df 39 2024-02-20T08:06:01.255 INFO:tasks.workunit.client.1.smithi194.stdout:3/55: fsync d5/fe 0 2024-02-20T08:06:01.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/56: dwrite d5/f8 [0,4194304] 0 2024-02-20T08:06:01.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/82: creat d4/f10 x:0 0 0 2024-02-20T08:06:01.261 INFO:tasks.workunit.client.1.smithi194.stdout:7/69: truncate fd 2613582 0 2024-02-20T08:06:01.262 INFO:tasks.workunit.client.1.smithi194.stdout:8/64: fsync f1 0 2024-02-20T08:06:01.266 INFO:tasks.workunit.client.1.smithi194.stdout:3/57: dread d5/f8 [0,4194304] 0 2024-02-20T08:06:01.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/42: creat d0/fc x:0 0 0 2024-02-20T08:06:01.267 INFO:tasks.workunit.client.1.smithi194.stdout:9/88: creat d4/f19 x:0 0 0 2024-02-20T08:06:01.267 INFO:tasks.workunit.client.1.smithi194.stdout:3/58: dread - d5/fe zero size 2024-02-20T08:06:01.267 INFO:tasks.workunit.client.1.smithi194.stdout:4/43: dread - d0/fc zero size 2024-02-20T08:06:01.267 INFO:tasks.workunit.client.1.smithi194.stdout:3/59: stat d5/fa 0 2024-02-20T08:06:01.269 INFO:tasks.workunit.client.1.smithi194.stdout:1/87: rename d2/d8/dc/c10 to d2/d8/df/c1b 0 2024-02-20T08:06:01.270 INFO:tasks.workunit.client.1.smithi194.stdout:1/88: truncate d2/d8/f11 1417025 0 2024-02-20T08:06:01.271 INFO:tasks.workunit.client.1.smithi194.stdout:3/60: dread d5/fb [0,4194304] 0 2024-02-20T08:06:01.272 INFO:tasks.workunit.client.1.smithi194.stdout:6/191: creat df/d18/f40 x:0 0 0 2024-02-20T08:06:01.274 INFO:tasks.workunit.client.1.smithi194.stdout:5/83: mkdir d4/d6/d11 0 2024-02-20T08:06:01.277 INFO:tasks.workunit.client.1.smithi194.stdout:8/65: unlink d2/cb 0 2024-02-20T08:06:01.277 INFO:tasks.workunit.client.1.smithi194.stdout:7/70: dread f3 [0,4194304] 0 2024-02-20T08:06:01.278 INFO:tasks.workunit.client.1.smithi194.stdout:7/71: dread f8 [0,4194304] 0 2024-02-20T08:06:01.281 INFO:tasks.workunit.client.1.smithi194.stdout:4/44: unlink d0/d2/f4 0 2024-02-20T08:06:01.281 INFO:tasks.workunit.client.1.smithi194.stdout:4/45: write d0/fc [852591,40175] 0 2024-02-20T08:06:01.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/46: chown d0 19 1 2024-02-20T08:06:01.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/121: mknod df/d14/c25 0 2024-02-20T08:06:01.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/61: mkdir d5/df 0 2024-02-20T08:06:01.285 INFO:tasks.workunit.client.1.smithi194.stdout:2/122: write df/d14/d19/f20 [335454,57575] 0 2024-02-20T08:06:01.286 INFO:tasks.workunit.client.1.smithi194.stdout:6/192: write df/d18/d19/d1d/d28/f2d [371158,1791] 0 2024-02-20T08:06:01.286 INFO:tasks.workunit.client.1.smithi194.stdout:3/62: truncate d5/fe 714921 0 2024-02-20T08:06:01.288 INFO:tasks.workunit.client.1.smithi194.stdout:3/63: dread - d5/fa zero size 2024-02-20T08:06:01.288 INFO:tasks.workunit.client.1.smithi194.stdout:5/84: unlink l2 0 2024-02-20T08:06:01.289 INFO:tasks.workunit.client.1.smithi194.stdout:3/64: write d5/fa [1046656,63288] 0 2024-02-20T08:06:01.289 INFO:tasks.workunit.client.1.smithi194.stdout:8/66: mknod d2/c10 0 2024-02-20T08:06:01.292 INFO:tasks.workunit.client.1.smithi194.stdout:2/123: dread df/d14/d19/f23 [0,4194304] 0 2024-02-20T08:06:01.295 INFO:tasks.workunit.client.1.smithi194.stdout:6/193: dwrite df/d18/d19/d1d/d28/d2b/f3e [0,4194304] 0 2024-02-20T08:06:01.297 INFO:tasks.workunit.client.1.smithi194.stdout:3/65: mkdir d5/d10 0 2024-02-20T08:06:01.303 INFO:tasks.workunit.client.1.smithi194.stdout:2/124: mknod df/d14/c26 0 2024-02-20T08:06:01.304 INFO:tasks.workunit.client.1.smithi194.stdout:2/125: chown df/d14/f1d 223 1 2024-02-20T08:06:01.305 INFO:tasks.workunit.client.1.smithi194.stdout:2/126: truncate df/d14/f22 640885 0 2024-02-20T08:06:01.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/194: readlink df/d18/d19/d1d/d28/d2b/l34 0 2024-02-20T08:06:01.308 INFO:tasks.workunit.client.1.smithi194.stdout:3/66: write d5/f8 [4122268,5998] 0 2024-02-20T08:06:01.309 INFO:tasks.workunit.client.1.smithi194.stdout:3/67: chown d5/fa 1 1 2024-02-20T08:06:01.310 INFO:tasks.workunit.client.1.smithi194.stdout:5/85: fdatasync d4/fc 0 2024-02-20T08:06:01.313 INFO:tasks.workunit.client.1.smithi194.stdout:8/67: rmdir d2 39 2024-02-20T08:06:01.314 INFO:tasks.workunit.client.1.smithi194.stdout:3/68: dwrite d5/f8 [0,4194304] 0 2024-02-20T08:06:01.315 INFO:tasks.workunit.client.1.smithi194.stdout:9/89: truncate d4/d7/fc 985168 0 2024-02-20T08:06:01.315 INFO:tasks.workunit.client.1.smithi194.stdout:6/195: stat c3 0 2024-02-20T08:06:01.316 INFO:tasks.workunit.client.1.smithi194.stdout:7/72: write f5 [2026290,103441] 0 2024-02-20T08:06:01.317 INFO:tasks.workunit.client.1.smithi194.stdout:3/69: dread d5/fe [0,4194304] 0 2024-02-20T08:06:01.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/86: creat d4/f12 x:0 0 0 2024-02-20T08:06:01.321 INFO:tasks.workunit.client.1.smithi194.stdout:8/68: read d2/f9 [2060699,25654] 0 2024-02-20T08:06:01.321 INFO:tasks.workunit.client.1.smithi194.stdout:5/87: dread d4/fb [0,4194304] 0 2024-02-20T08:06:01.322 INFO:tasks.workunit.client.1.smithi194.stdout:2/127: mknod df/d14/d24/c27 0 2024-02-20T08:06:01.322 INFO:tasks.workunit.client.1.smithi194.stdout:5/88: dread - d4/f10 zero size 2024-02-20T08:06:01.323 INFO:tasks.workunit.client.1.smithi194.stdout:5/89: read f3 [154276,1650] 0 2024-02-20T08:06:01.323 INFO:tasks.workunit.client.1.smithi194.stdout:6/196: mknod df/c41 0 2024-02-20T08:06:01.325 INFO:tasks.workunit.client.1.smithi194.stdout:7/73: stat c10 0 2024-02-20T08:06:01.325 INFO:tasks.workunit.client.1.smithi194.stdout:7/74: readlink l2 0 2024-02-20T08:06:01.327 INFO:tasks.workunit.client.1.smithi194.stdout:4/47: link d0/c7 d0/cd 0 2024-02-20T08:06:01.328 INFO:tasks.workunit.client.1.smithi194.stdout:2/128: dwrite f5 [0,4194304] 0 2024-02-20T08:06:01.330 INFO:tasks.workunit.client.1.smithi194.stdout:6/197: mkdir df/d42 0 2024-02-20T08:06:01.331 INFO:tasks.workunit.client.1.smithi194.stdout:5/90: symlink d4/d6/dd/l13 0 2024-02-20T08:06:01.334 INFO:tasks.workunit.client.1.smithi194.stdout:3/70: creat d5/df/f11 x:0 0 0 2024-02-20T08:06:01.334 INFO:tasks.workunit.client.1.smithi194.stdout:7/75: symlink d11/d15/l19 0 2024-02-20T08:06:01.341 INFO:tasks.workunit.client.1.smithi194.stdout:4/48: unlink d0/d2/l8 0 2024-02-20T08:06:01.342 INFO:tasks.workunit.client.1.smithi194.stdout:3/71: dread d5/fa [0,4194304] 0 2024-02-20T08:06:01.344 INFO:tasks.workunit.client.1.smithi194.stdout:2/129: rename df/c1a to df/d14/d19/c28 0 2024-02-20T08:06:01.345 INFO:tasks.workunit.client.1.smithi194.stdout:2/130: write fc [953987,50232] 0 2024-02-20T08:06:01.348 INFO:tasks.workunit.client.1.smithi194.stdout:0/50: sync 2024-02-20T08:06:01.349 INFO:tasks.workunit.client.1.smithi194.stdout:3/72: dwrite d5/f8 [0,4194304] 0 2024-02-20T08:06:01.350 INFO:tasks.workunit.client.1.smithi194.stdout:0/51: dread - d6/fe zero size 2024-02-20T08:06:01.351 INFO:tasks.workunit.client.1.smithi194.stdout:8/69: link d2/fd d2/f11 0 2024-02-20T08:06:01.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/49: creat d0/d2/fe x:0 0 0 2024-02-20T08:06:01.355 INFO:tasks.workunit.client.1.smithi194.stdout:4/50: fdatasync d0/d2/fe 0 2024-02-20T08:06:01.355 INFO:tasks.workunit.client.1.smithi194.stdout:9/90: truncate d4/d7/f8 1429790 0 2024-02-20T08:06:01.358 INFO:tasks.workunit.client.1.smithi194.stdout:5/91: dwrite d4/fb [0,4194304] 0 2024-02-20T08:06:01.359 INFO:tasks.workunit.client.1.smithi194.stdout:0/52: dread d6/fc [0,4194304] 0 2024-02-20T08:06:01.359 INFO:tasks.workunit.client.1.smithi194.stdout:5/92: write d4/fb [371401,120772] 0 2024-02-20T08:06:01.362 INFO:tasks.workunit.client.1.smithi194.stdout:4/51: dread d0/fc [0,4194304] 0 2024-02-20T08:06:01.363 INFO:tasks.workunit.client.1.smithi194.stdout:4/52: dread - d0/d2/fb zero size 2024-02-20T08:06:01.363 INFO:tasks.workunit.client.1.smithi194.stdout:6/198: getdents df/d42 0 2024-02-20T08:06:01.363 INFO:tasks.workunit.client.1.smithi194.stdout:4/53: fdatasync d0/fc 0 2024-02-20T08:06:01.364 INFO:tasks.workunit.client.1.smithi194.stdout:6/199: dread - df/f3c zero size 2024-02-20T08:06:01.366 INFO:tasks.workunit.client.1.smithi194.stdout:1/89: sync 2024-02-20T08:06:01.374 INFO:tasks.workunit.client.1.smithi194.stdout:3/73: creat d5/df/f12 x:0 0 0 2024-02-20T08:06:01.374 INFO:tasks.workunit.client.1.smithi194.stdout:3/74: readlink l0 0 2024-02-20T08:06:01.376 INFO:tasks.workunit.client.1.smithi194.stdout:7/76: unlink l9 0 2024-02-20T08:06:01.379 INFO:tasks.workunit.client.1.smithi194.stdout:8/70: mknod d2/c12 0 2024-02-20T08:06:01.386 INFO:tasks.workunit.client.1.smithi194.stdout:9/91: creat d4/d7/f1a x:0 0 0 2024-02-20T08:06:01.390 INFO:tasks.workunit.client.1.smithi194.stdout:0/53: creat d6/d8/ff x:0 0 0 2024-02-20T08:06:01.390 INFO:tasks.workunit.client.1.smithi194.stdout:2/131: write df/f11 [1122702,61540] 0 2024-02-20T08:06:01.392 INFO:tasks.workunit.client.1.smithi194.stdout:2/132: write df/f11 [2018274,71256] 0 2024-02-20T08:06:01.392 INFO:tasks.workunit.client.1.smithi194.stdout:0/54: truncate d6/d8/ff 719351 0 2024-02-20T08:06:01.392 INFO:tasks.workunit.client.1.smithi194.stdout:0/55: chown d6/d8 8206106 1 2024-02-20T08:06:01.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/133: dread - df/f21 zero size 2024-02-20T08:06:01.394 INFO:tasks.workunit.client.1.smithi194.stdout:0/56: truncate d6/d8/fb 585262 0 2024-02-20T08:06:01.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/134: chown df/d14/c1b 1131 1 2024-02-20T08:06:01.394 INFO:tasks.workunit.client.1.smithi194.stdout:4/54: rmdir d0 39 2024-02-20T08:06:01.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/200: unlink df/d18/d19/d1d/d28/d2b/l39 0 2024-02-20T08:06:01.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/201: stat df/c41 0 2024-02-20T08:06:01.398 INFO:tasks.workunit.client.1.smithi194.stdout:6/202: write df/d18/d19/d1d/d28/d2b/f2e [1034160,17931] 0 2024-02-20T08:06:01.403 INFO:tasks.workunit.client.1.smithi194.stdout:7/77: chown c7 13948934 1 2024-02-20T08:06:01.403 INFO:tasks.workunit.client.1.smithi194.stdout:7/78: dread f8 [0,4194304] 0 2024-02-20T08:06:01.407 INFO:tasks.workunit.client.1.smithi194.stdout:8/71: fdatasync f1 0 2024-02-20T08:06:01.410 INFO:tasks.workunit.client.1.smithi194.stdout:9/92: mkdir d4/d1b 0 2024-02-20T08:06:01.415 INFO:tasks.workunit.client.1.smithi194.stdout:4/55: dread - d0/d2/fb zero size 2024-02-20T08:06:01.417 INFO:tasks.workunit.client.1.smithi194.stdout:2/135: rmdir df/d14/d19 39 2024-02-20T08:06:01.418 INFO:tasks.workunit.client.1.smithi194.stdout:1/90: mkdir d2/d1c 0 2024-02-20T08:06:01.438 INFO:tasks.workunit.client.1.smithi194.stdout:3/75: rename d5/df/f12 to d5/d10/f13 0 2024-02-20T08:06:01.439 INFO:tasks.workunit.client.1.smithi194.stdout:0/57: rmdir d6/d8 39 2024-02-20T08:06:01.439 INFO:tasks.workunit.client.1.smithi194.stdout:8/72: symlink d2/l13 0 2024-02-20T08:06:01.439 INFO:tasks.workunit.client.1.smithi194.stdout:5/93: write d4/fc [3131064,67102] 0 2024-02-20T08:06:01.439 INFO:tasks.workunit.client.1.smithi194.stdout:9/93: mknod d4/de/c1c 0 2024-02-20T08:06:01.443 INFO:tasks.workunit.client.1.smithi194.stdout:1/91: write d2/f7 [3767946,38684] 0 2024-02-20T08:06:01.443 INFO:tasks.workunit.client.1.smithi194.stdout:6/203: symlink df/d42/l43 0 2024-02-20T08:06:01.444 INFO:tasks.workunit.client.1.smithi194.stdout:9/94: dread d4/d7/f11 [0,4194304] 0 2024-02-20T08:06:01.446 INFO:tasks.workunit.client.1.smithi194.stdout:1/92: dread d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:01.447 INFO:tasks.workunit.client.1.smithi194.stdout:1/93: truncate d2/d8/f11 1849945 0 2024-02-20T08:06:01.501 INFO:tasks.workunit.client.1.smithi194.stdout:7/79: sync 2024-02-20T08:06:01.688 INFO:tasks.workunit.client.1.smithi194.stdout:5/94: unlink l1 0 2024-02-20T08:06:01.690 INFO:tasks.workunit.client.1.smithi194.stdout:8/73: mkdir d2/d14 0 2024-02-20T08:06:01.690 INFO:tasks.workunit.client.1.smithi194.stdout:8/74: chown d2/fa 0 1 2024-02-20T08:06:01.691 INFO:tasks.workunit.client.1.smithi194.stdout:4/56: mkdir d0/df 0 2024-02-20T08:06:01.691 INFO:tasks.workunit.client.1.smithi194.stdout:4/57: chown d0/d2 4604 1 2024-02-20T08:06:01.692 INFO:tasks.workunit.client.1.smithi194.stdout:8/75: write d2/fa [1957073,7731] 0 2024-02-20T08:06:01.694 INFO:tasks.workunit.client.1.smithi194.stdout:5/95: dwrite d4/fc [4194304,4194304] 0 2024-02-20T08:06:01.695 INFO:tasks.workunit.client.1.smithi194.stdout:5/96: write d4/d6/fa [4962506,21060] 0 2024-02-20T08:06:01.697 INFO:tasks.workunit.client.1.smithi194.stdout:1/94: rmdir d2/d8/d12 39 2024-02-20T08:06:01.698 INFO:tasks.workunit.client.1.smithi194.stdout:7/80: chown l2 469316401 1 2024-02-20T08:06:01.699 INFO:tasks.workunit.client.1.smithi194.stdout:0/58: symlink d6/d8/l10 0 2024-02-20T08:06:01.699 INFO:tasks.workunit.client.1.smithi194.stdout:0/59: chown d6/fc 263393950 1 2024-02-20T08:06:01.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/76: link d5/f8 d5/d10/f14 0 2024-02-20T08:06:01.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/77: stat f4 0 2024-02-20T08:06:01.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/78: chown f4 1 1 2024-02-20T08:06:01.707 INFO:tasks.workunit.client.1.smithi194.stdout:2/136: link df/d14/c26 df/d14/d24/c29 0 2024-02-20T08:06:01.707 INFO:tasks.workunit.client.1.smithi194.stdout:2/137: write df/d14/f22 [1381026,63222] 0 2024-02-20T08:06:01.711 INFO:tasks.workunit.client.1.smithi194.stdout:6/204: mknod df/d18/c44 0 2024-02-20T08:06:01.711 INFO:tasks.workunit.client.1.smithi194.stdout:5/97: fsync d4/f9 0 2024-02-20T08:06:01.712 INFO:tasks.workunit.client.1.smithi194.stdout:5/98: readlink d4/d6/dd/l13 0 2024-02-20T08:06:01.714 INFO:tasks.workunit.client.1.smithi194.stdout:9/95: creat d4/d1b/f1d x:0 0 0 2024-02-20T08:06:01.715 INFO:tasks.workunit.client.1.smithi194.stdout:1/95: chown d2/d8/d12/l17 17 1 2024-02-20T08:06:01.718 INFO:tasks.workunit.client.1.smithi194.stdout:7/81: write fd [642116,99149] 0 2024-02-20T08:06:01.720 INFO:tasks.workunit.client.1.smithi194.stdout:3/79: creat d5/df/f15 x:0 0 0 2024-02-20T08:06:01.721 INFO:tasks.workunit.client.1.smithi194.stdout:4/58: fsync d0/f3 0 2024-02-20T08:06:01.721 INFO:tasks.workunit.client.1.smithi194.stdout:3/80: chown d5/df/f15 473767 1 2024-02-20T08:06:01.722 INFO:tasks.workunit.client.1.smithi194.stdout:4/59: write d0/d2/fb [326085,15725] 0 2024-02-20T08:06:01.723 INFO:tasks.workunit.client.1.smithi194.stdout:0/60: dread d6/fc [0,4194304] 0 2024-02-20T08:06:01.724 INFO:tasks.workunit.client.1.smithi194.stdout:4/60: write d0/d2/fe [995205,123583] 0 2024-02-20T08:06:01.725 INFO:tasks.workunit.client.1.smithi194.stdout:6/205: rmdir df/d42 39 2024-02-20T08:06:01.728 INFO:tasks.workunit.client.1.smithi194.stdout:9/96: dread d4/d7/fc [0,4194304] 0 2024-02-20T08:06:01.729 INFO:tasks.workunit.client.1.smithi194.stdout:3/81: fdatasync d5/fa 0 2024-02-20T08:06:01.730 INFO:tasks.workunit.client.1.smithi194.stdout:7/82: write f5 [1549559,30107] 0 2024-02-20T08:06:01.732 INFO:tasks.workunit.client.1.smithi194.stdout:0/61: readlink l5 0 2024-02-20T08:06:01.733 INFO:tasks.workunit.client.1.smithi194.stdout:6/206: unlink df/f14 0 2024-02-20T08:06:01.734 INFO:tasks.workunit.client.1.smithi194.stdout:3/82: dread - d5/df/f11 zero size 2024-02-20T08:06:01.734 INFO:tasks.workunit.client.1.smithi194.stdout:9/97: dread d4/d7/f15 [0,4194304] 0 2024-02-20T08:06:01.736 INFO:tasks.workunit.client.1.smithi194.stdout:2/138: dwrite df/d14/d19/f20 [0,4194304] 0 2024-02-20T08:06:01.739 INFO:tasks.workunit.client.1.smithi194.stdout:4/61: dwrite d0/d2/fb [0,4194304] 0 2024-02-20T08:06:01.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/96: rmdir d2/d1c 0 2024-02-20T08:06:01.740 INFO:tasks.workunit.client.1.smithi194.stdout:6/207: write df/d18/d19/d1d/d28/d2b/f3e [1198803,75852] 0 2024-02-20T08:06:01.742 INFO:tasks.workunit.client.1.smithi194.stdout:9/98: read d4/d7/f8 [1401505,80885] 0 2024-02-20T08:06:01.744 INFO:tasks.workunit.client.1.smithi194.stdout:6/208: chown df/d18/c32 3127 1 2024-02-20T08:06:01.746 INFO:tasks.workunit.client.1.smithi194.stdout:2/139: unlink cd 0 2024-02-20T08:06:01.746 INFO:tasks.workunit.client.1.smithi194.stdout:3/83: write d5/d10/f14 [4638816,103805] 0 2024-02-20T08:06:01.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/83: truncate f3 5661279 0 2024-02-20T08:06:01.750 INFO:tasks.workunit.client.1.smithi194.stdout:0/62: dwrite d6/d8/fb [0,4194304] 0 2024-02-20T08:06:01.754 INFO:tasks.workunit.client.1.smithi194.stdout:9/99: creat d4/de/f1e x:0 0 0 2024-02-20T08:06:01.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/100: stat d4/f12 0 2024-02-20T08:06:01.757 INFO:tasks.workunit.client.1.smithi194.stdout:3/84: mkdir d5/d10/d16 0 2024-02-20T08:06:01.759 INFO:tasks.workunit.client.1.smithi194.stdout:1/97: dwrite d2/f13 [4194304,4194304] 0 2024-02-20T08:06:01.759 INFO:tasks.workunit.client.1.smithi194.stdout:3/85: chown f4 43252072 1 2024-02-20T08:06:01.762 INFO:tasks.workunit.client.1.smithi194.stdout:2/140: dwrite df/f12 [4194304,4194304] 0 2024-02-20T08:06:01.764 INFO:tasks.workunit.client.1.smithi194.stdout:2/141: chown df/d14/d19/l1c 42921 1 2024-02-20T08:06:01.766 INFO:tasks.workunit.client.1.smithi194.stdout:7/84: unlink f8 0 2024-02-20T08:06:01.769 INFO:tasks.workunit.client.1.smithi194.stdout:1/98: dread d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:01.771 INFO:tasks.workunit.client.1.smithi194.stdout:0/63: fsync d6/d8/fb 0 2024-02-20T08:06:01.778 INFO:tasks.workunit.client.1.smithi194.stdout:8/76: write d2/fd [971910,94297] 0 2024-02-20T08:06:01.780 INFO:tasks.workunit.client.1.smithi194.stdout:8/77: write d2/fd [1529996,110173] 0 2024-02-20T08:06:01.783 INFO:tasks.workunit.client.1.smithi194.stdout:1/99: creat d2/d1a/f1d x:0 0 0 2024-02-20T08:06:01.785 INFO:tasks.workunit.client.1.smithi194.stdout:0/64: link d6/d8/fb d6/d8/f11 0 2024-02-20T08:06:01.792 INFO:tasks.workunit.client.1.smithi194.stdout:0/65: creat d6/d8/f12 x:0 0 0 2024-02-20T08:06:01.792 INFO:tasks.workunit.client.1.smithi194.stdout:0/66: dread - d6/fe zero size 2024-02-20T08:06:01.792 INFO:tasks.workunit.client.1.smithi194.stdout:8/78: creat d2/d14/f15 x:0 0 0 2024-02-20T08:06:01.794 INFO:tasks.workunit.client.1.smithi194.stdout:1/100: symlink d2/l1e 0 2024-02-20T08:06:01.795 INFO:tasks.workunit.client.1.smithi194.stdout:1/101: fdatasync d2/d1a/f1d 0 2024-02-20T08:06:01.797 INFO:tasks.workunit.client.1.smithi194.stdout:0/67: unlink d6/d8/fb 0 2024-02-20T08:06:01.797 INFO:tasks.workunit.client.1.smithi194.stdout:1/102: read d2/d8/dc/f14 [3464304,62246] 0 2024-02-20T08:06:01.798 INFO:tasks.workunit.client.1.smithi194.stdout:4/62: dwrite d0/f3 [4194304,4194304] 0 2024-02-20T08:06:01.799 INFO:tasks.workunit.client.1.smithi194.stdout:0/68: dread d6/d8/ff [0,4194304] 0 2024-02-20T08:06:01.800 INFO:tasks.workunit.client.1.smithi194.stdout:0/69: rename d6 to d6/d8/d13 22 2024-02-20T08:06:01.800 INFO:tasks.workunit.client.1.smithi194.stdout:9/101: write d4/d7/f8 [333434,62913] 0 2024-02-20T08:06:01.800 INFO:tasks.workunit.client.1.smithi194.stdout:0/70: readlink d6/d8/l10 0 2024-02-20T08:06:01.802 INFO:tasks.workunit.client.1.smithi194.stdout:1/103: creat d2/d8/dc/f1f x:0 0 0 2024-02-20T08:06:01.804 INFO:tasks.workunit.client.1.smithi194.stdout:3/86: dwrite d5/fa [0,4194304] 0 2024-02-20T08:06:01.808 INFO:tasks.workunit.client.1.smithi194.stdout:3/87: dread d5/d10/f14 [0,4194304] 0 2024-02-20T08:06:01.808 INFO:tasks.workunit.client.1.smithi194.stdout:8/79: link d2/ce d2/d14/c16 0 2024-02-20T08:06:01.809 INFO:tasks.workunit.client.1.smithi194.stdout:8/80: read - d2/d14/f15 zero size 2024-02-20T08:06:01.811 INFO:tasks.workunit.client.1.smithi194.stdout:9/102: rename d4/d7/cd to d4/c1f 0 2024-02-20T08:06:01.815 INFO:tasks.workunit.client.1.smithi194.stdout:1/104: symlink d2/d8/d12/l20 0 2024-02-20T08:06:01.819 INFO:tasks.workunit.client.1.smithi194.stdout:4/63: mkdir d0/d10 0 2024-02-20T08:06:01.820 INFO:tasks.workunit.client.1.smithi194.stdout:1/105: dwrite d2/f13 [0,4194304] 0 2024-02-20T08:06:01.821 INFO:tasks.workunit.client.1.smithi194.stdout:1/106: write d2/d1a/f1d [270714,55547] 0 2024-02-20T08:06:01.824 INFO:tasks.workunit.client.1.smithi194.stdout:5/99: sync 2024-02-20T08:06:01.824 INFO:tasks.workunit.client.1.smithi194.stdout:3/88: mkdir d5/d10/d17 0 2024-02-20T08:06:01.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/81: fsync d2/d14/f15 0 2024-02-20T08:06:01.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/100: chown d4/c8 281988320 1 2024-02-20T08:06:01.830 INFO:tasks.workunit.client.1.smithi194.stdout:9/103: mkdir d4/d20 0 2024-02-20T08:06:01.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/85: truncate f3 4487171 0 2024-02-20T08:06:01.839 INFO:tasks.workunit.client.1.smithi194.stdout:1/107: creat d2/d8/d12/f21 x:0 0 0 2024-02-20T08:06:01.841 INFO:tasks.workunit.client.1.smithi194.stdout:1/108: write d2/d8/d12/f21 [871317,17621] 0 2024-02-20T08:06:01.842 INFO:tasks.workunit.client.1.smithi194.stdout:3/89: mknod d5/c18 0 2024-02-20T08:06:01.842 INFO:tasks.workunit.client.1.smithi194.stdout:7/86: dread fd [0,4194304] 0 2024-02-20T08:06:01.843 INFO:tasks.workunit.client.1.smithi194.stdout:8/82: symlink d2/d14/l17 0 2024-02-20T08:06:01.845 INFO:tasks.workunit.client.1.smithi194.stdout:5/101: mknod d4/d6/c14 0 2024-02-20T08:06:01.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/104: readlink d4/l17 0 2024-02-20T08:06:01.849 INFO:tasks.workunit.client.1.smithi194.stdout:7/87: dwrite fd [0,4194304] 0 2024-02-20T08:06:01.851 INFO:tasks.workunit.client.1.smithi194.stdout:5/102: dread d4/d6/fa [0,4194304] 0 2024-02-20T08:06:01.858 INFO:tasks.workunit.client.1.smithi194.stdout:4/64: dwrite d0/fc [0,4194304] 0 2024-02-20T08:06:01.861 INFO:tasks.workunit.client.1.smithi194.stdout:8/83: mkdir d2/d14/d18 0 2024-02-20T08:06:01.864 INFO:tasks.workunit.client.1.smithi194.stdout:4/65: dread d0/d2/fe [0,4194304] 0 2024-02-20T08:06:01.867 INFO:tasks.workunit.client.1.smithi194.stdout:9/105: rmdir d4/de 39 2024-02-20T08:06:01.868 INFO:tasks.workunit.client.1.smithi194.stdout:6/209: sync 2024-02-20T08:06:01.869 INFO:tasks.workunit.client.1.smithi194.stdout:1/109: write d2/f9 [941338,35138] 0 2024-02-20T08:06:01.869 INFO:tasks.workunit.client.1.smithi194.stdout:6/210: stat c3 0 2024-02-20T08:06:01.872 INFO:tasks.workunit.client.1.smithi194.stdout:1/110: dread d2/d1a/f1d [0,4194304] 0 2024-02-20T08:06:01.874 INFO:tasks.workunit.client.1.smithi194.stdout:7/88: dread d11/f14 [0,4194304] 0 2024-02-20T08:06:01.874 INFO:tasks.workunit.client.1.smithi194.stdout:7/89: readlink l2 0 2024-02-20T08:06:01.874 INFO:tasks.workunit.client.1.smithi194.stdout:1/111: dread d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:01.879 INFO:tasks.workunit.client.1.smithi194.stdout:8/84: rename d2/c7 to d2/d14/d18/c19 0 2024-02-20T08:06:01.879 INFO:tasks.workunit.client.1.smithi194.stdout:8/85: fdatasync d2/d14/f15 0 2024-02-20T08:06:01.882 INFO:tasks.workunit.client.1.smithi194.stdout:9/106: creat d4/d1b/f21 x:0 0 0 2024-02-20T08:06:01.882 INFO:tasks.workunit.client.1.smithi194.stdout:9/107: stat d4/f5 0 2024-02-20T08:06:01.883 INFO:tasks.workunit.client.1.smithi194.stdout:9/108: readlink d4/d7/lf 0 2024-02-20T08:06:01.885 INFO:tasks.workunit.client.1.smithi194.stdout:6/211: unlink f8 0 2024-02-20T08:06:01.887 INFO:tasks.workunit.client.1.smithi194.stdout:5/103: mkdir d4/d6/d11/d15 0 2024-02-20T08:06:01.891 INFO:tasks.workunit.client.1.smithi194.stdout:5/104: dread d4/fc [4194304,4194304] 0 2024-02-20T08:06:01.891 INFO:tasks.workunit.client.1.smithi194.stdout:7/90: write f5 [318972,73853] 0 2024-02-20T08:06:01.894 INFO:tasks.workunit.client.1.smithi194.stdout:1/112: rename d2/d8/df/c16 to d2/d8/dc/c22 0 2024-02-20T08:06:01.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/86: symlink d2/d14/d18/l1a 0 2024-02-20T08:06:01.901 INFO:tasks.workunit.client.1.smithi194.stdout:4/66: mkdir d0/df/d11 0 2024-02-20T08:06:01.902 INFO:tasks.workunit.client.1.smithi194.stdout:4/67: write d0/d2/fb [2627012,102395] 0 2024-02-20T08:06:01.906 INFO:tasks.workunit.client.1.smithi194.stdout:6/212: mknod df/d18/d19/d1d/d28/d2b/c45 0 2024-02-20T08:06:01.907 INFO:tasks.workunit.client.1.smithi194.stdout:4/68: dwrite d0/d2/fb [0,4194304] 0 2024-02-20T08:06:01.908 INFO:tasks.workunit.client.1.smithi194.stdout:3/90: link d5/l9 d5/d10/l19 0 2024-02-20T08:06:01.912 INFO:tasks.workunit.client.1.smithi194.stdout:8/87: creat d2/d14/f1b x:0 0 0 2024-02-20T08:06:01.913 INFO:tasks.workunit.client.1.smithi194.stdout:8/88: truncate d2/fa 2560517 0 2024-02-20T08:06:01.913 INFO:tasks.workunit.client.1.smithi194.stdout:0/71: truncate d6/d8/f11 3397581 0 2024-02-20T08:06:01.921 INFO:tasks.workunit.client.1.smithi194.stdout:9/109: creat d4/d20/f22 x:0 0 0 2024-02-20T08:06:01.927 INFO:tasks.workunit.client.1.smithi194.stdout:9/110: dwrite d4/f19 [0,4194304] 0 2024-02-20T08:06:01.929 INFO:tasks.workunit.client.1.smithi194.stdout:8/89: symlink d2/l1c 0 2024-02-20T08:06:01.933 INFO:tasks.workunit.client.1.smithi194.stdout:6/213: mkdir df/d18/d19/d1d/d28/d46 0 2024-02-20T08:06:01.935 INFO:tasks.workunit.client.1.smithi194.stdout:4/69: mknod d0/c12 0 2024-02-20T08:06:01.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/111: mkdir d4/d1b/d23 0 2024-02-20T08:06:01.939 INFO:tasks.workunit.client.1.smithi194.stdout:7/91: write f3 [2304155,55395] 0 2024-02-20T08:06:01.940 INFO:tasks.workunit.client.1.smithi194.stdout:7/92: chown d11/d15 301671 1 2024-02-20T08:06:01.941 INFO:tasks.workunit.client.1.smithi194.stdout:8/90: mknod d2/d14/d18/c1d 0 2024-02-20T08:06:01.943 INFO:tasks.workunit.client.1.smithi194.stdout:6/214: fdatasync fd 0 2024-02-20T08:06:01.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/91: write d2/fa [1653057,60264] 0 2024-02-20T08:06:01.944 INFO:tasks.workunit.client.1.smithi194.stdout:9/112: creat d4/d7/f24 x:0 0 0 2024-02-20T08:06:01.946 INFO:tasks.workunit.client.1.smithi194.stdout:7/93: creat d11/f1a x:0 0 0 2024-02-20T08:06:01.946 INFO:tasks.workunit.client.1.smithi194.stdout:9/113: stat d4/d1b 0 2024-02-20T08:06:01.948 INFO:tasks.workunit.client.1.smithi194.stdout:3/91: dwrite d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:01.950 INFO:tasks.workunit.client.1.smithi194.stdout:9/114: write d4/d1b/f21 [845762,17499] 0 2024-02-20T08:06:01.951 INFO:tasks.workunit.client.1.smithi194.stdout:3/92: dread - d5/df/f15 zero size 2024-02-20T08:06:01.953 INFO:tasks.workunit.client.1.smithi194.stdout:6/215: rename df/c41 to df/c47 0 2024-02-20T08:06:01.955 INFO:tasks.workunit.client.1.smithi194.stdout:9/115: stat d4/d20 0 2024-02-20T08:06:01.956 INFO:tasks.workunit.client.1.smithi194.stdout:6/216: chown df/d18/c44 1517354 1 2024-02-20T08:06:01.958 INFO:tasks.workunit.client.1.smithi194.stdout:0/72: dwrite d6/d8/f12 [0,4194304] 0 2024-02-20T08:06:01.958 INFO:tasks.workunit.client.1.smithi194.stdout:9/116: write d4/d7/f8 [1978930,106953] 0 2024-02-20T08:06:01.960 INFO:tasks.workunit.client.1.smithi194.stdout:9/117: chown d4/d1b 334 1 2024-02-20T08:06:01.960 INFO:tasks.workunit.client.1.smithi194.stdout:7/94: dread f3 [0,4194304] 0 2024-02-20T08:06:01.966 INFO:tasks.workunit.client.1.smithi194.stdout:8/92: dread d2/f11 [0,4194304] 0 2024-02-20T08:06:01.967 INFO:tasks.workunit.client.1.smithi194.stdout:7/95: creat d11/f1b x:0 0 0 2024-02-20T08:06:01.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/142: sync 2024-02-20T08:06:01.970 INFO:tasks.workunit.client.1.smithi194.stdout:3/93: dwrite d5/fb [0,4194304] 0 2024-02-20T08:06:01.972 INFO:tasks.workunit.client.1.smithi194.stdout:9/118: symlink d4/l25 0 2024-02-20T08:06:01.973 INFO:tasks.workunit.client.1.smithi194.stdout:6/217: dwrite df/d18/d19/f22 [0,4194304] 0 2024-02-20T08:06:01.974 INFO:tasks.workunit.client.1.smithi194.stdout:8/93: creat d2/f1e x:0 0 0 2024-02-20T08:06:01.974 INFO:tasks.workunit.client.1.smithi194.stdout:7/96: creat d11/d15/f1c x:0 0 0 2024-02-20T08:06:01.975 INFO:tasks.workunit.client.1.smithi194.stdout:7/97: chown d11/c16 12 1 2024-02-20T08:06:01.978 INFO:tasks.workunit.client.1.smithi194.stdout:2/143: creat df/d14/d19/f2a x:0 0 0 2024-02-20T08:06:01.982 INFO:tasks.workunit.client.1.smithi194.stdout:9/119: symlink d4/d20/l26 0 2024-02-20T08:06:01.984 INFO:tasks.workunit.client.1.smithi194.stdout:8/94: rename d2/fd to d2/f1f 0 2024-02-20T08:06:01.986 INFO:tasks.workunit.client.1.smithi194.stdout:3/94: creat d5/d10/d16/f1a x:0 0 0 2024-02-20T08:06:01.988 INFO:tasks.workunit.client.1.smithi194.stdout:0/73: dwrite d6/d8/ff [0,4194304] 0 2024-02-20T08:06:01.989 INFO:tasks.workunit.client.1.smithi194.stdout:7/98: unlink ca 0 2024-02-20T08:06:01.990 INFO:tasks.workunit.client.1.smithi194.stdout:8/95: symlink d2/d14/l20 0 2024-02-20T08:06:01.993 INFO:tasks.workunit.client.1.smithi194.stdout:9/120: creat d4/de/f27 x:0 0 0 2024-02-20T08:06:01.994 INFO:tasks.workunit.client.1.smithi194.stdout:7/99: dread fd [0,4194304] 0 2024-02-20T08:06:01.994 INFO:tasks.workunit.client.1.smithi194.stdout:6/218: creat df/d18/d19/d1d/d28/f48 x:0 0 0 2024-02-20T08:06:01.999 INFO:tasks.workunit.client.1.smithi194.stdout:8/96: dread d2/f9 [0,4194304] 0 2024-02-20T08:06:01.999 INFO:tasks.workunit.client.1.smithi194.stdout:0/74: truncate d6/fc 4760739 0 2024-02-20T08:06:02.002 INFO:tasks.workunit.client.1.smithi194.stdout:2/144: creat df/f2b x:0 0 0 2024-02-20T08:06:02.002 INFO:tasks.workunit.client.1.smithi194.stdout:9/121: rename d4/d1b/d23 to d4/d7/d28 0 2024-02-20T08:06:02.005 INFO:tasks.workunit.client.1.smithi194.stdout:7/100: dwrite d11/f12 [0,4194304] 0 2024-02-20T08:06:02.005 INFO:tasks.workunit.client.1.smithi194.stdout:6/219: rmdir df/d18/d19/d1d 39 2024-02-20T08:06:02.008 INFO:tasks.workunit.client.1.smithi194.stdout:0/75: dread d6/d8/f12 [0,4194304] 0 2024-02-20T08:06:02.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/97: mknod d2/c21 0 2024-02-20T08:06:02.017 INFO:tasks.workunit.client.1.smithi194.stdout:9/122: mknod d4/d7/d28/c29 0 2024-02-20T08:06:02.019 INFO:tasks.workunit.client.1.smithi194.stdout:9/123: write d4/d7/f24 [19258,82266] 0 2024-02-20T08:06:02.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/145: write df/d14/d19/f23 [1758712,50814] 0 2024-02-20T08:06:02.025 INFO:tasks.workunit.client.1.smithi194.stdout:6/220: write df/d18/d19/f29 [2792064,34956] 0 2024-02-20T08:06:02.026 INFO:tasks.workunit.client.1.smithi194.stdout:7/101: dread f3 [0,4194304] 0 2024-02-20T08:06:02.027 INFO:tasks.workunit.client.1.smithi194.stdout:8/98: write d2/f1f [666728,102715] 0 2024-02-20T08:06:02.030 INFO:tasks.workunit.client.1.smithi194.stdout:9/124: creat d4/de/f2a x:0 0 0 2024-02-20T08:06:02.031 INFO:tasks.workunit.client.1.smithi194.stdout:0/76: mknod d6/c14 0 2024-02-20T08:06:02.033 INFO:tasks.workunit.client.1.smithi194.stdout:8/99: rename d2/l13 to d2/d14/d18/l22 0 2024-02-20T08:06:02.035 INFO:tasks.workunit.client.1.smithi194.stdout:2/146: mknod df/d14/c2c 0 2024-02-20T08:06:02.041 INFO:tasks.workunit.client.1.smithi194.stdout:2/147: dwrite fe [0,4194304] 0 2024-02-20T08:06:02.043 INFO:tasks.workunit.client.1.smithi194.stdout:7/102: symlink d11/d15/l1d 0 2024-02-20T08:06:02.047 INFO:tasks.workunit.client.1.smithi194.stdout:9/125: mknod d4/c2b 0 2024-02-20T08:06:02.048 INFO:tasks.workunit.client.1.smithi194.stdout:6/221: creat df/d18/f49 x:0 0 0 2024-02-20T08:06:02.052 INFO:tasks.workunit.client.1.smithi194.stdout:2/148: creat df/d14/d24/f2d x:0 0 0 2024-02-20T08:06:02.052 INFO:tasks.workunit.client.1.smithi194.stdout:2/149: chown lb 248 1 2024-02-20T08:06:02.053 INFO:tasks.workunit.client.1.smithi194.stdout:2/150: truncate df/f21 81901 0 2024-02-20T08:06:02.053 INFO:tasks.workunit.client.1.smithi194.stdout:7/103: symlink d11/d15/l1e 0 2024-02-20T08:06:02.055 INFO:tasks.workunit.client.1.smithi194.stdout:9/126: chown d4/c1f 385481162 1 2024-02-20T08:06:02.057 INFO:tasks.workunit.client.1.smithi194.stdout:6/222: chown df/d18/d19/d1d/c3f 1 1 2024-02-20T08:06:02.058 INFO:tasks.workunit.client.1.smithi194.stdout:0/77: creat d6/d8/f15 x:0 0 0 2024-02-20T08:06:02.058 INFO:tasks.workunit.client.1.smithi194.stdout:6/223: truncate df/d18/f33 4671122 0 2024-02-20T08:06:02.059 INFO:tasks.workunit.client.1.smithi194.stdout:7/104: truncate d11/f14 75975 0 2024-02-20T08:06:02.060 INFO:tasks.workunit.client.1.smithi194.stdout:2/151: dread df/d14/f22 [0,4194304] 0 2024-02-20T08:06:02.061 INFO:tasks.workunit.client.1.smithi194.stdout:9/127: read d4/d7/f11 [878199,68685] 0 2024-02-20T08:06:02.064 INFO:tasks.workunit.client.1.smithi194.stdout:8/100: link d2/d14/d18/l22 d2/l23 0 2024-02-20T08:06:02.065 INFO:tasks.workunit.client.1.smithi194.stdout:2/152: creat df/d14/d19/f2e x:0 0 0 2024-02-20T08:06:02.067 INFO:tasks.workunit.client.1.smithi194.stdout:9/128: dwrite d4/de/f1e [0,4194304] 0 2024-02-20T08:06:02.070 INFO:tasks.workunit.client.1.smithi194.stdout:9/129: write d4/de/f2a [519759,83842] 0 2024-02-20T08:06:02.072 INFO:tasks.workunit.client.1.smithi194.stdout:6/224: creat df/d18/d19/f4a x:0 0 0 2024-02-20T08:06:02.074 INFO:tasks.workunit.client.1.smithi194.stdout:2/153: dwrite df/d14/f1d [0,4194304] 0 2024-02-20T08:06:02.075 INFO:tasks.workunit.client.1.smithi194.stdout:6/225: write df/d18/d19/f1a [2112958,31032] 0 2024-02-20T08:06:02.077 INFO:tasks.workunit.client.1.smithi194.stdout:0/78: write d6/d8/f12 [3235468,40815] 0 2024-02-20T08:06:02.079 INFO:tasks.workunit.client.1.smithi194.stdout:6/226: stat df/d18/c44 0 2024-02-20T08:06:02.083 INFO:tasks.workunit.client.1.smithi194.stdout:5/105: sync 2024-02-20T08:06:02.084 INFO:tasks.workunit.client.1.smithi194.stdout:9/130: write d4/f5 [1755672,109758] 0 2024-02-20T08:06:02.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/154: mknod df/d14/d24/c2f 0 2024-02-20T08:06:02.089 INFO:tasks.workunit.client.1.smithi194.stdout:8/101: getdents d2 0 2024-02-20T08:06:02.089 INFO:tasks.workunit.client.1.smithi194.stdout:9/131: chown d4/d20/f22 60950 1 2024-02-20T08:06:02.090 INFO:tasks.workunit.client.1.smithi194.stdout:5/106: creat d4/d6/f16 x:0 0 0 2024-02-20T08:06:02.091 INFO:tasks.workunit.client.1.smithi194.stdout:8/102: dread - d2/f1e zero size 2024-02-20T08:06:02.093 INFO:tasks.workunit.client.1.smithi194.stdout:9/132: write d4/f12 [324998,20386] 0 2024-02-20T08:06:02.094 INFO:tasks.workunit.client.1.smithi194.stdout:0/79: creat d6/d8/f16 x:0 0 0 2024-02-20T08:06:02.094 INFO:tasks.workunit.client.1.smithi194.stdout:6/227: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:02.095 INFO:tasks.workunit.client.1.smithi194.stdout:7/105: dwrite f5 [0,4194304] 0 2024-02-20T08:06:02.096 INFO:tasks.workunit.client.1.smithi194.stdout:2/155: unlink df/d14/c26 0 2024-02-20T08:06:02.097 INFO:tasks.workunit.client.1.smithi194.stdout:9/133: write d4/f12 [1036274,41912] 0 2024-02-20T08:06:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: Upgrade: Updating mgr.smithi123.kwyrtl 2024-02-20T08:06:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:06:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:06:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:06:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: Deploying daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T08:06:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:01 smithi194 ceph-mon[37804]: pgmap v50: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 9.3 MiB/s rd, 20 MiB/s wr, 298 op/s 2024-02-20T08:06:02.167 INFO:tasks.workunit.client.1.smithi194.stdout:6/228: mknod df/d18/d19/d1d/d28/d46/c4b 0 2024-02-20T08:06:02.169 INFO:tasks.workunit.client.1.smithi194.stdout:5/107: truncate d4/fb 1130382 0 2024-02-20T08:06:02.169 INFO:tasks.workunit.client.1.smithi194.stdout:2/156: dwrite fc [0,4194304] 0 2024-02-20T08:06:02.172 INFO:tasks.workunit.client.1.smithi194.stdout:9/134: dwrite d4/de/f27 [0,4194304] 0 2024-02-20T08:06:02.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/135: write d4/de/f16 [884579,106875] 0 2024-02-20T08:06:02.176 INFO:tasks.workunit.client.1.smithi194.stdout:8/103: dwrite f1 [4194304,4194304] 0 2024-02-20T08:06:02.177 INFO:tasks.workunit.client.1.smithi194.stdout:9/136: chown d4/d20 186 1 2024-02-20T08:06:02.179 INFO:tasks.workunit.client.1.smithi194.stdout:6/229: dread df/d18/d19/f22 [0,4194304] 0 2024-02-20T08:06:02.185 INFO:tasks.workunit.client.1.smithi194.stdout:8/104: dwrite d2/fa [0,4194304] 0 2024-02-20T08:06:02.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/105: chown d2/d14/f1b 1 1 2024-02-20T08:06:02.194 INFO:tasks.workunit.client.1.smithi194.stdout:9/137: creat d4/d7/f2c x:0 0 0 2024-02-20T08:06:02.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/106: creat d2/d14/f24 x:0 0 0 2024-02-20T08:06:02.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/107: fdatasync d2/f9 0 2024-02-20T08:06:02.200 INFO:tasks.workunit.client.1.smithi194.stdout:6/230: symlink df/d18/d19/l4c 0 2024-02-20T08:06:02.202 INFO:tasks.workunit.client.1.smithi194.stdout:0/80: link d6/fc d6/f17 0 2024-02-20T08:06:02.203 INFO:tasks.workunit.client.1.smithi194.stdout:8/108: mknod d2/c25 0 2024-02-20T08:06:02.203 INFO:tasks.workunit.client.1.smithi194.stdout:8/109: rename d2 to d2/d14/d26 22 2024-02-20T08:06:02.203 INFO:tasks.workunit.client.1.smithi194.stdout:8/110: dread - d2/f1e zero size 2024-02-20T08:06:02.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/157: link df/d14/c1b df/d14/c30 0 2024-02-20T08:06:02.211 INFO:tasks.workunit.client.1.smithi194.stdout:8/111: dwrite d2/d14/f24 [0,4194304] 0 2024-02-20T08:06:02.212 INFO:tasks.workunit.client.1.smithi194.stdout:1/113: sync 2024-02-20T08:06:02.212 INFO:tasks.workunit.client.1.smithi194.stdout:8/112: dread - d2/f1e zero size 2024-02-20T08:06:02.212 INFO:tasks.workunit.client.1.smithi194.stdout:1/114: write d2/d8/dc/f1f [89483,97085] 0 2024-02-20T08:06:02.213 INFO:tasks.workunit.client.1.smithi194.stdout:6/231: creat df/d42/f4d x:0 0 0 2024-02-20T08:06:02.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/81: creat d6/f18 x:0 0 0 2024-02-20T08:06:02.218 INFO:tasks.workunit.client.1.smithi194.stdout:1/115: dread d2/d8/fb [4194304,4194304] 0 2024-02-20T08:06:02.218 INFO:tasks.workunit.client.1.smithi194.stdout:6/232: truncate df/d18/d19/d1d/f23 4431571 0 2024-02-20T08:06:02.219 INFO:tasks.workunit.client.1.smithi194.stdout:8/113: creat d2/d14/d18/f27 x:0 0 0 2024-02-20T08:06:02.222 INFO:tasks.workunit.client.1.smithi194.stdout:9/138: truncate d4/f19 1204317 0 2024-02-20T08:06:02.222 INFO:tasks.workunit.client.1.smithi194.stdout:9/139: fsync d4/f12 0 2024-02-20T08:06:02.222 INFO:tasks.workunit.client.1.smithi194.stdout:9/140: stat d4/d20/f22 0 2024-02-20T08:06:02.223 INFO:tasks.workunit.client.1.smithi194.stdout:5/108: write d4/fb [400331,95025] 0 2024-02-20T08:06:02.227 INFO:tasks.workunit.client.1.smithi194.stdout:1/116: symlink d2/d1a/l23 0 2024-02-20T08:06:02.227 INFO:tasks.workunit.client.1.smithi194.stdout:9/141: dread d4/de/f2a [0,4194304] 0 2024-02-20T08:06:02.230 INFO:tasks.workunit.client.1.smithi194.stdout:0/82: dwrite d6/fe [0,4194304] 0 2024-02-20T08:06:02.232 INFO:tasks.workunit.client.1.smithi194.stdout:8/114: symlink d2/d14/d18/l28 0 2024-02-20T08:06:02.243 INFO:tasks.workunit.client.1.smithi194.stdout:3/95: sync 2024-02-20T08:06:02.243 INFO:tasks.workunit.client.1.smithi194.stdout:4/70: sync 2024-02-20T08:06:02.249 INFO:tasks.workunit.client.1.smithi194.stdout:4/71: dwrite d0/f3 [4194304,4194304] 0 2024-02-20T08:06:02.250 INFO:tasks.workunit.client.1.smithi194.stdout:1/117: fsync d2/d8/f11 0 2024-02-20T08:06:02.250 INFO:tasks.workunit.client.1.smithi194.stdout:6/233: mknod df/c4e 0 2024-02-20T08:06:02.251 INFO:tasks.workunit.client.1.smithi194.stdout:4/72: write d0/f3 [4706473,42643] 0 2024-02-20T08:06:02.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/115: mknod d2/d14/d18/c29 0 2024-02-20T08:06:02.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/158: link df/d14/d19/l1c df/d14/l31 0 2024-02-20T08:06:02.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/96: creat d5/f1b x:0 0 0 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: Upgrade: Updating mgr.smithi123.kwyrtl 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: Deploying daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T08:06:02.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:01 smithi123 ceph-mon[29383]: pgmap v50: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 9.3 MiB/s rd, 20 MiB/s wr, 298 op/s 2024-02-20T08:06:02.260 INFO:tasks.workunit.client.1.smithi194.stdout:2/159: dwrite df/f21 [0,4194304] 0 2024-02-20T08:06:02.260 INFO:tasks.workunit.client.1.smithi194.stdout:5/109: write f3 [1724881,109512] 0 2024-02-20T08:06:02.261 INFO:tasks.workunit.client.1.smithi194.stdout:2/160: write df/d14/d19/f23 [2221536,12906] 0 2024-02-20T08:06:02.263 INFO:tasks.workunit.client.1.smithi194.stdout:9/142: mkdir d4/d2d 0 2024-02-20T08:06:02.265 INFO:tasks.workunit.client.1.smithi194.stdout:6/234: creat df/d42/f4f x:0 0 0 2024-02-20T08:06:02.266 INFO:tasks.workunit.client.1.smithi194.stdout:1/118: creat d2/d8/df/f24 x:0 0 0 2024-02-20T08:06:02.268 INFO:tasks.workunit.client.1.smithi194.stdout:8/116: rename d2/c12 to d2/d14/d18/c2a 0 2024-02-20T08:06:02.270 INFO:tasks.workunit.client.1.smithi194.stdout:8/117: dread - d2/d14/f1b zero size 2024-02-20T08:06:02.270 INFO:tasks.workunit.client.1.smithi194.stdout:8/118: fsync f1 0 2024-02-20T08:06:02.271 INFO:tasks.workunit.client.1.smithi194.stdout:5/110: creat d4/d6/dd/f17 x:0 0 0 2024-02-20T08:06:02.271 INFO:tasks.workunit.client.1.smithi194.stdout:1/119: dread d2/f9 [0,4194304] 0 2024-02-20T08:06:02.273 INFO:tasks.workunit.client.1.smithi194.stdout:9/143: mkdir d4/d1b/d2e 0 2024-02-20T08:06:02.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/119: rmdir d2 39 2024-02-20T08:06:02.278 INFO:tasks.workunit.client.1.smithi194.stdout:5/111: unlink d4/d6/dd/l13 0 2024-02-20T08:06:02.280 INFO:tasks.workunit.client.1.smithi194.stdout:9/144: write d4/de/f2a [1132657,6285] 0 2024-02-20T08:06:02.282 INFO:tasks.workunit.client.1.smithi194.stdout:2/161: dwrite df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:02.285 INFO:tasks.workunit.client.1.smithi194.stdout:5/112: mknod d4/d6/c18 0 2024-02-20T08:06:02.288 INFO:tasks.workunit.client.1.smithi194.stdout:6/235: creat df/d18/f50 x:0 0 0 2024-02-20T08:06:02.292 INFO:tasks.workunit.client.1.smithi194.stdout:6/236: write df/d18/f49 [752744,51392] 0 2024-02-20T08:06:02.292 INFO:tasks.workunit.client.1.smithi194.stdout:6/237: dread - df/f3c zero size 2024-02-20T08:06:02.292 INFO:tasks.workunit.client.1.smithi194.stdout:3/97: write d5/fe [529988,9300] 0 2024-02-20T08:06:02.293 INFO:tasks.workunit.client.1.smithi194.stdout:8/120: creat d2/d14/f2b x:0 0 0 2024-02-20T08:06:02.295 INFO:tasks.workunit.client.1.smithi194.stdout:1/120: creat d2/d8/f25 x:0 0 0 2024-02-20T08:06:02.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/73: truncate d0/f3 1829091 0 2024-02-20T08:06:02.299 INFO:tasks.workunit.client.1.smithi194.stdout:9/145: mknod d4/c2f 0 2024-02-20T08:06:02.301 INFO:tasks.workunit.client.1.smithi194.stdout:3/98: mknod d5/c1c 0 2024-02-20T08:06:02.302 INFO:tasks.workunit.client.1.smithi194.stdout:1/121: dwrite d2/d8/dc/f19 [0,4194304] 0 2024-02-20T08:06:02.304 INFO:tasks.workunit.client.1.smithi194.stdout:8/121: chown d2/d14/d18/l22 5 1 2024-02-20T08:06:02.306 INFO:tasks.workunit.client.1.smithi194.stdout:5/113: rename d4/d6/dd/ce to d4/d6/d11/d15/c19 0 2024-02-20T08:06:02.308 INFO:tasks.workunit.client.1.smithi194.stdout:4/74: creat d0/df/f13 x:0 0 0 2024-02-20T08:06:02.308 INFO:tasks.workunit.client.1.smithi194.stdout:2/162: creat df/d14/f32 x:0 0 0 2024-02-20T08:06:02.309 INFO:tasks.workunit.client.1.smithi194.stdout:4/75: dread - d0/df/f13 zero size 2024-02-20T08:06:02.309 INFO:tasks.workunit.client.1.smithi194.stdout:2/163: dread - df/f2b zero size 2024-02-20T08:06:02.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/122: mkdir d2/d1a/d26 0 2024-02-20T08:06:02.312 INFO:tasks.workunit.client.1.smithi194.stdout:8/122: chown d2/d14/d18/c19 2540537 1 2024-02-20T08:06:02.314 INFO:tasks.workunit.client.1.smithi194.stdout:6/238: rename df/d18/d19/d1d/f36 to df/d18/d19/d1d/d28/d2b/f51 0 2024-02-20T08:06:02.315 INFO:tasks.workunit.client.1.smithi194.stdout:6/239: chown cb 0 1 2024-02-20T08:06:02.315 INFO:tasks.workunit.client.1.smithi194.stdout:6/240: chown df/d18/d19/d1d/d28/d2b/c45 2561715 1 2024-02-20T08:06:02.318 INFO:tasks.workunit.client.1.smithi194.stdout:9/146: creat d4/d1b/d2e/f30 x:0 0 0 2024-02-20T08:06:02.319 INFO:tasks.workunit.client.1.smithi194.stdout:3/99: mkdir d5/d10/d17/d1d 0 2024-02-20T08:06:02.321 INFO:tasks.workunit.client.1.smithi194.stdout:3/100: truncate d5/f1b 666192 0 2024-02-20T08:06:02.322 INFO:tasks.workunit.client.1.smithi194.stdout:3/101: chown d5/d10/d17/d1d 970534 1 2024-02-20T08:06:02.323 INFO:tasks.workunit.client.1.smithi194.stdout:8/123: creat d2/d14/f2c x:0 0 0 2024-02-20T08:06:02.323 INFO:tasks.workunit.client.1.smithi194.stdout:4/76: dwrite d0/f3 [0,4194304] 0 2024-02-20T08:06:02.323 INFO:tasks.workunit.client.1.smithi194.stdout:3/102: dread - d5/d10/d16/f1a zero size 2024-02-20T08:06:02.325 INFO:tasks.workunit.client.1.smithi194.stdout:2/164: symlink df/l33 0 2024-02-20T08:06:02.326 INFO:tasks.workunit.client.1.smithi194.stdout:7/106: sync 2024-02-20T08:06:02.327 INFO:tasks.workunit.client.1.smithi194.stdout:9/147: creat d4/d7/f31 x:0 0 0 2024-02-20T08:06:02.328 INFO:tasks.workunit.client.1.smithi194.stdout:1/123: symlink d2/d8/l27 0 2024-02-20T08:06:02.330 INFO:tasks.workunit.client.1.smithi194.stdout:9/148: write d4/d1b/f1d [936111,54158] 0 2024-02-20T08:06:02.332 INFO:tasks.workunit.client.1.smithi194.stdout:5/114: write d4/d6/fa [9382438,28677] 0 2024-02-20T08:06:02.333 INFO:tasks.workunit.client.1.smithi194.stdout:8/124: dwrite f1 [0,4194304] 0 2024-02-20T08:06:02.334 INFO:tasks.workunit.client.1.smithi194.stdout:7/107: creat d11/f1f x:0 0 0 2024-02-20T08:06:02.334 INFO:tasks.workunit.client.1.smithi194.stdout:5/115: chown f3 0 1 2024-02-20T08:06:02.335 INFO:tasks.workunit.client.1.smithi194.stdout:5/116: dread - d4/f12 zero size 2024-02-20T08:06:02.335 INFO:tasks.workunit.client.1.smithi194.stdout:3/103: creat d5/d10/d17/d1d/f1e x:0 0 0 2024-02-20T08:06:02.336 INFO:tasks.workunit.client.1.smithi194.stdout:8/125: dread d2/f11 [0,4194304] 0 2024-02-20T08:06:02.338 INFO:tasks.workunit.client.1.smithi194.stdout:2/165: symlink df/d14/d24/l34 0 2024-02-20T08:06:02.339 INFO:tasks.workunit.client.1.smithi194.stdout:7/108: stat lc 0 2024-02-20T08:06:02.340 INFO:tasks.workunit.client.1.smithi194.stdout:1/124: mknod d2/d1a/d26/c28 0 2024-02-20T08:06:02.340 INFO:tasks.workunit.client.1.smithi194.stdout:3/104: rmdir d5/d10/d17 39 2024-02-20T08:06:02.341 INFO:tasks.workunit.client.1.smithi194.stdout:8/126: chown d2/d14/d18/c19 3274 1 2024-02-20T08:06:02.344 INFO:tasks.workunit.client.1.smithi194.stdout:8/127: truncate d2/d14/d18/f27 558593 0 2024-02-20T08:06:02.345 INFO:tasks.workunit.client.1.smithi194.stdout:7/109: dread f3 [0,4194304] 0 2024-02-20T08:06:02.347 INFO:tasks.workunit.client.1.smithi194.stdout:1/125: dwrite d2/f7 [0,4194304] 0 2024-02-20T08:06:02.347 INFO:tasks.workunit.client.1.smithi194.stdout:1/126: stat d2/d1a/f1d 0 2024-02-20T08:06:02.350 INFO:tasks.workunit.client.1.smithi194.stdout:9/149: link d4/d7/f31 d4/f32 0 2024-02-20T08:06:02.351 INFO:tasks.workunit.client.1.smithi194.stdout:9/150: write d4/d7/f24 [136893,110704] 0 2024-02-20T08:06:02.354 INFO:tasks.workunit.client.1.smithi194.stdout:3/105: mknod d5/d10/c1f 0 2024-02-20T08:06:02.355 INFO:tasks.workunit.client.1.smithi194.stdout:4/77: truncate d0/f3 3499810 0 2024-02-20T08:06:02.355 INFO:tasks.workunit.client.1.smithi194.stdout:7/110: mkdir d11/d15/d20 0 2024-02-20T08:06:02.357 INFO:tasks.workunit.client.1.smithi194.stdout:7/111: write d11/f1a [560104,16017] 0 2024-02-20T08:06:02.359 INFO:tasks.workunit.client.1.smithi194.stdout:2/166: write df/d14/d19/f20 [4891389,67908] 0 2024-02-20T08:06:02.360 INFO:tasks.workunit.client.1.smithi194.stdout:2/167: chown df/d14/d19/f23 141 1 2024-02-20T08:06:02.361 INFO:tasks.workunit.client.1.smithi194.stdout:2/168: truncate fe 4515222 0 2024-02-20T08:06:02.361 INFO:tasks.workunit.client.1.smithi194.stdout:4/78: dread d0/fc [0,4194304] 0 2024-02-20T08:06:02.363 INFO:tasks.workunit.client.1.smithi194.stdout:8/128: dwrite d2/f11 [0,4194304] 0 2024-02-20T08:06:02.367 INFO:tasks.workunit.client.1.smithi194.stdout:4/79: dwrite d0/d2/fb [0,4194304] 0 2024-02-20T08:06:02.368 INFO:tasks.workunit.client.1.smithi194.stdout:4/80: chown d0/f3 13827 1 2024-02-20T08:06:02.368 INFO:tasks.workunit.client.1.smithi194.stdout:4/81: readlink - no filename 2024-02-20T08:06:02.368 INFO:tasks.workunit.client.1.smithi194.stdout:4/82: dread - d0/df/f13 zero size 2024-02-20T08:06:02.373 INFO:tasks.workunit.client.1.smithi194.stdout:4/83: dread d0/d2/fb [0,4194304] 0 2024-02-20T08:06:02.377 INFO:tasks.workunit.client.1.smithi194.stdout:1/127: write d2/d8/f11 [1346110,84826] 0 2024-02-20T08:06:02.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/112: creat d11/d15/f21 x:0 0 0 2024-02-20T08:06:02.380 INFO:tasks.workunit.client.1.smithi194.stdout:7/113: fsync d11/d15/f1c 0 2024-02-20T08:06:02.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/84: dwrite d0/d2/fb [4194304,4194304] 0 2024-02-20T08:06:02.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/85: chown d0/d2/ca 14370 1 2024-02-20T08:06:02.382 INFO:tasks.workunit.client.1.smithi194.stdout:9/151: symlink d4/l33 0 2024-02-20T08:06:02.384 INFO:tasks.workunit.client.1.smithi194.stdout:3/106: creat d5/d10/d17/d1d/f20 x:0 0 0 2024-02-20T08:06:02.385 INFO:tasks.workunit.client.1.smithi194.stdout:3/107: write f4 [3180495,40754] 0 2024-02-20T08:06:02.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/129: creat d2/f2d x:0 0 0 2024-02-20T08:06:02.388 INFO:tasks.workunit.client.1.smithi194.stdout:1/128: truncate d2/f9 1069070 0 2024-02-20T08:06:02.388 INFO:tasks.workunit.client.1.smithi194.stdout:9/152: dread d4/de/f1e [0,4194304] 0 2024-02-20T08:06:02.389 INFO:tasks.workunit.client.1.smithi194.stdout:1/129: read d2/f7 [100240,38292] 0 2024-02-20T08:06:02.390 INFO:tasks.workunit.client.1.smithi194.stdout:9/153: chown d4/d1b/f1d 496490915 1 2024-02-20T08:06:02.390 INFO:tasks.workunit.client.1.smithi194.stdout:7/114: write fe [633858,26086] 0 2024-02-20T08:06:02.391 INFO:tasks.workunit.client.1.smithi194.stdout:9/154: chown d4/d7/f11 3094724 1 2024-02-20T08:06:02.403 INFO:tasks.workunit.client.1.smithi194.stdout:4/86: link d0/df/f13 d0/df/f14 0 2024-02-20T08:06:02.417 INFO:tasks.workunit.client.1.smithi194.stdout:0/83: sync 2024-02-20T08:06:02.423 INFO:tasks.workunit.client.1.smithi194.stdout:7/115: dwrite f3 [0,4194304] 0 2024-02-20T08:06:02.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/87: fdatasync d0/d2/fb 0 2024-02-20T08:06:02.423 INFO:tasks.workunit.client.1.smithi194.stdout:0/84: chown l5 53 1 2024-02-20T08:06:02.431 INFO:tasks.workunit.client.1.smithi194.stdout:3/108: link d5/d10/l19 d5/d10/d16/l21 0 2024-02-20T08:06:02.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/85: fdatasync d6/d8/f11 0 2024-02-20T08:06:02.434 INFO:tasks.workunit.client.1.smithi194.stdout:7/116: creat d11/d15/d20/f22 x:0 0 0 2024-02-20T08:06:02.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/88: dwrite d0/f3 [0,4194304] 0 2024-02-20T08:06:02.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/155: getdents d4/d7/d28 0 2024-02-20T08:06:02.435 INFO:tasks.workunit.client.1.smithi194.stdout:9/156: chown d4/d1b/f21 27354 1 2024-02-20T08:06:02.436 INFO:tasks.workunit.client.1.smithi194.stdout:9/157: write d4/d20/f22 [161888,31515] 0 2024-02-20T08:06:02.451 INFO:tasks.workunit.client.1.smithi194.stdout:3/109: rename d5/fb to d5/d10/d17/d1d/f22 0 2024-02-20T08:06:02.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/158: write d4/d1b/f21 [782168,81373] 0 2024-02-20T08:06:02.452 INFO:tasks.workunit.client.1.smithi194.stdout:4/89: fdatasync d0/f3 0 2024-02-20T08:06:02.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/117: read fd [1028778,35822] 0 2024-02-20T08:06:02.455 INFO:tasks.workunit.client.1.smithi194.stdout:1/130: dwrite d2/d8/fb [0,4194304] 0 2024-02-20T08:06:02.457 INFO:tasks.workunit.client.1.smithi194.stdout:3/110: dread d5/fa [0,4194304] 0 2024-02-20T08:06:02.458 INFO:tasks.workunit.client.1.smithi194.stdout:3/111: write d5/df/f11 [916059,83223] 0 2024-02-20T08:06:02.459 INFO:tasks.workunit.client.1.smithi194.stdout:3/112: fdatasync d5/df/f15 0 2024-02-20T08:06:02.490 INFO:tasks.workunit.client.1.smithi194.stdout:0/86: dwrite d6/f17 [0,4194304] 0 2024-02-20T08:06:02.495 INFO:tasks.workunit.client.1.smithi194.stdout:0/87: dread d6/d8/ff [0,4194304] 0 2024-02-20T08:06:02.495 INFO:tasks.workunit.client.1.smithi194.stdout:0/88: dread d6/f17 [4194304,4194304] 0 2024-02-20T08:06:02.497 INFO:tasks.workunit.client.1.smithi194.stdout:6/241: sync 2024-02-20T08:06:02.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/169: sync 2024-02-20T08:06:02.528 INFO:tasks.workunit.client.1.smithi194.stdout:8/130: sync 2024-02-20T08:06:02.528 INFO:tasks.workunit.client.1.smithi194.stdout:5/117: sync 2024-02-20T08:06:02.528 INFO:tasks.workunit.client.1.smithi194.stdout:8/131: readlink d2/d14/d18/l1a 0 2024-02-20T08:06:02.530 INFO:tasks.workunit.client.1.smithi194.stdout:5/118: dread - d4/d6/dd/f17 zero size 2024-02-20T08:06:02.531 INFO:tasks.workunit.client.1.smithi194.stdout:5/119: read d4/f9 [2298560,67795] 0 2024-02-20T08:06:02.702 INFO:tasks.workunit.client.1.smithi194.stdout:7/118: chown l2 8 1 2024-02-20T08:06:02.702 INFO:tasks.workunit.client.1.smithi194.stdout:7/119: truncate d11/d15/f1c 190104 0 2024-02-20T08:06:02.703 INFO:tasks.workunit.client.1.smithi194.stdout:1/131: chown d2/d8/dc/c22 6 1 2024-02-20T08:06:02.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/113: symlink d5/l23 0 2024-02-20T08:06:02.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/114: stat d5/d10/d17/d1d/f22 0 2024-02-20T08:06:02.708 INFO:tasks.workunit.client.1.smithi194.stdout:6/242: write df/d18/d19/d1d/d28/f2d [945919,105373] 0 2024-02-20T08:06:02.709 INFO:tasks.workunit.client.1.smithi194.stdout:2/170: chown df/d14/d24/c27 90 1 2024-02-20T08:06:02.710 INFO:tasks.workunit.client.1.smithi194.stdout:2/171: chown df/d14/d19/f23 3557812 1 2024-02-20T08:06:02.710 INFO:tasks.workunit.client.1.smithi194.stdout:8/132: creat d2/f2e x:0 0 0 2024-02-20T08:06:02.711 INFO:tasks.workunit.client.1.smithi194.stdout:5/120: symlink d4/d6/l1a 0 2024-02-20T08:06:02.713 INFO:tasks.workunit.client.1.smithi194.stdout:8/133: dread d2/d14/d18/f27 [0,4194304] 0 2024-02-20T08:06:02.714 INFO:tasks.workunit.client.1.smithi194.stdout:9/159: mkdir d4/d2d/d34 0 2024-02-20T08:06:02.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/120: mkdir d11/d15/d20/d23 0 2024-02-20T08:06:02.716 INFO:tasks.workunit.client.1.smithi194.stdout:6/243: dwrite df/d18/f40 [0,4194304] 0 2024-02-20T08:06:02.718 INFO:tasks.workunit.client.1.smithi194.stdout:6/244: write df/d18/d19/f1a [2679823,89351] 0 2024-02-20T08:06:02.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/132: dread d2/f9 [0,4194304] 0 2024-02-20T08:06:02.721 INFO:tasks.workunit.client.1.smithi194.stdout:5/121: dwrite d4/d6/dd/f17 [0,4194304] 0 2024-02-20T08:06:02.722 INFO:tasks.workunit.client.1.smithi194.stdout:3/115: creat d5/df/f24 x:0 0 0 2024-02-20T08:06:02.722 INFO:tasks.workunit.client.1.smithi194.stdout:1/133: chown d2/f13 28 1 2024-02-20T08:06:02.723 INFO:tasks.workunit.client.1.smithi194.stdout:3/116: write d5/d10/d17/d1d/f1e [599420,17178] 0 2024-02-20T08:06:02.724 INFO:tasks.workunit.client.1.smithi194.stdout:0/89: mknod d6/c19 0 2024-02-20T08:06:02.731 INFO:tasks.workunit.client.1.smithi194.stdout:8/134: rename d2/l1c to d2/d14/d18/l2f 0 2024-02-20T08:06:02.731 INFO:tasks.workunit.client.1.smithi194.stdout:8/135: dread - d2/d14/f2b zero size 2024-02-20T08:06:02.733 INFO:tasks.workunit.client.1.smithi194.stdout:7/121: fsync fd 0 2024-02-20T08:06:02.734 INFO:tasks.workunit.client.1.smithi194.stdout:4/90: link d0/fc d0/d2/f15 0 2024-02-20T08:06:02.734 INFO:tasks.workunit.client.1.smithi194.stdout:4/91: fsync d0/f3 0 2024-02-20T08:06:02.735 INFO:tasks.workunit.client.1.smithi194.stdout:4/92: truncate d0/df/f13 244538 0 2024-02-20T08:06:02.738 INFO:tasks.workunit.client.1.smithi194.stdout:6/245: mknod df/d42/c52 0 2024-02-20T08:06:02.739 INFO:tasks.workunit.client.1.smithi194.stdout:4/93: dread d0/f3 [0,4194304] 0 2024-02-20T08:06:02.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/134: creat d2/d8/df/f29 x:0 0 0 2024-02-20T08:06:02.747 INFO:tasks.workunit.client.1.smithi194.stdout:3/117: dwrite d5/fa [0,4194304] 0 2024-02-20T08:06:02.748 INFO:tasks.workunit.client.1.smithi194.stdout:3/118: write d5/fa [510933,30620] 0 2024-02-20T08:06:02.750 INFO:tasks.workunit.client.1.smithi194.stdout:3/119: write d5/d10/d17/d1d/f20 [377922,61102] 0 2024-02-20T08:06:02.752 INFO:tasks.workunit.client.1.smithi194.stdout:2/172: creat df/d14/d24/f35 x:0 0 0 2024-02-20T08:06:02.753 INFO:tasks.workunit.client.1.smithi194.stdout:2/173: write df/f21 [4539930,32249] 0 2024-02-20T08:06:02.754 INFO:tasks.workunit.client.1.smithi194.stdout:7/122: creat d11/d15/d20/d23/f24 x:0 0 0 2024-02-20T08:06:02.758 INFO:tasks.workunit.client.1.smithi194.stdout:3/120: mkdir d5/df/d25 0 2024-02-20T08:06:02.759 INFO:tasks.workunit.client.1.smithi194.stdout:7/123: dwrite d11/f12 [4194304,4194304] 0 2024-02-20T08:06:02.762 INFO:tasks.workunit.client.1.smithi194.stdout:3/121: dread f4 [0,4194304] 0 2024-02-20T08:06:02.763 INFO:tasks.workunit.client.1.smithi194.stdout:9/160: rename d4/d7/f1a to d4/f35 0 2024-02-20T08:06:02.763 INFO:tasks.workunit.client.1.smithi194.stdout:8/136: link d2/c8 d2/d14/d18/c30 0 2024-02-20T08:06:02.767 INFO:tasks.workunit.client.1.smithi194.stdout:0/90: getdents d6/d8 0 2024-02-20T08:06:02.768 INFO:tasks.workunit.client.1.smithi194.stdout:7/124: mkdir d11/d15/d25 0 2024-02-20T08:06:02.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/246: rename df/d18/c44 to df/d42/c53 0 2024-02-20T08:06:02.773 INFO:tasks.workunit.client.1.smithi194.stdout:3/122: symlink d5/d10/d17/d1d/l26 0 2024-02-20T08:06:02.773 INFO:tasks.workunit.client.1.smithi194.stdout:3/123: chown d5 106 1 2024-02-20T08:06:02.774 INFO:tasks.workunit.client.1.smithi194.stdout:8/137: creat d2/f31 x:0 0 0 2024-02-20T08:06:02.776 INFO:tasks.workunit.client.1.smithi194.stdout:2/174: mkdir df/d36 0 2024-02-20T08:06:02.777 INFO:tasks.workunit.client.1.smithi194.stdout:2/175: truncate df/f11 2409799 0 2024-02-20T08:06:02.778 INFO:tasks.workunit.client.1.smithi194.stdout:2/176: read df/d14/f22 [726341,84034] 0 2024-02-20T08:06:02.779 INFO:tasks.workunit.client.1.smithi194.stdout:2/177: truncate df/d14/d24/f2d 5007442 0 2024-02-20T08:06:02.779 INFO:tasks.workunit.client.1.smithi194.stdout:6/247: rmdir df/d18/d19/d1d/d28/d46 39 2024-02-20T08:06:02.783 INFO:tasks.workunit.client.1.smithi194.stdout:2/178: fsync df/d14/f22 0 2024-02-20T08:06:02.784 INFO:tasks.workunit.client.1.smithi194.stdout:3/124: creat d5/df/d25/f27 x:0 0 0 2024-02-20T08:06:02.785 INFO:tasks.workunit.client.1.smithi194.stdout:3/125: dread - d5/df/f24 zero size 2024-02-20T08:06:02.787 INFO:tasks.workunit.client.1.smithi194.stdout:1/135: rename d2/d8/d12/l15 to d2/l2a 0 2024-02-20T08:06:02.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/126: write f4 [1938299,116296] 0 2024-02-20T08:06:02.790 INFO:tasks.workunit.client.1.smithi194.stdout:2/179: link df/d14/l17 df/d14/d19/l37 0 2024-02-20T08:06:02.791 INFO:tasks.workunit.client.1.smithi194.stdout:3/127: write d5/d10/d16/f1a [813320,73499] 0 2024-02-20T08:06:02.792 INFO:tasks.workunit.client.1.smithi194.stdout:1/136: dread d2/d8/fb [0,4194304] 0 2024-02-20T08:06:02.795 INFO:tasks.workunit.client.1.smithi194.stdout:0/91: rename d6/d8/f12 to d6/f1a 0 2024-02-20T08:06:02.798 INFO:tasks.workunit.client.1.smithi194.stdout:2/180: dread df/d14/f1d [0,4194304] 0 2024-02-20T08:06:02.799 INFO:tasks.workunit.client.1.smithi194.stdout:3/128: dwrite d5/f1b [0,4194304] 0 2024-02-20T08:06:02.802 INFO:tasks.workunit.client.1.smithi194.stdout:1/137: creat d2/d8/d12/f2b x:0 0 0 2024-02-20T08:06:02.802 INFO:tasks.workunit.client.1.smithi194.stdout:7/125: dread fe [0,4194304] 0 2024-02-20T08:06:02.804 INFO:tasks.workunit.client.1.smithi194.stdout:0/92: dwrite d6/f18 [0,4194304] 0 2024-02-20T08:06:02.809 INFO:tasks.workunit.client.1.smithi194.stdout:1/138: rmdir d2/d1a/d26 39 2024-02-20T08:06:02.811 INFO:tasks.workunit.client.1.smithi194.stdout:7/126: creat d11/d15/d20/d23/f26 x:0 0 0 2024-02-20T08:06:02.816 INFO:tasks.workunit.client.1.smithi194.stdout:2/181: rmdir df/d36 0 2024-02-20T08:06:02.819 INFO:tasks.workunit.client.1.smithi194.stdout:2/182: dread df/f21 [0,4194304] 0 2024-02-20T08:06:02.820 INFO:tasks.workunit.client.1.smithi194.stdout:2/183: chown fe 113944255 1 2024-02-20T08:06:02.823 INFO:tasks.workunit.client.1.smithi194.stdout:2/184: dread df/f12 [4194304,4194304] 0 2024-02-20T08:06:02.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/127: rename d11/d15/d25 to d11/d15/d27 0 2024-02-20T08:06:02.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/139: rmdir d2/d1a/d26 39 2024-02-20T08:06:02.828 INFO:tasks.workunit.client.1.smithi194.stdout:3/129: getdents d5/d10/d17 0 2024-02-20T08:06:02.829 INFO:tasks.workunit.client.1.smithi194.stdout:7/128: fdatasync fe 0 2024-02-20T08:06:02.830 INFO:tasks.workunit.client.1.smithi194.stdout:7/129: write f3 [3891022,85892] 0 2024-02-20T08:06:02.833 INFO:tasks.workunit.client.1.smithi194.stdout:2/185: symlink df/l38 0 2024-02-20T08:06:02.833 INFO:tasks.workunit.client.1.smithi194.stdout:3/130: dread d5/f6 [0,4194304] 0 2024-02-20T08:06:02.835 INFO:tasks.workunit.client.1.smithi194.stdout:3/131: write d5/df/f15 [472548,83457] 0 2024-02-20T08:06:02.837 INFO:tasks.workunit.client.1.smithi194.stdout:2/186: mknod df/d14/d19/c39 0 2024-02-20T08:06:02.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/130: dwrite d11/f12 [0,4194304] 0 2024-02-20T08:06:02.847 INFO:tasks.workunit.client.1.smithi194.stdout:7/131: dwrite fd [0,4194304] 0 2024-02-20T08:06:02.849 INFO:tasks.workunit.client.1.smithi194.stdout:2/187: dwrite df/f12 [0,4194304] 0 2024-02-20T08:06:02.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/188: write df/d14/d19/f2a [53477,103353] 0 2024-02-20T08:06:02.851 INFO:tasks.workunit.client.1.smithi194.stdout:7/132: creat d11/d15/d20/f28 x:0 0 0 2024-02-20T08:06:02.855 INFO:tasks.workunit.client.1.smithi194.stdout:7/133: link d11/f1f d11/d15/d27/f29 0 2024-02-20T08:06:02.856 INFO:tasks.workunit.client.1.smithi194.stdout:7/134: readlink d11/d15/l17 0 2024-02-20T08:06:02.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/135: write f3 [2199914,51373] 0 2024-02-20T08:06:02.861 INFO:tasks.workunit.client.1.smithi194.stdout:7/136: symlink d11/l2a 0 2024-02-20T08:06:02.861 INFO:tasks.workunit.client.1.smithi194.stdout:7/137: chown d11/c16 53437185 1 2024-02-20T08:06:02.864 INFO:tasks.workunit.client.1.smithi194.stdout:7/138: dread fe [0,4194304] 0 2024-02-20T08:06:02.864 INFO:tasks.workunit.client.1.smithi194.stdout:7/139: stat d11/d15/d20 0 2024-02-20T08:06:02.866 INFO:tasks.workunit.client.1.smithi194.stdout:7/140: chown c7 1 1 2024-02-20T08:06:02.866 INFO:tasks.workunit.client.1.smithi194.stdout:7/141: stat d11/d15/d20/f22 0 2024-02-20T08:06:02.874 INFO:tasks.workunit.client.1.smithi194.stdout:8/138: truncate d2/d14/d18/f27 438183 0 2024-02-20T08:06:02.874 INFO:tasks.workunit.client.1.smithi194.stdout:7/142: dwrite d11/f1f [0,4194304] 0 2024-02-20T08:06:02.875 INFO:tasks.workunit.client.1.smithi194.stdout:5/122: truncate d4/d6/fa 9177413 0 2024-02-20T08:06:02.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/139: chown d2/d14/l20 1 1 2024-02-20T08:06:02.880 INFO:tasks.workunit.client.1.smithi194.stdout:3/132: getdents d5/d10/d17/d1d 0 2024-02-20T08:06:02.881 INFO:tasks.workunit.client.1.smithi194.stdout:5/123: symlink d4/d6/d11/d15/l1b 0 2024-02-20T08:06:02.882 INFO:tasks.workunit.client.1.smithi194.stdout:8/140: mknod d2/c32 0 2024-02-20T08:06:02.884 INFO:tasks.workunit.client.1.smithi194.stdout:8/141: read f1 [4323522,43267] 0 2024-02-20T08:06:02.887 INFO:tasks.workunit.client.1.smithi194.stdout:6/248: sync 2024-02-20T08:06:02.906 INFO:tasks.workunit.client.1.smithi194.stdout:4/94: dwrite d0/df/f13 [0,4194304] 0 2024-02-20T08:06:02.906 INFO:tasks.workunit.client.1.smithi194.stdout:5/124: write d4/d6/dd/f17 [5062018,126021] 0 2024-02-20T08:06:02.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/143: dwrite f5 [0,4194304] 0 2024-02-20T08:06:02.909 INFO:tasks.workunit.client.1.smithi194.stdout:8/142: read d2/f11 [1974895,111421] 0 2024-02-20T08:06:02.911 INFO:tasks.workunit.client.1.smithi194.stdout:9/161: dwrite d4/d7/f31 [0,4194304] 0 2024-02-20T08:06:02.911 INFO:tasks.workunit.client.1.smithi194.stdout:0/93: truncate d6/f18 1485401 0 2024-02-20T08:06:02.915 INFO:tasks.workunit.client.1.smithi194.stdout:2/189: getdents df 0 2024-02-20T08:06:02.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/162: readlink d4/d7/lf 0 2024-02-20T08:06:02.921 INFO:tasks.workunit.client.1.smithi194.stdout:1/140: dwrite d2/f7 [0,4194304] 0 2024-02-20T08:06:02.922 INFO:tasks.workunit.client.1.smithi194.stdout:4/95: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:02.924 INFO:tasks.workunit.client.1.smithi194.stdout:1/141: chown d2/d8/dc/f1f 2653 1 2024-02-20T08:06:02.924 INFO:tasks.workunit.client.1.smithi194.stdout:5/125: mkdir d4/d1c 0 2024-02-20T08:06:02.925 INFO:tasks.workunit.client.1.smithi194.stdout:2/190: dread df/f21 [0,4194304] 0 2024-02-20T08:06:02.926 INFO:tasks.workunit.client.1.smithi194.stdout:7/144: unlink fe 0 2024-02-20T08:06:02.927 INFO:tasks.workunit.client.1.smithi194.stdout:1/142: chown d2/d8/f11 462 1 2024-02-20T08:06:02.927 INFO:tasks.workunit.client.1.smithi194.stdout:5/126: write d4/f10 [333441,129816] 0 2024-02-20T08:06:02.928 INFO:tasks.workunit.client.1.smithi194.stdout:9/163: creat d4/d1b/f36 x:0 0 0 2024-02-20T08:06:02.930 INFO:tasks.workunit.client.1.smithi194.stdout:4/96: unlink d0/f3 0 2024-02-20T08:06:02.930 INFO:tasks.workunit.client.1.smithi194.stdout:2/191: write df/d14/d24/f35 [818610,55261] 0 2024-02-20T08:06:02.931 INFO:tasks.workunit.client.1.smithi194.stdout:7/145: truncate d11/d15/d20/d23/f26 948180 0 2024-02-20T08:06:02.931 INFO:tasks.workunit.client.1.smithi194.stdout:0/94: dread d6/f18 [0,4194304] 0 2024-02-20T08:06:02.932 INFO:tasks.workunit.client.1.smithi194.stdout:0/95: truncate d6/f18 2077708 0 2024-02-20T08:06:02.936 INFO:tasks.workunit.client.1.smithi194.stdout:1/143: creat d2/d8/d12/f2c x:0 0 0 2024-02-20T08:06:02.938 INFO:tasks.workunit.client.1.smithi194.stdout:2/192: mkdir df/d3a 0 2024-02-20T08:06:02.938 INFO:tasks.workunit.client.1.smithi194.stdout:7/146: stat f5 0 2024-02-20T08:06:02.939 INFO:tasks.workunit.client.1.smithi194.stdout:1/144: dread d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:02.940 INFO:tasks.workunit.client.1.smithi194.stdout:6/249: creat df/d18/d19/f54 x:0 0 0 2024-02-20T08:06:02.941 INFO:tasks.workunit.client.1.smithi194.stdout:7/147: dread d11/d15/d20/d23/f26 [0,4194304] 0 2024-02-20T08:06:02.942 INFO:tasks.workunit.client.1.smithi194.stdout:7/148: fdatasync d11/d15/d27/f29 0 2024-02-20T08:06:02.943 INFO:tasks.workunit.client.1.smithi194.stdout:9/164: mkdir d4/d37 0 2024-02-20T08:06:02.943 INFO:tasks.workunit.client.1.smithi194.stdout:4/97: mknod d0/d10/c16 0 2024-02-20T08:06:02.943 INFO:tasks.workunit.client.1.smithi194.stdout:9/165: readlink d4/l33 0 2024-02-20T08:06:02.945 INFO:tasks.workunit.client.1.smithi194.stdout:9/166: write d4/d7/f31 [3830556,112142] 0 2024-02-20T08:06:02.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/143: getdents d2/d14/d18 0 2024-02-20T08:06:02.947 INFO:tasks.workunit.client.1.smithi194.stdout:8/144: dread - d2/f2e zero size 2024-02-20T08:06:02.950 INFO:tasks.workunit.client.1.smithi194.stdout:2/193: dwrite df/f2b [0,4194304] 0 2024-02-20T08:06:02.952 INFO:tasks.workunit.client.1.smithi194.stdout:7/149: creat d11/d15/d27/f2b x:0 0 0 2024-02-20T08:06:02.958 INFO:tasks.workunit.client.1.smithi194.stdout:7/150: dwrite d11/d15/d27/f2b [0,4194304] 0 2024-02-20T08:06:02.959 INFO:tasks.workunit.client.1.smithi194.stdout:5/127: truncate f3 3782623 0 2024-02-20T08:06:02.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/128: chown d4/d6/c14 102 1 2024-02-20T08:06:02.960 INFO:tasks.workunit.client.1.smithi194.stdout:8/145: mknod d2/c33 0 2024-02-20T08:06:02.963 INFO:tasks.workunit.client.1.smithi194.stdout:3/133: sync 2024-02-20T08:06:02.963 INFO:tasks.workunit.client.1.smithi194.stdout:1/145: creat d2/d1a/d26/f2d x:0 0 0 2024-02-20T08:06:02.964 INFO:tasks.workunit.client.1.smithi194.stdout:5/129: dread d4/d6/dd/f17 [0,4194304] 0 2024-02-20T08:06:02.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/194: read df/d14/f1d [2983236,90432] 0 2024-02-20T08:06:02.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/130: chown d4/f9 2030339 1 2024-02-20T08:06:02.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/195: stat df/d14/f32 0 2024-02-20T08:06:02.966 INFO:tasks.workunit.client.1.smithi194.stdout:2/196: write df/d14/f22 [1233359,49729] 0 2024-02-20T08:06:02.967 INFO:tasks.workunit.client.1.smithi194.stdout:2/197: chown df/d3a 5430583 1 2024-02-20T08:06:02.967 INFO:tasks.workunit.client.1.smithi194.stdout:0/96: creat d6/d8/f1b x:0 0 0 2024-02-20T08:06:02.970 INFO:tasks.workunit.client.1.smithi194.stdout:2/198: dread df/d14/f1d [0,4194304] 0 2024-02-20T08:06:02.971 INFO:tasks.workunit.client.1.smithi194.stdout:2/199: write df/d14/f32 [710216,69539] 0 2024-02-20T08:06:02.976 INFO:tasks.workunit.client.1.smithi194.stdout:9/167: fsync d4/f19 0 2024-02-20T08:06:02.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/250: creat df/d18/f55 x:0 0 0 2024-02-20T08:06:02.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/251: read - df/d18/d19/f54 zero size 2024-02-20T08:06:02.979 INFO:tasks.workunit.client.1.smithi194.stdout:8/146: creat d2/d14/f34 x:0 0 0 2024-02-20T08:06:02.981 INFO:tasks.workunit.client.1.smithi194.stdout:5/131: symlink d4/d6/d11/d15/l1d 0 2024-02-20T08:06:02.983 INFO:tasks.workunit.client.1.smithi194.stdout:7/151: dread fd [0,4194304] 0 2024-02-20T08:06:02.984 INFO:tasks.workunit.client.1.smithi194.stdout:7/152: chown d11/d15/f1c 2098526700 1 2024-02-20T08:06:02.985 INFO:tasks.workunit.client.1.smithi194.stdout:6/252: dwrite df/d42/f4f [0,4194304] 0 2024-02-20T08:06:02.989 INFO:tasks.workunit.client.1.smithi194.stdout:4/98: truncate d0/df/f13 820323 0 2024-02-20T08:06:02.989 INFO:tasks.workunit.client.1.smithi194.stdout:9/168: dread d4/de/f1e [0,4194304] 0 2024-02-20T08:06:02.992 INFO:tasks.workunit.client.1.smithi194.stdout:3/134: mkdir d5/d10/d28 0 2024-02-20T08:06:02.993 INFO:tasks.workunit.client.1.smithi194.stdout:8/147: fdatasync f1 0 2024-02-20T08:06:02.995 INFO:tasks.workunit.client.1.smithi194.stdout:1/146: symlink d2/d1a/l2e 0 2024-02-20T08:06:02.995 INFO:tasks.workunit.client.1.smithi194.stdout:9/169: dwrite d4/d20/f22 [0,4194304] 0 2024-02-20T08:06:02.998 INFO:tasks.workunit.client.1.smithi194.stdout:5/132: rmdir d4/d6/dd 39 2024-02-20T08:06:02.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/200: symlink df/d3a/l3b 0 2024-02-20T08:06:03.004 INFO:tasks.workunit.client.1.smithi194.stdout:6/253: rmdir df/d18 39 2024-02-20T08:06:03.004 INFO:tasks.workunit.client.1.smithi194.stdout:6/254: chown fd 1642502 1 2024-02-20T08:06:03.010 INFO:tasks.workunit.client.1.smithi194.stdout:0/97: chown d6/d8/f15 120048653 1 2024-02-20T08:06:03.022 INFO:tasks.workunit.client.1.smithi194.stdout:3/135: read f4 [723228,18140] 0 2024-02-20T08:06:03.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/153: link d11/d15/d27/f2b d11/f2c 0 2024-02-20T08:06:03.037 INFO:tasks.workunit.client.1.smithi194.stdout:9/170: mkdir d4/d37/d38 0 2024-02-20T08:06:03.037 INFO:tasks.workunit.client.1.smithi194.stdout:9/171: stat d4/de 0 2024-02-20T08:06:03.038 INFO:tasks.workunit.client.1.smithi194.stdout:1/147: write d2/f9 [823031,74944] 0 2024-02-20T08:06:03.039 INFO:tasks.workunit.client.1.smithi194.stdout:2/201: symlink df/d14/d24/l3c 0 2024-02-20T08:06:03.040 INFO:tasks.workunit.client.1.smithi194.stdout:8/148: truncate d2/f1f 3516216 0 2024-02-20T08:06:03.041 INFO:tasks.workunit.client.1.smithi194.stdout:8/149: truncate d2/d14/f2c 369891 0 2024-02-20T08:06:03.042 INFO:tasks.workunit.client.1.smithi194.stdout:7/154: rename d11/d15/d20/d23 to d11/d2d 0 2024-02-20T08:06:03.043 INFO:tasks.workunit.client.1.smithi194.stdout:7/155: fdatasync f3 0 2024-02-20T08:06:03.044 INFO:tasks.workunit.client.1.smithi194.stdout:0/98: symlink d6/d8/l1c 0 2024-02-20T08:06:03.049 INFO:tasks.workunit.client.1.smithi194.stdout:0/99: dwrite d6/fe [4194304,4194304] 0 2024-02-20T08:06:03.055 INFO:tasks.workunit.client.1.smithi194.stdout:5/133: truncate f3 1478212 0 2024-02-20T08:06:03.062 INFO:tasks.workunit.client.1.smithi194.stdout:2/202: chown df/f21 0 1 2024-02-20T08:06:03.064 INFO:tasks.workunit.client.1.smithi194.stdout:8/150: rmdir d2/d14/d18 39 2024-02-20T08:06:03.068 INFO:tasks.workunit.client.1.smithi194.stdout:9/172: rename d4/c2f to d4/d37/d38/c39 0 2024-02-20T08:06:03.069 INFO:tasks.workunit.client.1.smithi194.stdout:7/156: fdatasync d11/d2d/f26 0 2024-02-20T08:06:03.075 INFO:tasks.workunit.client.1.smithi194.stdout:6/255: mknod df/d18/d19/d1d/d28/c56 0 2024-02-20T08:06:03.076 INFO:tasks.workunit.client.1.smithi194.stdout:6/256: fdatasync df/d18/d19/d1d/d28/f2d 0 2024-02-20T08:06:03.077 INFO:tasks.workunit.client.1.smithi194.stdout:6/257: dread - df/d18/f50 zero size 2024-02-20T08:06:03.079 INFO:tasks.workunit.client.1.smithi194.stdout:4/99: write d0/df/f14 [1019207,18744] 0 2024-02-20T08:06:03.081 INFO:tasks.workunit.client.1.smithi194.stdout:0/100: write d6/fc [5570144,112031] 0 2024-02-20T08:06:03.082 INFO:tasks.workunit.client.1.smithi194.stdout:0/101: dread - d6/d8/f1b zero size 2024-02-20T08:06:03.082 INFO:tasks.workunit.client.1.smithi194.stdout:3/136: link d5/l23 d5/df/d25/l29 0 2024-02-20T08:06:03.084 INFO:tasks.workunit.client.1.smithi194.stdout:2/203: rmdir df/d3a 39 2024-02-20T08:06:03.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/204: write df/d14/d19/f2a [339952,111963] 0 2024-02-20T08:06:03.086 INFO:tasks.workunit.client.1.smithi194.stdout:9/173: creat d4/d20/f3a x:0 0 0 2024-02-20T08:06:03.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/205: readlink df/d14/d19/l1e 0 2024-02-20T08:06:03.088 INFO:tasks.workunit.client.1.smithi194.stdout:7/157: rename d11/d15/d20 to d11/d2e 0 2024-02-20T08:06:03.089 INFO:tasks.workunit.client.1.smithi194.stdout:9/174: dread d4/d1b/f1d [0,4194304] 0 2024-02-20T08:06:03.092 INFO:tasks.workunit.client.1.smithi194.stdout:5/134: creat d4/d6/dd/f1e x:0 0 0 2024-02-20T08:06:03.092 INFO:tasks.workunit.client.1.smithi194.stdout:5/135: dread - d4/d6/f16 zero size 2024-02-20T08:06:03.094 INFO:tasks.workunit.client.1.smithi194.stdout:3/137: mknod d5/df/c2a 0 2024-02-20T08:06:03.094 INFO:tasks.workunit.client.1.smithi194.stdout:1/148: creat d2/d1a/f2f x:0 0 0 2024-02-20T08:06:03.097 INFO:tasks.workunit.client.1.smithi194.stdout:8/151: unlink d2/d14/d18/c19 0 2024-02-20T08:06:03.098 INFO:tasks.workunit.client.1.smithi194.stdout:5/136: dwrite d4/f9 [0,4194304] 0 2024-02-20T08:06:03.098 INFO:tasks.workunit.client.1.smithi194.stdout:8/152: write d2/d14/f34 [862641,61403] 0 2024-02-20T08:06:03.099 INFO:tasks.workunit.client.1.smithi194.stdout:3/138: dread d5/fa [0,4194304] 0 2024-02-20T08:06:03.100 INFO:tasks.workunit.client.1.smithi194.stdout:7/158: symlink d11/d15/d27/l2f 0 2024-02-20T08:06:03.102 INFO:tasks.workunit.client.1.smithi194.stdout:6/258: symlink df/d18/l57 0 2024-02-20T08:06:03.102 INFO:tasks.workunit.client.1.smithi194.stdout:9/175: creat d4/d7/d28/f3b x:0 0 0 2024-02-20T08:06:03.103 INFO:tasks.workunit.client.1.smithi194.stdout:9/176: chown d4/d37 23402549 1 2024-02-20T08:06:03.104 INFO:tasks.workunit.client.1.smithi194.stdout:9/177: fdatasync d4/f12 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:9/178: dread - d4/d7/d28/f3b zero size 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:1/149: creat d2/d8/d12/f30 x:0 0 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:2/206: symlink df/d14/d24/l3d 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:5/137: read d4/fc [1533681,26827] 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:8/153: creat d2/f35 x:0 0 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:3/139: symlink d5/d10/d16/l2b 0 2024-02-20T08:06:03.109 INFO:tasks.workunit.client.1.smithi194.stdout:8/154: write d2/f2d [829759,1823] 0 2024-02-20T08:06:03.110 INFO:tasks.workunit.client.1.smithi194.stdout:7/159: rename d11/d2d/f26 to d11/d15/f30 0 2024-02-20T08:06:03.113 INFO:tasks.workunit.client.1.smithi194.stdout:1/150: dwrite d2/f13 [0,4194304] 0 2024-02-20T08:06:03.118 INFO:tasks.workunit.client.1.smithi194.stdout:4/100: getdents d0/d10 0 2024-02-20T08:06:03.121 INFO:tasks.workunit.client.1.smithi194.stdout:5/138: truncate f3 652179 0 2024-02-20T08:06:03.122 INFO:tasks.workunit.client.1.smithi194.stdout:5/139: read - d4/f12 zero size 2024-02-20T08:06:03.128 INFO:tasks.workunit.client.1.smithi194.stdout:8/155: unlink d2/d14/d18/c30 0 2024-02-20T08:06:03.129 INFO:tasks.workunit.client.1.smithi194.stdout:4/101: dread d0/d2/fe [0,4194304] 0 2024-02-20T08:06:03.133 INFO:tasks.workunit.client.1.smithi194.stdout:1/151: symlink d2/l31 0 2024-02-20T08:06:03.133 INFO:tasks.workunit.client.1.smithi194.stdout:8/156: dwrite d2/fa [4194304,4194304] 0 2024-02-20T08:06:03.134 INFO:tasks.workunit.client.1.smithi194.stdout:6/259: getdents df/d42 0 2024-02-20T08:06:03.136 INFO:tasks.workunit.client.1.smithi194.stdout:8/157: chown d2/d14/d18/l1a 3812 1 2024-02-20T08:06:03.138 INFO:tasks.workunit.client.1.smithi194.stdout:9/179: rename d4/d7/f15 to d4/f3c 0 2024-02-20T08:06:03.139 INFO:tasks.workunit.client.1.smithi194.stdout:9/180: write d4/d7/f31 [4603325,74852] 0 2024-02-20T08:06:03.140 INFO:tasks.workunit.client.1.smithi194.stdout:0/102: write d6/d8/ff [1870074,123467] 0 2024-02-20T08:06:03.140 INFO:tasks.workunit.client.1.smithi194.stdout:4/102: creat d0/d10/f17 x:0 0 0 2024-02-20T08:06:03.141 INFO:tasks.workunit.client.1.smithi194.stdout:9/181: write d4/f32 [893018,116758] 0 2024-02-20T08:06:03.142 INFO:tasks.workunit.client.1.smithi194.stdout:1/152: creat d2/d1a/d26/f32 x:0 0 0 2024-02-20T08:06:03.143 INFO:tasks.workunit.client.1.smithi194.stdout:3/140: getdents d5/df/d25 0 2024-02-20T08:06:03.144 INFO:tasks.workunit.client.1.smithi194.stdout:1/153: write d2/d1a/d26/f2d [957679,24861] 0 2024-02-20T08:06:03.147 INFO:tasks.workunit.client.1.smithi194.stdout:3/141: dread f4 [0,4194304] 0 2024-02-20T08:06:03.148 INFO:tasks.workunit.client.1.smithi194.stdout:7/160: rename d11/d15/l1e to d11/d15/d27/l31 0 2024-02-20T08:06:03.149 INFO:tasks.workunit.client.1.smithi194.stdout:7/161: write d11/f1a [1367575,118117] 0 2024-02-20T08:06:03.150 INFO:tasks.workunit.client.1.smithi194.stdout:7/162: fsync d11/d2e/f22 0 2024-02-20T08:06:03.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/103: mkdir d0/df/d18 0 2024-02-20T08:06:03.154 INFO:tasks.workunit.client.1.smithi194.stdout:9/182: rmdir d4/d37/d38 39 2024-02-20T08:06:03.155 INFO:tasks.workunit.client.1.smithi194.stdout:4/104: truncate d0/d2/fb 8591313 0 2024-02-20T08:06:03.157 INFO:tasks.workunit.client.1.smithi194.stdout:1/154: creat d2/d8/df/f33 x:0 0 0 2024-02-20T08:06:03.158 INFO:tasks.workunit.client.1.smithi194.stdout:6/260: mknod df/d18/d19/d1d/d28/c58 0 2024-02-20T08:06:03.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/155: truncate d2/d8/d12/f30 956857 0 2024-02-20T08:06:03.160 INFO:tasks.workunit.client.1.smithi194.stdout:9/183: dwrite d4/d1b/f36 [0,4194304] 0 2024-02-20T08:06:03.161 INFO:tasks.workunit.client.1.smithi194.stdout:9/184: write d4/f5 [2842473,37078] 0 2024-02-20T08:06:03.161 INFO:tasks.workunit.client.1.smithi194.stdout:8/158: mknod d2/d14/c36 0 2024-02-20T08:06:03.163 INFO:tasks.workunit.client.1.smithi194.stdout:8/159: write d2/d14/f24 [3466612,112995] 0 2024-02-20T08:06:03.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/163: fsync f5 0 2024-02-20T08:06:03.170 INFO:tasks.workunit.client.1.smithi194.stdout:7/164: dread d11/d15/d27/f2b [0,4194304] 0 2024-02-20T08:06:03.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/261: creat df/d42/f59 x:0 0 0 2024-02-20T08:06:03.173 INFO:tasks.workunit.client.1.smithi194.stdout:1/156: write d2/d8/fb [3326209,65321] 0 2024-02-20T08:06:03.177 INFO:tasks.workunit.client.1.smithi194.stdout:9/185: symlink d4/d1b/l3d 0 2024-02-20T08:06:03.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/160: creat d2/f37 x:0 0 0 2024-02-20T08:06:03.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/186: dwrite d4/d20/f22 [0,4194304] 0 2024-02-20T08:06:03.183 INFO:tasks.workunit.client.1.smithi194.stdout:9/187: write d4/d20/f3a [262561,61820] 0 2024-02-20T08:06:03.184 INFO:tasks.workunit.client.1.smithi194.stdout:9/188: chown d4/d2d 19277654 1 2024-02-20T08:06:03.191 INFO:tasks.workunit.client.1.smithi194.stdout:7/165: mknod d11/c32 0 2024-02-20T08:06:03.194 INFO:tasks.workunit.client.1.smithi194.stdout:1/157: mkdir d2/d8/dc/d34 0 2024-02-20T08:06:03.196 INFO:tasks.workunit.client.1.smithi194.stdout:0/103: rename d6/c19 to d6/d8/c1d 0 2024-02-20T08:06:03.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/161: mknod d2/c38 0 2024-02-20T08:06:03.198 INFO:tasks.workunit.client.1.smithi194.stdout:0/104: dread - d6/d8/f1b zero size 2024-02-20T08:06:03.200 INFO:tasks.workunit.client.1.smithi194.stdout:4/105: creat d0/f19 x:0 0 0 2024-02-20T08:06:03.201 INFO:tasks.workunit.client.1.smithi194.stdout:6/262: mkdir df/d18/d19/d1d/d28/d46/d5a 0 2024-02-20T08:06:03.201 INFO:tasks.workunit.client.1.smithi194.stdout:4/106: read d0/df/f14 [921896,43963] 0 2024-02-20T08:06:03.203 INFO:tasks.workunit.client.1.smithi194.stdout:3/142: rename d5/d10/f14 to d5/d10/d16/f2c 0 2024-02-20T08:06:03.204 INFO:tasks.workunit.client.1.smithi194.stdout:2/207: sync 2024-02-20T08:06:03.204 INFO:tasks.workunit.client.1.smithi194.stdout:8/162: creat d2/f39 x:0 0 0 2024-02-20T08:06:03.209 INFO:tasks.workunit.client.1.smithi194.stdout:0/105: dwrite d6/d8/f16 [0,4194304] 0 2024-02-20T08:06:03.211 INFO:tasks.workunit.client.1.smithi194.stdout:6/263: rmdir df/d18/d19 39 2024-02-20T08:06:03.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/107: unlink d0/d10/f17 0 2024-02-20T08:06:03.212 INFO:tasks.workunit.client.1.smithi194.stdout:6/264: readlink df/d42/l43 0 2024-02-20T08:06:03.215 INFO:tasks.workunit.client.1.smithi194.stdout:0/106: dwrite d6/d8/ff [0,4194304] 0 2024-02-20T08:06:03.217 INFO:tasks.workunit.client.1.smithi194.stdout:3/143: creat d5/d10/d16/f2d x:0 0 0 2024-02-20T08:06:03.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/107: read d6/fe [6835863,2820] 0 2024-02-20T08:06:03.217 INFO:tasks.workunit.client.1.smithi194.stdout:3/144: readlink l0 0 2024-02-20T08:06:03.217 INFO:tasks.workunit.client.1.smithi194.stdout:2/208: stat df/l33 0 2024-02-20T08:06:03.219 INFO:tasks.workunit.client.1.smithi194.stdout:9/189: link d4/d7/f11 d4/d7/f3e 0 2024-02-20T08:06:03.220 INFO:tasks.workunit.client.1.smithi194.stdout:2/209: write df/d14/d19/f23 [4343184,80700] 0 2024-02-20T08:06:03.221 INFO:tasks.workunit.client.1.smithi194.stdout:9/190: write d4/d7/d28/f3b [404489,115380] 0 2024-02-20T08:06:03.222 INFO:tasks.workunit.client.1.smithi194.stdout:2/210: chown df/d14/d24/f35 1062066036 1 2024-02-20T08:06:03.227 INFO:tasks.workunit.client.1.smithi194.stdout:9/191: dread d4/d20/f22 [0,4194304] 0 2024-02-20T08:06:03.228 INFO:tasks.workunit.client.1.smithi194.stdout:4/108: dread d0/fc [0,4194304] 0 2024-02-20T08:06:03.229 INFO:tasks.workunit.client.1.smithi194.stdout:7/166: rename lc to d11/d15/d27/l33 0 2024-02-20T08:06:03.229 INFO:tasks.workunit.client.1.smithi194.stdout:7/167: chown d11/d2d 96 1 2024-02-20T08:06:03.241 INFO:tasks.workunit.client.1.smithi194.stdout:1/158: truncate d2/d8/dc/f1f 153047 0 2024-02-20T08:06:03.245 INFO:tasks.workunit.client.1.smithi194.stdout:5/140: sync 2024-02-20T08:06:03.245 INFO:tasks.workunit.client.1.smithi194.stdout:4/109: fsync d0/d2/fe 0 2024-02-20T08:06:03.250 INFO:tasks.workunit.client.1.smithi194.stdout:7/168: chown c10 40691 1 2024-02-20T08:06:03.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/108: mkdir d6/d8/d1e 0 2024-02-20T08:06:03.254 INFO:tasks.workunit.client.1.smithi194.stdout:6/265: dwrite df/d18/f33 [4194304,4194304] 0 2024-02-20T08:06:03.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/145: mknod d5/d10/d28/c2e 0 2024-02-20T08:06:03.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/146: readlink l0 0 2024-02-20T08:06:03.258 INFO:tasks.workunit.client.1.smithi194.stdout:2/211: symlink df/d14/l3e 0 2024-02-20T08:06:03.261 INFO:tasks.workunit.client.1.smithi194.stdout:3/147: dread d5/d10/d17/d1d/f1e [0,4194304] 0 2024-02-20T08:06:03.267 INFO:tasks.workunit.client.1.smithi194.stdout:7/169: symlink d11/d15/d27/l34 0 2024-02-20T08:06:03.268 INFO:tasks.workunit.client.1.smithi194.stdout:3/148: dwrite d5/d10/d16/f1a [0,4194304] 0 2024-02-20T08:06:03.268 INFO:tasks.workunit.client.1.smithi194.stdout:4/110: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:03.272 INFO:tasks.workunit.client.1.smithi194.stdout:3/149: read d5/df/f15 [252708,98198] 0 2024-02-20T08:06:03.273 INFO:tasks.workunit.client.1.smithi194.stdout:6/266: dread - df/d18/d19/f2c zero size 2024-02-20T08:06:03.274 INFO:tasks.workunit.client.1.smithi194.stdout:2/212: stat df/l38 0 2024-02-20T08:06:03.278 INFO:tasks.workunit.client.1.smithi194.stdout:0/109: dwrite d6/f18 [0,4194304] 0 2024-02-20T08:06:03.279 INFO:tasks.workunit.client.1.smithi194.stdout:4/111: dread d0/fc [0,4194304] 0 2024-02-20T08:06:03.280 INFO:tasks.workunit.client.1.smithi194.stdout:7/170: dwrite d11/d15/d27/f29 [0,4194304] 0 2024-02-20T08:06:03.281 INFO:tasks.workunit.client.1.smithi194.stdout:8/163: rename d2/d14/d18/l22 to d2/d14/l3a 0 2024-02-20T08:06:03.282 INFO:tasks.workunit.client.1.smithi194.stdout:8/164: dread - d2/f1e zero size 2024-02-20T08:06:03.284 INFO:tasks.workunit.client.1.smithi194.stdout:8/165: fsync d2/d14/f1b 0 2024-02-20T08:06:03.286 INFO:tasks.workunit.client.1.smithi194.stdout:9/192: getdents d4/d7 0 2024-02-20T08:06:03.286 INFO:tasks.workunit.client.1.smithi194.stdout:8/166: write f1 [1498766,109042] 0 2024-02-20T08:06:03.289 INFO:tasks.workunit.client.1.smithi194.stdout:0/110: dwrite d6/d8/ff [0,4194304] 0 2024-02-20T08:06:03.296 INFO:tasks.workunit.client.1.smithi194.stdout:9/193: dwrite d4/de/f2a [0,4194304] 0 2024-02-20T08:06:03.296 INFO:tasks.workunit.client.1.smithi194.stdout:7/171: unlink d11/d15/f1c 0 2024-02-20T08:06:03.298 INFO:tasks.workunit.client.1.smithi194.stdout:0/111: dread d6/d8/ff [0,4194304] 0 2024-02-20T08:06:03.299 INFO:tasks.workunit.client.1.smithi194.stdout:1/159: rename d2/d8/dc/c22 to d2/d8/df/c35 0 2024-02-20T08:06:03.299 INFO:tasks.workunit.client.1.smithi194.stdout:0/112: fsync d6/fc 0 2024-02-20T08:06:03.301 INFO:tasks.workunit.client.1.smithi194.stdout:0/113: chown d6/d8/f16 6 1 2024-02-20T08:06:03.302 INFO:tasks.workunit.client.1.smithi194.stdout:2/213: mknod df/c3f 0 2024-02-20T08:06:03.305 INFO:tasks.workunit.client.1.smithi194.stdout:7/172: dwrite d11/d2e/f22 [0,4194304] 0 2024-02-20T08:06:03.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/267: mknod df/d18/d19/d1d/d28/c5b 0 2024-02-20T08:06:03.307 INFO:tasks.workunit.client.1.smithi194.stdout:6/268: write df/d18/d19/f4a [98844,29194] 0 2024-02-20T08:06:03.309 INFO:tasks.workunit.client.1.smithi194.stdout:9/194: symlink d4/d7/d28/l3f 0 2024-02-20T08:06:03.310 INFO:tasks.workunit.client.1.smithi194.stdout:9/195: fdatasync d4/de/f16 0 2024-02-20T08:06:03.310 INFO:tasks.workunit.client.1.smithi194.stdout:9/196: stat d4/d20/l26 0 2024-02-20T08:06:03.313 INFO:tasks.workunit.client.1.smithi194.stdout:1/160: unlink d2/d8/cd 0 2024-02-20T08:06:03.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/214: chown df/l15 167216 1 2024-02-20T08:06:03.317 INFO:tasks.workunit.client.1.smithi194.stdout:2/215: write df/d14/d19/f2a [356715,54557] 0 2024-02-20T08:06:03.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/167: truncate d2/d14/d18/f27 1090870 0 2024-02-20T08:06:03.319 INFO:tasks.workunit.client.1.smithi194.stdout:7/173: fdatasync d11/d15/d27/f2b 0 2024-02-20T08:06:03.323 INFO:tasks.workunit.client.1.smithi194.stdout:2/216: dwrite df/d14/f32 [0,4194304] 0 2024-02-20T08:06:03.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/197: unlink d4/f32 0 2024-02-20T08:06:03.326 INFO:tasks.workunit.client.1.smithi194.stdout:0/114: mkdir d6/d8/d1e/d1f 0 2024-02-20T08:06:03.327 INFO:tasks.workunit.client.1.smithi194.stdout:7/174: dread d11/f1f [0,4194304] 0 2024-02-20T08:06:03.330 INFO:tasks.workunit.client.1.smithi194.stdout:6/269: mknod df/d18/d19/d1d/d28/d46/d5a/c5c 0 2024-02-20T08:06:03.333 INFO:tasks.workunit.client.1.smithi194.stdout:5/141: rename d4/d6/dd/f1e to d4/d6/f1f 0 2024-02-20T08:06:03.333 INFO:tasks.workunit.client.1.smithi194.stdout:3/150: rename d5 to d5/df/d2f 22 2024-02-20T08:06:03.339 INFO:tasks.workunit.client.1.smithi194.stdout:0/115: creat d6/d8/d1e/f20 x:0 0 0 2024-02-20T08:06:03.340 INFO:tasks.workunit.client.1.smithi194.stdout:9/198: dread d4/d7/fc [0,4194304] 0 2024-02-20T08:06:03.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/142: dwrite d4/d6/f16 [0,4194304] 0 2024-02-20T08:06:03.344 INFO:tasks.workunit.client.1.smithi194.stdout:3/151: dwrite d5/d10/d17/d1d/f20 [0,4194304] 0 2024-02-20T08:06:03.344 INFO:tasks.workunit.client.1.smithi194.stdout:8/168: rename d2/d14/f1b to d2/f3b 0 2024-02-20T08:06:03.347 INFO:tasks.workunit.client.1.smithi194.stdout:4/112: sync 2024-02-20T08:06:03.348 INFO:tasks.workunit.client.1.smithi194.stdout:4/113: dread - d0/f19 zero size 2024-02-20T08:06:03.349 INFO:tasks.workunit.client.1.smithi194.stdout:1/161: creat d2/f36 x:0 0 0 2024-02-20T08:06:03.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/162: stat d2/d8/dc/f19 0 2024-02-20T08:06:03.352 INFO:tasks.workunit.client.1.smithi194.stdout:3/152: dwrite d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:03.353 INFO:tasks.workunit.client.1.smithi194.stdout:9/199: rmdir d4/d7/d28 39 2024-02-20T08:06:03.356 INFO:tasks.workunit.client.1.smithi194.stdout:7/175: write d11/d15/d27/f2b [591891,58583] 0 2024-02-20T08:06:03.361 INFO:tasks.workunit.client.1.smithi194.stdout:3/153: dwrite d5/d10/d17/d1d/f20 [0,4194304] 0 2024-02-20T08:06:03.366 INFO:tasks.workunit.client.1.smithi194.stdout:4/114: rename d0/d2/f15 to d0/d2/f1a 0 2024-02-20T08:06:03.368 INFO:tasks.workunit.client.1.smithi194.stdout:4/115: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:03.368 INFO:tasks.workunit.client.1.smithi194.stdout:6/270: creat df/f5d x:0 0 0 2024-02-20T08:06:03.372 INFO:tasks.workunit.client.1.smithi194.stdout:1/163: unlink d2/d1a/l2e 0 2024-02-20T08:06:03.375 INFO:tasks.workunit.client.1.smithi194.stdout:1/164: dread d2/f7 [0,4194304] 0 2024-02-20T08:06:03.383 INFO:tasks.workunit.client.1.smithi194.stdout:9/200: dread d4/d7/f31 [4194304,4194304] 0 2024-02-20T08:06:03.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/217: rename df/c10 to df/c40 0 2024-02-20T08:06:03.391 INFO:tasks.workunit.client.1.smithi194.stdout:9/201: dread d4/de/f16 [0,4194304] 0 2024-02-20T08:06:03.391 INFO:tasks.workunit.client.1.smithi194.stdout:3/154: mkdir d5/df/d30 0 2024-02-20T08:06:03.392 INFO:tasks.workunit.client.1.smithi194.stdout:3/155: write d5/d10/d16/f2d [229033,105249] 0 2024-02-20T08:06:03.393 INFO:tasks.workunit.client.1.smithi194.stdout:6/271: unlink fd 0 2024-02-20T08:06:03.396 INFO:tasks.workunit.client.1.smithi194.stdout:4/116: creat d0/d2/f1b x:0 0 0 2024-02-20T08:06:03.398 INFO:tasks.workunit.client.1.smithi194.stdout:6/272: dwrite df/d18/d19/f4a [0,4194304] 0 2024-02-20T08:06:03.400 INFO:tasks.workunit.client.1.smithi194.stdout:1/165: rename d2/d8/la to d2/d8/df/l37 0 2024-02-20T08:06:03.401 INFO:tasks.workunit.client.1.smithi194.stdout:1/166: dread - d2/d1a/f2f zero size 2024-02-20T08:06:03.401 INFO:tasks.workunit.client.1.smithi194.stdout:1/167: dread - d2/d8/f25 zero size 2024-02-20T08:06:03.402 INFO:tasks.workunit.client.1.smithi194.stdout:0/116: truncate d6/f18 2407144 0 2024-02-20T08:06:03.403 INFO:tasks.workunit.client.1.smithi194.stdout:2/218: write df/f11 [2623701,42442] 0 2024-02-20T08:06:03.403 INFO:tasks.workunit.client.1.smithi194.stdout:2/219: chown df 0 1 2024-02-20T08:06:03.405 INFO:tasks.workunit.client.1.smithi194.stdout:7/176: write d11/f1f [1103123,4613] 0 2024-02-20T08:06:03.411 INFO:tasks.workunit.client.1.smithi194.stdout:9/202: dwrite d4/f5 [0,4194304] 0 2024-02-20T08:06:03.412 INFO:tasks.workunit.client.1.smithi194.stdout:8/169: dwrite d2/d14/d18/f27 [0,4194304] 0 2024-02-20T08:06:03.414 INFO:tasks.workunit.client.1.smithi194.stdout:4/117: mkdir d0/d10/d1c 0 2024-02-20T08:06:03.419 INFO:tasks.workunit.client.1.smithi194.stdout:2/220: rmdir df/d14/d24 39 2024-02-20T08:06:03.421 INFO:tasks.workunit.client.1.smithi194.stdout:7/177: creat d11/f35 x:0 0 0 2024-02-20T08:06:03.422 INFO:tasks.workunit.client.1.smithi194.stdout:7/178: write d11/f12 [6849017,48102] 0 2024-02-20T08:06:03.464 INFO:tasks.workunit.client.1.smithi194.stdout:5/143: sync 2024-02-20T08:06:03.469 INFO:tasks.workunit.client.1.smithi194.stdout:2/221: truncate df/f21 3215593 0 2024-02-20T08:06:03.473 INFO:tasks.workunit.client.1.smithi194.stdout:7/179: chown c7 17080 1 2024-02-20T08:06:03.473 INFO:tasks.workunit.client.1.smithi194.stdout:7/180: read - d11/d2d/f24 zero size 2024-02-20T08:06:03.480 INFO:tasks.workunit.client.1.smithi194.stdout:1/168: rename d2/f9 to d2/f38 0 2024-02-20T08:06:03.503 INFO:tasks.workunit.client.1.smithi194.stdout:3/156: dwrite d5/f8 [0,4194304] 0 2024-02-20T08:06:03.521 INFO:tasks.workunit.client.1.smithi194.stdout:9/203: sync 2024-02-20T08:06:03.521 INFO:tasks.workunit.client.1.smithi194.stdout:0/117: sync 2024-02-20T08:06:03.522 INFO:tasks.workunit.client.1.smithi194.stdout:0/118: chown d6/d8/f1b 130646879 1 2024-02-20T08:06:03.523 INFO:tasks.workunit.client.1.smithi194.stdout:0/119: fdatasync d6/d8/f1b 0 2024-02-20T08:06:03.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/118: write d0/fc [4254633,27645] 0 2024-02-20T08:06:03.696 INFO:tasks.workunit.client.1.smithi194.stdout:5/144: mkdir d4/d20 0 2024-02-20T08:06:03.697 INFO:tasks.workunit.client.1.smithi194.stdout:5/145: stat d4/fc 0 2024-02-20T08:06:03.697 INFO:tasks.workunit.client.1.smithi194.stdout:5/146: chown d4/d1c 2578 1 2024-02-20T08:06:03.697 INFO:tasks.workunit.client.1.smithi194.stdout:5/147: write d4/f12 [214402,100005] 0 2024-02-20T08:06:03.698 INFO:tasks.workunit.client.1.smithi194.stdout:7/181: fdatasync d11/f14 0 2024-02-20T08:06:03.700 INFO:tasks.workunit.client.1.smithi194.stdout:7/182: truncate d11/d15/f30 1488471 0 2024-02-20T08:06:03.700 INFO:tasks.workunit.client.1.smithi194.stdout:8/170: creat d2/d14/f3c x:0 0 0 2024-02-20T08:06:03.701 INFO:tasks.workunit.client.1.smithi194.stdout:6/273: getdents df/d18/d19/d1d/d28 0 2024-02-20T08:06:03.702 INFO:tasks.workunit.client.1.smithi194.stdout:8/171: truncate d2/f31 38593 0 2024-02-20T08:06:03.702 INFO:tasks.workunit.client.1.smithi194.stdout:6/274: write df/d18/d19/f1a [3562551,112506] 0 2024-02-20T08:06:03.703 INFO:tasks.workunit.client.1.smithi194.stdout:1/169: mknod d2/d1a/d26/c39 0 2024-02-20T08:06:03.703 INFO:tasks.workunit.client.1.smithi194.stdout:3/157: mknod d5/df/c31 0 2024-02-20T08:06:03.704 INFO:tasks.workunit.client.1.smithi194.stdout:9/204: symlink d4/d1b/d2e/l40 0 2024-02-20T08:06:03.705 INFO:tasks.workunit.client.1.smithi194.stdout:4/119: fsync d0/df/f13 0 2024-02-20T08:06:03.707 INFO:tasks.workunit.client.1.smithi194.stdout:3/158: dread d5/f8 [0,4194304] 0 2024-02-20T08:06:03.708 INFO:tasks.workunit.client.1.smithi194.stdout:7/183: mknod d11/d15/c36 0 2024-02-20T08:06:03.711 INFO:tasks.workunit.client.1.smithi194.stdout:3/159: dread d5/d10/d16/f1a [0,4194304] 0 2024-02-20T08:06:03.711 INFO:tasks.workunit.client.1.smithi194.stdout:0/120: symlink d6/d8/l21 0 2024-02-20T08:06:03.711 INFO:tasks.workunit.client.1.smithi194.stdout:7/184: dread f3 [4194304,4194304] 0 2024-02-20T08:06:03.712 INFO:tasks.workunit.client.1.smithi194.stdout:9/205: mkdir d4/d20/d41 0 2024-02-20T08:06:03.714 INFO:tasks.workunit.client.1.smithi194.stdout:2/222: creat df/f41 x:0 0 0 2024-02-20T08:06:03.716 INFO:tasks.workunit.client.1.smithi194.stdout:8/172: mknod d2/d14/c3d 0 2024-02-20T08:06:03.716 INFO:tasks.workunit.client.1.smithi194.stdout:8/173: stat f1 0 2024-02-20T08:06:03.718 INFO:tasks.workunit.client.1.smithi194.stdout:3/160: symlink d5/df/l32 0 2024-02-20T08:06:03.719 INFO:tasks.workunit.client.1.smithi194.stdout:7/185: mkdir d11/d2e/d37 0 2024-02-20T08:06:03.720 INFO:tasks.workunit.client.1.smithi194.stdout:9/206: mkdir d4/d2d/d42 0 2024-02-20T08:06:03.720 INFO:tasks.workunit.client.1.smithi194.stdout:4/120: creat d0/df/d18/f1d x:0 0 0 2024-02-20T08:06:03.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/161: mknod d5/df/c33 0 2024-02-20T08:06:03.725 INFO:tasks.workunit.client.1.smithi194.stdout:4/121: write d0/d2/f1a [808521,107784] 0 2024-02-20T08:06:03.726 INFO:tasks.workunit.client.1.smithi194.stdout:8/174: dwrite d2/d14/d18/f27 [4194304,4194304] 0 2024-02-20T08:06:03.731 INFO:tasks.workunit.client.1.smithi194.stdout:8/175: fdatasync d2/d14/f24 0 2024-02-20T08:06:03.731 INFO:tasks.workunit.client.1.smithi194.stdout:2/223: getdents df/d14 0 2024-02-20T08:06:03.732 INFO:tasks.workunit.client.1.smithi194.stdout:0/121: dwrite d6/d8/f15 [0,4194304] 0 2024-02-20T08:06:03.733 INFO:tasks.workunit.client.1.smithi194.stdout:7/186: dread d11/f2c [0,4194304] 0 2024-02-20T08:06:03.734 INFO:tasks.workunit.client.1.smithi194.stdout:4/122: truncate d0/df/d18/f1d 801800 0 2024-02-20T08:06:03.735 INFO:tasks.workunit.client.1.smithi194.stdout:3/162: dread d5/d10/d17/d1d/f1e [0,4194304] 0 2024-02-20T08:06:03.735 INFO:tasks.workunit.client.1.smithi194.stdout:7/187: stat f5 0 2024-02-20T08:06:03.735 INFO:tasks.workunit.client.1.smithi194.stdout:9/207: dwrite d4/d1b/f36 [0,4194304] 0 2024-02-20T08:06:03.736 INFO:tasks.workunit.client.1.smithi194.stdout:8/176: write d2/f2e [313980,118585] 0 2024-02-20T08:06:03.739 INFO:tasks.workunit.client.1.smithi194.stdout:4/123: chown d0/d2/fb 7492 1 2024-02-20T08:06:03.740 INFO:tasks.workunit.client.1.smithi194.stdout:9/208: write d4/d1b/f36 [2858688,73775] 0 2024-02-20T08:06:03.742 INFO:tasks.workunit.client.1.smithi194.stdout:3/163: creat d5/f34 x:0 0 0 2024-02-20T08:06:03.745 INFO:tasks.workunit.client.1.smithi194.stdout:8/177: symlink d2/d14/d18/l3e 0 2024-02-20T08:06:03.751 INFO:tasks.workunit.client.1.smithi194.stdout:9/209: dwrite d4/de/f27 [0,4194304] 0 2024-02-20T08:06:03.751 INFO:tasks.workunit.client.1.smithi194.stdout:4/124: dwrite d0/d2/f1b [0,4194304] 0 2024-02-20T08:06:03.754 INFO:tasks.workunit.client.1.smithi194.stdout:3/164: mknod d5/d10/d28/c35 0 2024-02-20T08:06:03.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/178: readlink d2/l23 0 2024-02-20T08:06:03.759 INFO:tasks.workunit.client.1.smithi194.stdout:4/125: dread d0/d2/fb [4194304,4194304] 0 2024-02-20T08:06:03.760 INFO:tasks.workunit.client.1.smithi194.stdout:8/179: chown d2/fa 114 1 2024-02-20T08:06:03.760 INFO:tasks.workunit.client.1.smithi194.stdout:8/180: fdatasync d2/f1e 0 2024-02-20T08:06:03.760 INFO:tasks.workunit.client.1.smithi194.stdout:0/122: rename d6/d8/d1e/f20 to d6/f22 0 2024-02-20T08:06:03.762 INFO:tasks.workunit.client.1.smithi194.stdout:9/210: mkdir d4/d20/d43 0 2024-02-20T08:06:03.762 INFO:tasks.workunit.client.1.smithi194.stdout:9/211: chown d4/f19 6 1 2024-02-20T08:06:03.777 INFO:tasks.workunit.client.1.smithi194.stdout:3/165: creat d5/df/d30/f36 x:0 0 0 2024-02-20T08:06:03.778 INFO:tasks.workunit.client.1.smithi194.stdout:0/123: fsync d6/d8/f11 0 2024-02-20T08:06:03.779 INFO:tasks.workunit.client.1.smithi194.stdout:9/212: creat d4/d2d/d34/f44 x:0 0 0 2024-02-20T08:06:03.784 INFO:tasks.workunit.client.1.smithi194.stdout:3/166: dread d5/fa [0,4194304] 0 2024-02-20T08:06:03.786 INFO:tasks.workunit.client.1.smithi194.stdout:9/213: dwrite d4/d7/f8 [0,4194304] 0 2024-02-20T08:06:03.791 INFO:tasks.workunit.client.1.smithi194.stdout:9/214: creat d4/d1b/d2e/f45 x:0 0 0 2024-02-20T08:06:03.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/170: getdents d2/d1a/d26 0 2024-02-20T08:06:03.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/171: dread - d2/d1a/f2f zero size 2024-02-20T08:06:03.794 INFO:tasks.workunit.client.1.smithi194.stdout:9/215: unlink d4/d20/f22 0 2024-02-20T08:06:03.795 INFO:tasks.workunit.client.1.smithi194.stdout:9/216: read - d4/f35 zero size 2024-02-20T08:06:03.795 INFO:tasks.workunit.client.1.smithi194.stdout:9/217: chown d4/d20/l26 25 1 2024-02-20T08:06:03.797 INFO:tasks.workunit.client.1.smithi194.stdout:1/172: mkdir d2/d3a 0 2024-02-20T08:06:03.797 INFO:tasks.workunit.client.1.smithi194.stdout:4/126: write d0/df/f13 [1107599,88702] 0 2024-02-20T08:06:03.799 INFO:tasks.workunit.client.1.smithi194.stdout:1/173: rmdir d2/d8/dc 39 2024-02-20T08:06:03.801 INFO:tasks.workunit.client.1.smithi194.stdout:4/127: rmdir d0/d10 39 2024-02-20T08:06:03.804 INFO:tasks.workunit.client.1.smithi194.stdout:4/128: truncate d0/d2/fe 610225 0 2024-02-20T08:06:03.807 INFO:tasks.workunit.client.1.smithi194.stdout:4/129: link d0/d2/f1b d0/d2/f1e 0 2024-02-20T08:06:03.809 INFO:tasks.workunit.client.1.smithi194.stdout:4/130: creat d0/d2/f1f x:0 0 0 2024-02-20T08:06:03.811 INFO:tasks.workunit.client.1.smithi194.stdout:8/181: rmdir d2/d14 39 2024-02-20T08:06:03.811 INFO:tasks.workunit.client.1.smithi194.stdout:2/224: truncate df/d14/f1d 2379865 0 2024-02-20T08:06:03.813 INFO:tasks.workunit.client.1.smithi194.stdout:2/225: symlink df/d14/d19/l42 0 2024-02-20T08:06:03.813 INFO:tasks.workunit.client.1.smithi194.stdout:2/226: chown c9 0 1 2024-02-20T08:06:03.813 INFO:tasks.workunit.client.1.smithi194.stdout:7/188: truncate d11/f1f 2602573 0 2024-02-20T08:06:03.815 INFO:tasks.workunit.client.1.smithi194.stdout:8/182: mknod d2/d14/c3f 0 2024-02-20T08:06:03.817 INFO:tasks.workunit.client.1.smithi194.stdout:0/124: rename d6/f22 to d6/d8/d1e/f23 0 2024-02-20T08:06:03.819 INFO:tasks.workunit.client.1.smithi194.stdout:0/125: stat d6/f1a 0 2024-02-20T08:06:03.819 INFO:tasks.workunit.client.1.smithi194.stdout:8/183: creat d2/d14/d18/f40 x:0 0 0 2024-02-20T08:06:03.820 INFO:tasks.workunit.client.1.smithi194.stdout:4/131: rename d0/df/d18/f1d to d0/d2/f20 0 2024-02-20T08:06:03.820 INFO:tasks.workunit.client.1.smithi194.stdout:2/227: dwrite df/f2b [0,4194304] 0 2024-02-20T08:06:03.821 INFO:tasks.workunit.client.1.smithi194.stdout:1/174: dread d2/d8/dc/f14 [0,4194304] 0 2024-02-20T08:06:03.822 INFO:tasks.workunit.client.1.smithi194.stdout:2/228: fsync df/d14/d24/f35 0 2024-02-20T08:06:03.825 INFO:tasks.workunit.client.1.smithi194.stdout:7/189: rename d11/d2e to d11/d2d/d38 0 2024-02-20T08:06:03.825 INFO:tasks.workunit.client.1.smithi194.stdout:0/126: dread d6/d8/f16 [0,4194304] 0 2024-02-20T08:06:03.826 INFO:tasks.workunit.client.1.smithi194.stdout:4/132: unlink d0/d2/f1e 0 2024-02-20T08:06:03.826 INFO:tasks.workunit.client.1.smithi194.stdout:7/190: write d11/d2d/d38/f22 [1275015,9798] 0 2024-02-20T08:06:03.830 INFO:tasks.workunit.client.1.smithi194.stdout:3/167: write d5/fa [3376502,2614] 0 2024-02-20T08:06:03.833 INFO:tasks.workunit.client.1.smithi194.stdout:7/191: dwrite d11/f35 [0,4194304] 0 2024-02-20T08:06:03.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/229: read df/f12 [2433757,40035] 0 2024-02-20T08:06:03.834 INFO:tasks.workunit.client.1.smithi194.stdout:7/192: chown d11/f1a 129347 1 2024-02-20T08:06:03.841 INFO:tasks.workunit.client.1.smithi194.stdout:3/168: dwrite d5/df/d25/f27 [0,4194304] 0 2024-02-20T08:06:03.843 INFO:tasks.workunit.client.1.smithi194.stdout:3/169: fsync d5/df/d30/f36 0 2024-02-20T08:06:03.848 INFO:tasks.workunit.client.1.smithi194.stdout:2/230: dwrite df/d14/f22 [0,4194304] 0 2024-02-20T08:06:03.848 INFO:tasks.workunit.client.1.smithi194.stdout:8/184: creat d2/f41 x:0 0 0 2024-02-20T08:06:03.849 INFO:tasks.workunit.client.1.smithi194.stdout:2/231: readlink df/d14/d19/l1e 0 2024-02-20T08:06:03.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/232: write df/d14/d19/f2e [397225,19504] 0 2024-02-20T08:06:03.854 INFO:tasks.workunit.client.1.smithi194.stdout:5/148: sync 2024-02-20T08:06:03.860 INFO:tasks.workunit.client.1.smithi194.stdout:3/170: creat d5/f37 x:0 0 0 2024-02-20T08:06:03.861 INFO:tasks.workunit.client.1.smithi194.stdout:5/149: dwrite d4/f10 [0,4194304] 0 2024-02-20T08:06:03.863 INFO:tasks.workunit.client.1.smithi194.stdout:1/175: creat d2/d8/f3b x:0 0 0 2024-02-20T08:06:03.863 INFO:tasks.workunit.client.1.smithi194.stdout:1/176: readlink d2/d1a/l23 0 2024-02-20T08:06:03.867 INFO:tasks.workunit.client.1.smithi194.stdout:8/185: rmdir d2/d14/d18 39 2024-02-20T08:06:03.873 INFO:tasks.workunit.client.1.smithi194.stdout:0/127: creat d6/d8/f24 x:0 0 0 2024-02-20T08:06:03.873 INFO:tasks.workunit.client.1.smithi194.stdout:0/128: dread - d6/d8/f24 zero size 2024-02-20T08:06:03.874 INFO:tasks.workunit.client.1.smithi194.stdout:4/133: mkdir d0/d10/d1c/d21 0 2024-02-20T08:06:03.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/171: creat d5/d10/d17/f38 x:0 0 0 2024-02-20T08:06:03.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/172: read - d5/df/f24 zero size 2024-02-20T08:06:03.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/173: chown l0 1208 1 2024-02-20T08:06:03.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/174: write d5/fa [377858,27930] 0 2024-02-20T08:06:03.878 INFO:tasks.workunit.client.1.smithi194.stdout:6/275: sync 2024-02-20T08:06:03.879 INFO:tasks.workunit.client.1.smithi194.stdout:9/218: sync 2024-02-20T08:06:03.883 INFO:tasks.workunit.client.1.smithi194.stdout:3/175: dwrite d5/f1b [0,4194304] 0 2024-02-20T08:06:03.884 INFO:tasks.workunit.client.1.smithi194.stdout:3/176: chown d5/f34 789162 1 2024-02-20T08:06:03.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/193: fdatasync d11/d15/d27/f29 0 2024-02-20T08:06:03.885 INFO:tasks.workunit.client.1.smithi194.stdout:7/194: readlink d11/l2a 0 2024-02-20T08:06:03.886 INFO:tasks.workunit.client.1.smithi194.stdout:7/195: read - d11/d2d/f24 zero size 2024-02-20T08:06:03.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/186: mknod d2/c42 0 2024-02-20T08:06:03.898 INFO:tasks.workunit.client.1.smithi194.stdout:6/276: mkdir df/d18/d19/d1d/d28/d5e 0 2024-02-20T08:06:03.898 INFO:tasks.workunit.client.1.smithi194.stdout:6/277: readlink df/d18/d19/d1d/l3a 0 2024-02-20T08:06:03.899 INFO:tasks.workunit.client.1.smithi194.stdout:9/219: truncate d4/d7/f31 3783951 0 2024-02-20T08:06:03.902 INFO:tasks.workunit.client.1.smithi194.stdout:4/134: write d0/d2/fb [7385184,29643] 0 2024-02-20T08:06:03.905 INFO:tasks.workunit.client.1.smithi194.stdout:3/177: read d5/d10/d16/f1a [896923,62586] 0 2024-02-20T08:06:03.906 INFO:tasks.workunit.client.1.smithi194.stdout:1/177: creat d2/d8/f3c x:0 0 0 2024-02-20T08:06:03.907 INFO:tasks.workunit.client.1.smithi194.stdout:1/178: dread - d2/d8/d12/f2b zero size 2024-02-20T08:06:03.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/196: rename d11/f1b to d11/d15/d27/f39 0 2024-02-20T08:06:03.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/197: chown c10 15896419 1 2024-02-20T08:06:03.913 INFO:tasks.workunit.client.1.smithi194.stdout:2/233: getdents df/d14/d19 0 2024-02-20T08:06:03.916 INFO:tasks.workunit.client.1.smithi194.stdout:4/135: creat d0/d10/f22 x:0 0 0 2024-02-20T08:06:03.920 INFO:tasks.workunit.client.1.smithi194.stdout:1/179: mkdir d2/d1a/d26/d3d 0 2024-02-20T08:06:03.920 INFO:tasks.workunit.client.1.smithi194.stdout:1/180: chown d2/d1a/f1d 130523 1 2024-02-20T08:06:03.921 INFO:tasks.workunit.client.1.smithi194.stdout:3/178: write d5/d10/d16/f2c [4049226,111793] 0 2024-02-20T08:06:03.923 INFO:tasks.workunit.client.1.smithi194.stdout:7/198: creat d11/d2d/d38/f3a x:0 0 0 2024-02-20T08:06:03.928 INFO:tasks.workunit.client.1.smithi194.stdout:4/136: symlink d0/df/d18/l23 0 2024-02-20T08:06:03.928 INFO:tasks.workunit.client.1.smithi194.stdout:4/137: write d0/d2/f1a [552433,43110] 0 2024-02-20T08:06:03.928 INFO:tasks.workunit.client.1.smithi194.stdout:4/138: write d0/f19 [811390,78512] 0 2024-02-20T08:06:03.929 INFO:tasks.workunit.client.1.smithi194.stdout:7/199: mkdir d11/d3b 0 2024-02-20T08:06:03.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/129: sync 2024-02-20T08:06:03.930 INFO:tasks.workunit.client.1.smithi194.stdout:5/150: sync 2024-02-20T08:06:03.930 INFO:tasks.workunit.client.1.smithi194.stdout:6/278: mknod df/d18/d19/d1d/d28/d5e/c5f 0 2024-02-20T08:06:03.932 INFO:tasks.workunit.client.1.smithi194.stdout:2/234: fsync df/d14/f1d 0 2024-02-20T08:06:03.934 INFO:tasks.workunit.client.1.smithi194.stdout:1/181: write d2/d8/dc/f14 [3856567,35565] 0 2024-02-20T08:06:03.934 INFO:tasks.workunit.client.1.smithi194.stdout:4/139: dwrite d0/fc [0,4194304] 0 2024-02-20T08:06:03.938 INFO:tasks.workunit.client.1.smithi194.stdout:8/187: rename d2/ce to d2/c43 0 2024-02-20T08:06:03.940 INFO:tasks.workunit.client.1.smithi194.stdout:5/151: creat d4/f21 x:0 0 0 2024-02-20T08:06:03.941 INFO:tasks.workunit.client.1.smithi194.stdout:0/130: unlink d6/d8/ff 0 2024-02-20T08:06:03.942 INFO:tasks.workunit.client.1.smithi194.stdout:2/235: dwrite df/d14/f22 [0,4194304] 0 2024-02-20T08:06:03.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/131: dwrite d6/fc [4194304,4194304] 0 2024-02-20T08:06:03.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/132: chown d6/d8/l21 380772 1 2024-02-20T08:06:03.950 INFO:tasks.workunit.client.1.smithi194.stdout:9/220: rename d4/f3c to d4/d7/f46 0 2024-02-20T08:06:03.950 INFO:tasks.workunit.client.1.smithi194.stdout:7/200: mkdir d11/d2d/d38/d37/d3c 0 2024-02-20T08:06:03.952 INFO:tasks.workunit.client.1.smithi194.stdout:8/188: readlink d2/d14/d18/l3e 0 2024-02-20T08:06:03.954 INFO:tasks.workunit.client.1.smithi194.stdout:5/152: dread d4/fb [0,4194304] 0 2024-02-20T08:06:03.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/189: write d2/d14/f15 [323285,81256] 0 2024-02-20T08:06:03.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/190: fdatasync d2/f41 0 2024-02-20T08:06:03.962 INFO:tasks.workunit.client.1.smithi194.stdout:4/140: truncate d0/d2/fe 1124756 0 2024-02-20T08:06:03.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/236: write df/d14/f32 [4371478,20269] 0 2024-02-20T08:06:03.969 INFO:tasks.workunit.client.1.smithi194.stdout:2/237: chown fc 257685976 1 2024-02-20T08:06:03.969 INFO:tasks.workunit.client.1.smithi194.stdout:4/141: dwrite d0/df/f13 [0,4194304] 0 2024-02-20T08:06:03.970 INFO:tasks.workunit.client.1.smithi194.stdout:6/279: symlink df/d18/d19/d1d/d28/d2b/l60 0 2024-02-20T08:06:03.970 INFO:tasks.workunit.client.1.smithi194.stdout:4/142: stat d0/c12 0 2024-02-20T08:06:03.971 INFO:tasks.workunit.client.1.smithi194.stdout:6/280: chown df/f3c 490638 1 2024-02-20T08:06:03.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/133: dread d6/f18 [0,4194304] 0 2024-02-20T08:06:03.972 INFO:tasks.workunit.client.1.smithi194.stdout:3/179: rename d5/d10/l19 to d5/d10/d16/l39 0 2024-02-20T08:06:03.973 INFO:tasks.workunit.client.1.smithi194.stdout:9/221: creat d4/d20/d43/f47 x:0 0 0 2024-02-20T08:06:03.973 INFO:tasks.workunit.client.1.smithi194.stdout:2/238: write df/d14/d19/f2e [669552,33443] 0 2024-02-20T08:06:03.974 INFO:tasks.workunit.client.1.smithi194.stdout:7/201: creat d11/d3b/f3d x:0 0 0 2024-02-20T08:06:03.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/134: chown d6/d8/f15 1477 1 2024-02-20T08:06:03.975 INFO:tasks.workunit.client.1.smithi194.stdout:9/222: chown d4/d1b 0 1 2024-02-20T08:06:03.975 INFO:tasks.workunit.client.1.smithi194.stdout:1/182: rename d2/d1a/d26/d3d to d2/d1a/d26/d3d/d3e 22 2024-02-20T08:06:03.975 INFO:tasks.workunit.client.1.smithi194.stdout:8/191: mknod d2/c44 0 2024-02-20T08:06:03.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/180: fdatasync d5/f37 0 2024-02-20T08:06:03.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/281: truncate df/d42/f4d 22476 0 2024-02-20T08:06:03.977 INFO:tasks.workunit.client.1.smithi194.stdout:8/192: chown d2/d14/c36 0 1 2024-02-20T08:06:03.978 INFO:tasks.workunit.client.1.smithi194.stdout:9/223: chown d4/d1b/f36 2 1 2024-02-20T08:06:03.979 INFO:tasks.workunit.client.1.smithi194.stdout:0/135: unlink d6/d8/f11 0 2024-02-20T08:06:03.979 INFO:tasks.workunit.client.1.smithi194.stdout:8/193: stat d2/d14/f24 0 2024-02-20T08:06:03.980 INFO:tasks.workunit.client.1.smithi194.stdout:6/282: write df/d18/d19/f1a [5960130,126572] 0 2024-02-20T08:06:03.981 INFO:tasks.workunit.client.1.smithi194.stdout:0/136: chown d6/f17 1324 1 2024-02-20T08:06:03.981 INFO:tasks.workunit.client.1.smithi194.stdout:4/143: rename d0/d2/f20 to d0/df/d11/f24 0 2024-02-20T08:06:03.987 INFO:tasks.workunit.client.1.smithi194.stdout:3/181: dread d5/fa [0,4194304] 0 2024-02-20T08:06:03.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/202: dwrite d11/d2d/d38/f28 [0,4194304] 0 2024-02-20T08:06:03.990 INFO:tasks.workunit.client.1.smithi194.stdout:9/224: dread d4/d7/f8 [0,4194304] 0 2024-02-20T08:06:03.990 INFO:tasks.workunit.client.1.smithi194.stdout:3/182: stat d5/d10/d16/f2c 0 2024-02-20T08:06:03.991 INFO:tasks.workunit.client.1.smithi194.stdout:9/225: readlink d4/d7/lf 0 2024-02-20T08:06:03.992 INFO:tasks.workunit.client.1.smithi194.stdout:5/153: dwrite d4/fc [0,4194304] 0 2024-02-20T08:06:03.996 INFO:tasks.workunit.client.1.smithi194.stdout:9/226: read d4/d1b/f36 [1128721,26566] 0 2024-02-20T08:06:03.996 INFO:tasks.workunit.client.1.smithi194.stdout:4/144: mkdir d0/df/d25 0 2024-02-20T08:06:03.997 INFO:tasks.workunit.client.1.smithi194.stdout:1/183: creat d2/d1a/f3f x:0 0 0 2024-02-20T08:06:03.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/239: getdents df/d14/d19 0 2024-02-20T08:06:04.000 INFO:tasks.workunit.client.1.smithi194.stdout:1/184: read - d2/d8/df/f29 zero size 2024-02-20T08:06:04.001 INFO:tasks.workunit.client.1.smithi194.stdout:7/203: dwrite d11/f1f [0,4194304] 0 2024-02-20T08:06:04.002 INFO:tasks.workunit.client.1.smithi194.stdout:3/183: creat d5/d10/d16/f3a x:0 0 0 2024-02-20T08:06:04.007 INFO:tasks.workunit.client.1.smithi194.stdout:5/154: dread d4/f10 [0,4194304] 0 2024-02-20T08:06:04.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/227: dwrite d4/d1b/d2e/f30 [0,4194304] 0 2024-02-20T08:06:04.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/194: write d2/f11 [3061662,30023] 0 2024-02-20T08:06:04.013 INFO:tasks.workunit.client.1.smithi194.stdout:1/185: creat d2/d1a/d26/f40 x:0 0 0 2024-02-20T08:06:04.016 INFO:tasks.workunit.client.1.smithi194.stdout:8/195: dread d2/d14/d18/f27 [4194304,4194304] 0 2024-02-20T08:06:04.017 INFO:tasks.workunit.client.1.smithi194.stdout:7/204: chown d11/d15/d27/l33 337472 1 2024-02-20T08:06:04.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/137: rename d6/fe to d6/d8/f25 0 2024-02-20T08:06:04.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/283: link df/d18/f55 df/d18/d19/d1d/f61 0 2024-02-20T08:06:04.024 INFO:tasks.workunit.client.1.smithi194.stdout:3/184: rmdir d5 39 2024-02-20T08:06:04.027 INFO:tasks.workunit.client.1.smithi194.stdout:2/240: creat df/d3a/f43 x:0 0 0 2024-02-20T08:06:04.027 INFO:tasks.workunit.client.1.smithi194.stdout:2/241: readlink df/d14/d24/l3c 0 2024-02-20T08:06:04.034 INFO:tasks.workunit.client.1.smithi194.stdout:8/196: mkdir d2/d14/d18/d45 0 2024-02-20T08:06:04.035 INFO:tasks.workunit.client.1.smithi194.stdout:7/205: symlink d11/d15/l3e 0 2024-02-20T08:06:04.035 INFO:tasks.workunit.client.1.smithi194.stdout:8/197: chown d2/l23 1921261 1 2024-02-20T08:06:04.036 INFO:tasks.workunit.client.1.smithi194.stdout:1/186: dwrite d2/f38 [0,4194304] 0 2024-02-20T08:06:04.036 INFO:tasks.workunit.client.1.smithi194.stdout:8/198: write d2/f37 [946742,17175] 0 2024-02-20T08:06:04.037 INFO:tasks.workunit.client.1.smithi194.stdout:1/187: read d2/f13 [2474463,71103] 0 2024-02-20T08:06:04.037 INFO:tasks.workunit.client.1.smithi194.stdout:1/188: readlink d2/l31 0 2024-02-20T08:06:04.038 INFO:tasks.workunit.client.1.smithi194.stdout:4/145: rename d0 to d0/d26 22 2024-02-20T08:06:04.043 INFO:tasks.workunit.client.1.smithi194.stdout:5/155: mknod d4/d1c/c22 0 2024-02-20T08:06:04.044 INFO:tasks.workunit.client.1.smithi194.stdout:5/156: write d4/f12 [829659,31082] 0 2024-02-20T08:06:04.045 INFO:tasks.workunit.client.1.smithi194.stdout:5/157: fdatasync d4/fc 0 2024-02-20T08:06:04.051 INFO:tasks.workunit.client.1.smithi194.stdout:3/185: write f4 [3396401,99692] 0 2024-02-20T08:06:04.052 INFO:tasks.workunit.client.1.smithi194.stdout:1/189: creat d2/d8/d12/f41 x:0 0 0 2024-02-20T08:06:04.059 INFO:tasks.workunit.client.1.smithi194.stdout:4/146: dwrite d0/df/f13 [4194304,4194304] 0 2024-02-20T08:06:04.060 INFO:tasks.workunit.client.1.smithi194.stdout:5/158: mknod d4/d6/d11/d15/c23 0 2024-02-20T08:06:04.062 INFO:tasks.workunit.client.1.smithi194.stdout:2/242: mknod df/c44 0 2024-02-20T08:06:04.063 INFO:tasks.workunit.client.1.smithi194.stdout:7/206: symlink d11/d2d/d38/d37/d3c/l3f 0 2024-02-20T08:06:04.065 INFO:tasks.workunit.client.1.smithi194.stdout:8/199: mknod d2/d14/d18/d45/c46 0 2024-02-20T08:06:04.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/284: symlink df/d18/d19/d1d/d28/d2b/l62 0 2024-02-20T08:06:04.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/207: dwrite d11/d2d/d38/f22 [0,4194304] 0 2024-02-20T08:06:04.072 INFO:tasks.workunit.client.1.smithi194.stdout:3/186: dread d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:04.074 INFO:tasks.workunit.client.1.smithi194.stdout:5/159: unlink d4/d6/f16 0 2024-02-20T08:06:04.075 INFO:tasks.workunit.client.1.smithi194.stdout:2/243: rmdir df/d14/d24 39 2024-02-20T08:06:04.077 INFO:tasks.workunit.client.1.smithi194.stdout:8/200: chown d2/d14/c16 12551 1 2024-02-20T08:06:04.078 INFO:tasks.workunit.client.1.smithi194.stdout:8/201: readlink d2/d14/l17 0 2024-02-20T08:06:04.080 INFO:tasks.workunit.client.1.smithi194.stdout:6/285: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:04.081 INFO:tasks.workunit.client.1.smithi194.stdout:0/138: link d6/c14 d6/c26 0 2024-02-20T08:06:04.082 INFO:tasks.workunit.client.1.smithi194.stdout:9/228: sync 2024-02-20T08:06:04.082 INFO:tasks.workunit.client.1.smithi194.stdout:4/147: symlink d0/d10/d1c/d21/l27 0 2024-02-20T08:06:04.083 INFO:tasks.workunit.client.1.smithi194.stdout:0/139: dread - d6/d8/f24 zero size 2024-02-20T08:06:04.084 INFO:tasks.workunit.client.1.smithi194.stdout:7/208: mknod d11/d15/c40 0 2024-02-20T08:06:04.085 INFO:tasks.workunit.client.1.smithi194.stdout:9/229: write d4/d20/f3a [432068,126544] 0 2024-02-20T08:06:04.086 INFO:tasks.workunit.client.1.smithi194.stdout:1/190: dwrite d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:04.093 INFO:tasks.workunit.client.1.smithi194.stdout:0/140: rmdir d6 39 2024-02-20T08:06:04.094 INFO:tasks.workunit.client.1.smithi194.stdout:4/148: symlink d0/d10/d1c/d21/l28 0 2024-02-20T08:06:04.095 INFO:tasks.workunit.client.1.smithi194.stdout:9/230: symlink d4/d1b/d2e/l48 0 2024-02-20T08:06:04.096 INFO:tasks.workunit.client.1.smithi194.stdout:7/209: dwrite d11/d2d/d38/f28 [0,4194304] 0 2024-02-20T08:06:04.099 INFO:tasks.workunit.client.1.smithi194.stdout:1/191: fsync d2/d8/dc/f1f 0 2024-02-20T08:06:04.101 INFO:tasks.workunit.client.1.smithi194.stdout:8/202: rename d2/c42 to d2/c47 0 2024-02-20T08:06:04.102 INFO:tasks.workunit.client.1.smithi194.stdout:2/244: rename l4 to df/d14/d24/l45 0 2024-02-20T08:06:04.103 INFO:tasks.workunit.client.1.smithi194.stdout:9/231: mknod d4/d7/c49 0 2024-02-20T08:06:04.105 INFO:tasks.workunit.client.1.smithi194.stdout:1/192: dread d2/d8/d12/f30 [0,4194304] 0 2024-02-20T08:06:04.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/203: write f1 [3476981,68076] 0 2024-02-20T08:06:04.105 INFO:tasks.workunit.client.1.smithi194.stdout:5/160: link f3 d4/d1c/f24 0 2024-02-20T08:06:04.107 INFO:tasks.workunit.client.1.smithi194.stdout:5/161: fsync d4/fc 0 2024-02-20T08:06:04.108 INFO:tasks.workunit.client.1.smithi194.stdout:0/141: dread d6/d8/f16 [0,4194304] 0 2024-02-20T08:06:04.108 INFO:tasks.workunit.client.1.smithi194.stdout:8/204: chown d2/d14/d18/c1d 390 1 2024-02-20T08:06:04.108 INFO:tasks.workunit.client.1.smithi194.stdout:9/232: creat d4/d1b/f4a x:0 0 0 2024-02-20T08:06:04.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/149: link d0/d10/d1c/d21/l27 d0/d2/l29 0 2024-02-20T08:06:04.110 INFO:tasks.workunit.client.1.smithi194.stdout:0/142: write d6/fc [5205846,79275] 0 2024-02-20T08:06:04.111 INFO:tasks.workunit.client.1.smithi194.stdout:1/193: readlink d2/d8/df/l18 0 2024-02-20T08:06:04.113 INFO:tasks.workunit.client.1.smithi194.stdout:2/245: rename df/d14/d24/l34 to df/d14/d19/l46 0 2024-02-20T08:06:04.117 INFO:tasks.workunit.client.1.smithi194.stdout:8/205: dwrite d2/d14/f24 [0,4194304] 0 2024-02-20T08:06:04.117 INFO:tasks.workunit.client.1.smithi194.stdout:4/150: symlink d0/d10/d1c/l2a 0 2024-02-20T08:06:04.118 INFO:tasks.workunit.client.1.smithi194.stdout:0/143: creat d6/d8/d1e/f27 x:0 0 0 2024-02-20T08:06:04.121 INFO:tasks.workunit.client.1.smithi194.stdout:3/187: dwrite d5/df/f15 [0,4194304] 0 2024-02-20T08:06:04.122 INFO:tasks.workunit.client.1.smithi194.stdout:0/144: chown d6/d8/d1e/f23 991494 1 2024-02-20T08:06:04.124 INFO:tasks.workunit.client.1.smithi194.stdout:0/145: dread - d6/d8/d1e/f27 zero size 2024-02-20T08:06:04.124 INFO:tasks.workunit.client.1.smithi194.stdout:9/233: symlink d4/d7/l4b 0 2024-02-20T08:06:04.127 INFO:tasks.workunit.client.1.smithi194.stdout:9/234: fdatasync d4/d20/f3a 0 2024-02-20T08:06:04.131 INFO:tasks.workunit.client.1.smithi194.stdout:8/206: dread d2/f37 [0,4194304] 0 2024-02-20T08:06:04.132 INFO:tasks.workunit.client.1.smithi194.stdout:6/286: truncate df/d18/d19/d1d/d28/d2b/f51 2526686 0 2024-02-20T08:06:04.134 INFO:tasks.workunit.client.1.smithi194.stdout:7/210: dread d11/f14 [0,4194304] 0 2024-02-20T08:06:04.139 INFO:tasks.workunit.client.1.smithi194.stdout:5/162: write d4/d6/fa [2610983,42031] 0 2024-02-20T08:06:04.140 INFO:tasks.workunit.client.1.smithi194.stdout:1/194: rename d2/d8/f25 to d2/f42 0 2024-02-20T08:06:04.141 INFO:tasks.workunit.client.1.smithi194.stdout:1/195: write d2/d1a/d26/f40 [912536,6201] 0 2024-02-20T08:06:04.144 INFO:tasks.workunit.client.1.smithi194.stdout:4/151: link d0/d10/f22 d0/df/d11/f2b 0 2024-02-20T08:06:04.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/152: dread d0/df/f14 [4194304,4194304] 0 2024-02-20T08:06:04.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/153: stat d0/df/d11/f2b 0 2024-02-20T08:06:04.153 INFO:tasks.workunit.client.1.smithi194.stdout:0/146: creat d6/d8/f28 x:0 0 0 2024-02-20T08:06:04.153 INFO:tasks.workunit.client.1.smithi194.stdout:0/147: dread - d6/d8/f28 zero size 2024-02-20T08:06:04.153 INFO:tasks.workunit.client.1.smithi194.stdout:6/287: mkdir df/d18/d19/d1d/d28/d46/d5a/d63 0 2024-02-20T08:06:04.153 INFO:tasks.workunit.client.1.smithi194.stdout:0/148: stat d6/c26 0 2024-02-20T08:06:04.155 INFO:tasks.workunit.client.1.smithi194.stdout:0/149: write d6/d8/f28 [645578,116974] 0 2024-02-20T08:06:04.155 INFO:tasks.workunit.client.1.smithi194.stdout:6/288: write df/d18/f50 [721810,51646] 0 2024-02-20T08:06:04.156 INFO:tasks.workunit.client.1.smithi194.stdout:0/150: stat d6/d8/d1e/f27 0 2024-02-20T08:06:04.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/196: getdents d2/d3a 0 2024-02-20T08:06:04.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/197: chown d2/d8/d12/f2c 22 1 2024-02-20T08:06:04.164 INFO:tasks.workunit.client.1.smithi194.stdout:8/207: truncate d2/f11 341619 0 2024-02-20T08:06:04.164 INFO:tasks.workunit.client.1.smithi194.stdout:1/198: write d2/d1a/d26/f40 [717107,52974] 0 2024-02-20T08:06:04.166 INFO:tasks.workunit.client.1.smithi194.stdout:3/188: getdents d5/df 0 2024-02-20T08:06:04.167 INFO:tasks.workunit.client.1.smithi194.stdout:6/289: creat df/d18/d19/d1d/d28/d46/d5a/f64 x:0 0 0 2024-02-20T08:06:04.167 INFO:tasks.workunit.client.1.smithi194.stdout:3/189: dread - d5/d10/d17/f38 zero size 2024-02-20T08:06:04.169 INFO:tasks.workunit.client.1.smithi194.stdout:9/235: link d4/d7/d28/c29 d4/de/c4c 0 2024-02-20T08:06:04.170 INFO:tasks.workunit.client.1.smithi194.stdout:3/190: chown d5/d10/d17/d1d/f1e 995445 1 2024-02-20T08:06:04.170 INFO:tasks.workunit.client.1.smithi194.stdout:8/208: dwrite d2/fa [4194304,4194304] 0 2024-02-20T08:06:04.171 INFO:tasks.workunit.client.1.smithi194.stdout:4/154: symlink d0/l2c 0 2024-02-20T08:06:04.171 INFO:tasks.workunit.client.1.smithi194.stdout:7/211: truncate d11/f2c 473242 0 2024-02-20T08:06:04.174 INFO:tasks.workunit.client.1.smithi194.stdout:2/246: rename df/d14/d19/f20 to df/d14/f47 0 2024-02-20T08:06:04.178 INFO:tasks.workunit.client.1.smithi194.stdout:7/212: dwrite d11/d2d/d38/f22 [4194304,4194304] 0 2024-02-20T08:06:04.183 INFO:tasks.workunit.client.1.smithi194.stdout:1/199: creat d2/d8/d12/f43 x:0 0 0 2024-02-20T08:06:04.184 INFO:tasks.workunit.client.1.smithi194.stdout:7/213: dwrite f3 [0,4194304] 0 2024-02-20T08:06:04.187 INFO:tasks.workunit.client.1.smithi194.stdout:6/290: rmdir df 39 2024-02-20T08:06:04.198 INFO:tasks.workunit.client.1.smithi194.stdout:9/236: mkdir d4/d20/d4d 0 2024-02-20T08:06:04.199 INFO:tasks.workunit.client.1.smithi194.stdout:8/209: creat d2/d14/d18/f48 x:0 0 0 2024-02-20T08:06:04.207 INFO:tasks.workunit.client.1.smithi194.stdout:0/151: truncate d6/d8/f28 139525 0 2024-02-20T08:06:04.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/163: sync 2024-02-20T08:06:04.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/164: readlink d4/d6/d11/d15/l1d 0 2024-02-20T08:06:04.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/214: write f5 [490308,9991] 0 2024-02-20T08:06:04.226 INFO:tasks.workunit.client.1.smithi194.stdout:0/152: dwrite d6/d8/f16 [4194304,4194304] 0 2024-02-20T08:06:04.227 INFO:tasks.workunit.client.1.smithi194.stdout:1/200: creat d2/d8/dc/d34/f44 x:0 0 0 2024-02-20T08:06:04.228 INFO:tasks.workunit.client.1.smithi194.stdout:1/201: readlink d2/d8/dc/le 0 2024-02-20T08:06:04.229 INFO:tasks.workunit.client.1.smithi194.stdout:1/202: chown d2/d8/d12/l17 20896 1 2024-02-20T08:06:04.233 INFO:tasks.workunit.client.1.smithi194.stdout:5/165: mkdir d4/d6/dd/d25 0 2024-02-20T08:06:04.235 INFO:tasks.workunit.client.1.smithi194.stdout:3/191: link d5/df/c31 d5/d10/d17/d1d/c3b 0 2024-02-20T08:06:04.237 INFO:tasks.workunit.client.1.smithi194.stdout:4/155: creat d0/f2d x:0 0 0 2024-02-20T08:06:04.239 INFO:tasks.workunit.client.1.smithi194.stdout:7/215: dread d11/f12 [4194304,4194304] 0 2024-02-20T08:06:04.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/247: creat df/d14/d24/f48 x:0 0 0 2024-02-20T08:06:04.240 INFO:tasks.workunit.client.1.smithi194.stdout:7/216: chown d11/f1a 5802 1 2024-02-20T08:06:04.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/248: chown df/f11 130999551 1 2024-02-20T08:06:04.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/249: chown df/d14 666380532 1 2024-02-20T08:06:04.241 INFO:tasks.workunit.client.1.smithi194.stdout:6/291: write fe [333694,89596] 0 2024-02-20T08:06:04.242 INFO:tasks.workunit.client.1.smithi194.stdout:9/237: write d4/d7/f31 [1665290,26336] 0 2024-02-20T08:06:04.245 INFO:tasks.workunit.client.1.smithi194.stdout:0/153: unlink d6/d8/l21 0 2024-02-20T08:06:04.247 INFO:tasks.workunit.client.1.smithi194.stdout:1/203: rename d2/d3a to d2/d1a/d26/d45 0 2024-02-20T08:06:04.248 INFO:tasks.workunit.client.1.smithi194.stdout:8/210: creat d2/d14/f49 x:0 0 0 2024-02-20T08:06:04.248 INFO:tasks.workunit.client.1.smithi194.stdout:1/204: truncate d2/d8/d12/f2c 865282 0 2024-02-20T08:06:04.249 INFO:tasks.workunit.client.1.smithi194.stdout:1/205: write d2/d8/fb [3078744,35900] 0 2024-02-20T08:06:04.249 INFO:tasks.workunit.client.1.smithi194.stdout:7/217: symlink d11/l41 0 2024-02-20T08:06:04.250 INFO:tasks.workunit.client.1.smithi194.stdout:1/206: chown d2/d8/d12 18 1 2024-02-20T08:06:04.256 INFO:tasks.workunit.client.1.smithi194.stdout:0/154: unlink d6/fc 0 2024-02-20T08:06:04.258 INFO:tasks.workunit.client.1.smithi194.stdout:5/166: rename d4/f21 to d4/d6/d11/d15/f26 0 2024-02-20T08:06:04.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/207: creat d2/d8/dc/f46 x:0 0 0 2024-02-20T08:06:04.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/250: mknod df/d14/d24/c49 0 2024-02-20T08:06:04.265 INFO:tasks.workunit.client.1.smithi194.stdout:6/292: creat df/d42/f65 x:0 0 0 2024-02-20T08:06:04.266 INFO:tasks.workunit.client.1.smithi194.stdout:9/238: mkdir d4/d2d/d42/d4e 0 2024-02-20T08:06:04.267 INFO:tasks.workunit.client.1.smithi194.stdout:8/211: dwrite d2/f37 [0,4194304] 0 2024-02-20T08:06:04.269 INFO:tasks.workunit.client.1.smithi194.stdout:8/212: write f1 [4400831,40903] 0 2024-02-20T08:06:04.269 INFO:tasks.workunit.client.1.smithi194.stdout:9/239: truncate d4/d1b/d2e/f30 4378983 0 2024-02-20T08:06:04.270 INFO:tasks.workunit.client.1.smithi194.stdout:9/240: write d4/d20/f3a [54299,33173] 0 2024-02-20T08:06:04.279 INFO:tasks.workunit.client.1.smithi194.stdout:5/167: symlink d4/l27 0 2024-02-20T08:06:04.279 INFO:tasks.workunit.client.1.smithi194.stdout:7/218: dwrite d11/f12 [8388608,4194304] 0 2024-02-20T08:06:04.290 INFO:tasks.workunit.client.1.smithi194.stdout:6/293: mknod df/d18/d19/d1d/d28/d46/c66 0 2024-02-20T08:06:04.290 INFO:tasks.workunit.client.1.smithi194.stdout:6/294: write df/d18/d19/f2c [267113,43711] 0 2024-02-20T08:06:04.290 INFO:tasks.workunit.client.1.smithi194.stdout:8/213: rename d2/f35 to d2/d14/d18/f4a 0 2024-02-20T08:06:04.293 INFO:tasks.workunit.client.1.smithi194.stdout:3/192: getdents d5/d10/d17 0 2024-02-20T08:06:04.293 INFO:tasks.workunit.client.1.smithi194.stdout:3/193: readlink l0 0 2024-02-20T08:06:04.297 INFO:tasks.workunit.client.1.smithi194.stdout:3/194: dread d5/d10/d16/f1a [0,4194304] 0 2024-02-20T08:06:04.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/156: getdents d0/df 0 2024-02-20T08:06:04.299 INFO:tasks.workunit.client.1.smithi194.stdout:4/157: chown d0/l2c 535554 1 2024-02-20T08:06:04.301 INFO:tasks.workunit.client.1.smithi194.stdout:5/168: unlink d4/d6/d11/d15/l1b 0 2024-02-20T08:06:04.302 INFO:tasks.workunit.client.1.smithi194.stdout:7/219: rmdir d11/d2d/d38/d37/d3c 39 2024-02-20T08:06:04.303 INFO:tasks.workunit.client.1.smithi194.stdout:3/195: dwrite d5/d10/d16/f3a [0,4194304] 0 2024-02-20T08:06:04.304 INFO:tasks.workunit.client.1.smithi194.stdout:7/220: write d11/d2d/d38/f28 [4937470,72290] 0 2024-02-20T08:06:04.306 INFO:tasks.workunit.client.1.smithi194.stdout:7/221: chown d11/d15/c40 404 1 2024-02-20T08:06:04.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/208: symlink d2/d1a/l47 0 2024-02-20T08:06:04.309 INFO:tasks.workunit.client.1.smithi194.stdout:1/209: write d2/d1a/d26/f40 [1377202,2661] 0 2024-02-20T08:06:04.313 INFO:tasks.workunit.client.1.smithi194.stdout:8/214: write d2/f3b [375698,124934] 0 2024-02-20T08:06:04.313 INFO:tasks.workunit.client.1.smithi194.stdout:9/241: mkdir d4/d37/d4f 0 2024-02-20T08:06:04.314 INFO:tasks.workunit.client.1.smithi194.stdout:9/242: fdatasync d4/d20/d43/f47 0 2024-02-20T08:06:04.314 INFO:tasks.workunit.client.1.smithi194.stdout:8/215: write d2/d14/f2b [722970,20682] 0 2024-02-20T08:06:04.316 INFO:tasks.workunit.client.1.smithi194.stdout:9/243: write d4/de/f16 [120306,4050] 0 2024-02-20T08:06:04.316 INFO:tasks.workunit.client.1.smithi194.stdout:0/155: creat d6/f29 x:0 0 0 2024-02-20T08:06:04.317 INFO:tasks.workunit.client.1.smithi194.stdout:9/244: write d4/de/f27 [4880596,64109] 0 2024-02-20T08:06:04.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/158: creat d0/d2/f2e x:0 0 0 2024-02-20T08:06:04.320 INFO:tasks.workunit.client.1.smithi194.stdout:3/196: truncate d5/d10/f13 649176 0 2024-02-20T08:06:04.322 INFO:tasks.workunit.client.1.smithi194.stdout:9/245: dread d4/f5 [0,4194304] 0 2024-02-20T08:06:04.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/246: fdatasync d4/d7/f2c 0 2024-02-20T08:06:04.323 INFO:tasks.workunit.client.1.smithi194.stdout:5/169: dread d4/fc [4194304,4194304] 0 2024-02-20T08:06:04.324 INFO:tasks.workunit.client.1.smithi194.stdout:9/247: write d4/d1b/f21 [772322,57077] 0 2024-02-20T08:06:04.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/170: dread d4/fc [0,4194304] 0 2024-02-20T08:06:04.327 INFO:tasks.workunit.client.1.smithi194.stdout:8/216: symlink d2/d14/d18/l4b 0 2024-02-20T08:06:04.339 INFO:tasks.workunit.client.1.smithi194.stdout:7/222: rename d11/d2d/d38/f3a to d11/d2d/d38/d37/d3c/f42 0 2024-02-20T08:06:04.340 INFO:tasks.workunit.client.1.smithi194.stdout:7/223: read fd [2583101,7847] 0 2024-02-20T08:06:04.340 INFO:tasks.workunit.client.1.smithi194.stdout:6/295: truncate df/d18/d19/f29 33867 0 2024-02-20T08:06:04.341 INFO:tasks.workunit.client.1.smithi194.stdout:1/210: mkdir d2/d48 0 2024-02-20T08:06:04.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/251: link df/d14/d19/c39 df/d14/c4a 0 2024-02-20T08:06:04.345 INFO:tasks.workunit.client.1.smithi194.stdout:7/224: dwrite d11/f35 [4194304,4194304] 0 2024-02-20T08:06:04.347 INFO:tasks.workunit.client.1.smithi194.stdout:7/225: write d11/f35 [7842950,10140] 0 2024-02-20T08:06:04.352 INFO:tasks.workunit.client.1.smithi194.stdout:3/197: dwrite d5/d10/d17/d1d/f1e [0,4194304] 0 2024-02-20T08:06:04.357 INFO:tasks.workunit.client.1.smithi194.stdout:6/296: chown df/d18/d19/d1d/d28/d2b/f2e 157279 1 2024-02-20T08:06:04.358 INFO:tasks.workunit.client.1.smithi194.stdout:1/211: creat d2/d1a/d26/f49 x:0 0 0 2024-02-20T08:06:04.360 INFO:tasks.workunit.client.1.smithi194.stdout:1/212: write d2/d8/dc/f46 [61676,7972] 0 2024-02-20T08:06:04.362 INFO:tasks.workunit.client.1.smithi194.stdout:1/213: truncate d2/d1a/f2f 322137 0 2024-02-20T08:06:04.363 INFO:tasks.workunit.client.1.smithi194.stdout:2/252: mknod df/d14/d19/c4b 0 2024-02-20T08:06:04.363 INFO:tasks.workunit.client.1.smithi194.stdout:6/297: dwrite df/d18/f33 [4194304,4194304] 0 2024-02-20T08:06:04.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/253: write df/d14/f32 [2129465,114924] 0 2024-02-20T08:06:04.370 INFO:tasks.workunit.client.1.smithi194.stdout:5/171: dread d4/d6/dd/f17 [0,4194304] 0 2024-02-20T08:06:04.372 INFO:tasks.workunit.client.1.smithi194.stdout:3/198: readlink d5/d10/d16/l21 0 2024-02-20T08:06:04.373 INFO:tasks.workunit.client.1.smithi194.stdout:3/199: stat d5/d10/d17/d1d/l26 0 2024-02-20T08:06:04.376 INFO:tasks.workunit.client.1.smithi194.stdout:1/214: creat d2/d1a/d26/d45/f4a x:0 0 0 2024-02-20T08:06:04.377 INFO:tasks.workunit.client.1.smithi194.stdout:1/215: chown d2/d1a/d26/d45/f4a 120954 1 2024-02-20T08:06:04.377 INFO:tasks.workunit.client.1.smithi194.stdout:2/254: chown df/d14/d19/l37 2 1 2024-02-20T08:06:04.377 INFO:tasks.workunit.client.1.smithi194.stdout:8/217: creat d2/d14/f4c x:0 0 0 2024-02-20T08:06:04.379 INFO:tasks.workunit.client.1.smithi194.stdout:3/200: dread d5/df/f11 [0,4194304] 0 2024-02-20T08:06:04.380 INFO:tasks.workunit.client.1.smithi194.stdout:3/201: readlink d5/l9 0 2024-02-20T08:06:04.381 INFO:tasks.workunit.client.1.smithi194.stdout:3/202: dread - d5/d10/d17/f38 zero size 2024-02-20T08:06:04.383 INFO:tasks.workunit.client.1.smithi194.stdout:0/156: mknod d6/d8/c2a 0 2024-02-20T08:06:04.383 INFO:tasks.workunit.client.1.smithi194.stdout:0/157: dread - d6/d8/f1b zero size 2024-02-20T08:06:04.384 INFO:tasks.workunit.client.1.smithi194.stdout:7/226: mkdir d11/d2d/d38/d37/d43 0 2024-02-20T08:06:04.384 INFO:tasks.workunit.client.1.smithi194.stdout:0/158: dread - d6/d8/f24 zero size 2024-02-20T08:06:04.385 INFO:tasks.workunit.client.1.smithi194.stdout:4/159: getdents d0 0 2024-02-20T08:06:04.385 INFO:tasks.workunit.client.1.smithi194.stdout:0/159: truncate d6/d8/f1b 42842 0 2024-02-20T08:06:04.386 INFO:tasks.workunit.client.1.smithi194.stdout:5/172: mkdir d4/d6/d11/d15/d28 0 2024-02-20T08:06:04.388 INFO:tasks.workunit.client.1.smithi194.stdout:6/298: symlink df/d18/d19/d1d/d28/d2b/l67 0 2024-02-20T08:06:04.388 INFO:tasks.workunit.client.1.smithi194.stdout:6/299: fdatasync f2 0 2024-02-20T08:06:04.390 INFO:tasks.workunit.client.1.smithi194.stdout:3/203: symlink d5/d10/d17/l3c 0 2024-02-20T08:06:04.391 INFO:tasks.workunit.client.1.smithi194.stdout:7/227: unlink d11/d15/l1d 0 2024-02-20T08:06:04.393 INFO:tasks.workunit.client.1.smithi194.stdout:0/160: read d6/d8/f28 [5216,27781] 0 2024-02-20T08:06:04.396 INFO:tasks.workunit.client.1.smithi194.stdout:9/248: getdents d4/d37/d38 0 2024-02-20T08:06:04.398 INFO:tasks.workunit.client.1.smithi194.stdout:8/218: mkdir d2/d4d 0 2024-02-20T08:06:04.400 INFO:tasks.workunit.client.1.smithi194.stdout:3/204: rmdir d5/df/d25 39 2024-02-20T08:06:04.403 INFO:tasks.workunit.client.1.smithi194.stdout:5/173: creat d4/d6/dd/d25/f29 x:0 0 0 2024-02-20T08:06:04.406 INFO:tasks.workunit.client.1.smithi194.stdout:1/216: creat d2/f4b x:0 0 0 2024-02-20T08:06:04.410 INFO:tasks.workunit.client.1.smithi194.stdout:2/255: creat df/d14/f4c x:0 0 0 2024-02-20T08:06:04.413 INFO:tasks.workunit.client.1.smithi194.stdout:3/205: mkdir d5/d10/d17/d1d/d3d 0 2024-02-20T08:06:04.416 INFO:tasks.workunit.client.1.smithi194.stdout:5/174: rmdir d4/d6/d11/d15 39 2024-02-20T08:06:04.419 INFO:tasks.workunit.client.1.smithi194.stdout:1/217: creat d2/d8/dc/d34/f4c x:0 0 0 2024-02-20T08:06:04.421 INFO:tasks.workunit.client.1.smithi194.stdout:1/218: dread d2/d1a/f2f [0,4194304] 0 2024-02-20T08:06:04.421 INFO:tasks.workunit.client.1.smithi194.stdout:1/219: chown d2/d8/dc/d34 2174 1 2024-02-20T08:06:04.422 INFO:tasks.workunit.client.1.smithi194.stdout:4/160: write d0/df/f13 [4798644,106942] 0 2024-02-20T08:06:04.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/161: write d0/df/f13 [9425677,118102] 0 2024-02-20T08:06:04.424 INFO:tasks.workunit.client.1.smithi194.stdout:8/219: truncate d2/f11 787893 0 2024-02-20T08:06:04.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/162: rmdir d0/d2 39 2024-02-20T08:06:04.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/206: creat d5/d10/d17/d1d/d3d/f3e x:0 0 0 2024-02-20T08:06:04.436 INFO:tasks.workunit.client.1.smithi194.stdout:3/207: write d5/d10/d16/f3a [421337,40419] 0 2024-02-20T08:06:04.437 INFO:tasks.workunit.client.1.smithi194.stdout:3/208: readlink d5/df/l32 0 2024-02-20T08:06:04.437 INFO:tasks.workunit.client.1.smithi194.stdout:5/175: rename d4/f9 to d4/d6/d11/d15/f2a 0 2024-02-20T08:06:04.438 INFO:tasks.workunit.client.1.smithi194.stdout:3/209: chown d5/df/d30/f36 58522 1 2024-02-20T08:06:04.439 INFO:tasks.workunit.client.1.smithi194.stdout:5/176: truncate d4/d6/d11/d15/f26 111399 0 2024-02-20T08:06:04.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/220: creat d2/d1a/d26/d3d/f4d x:0 0 0 2024-02-20T08:06:04.440 INFO:tasks.workunit.client.1.smithi194.stdout:2/256: creat df/f4d x:0 0 0 2024-02-20T08:06:04.441 INFO:tasks.workunit.client.1.smithi194.stdout:6/300: link df/d18/d19/d1d/d28/d2b/l3d df/d18/d19/l68 0 2024-02-20T08:06:04.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/301: dread - df/f3c zero size 2024-02-20T08:06:04.444 INFO:tasks.workunit.client.1.smithi194.stdout:3/210: dwrite d5/d10/d16/f2d [0,4194304] 0 2024-02-20T08:06:04.446 INFO:tasks.workunit.client.1.smithi194.stdout:3/211: chown d5/d10/d16/l39 123967 1 2024-02-20T08:06:04.452 INFO:tasks.workunit.client.1.smithi194.stdout:9/249: dwrite d4/f19 [0,4194304] 0 2024-02-20T08:06:04.456 INFO:tasks.workunit.client.1.smithi194.stdout:0/161: write d6/f18 [2934464,11362] 0 2024-02-20T08:06:04.456 INFO:tasks.workunit.client.1.smithi194.stdout:4/163: write d0/d2/fb [6206649,8957] 0 2024-02-20T08:06:04.458 INFO:tasks.workunit.client.1.smithi194.stdout:6/302: rmdir df/d18/d19/d1d/d28/d46 39 2024-02-20T08:06:04.460 INFO:tasks.workunit.client.1.smithi194.stdout:5/177: mkdir d4/d20/d2b 0 2024-02-20T08:06:04.470 INFO:tasks.workunit.client.1.smithi194.stdout:3/212: mkdir d5/d10/d17/d1d/d3d/d3f 0 2024-02-20T08:06:04.477 INFO:tasks.workunit.client.1.smithi194.stdout:8/220: getdents d2/d14/d18 0 2024-02-20T08:06:04.478 INFO:tasks.workunit.client.1.smithi194.stdout:8/221: dread - d2/d14/f49 zero size 2024-02-20T08:06:04.479 INFO:tasks.workunit.client.1.smithi194.stdout:3/213: dread d5/fe [0,4194304] 0 2024-02-20T08:06:04.480 INFO:tasks.workunit.client.1.smithi194.stdout:3/214: write d5/d10/d17/d1d/f22 [3799931,39195] 0 2024-02-20T08:06:04.481 INFO:tasks.workunit.client.1.smithi194.stdout:3/215: dread - d5/df/d30/f36 zero size 2024-02-20T08:06:04.487 INFO:tasks.workunit.client.1.smithi194.stdout:1/221: link d2/d8/d12/f30 d2/d1a/d26/f4e 0 2024-02-20T08:06:04.489 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:04 smithi123 ceph-mon[29383]: pgmap v51: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 71 MiB/s wr, 416 op/s 2024-02-20T08:06:04.493 INFO:tasks.workunit.client.1.smithi194.stdout:9/250: symlink d4/d7/l50 0 2024-02-20T08:06:04.496 INFO:tasks.workunit.client.1.smithi194.stdout:8/222: mkdir d2/d14/d18/d45/d4e 0 2024-02-20T08:06:04.497 INFO:tasks.workunit.client.1.smithi194.stdout:8/223: read d2/f2d [677008,57558] 0 2024-02-20T08:06:04.497 INFO:tasks.workunit.client.1.smithi194.stdout:8/224: dread - d2/d14/d18/f4a zero size 2024-02-20T08:06:04.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/216: unlink d5/f37 0 2024-02-20T08:06:04.503 INFO:tasks.workunit.client.1.smithi194.stdout:5/178: link d4/f10 d4/d20/d2b/f2c 0 2024-02-20T08:06:04.505 INFO:tasks.workunit.client.1.smithi194.stdout:2/257: truncate f5 3608421 0 2024-02-20T08:06:04.506 INFO:tasks.workunit.client.1.smithi194.stdout:1/222: mknod d2/d8/df/c4f 0 2024-02-20T08:06:04.508 INFO:tasks.workunit.client.1.smithi194.stdout:0/162: rename d6/d8/d1e/d1f to d6/d2b 0 2024-02-20T08:06:04.511 INFO:tasks.workunit.client.1.smithi194.stdout:1/223: dwrite d2/d1a/d26/f40 [0,4194304] 0 2024-02-20T08:06:04.515 INFO:tasks.workunit.client.1.smithi194.stdout:4/164: mkdir d0/df/d25/d2f 0 2024-02-20T08:06:04.516 INFO:tasks.workunit.client.1.smithi194.stdout:2/258: unlink df/f12 0 2024-02-20T08:06:04.518 INFO:tasks.workunit.client.1.smithi194.stdout:7/228: sync 2024-02-20T08:06:04.519 INFO:tasks.workunit.client.1.smithi194.stdout:7/229: stat d11/d15/d27/l34 0 2024-02-20T08:06:04.519 INFO:tasks.workunit.client.1.smithi194.stdout:3/217: dwrite d5/fe [0,4194304] 0 2024-02-20T08:06:04.521 INFO:tasks.workunit.client.1.smithi194.stdout:0/163: readlink d6/d8/l1c 0 2024-02-20T08:06:04.522 INFO:tasks.workunit.client.1.smithi194.stdout:0/164: dread - d6/f29 zero size 2024-02-20T08:06:04.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/251: rename d4/d7/d28 to d4/d20/d43/d51 0 2024-02-20T08:06:04.525 INFO:tasks.workunit.client.1.smithi194.stdout:9/252: write d4/f12 [1307407,108700] 0 2024-02-20T08:06:04.529 INFO:tasks.workunit.client.1.smithi194.stdout:8/225: mknod d2/d4d/c4f 0 2024-02-20T08:06:04.530 INFO:tasks.workunit.client.1.smithi194.stdout:8/226: read d2/fa [6365548,19292] 0 2024-02-20T08:06:04.554 INFO:tasks.workunit.client.1.smithi194.stdout:1/224: creat d2/d8/dc/d34/f50 x:0 0 0 2024-02-20T08:06:04.554 INFO:tasks.workunit.client.1.smithi194.stdout:7/230: mknod d11/c44 0 2024-02-20T08:06:04.555 INFO:tasks.workunit.client.1.smithi194.stdout:0/165: symlink d6/d2b/l2c 0 2024-02-20T08:06:04.555 INFO:tasks.workunit.client.1.smithi194.stdout:9/253: rmdir d4/d1b/d2e 39 2024-02-20T08:06:04.557 INFO:tasks.workunit.client.1.smithi194.stdout:3/218: creat d5/d10/d17/d1d/d3d/d3f/f40 x:0 0 0 2024-02-20T08:06:04.563 INFO:tasks.workunit.client.1.smithi194.stdout:1/225: mknod d2/d8/dc/d34/c51 0 2024-02-20T08:06:04.565 INFO:tasks.workunit.client.1.smithi194.stdout:7/231: read d11/f2c [198587,85863] 0 2024-02-20T08:06:04.569 INFO:tasks.workunit.client.1.smithi194.stdout:2/259: rename df/d14/d19/f2e to df/d14/d24/f4e 0 2024-02-20T08:06:04.570 INFO:tasks.workunit.client.1.smithi194.stdout:2/260: write df/d14/d24/f35 [292549,77636] 0 2024-02-20T08:06:04.571 INFO:tasks.workunit.client.1.smithi194.stdout:6/303: sync 2024-02-20T08:06:04.573 INFO:tasks.workunit.client.1.smithi194.stdout:7/232: dread d11/f1a [0,4194304] 0 2024-02-20T08:06:04.576 INFO:tasks.workunit.client.1.smithi194.stdout:0/166: rename d6/d8/l1c to d6/d8/l2d 0 2024-02-20T08:06:04.576 INFO:tasks.workunit.client.1.smithi194.stdout:0/167: readlink l5 0 2024-02-20T08:06:04.577 INFO:tasks.workunit.client.1.smithi194.stdout:0/168: fsync d6/d8/f16 0 2024-02-20T08:06:04.577 INFO:tasks.workunit.client.1.smithi194.stdout:6/304: dwrite df/d18/f49 [0,4194304] 0 2024-02-20T08:06:04.579 INFO:tasks.workunit.client.1.smithi194.stdout:7/233: unlink d11/c16 0 2024-02-20T08:06:04.582 INFO:tasks.workunit.client.1.smithi194.stdout:3/219: getdents d5/df 0 2024-02-20T08:06:04.585 INFO:tasks.workunit.client.1.smithi194.stdout:6/305: creat df/d18/d19/d1d/d28/d5e/f69 x:0 0 0 2024-02-20T08:06:04.587 INFO:tasks.workunit.client.1.smithi194.stdout:8/227: rename d2/c38 to d2/d14/c50 0 2024-02-20T08:06:04.588 INFO:tasks.workunit.client.1.smithi194.stdout:7/234: mknod d11/d15/c45 0 2024-02-20T08:06:04.589 INFO:tasks.workunit.client.1.smithi194.stdout:2/261: creat df/f4f x:0 0 0 2024-02-20T08:06:04.589 INFO:tasks.workunit.client.1.smithi194.stdout:3/220: mkdir d5/d10/d28/d41 0 2024-02-20T08:06:04.594 INFO:tasks.workunit.client.1.smithi194.stdout:9/254: rename d4/de/f1e to d4/d20/d43/d51/f52 0 2024-02-20T08:06:04.610 INFO:tasks.workunit.client.1.smithi194.stdout:3/221: unlink d5/d10/d17/d1d/c3b 0 2024-02-20T08:06:04.612 INFO:tasks.workunit.client.1.smithi194.stdout:9/255: write d4/d1b/f1d [1920194,54713] 0 2024-02-20T08:06:04.612 INFO:tasks.workunit.client.1.smithi194.stdout:6/306: dwrite df/d18/d19/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:04.615 INFO:tasks.workunit.client.1.smithi194.stdout:3/222: rmdir d5/df/d25 39 2024-02-20T08:06:04.617 INFO:tasks.workunit.client.1.smithi194.stdout:0/169: dwrite d6/d8/f25 [0,4194304] 0 2024-02-20T08:06:04.619 INFO:tasks.workunit.client.1.smithi194.stdout:7/235: rename d11/l2a to d11/d2d/d38/d37/l46 0 2024-02-20T08:06:04.620 INFO:tasks.workunit.client.1.smithi194.stdout:0/170: creat d6/d8/d1e/f2e x:0 0 0 2024-02-20T08:06:04.621 INFO:tasks.workunit.client.1.smithi194.stdout:6/307: write df/d18/d19/d1d/d28/f2d [1204423,33991] 0 2024-02-20T08:06:04.621 INFO:tasks.workunit.client.1.smithi194.stdout:9/256: getdents d4/d37/d38 0 2024-02-20T08:06:04.622 INFO:tasks.workunit.client.1.smithi194.stdout:9/257: chown d4/f5 3474240 1 2024-02-20T08:06:04.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/308: chown df/f3c 4 1 2024-02-20T08:06:04.623 INFO:tasks.workunit.client.1.smithi194.stdout:3/223: dwrite d5/d10/d17/f38 [0,4194304] 0 2024-02-20T08:06:04.624 INFO:tasks.workunit.client.1.smithi194.stdout:7/236: truncate d11/f2c 1075698 0 2024-02-20T08:06:04.624 INFO:tasks.workunit.client.1.smithi194.stdout:7/237: dread - d11/d2d/f24 zero size 2024-02-20T08:06:04.625 INFO:tasks.workunit.client.1.smithi194.stdout:7/238: read d11/d15/d27/f29 [2557107,41938] 0 2024-02-20T08:06:04.626 INFO:tasks.workunit.client.1.smithi194.stdout:7/239: chown d11/d2d/d38/d37/d43 2 1 2024-02-20T08:06:04.629 INFO:tasks.workunit.client.1.smithi194.stdout:6/309: read df/d18/d19/d1d/f23 [26375,40132] 0 2024-02-20T08:06:04.630 INFO:tasks.workunit.client.1.smithi194.stdout:6/310: fdatasync df/d18/d19/f22 0 2024-02-20T08:06:04.636 INFO:tasks.workunit.client.1.smithi194.stdout:6/311: dwrite df/d18/d19/f2c [0,4194304] 0 2024-02-20T08:06:04.641 INFO:tasks.workunit.client.1.smithi194.stdout:5/179: sync 2024-02-20T08:06:04.641 INFO:tasks.workunit.client.1.smithi194.stdout:2/262: rename df/d14/d24/c27 to df/c50 0 2024-02-20T08:06:04.644 INFO:tasks.workunit.client.1.smithi194.stdout:0/171: creat d6/d8/f2f x:0 0 0 2024-02-20T08:06:04.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:04 smithi194 ceph-mon[37804]: pgmap v51: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 71 MiB/s wr, 416 op/s 2024-02-20T08:06:04.645 INFO:tasks.workunit.client.1.smithi194.stdout:6/312: dwrite fe [0,4194304] 0 2024-02-20T08:06:04.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/258: link d4/f35 d4/d2d/d42/f53 0 2024-02-20T08:06:04.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/259: stat d4/f35 0 2024-02-20T08:06:04.649 INFO:tasks.workunit.client.1.smithi194.stdout:6/313: truncate df/d18/d19/d1d/d28/d5e/f69 416015 0 2024-02-20T08:06:04.649 INFO:tasks.workunit.client.1.smithi194.stdout:9/260: fdatasync d4/f12 0 2024-02-20T08:06:04.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/180: write d4/fb [1114134,74407] 0 2024-02-20T08:06:04.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/240: link d11/d15/l19 d11/d15/d27/l47 0 2024-02-20T08:06:04.661 INFO:tasks.workunit.client.1.smithi194.stdout:5/181: creat d4/d6/dd/f2d x:0 0 0 2024-02-20T08:06:04.663 INFO:tasks.workunit.client.1.smithi194.stdout:9/261: mknod d4/c54 0 2024-02-20T08:06:04.664 INFO:tasks.workunit.client.1.smithi194.stdout:3/224: getdents d5/d10/d16 0 2024-02-20T08:06:04.665 INFO:tasks.workunit.client.1.smithi194.stdout:3/225: fsync d5/f8 0 2024-02-20T08:06:04.665 INFO:tasks.workunit.client.1.smithi194.stdout:0/172: creat d6/d8/f30 x:0 0 0 2024-02-20T08:06:04.665 INFO:tasks.workunit.client.1.smithi194.stdout:9/262: rmdir d4/d37 39 2024-02-20T08:06:04.666 INFO:tasks.workunit.client.1.smithi194.stdout:2/263: link df/d14/d19/l1c df/d3a/l51 0 2024-02-20T08:06:04.667 INFO:tasks.workunit.client.1.smithi194.stdout:9/263: stat d4/d2d/d34 0 2024-02-20T08:06:04.669 INFO:tasks.workunit.client.1.smithi194.stdout:1/226: sync 2024-02-20T08:06:04.670 INFO:tasks.workunit.client.1.smithi194.stdout:4/165: sync 2024-02-20T08:06:04.672 INFO:tasks.workunit.client.1.smithi194.stdout:5/182: dwrite d4/d6/fa [0,4194304] 0 2024-02-20T08:06:04.672 INFO:tasks.workunit.client.1.smithi194.stdout:3/226: mknod d5/d10/d17/d1d/d3d/c42 0 2024-02-20T08:06:04.673 INFO:tasks.workunit.client.1.smithi194.stdout:9/264: mkdir d4/d55 0 2024-02-20T08:06:04.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/241: dread d11/d15/d27/f29 [0,4194304] 0 2024-02-20T08:06:04.675 INFO:tasks.workunit.client.1.smithi194.stdout:0/173: rename d6/d8/c1d to d6/d2b/c31 0 2024-02-20T08:06:04.676 INFO:tasks.workunit.client.1.smithi194.stdout:3/227: dread - d5/f34 zero size 2024-02-20T08:06:04.676 INFO:tasks.workunit.client.1.smithi194.stdout:5/183: write d4/d6/fa [2828698,50498] 0 2024-02-20T08:06:04.676 INFO:tasks.workunit.client.1.smithi194.stdout:0/174: chown l4 827 1 2024-02-20T08:06:04.677 INFO:tasks.workunit.client.1.smithi194.stdout:3/228: read d5/fe [1676501,17888] 0 2024-02-20T08:06:04.678 INFO:tasks.workunit.client.1.smithi194.stdout:5/184: chown d4/d20 961 1 2024-02-20T08:06:04.680 INFO:tasks.workunit.client.1.smithi194.stdout:0/175: write d6/d8/f15 [2608461,13241] 0 2024-02-20T08:06:04.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/227: dread d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:04.682 INFO:tasks.workunit.client.1.smithi194.stdout:6/314: dread df/d18/d19/d1d/f31 [0,4194304] 0 2024-02-20T08:06:04.685 INFO:tasks.workunit.client.1.smithi194.stdout:6/315: chown df/d18/d19/d1d/l24 75427 1 2024-02-20T08:06:04.687 INFO:tasks.workunit.client.1.smithi194.stdout:6/316: write df/d18/d19/f22 [5950957,129901] 0 2024-02-20T08:06:04.687 INFO:tasks.workunit.client.1.smithi194.stdout:5/185: dwrite d4/f12 [0,4194304] 0 2024-02-20T08:06:04.690 INFO:tasks.workunit.client.1.smithi194.stdout:6/317: write df/d18/d19/f1a [143031,17918] 0 2024-02-20T08:06:04.690 INFO:tasks.workunit.client.1.smithi194.stdout:9/265: mknod d4/d37/c56 0 2024-02-20T08:06:04.691 INFO:tasks.workunit.client.1.smithi194.stdout:9/266: chown d4/l33 61 1 2024-02-20T08:06:04.692 INFO:tasks.workunit.client.1.smithi194.stdout:1/228: rename d2/f13 to d2/d8/d12/f52 0 2024-02-20T08:06:04.694 INFO:tasks.workunit.client.1.smithi194.stdout:3/229: write d5/df/d30/f36 [408209,90268] 0 2024-02-20T08:06:04.700 INFO:tasks.workunit.client.1.smithi194.stdout:9/267: rmdir d4/d20/d43 39 2024-02-20T08:06:04.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/230: dwrite f4 [0,4194304] 0 2024-02-20T08:06:04.706 INFO:tasks.workunit.client.1.smithi194.stdout:4/166: write d0/d2/fe [1283806,53111] 0 2024-02-20T08:06:04.706 INFO:tasks.workunit.client.1.smithi194.stdout:4/167: chown d0/df/d18 4 1 2024-02-20T08:06:04.707 INFO:tasks.workunit.client.1.smithi194.stdout:0/176: creat d6/f32 x:0 0 0 2024-02-20T08:06:04.708 INFO:tasks.workunit.client.1.smithi194.stdout:9/268: mknod d4/d2d/d42/c57 0 2024-02-20T08:06:04.709 INFO:tasks.workunit.client.1.smithi194.stdout:0/177: write d6/d8/f25 [8705896,89458] 0 2024-02-20T08:06:04.713 INFO:tasks.workunit.client.1.smithi194.stdout:6/318: mknod df/d18/d19/d1d/d28/c6a 0 2024-02-20T08:06:04.720 INFO:tasks.workunit.client.1.smithi194.stdout:3/231: symlink d5/d10/l43 0 2024-02-20T08:06:04.720 INFO:tasks.workunit.client.1.smithi194.stdout:0/178: mknod d6/d2b/c33 0 2024-02-20T08:06:04.720 INFO:tasks.workunit.client.1.smithi194.stdout:5/186: dwrite d4/d6/dd/f17 [0,4194304] 0 2024-02-20T08:06:04.722 INFO:tasks.workunit.client.1.smithi194.stdout:2/264: dread f5 [0,4194304] 0 2024-02-20T08:06:04.722 INFO:tasks.workunit.client.1.smithi194.stdout:5/187: chown d4/f12 7253370 1 2024-02-20T08:06:04.722 INFO:tasks.workunit.client.1.smithi194.stdout:4/168: creat d0/d10/d1c/f30 x:0 0 0 2024-02-20T08:06:04.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/232: truncate d5/d10/d17/d1d/f20 4411101 0 2024-02-20T08:06:04.724 INFO:tasks.workunit.client.1.smithi194.stdout:5/188: truncate d4/d6/dd/f2d 21694 0 2024-02-20T08:06:04.726 INFO:tasks.workunit.client.1.smithi194.stdout:6/319: mkdir df/d18/d19/d1d/d28/d46/d5a/d6b 0 2024-02-20T08:06:04.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/179: creat d6/d8/d1e/f34 x:0 0 0 2024-02-20T08:06:04.732 INFO:tasks.workunit.client.1.smithi194.stdout:4/169: unlink d0/df/f14 0 2024-02-20T08:06:04.733 INFO:tasks.workunit.client.1.smithi194.stdout:1/229: truncate d2/d8/d12/f2c 290072 0 2024-02-20T08:06:04.737 INFO:tasks.workunit.client.1.smithi194.stdout:0/180: chown d6/f18 5416 1 2024-02-20T08:06:04.738 INFO:tasks.workunit.client.1.smithi194.stdout:4/170: fsync d0/f19 0 2024-02-20T08:06:04.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/230: creat d2/d1a/d26/f53 x:0 0 0 2024-02-20T08:06:04.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/181: chown d6/d8/c2a 0 1 2024-02-20T08:06:04.741 INFO:tasks.workunit.client.1.smithi194.stdout:0/182: fsync d6/d8/f1b 0 2024-02-20T08:06:04.742 INFO:tasks.workunit.client.1.smithi194.stdout:4/171: chown d0/d10/d1c/d21/l28 5 1 2024-02-20T08:06:04.742 INFO:tasks.workunit.client.1.smithi194.stdout:1/231: chown d2/d1a/d26/f53 463 1 2024-02-20T08:06:04.743 INFO:tasks.workunit.client.1.smithi194.stdout:9/269: dwrite d4/d1b/f36 [0,4194304] 0 2024-02-20T08:06:04.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/233: dread d5/d10/d16/f2c [0,4194304] 0 2024-02-20T08:06:04.747 INFO:tasks.workunit.client.1.smithi194.stdout:3/234: read f4 [2909474,24423] 0 2024-02-20T08:06:04.747 INFO:tasks.workunit.client.1.smithi194.stdout:6/320: rmdir df/d18/d19/d1d/d28/d46/d5a/d63 0 2024-02-20T08:06:04.747 INFO:tasks.workunit.client.1.smithi194.stdout:3/235: readlink d5/d10/d16/l2b 0 2024-02-20T08:06:04.748 INFO:tasks.workunit.client.1.smithi194.stdout:8/228: sync 2024-02-20T08:06:04.750 INFO:tasks.workunit.client.1.smithi194.stdout:6/321: chown df/d18/d19/d1d/d28/d5e/f69 52806 1 2024-02-20T08:06:04.753 INFO:tasks.workunit.client.1.smithi194.stdout:4/172: dwrite d0/d2/f1a [0,4194304] 0 2024-02-20T08:06:04.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/270: unlink d4/d1b/f21 0 2024-02-20T08:06:04.757 INFO:tasks.workunit.client.1.smithi194.stdout:3/236: dread d5/fa [0,4194304] 0 2024-02-20T08:06:04.762 INFO:tasks.workunit.client.1.smithi194.stdout:5/189: dwrite f3 [0,4194304] 0 2024-02-20T08:06:04.763 INFO:tasks.workunit.client.1.smithi194.stdout:6/322: creat df/d18/d19/d1d/d28/d46/f6c x:0 0 0 2024-02-20T08:06:04.764 INFO:tasks.workunit.client.1.smithi194.stdout:0/183: write d6/d8/f28 [221324,17196] 0 2024-02-20T08:06:04.769 INFO:tasks.workunit.client.1.smithi194.stdout:3/237: fdatasync d5/df/f24 0 2024-02-20T08:06:04.771 INFO:tasks.workunit.client.1.smithi194.stdout:5/190: mknod d4/c2e 0 2024-02-20T08:06:04.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/191: stat d4/f10 0 2024-02-20T08:06:04.773 INFO:tasks.workunit.client.1.smithi194.stdout:4/173: creat d0/df/d25/d2f/f31 x:0 0 0 2024-02-20T08:06:04.775 INFO:tasks.workunit.client.1.smithi194.stdout:0/184: chown d6/f1a 41776 1 2024-02-20T08:06:04.775 INFO:tasks.workunit.client.1.smithi194.stdout:9/271: mknod d4/d20/c58 0 2024-02-20T08:06:04.776 INFO:tasks.workunit.client.1.smithi194.stdout:0/185: fsync d6/d8/f1b 0 2024-02-20T08:06:04.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/238: dwrite d5/d10/d17/d1d/d3d/d3f/f40 [0,4194304] 0 2024-02-20T08:06:04.777 INFO:tasks.workunit.client.1.smithi194.stdout:8/229: creat d2/d14/f51 x:0 0 0 2024-02-20T08:06:04.777 INFO:tasks.workunit.client.1.smithi194.stdout:6/323: mknod df/d18/d19/d1d/d28/d46/d5a/d6b/c6d 0 2024-02-20T08:06:04.779 INFO:tasks.workunit.client.1.smithi194.stdout:3/239: write d5/f8 [3535939,112065] 0 2024-02-20T08:06:04.779 INFO:tasks.workunit.client.1.smithi194.stdout:0/186: chown d6/d8/f24 59462 1 2024-02-20T08:06:04.781 INFO:tasks.workunit.client.1.smithi194.stdout:6/324: chown df/d18/d19/f2c 45129268 1 2024-02-20T08:06:04.785 INFO:tasks.workunit.client.1.smithi194.stdout:9/272: mkdir d4/d2d/d59 0 2024-02-20T08:06:04.786 INFO:tasks.workunit.client.1.smithi194.stdout:8/230: dwrite d2/d14/f2c [0,4194304] 0 2024-02-20T08:06:04.789 INFO:tasks.workunit.client.1.smithi194.stdout:5/192: mkdir d4/d6/d11/d2f 0 2024-02-20T08:06:04.791 INFO:tasks.workunit.client.1.smithi194.stdout:0/187: mkdir d6/d2b/d35 0 2024-02-20T08:06:04.792 INFO:tasks.workunit.client.1.smithi194.stdout:0/188: stat d6/d8/f28 0 2024-02-20T08:06:04.794 INFO:tasks.workunit.client.1.smithi194.stdout:3/240: rmdir d5/d10/d17/d1d/d3d/d3f 39 2024-02-20T08:06:04.799 INFO:tasks.workunit.client.1.smithi194.stdout:5/193: dread d4/fb [0,4194304] 0 2024-02-20T08:06:04.800 INFO:tasks.workunit.client.1.smithi194.stdout:5/194: chown d4/d1c/f24 681793 1 2024-02-20T08:06:04.805 INFO:tasks.workunit.client.1.smithi194.stdout:4/174: creat d0/f32 x:0 0 0 2024-02-20T08:06:04.808 INFO:tasks.workunit.client.1.smithi194.stdout:9/273: dread d4/d20/d43/d51/f3b [0,4194304] 0 2024-02-20T08:06:04.808 INFO:tasks.workunit.client.1.smithi194.stdout:0/189: mknod d6/d8/d1e/c36 0 2024-02-20T08:06:04.809 INFO:tasks.workunit.client.1.smithi194.stdout:9/274: dread - d4/d1b/f4a zero size 2024-02-20T08:06:04.811 INFO:tasks.workunit.client.1.smithi194.stdout:4/175: dwrite d0/f19 [0,4194304] 0 2024-02-20T08:06:04.811 INFO:tasks.workunit.client.1.smithi194.stdout:3/241: mknod d5/d10/d28/d41/c44 0 2024-02-20T08:06:04.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/195: mknod d4/d6/d11/d15/d28/c30 0 2024-02-20T08:06:04.815 INFO:tasks.workunit.client.1.smithi194.stdout:8/231: rename d2/d14/c16 to d2/c52 0 2024-02-20T08:06:04.816 INFO:tasks.workunit.client.1.smithi194.stdout:9/275: symlink d4/d20/d43/l5a 0 2024-02-20T08:06:04.820 INFO:tasks.workunit.client.1.smithi194.stdout:0/190: symlink d6/l37 0 2024-02-20T08:06:04.821 INFO:tasks.workunit.client.1.smithi194.stdout:0/191: write d6/d8/d1e/f34 [835716,75743] 0 2024-02-20T08:06:04.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/232: unlink d2/d14/f51 0 2024-02-20T08:06:04.827 INFO:tasks.workunit.client.1.smithi194.stdout:4/176: unlink d0/fc 0 2024-02-20T08:06:04.830 INFO:tasks.workunit.client.1.smithi194.stdout:3/242: link d5/f8 d5/d10/d28/f45 0 2024-02-20T08:06:04.833 INFO:tasks.workunit.client.1.smithi194.stdout:9/276: creat d4/d2d/d59/f5b x:0 0 0 2024-02-20T08:06:04.834 INFO:tasks.workunit.client.1.smithi194.stdout:0/192: creat d6/d2b/d35/f38 x:0 0 0 2024-02-20T08:06:04.835 INFO:tasks.workunit.client.1.smithi194.stdout:0/193: write d6/d8/f15 [4937761,95605] 0 2024-02-20T08:06:04.835 INFO:tasks.workunit.client.1.smithi194.stdout:3/243: symlink d5/d10/d28/l46 0 2024-02-20T08:06:04.836 INFO:tasks.workunit.client.1.smithi194.stdout:7/242: sync 2024-02-20T08:06:04.837 INFO:tasks.workunit.client.1.smithi194.stdout:7/243: fdatasync d11/d15/f21 0 2024-02-20T08:06:04.837 INFO:tasks.workunit.client.1.smithi194.stdout:5/196: rename f3 to d4/d6/d11/f31 0 2024-02-20T08:06:04.838 INFO:tasks.workunit.client.1.smithi194.stdout:8/233: symlink d2/l53 0 2024-02-20T08:06:04.839 INFO:tasks.workunit.client.1.smithi194.stdout:8/234: fdatasync d2/d14/f2c 0 2024-02-20T08:06:04.840 INFO:tasks.workunit.client.1.smithi194.stdout:8/235: dread - d2/f1e zero size 2024-02-20T08:06:04.841 INFO:tasks.workunit.client.1.smithi194.stdout:0/194: mkdir d6/d2b/d35/d39 0 2024-02-20T08:06:04.842 INFO:tasks.workunit.client.1.smithi194.stdout:6/325: dread df/d18/f40 [0,4194304] 0 2024-02-20T08:06:04.843 INFO:tasks.workunit.client.1.smithi194.stdout:3/244: unlink d5/d10/d16/f1a 0 2024-02-20T08:06:04.845 INFO:tasks.workunit.client.1.smithi194.stdout:5/197: dwrite d4/d6/dd/f2d [0,4194304] 0 2024-02-20T08:06:04.845 INFO:tasks.workunit.client.1.smithi194.stdout:6/326: write df/d18/d19/d1d/d28/d5e/f69 [378097,54008] 0 2024-02-20T08:06:04.847 INFO:tasks.workunit.client.1.smithi194.stdout:7/244: unlink d11/d15/c40 0 2024-02-20T08:06:04.848 INFO:tasks.workunit.client.1.smithi194.stdout:7/245: truncate d11/d2d/f24 553226 0 2024-02-20T08:06:04.852 INFO:tasks.workunit.client.1.smithi194.stdout:8/236: mknod d2/d4d/c54 0 2024-02-20T08:06:04.852 INFO:tasks.workunit.client.1.smithi194.stdout:8/237: fdatasync d2/f3b 0 2024-02-20T08:06:04.858 INFO:tasks.workunit.client.1.smithi194.stdout:0/195: creat d6/d2b/f3a x:0 0 0 2024-02-20T08:06:04.858 INFO:tasks.workunit.client.1.smithi194.stdout:8/238: dwrite d2/d14/f34 [0,4194304] 0 2024-02-20T08:06:04.859 INFO:tasks.workunit.client.1.smithi194.stdout:0/196: fdatasync d6/d8/d1e/f27 0 2024-02-20T08:06:04.860 INFO:tasks.workunit.client.1.smithi194.stdout:3/245: fdatasync d5/df/d25/f27 0 2024-02-20T08:06:04.863 INFO:tasks.workunit.client.1.smithi194.stdout:6/327: mknod df/d42/c6e 0 2024-02-20T08:06:04.863 INFO:tasks.workunit.client.1.smithi194.stdout:6/328: fdatasync df/d18/d19/f2c 0 2024-02-20T08:06:04.865 INFO:tasks.workunit.client.1.smithi194.stdout:6/329: dread - df/d18/d19/d1d/d28/d46/d5a/f64 zero size 2024-02-20T08:06:04.875 INFO:tasks.workunit.client.1.smithi194.stdout:9/277: rename d4/d7 to d4/d20/d5c 0 2024-02-20T08:06:04.880 INFO:tasks.workunit.client.1.smithi194.stdout:7/246: write fd [3094375,7364] 0 2024-02-20T08:06:04.881 INFO:tasks.workunit.client.1.smithi194.stdout:9/278: dwrite d4/de/f16 [0,4194304] 0 2024-02-20T08:06:04.882 INFO:tasks.workunit.client.1.smithi194.stdout:3/246: readlink d5/df/l32 0 2024-02-20T08:06:04.893 INFO:tasks.workunit.client.1.smithi194.stdout:8/239: rename d2/d14/c3d to d2/d14/d18/d45/c55 0 2024-02-20T08:06:04.898 INFO:tasks.workunit.client.1.smithi194.stdout:1/232: sync 2024-02-20T08:06:04.898 INFO:tasks.workunit.client.1.smithi194.stdout:2/265: sync 2024-02-20T08:06:04.902 INFO:tasks.workunit.client.1.smithi194.stdout:7/247: symlink d11/d2d/l48 0 2024-02-20T08:06:04.911 INFO:tasks.workunit.client.1.smithi194.stdout:3/247: creat d5/d10/d17/d1d/f47 x:0 0 0 2024-02-20T08:06:04.911 INFO:tasks.workunit.client.1.smithi194.stdout:3/248: stat d5/d10/d28/f45 0 2024-02-20T08:06:04.916 INFO:tasks.workunit.client.1.smithi194.stdout:1/233: mknod d2/d8/dc/d34/c54 0 2024-02-20T08:06:04.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/198: link d4/c2e d4/d6/c32 0 2024-02-20T08:06:04.922 INFO:tasks.workunit.client.1.smithi194.stdout:9/279: unlink d4/d20/d5c/f11 0 2024-02-20T08:06:04.925 INFO:tasks.workunit.client.1.smithi194.stdout:8/240: symlink d2/d14/l56 0 2024-02-20T08:06:04.926 INFO:tasks.workunit.client.1.smithi194.stdout:0/197: getdents d6/d2b 0 2024-02-20T08:06:04.928 INFO:tasks.workunit.client.1.smithi194.stdout:0/198: write d6/f18 [3993756,112830] 0 2024-02-20T08:06:04.928 INFO:tasks.workunit.client.1.smithi194.stdout:7/248: mknod d11/d2d/d38/d37/d43/c49 0 2024-02-20T08:06:04.929 INFO:tasks.workunit.client.1.smithi194.stdout:9/280: dwrite d4/f19 [0,4194304] 0 2024-02-20T08:06:04.931 INFO:tasks.workunit.client.1.smithi194.stdout:6/330: getdents df/d18/d19/d1d 0 2024-02-20T08:06:04.933 INFO:tasks.workunit.client.1.smithi194.stdout:4/177: sync 2024-02-20T08:06:04.941 INFO:tasks.workunit.client.1.smithi194.stdout:3/249: link d5/c18 d5/d10/d17/d1d/c48 0 2024-02-20T08:06:04.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/331: unlink df/d42/f59 0 2024-02-20T08:06:04.948 INFO:tasks.workunit.client.1.smithi194.stdout:6/332: dwrite df/d18/d19/d1d/f31 [0,4194304] 0 2024-02-20T08:06:04.948 INFO:tasks.workunit.client.1.smithi194.stdout:1/234: dread d2/d8/d12/f52 [4194304,4194304] 0 2024-02-20T08:06:04.948 INFO:tasks.workunit.client.1.smithi194.stdout:2/266: rename df/c13 to df/d14/d24/c52 0 2024-02-20T08:06:04.950 INFO:tasks.workunit.client.1.smithi194.stdout:1/235: dread - d2/d8/df/f24 zero size 2024-02-20T08:06:04.954 INFO:tasks.workunit.client.1.smithi194.stdout:0/199: symlink d6/d2b/d35/d39/l3b 0 2024-02-20T08:06:04.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/241: link d2/f2d d2/d14/d18/f57 0 2024-02-20T08:06:04.957 INFO:tasks.workunit.client.1.smithi194.stdout:5/199: dread d4/d6/fa [4194304,4194304] 0 2024-02-20T08:06:04.959 INFO:tasks.workunit.client.1.smithi194.stdout:5/200: fdatasync d4/f12 0 2024-02-20T08:06:04.959 INFO:tasks.workunit.client.1.smithi194.stdout:9/281: dread d4/de/f2a [0,4194304] 0 2024-02-20T08:06:04.959 INFO:tasks.workunit.client.1.smithi194.stdout:7/249: rename d11/d15 to d11/d2d/d38/d4a 0 2024-02-20T08:06:04.960 INFO:tasks.workunit.client.1.smithi194.stdout:9/282: chown d4/d20 37 1 2024-02-20T08:06:04.961 INFO:tasks.workunit.client.1.smithi194.stdout:2/267: readlink df/d14/d24/l45 0 2024-02-20T08:06:04.963 INFO:tasks.workunit.client.1.smithi194.stdout:2/268: chown df/d14/d24/f2d 191098 1 2024-02-20T08:06:04.964 INFO:tasks.workunit.client.1.smithi194.stdout:1/236: creat d2/d8/d12/f55 x:0 0 0 2024-02-20T08:06:04.964 INFO:tasks.workunit.client.1.smithi194.stdout:4/178: dwrite d0/d2/f2e [0,4194304] 0 2024-02-20T08:06:04.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/269: fdatasync df/f4d 0 2024-02-20T08:06:04.966 INFO:tasks.workunit.client.1.smithi194.stdout:6/333: creat df/d18/d19/d1d/d28/d46/f6f x:0 0 0 2024-02-20T08:06:04.967 INFO:tasks.workunit.client.1.smithi194.stdout:6/334: read df/d18/d19/f29 [24737,124203] 0 2024-02-20T08:06:04.968 INFO:tasks.workunit.client.1.smithi194.stdout:6/335: write f2 [4724853,73020] 0 2024-02-20T08:06:04.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/200: mkdir d6/d8/d1e/d3c 0 2024-02-20T08:06:04.973 INFO:tasks.workunit.client.1.smithi194.stdout:0/201: fsync d6/d8/f2f 0 2024-02-20T08:06:04.973 INFO:tasks.workunit.client.1.smithi194.stdout:6/336: dread df/d18/d19/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:04.974 INFO:tasks.workunit.client.1.smithi194.stdout:6/337: chown df/d18/d19/d1d/d28/d5e/f69 406801 1 2024-02-20T08:06:04.975 INFO:tasks.workunit.client.1.smithi194.stdout:6/338: write df/d42/f4d [807545,67632] 0 2024-02-20T08:06:04.980 INFO:tasks.workunit.client.1.smithi194.stdout:3/250: rename d5/c7 to d5/d10/d17/c49 0 2024-02-20T08:06:04.980 INFO:tasks.workunit.client.1.smithi194.stdout:8/242: dwrite d2/d14/d18/f4a [0,4194304] 0 2024-02-20T08:06:04.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/270: creat df/d3a/f53 x:0 0 0 2024-02-20T08:06:04.985 INFO:tasks.workunit.client.1.smithi194.stdout:4/179: symlink d0/df/d25/l33 0 2024-02-20T08:06:04.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/243: dread d2/d14/f2c [0,4194304] 0 2024-02-20T08:06:04.987 INFO:tasks.workunit.client.1.smithi194.stdout:8/244: write d2/f37 [2258603,81] 0 2024-02-20T08:06:04.995 INFO:tasks.workunit.client.1.smithi194.stdout:3/251: mknod d5/d10/d16/c4a 0 2024-02-20T08:06:04.995 INFO:tasks.workunit.client.1.smithi194.stdout:3/252: chown d5/l23 0 1 2024-02-20T08:06:04.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/271: symlink df/d3a/l54 0 2024-02-20T08:06:04.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/272: write df/f4f [377048,115802] 0 2024-02-20T08:06:05.001 INFO:tasks.workunit.client.1.smithi194.stdout:1/237: link d2/d8/d12/f2b d2/d8/dc/f56 0 2024-02-20T08:06:05.002 INFO:tasks.workunit.client.1.smithi194.stdout:8/245: mknod d2/d14/d18/d45/c58 0 2024-02-20T08:06:05.007 INFO:tasks.workunit.client.1.smithi194.stdout:7/250: creat d11/d2d/d38/d37/f4b x:0 0 0 2024-02-20T08:06:05.008 INFO:tasks.workunit.client.1.smithi194.stdout:2/273: dwrite df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:05.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/283: symlink d4/d20/d5c/l5d 0 2024-02-20T08:06:05.010 INFO:tasks.workunit.client.1.smithi194.stdout:6/339: dread df/d18/d19/d1d/d28/d2b/f51 [0,4194304] 0 2024-02-20T08:06:05.014 INFO:tasks.workunit.client.1.smithi194.stdout:1/238: dread d2/d8/d12/f52 [4194304,4194304] 0 2024-02-20T08:06:05.014 INFO:tasks.workunit.client.1.smithi194.stdout:5/201: getdents d4/d6 0 2024-02-20T08:06:05.015 INFO:tasks.workunit.client.1.smithi194.stdout:0/202: creat d6/f3d x:0 0 0 2024-02-20T08:06:05.015 INFO:tasks.workunit.client.1.smithi194.stdout:4/180: creat d0/f34 x:0 0 0 2024-02-20T08:06:05.017 INFO:tasks.workunit.client.1.smithi194.stdout:9/284: chown d4/d20/d43/d51/l3f 42244 1 2024-02-20T08:06:05.017 INFO:tasks.workunit.client.1.smithi194.stdout:8/246: dwrite d2/d14/f49 [0,4194304] 0 2024-02-20T08:06:05.021 INFO:tasks.workunit.client.1.smithi194.stdout:3/253: dread d5/fe [0,4194304] 0 2024-02-20T08:06:05.022 INFO:tasks.workunit.client.1.smithi194.stdout:5/202: symlink d4/l33 0 2024-02-20T08:06:05.023 INFO:tasks.workunit.client.1.smithi194.stdout:4/181: truncate d0/df/d25/d2f/f31 772341 0 2024-02-20T08:06:05.026 INFO:tasks.workunit.client.1.smithi194.stdout:6/340: dwrite df/d42/f65 [0,4194304] 0 2024-02-20T08:06:05.031 INFO:tasks.workunit.client.1.smithi194.stdout:3/254: symlink d5/df/d25/l4b 0 2024-02-20T08:06:05.034 INFO:tasks.workunit.client.1.smithi194.stdout:5/203: write d4/d6/d11/d15/f2a [1064078,126681] 0 2024-02-20T08:06:05.041 INFO:tasks.workunit.client.1.smithi194.stdout:1/239: write d2/d8/dc/f1f [866248,86710] 0 2024-02-20T08:06:05.042 INFO:tasks.workunit.client.1.smithi194.stdout:7/251: truncate d11/f12 10305387 0 2024-02-20T08:06:05.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/285: dwrite d4/d20/d5c/fc [0,4194304] 0 2024-02-20T08:06:05.045 INFO:tasks.workunit.client.1.smithi194.stdout:5/204: creat d4/d6/d11/d15/f34 x:0 0 0 2024-02-20T08:06:05.045 INFO:tasks.workunit.client.1.smithi194.stdout:5/205: stat d4/d6/d11/d15/c23 0 2024-02-20T08:06:05.050 INFO:tasks.workunit.client.1.smithi194.stdout:8/247: truncate d2/d14/d18/f27 177916 0 2024-02-20T08:06:05.052 INFO:tasks.workunit.client.1.smithi194.stdout:3/255: mknod d5/d10/d17/d1d/d3d/d3f/c4c 0 2024-02-20T08:06:05.057 INFO:tasks.workunit.client.1.smithi194.stdout:4/182: creat d0/d2/f35 x:0 0 0 2024-02-20T08:06:05.060 INFO:tasks.workunit.client.1.smithi194.stdout:6/341: truncate df/d18/f33 1000771 0 2024-02-20T08:06:05.063 INFO:tasks.workunit.client.1.smithi194.stdout:3/256: read d5/df/f11 [837345,5670] 0 2024-02-20T08:06:05.063 INFO:tasks.workunit.client.1.smithi194.stdout:4/183: rmdir d0/df 39 2024-02-20T08:06:05.065 INFO:tasks.workunit.client.1.smithi194.stdout:9/286: mknod d4/d20/c5e 0 2024-02-20T08:06:05.065 INFO:tasks.workunit.client.1.smithi194.stdout:9/287: chown d4/d20/c58 99501 1 2024-02-20T08:06:05.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/252: link d11/d2d/d38/d37/f4b d11/d2d/d38/d37/d3c/f4c 0 2024-02-20T08:06:05.071 INFO:tasks.workunit.client.1.smithi194.stdout:0/203: dread d6/f17 [4194304,4194304] 0 2024-02-20T08:06:05.072 INFO:tasks.workunit.client.1.smithi194.stdout:5/206: mknod d4/d6/d11/c35 0 2024-02-20T08:06:05.078 INFO:tasks.workunit.client.1.smithi194.stdout:4/184: write d0/d2/fe [602643,19124] 0 2024-02-20T08:06:05.079 INFO:tasks.workunit.client.1.smithi194.stdout:3/257: fsync d5/d10/d28/f45 0 2024-02-20T08:06:05.081 INFO:tasks.workunit.client.1.smithi194.stdout:9/288: rmdir d4/d1b 39 2024-02-20T08:06:05.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/185: truncate d0/d10/d1c/f30 469205 0 2024-02-20T08:06:05.084 INFO:tasks.workunit.client.1.smithi194.stdout:3/258: truncate d5/d10/d17/f38 4220451 0 2024-02-20T08:06:05.084 INFO:tasks.workunit.client.1.smithi194.stdout:1/240: dwrite d2/d8/d12/f30 [0,4194304] 0 2024-02-20T08:06:05.085 INFO:tasks.workunit.client.1.smithi194.stdout:0/204: chown d6/d8/l10 3090 1 2024-02-20T08:06:05.085 INFO:tasks.workunit.client.1.smithi194.stdout:3/259: fdatasync d5/d10/d16/f3a 0 2024-02-20T08:06:05.092 INFO:tasks.workunit.client.1.smithi194.stdout:4/186: dwrite d0/d2/fe [0,4194304] 0 2024-02-20T08:06:05.094 INFO:tasks.workunit.client.1.smithi194.stdout:1/241: dwrite d2/d1a/d26/d3d/f4d [0,4194304] 0 2024-02-20T08:06:05.095 INFO:tasks.workunit.client.1.smithi194.stdout:1/242: dread - d2/f42 zero size 2024-02-20T08:06:05.098 INFO:tasks.workunit.client.1.smithi194.stdout:2/274: sync 2024-02-20T08:06:05.098 INFO:tasks.workunit.client.1.smithi194.stdout:5/207: truncate d4/f12 572259 0 2024-02-20T08:06:05.100 INFO:tasks.workunit.client.1.smithi194.stdout:2/275: write df/d3a/f53 [234176,120164] 0 2024-02-20T08:06:05.102 INFO:tasks.workunit.client.1.smithi194.stdout:0/205: unlink l4 0 2024-02-20T08:06:05.103 INFO:tasks.workunit.client.1.smithi194.stdout:8/248: rename d2/f2d to d2/d14/f59 0 2024-02-20T08:06:05.103 INFO:tasks.workunit.client.1.smithi194.stdout:9/289: dwrite d4/de/f2a [0,4194304] 0 2024-02-20T08:06:05.108 INFO:tasks.workunit.client.1.smithi194.stdout:1/243: mkdir d2/d1a/d26/d57 0 2024-02-20T08:06:05.108 INFO:tasks.workunit.client.1.smithi194.stdout:1/244: readlink d2/d1a/l23 0 2024-02-20T08:06:05.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/208: write d4/d1c/f24 [4156516,65223] 0 2024-02-20T08:06:05.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/249: dread d2/f3b [0,4194304] 0 2024-02-20T08:06:05.111 INFO:tasks.workunit.client.1.smithi194.stdout:5/209: write d4/d6/dd/d25/f29 [895479,99157] 0 2024-02-20T08:06:05.113 INFO:tasks.workunit.client.1.smithi194.stdout:7/253: link l4 d11/d2d/d38/d4a/l4d 0 2024-02-20T08:06:05.114 INFO:tasks.workunit.client.1.smithi194.stdout:7/254: chown d11/d2d/d38/d37/d43 1052 1 2024-02-20T08:06:05.117 INFO:tasks.workunit.client.1.smithi194.stdout:4/187: rmdir d0/df/d18 39 2024-02-20T08:06:05.117 INFO:tasks.workunit.client.1.smithi194.stdout:8/250: dwrite d2/f9 [0,4194304] 0 2024-02-20T08:06:05.121 INFO:tasks.workunit.client.1.smithi194.stdout:3/260: creat d5/d10/f4d x:0 0 0 2024-02-20T08:06:05.123 INFO:tasks.workunit.client.1.smithi194.stdout:2/276: symlink df/d14/l55 0 2024-02-20T08:06:05.133 INFO:tasks.workunit.client.1.smithi194.stdout:9/290: truncate d4/f12 1052323 0 2024-02-20T08:06:05.133 INFO:tasks.workunit.client.1.smithi194.stdout:4/188: write d0/df/d11/f24 [629028,52712] 0 2024-02-20T08:06:05.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/189: write d0/d2/f2e [883766,116428] 0 2024-02-20T08:06:05.135 INFO:tasks.workunit.client.1.smithi194.stdout:3/261: mknod d5/c4e 0 2024-02-20T08:06:05.137 INFO:tasks.workunit.client.1.smithi194.stdout:4/190: dread d0/df/d25/d2f/f31 [0,4194304] 0 2024-02-20T08:06:05.141 INFO:tasks.workunit.client.1.smithi194.stdout:6/342: rename df/d18/c21 to df/c70 0 2024-02-20T08:06:05.142 INFO:tasks.workunit.client.1.smithi194.stdout:6/343: readlink df/d18/d19/d1d/l27 0 2024-02-20T08:06:05.143 INFO:tasks.workunit.client.1.smithi194.stdout:0/206: rename d6/f32 to d6/f3e 0 2024-02-20T08:06:05.144 INFO:tasks.workunit.client.1.smithi194.stdout:0/207: write d6/d8/d1e/f34 [985871,58787] 0 2024-02-20T08:06:05.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/344: truncate df/d18/d19/d1d/d28/d46/f6f 499753 0 2024-02-20T08:06:05.145 INFO:tasks.workunit.client.1.smithi194.stdout:0/208: write d6/d8/f30 [11689,5563] 0 2024-02-20T08:06:05.147 INFO:tasks.workunit.client.1.smithi194.stdout:0/209: truncate d6/f3d 996060 0 2024-02-20T08:06:05.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/251: mknod d2/d14/d18/d45/d4e/c5a 0 2024-02-20T08:06:05.150 INFO:tasks.workunit.client.1.smithi194.stdout:1/245: write d2/d1a/f2f [450149,90744] 0 2024-02-20T08:06:05.154 INFO:tasks.workunit.client.1.smithi194.stdout:0/210: dwrite d6/d8/f2f [0,4194304] 0 2024-02-20T08:06:05.154 INFO:tasks.workunit.client.1.smithi194.stdout:2/277: mkdir df/d14/d24/d56 0 2024-02-20T08:06:05.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/210: link d4/f10 d4/d6/dd/f36 0 2024-02-20T08:06:05.157 INFO:tasks.workunit.client.1.smithi194.stdout:1/246: dread d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:05.161 INFO:tasks.workunit.client.1.smithi194.stdout:9/291: write d4/d1b/d2e/f45 [886021,18926] 0 2024-02-20T08:06:05.162 INFO:tasks.workunit.client.1.smithi194.stdout:4/191: dwrite d0/d2/fb [4194304,4194304] 0 2024-02-20T08:06:05.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/247: dread d2/d1a/d26/d3d/f4d [0,4194304] 0 2024-02-20T08:06:05.163 INFO:tasks.workunit.client.1.smithi194.stdout:4/192: readlink d0/df/d25/l33 0 2024-02-20T08:06:05.167 INFO:tasks.workunit.client.1.smithi194.stdout:6/345: creat df/d18/d19/d1d/d28/d46/d5a/f71 x:0 0 0 2024-02-20T08:06:05.174 INFO:tasks.workunit.client.1.smithi194.stdout:1/248: dwrite d2/f36 [0,4194304] 0 2024-02-20T08:06:05.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/193: dwrite d0/d10/d1c/f30 [0,4194304] 0 2024-02-20T08:06:05.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/211: creat d6/d8/d1e/f3f x:0 0 0 2024-02-20T08:06:05.177 INFO:tasks.workunit.client.1.smithi194.stdout:0/212: read - d6/d8/d1e/f2e zero size 2024-02-20T08:06:05.182 INFO:tasks.workunit.client.1.smithi194.stdout:0/213: write d6/d8/d1e/f34 [306873,86199] 0 2024-02-20T08:06:05.183 INFO:tasks.workunit.client.1.smithi194.stdout:5/211: dread d4/f12 [0,4194304] 0 2024-02-20T08:06:05.184 INFO:tasks.workunit.client.1.smithi194.stdout:7/255: getdents d11/d3b 0 2024-02-20T08:06:05.184 INFO:tasks.workunit.client.1.smithi194.stdout:0/214: chown d6/d8/d1e/f3f 30 1 2024-02-20T08:06:05.187 INFO:tasks.workunit.client.1.smithi194.stdout:3/262: link d5/c4e d5/c4f 0 2024-02-20T08:06:05.187 INFO:tasks.workunit.client.1.smithi194.stdout:6/346: creat df/d42/f72 x:0 0 0 2024-02-20T08:06:05.187 INFO:tasks.workunit.client.1.smithi194.stdout:2/278: getdents df/d14/d24/d56 0 2024-02-20T08:06:05.189 INFO:tasks.workunit.client.1.smithi194.stdout:3/263: write d5/f1b [1715657,18935] 0 2024-02-20T08:06:05.189 INFO:tasks.workunit.client.1.smithi194.stdout:6/347: write df/d42/f65 [4229505,53623] 0 2024-02-20T08:06:05.198 INFO:tasks.workunit.client.1.smithi194.stdout:1/249: mkdir d2/d1a/d26/d57/d58 0 2024-02-20T08:06:05.199 INFO:tasks.workunit.client.1.smithi194.stdout:1/250: write d2/d8/df/f33 [818080,106209] 0 2024-02-20T08:06:05.200 INFO:tasks.workunit.client.1.smithi194.stdout:1/251: truncate d2/d1a/f3f 836152 0 2024-02-20T08:06:05.201 INFO:tasks.workunit.client.1.smithi194.stdout:1/252: dread - d2/d8/d12/f2b zero size 2024-02-20T08:06:05.207 INFO:tasks.workunit.client.1.smithi194.stdout:7/256: dread fd [0,4194304] 0 2024-02-20T08:06:05.214 INFO:tasks.workunit.client.1.smithi194.stdout:8/252: rename d2/d14/f59 to d2/f5b 0 2024-02-20T08:06:05.215 INFO:tasks.workunit.client.1.smithi194.stdout:8/253: write d2/f9 [4126087,121881] 0 2024-02-20T08:06:05.220 INFO:tasks.workunit.client.1.smithi194.stdout:7/257: creat d11/d2d/d38/d4a/d27/f4e x:0 0 0 2024-02-20T08:06:05.221 INFO:tasks.workunit.client.1.smithi194.stdout:6/348: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:05.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/258: stat d11/d2d/d38/d4a/d27/f39 0 2024-02-20T08:06:05.222 INFO:tasks.workunit.client.1.smithi194.stdout:6/349: read df/d18/d19/f1a [2701965,60397] 0 2024-02-20T08:06:05.224 INFO:tasks.workunit.client.1.smithi194.stdout:6/350: dread - df/d18/d19/d1d/f61 zero size 2024-02-20T08:06:05.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/279: mknod df/d14/c57 0 2024-02-20T08:06:05.241 INFO:tasks.workunit.client.1.smithi194.stdout:5/212: rename d4/d6/c32 to d4/d6/d11/d2f/c37 0 2024-02-20T08:06:05.247 INFO:tasks.workunit.client.1.smithi194.stdout:1/253: dwrite d2/d1a/d26/f40 [4194304,4194304] 0 2024-02-20T08:06:05.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/215: truncate d6/d8/f28 211637 0 2024-02-20T08:06:05.255 INFO:tasks.workunit.client.1.smithi194.stdout:6/351: symlink df/d18/d19/d1d/l73 0 2024-02-20T08:06:05.259 INFO:tasks.workunit.client.1.smithi194.stdout:3/264: rename d5/d10/d17/d1d/d3d/c42 to d5/d10/d17/c50 0 2024-02-20T08:06:05.261 INFO:tasks.workunit.client.1.smithi194.stdout:9/292: sync 2024-02-20T08:06:05.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/254: mkdir d2/d1a/d26/d3d/d59 0 2024-02-20T08:06:05.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/280: symlink df/d14/l58 0 2024-02-20T08:06:05.267 INFO:tasks.workunit.client.1.smithi194.stdout:0/216: dread d6/f1a [0,4194304] 0 2024-02-20T08:06:05.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/259: creat d11/d2d/d38/d37/f4f x:0 0 0 2024-02-20T08:06:05.275 INFO:tasks.workunit.client.1.smithi194.stdout:5/213: mknod d4/d6/dd/d25/c38 0 2024-02-20T08:06:05.277 INFO:tasks.workunit.client.1.smithi194.stdout:3/265: mknod d5/df/c51 0 2024-02-20T08:06:05.285 INFO:tasks.workunit.client.1.smithi194.stdout:1/255: truncate d2/d8/d12/f30 1528167 0 2024-02-20T08:06:05.287 INFO:tasks.workunit.client.1.smithi194.stdout:9/293: dwrite d4/f35 [0,4194304] 0 2024-02-20T08:06:05.287 INFO:tasks.workunit.client.1.smithi194.stdout:8/254: rename d2/f1e to d2/d14/f5c 0 2024-02-20T08:06:05.288 INFO:tasks.workunit.client.1.smithi194.stdout:8/255: chown d2/d14/d18/d45/d4e 6997506 1 2024-02-20T08:06:05.289 INFO:tasks.workunit.client.1.smithi194.stdout:6/352: symlink df/d18/d19/d1d/d28/l74 0 2024-02-20T08:06:05.290 INFO:tasks.workunit.client.1.smithi194.stdout:8/256: write d2/d14/d18/f4a [4316018,11250] 0 2024-02-20T08:06:05.292 INFO:tasks.workunit.client.1.smithi194.stdout:0/217: getdents d6/d2b 0 2024-02-20T08:06:05.293 INFO:tasks.workunit.client.1.smithi194.stdout:8/257: read d2/f2e [63639,79718] 0 2024-02-20T08:06:05.294 INFO:tasks.workunit.client.1.smithi194.stdout:0/218: write d6/d2b/d35/f38 [743784,54346] 0 2024-02-20T08:06:05.294 INFO:tasks.workunit.client.1.smithi194.stdout:5/214: creat d4/d6/d11/d15/d28/f39 x:0 0 0 2024-02-20T08:06:05.299 INFO:tasks.workunit.client.1.smithi194.stdout:7/260: link d11/l18 d11/d3b/l50 0 2024-02-20T08:06:05.299 INFO:tasks.workunit.client.1.smithi194.stdout:6/353: dwrite df/d18/d19/d1d/d28/f2d [0,4194304] 0 2024-02-20T08:06:05.302 INFO:tasks.workunit.client.1.smithi194.stdout:1/256: creat d2/d1a/d26/d3d/d59/f5a x:0 0 0 2024-02-20T08:06:05.304 INFO:tasks.workunit.client.1.smithi194.stdout:1/257: truncate d2/d1a/f3f 1150989 0 2024-02-20T08:06:05.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/354: dread df/d18/d19/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:05.309 INFO:tasks.workunit.client.1.smithi194.stdout:3/266: creat d5/d10/f52 x:0 0 0 2024-02-20T08:06:05.310 INFO:tasks.workunit.client.1.smithi194.stdout:5/215: mkdir d4/d6/dd/d3a 0 2024-02-20T08:06:05.311 INFO:tasks.workunit.client.1.smithi194.stdout:5/216: readlink d4/l33 0 2024-02-20T08:06:05.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/258: dwrite d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:05.311 INFO:tasks.workunit.client.1.smithi194.stdout:7/261: mkdir d11/d2d/d38/d4a/d27/d51 0 2024-02-20T08:06:05.312 INFO:tasks.workunit.client.1.smithi194.stdout:7/262: chown f3 30946128 1 2024-02-20T08:06:05.312 INFO:tasks.workunit.client.1.smithi194.stdout:5/217: chown d4/d6/d11/d15/f34 79347328 1 2024-02-20T08:06:05.318 INFO:tasks.workunit.client.1.smithi194.stdout:2/281: rename lb to df/l59 0 2024-02-20T08:06:05.319 INFO:tasks.workunit.client.1.smithi194.stdout:6/355: creat df/d18/d19/d1d/d28/d5e/f75 x:0 0 0 2024-02-20T08:06:05.321 INFO:tasks.workunit.client.1.smithi194.stdout:1/259: dwrite d2/d1a/d26/d3d/d59/f5a [0,4194304] 0 2024-02-20T08:06:05.324 INFO:tasks.workunit.client.1.smithi194.stdout:8/258: creat d2/d14/f5d x:0 0 0 2024-02-20T08:06:05.326 INFO:tasks.workunit.client.1.smithi194.stdout:9/294: getdents d4/de 0 2024-02-20T08:06:05.327 INFO:tasks.workunit.client.1.smithi194.stdout:6/356: dread df/d42/f65 [0,4194304] 0 2024-02-20T08:06:05.330 INFO:tasks.workunit.client.1.smithi194.stdout:7/263: dwrite f5 [0,4194304] 0 2024-02-20T08:06:05.331 INFO:tasks.workunit.client.1.smithi194.stdout:3/267: rename d5/f1b to d5/d10/d28/f53 0 2024-02-20T08:06:05.339 INFO:tasks.workunit.client.1.smithi194.stdout:6/357: chown df/c70 260 1 2024-02-20T08:06:05.342 INFO:tasks.workunit.client.1.smithi194.stdout:9/295: creat d4/d20/d43/d51/f5f x:0 0 0 2024-02-20T08:06:05.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/282: symlink df/d14/l5a 0 2024-02-20T08:06:05.345 INFO:tasks.workunit.client.1.smithi194.stdout:7/264: symlink d11/d2d/d38/d4a/d27/l52 0 2024-02-20T08:06:05.345 INFO:tasks.workunit.client.1.smithi194.stdout:4/194: sync 2024-02-20T08:06:05.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/265: write d11/f35 [3490841,95140] 0 2024-02-20T08:06:05.346 INFO:tasks.workunit.client.1.smithi194.stdout:5/218: rename d4/l27 to d4/d20/l3b 0 2024-02-20T08:06:05.349 INFO:tasks.workunit.client.1.smithi194.stdout:0/219: link d6/c14 d6/c40 0 2024-02-20T08:06:05.354 INFO:tasks.workunit.client.1.smithi194.stdout:4/195: dwrite d0/df/d11/f24 [0,4194304] 0 2024-02-20T08:06:05.355 INFO:tasks.workunit.client.1.smithi194.stdout:7/266: fdatasync d11/d2d/d38/d4a/d27/f39 0 2024-02-20T08:06:05.357 INFO:tasks.workunit.client.1.smithi194.stdout:6/358: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:05.371 INFO:tasks.workunit.client.1.smithi194.stdout:2/283: unlink df/d14/d19/l46 0 2024-02-20T08:06:05.373 INFO:tasks.workunit.client.1.smithi194.stdout:4/196: chown d0/c7 711 1 2024-02-20T08:06:05.374 INFO:tasks.workunit.client.1.smithi194.stdout:1/260: write d2/d8/d12/f2c [863729,105078] 0 2024-02-20T08:06:05.375 INFO:tasks.workunit.client.1.smithi194.stdout:7/267: mkdir d11/d2d/d38/d4a/d53 0 2024-02-20T08:06:05.375 INFO:tasks.workunit.client.1.smithi194.stdout:1/261: dread - d2/d1a/d26/f32 zero size 2024-02-20T08:06:05.377 INFO:tasks.workunit.client.1.smithi194.stdout:7/268: dread - d11/d2d/d38/d37/d3c/f4c zero size 2024-02-20T08:06:05.379 INFO:tasks.workunit.client.1.smithi194.stdout:8/259: getdents d2 0 2024-02-20T08:06:05.379 INFO:tasks.workunit.client.1.smithi194.stdout:2/284: dread df/d14/d24/f35 [0,4194304] 0 2024-02-20T08:06:05.380 INFO:tasks.workunit.client.1.smithi194.stdout:0/220: symlink d6/d8/l41 0 2024-02-20T08:06:05.380 INFO:tasks.workunit.client.1.smithi194.stdout:1/262: dread d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:05.381 INFO:tasks.workunit.client.1.smithi194.stdout:0/221: fsync d6/d8/d1e/f27 0 2024-02-20T08:06:05.381 INFO:tasks.workunit.client.1.smithi194.stdout:2/285: write df/d3a/f53 [466681,61291] 0 2024-02-20T08:06:05.387 INFO:tasks.workunit.client.1.smithi194.stdout:2/286: dwrite df/d14/f22 [4194304,4194304] 0 2024-02-20T08:06:05.391 INFO:tasks.workunit.client.1.smithi194.stdout:5/219: rename d4/d20/l3b to d4/l3c 0 2024-02-20T08:06:05.395 INFO:tasks.workunit.client.1.smithi194.stdout:6/359: mkdir df/d18/d19/d1d/d76 0 2024-02-20T08:06:05.396 INFO:tasks.workunit.client.1.smithi194.stdout:6/360: fdatasync df/d18/d19/d1d/d28/f2d 0 2024-02-20T08:06:05.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/361: write df/d18/d19/d1d/d28/d46/d5a/f64 [111593,13812] 0 2024-02-20T08:06:05.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/263: symlink d2/d8/dc/l5b 0 2024-02-20T08:06:05.408 INFO:tasks.workunit.client.1.smithi194.stdout:2/287: fsync f5 0 2024-02-20T08:06:05.408 INFO:tasks.workunit.client.1.smithi194.stdout:2/288: fdatasync fe 0 2024-02-20T08:06:05.414 INFO:tasks.workunit.client.1.smithi194.stdout:0/222: rename d6/d8 to d6/d2b/d35/d42 0 2024-02-20T08:06:05.417 INFO:tasks.workunit.client.1.smithi194.stdout:4/197: unlink d0/l2c 0 2024-02-20T08:06:05.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/198: dwrite d0/f19 [0,4194304] 0 2024-02-20T08:06:05.425 INFO:tasks.workunit.client.1.smithi194.stdout:4/199: truncate d0/d2/fb 8972927 0 2024-02-20T08:06:05.426 INFO:tasks.workunit.client.1.smithi194.stdout:4/200: read - d0/d10/f22 zero size 2024-02-20T08:06:05.427 INFO:tasks.workunit.client.1.smithi194.stdout:4/201: write d0/d2/fb [5492345,102770] 0 2024-02-20T08:06:05.429 INFO:tasks.workunit.client.1.smithi194.stdout:9/296: link d4/d20/d5c/c49 d4/d1b/c60 0 2024-02-20T08:06:05.445 INFO:tasks.workunit.client.1.smithi194.stdout:7/269: truncate f5 3738514 0 2024-02-20T08:06:05.451 INFO:tasks.workunit.client.1.smithi194.stdout:3/268: sync 2024-02-20T08:06:05.451 INFO:tasks.workunit.client.1.smithi194.stdout:8/260: write d2/f1f [1133663,6954] 0 2024-02-20T08:06:05.452 INFO:tasks.workunit.client.1.smithi194.stdout:8/261: fsync d2/d14/d18/f4a 0 2024-02-20T08:06:05.454 INFO:tasks.workunit.client.1.smithi194.stdout:1/264: truncate d2/d8/d12/f30 1207523 0 2024-02-20T08:06:05.457 INFO:tasks.workunit.client.1.smithi194.stdout:9/297: unlink d4/l17 0 2024-02-20T08:06:05.457 INFO:tasks.workunit.client.1.smithi194.stdout:1/265: dread d2/d1a/d26/f40 [4194304,4194304] 0 2024-02-20T08:06:05.462 INFO:tasks.workunit.client.1.smithi194.stdout:2/289: mkdir df/d5b 0 2024-02-20T08:06:05.469 INFO:tasks.workunit.client.1.smithi194.stdout:3/269: symlink d5/d10/d17/d1d/l54 0 2024-02-20T08:06:05.474 INFO:tasks.workunit.client.1.smithi194.stdout:4/202: mkdir d0/d36 0 2024-02-20T08:06:05.474 INFO:tasks.workunit.client.1.smithi194.stdout:8/262: creat d2/d14/d18/d45/d4e/f5e x:0 0 0 2024-02-20T08:06:05.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/220: dwrite d4/f10 [0,4194304] 0 2024-02-20T08:06:05.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/298: fsync d4/d20/d43/d51/f3b 0 2024-02-20T08:06:05.483 INFO:tasks.workunit.client.1.smithi194.stdout:2/290: mkdir df/d14/d19/d5c 0 2024-02-20T08:06:05.486 INFO:tasks.workunit.client.1.smithi194.stdout:3/270: dwrite d5/d10/d17/d1d/f20 [0,4194304] 0 2024-02-20T08:06:05.489 INFO:tasks.workunit.client.1.smithi194.stdout:6/362: dwrite df/d18/f33 [0,4194304] 0 2024-02-20T08:06:05.489 INFO:tasks.workunit.client.1.smithi194.stdout:4/203: dread - d0/d2/f1f zero size 2024-02-20T08:06:05.490 INFO:tasks.workunit.client.1.smithi194.stdout:6/363: fsync df/d18/d19/d1d/d28/d46/d5a/f64 0 2024-02-20T08:06:05.491 INFO:tasks.workunit.client.1.smithi194.stdout:9/299: creat d4/d1b/d2e/f61 x:0 0 0 2024-02-20T08:06:05.494 INFO:tasks.workunit.client.1.smithi194.stdout:0/223: getdents d6 0 2024-02-20T08:06:05.494 INFO:tasks.workunit.client.1.smithi194.stdout:0/224: readlink d6/l37 0 2024-02-20T08:06:05.501 INFO:tasks.workunit.client.1.smithi194.stdout:5/221: truncate d4/fc 8079322 0 2024-02-20T08:06:05.508 INFO:tasks.workunit.client.1.smithi194.stdout:2/291: mkdir df/d14/d5d 0 2024-02-20T08:06:05.517 INFO:tasks.workunit.client.1.smithi194.stdout:3/271: symlink d5/df/l55 0 2024-02-20T08:06:05.521 INFO:tasks.workunit.client.1.smithi194.stdout:5/222: creat d4/d6/d11/d15/d28/f3d x:0 0 0 2024-02-20T08:06:05.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/223: write d4/d6/d11/d15/f2a [3743041,104077] 0 2024-02-20T08:06:05.526 INFO:tasks.workunit.client.1.smithi194.stdout:5/224: write d4/d6/dd/f17 [2730534,14118] 0 2024-02-20T08:06:05.527 INFO:tasks.workunit.client.1.smithi194.stdout:4/204: creat d0/df/d18/f37 x:0 0 0 2024-02-20T08:06:05.528 INFO:tasks.workunit.client.1.smithi194.stdout:5/225: readlink d4/l33 0 2024-02-20T08:06:05.530 INFO:tasks.workunit.client.1.smithi194.stdout:7/270: dwrite d11/d2d/d38/d4a/f30 [0,4194304] 0 2024-02-20T08:06:05.532 INFO:tasks.workunit.client.1.smithi194.stdout:5/226: dread - d4/d6/d11/d15/d28/f3d zero size 2024-02-20T08:06:05.541 INFO:tasks.workunit.client.1.smithi194.stdout:6/364: creat df/d18/f77 x:0 0 0 2024-02-20T08:06:05.544 INFO:tasks.workunit.client.1.smithi194.stdout:9/300: creat d4/d37/f62 x:0 0 0 2024-02-20T08:06:05.545 INFO:tasks.workunit.client.1.smithi194.stdout:9/301: chown d4/d37/d38 17391553 1 2024-02-20T08:06:05.546 INFO:tasks.workunit.client.1.smithi194.stdout:1/266: dwrite d2/d1a/f1d [0,4194304] 0 2024-02-20T08:06:05.547 INFO:tasks.workunit.client.1.smithi194.stdout:9/302: truncate d4/d20/d43/d51/f5f 169012 0 2024-02-20T08:06:05.548 INFO:tasks.workunit.client.1.smithi194.stdout:4/205: rmdir d0/df/d25/d2f 39 2024-02-20T08:06:05.551 INFO:tasks.workunit.client.1.smithi194.stdout:7/271: unlink d11/d2d/d38/d4a/f30 0 2024-02-20T08:06:05.556 INFO:tasks.workunit.client.1.smithi194.stdout:9/303: dwrite d4/de/f16 [0,4194304] 0 2024-02-20T08:06:05.562 INFO:tasks.workunit.client.1.smithi194.stdout:7/272: mknod d11/d2d/d38/d37/d43/c54 0 2024-02-20T08:06:05.563 INFO:tasks.workunit.client.1.smithi194.stdout:7/273: chown d11/d2d/d38/d4a/c45 94421 1 2024-02-20T08:06:05.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/267: getdents d2/d1a/d26/d57/d58 0 2024-02-20T08:06:05.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/268: chown d2/d8/dc/l5b 6672430 1 2024-02-20T08:06:05.567 INFO:tasks.workunit.client.1.smithi194.stdout:1/269: fsync d2/d8/d12/f41 0 2024-02-20T08:06:05.569 INFO:tasks.workunit.client.1.smithi194.stdout:6/365: creat df/d18/d19/d1d/d28/f78 x:0 0 0 2024-02-20T08:06:05.570 INFO:tasks.workunit.client.1.smithi194.stdout:3/272: dread d5/d10/d17/f38 [0,4194304] 0 2024-02-20T08:06:05.571 INFO:tasks.workunit.client.1.smithi194.stdout:1/270: symlink d2/d1a/d26/d45/l5c 0 2024-02-20T08:06:05.573 INFO:tasks.workunit.client.1.smithi194.stdout:4/206: creat d0/df/d25/f38 x:0 0 0 2024-02-20T08:06:05.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/273: mkdir d5/d10/d17/d1d/d56 0 2024-02-20T08:06:05.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/207: write d0/d10/d1c/f30 [2188695,15394] 0 2024-02-20T08:06:05.576 INFO:tasks.workunit.client.1.smithi194.stdout:9/304: rmdir d4/d20/d4d 0 2024-02-20T08:06:05.576 INFO:tasks.workunit.client.1.smithi194.stdout:3/274: readlink d5/d10/d28/l46 0 2024-02-20T08:06:05.577 INFO:tasks.workunit.client.1.smithi194.stdout:9/305: chown d4/d2d/d42 432097900 1 2024-02-20T08:06:05.578 INFO:tasks.workunit.client.1.smithi194.stdout:1/271: creat d2/d1a/d26/d57/f5d x:0 0 0 2024-02-20T08:06:05.579 INFO:tasks.workunit.client.1.smithi194.stdout:6/366: dwrite df/d18/d19/d1d/d28/d2b/f2e [0,4194304] 0 2024-02-20T08:06:05.583 INFO:tasks.workunit.client.1.smithi194.stdout:9/306: creat d4/d20/d43/f63 x:0 0 0 2024-02-20T08:06:05.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/367: write df/d18/d19/f4a [931793,88266] 0 2024-02-20T08:06:05.588 INFO:tasks.workunit.client.1.smithi194.stdout:6/368: chown df/d42/c6e 120430113 1 2024-02-20T08:06:05.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/275: dwrite d5/df/f24 [0,4194304] 0 2024-02-20T08:06:05.592 INFO:tasks.workunit.client.1.smithi194.stdout:4/208: dwrite d0/f34 [0,4194304] 0 2024-02-20T08:06:05.596 INFO:tasks.workunit.client.1.smithi194.stdout:9/307: unlink d4/d20/f3a 0 2024-02-20T08:06:05.596 INFO:tasks.workunit.client.1.smithi194.stdout:4/209: dread - d0/df/d11/f2b zero size 2024-02-20T08:06:05.597 INFO:tasks.workunit.client.1.smithi194.stdout:0/225: dwrite d6/d2b/d35/d42/f28 [0,4194304] 0 2024-02-20T08:06:05.599 INFO:tasks.workunit.client.1.smithi194.stdout:0/226: fsync d6/d2b/f3a 0 2024-02-20T08:06:05.599 INFO:tasks.workunit.client.1.smithi194.stdout:4/210: read d0/d2/fb [6391581,61934] 0 2024-02-20T08:06:05.606 INFO:tasks.workunit.client.1.smithi194.stdout:5/227: truncate d4/d6/dd/f17 2121792 0 2024-02-20T08:06:05.611 INFO:tasks.workunit.client.1.smithi194.stdout:1/272: getdents d2/d1a 0 2024-02-20T08:06:05.612 INFO:tasks.workunit.client.1.smithi194.stdout:9/308: fsync d4/d20/d5c/f2c 0 2024-02-20T08:06:05.613 INFO:tasks.workunit.client.1.smithi194.stdout:1/273: write d2/d8/dc/d34/f50 [602981,107223] 0 2024-02-20T08:06:05.617 INFO:tasks.workunit.client.1.smithi194.stdout:8/263: sync 2024-02-20T08:06:05.622 INFO:tasks.workunit.client.1.smithi194.stdout:0/227: mkdir d6/d2b/d35/d42/d1e/d3c/d43 0 2024-02-20T08:06:05.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/264: mknod d2/c5f 0 2024-02-20T08:06:05.625 INFO:tasks.workunit.client.1.smithi194.stdout:0/228: dread d6/f3d [0,4194304] 0 2024-02-20T08:06:05.626 INFO:tasks.workunit.client.1.smithi194.stdout:6/369: link df/d18/d19/l4c df/d42/l79 0 2024-02-20T08:06:05.633 INFO:tasks.workunit.client.1.smithi194.stdout:9/309: mkdir d4/d1b/d64 0 2024-02-20T08:06:05.636 INFO:tasks.workunit.client.1.smithi194.stdout:8/265: mknod d2/d4d/c60 0 2024-02-20T08:06:05.639 INFO:tasks.workunit.client.1.smithi194.stdout:3/276: dwrite d5/d10/d17/d1d/f22 [0,4194304] 0 2024-02-20T08:06:05.640 INFO:tasks.workunit.client.1.smithi194.stdout:0/229: write d6/f3e [814469,56452] 0 2024-02-20T08:06:05.641 INFO:tasks.workunit.client.1.smithi194.stdout:0/230: chown l5 32195 1 2024-02-20T08:06:05.642 INFO:tasks.workunit.client.1.smithi194.stdout:7/274: write f5 [2704500,76286] 0 2024-02-20T08:06:05.644 INFO:tasks.workunit.client.1.smithi194.stdout:6/370: unlink df/d18/f50 0 2024-02-20T08:06:05.646 INFO:tasks.workunit.client.1.smithi194.stdout:6/371: truncate df/d18/d19/d1d/d28/d46/d5a/f71 286194 0 2024-02-20T08:06:05.647 INFO:tasks.workunit.client.1.smithi194.stdout:6/372: write df/d42/f4f [288791,31884] 0 2024-02-20T08:06:05.651 INFO:tasks.workunit.client.1.smithi194.stdout:5/228: truncate d4/d6/d11/d15/f26 43595 0 2024-02-20T08:06:05.652 INFO:tasks.workunit.client.1.smithi194.stdout:3/277: fdatasync d5/fe 0 2024-02-20T08:06:05.652 INFO:tasks.workunit.client.1.smithi194.stdout:5/229: dread - d4/d6/d11/d15/d28/f3d zero size 2024-02-20T08:06:05.653 INFO:tasks.workunit.client.1.smithi194.stdout:3/278: dread - d5/d10/f52 zero size 2024-02-20T08:06:05.654 INFO:tasks.workunit.client.1.smithi194.stdout:0/231: write d6/d2b/d35/d42/d1e/f23 [408748,30416] 0 2024-02-20T08:06:05.655 INFO:tasks.workunit.client.1.smithi194.stdout:3/279: dread - d5/d10/d17/d1d/f47 zero size 2024-02-20T08:06:05.656 INFO:tasks.workunit.client.1.smithi194.stdout:7/275: rename c7 to d11/d2d/d38/d4a/c55 0 2024-02-20T08:06:05.657 INFO:tasks.workunit.client.1.smithi194.stdout:3/280: read d5/d10/d16/f3a [2220934,112217] 0 2024-02-20T08:06:05.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/281: write d5/d10/d17/d1d/f22 [2238387,93365] 0 2024-02-20T08:06:05.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/274: dwrite d2/d8/d12/f30 [0,4194304] 0 2024-02-20T08:06:05.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/275: rename d2 to d2/d1a/d26/d5e 22 2024-02-20T08:06:05.669 INFO:tasks.workunit.client.1.smithi194.stdout:0/232: mknod d6/d2b/d35/d42/d1e/d3c/c44 0 2024-02-20T08:06:05.670 INFO:tasks.workunit.client.1.smithi194.stdout:0/233: chown d6/d2b/d35/d42/f2f 69 1 2024-02-20T08:06:05.670 INFO:tasks.workunit.client.1.smithi194.stdout:0/234: chown d6 104 1 2024-02-20T08:06:05.671 INFO:tasks.workunit.client.1.smithi194.stdout:0/235: truncate d6/d2b/d35/d42/d1e/f2e 395001 0 2024-02-20T08:06:05.674 INFO:tasks.workunit.client.1.smithi194.stdout:7/276: symlink d11/d2d/d38/d4a/d27/l56 0 2024-02-20T08:06:05.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/277: dread - d11/d2d/d38/d4a/d27/f39 zero size 2024-02-20T08:06:05.676 INFO:tasks.workunit.client.1.smithi194.stdout:3/282: symlink d5/d10/d16/l57 0 2024-02-20T08:06:05.677 INFO:tasks.workunit.client.1.smithi194.stdout:3/283: fdatasync d5/d10/d17/d1d/f1e 0 2024-02-20T08:06:05.677 INFO:tasks.workunit.client.1.smithi194.stdout:3/284: stat d5/f34 0 2024-02-20T08:06:05.678 INFO:tasks.workunit.client.1.smithi194.stdout:3/285: truncate d5/fa 5025537 0 2024-02-20T08:06:05.681 INFO:tasks.workunit.client.1.smithi194.stdout:9/310: link d4/c18 d4/d20/d41/c65 0 2024-02-20T08:06:05.686 INFO:tasks.workunit.client.1.smithi194.stdout:1/276: creat d2/d1a/d26/d57/f5f x:0 0 0 2024-02-20T08:06:05.690 INFO:tasks.workunit.client.1.smithi194.stdout:0/236: mkdir d6/d2b/d35/d42/d1e/d45 0 2024-02-20T08:06:05.691 INFO:tasks.workunit.client.1.smithi194.stdout:6/373: creat df/d18/d19/f7a x:0 0 0 2024-02-20T08:06:05.693 INFO:tasks.workunit.client.1.smithi194.stdout:7/278: mknod d11/d2d/d38/d4a/c57 0 2024-02-20T08:06:05.694 INFO:tasks.workunit.client.1.smithi194.stdout:7/279: chown d11/d2d/d38/d37/f4b 459504090 1 2024-02-20T08:06:05.698 INFO:tasks.workunit.client.1.smithi194.stdout:9/311: write d4/d20/d5c/f24 [623904,27994] 0 2024-02-20T08:06:05.701 INFO:tasks.workunit.client.1.smithi194.stdout:7/280: dwrite d11/d3b/f3d [0,4194304] 0 2024-02-20T08:06:05.702 INFO:tasks.workunit.client.1.smithi194.stdout:0/237: write d6/f1a [1198560,113640] 0 2024-02-20T08:06:05.703 INFO:tasks.workunit.client.1.smithi194.stdout:6/374: mknod df/d18/d19/d1d/d28/d46/d5a/c7b 0 2024-02-20T08:06:05.703 INFO:tasks.workunit.client.1.smithi194.stdout:7/281: write d11/d2d/d38/f28 [4514493,112830] 0 2024-02-20T08:06:05.704 INFO:tasks.workunit.client.1.smithi194.stdout:7/282: chown d11 4535 1 2024-02-20T08:06:05.708 INFO:tasks.workunit.client.1.smithi194.stdout:5/230: read d4/d6/d11/d15/f26 [29748,77300] 0 2024-02-20T08:06:05.708 INFO:tasks.workunit.client.1.smithi194.stdout:9/312: symlink d4/d2d/l66 0 2024-02-20T08:06:05.711 INFO:tasks.workunit.client.1.smithi194.stdout:1/277: mkdir d2/d8/d60 0 2024-02-20T08:06:05.712 INFO:tasks.workunit.client.1.smithi194.stdout:1/278: fdatasync d2/d8/d12/f41 0 2024-02-20T08:06:05.712 INFO:tasks.workunit.client.1.smithi194.stdout:0/238: dread d6/d2b/d35/d42/f2f [0,4194304] 0 2024-02-20T08:06:05.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/283: chown d11/d2d/d38/d4a/d27/f2b 55146 1 2024-02-20T08:06:05.724 INFO:tasks.workunit.client.1.smithi194.stdout:1/279: mkdir d2/d1a/d61 0 2024-02-20T08:06:05.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/280: dread - d2/d8/dc/f56 zero size 2024-02-20T08:06:05.726 INFO:tasks.workunit.client.1.smithi194.stdout:1/281: truncate d2/f4b 1042525 0 2024-02-20T08:06:05.736 INFO:tasks.workunit.client.1.smithi194.stdout:5/231: rename d4/d6/dd/f17 to d4/d1c/f3e 0 2024-02-20T08:06:05.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/239: mkdir d6/d2b/d35/d42/d1e/d3c/d43/d46 0 2024-02-20T08:06:05.742 INFO:tasks.workunit.client.1.smithi194.stdout:9/313: dwrite d4/d20/d43/d51/f3b [0,4194304] 0 2024-02-20T08:06:05.742 INFO:tasks.workunit.client.1.smithi194.stdout:6/375: link df/d18/d19/d1d/d28/f48 df/d18/d19/d1d/d28/d2b/f7c 0 2024-02-20T08:06:05.748 INFO:tasks.workunit.client.1.smithi194.stdout:5/232: creat d4/d1c/f3f x:0 0 0 2024-02-20T08:06:05.757 INFO:tasks.workunit.client.1.smithi194.stdout:6/376: mkdir df/d18/d19/d1d/d28/d46/d5a/d7d 0 2024-02-20T08:06:05.763 INFO:tasks.workunit.client.1.smithi194.stdout:2/292: sync 2024-02-20T08:06:05.764 INFO:tasks.workunit.client.1.smithi194.stdout:7/284: write d11/f12 [9876685,72193] 0 2024-02-20T08:06:05.765 INFO:tasks.workunit.client.1.smithi194.stdout:2/293: chown df/d14/d19/c4b 404543037 1 2024-02-20T08:06:05.766 INFO:tasks.workunit.client.1.smithi194.stdout:1/282: chown d2/d1a/d26/d57/d58 114 1 2024-02-20T08:06:05.766 INFO:tasks.workunit.client.1.smithi194.stdout:2/294: chown df/f2b 89988965 1 2024-02-20T08:06:05.769 INFO:tasks.workunit.client.1.smithi194.stdout:9/314: creat d4/d55/f67 x:0 0 0 2024-02-20T08:06:05.771 INFO:tasks.workunit.client.1.smithi194.stdout:5/233: dread d4/d6/d11/d15/f2a [0,4194304] 0 2024-02-20T08:06:05.772 INFO:tasks.workunit.client.1.smithi194.stdout:6/377: unlink df/d18/d19/d1d/d28/d46/f6f 0 2024-02-20T08:06:05.786 INFO:tasks.workunit.client.1.smithi194.stdout:1/283: write d2/d1a/d26/d3d/f4d [789319,88053] 0 2024-02-20T08:06:05.786 INFO:tasks.workunit.client.1.smithi194.stdout:7/285: creat d11/d2d/d38/d4a/d53/f58 x:0 0 0 2024-02-20T08:06:05.787 INFO:tasks.workunit.client.1.smithi194.stdout:1/284: chown d2/d8/dc/d34 138 1 2024-02-20T08:06:05.787 INFO:tasks.workunit.client.1.smithi194.stdout:2/295: creat df/d14/d19/d5c/f5e x:0 0 0 2024-02-20T08:06:05.788 INFO:tasks.workunit.client.1.smithi194.stdout:7/286: dread - d11/d2d/d38/d4a/d27/f4e zero size 2024-02-20T08:06:05.794 INFO:tasks.workunit.client.1.smithi194.stdout:6/378: dwrite df/d18/d19/d1d/d28/d2b/f7c [0,4194304] 0 2024-02-20T08:06:05.796 INFO:tasks.workunit.client.1.smithi194.stdout:1/285: dread d2/d1a/d26/d3d/d59/f5a [0,4194304] 0 2024-02-20T08:06:05.797 INFO:tasks.workunit.client.1.smithi194.stdout:1/286: stat d2/d8/dc/f46 0 2024-02-20T08:06:05.799 INFO:tasks.workunit.client.1.smithi194.stdout:9/315: link d4/d20/d5c/f8 d4/f68 0 2024-02-20T08:06:05.799 INFO:tasks.workunit.client.1.smithi194.stdout:5/234: dwrite d4/fc [4194304,4194304] 0 2024-02-20T08:06:05.802 INFO:tasks.workunit.client.1.smithi194.stdout:2/296: rename df/d14/d19/l1c to df/d5b/l5f 0 2024-02-20T08:06:05.803 INFO:tasks.workunit.client.1.smithi194.stdout:2/297: write df/f4d [533359,95581] 0 2024-02-20T08:06:05.807 INFO:tasks.workunit.client.1.smithi194.stdout:6/379: unlink df/d18/d19/d1d/l73 0 2024-02-20T08:06:05.809 INFO:tasks.workunit.client.1.smithi194.stdout:7/287: creat d11/d2d/d38/d37/f59 x:0 0 0 2024-02-20T08:06:05.811 INFO:tasks.workunit.client.1.smithi194.stdout:1/287: symlink d2/l62 0 2024-02-20T08:06:05.812 INFO:tasks.workunit.client.1.smithi194.stdout:1/288: dread - d2/d8/dc/d34/f4c zero size 2024-02-20T08:06:05.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/235: symlink d4/d6/l40 0 2024-02-20T08:06:05.815 INFO:tasks.workunit.client.1.smithi194.stdout:7/288: mkdir d11/d2d/d38/d5a 0 2024-02-20T08:06:05.816 INFO:tasks.workunit.client.1.smithi194.stdout:7/289: read fd [2218221,90419] 0 2024-02-20T08:06:05.816 INFO:tasks.workunit.client.1.smithi194.stdout:7/290: chown d11/d2d/d38/d4a 145256579 1 2024-02-20T08:06:05.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/289: mknod d2/d8/df/c63 0 2024-02-20T08:06:05.817 INFO:tasks.workunit.client.1.smithi194.stdout:7/291: stat d11/d2d/d38/d4a/l17 0 2024-02-20T08:06:05.817 INFO:tasks.workunit.client.1.smithi194.stdout:5/236: symlink d4/d6/d11/d2f/l41 0 2024-02-20T08:06:05.820 INFO:tasks.workunit.client.1.smithi194.stdout:6/380: rename df/d18/d19/d1d/d28/l20 to df/d18/d19/d1d/d28/d5e/l7e 0 2024-02-20T08:06:05.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/292: dread f5 [0,4194304] 0 2024-02-20T08:06:05.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/290: dwrite d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:05.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/237: fdatasync d4/d6/fa 0 2024-02-20T08:06:05.828 INFO:tasks.workunit.client.1.smithi194.stdout:5/238: truncate d4/d6/d11/d15/f26 553320 0 2024-02-20T08:06:05.829 INFO:tasks.workunit.client.1.smithi194.stdout:1/291: getdents d2/d8/d60 0 2024-02-20T08:06:05.833 INFO:tasks.workunit.client.1.smithi194.stdout:6/381: rename df/d18/c37 to df/d18/d19/d1d/d28/d2b/c7f 0 2024-02-20T08:06:05.838 INFO:tasks.workunit.client.1.smithi194.stdout:1/292: unlink d2/d8/d12/f30 0 2024-02-20T08:06:05.839 INFO:tasks.workunit.client.1.smithi194.stdout:6/382: dwrite df/f5d [0,4194304] 0 2024-02-20T08:06:05.839 INFO:tasks.workunit.client.1.smithi194.stdout:1/293: chown d2/d1a/d26/d57/f5f 36632 1 2024-02-20T08:06:05.840 INFO:tasks.workunit.client.1.smithi194.stdout:1/294: readlink d2/d8/d12/l17 0 2024-02-20T08:06:05.841 INFO:tasks.workunit.client.1.smithi194.stdout:5/239: rename d4/d6/dd/d25/c38 to d4/c42 0 2024-02-20T08:06:05.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/293: fsync d11/d2d/d38/d37/f59 0 2024-02-20T08:06:05.848 INFO:tasks.workunit.client.1.smithi194.stdout:6/383: dwrite df/d18/f33 [0,4194304] 0 2024-02-20T08:06:05.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/298: dwrite fc [0,4194304] 0 2024-02-20T08:06:05.851 INFO:tasks.workunit.client.1.smithi194.stdout:2/299: stat df/d14/d19/f23 0 2024-02-20T08:06:05.853 INFO:tasks.workunit.client.1.smithi194.stdout:1/295: unlink d2/d8/dc/l5b 0 2024-02-20T08:06:05.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/211: sync 2024-02-20T08:06:05.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/212: stat d0/df/d25/l33 0 2024-02-20T08:06:05.856 INFO:tasks.workunit.client.1.smithi194.stdout:7/294: symlink d11/l5b 0 2024-02-20T08:06:05.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/295: dread d11/d2d/f24 [0,4194304] 0 2024-02-20T08:06:05.864 INFO:tasks.workunit.client.1.smithi194.stdout:2/300: read df/d14/d24/f35 [552395,83631] 0 2024-02-20T08:06:05.870 INFO:tasks.workunit.client.1.smithi194.stdout:1/296: rename d2/d1a/d26/d3d/d59/f5a to d2/d48/f64 0 2024-02-20T08:06:05.871 INFO:tasks.workunit.client.1.smithi194.stdout:1/297: chown d2/d8/df/l18 584371 1 2024-02-20T08:06:05.872 INFO:tasks.workunit.client.1.smithi194.stdout:1/298: chown d2/d8/d12/l20 188805 1 2024-02-20T08:06:05.875 INFO:tasks.workunit.client.1.smithi194.stdout:5/240: creat d4/d20/d2b/f43 x:0 0 0 2024-02-20T08:06:05.876 INFO:tasks.workunit.client.1.smithi194.stdout:5/241: dread - d4/d6/d11/d15/f34 zero size 2024-02-20T08:06:05.877 INFO:tasks.workunit.client.1.smithi194.stdout:5/242: write d4/d6/d11/d15/d28/f3d [185526,89653] 0 2024-02-20T08:06:05.877 INFO:tasks.workunit.client.1.smithi194.stdout:6/384: mkdir df/d18/d19/d1d/d28/d2b/d80 0 2024-02-20T08:06:05.880 INFO:tasks.workunit.client.1.smithi194.stdout:2/301: mkdir df/d14/d19/d5c/d60 0 2024-02-20T08:06:05.884 INFO:tasks.workunit.client.1.smithi194.stdout:5/243: dwrite d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:05.888 INFO:tasks.workunit.client.1.smithi194.stdout:1/299: creat d2/d8/df/f65 x:0 0 0 2024-02-20T08:06:05.889 INFO:tasks.workunit.client.1.smithi194.stdout:7/296: write d11/d2d/d38/d4a/d27/f29 [5113027,6803] 0 2024-02-20T08:06:05.890 INFO:tasks.workunit.client.1.smithi194.stdout:7/297: readlink d11/d2d/l48 0 2024-02-20T08:06:05.890 INFO:tasks.workunit.client.1.smithi194.stdout:7/298: stat d11/l5b 0 2024-02-20T08:06:05.895 INFO:tasks.workunit.client.1.smithi194.stdout:6/385: unlink f2 0 2024-02-20T08:06:05.896 INFO:tasks.workunit.client.1.smithi194.stdout:6/386: write df/d42/f4f [4682265,84894] 0 2024-02-20T08:06:05.898 INFO:tasks.workunit.client.1.smithi194.stdout:7/299: dread d11/d2d/d38/d4a/d27/f2b [0,4194304] 0 2024-02-20T08:06:05.898 INFO:tasks.workunit.client.1.smithi194.stdout:2/302: mkdir df/d5b/d61 0 2024-02-20T08:06:05.899 INFO:tasks.workunit.client.1.smithi194.stdout:5/244: mknod d4/d20/d2b/c44 0 2024-02-20T08:06:05.900 INFO:tasks.workunit.client.1.smithi194.stdout:5/245: write d4/fc [5657370,117904] 0 2024-02-20T08:06:05.902 INFO:tasks.workunit.client.1.smithi194.stdout:3/286: sync 2024-02-20T08:06:05.902 INFO:tasks.workunit.client.1.smithi194.stdout:8/266: sync 2024-02-20T08:06:05.903 INFO:tasks.workunit.client.1.smithi194.stdout:1/300: unlink d2/l1e 0 2024-02-20T08:06:05.911 INFO:tasks.workunit.client.1.smithi194.stdout:4/213: getdents d0/df/d18 0 2024-02-20T08:06:05.914 INFO:tasks.workunit.client.1.smithi194.stdout:7/300: write d11/d2d/d38/d37/d3c/f4c [605799,126187] 0 2024-02-20T08:06:05.916 INFO:tasks.workunit.client.1.smithi194.stdout:8/267: creat d2/d14/d18/f61 x:0 0 0 2024-02-20T08:06:05.923 INFO:tasks.workunit.client.1.smithi194.stdout:2/303: creat df/d14/d5d/f62 x:0 0 0 2024-02-20T08:06:05.927 INFO:tasks.workunit.client.1.smithi194.stdout:7/301: dread d11/d2d/d38/f28 [0,4194304] 0 2024-02-20T08:06:05.937 INFO:tasks.workunit.client.1.smithi194.stdout:8/268: truncate d2/f2e 63096 0 2024-02-20T08:06:05.937 INFO:tasks.workunit.client.1.smithi194.stdout:8/269: chown d2/d14/d18/c1d 65 1 2024-02-20T08:06:05.937 INFO:tasks.workunit.client.1.smithi194.stdout:5/246: truncate d4/fc 5858479 0 2024-02-20T08:06:05.941 INFO:tasks.workunit.client.1.smithi194.stdout:6/387: creat df/d18/f81 x:0 0 0 2024-02-20T08:06:05.942 INFO:tasks.workunit.client.1.smithi194.stdout:8/270: dwrite d2/f37 [0,4194304] 0 2024-02-20T08:06:05.943 INFO:tasks.workunit.client.1.smithi194.stdout:2/304: rmdir df/d14/d19 39 2024-02-20T08:06:05.947 INFO:tasks.workunit.client.1.smithi194.stdout:4/214: creat d0/d36/f39 x:0 0 0 2024-02-20T08:06:05.951 INFO:tasks.workunit.client.1.smithi194.stdout:0/240: sync 2024-02-20T08:06:05.951 INFO:tasks.workunit.client.1.smithi194.stdout:9/316: sync 2024-02-20T08:06:05.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/241: read d6/d2b/d35/d42/f15 [713198,115696] 0 2024-02-20T08:06:05.956 INFO:tasks.workunit.client.1.smithi194.stdout:1/301: creat d2/d1a/d26/d3d/d59/f66 x:0 0 0 2024-02-20T08:06:05.958 INFO:tasks.workunit.client.1.smithi194.stdout:9/317: dwrite d4/d2d/d34/f44 [0,4194304] 0 2024-02-20T08:06:05.960 INFO:tasks.workunit.client.1.smithi194.stdout:9/318: write d4/d55/f67 [790639,3701] 0 2024-02-20T08:06:05.964 INFO:tasks.workunit.client.1.smithi194.stdout:9/319: chown d4/l33 0 1 2024-02-20T08:06:05.965 INFO:tasks.workunit.client.1.smithi194.stdout:0/242: dwrite d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:05.966 INFO:tasks.workunit.client.1.smithi194.stdout:5/247: fsync d4/fc 0 2024-02-20T08:06:05.966 INFO:tasks.workunit.client.1.smithi194.stdout:9/320: dread d4/d20/d43/d51/f5f [0,4194304] 0 2024-02-20T08:06:05.969 INFO:tasks.workunit.client.1.smithi194.stdout:3/287: link d5/d10/d28/c2e d5/d10/d17/d1d/d3d/c58 0 2024-02-20T08:06:05.972 INFO:tasks.workunit.client.1.smithi194.stdout:0/243: truncate d6/d2b/d35/d42/d1e/f27 864814 0 2024-02-20T08:06:05.972 INFO:tasks.workunit.client.1.smithi194.stdout:2/305: truncate fe 3123976 0 2024-02-20T08:06:05.973 INFO:tasks.workunit.client.1.smithi194.stdout:5/248: truncate d4/d6/d11/d15/d28/f3d 599245 0 2024-02-20T08:06:05.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/288: read d5/d10/d16/f3a [1996795,124279] 0 2024-02-20T08:06:05.979 INFO:tasks.workunit.client.1.smithi194.stdout:4/215: rename d0/df/d11/f24 to d0/df/d25/d2f/f3a 0 2024-02-20T08:06:05.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/271: link d2/d14/l20 d2/d14/d18/d45/l62 0 2024-02-20T08:06:05.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/272: fsync d2/d14/f49 0 2024-02-20T08:06:05.992 INFO:tasks.workunit.client.1.smithi194.stdout:6/388: creat df/d18/d19/d1d/d28/d5e/f82 x:0 0 0 2024-02-20T08:06:05.993 INFO:tasks.workunit.client.1.smithi194.stdout:0/244: symlink d6/d2b/d35/d42/d1e/d3c/l47 0 2024-02-20T08:06:05.995 INFO:tasks.workunit.client.1.smithi194.stdout:0/245: fdatasync d6/f3e 0 2024-02-20T08:06:05.997 INFO:tasks.workunit.client.1.smithi194.stdout:7/302: getdents d11/d2d 0 2024-02-20T08:06:05.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/306: read - df/d14/d19/d5c/f5e zero size 2024-02-20T08:06:05.999 INFO:tasks.workunit.client.1.smithi194.stdout:6/389: dwrite df/d18/d19/d1d/d28/d46/d5a/f71 [0,4194304] 0 2024-02-20T08:06:06.001 INFO:tasks.workunit.client.1.smithi194.stdout:6/390: dread - df/f3c zero size 2024-02-20T08:06:06.001 INFO:tasks.workunit.client.1.smithi194.stdout:2/307: write df/d3a/f53 [655488,9498] 0 2024-02-20T08:06:06.001 INFO:tasks.workunit.client.1.smithi194.stdout:3/289: creat d5/d10/d16/f59 x:0 0 0 2024-02-20T08:06:06.002 INFO:tasks.workunit.client.1.smithi194.stdout:4/216: rmdir d0/df/d11 39 2024-02-20T08:06:06.003 INFO:tasks.workunit.client.1.smithi194.stdout:4/217: write d0/d2/f1f [422640,34052] 0 2024-02-20T08:06:06.006 INFO:tasks.workunit.client.1.smithi194.stdout:4/218: chown d0/d10/c16 305811 1 2024-02-20T08:06:06.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/308: dread df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:06.015 INFO:tasks.workunit.client.1.smithi194.stdout:5/249: mknod d4/d6/dd/d3a/c45 0 2024-02-20T08:06:06.020 INFO:tasks.workunit.client.1.smithi194.stdout:5/250: dread d4/d6/dd/f36 [0,4194304] 0 2024-02-20T08:06:06.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/246: rename d6/d2b/d35/d42/d1e/d3c/d43/d46 to d6/d2b/d35/d48 0 2024-02-20T08:06:06.021 INFO:tasks.workunit.client.1.smithi194.stdout:0/247: read - d6/d2b/d35/d42/d1e/f3f zero size 2024-02-20T08:06:06.028 INFO:tasks.workunit.client.1.smithi194.stdout:9/321: rmdir d4/d1b/d64 0 2024-02-20T08:06:06.028 INFO:tasks.workunit.client.1.smithi194.stdout:9/322: readlink d4/d2d/l66 0 2024-02-20T08:06:06.029 INFO:tasks.workunit.client.1.smithi194.stdout:1/302: sync 2024-02-20T08:06:06.030 INFO:tasks.workunit.client.1.smithi194.stdout:1/303: fsync d2/d8/dc/f19 0 2024-02-20T08:06:06.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/273: mknod d2/d14/c63 0 2024-02-20T08:06:06.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/274: chown d2/d14/f34 38 1 2024-02-20T08:06:06.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/323: dread d4/de/f16 [0,4194304] 0 2024-02-20T08:06:06.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/324: chown d4/d1b/d2e/l40 2121 1 2024-02-20T08:06:06.033 INFO:tasks.workunit.client.1.smithi194.stdout:2/309: read df/d14/f1d [1745857,106795] 0 2024-02-20T08:06:06.034 INFO:tasks.workunit.client.1.smithi194.stdout:2/310: chown df/d14/d24/l45 64953609 1 2024-02-20T08:06:06.038 INFO:tasks.workunit.client.1.smithi194.stdout:7/303: creat d11/d2d/d38/d5a/f5c x:0 0 0 2024-02-20T08:06:06.038 INFO:tasks.workunit.client.1.smithi194.stdout:3/290: dread d5/d10/d17/d1d/d3d/d3f/f40 [0,4194304] 0 2024-02-20T08:06:06.045 INFO:tasks.workunit.client.1.smithi194.stdout:3/291: dwrite d5/d10/d17/d1d/f1e [4194304,4194304] 0 2024-02-20T08:06:06.045 INFO:tasks.workunit.client.1.smithi194.stdout:0/248: symlink d6/d2b/d35/d42/d1e/l49 0 2024-02-20T08:06:06.047 INFO:tasks.workunit.client.1.smithi194.stdout:0/249: write d6/d2b/d35/d42/f16 [7168428,100898] 0 2024-02-20T08:06:06.047 INFO:tasks.workunit.client.1.smithi194.stdout:3/292: write d5/d10/d17/d1d/f1e [7194035,67682] 0 2024-02-20T08:06:06.051 INFO:tasks.workunit.client.1.smithi194.stdout:2/311: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:06.056 INFO:tasks.workunit.client.1.smithi194.stdout:1/304: rmdir d2/d1a/d26/d3d/d59 39 2024-02-20T08:06:06.059 INFO:tasks.workunit.client.1.smithi194.stdout:1/305: dread - d2/d8/dc/d34/f44 zero size 2024-02-20T08:06:06.059 INFO:tasks.workunit.client.1.smithi194.stdout:3/293: dwrite d5/d10/f52 [0,4194304] 0 2024-02-20T08:06:06.062 INFO:tasks.workunit.client.1.smithi194.stdout:2/312: dwrite df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:06.069 INFO:tasks.workunit.client.1.smithi194.stdout:7/304: write d11/f14 [916552,113827] 0 2024-02-20T08:06:06.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/391: truncate df/d18/d19/d1d/d28/d46/d5a/f71 3293555 0 2024-02-20T08:06:06.072 INFO:tasks.workunit.client.1.smithi194.stdout:2/313: dread df/d3a/f53 [0,4194304] 0 2024-02-20T08:06:06.072 INFO:tasks.workunit.client.1.smithi194.stdout:3/294: dread d5/d10/d17/d1d/f1e [4194304,4194304] 0 2024-02-20T08:06:06.074 INFO:tasks.workunit.client.1.smithi194.stdout:0/250: stat d6/c40 0 2024-02-20T08:06:06.076 INFO:tasks.workunit.client.1.smithi194.stdout:4/219: creat d0/df/f3b x:0 0 0 2024-02-20T08:06:06.077 INFO:tasks.workunit.client.1.smithi194.stdout:5/251: dread d4/d1c/f3e [0,4194304] 0 2024-02-20T08:06:06.080 INFO:tasks.workunit.client.1.smithi194.stdout:3/295: read d5/d10/d28/f53 [2109271,90616] 0 2024-02-20T08:06:06.082 INFO:tasks.workunit.client.1.smithi194.stdout:6/392: dwrite df/d18/d19/d1d/d28/d5e/f69 [0,4194304] 0 2024-02-20T08:06:06.083 INFO:tasks.workunit.client.1.smithi194.stdout:9/325: symlink d4/d20/l69 0 2024-02-20T08:06:06.095 INFO:tasks.workunit.client.1.smithi194.stdout:7/305: creat d11/d2d/d38/d5a/f5d x:0 0 0 2024-02-20T08:06:06.095 INFO:tasks.workunit.client.1.smithi194.stdout:7/306: stat d11/d2d/d38/d4a/d27 0 2024-02-20T08:06:06.096 INFO:tasks.workunit.client.1.smithi194.stdout:7/307: truncate d11/d2d/d38/d37/d3c/f42 181350 0 2024-02-20T08:06:06.097 INFO:tasks.workunit.client.1.smithi194.stdout:7/308: write d11/d2d/d38/f22 [4482376,2169] 0 2024-02-20T08:06:06.098 INFO:tasks.workunit.client.1.smithi194.stdout:7/309: write d11/f35 [7364176,18463] 0 2024-02-20T08:06:06.102 INFO:tasks.workunit.client.1.smithi194.stdout:2/314: rename df/d14/d5d to df/d14/d19/d5c/d60/d63 0 2024-02-20T08:06:06.103 INFO:tasks.workunit.client.1.smithi194.stdout:2/315: write df/f4f [1332109,115350] 0 2024-02-20T08:06:06.105 INFO:tasks.workunit.client.1.smithi194.stdout:2/316: write df/f4f [2085879,118273] 0 2024-02-20T08:06:06.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/275: write d2/d14/d18/f27 [29462,113459] 0 2024-02-20T08:06:06.107 INFO:tasks.workunit.client.1.smithi194.stdout:5/252: stat d4/d6/l1a 0 2024-02-20T08:06:06.110 INFO:tasks.workunit.client.1.smithi194.stdout:6/393: write df/d18/d19/f22 [332699,105798] 0 2024-02-20T08:06:06.111 INFO:tasks.workunit.client.1.smithi194.stdout:5/253: dread d4/d6/d11/d15/d28/f3d [0,4194304] 0 2024-02-20T08:06:06.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/394: read - df/d18/d19/d1d/d28/d5e/f75 zero size 2024-02-20T08:06:06.112 INFO:tasks.workunit.client.1.smithi194.stdout:9/326: mkdir d4/d20/d43/d51/d6a 0 2024-02-20T08:06:06.114 INFO:tasks.workunit.client.1.smithi194.stdout:1/306: creat d2/d1a/d61/f67 x:0 0 0 2024-02-20T08:06:06.114 INFO:tasks.workunit.client.1.smithi194.stdout:1/307: readlink d2/d8/d12/l20 0 2024-02-20T08:06:06.118 INFO:tasks.workunit.client.1.smithi194.stdout:7/310: mkdir d11/d2d/d38/d5a/d5e 0 2024-02-20T08:06:06.122 INFO:tasks.workunit.client.1.smithi194.stdout:0/251: rename d6/d2b/d35/d42/f2f to d6/d2b/d35/d48/f4a 0 2024-02-20T08:06:06.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/296: dwrite d5/df/f11 [0,4194304] 0 2024-02-20T08:06:06.129 INFO:tasks.workunit.client.1.smithi194.stdout:5/254: write d4/d6/d11/d15/f2a [345665,43548] 0 2024-02-20T08:06:06.130 INFO:tasks.workunit.client.1.smithi194.stdout:5/255: stat d4/d6/d11/d15/l1d 0 2024-02-20T08:06:06.130 INFO:tasks.workunit.client.1.smithi194.stdout:6/395: mkdir df/d18/d19/d1d/d28/d46/d5a/d6b/d83 0 2024-02-20T08:06:06.131 INFO:tasks.workunit.client.1.smithi194.stdout:5/256: dread - d4/d6/d11/d15/f34 zero size 2024-02-20T08:06:06.133 INFO:tasks.workunit.client.1.smithi194.stdout:8/276: rename d2/f11 to d2/d14/d18/d45/d4e/f64 0 2024-02-20T08:06:06.140 INFO:tasks.workunit.client.1.smithi194.stdout:8/277: dwrite d2/d14/d18/d45/d4e/f5e [0,4194304] 0 2024-02-20T08:06:06.141 INFO:tasks.workunit.client.1.smithi194.stdout:6/396: fdatasync df/d42/f65 0 2024-02-20T08:06:06.142 INFO:tasks.workunit.client.1.smithi194.stdout:9/327: symlink d4/d20/d41/l6b 0 2024-02-20T08:06:06.144 INFO:tasks.workunit.client.1.smithi194.stdout:4/220: getdents d0/df/d25 0 2024-02-20T08:06:06.148 INFO:tasks.workunit.client.1.smithi194.stdout:5/257: rename d4/d1c to d4/d6/d11/d15/d28/d46 0 2024-02-20T08:06:06.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/258: dread - d4/d6/d11/d15/d28/f39 zero size 2024-02-20T08:06:06.166 INFO:tasks.workunit.client.1.smithi194.stdout:8/278: symlink d2/d4d/l65 0 2024-02-20T08:06:06.167 INFO:tasks.workunit.client.1.smithi194.stdout:2/317: dwrite fe [0,4194304] 0 2024-02-20T08:06:06.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/397: write df/d18/f40 [5201759,70389] 0 2024-02-20T08:06:06.174 INFO:tasks.workunit.client.1.smithi194.stdout:6/398: truncate df/d42/f4d 1631259 0 2024-02-20T08:06:06.175 INFO:tasks.workunit.client.1.smithi194.stdout:0/252: truncate d6/d2b/d35/d42/f25 8003262 0 2024-02-20T08:06:06.177 INFO:tasks.workunit.client.1.smithi194.stdout:5/259: fsync d4/d6/dd/f36 0 2024-02-20T08:06:06.178 INFO:tasks.workunit.client.1.smithi194.stdout:3/297: truncate d5/d10/f52 195192 0 2024-02-20T08:06:06.186 INFO:tasks.workunit.client.1.smithi194.stdout:3/298: dwrite d5/df/d30/f36 [0,4194304] 0 2024-02-20T08:06:06.188 INFO:tasks.workunit.client.1.smithi194.stdout:8/279: dwrite d2/f1f [0,4194304] 0 2024-02-20T08:06:06.188 INFO:tasks.workunit.client.1.smithi194.stdout:6/399: stat df/d18/d19/d1d/l24 0 2024-02-20T08:06:06.188 INFO:tasks.workunit.client.1.smithi194.stdout:3/299: dread - d5/d10/d17/d1d/d3d/f3e zero size 2024-02-20T08:06:06.193 INFO:tasks.workunit.client.1.smithi194.stdout:5/260: symlink d4/d20/l47 0 2024-02-20T08:06:06.195 INFO:tasks.workunit.client.1.smithi194.stdout:5/261: write d4/d6/d11/d15/d28/f39 [1006978,127833] 0 2024-02-20T08:06:06.196 INFO:tasks.workunit.client.1.smithi194.stdout:5/262: chown d4/d6/d11 139399371 1 2024-02-20T08:06:06.200 INFO:tasks.workunit.client.1.smithi194.stdout:2/318: symlink df/d14/l64 0 2024-02-20T08:06:06.202 INFO:tasks.workunit.client.1.smithi194.stdout:9/328: link d4/d20/d5c/l5d d4/d37/d38/l6c 0 2024-02-20T08:06:06.207 INFO:tasks.workunit.client.1.smithi194.stdout:4/221: creat d0/d2/f3c x:0 0 0 2024-02-20T08:06:06.212 INFO:tasks.workunit.client.1.smithi194.stdout:1/308: sync 2024-02-20T08:06:06.212 INFO:tasks.workunit.client.1.smithi194.stdout:7/311: sync 2024-02-20T08:06:06.212 INFO:tasks.workunit.client.1.smithi194.stdout:3/300: creat d5/d10/d16/f5a x:0 0 0 2024-02-20T08:06:06.213 INFO:tasks.workunit.client.1.smithi194.stdout:2/319: chown df/d14/d24/c52 7992 1 2024-02-20T08:06:06.214 INFO:tasks.workunit.client.1.smithi194.stdout:1/309: chown d2/d8/d12/f21 252 1 2024-02-20T08:06:06.218 INFO:tasks.workunit.client.1.smithi194.stdout:8/280: mknod d2/d14/c66 0 2024-02-20T08:06:06.220 INFO:tasks.workunit.client.1.smithi194.stdout:4/222: fsync d0/df/d25/d2f/f31 0 2024-02-20T08:06:06.221 INFO:tasks.workunit.client.1.smithi194.stdout:0/253: write d6/f17 [8253625,20061] 0 2024-02-20T08:06:06.222 INFO:tasks.workunit.client.1.smithi194.stdout:4/223: write d0/d2/f1f [2166,2644] 0 2024-02-20T08:06:06.230 INFO:tasks.workunit.client.1.smithi194.stdout:7/312: mknod d11/d2d/d38/d4a/d53/c5f 0 2024-02-20T08:06:06.235 INFO:tasks.workunit.client.1.smithi194.stdout:2/320: truncate df/d14/f1d 3325062 0 2024-02-20T08:06:06.238 INFO:tasks.workunit.client.1.smithi194.stdout:1/310: mkdir d2/d1a/d61/d68 0 2024-02-20T08:06:06.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/281: rename d2/d14/d18/d45/d4e/c5a to d2/c67 0 2024-02-20T08:06:06.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/282: write d2/d14/d18/f27 [281555,70539] 0 2024-02-20T08:06:06.250 INFO:tasks.workunit.client.1.smithi194.stdout:9/329: write d4/d20/d5c/f3e [1975892,115322] 0 2024-02-20T08:06:06.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/301: unlink d5/df/c2a 0 2024-02-20T08:06:06.258 INFO:tasks.workunit.client.1.smithi194.stdout:7/313: mkdir d11/d2d/d38/d4a/d60 0 2024-02-20T08:06:06.261 INFO:tasks.workunit.client.1.smithi194.stdout:2/321: creat df/d14/d19/d5c/f65 x:0 0 0 2024-02-20T08:06:06.265 INFO:tasks.workunit.client.1.smithi194.stdout:0/254: mknod d6/d2b/d35/d42/d1e/d45/c4b 0 2024-02-20T08:06:06.272 INFO:tasks.workunit.client.1.smithi194.stdout:9/330: rename d4/f35 to d4/de/f6d 0 2024-02-20T08:06:06.272 INFO:tasks.workunit.client.1.smithi194.stdout:9/331: chown d4/de 66198552 1 2024-02-20T08:06:06.272 INFO:tasks.workunit.client.1.smithi194.stdout:1/311: dread d2/d8/dc/f19 [0,4194304] 0 2024-02-20T08:06:06.274 INFO:tasks.workunit.client.1.smithi194.stdout:5/263: link d4/d20/d2b/f2c d4/d6/f48 0 2024-02-20T08:06:06.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/302: creat d5/d10/d17/f5b x:0 0 0 2024-02-20T08:06:06.277 INFO:tasks.workunit.client.1.smithi194.stdout:1/312: dread d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:06.277 INFO:tasks.workunit.client.1.smithi194.stdout:9/332: dwrite d4/d1b/d2e/f30 [0,4194304] 0 2024-02-20T08:06:06.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/333: stat d4/de/f2a 0 2024-02-20T08:06:06.282 INFO:tasks.workunit.client.1.smithi194.stdout:8/283: symlink d2/d14/l68 0 2024-02-20T08:06:06.285 INFO:tasks.workunit.client.1.smithi194.stdout:9/334: dwrite d4/d20/d5c/fc [0,4194304] 0 2024-02-20T08:06:06.287 INFO:tasks.workunit.client.1.smithi194.stdout:2/322: dwrite df/d14/f47 [0,4194304] 0 2024-02-20T08:06:06.288 INFO:tasks.workunit.client.1.smithi194.stdout:6/400: link df/d18/d19/d1d/d28/d2b/l34 df/d18/d19/l84 0 2024-02-20T08:06:06.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/323: dread df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:06.296 INFO:tasks.workunit.client.1.smithi194.stdout:0/255: rename d6/d2b/d35/d42/d1e/f34 to d6/d2b/d35/f4c 0 2024-02-20T08:06:06.308 INFO:tasks.workunit.client.1.smithi194.stdout:5/264: creat d4/d6/d11/d2f/f49 x:0 0 0 2024-02-20T08:06:06.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/313: fdatasync d2/d1a/d26/f32 0 2024-02-20T08:06:06.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/314: readlink d2/d8/d12/l17 0 2024-02-20T08:06:06.312 INFO:tasks.workunit.client.1.smithi194.stdout:1/315: fsync d2/d8/dc/d34/f50 0 2024-02-20T08:06:06.315 INFO:tasks.workunit.client.1.smithi194.stdout:4/224: getdents d0/d36 0 2024-02-20T08:06:06.316 INFO:tasks.workunit.client.1.smithi194.stdout:4/225: chown d0/df 65066655 1 2024-02-20T08:06:06.316 INFO:tasks.workunit.client.1.smithi194.stdout:4/226: chown d0/df/d25/d2f/f31 143844 1 2024-02-20T08:06:06.320 INFO:tasks.workunit.client.1.smithi194.stdout:8/284: mkdir d2/d14/d18/d45/d69 0 2024-02-20T08:06:06.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/314: write d11/d2d/f24 [1161184,5852] 0 2024-02-20T08:06:06.322 INFO:tasks.workunit.client.1.smithi194.stdout:8/285: read d2/fa [7976292,29507] 0 2024-02-20T08:06:06.326 INFO:tasks.workunit.client.1.smithi194.stdout:8/286: dread d2/f1f [0,4194304] 0 2024-02-20T08:06:06.326 INFO:tasks.workunit.client.1.smithi194.stdout:8/287: fsync d2/f3b 0 2024-02-20T08:06:06.328 INFO:tasks.workunit.client.1.smithi194.stdout:8/288: write d2/d14/f24 [87412,126002] 0 2024-02-20T08:06:06.347 INFO:tasks.workunit.client.1.smithi194.stdout:4/227: creat d0/df/d25/d2f/f3d x:0 0 0 2024-02-20T08:06:06.350 INFO:tasks.workunit.client.1.smithi194.stdout:7/315: creat d11/d2d/d38/d4a/d53/f61 x:0 0 0 2024-02-20T08:06:06.355 INFO:tasks.workunit.client.1.smithi194.stdout:9/335: mkdir d4/d2d/d42/d4e/d6e 0 2024-02-20T08:06:06.362 INFO:tasks.workunit.client.1.smithi194.stdout:3/303: rename d5/df/f15 to d5/d10/d28/d41/f5c 0 2024-02-20T08:06:06.362 INFO:tasks.workunit.client.1.smithi194.stdout:3/304: readlink d5/d10/d28/l46 0 2024-02-20T08:06:06.363 INFO:tasks.workunit.client.1.smithi194.stdout:3/305: write d5/f6 [1847620,53318] 0 2024-02-20T08:06:06.373 INFO:tasks.workunit.client.1.smithi194.stdout:0/256: write d6/d2b/d35/d42/f25 [4901258,92189] 0 2024-02-20T08:06:06.375 INFO:tasks.workunit.client.1.smithi194.stdout:7/316: creat d11/d2d/d38/d4a/f62 x:0 0 0 2024-02-20T08:06:06.377 INFO:tasks.workunit.client.1.smithi194.stdout:7/317: write d11/f1f [4121733,122828] 0 2024-02-20T08:06:06.377 INFO:tasks.workunit.client.1.smithi194.stdout:9/336: symlink d4/d20/d43/d51/l6f 0 2024-02-20T08:06:06.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/318: fsync d11/d3b/f3d 0 2024-02-20T08:06:06.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/324: creat df/d14/f66 x:0 0 0 2024-02-20T08:06:06.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/289: write d2/f5b [1617963,35863] 0 2024-02-20T08:06:06.388 INFO:tasks.workunit.client.1.smithi194.stdout:7/319: dread d11/f1a [0,4194304] 0 2024-02-20T08:06:06.394 INFO:tasks.workunit.client.1.smithi194.stdout:6/401: sync 2024-02-20T08:06:06.400 INFO:tasks.workunit.client.1.smithi194.stdout:0/257: symlink d6/d2b/d35/d42/d1e/d45/l4d 0 2024-02-20T08:06:06.400 INFO:tasks.workunit.client.1.smithi194.stdout:6/402: dwrite df/d18/d19/d1d/d28/d46/f6c [0,4194304] 0 2024-02-20T08:06:06.406 INFO:tasks.workunit.client.1.smithi194.stdout:6/403: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:06.410 INFO:tasks.workunit.client.1.smithi194.stdout:4/228: write d0/d2/f1a [2349174,87117] 0 2024-02-20T08:06:06.413 INFO:tasks.workunit.client.1.smithi194.stdout:9/337: read d4/d20/d5c/f46 [229005,82657] 0 2024-02-20T08:06:06.413 INFO:tasks.workunit.client.1.smithi194.stdout:9/338: write d4/d20/d43/f47 [648301,30249] 0 2024-02-20T08:06:06.413 INFO:tasks.workunit.client.1.smithi194.stdout:2/325: creat df/d14/d19/d5c/d60/f67 x:0 0 0 2024-02-20T08:06:06.415 INFO:tasks.workunit.client.1.smithi194.stdout:3/306: symlink d5/d10/l5d 0 2024-02-20T08:06:06.419 INFO:tasks.workunit.client.1.smithi194.stdout:7/320: symlink d11/d2d/d38/l63 0 2024-02-20T08:06:06.420 INFO:tasks.workunit.client.1.smithi194.stdout:5/265: getdents d4/d6/d11/d15/d28/d46 0 2024-02-20T08:06:06.421 INFO:tasks.workunit.client.1.smithi194.stdout:0/258: creat d6/d2b/d35/d42/d1e/d45/f4e x:0 0 0 2024-02-20T08:06:06.421 INFO:tasks.workunit.client.1.smithi194.stdout:2/326: chown df/d14/d19/c4b 72704 1 2024-02-20T08:06:06.422 INFO:tasks.workunit.client.1.smithi194.stdout:1/316: sync 2024-02-20T08:06:06.423 INFO:tasks.workunit.client.1.smithi194.stdout:6/404: write df/d18/d19/f7a [425440,5049] 0 2024-02-20T08:06:06.425 INFO:tasks.workunit.client.1.smithi194.stdout:4/229: dread - d0/df/d11/f2b zero size 2024-02-20T08:06:06.425 INFO:tasks.workunit.client.1.smithi194.stdout:9/339: unlink d4/d1b/f1d 0 2024-02-20T08:06:06.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/405: chown df/d18/d19/d1d/d28/d46/d5a/d6b/d83 161157793 1 2024-02-20T08:06:06.428 INFO:tasks.workunit.client.1.smithi194.stdout:3/307: write d5/fa [5743053,32948] 0 2024-02-20T08:06:06.431 INFO:tasks.workunit.client.1.smithi194.stdout:7/321: readlink d11/d3b/l50 0 2024-02-20T08:06:06.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/266: read d4/d6/dd/f36 [238272,36316] 0 2024-02-20T08:06:06.441 INFO:tasks.workunit.client.1.smithi194.stdout:1/317: dwrite d2/d8/d12/f43 [0,4194304] 0 2024-02-20T08:06:06.443 INFO:tasks.workunit.client.1.smithi194.stdout:2/327: dwrite df/d14/d19/d5c/d60/d63/f62 [0,4194304] 0 2024-02-20T08:06:06.444 INFO:tasks.workunit.client.1.smithi194.stdout:9/340: dwrite d4/f5 [4194304,4194304] 0 2024-02-20T08:06:06.453 INFO:tasks.workunit.client.1.smithi194.stdout:8/290: creat d2/d14/f6a x:0 0 0 2024-02-20T08:06:06.456 INFO:tasks.workunit.client.1.smithi194.stdout:1/318: dwrite d2/d8/dc/f14 [0,4194304] 0 2024-02-20T08:06:06.457 INFO:tasks.workunit.client.1.smithi194.stdout:5/267: dread - d4/d6/f1f zero size 2024-02-20T08:06:06.459 INFO:tasks.workunit.client.1.smithi194.stdout:5/268: write d4/d6/fa [6493349,26610] 0 2024-02-20T08:06:06.466 INFO:tasks.workunit.client.1.smithi194.stdout:7/322: creat d11/d2d/d38/d4a/d60/f64 x:0 0 0 2024-02-20T08:06:06.474 INFO:tasks.workunit.client.1.smithi194.stdout:1/319: dwrite d2/d8/df/f24 [0,4194304] 0 2024-02-20T08:06:06.482 INFO:tasks.workunit.client.1.smithi194.stdout:7/323: dwrite d11/d2d/d38/d5a/f5d [0,4194304] 0 2024-02-20T08:06:06.482 INFO:tasks.workunit.client.1.smithi194.stdout:7/324: fsync d11/d3b/f3d 0 2024-02-20T08:06:06.484 INFO:tasks.workunit.client.1.smithi194.stdout:8/291: getdents d2/d14/d18/d45 0 2024-02-20T08:06:06.488 INFO:tasks.workunit.client.1.smithi194.stdout:9/341: link d4/d37/d38/l6c d4/d1b/l70 0 2024-02-20T08:06:06.492 INFO:tasks.workunit.client.1.smithi194.stdout:1/320: dwrite d2/d8/df/f65 [0,4194304] 0 2024-02-20T08:06:06.494 INFO:tasks.workunit.client.1.smithi194.stdout:1/321: write d2/d8/df/f65 [915168,36392] 0 2024-02-20T08:06:06.496 INFO:tasks.workunit.client.1.smithi194.stdout:1/322: read d2/f4b [931917,115252] 0 2024-02-20T08:06:06.497 INFO:tasks.workunit.client.1.smithi194.stdout:1/323: chown d2/l62 175634177 1 2024-02-20T08:06:06.501 INFO:tasks.workunit.client.1.smithi194.stdout:9/342: creat d4/d20/d43/d51/f71 x:0 0 0 2024-02-20T08:06:06.505 INFO:tasks.workunit.client.1.smithi194.stdout:1/324: dwrite d2/d8/d12/f43 [0,4194304] 0 2024-02-20T08:06:06.505 INFO:tasks.workunit.client.1.smithi194.stdout:0/259: write d6/f3d [1646105,84930] 0 2024-02-20T08:06:06.511 INFO:tasks.workunit.client.1.smithi194.stdout:7/325: getdents d11/d3b 0 2024-02-20T08:06:06.512 INFO:tasks.workunit.client.1.smithi194.stdout:7/326: write d11/d2d/d38/d4a/f21 [379704,80040] 0 2024-02-20T08:06:06.513 INFO:tasks.workunit.client.1.smithi194.stdout:7/327: fdatasync fd 0 2024-02-20T08:06:06.514 INFO:tasks.workunit.client.1.smithi194.stdout:9/343: dwrite d4/f19 [0,4194304] 0 2024-02-20T08:06:06.520 INFO:tasks.workunit.client.1.smithi194.stdout:8/292: rmdir d2/d14 39 2024-02-20T08:06:06.521 INFO:tasks.workunit.client.1.smithi194.stdout:1/325: read d2/d1a/d26/f4e [1793311,91384] 0 2024-02-20T08:06:06.522 INFO:tasks.workunit.client.1.smithi194.stdout:6/406: dread df/d42/f65 [0,4194304] 0 2024-02-20T08:06:06.523 INFO:tasks.workunit.client.1.smithi194.stdout:6/407: chown df/d18/f40 10 1 2024-02-20T08:06:06.527 INFO:tasks.workunit.client.1.smithi194.stdout:7/328: symlink d11/d2d/d38/d5a/l65 0 2024-02-20T08:06:06.528 INFO:tasks.workunit.client.1.smithi194.stdout:6/408: dread df/d18/d19/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:06.533 INFO:tasks.workunit.client.1.smithi194.stdout:3/308: write d5/f8 [4375499,109342] 0 2024-02-20T08:06:06.535 INFO:tasks.workunit.client.1.smithi194.stdout:3/309: chown d5/d10/d17/d1d 21245 1 2024-02-20T08:06:06.538 INFO:tasks.workunit.client.1.smithi194.stdout:3/310: dread - d5/d10/d16/f59 zero size 2024-02-20T08:06:06.540 INFO:tasks.workunit.client.1.smithi194.stdout:8/293: dwrite d2/d14/f2c [0,4194304] 0 2024-02-20T08:06:06.540 INFO:tasks.workunit.client.1.smithi194.stdout:6/409: dwrite df/d18/d19/d1d/d28/d5e/f75 [0,4194304] 0 2024-02-20T08:06:06.546 INFO:tasks.workunit.client.1.smithi194.stdout:8/294: chown d2/d14/f15 0 1 2024-02-20T08:06:06.548 INFO:tasks.workunit.client.1.smithi194.stdout:2/328: truncate fc 4147803 0 2024-02-20T08:06:06.552 INFO:tasks.workunit.client.1.smithi194.stdout:8/295: dread - d2/f41 zero size 2024-02-20T08:06:06.555 INFO:tasks.workunit.client.1.smithi194.stdout:2/329: chown df/d14/d19/d5c/d60/f67 13 1 2024-02-20T08:06:06.556 INFO:tasks.workunit.client.1.smithi194.stdout:7/329: rename d11/d2d/d38/l63 to d11/d2d/d38/d4a/d53/l66 0 2024-02-20T08:06:06.558 INFO:tasks.workunit.client.1.smithi194.stdout:8/296: write d2/d14/f5d [933154,67726] 0 2024-02-20T08:06:06.560 INFO:tasks.workunit.client.1.smithi194.stdout:4/230: dwrite d0/df/f13 [8388608,4194304] 0 2024-02-20T08:06:06.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/311: dwrite d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:06.565 INFO:tasks.workunit.client.1.smithi194.stdout:1/326: symlink d2/d1a/d26/d57/l69 0 2024-02-20T08:06:06.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/269: dwrite d4/d6/f48 [0,4194304] 0 2024-02-20T08:06:06.571 INFO:tasks.workunit.client.1.smithi194.stdout:9/344: link d4/d20/d43/f63 d4/d1b/f72 0 2024-02-20T08:06:06.572 INFO:tasks.workunit.client.1.smithi194.stdout:4/231: truncate d0/d36/f39 18202 0 2024-02-20T08:06:06.575 INFO:tasks.workunit.client.1.smithi194.stdout:7/330: symlink d11/d2d/l67 0 2024-02-20T08:06:06.575 INFO:tasks.workunit.client.1.smithi194.stdout:6/410: dwrite df/d18/d19/d1d/d28/d46/f6c [0,4194304] 0 2024-02-20T08:06:06.585 INFO:tasks.workunit.client.1.smithi194.stdout:5/270: mkdir d4/d20/d4a 0 2024-02-20T08:06:06.587 INFO:tasks.workunit.client.1.smithi194.stdout:7/331: dwrite f5 [4194304,4194304] 0 2024-02-20T08:06:06.589 INFO:tasks.workunit.client.1.smithi194.stdout:6/411: readlink df/d18/d19/d1d/l3a 0 2024-02-20T08:06:06.589 INFO:tasks.workunit.client.1.smithi194.stdout:1/327: dread d2/d8/dc/f1f [0,4194304] 0 2024-02-20T08:06:06.592 INFO:tasks.workunit.client.1.smithi194.stdout:1/328: fsync d2/d8/dc/d34/f50 0 2024-02-20T08:06:06.593 INFO:tasks.workunit.client.1.smithi194.stdout:5/271: truncate d4/d6/d11/d15/d28/d46/f3f 434023 0 2024-02-20T08:06:06.595 INFO:tasks.workunit.client.1.smithi194.stdout:1/329: fdatasync d2/f38 0 2024-02-20T08:06:06.600 INFO:tasks.workunit.client.1.smithi194.stdout:9/345: dwrite d4/d20/d5c/f31 [0,4194304] 0 2024-02-20T08:06:06.606 INFO:tasks.workunit.client.1.smithi194.stdout:8/297: dread d2/d14/f5d [0,4194304] 0 2024-02-20T08:06:06.610 INFO:tasks.workunit.client.1.smithi194.stdout:5/272: creat d4/d20/d2b/f4b x:0 0 0 2024-02-20T08:06:06.611 INFO:tasks.workunit.client.1.smithi194.stdout:8/298: write d2/f9 [3702929,102029] 0 2024-02-20T08:06:06.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/346: symlink d4/d1b/l73 0 2024-02-20T08:06:06.616 INFO:tasks.workunit.client.1.smithi194.stdout:7/332: link l2 d11/d2d/d38/d4a/d27/d51/l68 0 2024-02-20T08:06:06.617 INFO:tasks.workunit.client.1.smithi194.stdout:5/273: mknod d4/d6/d11/d2f/c4c 0 2024-02-20T08:06:06.617 INFO:tasks.workunit.client.1.smithi194.stdout:6/412: dread df/d18/d19/d1d/d28/d2b/f51 [0,4194304] 0 2024-02-20T08:06:06.619 INFO:tasks.workunit.client.1.smithi194.stdout:8/299: creat d2/d14/d18/d45/f6b x:0 0 0 2024-02-20T08:06:06.620 INFO:tasks.workunit.client.1.smithi194.stdout:1/330: dwrite d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:06.622 INFO:tasks.workunit.client.1.smithi194.stdout:5/274: chown d4/d6/d11/d15/c19 3 1 2024-02-20T08:06:06.623 INFO:tasks.workunit.client.1.smithi194.stdout:4/232: dread d0/d2/f1a [0,4194304] 0 2024-02-20T08:06:06.623 INFO:tasks.workunit.client.1.smithi194.stdout:1/331: readlink d2/d8/l27 0 2024-02-20T08:06:06.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/413: fdatasync df/d42/f65 0 2024-02-20T08:06:06.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/300: mkdir d2/d14/d18/d45/d4e/d6c 0 2024-02-20T08:06:06.626 INFO:tasks.workunit.client.1.smithi194.stdout:0/260: sync 2024-02-20T08:06:06.626 INFO:tasks.workunit.client.1.smithi194.stdout:1/332: write d2/d8/f3c [97140,12444] 0 2024-02-20T08:06:06.630 INFO:tasks.workunit.client.1.smithi194.stdout:8/301: chown d2/d14/d18/f4a 73524889 1 2024-02-20T08:06:06.631 INFO:tasks.workunit.client.1.smithi194.stdout:5/275: creat d4/d6/d11/d2f/f4d x:0 0 0 2024-02-20T08:06:06.664 INFO:tasks.workunit.client.1.smithi194.stdout:9/347: rename d4/d55/f67 to d4/d1b/f74 0 2024-02-20T08:06:06.664 INFO:tasks.workunit.client.1.smithi194.stdout:2/330: write df/d14/f32 [4684852,60421] 0 2024-02-20T08:06:06.665 INFO:tasks.workunit.client.1.smithi194.stdout:7/333: dwrite d11/d2d/d38/d4a/d53/f58 [0,4194304] 0 2024-02-20T08:06:06.665 INFO:tasks.workunit.client.1.smithi194.stdout:8/302: fdatasync d2/d14/f34 0 2024-02-20T08:06:06.669 INFO:tasks.workunit.client.1.smithi194.stdout:9/348: dread - d4/d1b/f72 zero size 2024-02-20T08:06:06.670 INFO:tasks.workunit.client.1.smithi194.stdout:2/331: chown df/d14/d19/f23 3382619 1 2024-02-20T08:06:06.672 INFO:tasks.workunit.client.1.smithi194.stdout:9/349: stat d4/d1b/d2e/f45 0 2024-02-20T08:06:06.673 INFO:tasks.workunit.client.1.smithi194.stdout:4/233: dwrite d0/f2d [0,4194304] 0 2024-02-20T08:06:06.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/350: chown d4/d20/d41/l6b 429257 1 2024-02-20T08:06:06.676 INFO:tasks.workunit.client.1.smithi194.stdout:4/234: read - d0/d10/f22 zero size 2024-02-20T08:06:06.676 INFO:tasks.workunit.client.1.smithi194.stdout:0/261: dwrite d6/d2b/d35/f4c [0,4194304] 0 2024-02-20T08:06:06.677 INFO:tasks.workunit.client.1.smithi194.stdout:4/235: readlink d0/df/d25/l33 0 2024-02-20T08:06:06.677 INFO:tasks.workunit.client.1.smithi194.stdout:9/351: write d4/d37/f62 [521939,22351] 0 2024-02-20T08:06:06.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/352: chown d4/d37/d38 156493544 1 2024-02-20T08:06:06.681 INFO:tasks.workunit.client.1.smithi194.stdout:4/236: chown d0/df/d18/f37 2390 1 2024-02-20T08:06:06.686 INFO:tasks.workunit.client.1.smithi194.stdout:2/332: dwrite df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:06.688 INFO:tasks.workunit.client.1.smithi194.stdout:2/333: chown df/f11 25458 1 2024-02-20T08:06:06.691 INFO:tasks.workunit.client.1.smithi194.stdout:9/353: dwrite d4/d1b/f36 [0,4194304] 0 2024-02-20T08:06:06.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/303: rename d2/d14/d18/l28 to d2/d14/d18/d45/d4e/d6c/l6d 0 2024-02-20T08:06:06.696 INFO:tasks.workunit.client.1.smithi194.stdout:8/304: readlink d2/d14/d18/l2f 0 2024-02-20T08:06:06.709 INFO:tasks.workunit.client.1.smithi194.stdout:0/262: rename d6/d2b/d35/d42/l41 to d6/d2b/d35/d48/l4f 0 2024-02-20T08:06:06.710 INFO:tasks.workunit.client.1.smithi194.stdout:5/276: link d4/d6/l1a d4/d6/dd/l4e 0 2024-02-20T08:06:06.710 INFO:tasks.workunit.client.1.smithi194.stdout:0/263: write d6/d2b/d35/d42/d1e/f27 [592134,109246] 0 2024-02-20T08:06:06.712 INFO:tasks.workunit.client.1.smithi194.stdout:0/264: write d6/d2b/d35/d42/d1e/f23 [671619,78513] 0 2024-02-20T08:06:06.713 INFO:tasks.workunit.client.1.smithi194.stdout:1/333: rename d2/d1a/d26/f49 to d2/d1a/d26/f6a 0 2024-02-20T08:06:06.719 INFO:tasks.workunit.client.1.smithi194.stdout:1/334: dwrite d2/f36 [0,4194304] 0 2024-02-20T08:06:06.720 INFO:tasks.workunit.client.1.smithi194.stdout:2/334: getdents df/d3a 0 2024-02-20T08:06:06.721 INFO:tasks.workunit.client.1.smithi194.stdout:7/334: dread d11/f12 [4194304,4194304] 0 2024-02-20T08:06:06.721 INFO:tasks.workunit.client.1.smithi194.stdout:3/312: sync 2024-02-20T08:06:06.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/335: fsync d2/d8/df/f33 0 2024-02-20T08:06:06.726 INFO:tasks.workunit.client.1.smithi194.stdout:9/354: dread d4/de/f27 [0,4194304] 0 2024-02-20T08:06:06.726 INFO:tasks.workunit.client.1.smithi194.stdout:9/355: readlink d4/d1b/l73 0 2024-02-20T08:06:06.728 INFO:tasks.workunit.client.1.smithi194.stdout:5/277: rename d4/d6/d11/d15/c19 to d4/d6/d11/c4f 0 2024-02-20T08:06:06.731 INFO:tasks.workunit.client.1.smithi194.stdout:9/356: read d4/d1b/d2e/f45 [883122,116509] 0 2024-02-20T08:06:06.732 INFO:tasks.workunit.client.1.smithi194.stdout:2/335: symlink df/d14/d19/d5c/d60/d63/l68 0 2024-02-20T08:06:06.735 INFO:tasks.workunit.client.1.smithi194.stdout:4/237: dread d0/f19 [0,4194304] 0 2024-02-20T08:06:06.738 INFO:tasks.workunit.client.1.smithi194.stdout:1/336: creat d2/d8/dc/d34/f6b x:0 0 0 2024-02-20T08:06:06.738 INFO:tasks.workunit.client.1.smithi194.stdout:1/337: chown d2/d8/dc 14 1 2024-02-20T08:06:06.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/338: dread - d2/f42 zero size 2024-02-20T08:06:06.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/265: getdents d6/d2b/d35/d39 0 2024-02-20T08:06:06.740 INFO:tasks.workunit.client.1.smithi194.stdout:8/305: dread d2/d14/f49 [0,4194304] 0 2024-02-20T08:06:06.741 INFO:tasks.workunit.client.1.smithi194.stdout:8/306: dread - d2/d14/d18/d45/f6b zero size 2024-02-20T08:06:06.741 INFO:tasks.workunit.client.1.smithi194.stdout:8/307: fdatasync d2/d14/f24 0 2024-02-20T08:06:06.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/313: rename d5/d10/l5d to d5/d10/d17/d1d/d3d/d3f/l5e 0 2024-02-20T08:06:06.745 INFO:tasks.workunit.client.1.smithi194.stdout:3/314: read - d5/d10/d17/d1d/d3d/f3e zero size 2024-02-20T08:06:06.747 INFO:tasks.workunit.client.1.smithi194.stdout:5/278: mkdir d4/d6/dd/d25/d50 0 2024-02-20T08:06:06.749 INFO:tasks.workunit.client.1.smithi194.stdout:9/357: creat d4/d20/d43/f75 x:0 0 0 2024-02-20T08:06:06.749 INFO:tasks.workunit.client.1.smithi194.stdout:6/414: sync 2024-02-20T08:06:06.750 INFO:tasks.workunit.client.1.smithi194.stdout:6/415: write df/d18/d19/d1d/d28/d46/f6c [2314101,47595] 0 2024-02-20T08:06:06.756 INFO:tasks.workunit.client.1.smithi194.stdout:1/339: read d2/d1a/f3f [849474,71616] 0 2024-02-20T08:06:06.760 INFO:tasks.workunit.client.1.smithi194.stdout:8/308: creat d2/d4d/f6e x:0 0 0 2024-02-20T08:06:06.760 INFO:tasks.workunit.client.1.smithi194.stdout:9/358: dread d4/d2d/d42/f53 [0,4194304] 0 2024-02-20T08:06:06.762 INFO:tasks.workunit.client.1.smithi194.stdout:0/266: rename d6/f3e to d6/d2b/f50 0 2024-02-20T08:06:06.763 INFO:tasks.workunit.client.1.smithi194.stdout:8/309: dread d2/f1f [0,4194304] 0 2024-02-20T08:06:06.764 INFO:tasks.workunit.client.1.smithi194.stdout:8/310: read d2/d14/f2b [636155,70196] 0 2024-02-20T08:06:06.767 INFO:tasks.workunit.client.1.smithi194.stdout:6/416: creat df/d18/d19/d1d/d28/d46/d5a/d6b/f85 x:0 0 0 2024-02-20T08:06:06.768 INFO:tasks.workunit.client.1.smithi194.stdout:2/336: mknod df/d5b/d61/c69 0 2024-02-20T08:06:06.768 INFO:tasks.workunit.client.1.smithi194.stdout:6/417: readlink df/d18/d19/d1d/d28/d2b/l62 0 2024-02-20T08:06:06.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/238: mkdir d0/d2/d3e 0 2024-02-20T08:06:06.773 INFO:tasks.workunit.client.1.smithi194.stdout:6/418: dwrite df/f3c [0,4194304] 0 2024-02-20T08:06:06.779 INFO:tasks.workunit.client.1.smithi194.stdout:0/267: readlink d6/d2b/d35/d42/l2d 0 2024-02-20T08:06:06.780 INFO:tasks.workunit.client.1.smithi194.stdout:3/315: symlink d5/d10/d17/d1d/d56/l5f 0 2024-02-20T08:06:06.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/311: rename d2/d14/d18/f57 to d2/d14/d18/d45/d69/f6f 0 2024-02-20T08:06:06.797 INFO:tasks.workunit.client.1.smithi194.stdout:2/337: unlink df/f11 0 2024-02-20T08:06:06.799 INFO:tasks.workunit.client.1.smithi194.stdout:7/335: getdents d11/d2d/d38/d4a/d27 0 2024-02-20T08:06:06.800 INFO:tasks.workunit.client.1.smithi194.stdout:7/336: fdatasync d11/d2d/d38/d4a/d27/f29 0 2024-02-20T08:06:06.804 INFO:tasks.workunit.client.1.smithi194.stdout:4/239: unlink d0/d2/fb 0 2024-02-20T08:06:06.805 INFO:tasks.workunit.client.1.smithi194.stdout:5/279: truncate d4/d6/d11/d15/d28/f39 187483 0 2024-02-20T08:06:06.805 INFO:tasks.workunit.client.1.smithi194.stdout:4/240: dread - d0/d2/f3c zero size 2024-02-20T08:06:06.810 INFO:tasks.workunit.client.1.smithi194.stdout:1/340: symlink d2/d8/l6c 0 2024-02-20T08:06:06.819 INFO:tasks.workunit.client.1.smithi194.stdout:0/268: unlink d6/c26 0 2024-02-20T08:06:06.826 INFO:tasks.workunit.client.1.smithi194.stdout:8/312: symlink d2/d14/d18/d45/d4e/d6c/l70 0 2024-02-20T08:06:06.827 INFO:tasks.workunit.client.1.smithi194.stdout:8/313: fdatasync d2/f39 0 2024-02-20T08:06:06.832 INFO:tasks.workunit.client.1.smithi194.stdout:6/419: dread df/d18/d19/d1d/d28/d2b/f3e [0,4194304] 0 2024-02-20T08:06:06.837 INFO:tasks.workunit.client.1.smithi194.stdout:5/280: mknod d4/d20/c51 0 2024-02-20T08:06:06.839 INFO:tasks.workunit.client.1.smithi194.stdout:2/338: dread df/d14/f1d [0,4194304] 0 2024-02-20T08:06:06.840 INFO:tasks.workunit.client.1.smithi194.stdout:1/341: fsync d2/f42 0 2024-02-20T08:06:06.844 INFO:tasks.workunit.client.1.smithi194.stdout:0/269: creat d6/d2b/d35/d42/d1e/d45/f51 x:0 0 0 2024-02-20T08:06:06.845 INFO:tasks.workunit.client.1.smithi194.stdout:8/314: write d2/d14/f5d [896975,75966] 0 2024-02-20T08:06:06.847 INFO:tasks.workunit.client.1.smithi194.stdout:7/337: getdents d11/d3b 0 2024-02-20T08:06:06.850 INFO:tasks.workunit.client.1.smithi194.stdout:4/241: link d0/d2/f1a d0/d2/d3e/f3f 0 2024-02-20T08:06:06.851 INFO:tasks.workunit.client.1.smithi194.stdout:4/242: write d0/f34 [4983709,67748] 0 2024-02-20T08:06:06.854 INFO:tasks.workunit.client.1.smithi194.stdout:1/342: read d2/d1a/d26/f2d [802101,103883] 0 2024-02-20T08:06:06.856 INFO:tasks.workunit.client.1.smithi194.stdout:9/359: link d4/f12 d4/d20/d41/f76 0 2024-02-20T08:06:06.861 INFO:tasks.workunit.client.1.smithi194.stdout:3/316: rename d5/d10/d17/d1d/d3d/d3f to d5/df/d60 0 2024-02-20T08:06:06.862 INFO:tasks.workunit.client.1.smithi194.stdout:0/270: mknod d6/d2b/d35/d42/d1e/d45/c52 0 2024-02-20T08:06:06.863 INFO:tasks.workunit.client.1.smithi194.stdout:0/271: chown d6/f1a 92583 1 2024-02-20T08:06:06.863 INFO:tasks.workunit.client.1.smithi194.stdout:0/272: readlink d6/d2b/l2c 0 2024-02-20T08:06:06.866 INFO:tasks.workunit.client.1.smithi194.stdout:6/420: write df/d18/d19/d1d/d28/d5e/f69 [4992995,4823] 0 2024-02-20T08:06:06.867 INFO:tasks.workunit.client.1.smithi194.stdout:7/338: write d11/f1a [211113,70843] 0 2024-02-20T08:06:06.867 INFO:tasks.workunit.client.1.smithi194.stdout:6/421: chown df/c4e 79109214 1 2024-02-20T08:06:06.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/339: dread d11/d2d/d38/d37/d3c/f42 [0,4194304] 0 2024-02-20T08:06:06.869 INFO:tasks.workunit.client.1.smithi194.stdout:7/340: dread d11/d2d/d38/d37/d3c/f42 [0,4194304] 0 2024-02-20T08:06:06.871 INFO:tasks.workunit.client.1.smithi194.stdout:1/343: mknod d2/d8/dc/c6d 0 2024-02-20T08:06:06.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/360: mkdir d4/d55/d77 0 2024-02-20T08:06:06.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/361: chown d4/d20 1259324609 1 2024-02-20T08:06:06.874 INFO:tasks.workunit.client.1.smithi194.stdout:5/281: rename d4/d6/d11/d15/f34 to d4/d6/d11/d2f/f52 0 2024-02-20T08:06:06.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/317: symlink d5/d10/d17/d1d/d56/l61 0 2024-02-20T08:06:06.877 INFO:tasks.workunit.client.1.smithi194.stdout:0/273: creat d6/d2b/d35/f53 x:0 0 0 2024-02-20T08:06:06.879 INFO:tasks.workunit.client.1.smithi194.stdout:0/274: dread d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:06.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/315: link d2/f3b d2/d14/d18/d45/d69/f71 0 2024-02-20T08:06:06.880 INFO:tasks.workunit.client.1.smithi194.stdout:0/275: write d6/d2b/d35/d42/f28 [666510,65363] 0 2024-02-20T08:06:06.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/316: write d2/f9 [1116522,8869] 0 2024-02-20T08:06:06.881 INFO:tasks.workunit.client.1.smithi194.stdout:0/276: readlink d6/d2b/d35/d42/d1e/l49 0 2024-02-20T08:06:06.881 INFO:tasks.workunit.client.1.smithi194.stdout:6/422: mkdir df/d42/d86 0 2024-02-20T08:06:06.886 INFO:tasks.workunit.client.1.smithi194.stdout:2/339: link df/d14/d19/d5c/f65 df/d14/f6a 0 2024-02-20T08:06:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: pgmap v52: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.3 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-02-20T08:06:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:06 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:06.902 INFO:tasks.workunit.client.1.smithi194.stdout:0/277: mknod d6/d2b/c54 0 2024-02-20T08:06:06.913 INFO:tasks.workunit.client.1.smithi194.stdout:1/344: creat d2/d1a/d26/d45/f6e x:0 0 0 2024-02-20T08:06:06.914 INFO:tasks.workunit.client.1.smithi194.stdout:1/345: truncate d2/d8/dc/f46 228583 0 2024-02-20T08:06:06.915 INFO:tasks.workunit.client.1.smithi194.stdout:5/282: mkdir d4/d6/dd/d25/d50/d53 0 2024-02-20T08:06:06.917 INFO:tasks.workunit.client.1.smithi194.stdout:3/318: mkdir d5/d10/d62 0 2024-02-20T08:06:06.919 INFO:tasks.workunit.client.1.smithi194.stdout:1/346: dwrite d2/d8/dc/d34/f44 [0,4194304] 0 2024-02-20T08:06:06.919 INFO:tasks.workunit.client.1.smithi194.stdout:8/317: mknod d2/d14/c72 0 2024-02-20T08:06:06.920 INFO:tasks.workunit.client.1.smithi194.stdout:0/278: mkdir d6/d2b/d35/d39/d55 0 2024-02-20T08:06:06.923 INFO:tasks.workunit.client.1.smithi194.stdout:2/340: mkdir df/d14/d24/d56/d6b 0 2024-02-20T08:06:06.924 INFO:tasks.workunit.client.1.smithi194.stdout:7/341: link d11/c44 d11/d2d/d38/d4a/d27/c69 0 2024-02-20T08:06:06.925 INFO:tasks.workunit.client.1.smithi194.stdout:2/341: write df/d14/d24/f48 [285225,70546] 0 2024-02-20T08:06:06.926 INFO:tasks.workunit.client.1.smithi194.stdout:7/342: write d11/d2d/d38/d4a/d27/f29 [6118964,67755] 0 2024-02-20T08:06:06.927 INFO:tasks.workunit.client.1.smithi194.stdout:4/243: rename d0/df/d25/l33 to d0/df/l40 0 2024-02-20T08:06:06.931 INFO:tasks.workunit.client.1.smithi194.stdout:3/319: creat d5/d10/d16/f63 x:0 0 0 2024-02-20T08:06:06.932 INFO:tasks.workunit.client.1.smithi194.stdout:4/244: dwrite d0/df/f13 [8388608,4194304] 0 2024-02-20T08:06:06.936 INFO:tasks.workunit.client.1.smithi194.stdout:8/318: unlink d2/d14/d18/d45/c58 0 2024-02-20T08:06:06.937 INFO:tasks.workunit.client.1.smithi194.stdout:0/279: rmdir d6/d2b 39 2024-02-20T08:06:06.940 INFO:tasks.workunit.client.1.smithi194.stdout:6/423: dwrite df/d18/f55 [0,4194304] 0 2024-02-20T08:06:06.945 INFO:tasks.workunit.client.1.smithi194.stdout:6/424: dread df/f3c [0,4194304] 0 2024-02-20T08:06:06.946 INFO:tasks.workunit.client.1.smithi194.stdout:1/347: unlink d2/d8/df/c35 0 2024-02-20T08:06:06.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/319: rmdir d2/d4d 39 2024-02-20T08:06:06.955 INFO:tasks.workunit.client.1.smithi194.stdout:8/320: chown d2/f39 51 1 2024-02-20T08:06:06.958 INFO:tasks.workunit.client.1.smithi194.stdout:8/321: dread d2/d14/f49 [0,4194304] 0 2024-02-20T08:06:06.962 INFO:tasks.workunit.client.1.smithi194.stdout:8/322: dwrite d2/f39 [0,4194304] 0 2024-02-20T08:06:06.965 INFO:tasks.workunit.client.1.smithi194.stdout:1/348: symlink d2/d48/l6f 0 2024-02-20T08:06:06.966 INFO:tasks.workunit.client.1.smithi194.stdout:1/349: fdatasync d2/d8/dc/f46 0 2024-02-20T08:06:06.967 INFO:tasks.workunit.client.1.smithi194.stdout:4/245: mkdir d0/df/d41 0 2024-02-20T08:06:06.967 INFO:tasks.workunit.client.1.smithi194.stdout:4/246: chown d0/d10/d1c/f30 23457078 1 2024-02-20T08:06:06.969 INFO:tasks.workunit.client.1.smithi194.stdout:1/350: dread d2/f36 [0,4194304] 0 2024-02-20T08:06:06.972 INFO:tasks.workunit.client.1.smithi194.stdout:1/351: dread d2/d8/dc/f14 [0,4194304] 0 2024-02-20T08:06:06.973 INFO:tasks.workunit.client.1.smithi194.stdout:0/280: rename d6/d2b/d35/d42/f25 to d6/d2b/d35/d39/d55/f56 0 2024-02-20T08:06:06.977 INFO:tasks.workunit.client.1.smithi194.stdout:5/283: getdents d4/d6/d11 0 2024-02-20T08:06:06.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/425: creat df/d18/d19/d1d/d76/f87 x:0 0 0 2024-02-20T08:06:06.978 INFO:tasks.workunit.client.1.smithi194.stdout:5/284: truncate d4/d20/d2b/f4b 33333 0 2024-02-20T08:06:06.989 INFO:tasks.workunit.client.1.smithi194.stdout:0/281: dread d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:06.991 INFO:tasks.workunit.client.1.smithi194.stdout:1/352: unlink d2/d8/dc/f1f 0 2024-02-20T08:06:06.992 INFO:tasks.workunit.client.1.smithi194.stdout:2/342: getdents df 0 2024-02-20T08:06:06.995 INFO:tasks.workunit.client.1.smithi194.stdout:5/285: creat d4/d6/d11/d15/d28/d46/f54 x:0 0 0 2024-02-20T08:06:07.004 INFO:tasks.workunit.client.1.smithi194.stdout:1/353: write d2/d1a/f2f [1520997,63246] 0 2024-02-20T08:06:07.005 INFO:tasks.workunit.client.1.smithi194.stdout:1/354: write d2/d8/dc/f19 [716791,14739] 0 2024-02-20T08:06:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: pgmap v52: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.3 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-02-20T08:06:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:06 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:07.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/426: symlink df/d18/d19/l88 0 2024-02-20T08:06:07.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/427: write df/d18/d19/f7a [1088535,69841] 0 2024-02-20T08:06:07.010 INFO:tasks.workunit.client.1.smithi194.stdout:5/286: mknod d4/d6/dd/d25/d50/c55 0 2024-02-20T08:06:07.017 INFO:tasks.workunit.client.1.smithi194.stdout:0/282: truncate d6/d2b/d35/d42/d1e/f27 81476 0 2024-02-20T08:06:07.017 INFO:tasks.workunit.client.1.smithi194.stdout:0/283: readlink d6/d2b/d35/d42/l10 0 2024-02-20T08:06:07.018 INFO:tasks.workunit.client.1.smithi194.stdout:0/284: chown d6/d2b/d35/d42/l2d 110869 1 2024-02-20T08:06:07.020 INFO:tasks.workunit.client.1.smithi194.stdout:1/355: mknod d2/d8/df/c70 0 2024-02-20T08:06:07.021 INFO:tasks.workunit.client.1.smithi194.stdout:2/343: truncate df/d14/d24/f4e 364087 0 2024-02-20T08:06:07.021 INFO:tasks.workunit.client.1.smithi194.stdout:2/344: chown df/c44 8186 1 2024-02-20T08:06:07.026 INFO:tasks.workunit.client.1.smithi194.stdout:4/247: getdents d0/d10 0 2024-02-20T08:06:07.026 INFO:tasks.workunit.client.1.smithi194.stdout:0/285: mknod d6/d2b/d35/d42/d1e/c57 0 2024-02-20T08:06:07.029 INFO:tasks.workunit.client.1.smithi194.stdout:6/428: symlink df/d18/d19/d1d/l89 0 2024-02-20T08:06:07.032 INFO:tasks.workunit.client.1.smithi194.stdout:4/248: unlink d0/d10/c16 0 2024-02-20T08:06:07.034 INFO:tasks.workunit.client.1.smithi194.stdout:6/429: readlink df/d18/d19/l84 0 2024-02-20T08:06:07.035 INFO:tasks.workunit.client.1.smithi194.stdout:5/287: rmdir d4/d20/d4a 0 2024-02-20T08:06:07.037 INFO:tasks.workunit.client.1.smithi194.stdout:4/249: creat d0/df/d18/f42 x:0 0 0 2024-02-20T08:06:07.038 INFO:tasks.workunit.client.1.smithi194.stdout:5/288: dread d4/d6/fa [8388608,4194304] 0 2024-02-20T08:06:07.039 INFO:tasks.workunit.client.1.smithi194.stdout:4/250: read d0/d2/fe [4116681,48874] 0 2024-02-20T08:06:07.040 INFO:tasks.workunit.client.1.smithi194.stdout:2/345: rename df/f4d to df/d14/d24/f6c 0 2024-02-20T08:06:07.042 INFO:tasks.workunit.client.1.smithi194.stdout:6/430: mknod df/d18/d19/d1d/d28/d46/d5a/d6b/c8a 0 2024-02-20T08:06:07.044 INFO:tasks.workunit.client.1.smithi194.stdout:1/356: rename d2/d1a/d26/d3d/d59 to d2/d1a/d26/d3d/d71 0 2024-02-20T08:06:07.054 INFO:tasks.workunit.client.1.smithi194.stdout:4/251: unlink d0/df/d18/f42 0 2024-02-20T08:06:07.074 INFO:tasks.workunit.client.1.smithi194.stdout:4/252: symlink d0/d10/d1c/d21/l43 0 2024-02-20T08:06:07.080 INFO:tasks.workunit.client.1.smithi194.stdout:4/253: creat d0/d10/d1c/d21/f44 x:0 0 0 2024-02-20T08:06:07.081 INFO:tasks.workunit.client.1.smithi194.stdout:1/357: creat d2/d1a/d26/f72 x:0 0 0 2024-02-20T08:06:07.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/346: truncate df/d14/d24/f35 1826220 0 2024-02-20T08:06:07.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/254: rmdir d0/d36 39 2024-02-20T08:06:07.085 INFO:tasks.workunit.client.1.smithi194.stdout:4/255: truncate d0/df/f3b 485579 0 2024-02-20T08:06:07.087 INFO:tasks.workunit.client.1.smithi194.stdout:5/289: dwrite d4/fb [0,4194304] 0 2024-02-20T08:06:07.087 INFO:tasks.workunit.client.1.smithi194.stdout:1/358: truncate d2/d8/dc/f14 4419157 0 2024-02-20T08:06:07.089 INFO:tasks.workunit.client.1.smithi194.stdout:1/359: write d2/d1a/d61/f67 [559514,30465] 0 2024-02-20T08:06:07.090 INFO:tasks.workunit.client.1.smithi194.stdout:6/431: write df/d18/d19/d1d/d28/f48 [1567244,47968] 0 2024-02-20T08:06:07.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/347: chown df/d14/d24/c29 0 1 2024-02-20T08:06:07.094 INFO:tasks.workunit.client.1.smithi194.stdout:1/360: dread d2/d8/dc/f19 [0,4194304] 0 2024-02-20T08:06:07.094 INFO:tasks.workunit.client.1.smithi194.stdout:4/256: symlink d0/d10/d1c/d21/l45 0 2024-02-20T08:06:07.105 INFO:tasks.workunit.client.1.smithi194.stdout:6/432: mknod df/d18/d19/d1d/d28/d46/c8b 0 2024-02-20T08:06:07.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/257: mkdir d0/d10/d1c/d21/d46 0 2024-02-20T08:06:07.110 INFO:tasks.workunit.client.1.smithi194.stdout:4/258: dread - d0/f32 zero size 2024-02-20T08:06:07.111 INFO:tasks.workunit.client.1.smithi194.stdout:6/433: dwrite df/d18/d19/d1d/d28/d5e/f69 [4194304,4194304] 0 2024-02-20T08:06:07.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/361: dwrite d2/d1a/d26/f6a [0,4194304] 0 2024-02-20T08:06:07.116 INFO:tasks.workunit.client.1.smithi194.stdout:1/362: dread - d2/f42 zero size 2024-02-20T08:06:07.119 INFO:tasks.workunit.client.1.smithi194.stdout:1/363: write d2/d8/f3b [971656,107367] 0 2024-02-20T08:06:07.119 INFO:tasks.workunit.client.1.smithi194.stdout:5/290: dwrite d4/f12 [0,4194304] 0 2024-02-20T08:06:07.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/434: chown df/d18/d19/d1d/d28/c5b 28205 1 2024-02-20T08:06:07.126 INFO:tasks.workunit.client.1.smithi194.stdout:2/348: write df/d3a/f53 [1297329,80588] 0 2024-02-20T08:06:07.130 INFO:tasks.workunit.client.1.smithi194.stdout:6/435: dwrite fe [0,4194304] 0 2024-02-20T08:06:07.132 INFO:tasks.workunit.client.1.smithi194.stdout:6/436: write df/d18/d19/d1d/d28/d46/f6c [667412,94360] 0 2024-02-20T08:06:07.133 INFO:tasks.workunit.client.1.smithi194.stdout:5/291: mkdir d4/d6/d11/d2f/d56 0 2024-02-20T08:06:07.135 INFO:tasks.workunit.client.1.smithi194.stdout:6/437: write df/d18/d19/d1d/f23 [701421,64675] 0 2024-02-20T08:06:07.139 INFO:tasks.workunit.client.1.smithi194.stdout:1/364: creat d2/d1a/d26/d57/d58/f73 x:0 0 0 2024-02-20T08:06:07.158 INFO:tasks.workunit.client.1.smithi194.stdout:6/438: symlink df/d18/d19/l8c 0 2024-02-20T08:06:07.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/365: symlink d2/d8/dc/d34/l74 0 2024-02-20T08:06:07.160 INFO:tasks.workunit.client.1.smithi194.stdout:4/259: dwrite d0/d2/fe [0,4194304] 0 2024-02-20T08:06:07.167 INFO:tasks.workunit.client.1.smithi194.stdout:4/260: chown d0/df/d25/d2f/f3d 54 1 2024-02-20T08:06:07.169 INFO:tasks.workunit.client.1.smithi194.stdout:1/366: dwrite d2/d1a/f1d [0,4194304] 0 2024-02-20T08:06:07.171 INFO:tasks.workunit.client.1.smithi194.stdout:6/439: getdents df/d18/d19 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:6/440: creat df/d18/d19/d1d/d76/f8d x:0 0 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:4/261: dwrite d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/292: dread d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:1/367: dwrite d2/d8/dc/d34/f50 [0,4194304] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:4/262: mkdir d0/d10/d1c/d21/d46/d47 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/293: write d4/d6/d11/d15/f26 [875340,96270] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:1/368: mkdir d2/d8/d60/d75 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/294: fdatasync d4/d6/f1f 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:6/441: write df/f13 [3253061,105159] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/295: read d4/d6/d11/d15/f2a [4174957,127554] 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:5/296: readlink d4/d6/dd/l4e 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:6/442: mknod df/d18/d19/d1d/d28/d2b/c8e 0 2024-02-20T08:06:07.261 INFO:tasks.workunit.client.1.smithi194.stdout:6/443: symlink df/d18/d19/d1d/d76/l8f 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:4/263: truncate d0/f34 2655149 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:9/362: sync 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:6/444: mknod df/c90 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:9/363: chown d4/de/f16 94846938 1 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/369: truncate d2/d8/df/f65 2629922 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:6/445: write df/d18/d19/d1d/d28/d46/d5a/f64 [559978,119943] 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:6/446: rename df/d18/d19/d1d/d28 to df/d18/d19/d1d/d28/d46/d5a/d7d/d91 22 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:6/447: fsync df/d18/d19/f2c 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:5/297: write d4/d6/d11/d15/d28/f39 [103638,39317] 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:9/364: truncate d4/d20/d5c/f46 33657 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:4/264: mknod d0/d36/c48 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/370: symlink d2/d1a/d26/l76 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/371: stat d2/d8/dc/d34/f4c 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:5/298: symlink d4/d20/d2b/l57 0 2024-02-20T08:06:07.262 INFO:tasks.workunit.client.1.smithi194.stdout:4/265: unlink d0/d2/f1a 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/372: unlink d2/d1a/f2f 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/373: chown d2/d8/d60 1 1 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:9/365: symlink d4/d1b/l78 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:5/299: symlink d4/d6/d11/l58 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:5/300: dread d4/d6/dd/f36 [0,4194304] 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/374: dwrite d2/d48/f64 [4194304,4194304] 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:0/286: sync 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/349: sync 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:7/343: sync 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:3/320: sync 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:8/323: sync 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/375: mkdir d2/d8/dc/d77 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:6/448: truncate df/d18/f49 778443 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:6/449: readlink df/d18/d19/d1d/l24 0 2024-02-20T08:06:07.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/350: dwrite df/d14/f22 [0,4194304] 0 2024-02-20T08:06:07.325 INFO:tasks.workunit.client.1.smithi194.stdout:4/266: getdents d0/d10/d1c/d21/d46 0 2024-02-20T08:06:07.326 INFO:tasks.workunit.client.1.smithi194.stdout:1/376: creat d2/d8/dc/d34/f78 x:0 0 0 2024-02-20T08:06:07.327 INFO:tasks.workunit.client.1.smithi194.stdout:2/351: symlink df/d14/d19/d5c/d60/l6d 0 2024-02-20T08:06:07.331 INFO:tasks.workunit.client.1.smithi194.stdout:4/267: dread d0/f19 [0,4194304] 0 2024-02-20T08:06:07.333 INFO:tasks.workunit.client.1.smithi194.stdout:4/268: write d0/f32 [910636,10533] 0 2024-02-20T08:06:07.334 INFO:tasks.workunit.client.1.smithi194.stdout:3/321: truncate d5/d10/d17/d1d/f22 2996818 0 2024-02-20T08:06:07.334 INFO:tasks.workunit.client.1.smithi194.stdout:9/366: dwrite d4/d20/d5c/f46 [0,4194304] 0 2024-02-20T08:06:07.335 INFO:tasks.workunit.client.1.smithi194.stdout:9/367: fsync d4/d2d/d59/f5b 0 2024-02-20T08:06:07.336 INFO:tasks.workunit.client.1.smithi194.stdout:1/377: fsync d2/d1a/d26/d57/f5f 0 2024-02-20T08:06:07.341 INFO:tasks.workunit.client.1.smithi194.stdout:6/450: creat df/f92 x:0 0 0 2024-02-20T08:06:07.342 INFO:tasks.workunit.client.1.smithi194.stdout:6/451: truncate df/d18/f40 5437095 0 2024-02-20T08:06:07.344 INFO:tasks.workunit.client.1.smithi194.stdout:6/452: write df/d18/d19/d1d/d28/d5e/f69 [4744197,18815] 0 2024-02-20T08:06:07.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/352: mkdir df/d14/d24/d6e 0 2024-02-20T08:06:07.348 INFO:tasks.workunit.client.1.smithi194.stdout:2/353: truncate df/d14/d24/f6c 713214 0 2024-02-20T08:06:07.350 INFO:tasks.workunit.client.1.smithi194.stdout:1/378: fdatasync d2/d8/d12/f2b 0 2024-02-20T08:06:07.351 INFO:tasks.workunit.client.1.smithi194.stdout:7/344: getdents d11/d2d/d38/d37/d3c 0 2024-02-20T08:06:07.351 INFO:tasks.workunit.client.1.smithi194.stdout:1/379: chown d2/d8/l6c 0 1 2024-02-20T08:06:07.351 INFO:tasks.workunit.client.1.smithi194.stdout:7/345: chown f5 2 1 2024-02-20T08:06:07.352 INFO:tasks.workunit.client.1.smithi194.stdout:2/354: read df/d14/d19/d5c/d60/d63/f62 [2791100,54774] 0 2024-02-20T08:06:07.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/346: chown d11/d2d/d38/d4a/d27/f2b 2736 1 2024-02-20T08:06:07.353 INFO:tasks.workunit.client.1.smithi194.stdout:5/301: link d4/d6/d11/d2f/f4d d4/d6/dd/d25/f59 0 2024-02-20T08:06:07.354 INFO:tasks.workunit.client.1.smithi194.stdout:4/269: mknod d0/df/d41/c49 0 2024-02-20T08:06:07.356 INFO:tasks.workunit.client.1.smithi194.stdout:4/270: write d0/d10/d1c/f30 [791673,90780] 0 2024-02-20T08:06:07.361 INFO:tasks.workunit.client.1.smithi194.stdout:7/347: dwrite d11/d2d/d38/d37/d3c/f4c [0,4194304] 0 2024-02-20T08:06:07.363 INFO:tasks.workunit.client.1.smithi194.stdout:3/322: dread d5/df/f24 [0,4194304] 0 2024-02-20T08:06:07.364 INFO:tasks.workunit.client.1.smithi194.stdout:1/380: truncate d2/f36 4985808 0 2024-02-20T08:06:07.365 INFO:tasks.workunit.client.1.smithi194.stdout:9/368: truncate d4/d1b/f74 126542 0 2024-02-20T08:06:07.366 INFO:tasks.workunit.client.1.smithi194.stdout:4/271: dwrite d0/d2/f1f [0,4194304] 0 2024-02-20T08:06:07.366 INFO:tasks.workunit.client.1.smithi194.stdout:3/323: chown d5/d10/d16/f59 56 1 2024-02-20T08:06:07.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/453: mkdir df/d18/d19/d1d/d28/d46/d5a/d6b/d83/d93 0 2024-02-20T08:06:07.374 INFO:tasks.workunit.client.1.smithi194.stdout:5/302: dwrite d4/d6/d11/d15/d28/f39 [0,4194304] 0 2024-02-20T08:06:07.380 INFO:tasks.workunit.client.1.smithi194.stdout:4/272: mkdir d0/d36/d4a 0 2024-02-20T08:06:07.382 INFO:tasks.workunit.client.1.smithi194.stdout:6/454: chown df/d18/d19/l4c 435700 1 2024-02-20T08:06:07.383 INFO:tasks.workunit.client.1.smithi194.stdout:5/303: mknod d4/d20/d2b/c5a 0 2024-02-20T08:06:07.387 INFO:tasks.workunit.client.1.smithi194.stdout:4/273: unlink d0/df/d18/l23 0 2024-02-20T08:06:07.387 INFO:tasks.workunit.client.1.smithi194.stdout:4/274: chown d0/f19 10031422 1 2024-02-20T08:06:07.389 INFO:tasks.workunit.client.1.smithi194.stdout:3/324: creat d5/df/f64 x:0 0 0 2024-02-20T08:06:07.392 INFO:tasks.workunit.client.1.smithi194.stdout:5/304: dread d4/d6/f48 [0,4194304] 0 2024-02-20T08:06:07.392 INFO:tasks.workunit.client.1.smithi194.stdout:3/325: truncate d5/d10/d16/f5a 623692 0 2024-02-20T08:06:07.392 INFO:tasks.workunit.client.1.smithi194.stdout:9/369: rename d4/d2d/d34 to d4/d1b/d79 0 2024-02-20T08:06:07.393 INFO:tasks.workunit.client.1.smithi194.stdout:6/455: mkdir df/d18/d19/d1d/d28/d2b/d94 0 2024-02-20T08:06:07.395 INFO:tasks.workunit.client.1.smithi194.stdout:4/275: mknod d0/df/d41/c4b 0 2024-02-20T08:06:07.400 INFO:tasks.workunit.client.1.smithi194.stdout:5/305: dwrite d4/d6/d11/d15/d28/d46/f54 [0,4194304] 0 2024-02-20T08:06:07.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/276: creat d0/d10/d1c/d21/f4c x:0 0 0 2024-02-20T08:06:07.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/456: dwrite df/f3c [0,4194304] 0 2024-02-20T08:06:07.410 INFO:tasks.workunit.client.1.smithi194.stdout:3/326: dread d5/d10/d16/f3a [0,4194304] 0 2024-02-20T08:06:07.411 INFO:tasks.workunit.client.1.smithi194.stdout:9/370: symlink d4/d2d/d42/d4e/d6e/l7a 0 2024-02-20T08:06:07.413 INFO:tasks.workunit.client.1.smithi194.stdout:5/306: mkdir d4/d6/d5b 0 2024-02-20T08:06:07.414 INFO:tasks.workunit.client.1.smithi194.stdout:5/307: write d4/d6/d11/d15/f26 [863611,18783] 0 2024-02-20T08:06:07.415 INFO:tasks.workunit.client.1.smithi194.stdout:4/277: rename d0/df/d25 to d0/d10/d1c/d4d 0 2024-02-20T08:06:07.420 INFO:tasks.workunit.client.1.smithi194.stdout:9/371: dwrite d4/d20/d5c/f2c [0,4194304] 0 2024-02-20T08:06:07.421 INFO:tasks.workunit.client.1.smithi194.stdout:7/348: truncate fd 6791246 0 2024-02-20T08:06:07.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/308: mkdir d4/d20/d2b/d5c 0 2024-02-20T08:06:07.429 INFO:tasks.workunit.client.1.smithi194.stdout:9/372: dwrite d4/d20/d43/f75 [0,4194304] 0 2024-02-20T08:06:07.429 INFO:tasks.workunit.client.1.smithi194.stdout:1/381: write d2/f36 [3965053,98426] 0 2024-02-20T08:06:07.433 INFO:tasks.workunit.client.1.smithi194.stdout:5/309: dread d4/d6/f48 [0,4194304] 0 2024-02-20T08:06:07.437 INFO:tasks.workunit.client.1.smithi194.stdout:4/278: mkdir d0/d36/d4a/d4e 0 2024-02-20T08:06:07.439 INFO:tasks.workunit.client.1.smithi194.stdout:9/373: creat d4/de/f7b x:0 0 0 2024-02-20T08:06:07.442 INFO:tasks.workunit.client.1.smithi194.stdout:7/349: creat d11/d2d/d38/d5a/d5e/f6a x:0 0 0 2024-02-20T08:06:07.446 INFO:tasks.workunit.client.1.smithi194.stdout:6/457: dread df/d18/d19/d1d/d28/d46/d5a/f71 [0,4194304] 0 2024-02-20T08:06:07.448 INFO:tasks.workunit.client.1.smithi194.stdout:1/382: dread d2/d1a/d26/f2d [0,4194304] 0 2024-02-20T08:06:07.449 INFO:tasks.workunit.client.1.smithi194.stdout:9/374: creat d4/d20/d41/f7c x:0 0 0 2024-02-20T08:06:07.450 INFO:tasks.workunit.client.1.smithi194.stdout:7/350: mkdir d11/d2d/d38/d5a/d6b 0 2024-02-20T08:06:07.451 INFO:tasks.workunit.client.1.smithi194.stdout:7/351: fsync d11/d2d/d38/d37/f59 0 2024-02-20T08:06:07.452 INFO:tasks.workunit.client.1.smithi194.stdout:7/352: write d11/d2d/d38/d4a/d27/f29 [168126,42647] 0 2024-02-20T08:06:07.453 INFO:tasks.workunit.client.1.smithi194.stdout:5/310: unlink d4/c42 0 2024-02-20T08:06:07.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/353: chown d11/d2d/d38/d37/d3c/f4c 3 1 2024-02-20T08:06:07.454 INFO:tasks.workunit.client.1.smithi194.stdout:4/279: mkdir d0/d4f 0 2024-02-20T08:06:07.454 INFO:tasks.workunit.client.1.smithi194.stdout:7/354: dread - d11/d2d/d38/d37/f59 zero size 2024-02-20T08:06:07.471 INFO:tasks.workunit.client.1.smithi194.stdout:4/280: mknod d0/df/c50 0 2024-02-20T08:06:07.471 INFO:tasks.workunit.client.1.smithi194.stdout:3/327: dwrite d5/f6 [0,4194304] 0 2024-02-20T08:06:07.471 INFO:tasks.workunit.client.1.smithi194.stdout:0/287: sync 2024-02-20T08:06:07.472 INFO:tasks.workunit.client.1.smithi194.stdout:6/458: dread df/d18/d19/d1d/d28/d5e/f69 [0,4194304] 0 2024-02-20T08:06:07.474 INFO:tasks.workunit.client.1.smithi194.stdout:6/459: write df/d42/f4f [3540225,58795] 0 2024-02-20T08:06:07.475 INFO:tasks.workunit.client.1.smithi194.stdout:4/281: mkdir d0/d2/d51 0 2024-02-20T08:06:07.476 INFO:tasks.workunit.client.1.smithi194.stdout:4/282: write d0/d36/f39 [422437,24000] 0 2024-02-20T08:06:07.476 INFO:tasks.workunit.client.1.smithi194.stdout:0/288: dread d6/d2b/d35/f38 [0,4194304] 0 2024-02-20T08:06:07.478 INFO:tasks.workunit.client.1.smithi194.stdout:4/283: write d0/f2d [3988383,88046] 0 2024-02-20T08:06:07.482 INFO:tasks.workunit.client.1.smithi194.stdout:3/328: rename d5/d10/l43 to d5/d10/d28/l65 0 2024-02-20T08:06:07.485 INFO:tasks.workunit.client.1.smithi194.stdout:6/460: rmdir df/d18/d19/d1d/d28/d46 39 2024-02-20T08:06:07.490 INFO:tasks.workunit.client.1.smithi194.stdout:0/289: mkdir d6/d2b/d35/d42/d1e/d45/d58 0 2024-02-20T08:06:07.494 INFO:tasks.workunit.client.1.smithi194.stdout:3/329: read d5/d10/d17/f38 [1898395,99698] 0 2024-02-20T08:06:07.496 INFO:tasks.workunit.client.1.smithi194.stdout:0/290: write d6/d2b/f50 [1442690,87570] 0 2024-02-20T08:06:07.502 INFO:tasks.workunit.client.1.smithi194.stdout:3/330: mknod d5/d10/d17/d1d/d56/c66 0 2024-02-20T08:06:07.503 INFO:tasks.workunit.client.1.smithi194.stdout:0/291: mkdir d6/d2b/d35/d39/d55/d59 0 2024-02-20T08:06:07.504 INFO:tasks.workunit.client.1.smithi194.stdout:4/284: getdents d0/d36 0 2024-02-20T08:06:07.505 INFO:tasks.workunit.client.1.smithi194.stdout:3/331: dread d5/df/f24 [0,4194304] 0 2024-02-20T08:06:07.506 INFO:tasks.workunit.client.1.smithi194.stdout:0/292: creat d6/d2b/d35/d42/d1e/f5a x:0 0 0 2024-02-20T08:06:07.509 INFO:tasks.workunit.client.1.smithi194.stdout:4/285: chown d0/c12 1 1 2024-02-20T08:06:07.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/383: dwrite d2/f4b [0,4194304] 0 2024-02-20T08:06:07.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/375: dwrite d4/d1b/d2e/f45 [0,4194304] 0 2024-02-20T08:06:07.518 INFO:tasks.workunit.client.1.smithi194.stdout:4/286: dread d0/f2d [0,4194304] 0 2024-02-20T08:06:07.521 INFO:tasks.workunit.client.1.smithi194.stdout:0/293: creat d6/d2b/d35/d42/f5b x:0 0 0 2024-02-20T08:06:07.524 INFO:tasks.workunit.client.1.smithi194.stdout:3/332: getdents d5 0 2024-02-20T08:06:07.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/376: creat d4/d2d/d42/f7d x:0 0 0 2024-02-20T08:06:07.526 INFO:tasks.workunit.client.1.smithi194.stdout:0/294: symlink d6/d2b/d35/d42/d1e/d3c/l5c 0 2024-02-20T08:06:07.529 INFO:tasks.workunit.client.1.smithi194.stdout:4/287: mknod d0/df/c52 0 2024-02-20T08:06:07.531 INFO:tasks.workunit.client.1.smithi194.stdout:1/384: symlink d2/d1a/d26/l79 0 2024-02-20T08:06:07.536 INFO:tasks.workunit.client.1.smithi194.stdout:0/295: mkdir d6/d2b/d35/d42/d1e/d3c/d5d 0 2024-02-20T08:06:07.539 INFO:tasks.workunit.client.1.smithi194.stdout:4/288: dwrite d0/d2/f35 [0,4194304] 0 2024-02-20T08:06:07.540 INFO:tasks.workunit.client.1.smithi194.stdout:1/385: creat d2/d1a/d26/d3d/d71/f7a x:0 0 0 2024-02-20T08:06:07.543 INFO:tasks.workunit.client.1.smithi194.stdout:1/386: fsync d2/d1a/d61/f67 0 2024-02-20T08:06:07.546 INFO:tasks.workunit.client.1.smithi194.stdout:0/296: dread d6/d2b/d35/f4c [0,4194304] 0 2024-02-20T08:06:07.547 INFO:tasks.workunit.client.1.smithi194.stdout:9/377: creat d4/f7e x:0 0 0 2024-02-20T08:06:07.548 INFO:tasks.workunit.client.1.smithi194.stdout:4/289: rename d0/d10/d1c/d21/f4c to d0/d4f/f53 0 2024-02-20T08:06:07.552 INFO:tasks.workunit.client.1.smithi194.stdout:1/387: mknod d2/d8/dc/c7b 0 2024-02-20T08:06:07.554 INFO:tasks.workunit.client.1.smithi194.stdout:1/388: truncate d2/d8/df/f29 560464 0 2024-02-20T08:06:07.557 INFO:tasks.workunit.client.1.smithi194.stdout:9/378: creat d4/d1b/d2e/f7f x:0 0 0 2024-02-20T08:06:07.565 INFO:tasks.workunit.client.1.smithi194.stdout:4/290: mknod d0/df/d11/c54 0 2024-02-20T08:06:07.565 INFO:tasks.workunit.client.1.smithi194.stdout:0/297: symlink d6/d2b/d35/d39/d55/d59/l5e 0 2024-02-20T08:06:07.572 INFO:tasks.workunit.client.1.smithi194.stdout:6/461: write df/d18/d19/d1d/d28/d2b/f51 [1123556,52021] 0 2024-02-20T08:06:07.573 INFO:tasks.workunit.client.1.smithi194.stdout:6/462: readlink df/d18/d19/d1d/d28/d2b/l34 0 2024-02-20T08:06:07.575 INFO:tasks.workunit.client.1.smithi194.stdout:4/291: mknod d0/df/d18/c55 0 2024-02-20T08:06:07.580 INFO:tasks.workunit.client.1.smithi194.stdout:6/463: dread df/d42/f4d [0,4194304] 0 2024-02-20T08:06:07.585 INFO:tasks.workunit.client.1.smithi194.stdout:9/379: creat d4/d20/f80 x:0 0 0 2024-02-20T08:06:07.587 INFO:tasks.workunit.client.1.smithi194.stdout:6/464: symlink df/d18/d19/d1d/d76/l95 0 2024-02-20T08:06:07.589 INFO:tasks.workunit.client.1.smithi194.stdout:4/292: symlink d0/df/l56 0 2024-02-20T08:06:07.590 INFO:tasks.workunit.client.1.smithi194.stdout:4/293: chown d0/df/d11/f2b 201160519 1 2024-02-20T08:06:07.590 INFO:tasks.workunit.client.1.smithi194.stdout:4/294: fsync d0/df/f13 0 2024-02-20T08:06:07.591 INFO:tasks.workunit.client.1.smithi194.stdout:4/295: truncate d0/df/d18/f37 115007 0 2024-02-20T08:06:07.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/298: rmdir d6/d2b/d35/d42/d1e/d3c/d5d 0 2024-02-20T08:06:07.592 INFO:tasks.workunit.client.1.smithi194.stdout:0/299: readlink d6/d2b/d35/d42/d1e/d3c/l47 0 2024-02-20T08:06:07.594 INFO:tasks.workunit.client.1.smithi194.stdout:9/380: creat d4/d2d/d42/f81 x:0 0 0 2024-02-20T08:06:07.595 INFO:tasks.workunit.client.1.smithi194.stdout:9/381: chown d4/d20/d5c/f2c 1 1 2024-02-20T08:06:07.596 INFO:tasks.workunit.client.1.smithi194.stdout:4/296: dwrite d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:07.604 INFO:tasks.workunit.client.1.smithi194.stdout:6/465: mkdir df/d18/d19/d1d/d28/d2b/d94/d96 0 2024-02-20T08:06:07.607 INFO:tasks.workunit.client.1.smithi194.stdout:9/382: unlink d4/d2d/d42/f53 0 2024-02-20T08:06:07.608 INFO:tasks.workunit.client.1.smithi194.stdout:4/297: creat d0/d10/d1c/d21/f57 x:0 0 0 2024-02-20T08:06:07.612 INFO:tasks.workunit.client.1.smithi194.stdout:8/324: sync 2024-02-20T08:06:07.612 INFO:tasks.workunit.client.1.smithi194.stdout:2/355: sync 2024-02-20T08:06:07.612 INFO:tasks.workunit.client.1.smithi194.stdout:4/298: write d0/d2/fe [5189059,66038] 0 2024-02-20T08:06:07.612 INFO:tasks.workunit.client.1.smithi194.stdout:6/466: symlink df/d42/l97 0 2024-02-20T08:06:07.613 INFO:tasks.workunit.client.1.smithi194.stdout:4/299: chown d0/d10/d1c/l2a 166 1 2024-02-20T08:06:07.614 INFO:tasks.workunit.client.1.smithi194.stdout:3/333: dwrite d5/d10/d17/d1d/f1e [8388608,4194304] 0 2024-02-20T08:06:07.615 INFO:tasks.workunit.client.1.smithi194.stdout:0/300: dread d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:07.616 INFO:tasks.workunit.client.1.smithi194.stdout:3/334: dread - d5/d10/d17/d1d/f47 zero size 2024-02-20T08:06:07.617 INFO:tasks.workunit.client.1.smithi194.stdout:8/325: fsync d2/d14/f5c 0 2024-02-20T08:06:07.621 INFO:tasks.workunit.client.1.smithi194.stdout:6/467: stat df/d18/d19/d1d/d28/d2b/c7f 0 2024-02-20T08:06:07.622 INFO:tasks.workunit.client.1.smithi194.stdout:6/468: readlink df/d42/l43 0 2024-02-20T08:06:07.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/356: symlink df/d5b/d61/l6f 0 2024-02-20T08:06:07.625 INFO:tasks.workunit.client.1.smithi194.stdout:3/335: dwrite d5/f34 [0,4194304] 0 2024-02-20T08:06:07.625 INFO:tasks.workunit.client.1.smithi194.stdout:3/336: chown d5/f34 109291 1 2024-02-20T08:06:07.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/300: creat d0/d10/d1c/d21/d46/f58 x:0 0 0 2024-02-20T08:06:07.628 INFO:tasks.workunit.client.1.smithi194.stdout:4/301: chown d0/df/d18/c55 2311 1 2024-02-20T08:06:07.629 INFO:tasks.workunit.client.1.smithi194.stdout:7/355: write f5 [7800640,111910] 0 2024-02-20T08:06:07.629 INFO:tasks.workunit.client.1.smithi194.stdout:1/389: dwrite d2/d1a/d26/f2d [0,4194304] 0 2024-02-20T08:06:07.631 INFO:tasks.workunit.client.1.smithi194.stdout:8/326: write d2/d4d/f6e [787173,130334] 0 2024-02-20T08:06:07.633 INFO:tasks.workunit.client.1.smithi194.stdout:8/327: fsync d2/d14/f15 0 2024-02-20T08:06:07.634 INFO:tasks.workunit.client.1.smithi194.stdout:8/328: stat d2/f9 0 2024-02-20T08:06:07.638 INFO:tasks.workunit.client.1.smithi194.stdout:7/356: dwrite f3 [0,4194304] 0 2024-02-20T08:06:07.640 INFO:tasks.workunit.client.1.smithi194.stdout:2/357: fdatasync df/d14/d19/d5c/d60/d63/f62 0 2024-02-20T08:06:07.644 INFO:tasks.workunit.client.1.smithi194.stdout:6/469: dwrite df/d18/d19/d1d/f61 [4194304,4194304] 0 2024-02-20T08:06:07.652 INFO:tasks.workunit.client.1.smithi194.stdout:8/329: rename d2 to d2/d14/d73 22 2024-02-20T08:06:07.657 INFO:tasks.workunit.client.1.smithi194.stdout:9/383: dwrite d4/f12 [0,4194304] 0 2024-02-20T08:06:07.659 INFO:tasks.workunit.client.1.smithi194.stdout:2/358: rmdir df/d5b/d61 39 2024-02-20T08:06:07.661 INFO:tasks.workunit.client.1.smithi194.stdout:6/470: rmdir df/d18/d19/d1d 39 2024-02-20T08:06:07.662 INFO:tasks.workunit.client.1.smithi194.stdout:1/390: creat d2/d1a/d61/d68/f7c x:0 0 0 2024-02-20T08:06:07.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/391: dread - d2/f42 zero size 2024-02-20T08:06:07.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/392: dread - d2/d1a/d26/d57/f5f zero size 2024-02-20T08:06:07.667 INFO:tasks.workunit.client.1.smithi194.stdout:8/330: dread d2/d14/f2b [0,4194304] 0 2024-02-20T08:06:07.668 INFO:tasks.workunit.client.1.smithi194.stdout:8/331: readlink d2/d14/d18/d45/d4e/d6c/l70 0 2024-02-20T08:06:07.669 INFO:tasks.workunit.client.1.smithi194.stdout:8/332: write d2/d14/d18/d45/d4e/f5e [3091732,13850] 0 2024-02-20T08:06:07.669 INFO:tasks.workunit.client.1.smithi194.stdout:8/333: readlink d2/l53 0 2024-02-20T08:06:07.670 INFO:tasks.workunit.client.1.smithi194.stdout:8/334: read - d2/d14/f5c zero size 2024-02-20T08:06:07.670 INFO:tasks.workunit.client.1.smithi194.stdout:0/301: getdents d6/d2b/d35/d42/d1e/d3c/d43 0 2024-02-20T08:06:07.671 INFO:tasks.workunit.client.1.smithi194.stdout:0/302: fsync d6/d2b/d35/d42/f5b 0 2024-02-20T08:06:07.672 INFO:tasks.workunit.client.1.smithi194.stdout:0/303: dread - d6/d2b/d35/f53 zero size 2024-02-20T08:06:07.676 INFO:tasks.workunit.client.1.smithi194.stdout:1/393: truncate d2/d8/f11 2988753 0 2024-02-20T08:06:07.677 INFO:tasks.workunit.client.1.smithi194.stdout:4/302: dread d0/f34 [0,4194304] 0 2024-02-20T08:06:07.677 INFO:tasks.workunit.client.1.smithi194.stdout:1/394: stat d2/d1a/d26/d45/l5c 0 2024-02-20T08:06:07.678 INFO:tasks.workunit.client.1.smithi194.stdout:1/395: write d2/d1a/d26/f2d [1591369,103515] 0 2024-02-20T08:06:07.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/303: truncate d0/df/f3b 969305 0 2024-02-20T08:06:07.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/337: getdents d5/d10 0 2024-02-20T08:06:07.680 INFO:tasks.workunit.client.1.smithi194.stdout:5/311: sync 2024-02-20T08:06:07.680 INFO:tasks.workunit.client.1.smithi194.stdout:5/312: dread - d4/d6/d11/d2f/f4d zero size 2024-02-20T08:06:07.681 INFO:tasks.workunit.client.1.smithi194.stdout:5/313: chown d4/d6/d11/d15/d28/d46/f24 27722906 1 2024-02-20T08:06:07.684 INFO:tasks.workunit.client.1.smithi194.stdout:8/335: mknod d2/d14/d18/d45/d4e/c74 0 2024-02-20T08:06:07.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/357: truncate f3 2938942 0 2024-02-20T08:06:07.687 INFO:tasks.workunit.client.1.smithi194.stdout:7/358: write d11/d2d/d38/d4a/d27/f4e [633233,10405] 0 2024-02-20T08:06:07.688 INFO:tasks.workunit.client.1.smithi194.stdout:7/359: write d11/d2d/d38/d37/f4b [796470,12468] 0 2024-02-20T08:06:07.691 INFO:tasks.workunit.client.1.smithi194.stdout:0/304: rmdir d6/d2b/d35/d39/d55/d59 39 2024-02-20T08:06:07.692 INFO:tasks.workunit.client.1.smithi194.stdout:6/471: dread - df/d18/d19/f54 zero size 2024-02-20T08:06:07.695 INFO:tasks.workunit.client.1.smithi194.stdout:1/396: mkdir d2/d1a/d61/d7d 0 2024-02-20T08:06:07.696 INFO:tasks.workunit.client.1.smithi194.stdout:4/304: mknod d0/d10/d1c/d21/d46/c59 0 2024-02-20T08:06:07.773 INFO:tasks.workunit.client.1.smithi194.stdout:5/314: rename d4/c8 to d4/d20/c5d 0 2024-02-20T08:06:07.774 INFO:tasks.workunit.client.1.smithi194.stdout:8/336: rmdir d2/d14/d18/d45/d4e/d6c 39 2024-02-20T08:06:07.777 INFO:tasks.workunit.client.1.smithi194.stdout:9/384: creat d4/d20/f82 x:0 0 0 2024-02-20T08:06:07.781 INFO:tasks.workunit.client.1.smithi194.stdout:0/305: creat d6/d2b/d35/d42/d1e/d3c/d43/f5f x:0 0 0 2024-02-20T08:06:07.782 INFO:tasks.workunit.client.1.smithi194.stdout:0/306: fsync d6/d2b/d35/d42/f16 0 2024-02-20T08:06:07.784 INFO:tasks.workunit.client.1.smithi194.stdout:1/397: mkdir d2/d1a/d61/d7e 0 2024-02-20T08:06:07.785 INFO:tasks.workunit.client.1.smithi194.stdout:1/398: fsync d2/d8/df/f33 0 2024-02-20T08:06:07.788 INFO:tasks.workunit.client.1.smithi194.stdout:9/385: creat d4/de/f83 x:0 0 0 2024-02-20T08:06:07.791 INFO:tasks.workunit.client.1.smithi194.stdout:0/307: fdatasync d6/d2b/d35/f38 0 2024-02-20T08:06:07.792 INFO:tasks.workunit.client.1.smithi194.stdout:1/399: creat d2/d1a/d61/d68/f7f x:0 0 0 2024-02-20T08:06:07.792 INFO:tasks.workunit.client.1.smithi194.stdout:3/338: creat d5/df/f67 x:0 0 0 2024-02-20T08:06:07.794 INFO:tasks.workunit.client.1.smithi194.stdout:4/305: rename d0/d2/f1b to d0/d10/d1c/f5a 0 2024-02-20T08:06:07.795 INFO:tasks.workunit.client.1.smithi194.stdout:2/359: getdents df/d5b/d61 0 2024-02-20T08:06:07.796 INFO:tasks.workunit.client.1.smithi194.stdout:9/386: unlink d4/d20/d43/d51/l6f 0 2024-02-20T08:06:07.798 INFO:tasks.workunit.client.1.smithi194.stdout:9/387: truncate d4/d2d/d42/f7d 699321 0 2024-02-20T08:06:07.798 INFO:tasks.workunit.client.1.smithi194.stdout:7/360: link d11/d2d/d38/d4a/l17 d11/l6c 0 2024-02-20T08:06:07.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/472: mknod df/d18/d19/d1d/d28/d2b/d94/d96/c98 0 2024-02-20T08:06:07.800 INFO:tasks.workunit.client.1.smithi194.stdout:0/308: mkdir d6/d2b/d35/d48/d60 0 2024-02-20T08:06:07.803 INFO:tasks.workunit.client.1.smithi194.stdout:4/306: mknod d0/df/d18/c5b 0 2024-02-20T08:06:07.806 INFO:tasks.workunit.client.1.smithi194.stdout:1/400: link d2/d8/d12/f2c d2/d8/d60/f80 0 2024-02-20T08:06:07.808 INFO:tasks.workunit.client.1.smithi194.stdout:0/309: symlink d6/d2b/d35/d48/l61 0 2024-02-20T08:06:07.810 INFO:tasks.workunit.client.1.smithi194.stdout:8/337: link d2/d14/d18/d45/d4e/d6c/l70 d2/d4d/l75 0 2024-02-20T08:06:07.811 INFO:tasks.workunit.client.1.smithi194.stdout:9/388: symlink d4/d55/d77/l84 0 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:6/473: mkdir df/d18/d19/d1d/d99 0 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/401: unlink d2/d1a/d26/f72 0 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:4/307: dread d0/d2/f2e [0,4194304] 0 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:0/310: mkdir d6/d2b/d35/d42/d1e/d3c/d43/d62 0 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/402: dread - d2/d1a/d26/d57/f5d zero size 2024-02-20T08:06:07.816 INFO:tasks.workunit.client.1.smithi194.stdout:5/315: rename d4/d6/d11/d15/d28/f3d to d4/d6/f5e 0 2024-02-20T08:06:07.819 INFO:tasks.workunit.client.1.smithi194.stdout:9/389: creat d4/d20/d43/d51/f85 x:0 0 0 2024-02-20T08:06:07.819 INFO:tasks.workunit.client.1.smithi194.stdout:9/390: stat d4/f5 0 2024-02-20T08:06:07.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/474: mknod df/d42/c9a 0 2024-02-20T08:06:07.822 INFO:tasks.workunit.client.1.smithi194.stdout:6/475: chown df/d18/d19/d1d/d28/d2b/f2e 1170 1 2024-02-20T08:06:07.824 INFO:tasks.workunit.client.1.smithi194.stdout:0/311: creat d6/d2b/f63 x:0 0 0 2024-02-20T08:06:07.830 INFO:tasks.workunit.client.1.smithi194.stdout:2/360: rename df/d14/l5a to df/d14/d19/d5c/d60/d63/l70 0 2024-02-20T08:06:07.831 INFO:tasks.workunit.client.1.smithi194.stdout:5/316: write d4/d6/d11/f31 [4733592,125263] 0 2024-02-20T08:06:07.834 INFO:tasks.workunit.client.1.smithi194.stdout:3/339: truncate d5/df/f11 2984817 0 2024-02-20T08:06:07.834 INFO:tasks.workunit.client.1.smithi194.stdout:3/340: stat d5/d10/d17/d1d/d56 0 2024-02-20T08:06:07.835 INFO:tasks.workunit.client.1.smithi194.stdout:9/391: read d4/d20/d43/d51/f52 [14972,34889] 0 2024-02-20T08:06:07.836 INFO:tasks.workunit.client.1.smithi194.stdout:3/341: read d5/d10/f52 [36132,87995] 0 2024-02-20T08:06:07.840 INFO:tasks.workunit.client.1.smithi194.stdout:0/312: symlink d6/d2b/d35/d42/d1e/d3c/l64 0 2024-02-20T08:06:07.841 INFO:tasks.workunit.client.1.smithi194.stdout:0/313: write d6/f29 [211302,99069] 0 2024-02-20T08:06:07.842 INFO:tasks.workunit.client.1.smithi194.stdout:6/476: dread df/d18/d19/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:07.844 INFO:tasks.workunit.client.1.smithi194.stdout:7/361: rename f3 to d11/d3b/f6d 0 2024-02-20T08:06:07.846 INFO:tasks.workunit.client.1.smithi194.stdout:2/361: mknod df/d14/d24/d56/c71 0 2024-02-20T08:06:07.848 INFO:tasks.workunit.client.1.smithi194.stdout:8/338: dwrite d2/d14/f2b [0,4194304] 0 2024-02-20T08:06:07.849 INFO:tasks.workunit.client.1.smithi194.stdout:1/403: write d2/d8/d12/f52 [4775997,33064] 0 2024-02-20T08:06:07.849 INFO:tasks.workunit.client.1.smithi194.stdout:3/342: write d5/df/d60/f40 [2004092,85654] 0 2024-02-20T08:06:07.850 INFO:tasks.workunit.client.1.smithi194.stdout:1/404: fdatasync d2/d1a/d26/d57/f5d 0 2024-02-20T08:06:07.851 INFO:tasks.workunit.client.1.smithi194.stdout:1/405: readlink d2/l62 0 2024-02-20T08:06:07.851 INFO:tasks.workunit.client.1.smithi194.stdout:3/343: chown d5/d10/d16/f59 0 1 2024-02-20T08:06:07.854 INFO:tasks.workunit.client.1.smithi194.stdout:0/314: chown d6/c40 737 1 2024-02-20T08:06:07.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/362: truncate d11/f2c 1328956 0 2024-02-20T08:06:07.858 INFO:tasks.workunit.client.1.smithi194.stdout:3/344: dwrite d5/f8 [4194304,4194304] 0 2024-02-20T08:06:07.865 INFO:tasks.workunit.client.1.smithi194.stdout:0/315: dwrite d6/d2b/f63 [0,4194304] 0 2024-02-20T08:06:07.867 INFO:tasks.workunit.client.1.smithi194.stdout:4/308: getdents d0/df/d11 0 2024-02-20T08:06:07.868 INFO:tasks.workunit.client.1.smithi194.stdout:0/316: dread d6/f29 [0,4194304] 0 2024-02-20T08:06:07.870 INFO:tasks.workunit.client.1.smithi194.stdout:1/406: creat d2/d8/d12/f81 x:0 0 0 2024-02-20T08:06:07.870 INFO:tasks.workunit.client.1.smithi194.stdout:6/477: mkdir df/d18/d19/d1d/d28/d2b/d9b 0 2024-02-20T08:06:07.871 INFO:tasks.workunit.client.1.smithi194.stdout:1/407: write d2/d1a/d26/d3d/d71/f66 [206001,79550] 0 2024-02-20T08:06:07.872 INFO:tasks.workunit.client.1.smithi194.stdout:7/363: mkdir d11/d6e 0 2024-02-20T08:06:07.873 INFO:tasks.workunit.client.1.smithi194.stdout:7/364: chown d11/d2d/d38/d4a/c45 2901 1 2024-02-20T08:06:07.873 INFO:tasks.workunit.client.1.smithi194.stdout:3/345: mknod d5/d10/d17/d1d/c68 0 2024-02-20T08:06:07.875 INFO:tasks.workunit.client.1.smithi194.stdout:5/317: link d4/d20/d2b/l57 d4/d20/l5f 0 2024-02-20T08:06:07.877 INFO:tasks.workunit.client.1.smithi194.stdout:9/392: creat d4/d37/f86 x:0 0 0 2024-02-20T08:06:07.881 INFO:tasks.workunit.client.1.smithi194.stdout:7/365: creat d11/d3b/f6f x:0 0 0 2024-02-20T08:06:07.882 INFO:tasks.workunit.client.1.smithi194.stdout:2/362: creat df/f72 x:0 0 0 2024-02-20T08:06:07.883 INFO:tasks.workunit.client.1.smithi194.stdout:5/318: rename d4/f10 to d4/d6/d5b/f60 0 2024-02-20T08:06:07.884 INFO:tasks.workunit.client.1.smithi194.stdout:4/309: mkdir d0/d5c 0 2024-02-20T08:06:07.884 INFO:tasks.workunit.client.1.smithi194.stdout:5/319: write d4/d6/dd/f2d [268132,130960] 0 2024-02-20T08:06:07.950 INFO:tasks.workunit.client.1.smithi194.stdout:8/339: creat d2/d14/f76 x:0 0 0 2024-02-20T08:06:07.952 INFO:tasks.workunit.client.1.smithi194.stdout:0/317: mknod d6/d2b/d35/d42/d1e/d45/d58/c65 0 2024-02-20T08:06:07.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/318: write d6/f3d [889657,14219] 0 2024-02-20T08:06:07.953 INFO:tasks.workunit.client.1.smithi194.stdout:1/408: mkdir d2/d1a/d26/d3d/d82 0 2024-02-20T08:06:07.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/319: chown d6/d2b/d35/d42/f24 6151 1 2024-02-20T08:06:07.955 INFO:tasks.workunit.client.1.smithi194.stdout:0/320: write d6/d2b/d35/f53 [946584,32257] 0 2024-02-20T08:06:07.955 INFO:tasks.workunit.client.1.smithi194.stdout:1/409: truncate d2/d8/dc/d34/f44 4855633 0 2024-02-20T08:06:07.956 INFO:tasks.workunit.client.1.smithi194.stdout:7/366: chown d11/d2d/d38/d4a/c55 4069 1 2024-02-20T08:06:07.962 INFO:tasks.workunit.client.1.smithi194.stdout:7/367: dread d11/d2d/f24 [0,4194304] 0 2024-02-20T08:06:07.963 INFO:tasks.workunit.client.1.smithi194.stdout:9/393: getdents d4/d37/d4f 0 2024-02-20T08:06:07.964 INFO:tasks.workunit.client.1.smithi194.stdout:9/394: chown d4/d2d/d42 281 1 2024-02-20T08:06:07.964 INFO:tasks.workunit.client.1.smithi194.stdout:4/310: write d0/d10/d1c/d4d/f38 [331310,80598] 0 2024-02-20T08:06:07.967 INFO:tasks.workunit.client.1.smithi194.stdout:4/311: write d0/d10/d1c/d21/f57 [591278,83448] 0 2024-02-20T08:06:07.968 INFO:tasks.workunit.client.1.smithi194.stdout:7/368: dwrite d11/f1a [0,4194304] 0 2024-02-20T08:06:07.971 INFO:tasks.workunit.client.1.smithi194.stdout:6/478: link df/d18/d19/d1d/f31 df/d18/d19/d1d/d28/d2b/d94/d96/f9c 0 2024-02-20T08:06:07.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/321: mknod d6/d2b/d35/d42/d1e/d45/d58/c66 0 2024-02-20T08:06:07.976 INFO:tasks.workunit.client.1.smithi194.stdout:1/410: fdatasync d2/d8/dc/f56 0 2024-02-20T08:06:07.981 INFO:tasks.workunit.client.1.smithi194.stdout:9/395: fsync d4/d1b/f72 0 2024-02-20T08:06:07.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/369: rmdir d11/d3b 39 2024-02-20T08:06:07.993 INFO:tasks.workunit.client.1.smithi194.stdout:7/370: dwrite d11/d2d/d38/d37/d3c/f4c [4194304,4194304] 0 2024-02-20T08:06:07.994 INFO:tasks.workunit.client.1.smithi194.stdout:3/346: getdents d5/df/d30 0 2024-02-20T08:06:07.995 INFO:tasks.workunit.client.1.smithi194.stdout:7/371: truncate d11/d2d/d38/d4a/d27/f39 556002 0 2024-02-20T08:06:08.000 INFO:tasks.workunit.client.1.smithi194.stdout:7/372: dwrite d11/d2d/d38/f22 [4194304,4194304] 0 2024-02-20T08:06:08.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/340: write d2/f2e [447293,114326] 0 2024-02-20T08:06:08.005 INFO:tasks.workunit.client.1.smithi194.stdout:4/312: symlink d0/d5c/l5d 0 2024-02-20T08:06:08.006 INFO:tasks.workunit.client.1.smithi194.stdout:4/313: read d0/f32 [741401,35901] 0 2024-02-20T08:06:08.007 INFO:tasks.workunit.client.1.smithi194.stdout:4/314: truncate d0/df/f13 12662842 0 2024-02-20T08:06:08.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/341: dread d2/f2e [0,4194304] 0 2024-02-20T08:06:08.012 INFO:tasks.workunit.client.1.smithi194.stdout:3/347: write d5/d10/d28/d41/f5c [948731,84548] 0 2024-02-20T08:06:08.021 INFO:tasks.workunit.client.1.smithi194.stdout:2/363: getdents df 0 2024-02-20T08:06:08.021 INFO:tasks.workunit.client.1.smithi194.stdout:3/348: dwrite d5/d10/f4d [0,4194304] 0 2024-02-20T08:06:08.021 INFO:tasks.workunit.client.1.smithi194.stdout:7/373: truncate d11/d2d/f24 1115638 0 2024-02-20T08:06:08.021 INFO:tasks.workunit.client.1.smithi194.stdout:7/374: chown d11 31688 1 2024-02-20T08:06:08.021 INFO:tasks.workunit.client.1.smithi194.stdout:5/320: getdents d4 0 2024-02-20T08:06:08.024 INFO:tasks.workunit.client.1.smithi194.stdout:0/322: link d6/f29 d6/d2b/d35/d39/f67 0 2024-02-20T08:06:08.026 INFO:tasks.workunit.client.1.smithi194.stdout:1/411: creat d2/d8/f83 x:0 0 0 2024-02-20T08:06:08.029 INFO:tasks.workunit.client.1.smithi194.stdout:3/349: rmdir d5/d10/d16 39 2024-02-20T08:06:08.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/396: creat d4/d20/f87 x:0 0 0 2024-02-20T08:06:08.032 INFO:tasks.workunit.client.1.smithi194.stdout:1/412: read d2/d1a/d26/d3d/d71/f66 [27012,113464] 0 2024-02-20T08:06:08.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/364: dread df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:08.035 INFO:tasks.workunit.client.1.smithi194.stdout:5/321: unlink d4/d6/l1a 0 2024-02-20T08:06:08.036 INFO:tasks.workunit.client.1.smithi194.stdout:5/322: fdatasync d4/d20/d2b/f4b 0 2024-02-20T08:06:08.041 INFO:tasks.workunit.client.1.smithi194.stdout:0/323: truncate d6/d2b/d35/d42/f15 1612824 0 2024-02-20T08:06:08.044 INFO:tasks.workunit.client.1.smithi194.stdout:8/342: write d2/f3b [756156,51854] 0 2024-02-20T08:06:08.048 INFO:tasks.workunit.client.1.smithi194.stdout:4/315: dwrite d0/df/d11/f2b [0,4194304] 0 2024-02-20T08:06:08.049 INFO:tasks.workunit.client.1.smithi194.stdout:4/316: write d0/d10/d1c/d21/d46/f58 [659956,38483] 0 2024-02-20T08:06:08.050 INFO:tasks.workunit.client.1.smithi194.stdout:7/375: mkdir d11/d70 0 2024-02-20T08:06:08.050 INFO:tasks.workunit.client.1.smithi194.stdout:4/317: stat d0/df/d18/f37 0 2024-02-20T08:06:08.052 INFO:tasks.workunit.client.1.smithi194.stdout:4/318: write d0/d36/f39 [1142528,45492] 0 2024-02-20T08:06:08.061 INFO:tasks.workunit.client.1.smithi194.stdout:9/397: dread d4/f5 [0,4194304] 0 2024-02-20T08:06:08.062 INFO:tasks.workunit.client.1.smithi194.stdout:3/350: chown d5/d10/d17/d1d/d56/c66 12511385 1 2024-02-20T08:06:08.063 INFO:tasks.workunit.client.1.smithi194.stdout:8/343: symlink d2/d14/d18/l77 0 2024-02-20T08:06:08.069 INFO:tasks.workunit.client.1.smithi194.stdout:5/323: mknod d4/d6/d11/d2f/d56/c61 0 2024-02-20T08:06:08.070 INFO:tasks.workunit.client.1.smithi194.stdout:5/324: dread - d4/d6/f1f zero size 2024-02-20T08:06:08.070 INFO:tasks.workunit.client.1.smithi194.stdout:4/319: mkdir d0/df/d18/d5e 0 2024-02-20T08:06:08.078 INFO:tasks.workunit.client.1.smithi194.stdout:2/365: dwrite f5 [0,4194304] 0 2024-02-20T08:06:08.078 INFO:tasks.workunit.client.1.smithi194.stdout:0/324: truncate d6/d2b/d35/f38 98157 0 2024-02-20T08:06:08.082 INFO:tasks.workunit.client.1.smithi194.stdout:9/398: mkdir d4/d2d/d42/d4e/d6e/d88 0 2024-02-20T08:06:08.083 INFO:tasks.workunit.client.1.smithi194.stdout:3/351: write d5/df/f24 [5194980,104127] 0 2024-02-20T08:06:08.084 INFO:tasks.workunit.client.1.smithi194.stdout:3/352: read d5/df/f24 [2087462,113663] 0 2024-02-20T08:06:08.087 INFO:tasks.workunit.client.1.smithi194.stdout:8/344: mkdir d2/d14/d18/d45/d4e/d6c/d78 0 2024-02-20T08:06:08.087 INFO:tasks.workunit.client.1.smithi194.stdout:8/345: dread - d2/d14/d18/d45/f6b zero size 2024-02-20T08:06:08.088 INFO:tasks.workunit.client.1.smithi194.stdout:8/346: chown d2/d14/c3f 9766524 1 2024-02-20T08:06:08.090 INFO:tasks.workunit.client.1.smithi194.stdout:7/376: link d11/d2d/d38/d37/f4f d11/d2d/d38/d5a/d6b/f71 0 2024-02-20T08:06:08.093 INFO:tasks.workunit.client.1.smithi194.stdout:5/325: chown d4/d20/d2b/f2c 4 1 2024-02-20T08:06:08.093 INFO:tasks.workunit.client.1.smithi194.stdout:4/320: write d0/d2/f2e [4857178,109969] 0 2024-02-20T08:06:08.095 INFO:tasks.workunit.client.1.smithi194.stdout:9/399: creat d4/d1b/d79/f89 x:0 0 0 2024-02-20T08:06:08.099 INFO:tasks.workunit.client.1.smithi194.stdout:5/326: mknod d4/d6/d5b/c62 0 2024-02-20T08:06:08.101 INFO:tasks.workunit.client.1.smithi194.stdout:2/366: dwrite df/d14/d24/f6c [0,4194304] 0 2024-02-20T08:06:08.109 INFO:tasks.workunit.client.1.smithi194.stdout:3/353: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:08.109 INFO:tasks.workunit.client.1.smithi194.stdout:2/367: dwrite df/f4f [0,4194304] 0 2024-02-20T08:06:08.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/327: mknod d4/d6/d11/d15/d28/d46/c63 0 2024-02-20T08:06:08.112 INFO:tasks.workunit.client.1.smithi194.stdout:2/368: write df/d14/d24/f48 [355934,79399] 0 2024-02-20T08:06:08.114 INFO:tasks.workunit.client.1.smithi194.stdout:7/377: rmdir d11/d70 0 2024-02-20T08:06:08.115 INFO:tasks.workunit.client.1.smithi194.stdout:7/378: chown d11/d2d/d38/d4a/d27 10554 1 2024-02-20T08:06:08.117 INFO:tasks.workunit.client.1.smithi194.stdout:7/379: readlink d11/d2d/d38/d4a/d27/l2f 0 2024-02-20T08:06:08.117 INFO:tasks.workunit.client.1.smithi194.stdout:0/325: getdents d6/d2b/d35/d42/d1e/d45 0 2024-02-20T08:06:08.118 INFO:tasks.workunit.client.1.smithi194.stdout:2/369: dwrite fe [0,4194304] 0 2024-02-20T08:06:08.119 INFO:tasks.workunit.client.1.smithi194.stdout:3/354: mknod d5/d10/d17/d1d/c69 0 2024-02-20T08:06:08.120 INFO:tasks.workunit.client.1.smithi194.stdout:7/380: write d11/d2d/d38/d4a/f21 [1486175,51597] 0 2024-02-20T08:06:08.122 INFO:tasks.workunit.client.1.smithi194.stdout:8/347: getdents d2/d14/d18/d45/d4e 0 2024-02-20T08:06:08.122 INFO:tasks.workunit.client.1.smithi194.stdout:3/355: chown d5/df/d30/f36 364954 1 2024-02-20T08:06:08.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/370: truncate df/d14/d19/d5c/f5e 971610 0 2024-02-20T08:06:08.126 INFO:tasks.workunit.client.1.smithi194.stdout:4/321: dread d0/df/f13 [4194304,4194304] 0 2024-02-20T08:06:08.131 INFO:tasks.workunit.client.1.smithi194.stdout:7/381: readlink d11/d2d/d38/d4a/d27/l47 0 2024-02-20T08:06:08.132 INFO:tasks.workunit.client.1.smithi194.stdout:2/371: mkdir df/d14/d24/d56/d73 0 2024-02-20T08:06:08.134 INFO:tasks.workunit.client.1.smithi194.stdout:3/356: dwrite d5/d10/d16/f5a [0,4194304] 0 2024-02-20T08:06:08.134 INFO:tasks.workunit.client.1.smithi194.stdout:9/400: truncate d4/d20/d5c/f31 525459 0 2024-02-20T08:06:08.135 INFO:tasks.workunit.client.1.smithi194.stdout:9/401: write d4/d1b/d79/f89 [679001,47969] 0 2024-02-20T08:06:08.136 INFO:tasks.workunit.client.1.smithi194.stdout:9/402: fdatasync d4/d20/d43/f47 0 2024-02-20T08:06:08.138 INFO:tasks.workunit.client.1.smithi194.stdout:0/326: link d6/f3d d6/d2b/d35/d42/d1e/d3c/f68 0 2024-02-20T08:06:08.143 INFO:tasks.workunit.client.1.smithi194.stdout:7/382: fdatasync d11/d2d/d38/d5a/d6b/f71 0 2024-02-20T08:06:08.144 INFO:tasks.workunit.client.1.smithi194.stdout:5/328: creat d4/d6/dd/d25/d50/d53/f64 x:0 0 0 2024-02-20T08:06:08.145 INFO:tasks.workunit.client.1.smithi194.stdout:0/327: dwrite d6/d2b/f50 [0,4194304] 0 2024-02-20T08:06:08.148 INFO:tasks.workunit.client.1.smithi194.stdout:2/372: symlink df/d14/l74 0 2024-02-20T08:06:08.152 INFO:tasks.workunit.client.1.smithi194.stdout:2/373: write fe [3148750,61575] 0 2024-02-20T08:06:08.157 INFO:tasks.workunit.client.1.smithi194.stdout:7/383: dwrite d11/d2d/d38/d4a/d27/f39 [0,4194304] 0 2024-02-20T08:06:08.159 INFO:tasks.workunit.client.1.smithi194.stdout:5/329: dwrite d4/d6/d11/d15/d28/f39 [0,4194304] 0 2024-02-20T08:06:08.161 INFO:tasks.workunit.client.1.smithi194.stdout:0/328: dwrite d6/f18 [4194304,4194304] 0 2024-02-20T08:06:08.163 INFO:tasks.workunit.client.1.smithi194.stdout:4/322: creat d0/d2/d3e/f5f x:0 0 0 2024-02-20T08:06:08.165 INFO:tasks.workunit.client.1.smithi194.stdout:9/403: link d4/d20/d41/l6b d4/l8a 0 2024-02-20T08:06:08.174 INFO:tasks.workunit.client.1.smithi194.stdout:4/323: dread d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:08.176 INFO:tasks.workunit.client.1.smithi194.stdout:2/374: dwrite df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:08.176 INFO:tasks.workunit.client.1.smithi194.stdout:7/384: dwrite d11/d3b/f6f [0,4194304] 0 2024-02-20T08:06:08.178 INFO:tasks.workunit.client.1.smithi194.stdout:4/324: write d0/d10/f22 [4069253,25497] 0 2024-02-20T08:06:08.179 INFO:tasks.workunit.client.1.smithi194.stdout:9/404: mkdir d4/d8b 0 2024-02-20T08:06:08.179 INFO:tasks.workunit.client.1.smithi194.stdout:7/385: write d11/d3b/f6f [2507529,8216] 0 2024-02-20T08:06:08.181 INFO:tasks.workunit.client.1.smithi194.stdout:7/386: readlink d11/l18 0 2024-02-20T08:06:08.186 INFO:tasks.workunit.client.1.smithi194.stdout:7/387: readlink d11/d2d/d38/d4a/l3e 0 2024-02-20T08:06:08.186 INFO:tasks.workunit.client.1.smithi194.stdout:9/405: readlink d4/l8a 0 2024-02-20T08:06:08.187 INFO:tasks.workunit.client.1.smithi194.stdout:4/325: read d0/d10/d1c/d4d/d2f/f31 [12989,39590] 0 2024-02-20T08:06:08.188 INFO:tasks.workunit.client.1.smithi194.stdout:9/406: write d4/de/f7b [962550,126722] 0 2024-02-20T08:06:08.190 INFO:tasks.workunit.client.1.smithi194.stdout:2/375: dwrite df/d14/d19/d5c/d60/d63/f62 [0,4194304] 0 2024-02-20T08:06:08.198 INFO:tasks.workunit.client.1.smithi194.stdout:7/388: mknod d11/d6e/c72 0 2024-02-20T08:06:08.198 INFO:tasks.workunit.client.1.smithi194.stdout:9/407: mknod d4/d2d/d42/c8c 0 2024-02-20T08:06:08.199 INFO:tasks.workunit.client.1.smithi194.stdout:4/326: dwrite d0/d10/d1c/d4d/f38 [0,4194304] 0 2024-02-20T08:06:08.204 INFO:tasks.workunit.client.1.smithi194.stdout:2/376: mknod df/d14/d24/d6e/c75 0 2024-02-20T08:06:08.204 INFO:tasks.workunit.client.1.smithi194.stdout:7/389: dwrite d11/d2d/d38/d37/f59 [0,4194304] 0 2024-02-20T08:06:08.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/330: truncate d4/d6/d11/d15/d28/f39 3601844 0 2024-02-20T08:06:08.218 INFO:tasks.workunit.client.1.smithi194.stdout:7/390: creat d11/d2d/d38/d4a/d27/f73 x:0 0 0 2024-02-20T08:06:08.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/329: dwrite d6/d2b/d35/d42/d1e/f27 [0,4194304] 0 2024-02-20T08:06:08.220 INFO:tasks.workunit.client.1.smithi194.stdout:2/377: fsync df/d14/d24/f4e 0 2024-02-20T08:06:08.220 INFO:tasks.workunit.client.1.smithi194.stdout:0/330: chown d6/d2b/c31 27392 1 2024-02-20T08:06:08.224 INFO:tasks.workunit.client.1.smithi194.stdout:7/391: write d11/d2d/d38/d4a/d60/f64 [659914,79115] 0 2024-02-20T08:06:08.224 INFO:tasks.workunit.client.1.smithi194.stdout:5/331: fdatasync d4/d6/f48 0 2024-02-20T08:06:08.224 INFO:tasks.workunit.client.1.smithi194.stdout:4/327: getdents d0/d5c 0 2024-02-20T08:06:08.228 INFO:tasks.workunit.client.1.smithi194.stdout:0/331: dread d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:08.229 INFO:tasks.workunit.client.1.smithi194.stdout:0/332: dread d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:08.231 INFO:tasks.workunit.client.1.smithi194.stdout:5/332: rename d4/d6/dd/d25/d50 to d4/d6/d11/d2f/d56/d65 0 2024-02-20T08:06:08.235 INFO:tasks.workunit.client.1.smithi194.stdout:4/328: rename d0/d36 to d0/d5c/d60 0 2024-02-20T08:06:08.236 INFO:tasks.workunit.client.1.smithi194.stdout:0/333: dwrite d6/d2b/d35/d42/d1e/f3f [0,4194304] 0 2024-02-20T08:06:08.237 INFO:tasks.workunit.client.1.smithi194.stdout:5/333: creat d4/d6/d11/d15/d28/f66 x:0 0 0 2024-02-20T08:06:08.239 INFO:tasks.workunit.client.1.smithi194.stdout:7/392: getdents d11/d2d/d38/d37 0 2024-02-20T08:06:08.244 INFO:tasks.workunit.client.1.smithi194.stdout:5/334: mknod d4/d6/dd/d25/c67 0 2024-02-20T08:06:08.245 INFO:tasks.workunit.client.1.smithi194.stdout:7/393: symlink d11/d2d/d38/d4a/d53/l74 0 2024-02-20T08:06:08.251 INFO:tasks.workunit.client.1.smithi194.stdout:5/335: creat d4/d6/d11/d2f/f68 x:0 0 0 2024-02-20T08:06:08.253 INFO:tasks.workunit.client.1.smithi194.stdout:7/394: creat d11/d2d/d38/d4a/d60/f75 x:0 0 0 2024-02-20T08:06:08.253 INFO:tasks.workunit.client.1.smithi194.stdout:2/378: dwrite df/d14/f1d [4194304,4194304] 0 2024-02-20T08:06:08.255 INFO:tasks.workunit.client.1.smithi194.stdout:2/379: write df/d14/f66 [325631,27483] 0 2024-02-20T08:06:08.257 INFO:tasks.workunit.client.1.smithi194.stdout:0/334: creat d6/d2b/d35/d39/d55/f69 x:0 0 0 2024-02-20T08:06:08.258 INFO:tasks.workunit.client.1.smithi194.stdout:4/329: link d0/d10/d1c/d4d/d2f/f31 d0/d10/d1c/d21/d46/f61 0 2024-02-20T08:06:08.258 INFO:tasks.workunit.client.1.smithi194.stdout:5/336: dwrite d4/d6/d11/f31 [0,4194304] 0 2024-02-20T08:06:08.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/330: fdatasync d0/d2/f2e 0 2024-02-20T08:06:08.259 INFO:tasks.workunit.client.1.smithi194.stdout:5/337: chown d4/d20/d2b/c44 747886 1 2024-02-20T08:06:08.260 INFO:tasks.workunit.client.1.smithi194.stdout:5/338: fsync d4/d6/d11/d15/d28/d46/f54 0 2024-02-20T08:06:08.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/331: mkdir d0/d10/d1c/d21/d62 0 2024-02-20T08:06:08.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/332: stat d0/d10/d1c/d21/d46/f58 0 2024-02-20T08:06:08.267 INFO:tasks.workunit.client.1.smithi194.stdout:5/339: truncate d4/d6/dd/d25/f59 800309 0 2024-02-20T08:06:08.267 INFO:tasks.workunit.client.1.smithi194.stdout:4/333: write d0/d2/f3c [45765,22546] 0 2024-02-20T08:06:08.268 INFO:tasks.workunit.client.1.smithi194.stdout:5/340: write d4/d6/f1f [450978,38470] 0 2024-02-20T08:06:08.268 INFO:tasks.workunit.client.1.smithi194.stdout:2/380: mknod df/d5b/c76 0 2024-02-20T08:06:08.270 INFO:tasks.workunit.client.1.smithi194.stdout:4/334: chown d0/d10/d1c/d21/d46/f58 2037862 1 2024-02-20T08:06:08.276 INFO:tasks.workunit.client.1.smithi194.stdout:5/341: mkdir d4/d6/d11/d69 0 2024-02-20T08:06:08.277 INFO:tasks.workunit.client.1.smithi194.stdout:2/381: dwrite f5 [4194304,4194304] 0 2024-02-20T08:06:08.277 INFO:tasks.workunit.client.1.smithi194.stdout:4/335: dwrite d0/d2/f2e [0,4194304] 0 2024-02-20T08:06:08.279 INFO:tasks.workunit.client.1.smithi194.stdout:2/382: write df/d14/f32 [847688,53369] 0 2024-02-20T08:06:08.279 INFO:tasks.workunit.client.1.smithi194.stdout:5/342: dread d4/d20/d2b/f4b [0,4194304] 0 2024-02-20T08:06:08.285 INFO:tasks.workunit.client.1.smithi194.stdout:5/343: creat d4/d6/dd/d25/f6a x:0 0 0 2024-02-20T08:06:08.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/395: truncate d11/d3b/f6f 2027571 0 2024-02-20T08:06:08.289 INFO:tasks.workunit.client.1.smithi194.stdout:0/335: write d6/f29 [1181649,44125] 0 2024-02-20T08:06:08.291 INFO:tasks.workunit.client.1.smithi194.stdout:4/336: dwrite d0/df/d11/f2b [0,4194304] 0 2024-02-20T08:06:08.292 INFO:tasks.workunit.client.1.smithi194.stdout:0/336: write d6/d2b/f50 [206260,13709] 0 2024-02-20T08:06:08.293 INFO:tasks.workunit.client.1.smithi194.stdout:7/396: creat d11/d2d/d38/d4a/d27/f76 x:0 0 0 2024-02-20T08:06:08.296 INFO:tasks.workunit.client.1.smithi194.stdout:2/383: getdents df 0 2024-02-20T08:06:08.296 INFO:tasks.workunit.client.1.smithi194.stdout:5/344: dwrite d4/d6/dd/d25/f6a [0,4194304] 0 2024-02-20T08:06:08.298 INFO:tasks.workunit.client.1.smithi194.stdout:5/345: stat d4/d6/dd/d25/f6a 0 2024-02-20T08:06:08.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/337: mkdir d0/d10/d1c/d63 0 2024-02-20T08:06:08.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/337: mknod d6/d2b/d35/d48/c6a 0 2024-02-20T08:06:08.302 INFO:tasks.workunit.client.1.smithi194.stdout:2/384: rmdir df/d5b 39 2024-02-20T08:06:08.302 INFO:tasks.workunit.client.1.smithi194.stdout:0/338: chown d6/d2b/d35/d42/d1e/d45/d58/c65 1727 1 2024-02-20T08:06:08.302 INFO:tasks.workunit.client.1.smithi194.stdout:7/397: mkdir d11/d2d/d38/d4a/d27/d51/d77 0 2024-02-20T08:06:08.306 INFO:tasks.workunit.client.1.smithi194.stdout:2/385: mknod df/d14/d24/d56/c77 0 2024-02-20T08:06:08.306 INFO:tasks.workunit.client.1.smithi194.stdout:4/338: dread d0/d10/d1c/d21/d46/f61 [0,4194304] 0 2024-02-20T08:06:08.307 INFO:tasks.workunit.client.1.smithi194.stdout:4/339: stat d0/d5c/d60/c48 0 2024-02-20T08:06:08.309 INFO:tasks.workunit.client.1.smithi194.stdout:0/339: dwrite d6/d2b/d35/d42/d1e/f27 [0,4194304] 0 2024-02-20T08:06:08.311 INFO:tasks.workunit.client.1.smithi194.stdout:7/398: unlink d11/l5b 0 2024-02-20T08:06:08.311 INFO:tasks.workunit.client.1.smithi194.stdout:0/340: read d6/d2b/f63 [863444,67707] 0 2024-02-20T08:06:08.314 INFO:tasks.workunit.client.1.smithi194.stdout:6/479: sync 2024-02-20T08:06:08.314 INFO:tasks.workunit.client.1.smithi194.stdout:6/480: fdatasync df/f3c 0 2024-02-20T08:06:08.315 INFO:tasks.workunit.client.1.smithi194.stdout:2/386: dwrite df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:08.317 INFO:tasks.workunit.client.1.smithi194.stdout:7/399: readlink d11/d2d/d38/d4a/d53/l66 0 2024-02-20T08:06:08.318 INFO:tasks.workunit.client.1.smithi194.stdout:0/341: creat d6/d2b/d35/d42/d1e/d3c/d43/f6b x:0 0 0 2024-02-20T08:06:08.327 INFO:tasks.workunit.client.1.smithi194.stdout:4/340: rmdir d0/d10/d1c/d21/d46/d47 0 2024-02-20T08:06:08.328 INFO:tasks.workunit.client.1.smithi194.stdout:7/400: dread d11/f1f [4194304,4194304] 0 2024-02-20T08:06:08.328 INFO:tasks.workunit.client.1.smithi194.stdout:0/342: symlink d6/d2b/d35/d42/d1e/d45/d58/l6c 0 2024-02-20T08:06:08.331 INFO:tasks.workunit.client.1.smithi194.stdout:6/481: mknod df/d18/d19/d1d/d28/d46/d5a/d7d/c9d 0 2024-02-20T08:06:08.332 INFO:tasks.workunit.client.1.smithi194.stdout:7/401: creat d11/d6e/f78 x:0 0 0 2024-02-20T08:06:08.333 INFO:tasks.workunit.client.1.smithi194.stdout:7/402: chown d11/d3b/l50 34 1 2024-02-20T08:06:08.334 INFO:tasks.workunit.client.1.smithi194.stdout:0/343: fdatasync d6/f3d 0 2024-02-20T08:06:08.336 INFO:tasks.workunit.client.1.smithi194.stdout:4/341: dread d0/f32 [0,4194304] 0 2024-02-20T08:06:08.341 INFO:tasks.workunit.client.1.smithi194.stdout:6/482: dread df/d18/d19/f7a [0,4194304] 0 2024-02-20T08:06:08.341 INFO:tasks.workunit.client.1.smithi194.stdout:7/403: dwrite fd [8388608,4194304] 0 2024-02-20T08:06:08.342 INFO:tasks.workunit.client.1.smithi194.stdout:4/342: unlink d0/d2/f3c 0 2024-02-20T08:06:08.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/404: readlink d11/d2d/d38/d4a/l3e 0 2024-02-20T08:06:08.344 INFO:tasks.workunit.client.1.smithi194.stdout:0/344: dwrite d6/d2b/d35/d42/f5b [0,4194304] 0 2024-02-20T08:06:08.345 INFO:tasks.workunit.client.1.smithi194.stdout:7/405: readlink d11/d2d/d38/d4a/d27/l31 0 2024-02-20T08:06:08.346 INFO:tasks.workunit.client.1.smithi194.stdout:0/345: fsync d6/d2b/d35/d42/d1e/d3c/d43/f6b 0 2024-02-20T08:06:08.351 INFO:tasks.workunit.client.1.smithi194.stdout:6/483: rename cb to df/d18/d19/d1d/d28/d46/d5a/d6b/d83/c9e 0 2024-02-20T08:06:08.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/406: symlink d11/d2d/d38/d4a/l79 0 2024-02-20T08:06:08.355 INFO:tasks.workunit.client.1.smithi194.stdout:7/407: truncate d11/d2d/d38/d4a/d60/f75 198369 0 2024-02-20T08:06:08.356 INFO:tasks.workunit.client.1.smithi194.stdout:7/408: write d11/d2d/d38/d5a/f5d [3123762,76487] 0 2024-02-20T08:06:08.359 INFO:tasks.workunit.client.1.smithi194.stdout:7/409: creat d11/d2d/d38/f7a x:0 0 0 2024-02-20T08:06:08.359 INFO:tasks.workunit.client.1.smithi194.stdout:6/484: mknod df/d18/d19/d1d/d28/c9f 0 2024-02-20T08:06:08.360 INFO:tasks.workunit.client.1.smithi194.stdout:0/346: creat d6/d2b/d35/d39/d55/f6d x:0 0 0 2024-02-20T08:06:08.362 INFO:tasks.workunit.client.1.smithi194.stdout:6/485: symlink df/d18/d19/d1d/d28/d46/d5a/d7d/la0 0 2024-02-20T08:06:08.364 INFO:tasks.workunit.client.1.smithi194.stdout:0/347: creat d6/d2b/d35/d42/d1e/d45/d58/f6e x:0 0 0 2024-02-20T08:06:08.366 INFO:tasks.workunit.client.1.smithi194.stdout:6/486: dread df/d18/d19/d1d/f61 [4194304,4194304] 0 2024-02-20T08:06:08.367 INFO:tasks.workunit.client.1.smithi194.stdout:6/487: read fe [1075525,10371] 0 2024-02-20T08:06:08.368 INFO:tasks.workunit.client.1.smithi194.stdout:0/348: symlink d6/d2b/d35/d42/l6f 0 2024-02-20T08:06:08.368 INFO:tasks.workunit.client.1.smithi194.stdout:6/488: chown df/c70 14857 1 2024-02-20T08:06:08.372 INFO:tasks.workunit.client.1.smithi194.stdout:6/489: mkdir df/d18/d19/d1d/d76/da1 0 2024-02-20T08:06:08.374 INFO:tasks.workunit.client.1.smithi194.stdout:0/349: creat d6/d2b/d35/d42/d1e/d45/f70 x:0 0 0 2024-02-20T08:06:08.376 INFO:tasks.workunit.client.1.smithi194.stdout:7/410: dread fd [4194304,4194304] 0 2024-02-20T08:06:08.383 INFO:tasks.workunit.client.1.smithi194.stdout:7/411: mkdir d11/d2d/d38/d37/d43/d7b 0 2024-02-20T08:06:08.384 INFO:tasks.workunit.client.1.smithi194.stdout:7/412: truncate d11/d2d/d38/d5a/f5c 707952 0 2024-02-20T08:06:08.389 INFO:tasks.workunit.client.1.smithi194.stdout:7/413: dwrite d11/d2d/d38/d5a/f5c [0,4194304] 0 2024-02-20T08:06:08.393 INFO:tasks.workunit.client.1.smithi194.stdout:6/490: truncate df/d18/d19/d1d/d28/d2b/f2e 3672738 0 2024-02-20T08:06:08.394 INFO:tasks.workunit.client.1.smithi194.stdout:6/491: readlink df/d42/l43 0 2024-02-20T08:06:08.394 INFO:tasks.workunit.client.1.smithi194.stdout:7/414: readlink d11/d2d/d38/d4a/l17 0 2024-02-20T08:06:08.396 INFO:tasks.workunit.client.1.smithi194.stdout:7/415: write d11/d6e/f78 [647285,129710] 0 2024-02-20T08:06:08.398 INFO:tasks.workunit.client.1.smithi194.stdout:7/416: write d11/d2d/d38/d4a/f62 [674415,24768] 0 2024-02-20T08:06:08.400 INFO:tasks.workunit.client.1.smithi194.stdout:0/350: write d6/d2b/d35/f38 [698839,49598] 0 2024-02-20T08:06:08.401 INFO:tasks.workunit.client.1.smithi194.stdout:6/492: dwrite df/d18/d19/d1d/d76/f87 [0,4194304] 0 2024-02-20T08:06:08.404 INFO:tasks.workunit.client.1.smithi194.stdout:6/493: dread - df/d18/f77 zero size 2024-02-20T08:06:08.417 INFO:tasks.workunit.client.1.smithi194.stdout:7/417: symlink d11/d2d/d38/d37/d43/d7b/l7c 0 2024-02-20T08:06:08.419 INFO:tasks.workunit.client.1.smithi194.stdout:0/351: link d6/d2b/d35/f4c d6/d2b/d35/d42/d1e/d3c/f71 0 2024-02-20T08:06:08.420 INFO:tasks.workunit.client.1.smithi194.stdout:0/352: readlink d6/d2b/d35/d42/d1e/d3c/l5c 0 2024-02-20T08:06:08.421 INFO:tasks.workunit.client.1.smithi194.stdout:0/353: chown d6/d2b/f63 2003964 1 2024-02-20T08:06:08.427 INFO:tasks.workunit.client.1.smithi194.stdout:0/354: mkdir d6/d2b/d35/d48/d60/d72 0 2024-02-20T08:06:08.429 INFO:tasks.workunit.client.1.smithi194.stdout:0/355: creat d6/d2b/d35/f73 x:0 0 0 2024-02-20T08:06:08.429 INFO:tasks.workunit.client.1.smithi194.stdout:6/494: fdatasync df/d18/d19/d1d/d76/f87 0 2024-02-20T08:06:08.432 INFO:tasks.workunit.client.1.smithi194.stdout:0/356: unlink d6/d2b/c31 0 2024-02-20T08:06:08.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/413: sync 2024-02-20T08:06:08.448 INFO:tasks.workunit.client.1.smithi194.stdout:6/495: creat df/d18/d19/d1d/d28/d46/d5a/fa2 x:0 0 0 2024-02-20T08:06:08.485 INFO:tasks.workunit.client.1.smithi194.stdout:7/418: write d11/f1a [4948660,24855] 0 2024-02-20T08:06:08.520 INFO:tasks.workunit.client.1.smithi194.stdout:8/348: sync 2024-02-20T08:06:08.543 INFO:tasks.workunit.client.1.smithi194.stdout:8/349: dread d2/fa [0,4194304] 0 2024-02-20T08:06:08.547 INFO:tasks.workunit.client.1.smithi194.stdout:8/350: mknod d2/d14/d18/d45/c79 0 2024-02-20T08:06:08.554 INFO:tasks.workunit.client.1.smithi194.stdout:0/357: truncate d6/d2b/d35/d42/f5b 852404 0 2024-02-20T08:06:08.570 INFO:tasks.workunit.client.1.smithi194.stdout:3/357: sync 2024-02-20T08:06:08.570 INFO:tasks.workunit.client.1.smithi194.stdout:9/408: sync 2024-02-20T08:06:08.570 INFO:tasks.workunit.client.1.smithi194.stdout:5/346: sync 2024-02-20T08:06:08.571 INFO:tasks.workunit.client.1.smithi194.stdout:2/387: sync 2024-02-20T08:06:08.571 INFO:tasks.workunit.client.1.smithi194.stdout:4/343: sync 2024-02-20T08:06:08.571 INFO:tasks.workunit.client.1.smithi194.stdout:1/414: creat d2/f84 x:0 0 0 2024-02-20T08:06:08.572 INFO:tasks.workunit.client.1.smithi194.stdout:1/415: chown d2/d1a/d26/d45/l5c 11983 1 2024-02-20T08:06:08.574 INFO:tasks.workunit.client.1.smithi194.stdout:5/347: stat d4/d6/d11/d2f/f52 0 2024-02-20T08:06:08.576 INFO:tasks.workunit.client.1.smithi194.stdout:2/388: mkdir df/d14/d19/d5c/d78 0 2024-02-20T08:06:08.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/344: mknod d0/d10/d1c/d21/c64 0 2024-02-20T08:06:08.577 INFO:tasks.workunit.client.1.smithi194.stdout:9/409: dwrite d4/de/f27 [0,4194304] 0 2024-02-20T08:06:08.578 INFO:tasks.workunit.client.1.smithi194.stdout:9/410: chown d4/d2d/d59 122320366 1 2024-02-20T08:06:08.579 INFO:tasks.workunit.client.1.smithi194.stdout:4/345: dread d0/df/f3b [0,4194304] 0 2024-02-20T08:06:08.579 INFO:tasks.workunit.client.1.smithi194.stdout:4/346: chown d0/d10/d1c/d21 934184482 1 2024-02-20T08:06:08.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/348: fsync d4/d6/d11/f31 0 2024-02-20T08:06:08.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/347: dwrite d0/d2/f2e [4194304,4194304] 0 2024-02-20T08:06:08.587 INFO:tasks.workunit.client.1.smithi194.stdout:2/389: creat df/d14/d24/d6e/f79 x:0 0 0 2024-02-20T08:06:08.593 INFO:tasks.workunit.client.1.smithi194.stdout:0/358: creat d6/d2b/d35/d42/f74 x:0 0 0 2024-02-20T08:06:08.593 INFO:tasks.workunit.client.1.smithi194.stdout:3/358: mknod d5/d10/d62/c6a 0 2024-02-20T08:06:08.599 INFO:tasks.workunit.client.1.smithi194.stdout:7/419: rmdir d11/d6e 39 2024-02-20T08:06:08.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/420: fdatasync d11/d2d/d38/d4a/d60/f75 0 2024-02-20T08:06:08.601 INFO:tasks.workunit.client.1.smithi194.stdout:6/496: rename df/c25 to df/d18/d19/d1d/d28/ca3 0 2024-02-20T08:06:08.603 INFO:tasks.workunit.client.1.smithi194.stdout:6/497: write df/d18/d19/d1d/d28/f78 [312874,121534] 0 2024-02-20T08:06:08.611 INFO:tasks.workunit.client.1.smithi194.stdout:1/416: link d2/d1a/d26/f2d d2/d8/f85 0 2024-02-20T08:06:08.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/359: unlink f4 0 2024-02-20T08:06:08.615 INFO:tasks.workunit.client.1.smithi194.stdout:0/359: mknod d6/d2b/d35/d42/d1e/d45/d58/c75 0 2024-02-20T08:06:08.616 INFO:tasks.workunit.client.1.smithi194.stdout:0/360: chown d6/d2b/d35/d48/l61 3 1 2024-02-20T08:06:08.616 INFO:tasks.workunit.client.1.smithi194.stdout:9/411: write d4/d20/d43/d51/f5f [35932,88523] 0 2024-02-20T08:06:08.618 INFO:tasks.workunit.client.1.smithi194.stdout:7/421: rmdir d11/d2d/d38/d4a/d60 39 2024-02-20T08:06:08.619 INFO:tasks.workunit.client.1.smithi194.stdout:8/351: rename d2/d4d/c54 to d2/d14/d18/d45/d4e/c7a 0 2024-02-20T08:06:08.622 INFO:tasks.workunit.client.1.smithi194.stdout:9/412: dwrite d4/d1b/d2e/f7f [0,4194304] 0 2024-02-20T08:06:08.624 INFO:tasks.workunit.client.1.smithi194.stdout:6/498: rename df/d42/c53 to df/d42/ca4 0 2024-02-20T08:06:08.625 INFO:tasks.workunit.client.1.smithi194.stdout:6/499: chown df/d18/d19/d1d/d76/l8f 2659 1 2024-02-20T08:06:08.626 INFO:tasks.workunit.client.1.smithi194.stdout:2/390: truncate df/d14/d24/f35 1086899 0 2024-02-20T08:06:08.636 INFO:tasks.workunit.client.1.smithi194.stdout:0/361: symlink d6/d2b/l76 0 2024-02-20T08:06:08.641 INFO:tasks.workunit.client.1.smithi194.stdout:7/422: dwrite fd [0,4194304] 0 2024-02-20T08:06:08.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/417: creat d2/d1a/d61/d7e/f86 x:0 0 0 2024-02-20T08:06:08.658 INFO:tasks.workunit.client.1.smithi194.stdout:1/418: dwrite d2/d8/df/f33 [0,4194304] 0 2024-02-20T08:06:08.661 INFO:tasks.workunit.client.1.smithi194.stdout:0/362: unlink d6/d2b/d35/d42/d1e/d45/f4e 0 2024-02-20T08:06:08.664 INFO:tasks.workunit.client.1.smithi194.stdout:5/349: link d4/c2e d4/d20/d2b/c6b 0 2024-02-20T08:06:08.666 INFO:tasks.workunit.client.1.smithi194.stdout:7/423: read d11/d2d/d38/f28 [4578028,22542] 0 2024-02-20T08:06:08.668 INFO:tasks.workunit.client.1.smithi194.stdout:5/350: write d4/d6/d11/d2f/d56/d65/d53/f64 [308503,83187] 0 2024-02-20T08:06:08.670 INFO:tasks.workunit.client.1.smithi194.stdout:2/391: mknod df/d5b/d61/c7a 0 2024-02-20T08:06:08.671 INFO:tasks.workunit.client.1.smithi194.stdout:6/500: dwrite df/d18/d19/d1d/d28/d2b/d94/d96/f9c [0,4194304] 0 2024-02-20T08:06:08.672 INFO:tasks.workunit.client.1.smithi194.stdout:4/348: getdents d0/d4f 0 2024-02-20T08:06:08.676 INFO:tasks.workunit.client.1.smithi194.stdout:3/360: dwrite d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:08.680 INFO:tasks.workunit.client.1.smithi194.stdout:1/419: dread d2/d1a/d26/d3d/d71/f66 [0,4194304] 0 2024-02-20T08:06:08.682 INFO:tasks.workunit.client.1.smithi194.stdout:9/413: rename d4/c2b to d4/d20/c8d 0 2024-02-20T08:06:08.686 INFO:tasks.workunit.client.1.smithi194.stdout:2/392: stat df/d3a/l51 0 2024-02-20T08:06:08.688 INFO:tasks.workunit.client.1.smithi194.stdout:6/501: stat df/d18/d19/f2c 0 2024-02-20T08:06:08.689 INFO:tasks.workunit.client.1.smithi194.stdout:7/424: dwrite d11/f12 [4194304,4194304] 0 2024-02-20T08:06:08.690 INFO:tasks.workunit.client.1.smithi194.stdout:6/502: write df/d18/d19/d1d/f31 [4100156,87590] 0 2024-02-20T08:06:08.691 INFO:tasks.workunit.client.1.smithi194.stdout:0/363: mkdir d6/d2b/d35/d39/d55/d59/d77 0 2024-02-20T08:06:08.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/352: getdents d2/d14/d18/d45 0 2024-02-20T08:06:08.693 INFO:tasks.workunit.client.1.smithi194.stdout:7/425: dread - d11/d2d/d38/d5a/d6b/f71 zero size 2024-02-20T08:06:08.696 INFO:tasks.workunit.client.1.smithi194.stdout:0/364: write d6/d2b/d35/d42/d1e/f5a [759484,36954] 0 2024-02-20T08:06:08.696 INFO:tasks.workunit.client.1.smithi194.stdout:7/426: write d11/d2d/d38/d37/f4b [4712781,95743] 0 2024-02-20T08:06:08.699 INFO:tasks.workunit.client.1.smithi194.stdout:9/414: rename d4/de/f83 to d4/d2d/d42/d4e/d6e/d88/f8e 0 2024-02-20T08:06:08.703 INFO:tasks.workunit.client.1.smithi194.stdout:0/365: dwrite d6/d2b/d35/f38 [0,4194304] 0 2024-02-20T08:06:08.704 INFO:tasks.workunit.client.1.smithi194.stdout:4/349: mknod d0/d10/d1c/d63/c65 0 2024-02-20T08:06:08.708 INFO:tasks.workunit.client.1.smithi194.stdout:5/351: write d4/d6/d11/d15/d28/d46/f3e [2721791,109926] 0 2024-02-20T08:06:08.710 INFO:tasks.workunit.client.1.smithi194.stdout:5/352: chown d4/d6/d11/d2f/d56/d65/d53 6187029 1 2024-02-20T08:06:08.711 INFO:tasks.workunit.client.1.smithi194.stdout:0/366: dread d6/d2b/d35/d42/d1e/f5a [0,4194304] 0 2024-02-20T08:06:08.711 INFO:tasks.workunit.client.1.smithi194.stdout:5/353: fdatasync d4/d6/d11/d15/d28/f66 0 2024-02-20T08:06:08.712 INFO:tasks.workunit.client.1.smithi194.stdout:6/503: unlink df/d18/d19/d1d/d28/d2b/c7f 0 2024-02-20T08:06:08.713 INFO:tasks.workunit.client.1.smithi194.stdout:8/353: mkdir d2/d14/d18/d45/d7b 0 2024-02-20T08:06:08.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/354: fsync d4/d20/d2b/f43 0 2024-02-20T08:06:08.714 INFO:tasks.workunit.client.1.smithi194.stdout:1/420: symlink d2/d1a/d26/l87 0 2024-02-20T08:06:08.716 INFO:tasks.workunit.client.1.smithi194.stdout:8/354: write d2/d4d/f6e [1037280,95208] 0 2024-02-20T08:06:08.717 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:08 smithi123 ceph-mon[29383]: pgmap v53: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.3 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-02-20T08:06:08.717 INFO:tasks.workunit.client.1.smithi194.stdout:8/355: readlink d2/d14/d18/l77 0 2024-02-20T08:06:08.719 INFO:tasks.workunit.client.1.smithi194.stdout:3/361: dwrite d5/d10/d16/f3a [4194304,4194304] 0 2024-02-20T08:06:08.722 INFO:tasks.workunit.client.1.smithi194.stdout:7/427: fsync d11/d2d/d38/d4a/d60/f75 0 2024-02-20T08:06:08.722 INFO:tasks.workunit.client.1.smithi194.stdout:4/350: creat d0/df/d41/f66 x:0 0 0 2024-02-20T08:06:08.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/421: dwrite d2/f42 [0,4194304] 0 2024-02-20T08:06:08.725 INFO:tasks.workunit.client.1.smithi194.stdout:7/428: write d11/d2d/d38/d4a/d27/f73 [888609,123091] 0 2024-02-20T08:06:08.727 INFO:tasks.workunit.client.1.smithi194.stdout:1/422: dread d2/d8/df/f29 [0,4194304] 0 2024-02-20T08:06:08.728 INFO:tasks.workunit.client.1.smithi194.stdout:0/367: symlink d6/d2b/l78 0 2024-02-20T08:06:08.729 INFO:tasks.workunit.client.1.smithi194.stdout:1/423: dread - d2/d1a/d61/d68/f7f zero size 2024-02-20T08:06:08.733 INFO:tasks.workunit.client.1.smithi194.stdout:0/368: chown d6/d2b/d35/d42/d1e/c57 1779443 1 2024-02-20T08:06:08.737 INFO:tasks.workunit.client.1.smithi194.stdout:5/355: dwrite d4/d6/d11/d2f/f52 [0,4194304] 0 2024-02-20T08:06:08.747 INFO:tasks.workunit.client.1.smithi194.stdout:5/356: dwrite d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:08.747 INFO:tasks.workunit.client.1.smithi194.stdout:2/393: truncate df/d14/d24/f6c 1620245 0 2024-02-20T08:06:08.750 INFO:tasks.workunit.client.1.smithi194.stdout:2/394: read df/d14/f6a [1641497,84732] 0 2024-02-20T08:06:08.752 INFO:tasks.workunit.client.1.smithi194.stdout:6/504: write df/d18/d19/d1d/d28/d46/d5a/f71 [1317559,91037] 0 2024-02-20T08:06:08.754 INFO:tasks.workunit.client.1.smithi194.stdout:9/415: truncate d4/d1b/d79/f44 2839234 0 2024-02-20T08:06:08.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/416: stat d4/d1b/d2e 0 2024-02-20T08:06:08.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/395: dwrite df/d14/f66 [0,4194304] 0 2024-02-20T08:06:08.761 INFO:tasks.workunit.client.1.smithi194.stdout:6/505: dwrite df/d18/d19/f2c [0,4194304] 0 2024-02-20T08:06:08.761 INFO:tasks.workunit.client.1.smithi194.stdout:3/362: fdatasync d5/d10/d17/f5b 0 2024-02-20T08:06:08.774 INFO:tasks.workunit.client.1.smithi194.stdout:6/506: dwrite df/d18/d19/d1d/d76/f8d [0,4194304] 0 2024-02-20T08:06:08.774 INFO:tasks.workunit.client.1.smithi194.stdout:7/429: creat d11/d2d/d38/d4a/d60/f7d x:0 0 0 2024-02-20T08:06:08.779 INFO:tasks.workunit.client.1.smithi194.stdout:1/424: unlink d2/d8/d12/l17 0 2024-02-20T08:06:08.780 INFO:tasks.workunit.client.1.smithi194.stdout:0/369: read d6/d2b/d35/d42/f15 [417778,60040] 0 2024-02-20T08:06:08.783 INFO:tasks.workunit.client.1.smithi194.stdout:6/507: dwrite df/d18/d19/d1d/d28/f78 [0,4194304] 0 2024-02-20T08:06:08.787 INFO:tasks.workunit.client.1.smithi194.stdout:1/425: dread d2/d8/d60/f80 [0,4194304] 0 2024-02-20T08:06:08.790 INFO:tasks.workunit.client.1.smithi194.stdout:9/417: rmdir d4/d2d/d42/d4e 39 2024-02-20T08:06:08.790 INFO:tasks.workunit.client.1.smithi194.stdout:2/396: fdatasync df/d14/d19/f23 0 2024-02-20T08:06:08.790 INFO:tasks.workunit.client.1.smithi194.stdout:9/418: dread - d4/d37/f86 zero size 2024-02-20T08:06:08.792 INFO:tasks.workunit.client.1.smithi194.stdout:3/363: rename d5/d10/d17/d1d/f47 to d5/d10/d17/d1d/f6b 0 2024-02-20T08:06:08.792 INFO:tasks.workunit.client.1.smithi194.stdout:9/419: truncate d4/d20/d5c/f3e 2566471 0 2024-02-20T08:06:08.799 INFO:tasks.workunit.client.1.smithi194.stdout:3/364: dwrite d5/d10/d16/f2d [0,4194304] 0 2024-02-20T08:06:08.803 INFO:tasks.workunit.client.1.smithi194.stdout:0/370: symlink d6/d2b/d35/l79 0 2024-02-20T08:06:08.804 INFO:tasks.workunit.client.1.smithi194.stdout:5/357: mknod d4/d20/d2b/d5c/c6c 0 2024-02-20T08:06:08.804 INFO:tasks.workunit.client.1.smithi194.stdout:0/371: write d6/d2b/f3a [964451,124873] 0 2024-02-20T08:06:08.805 INFO:tasks.workunit.client.1.smithi194.stdout:6/508: write df/d18/f55 [3145339,10541] 0 2024-02-20T08:06:08.806 INFO:tasks.workunit.client.1.smithi194.stdout:6/509: chown df/d18/d19/d1d/d28/d2b/d80 2409 1 2024-02-20T08:06:08.811 INFO:tasks.workunit.client.1.smithi194.stdout:5/358: dwrite d4/d6/d11/d15/d28/f66 [0,4194304] 0 2024-02-20T08:06:08.814 INFO:tasks.workunit.client.1.smithi194.stdout:5/359: fdatasync d4/d6/d11/d15/d28/d46/f3f 0 2024-02-20T08:06:08.814 INFO:tasks.workunit.client.1.smithi194.stdout:6/510: dwrite df/d18/d19/d1d/d28/d46/f6c [0,4194304] 0 2024-02-20T08:06:08.817 INFO:tasks.workunit.client.1.smithi194.stdout:2/397: symlink df/d14/d24/d6e/l7b 0 2024-02-20T08:06:08.818 INFO:tasks.workunit.client.1.smithi194.stdout:5/360: dread - d4/d20/d2b/f43 zero size 2024-02-20T08:06:08.819 INFO:tasks.workunit.client.1.smithi194.stdout:9/420: readlink d4/d20/d41/l6b 0 2024-02-20T08:06:08.823 INFO:tasks.workunit.client.1.smithi194.stdout:3/365: write d5/df/f67 [93926,77272] 0 2024-02-20T08:06:08.825 INFO:tasks.workunit.client.1.smithi194.stdout:6/511: dwrite df/d18/d19/d1d/f23 [0,4194304] 0 2024-02-20T08:06:08.827 INFO:tasks.workunit.client.1.smithi194.stdout:5/361: dwrite d4/d6/d11/f31 [4194304,4194304] 0 2024-02-20T08:06:08.828 INFO:tasks.workunit.client.1.smithi194.stdout:8/356: getdents d2/d14/d18/d45/d69 0 2024-02-20T08:06:08.834 INFO:tasks.workunit.client.1.smithi194.stdout:4/351: getdents d0/d10/d1c/d4d 0 2024-02-20T08:06:08.842 INFO:tasks.workunit.client.1.smithi194.stdout:2/398: dread df/d14/d24/f35 [0,4194304] 0 2024-02-20T08:06:08.843 INFO:tasks.workunit.client.1.smithi194.stdout:0/372: link d6/f17 d6/d2b/d35/f7a 0 2024-02-20T08:06:08.848 INFO:tasks.workunit.client.1.smithi194.stdout:8/357: rename d2/d14/c66 to d2/d14/d18/d45/c7c 0 2024-02-20T08:06:08.849 INFO:tasks.workunit.client.1.smithi194.stdout:1/426: link d2/d1a/d26/l76 d2/d8/d60/l88 0 2024-02-20T08:06:08.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/430: getdents d11/d2d/d38/d37 0 2024-02-20T08:06:08.854 INFO:tasks.workunit.client.1.smithi194.stdout:9/421: write d4/de/f6d [5113155,63345] 0 2024-02-20T08:06:08.856 INFO:tasks.workunit.client.1.smithi194.stdout:3/366: creat d5/d10/d28/f6c x:0 0 0 2024-02-20T08:06:08.858 INFO:tasks.workunit.client.1.smithi194.stdout:2/399: creat df/d14/d24/d56/f7c x:0 0 0 2024-02-20T08:06:08.859 INFO:tasks.workunit.client.1.smithi194.stdout:2/400: write df/d3a/f43 [807634,42982] 0 2024-02-20T08:06:08.860 INFO:tasks.workunit.client.1.smithi194.stdout:5/362: symlink d4/d6/dd/d3a/l6d 0 2024-02-20T08:06:08.864 INFO:tasks.workunit.client.1.smithi194.stdout:1/427: creat d2/d1a/d61/d68/f89 x:0 0 0 2024-02-20T08:06:08.867 INFO:tasks.workunit.client.1.smithi194.stdout:4/352: creat d0/d10/d1c/d21/d62/f67 x:0 0 0 2024-02-20T08:06:08.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/431: symlink d11/d2d/d38/d37/d3c/l7e 0 2024-02-20T08:06:08.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/432: chown d11/d2d/d38/d37/l46 793002595 1 2024-02-20T08:06:08.873 INFO:tasks.workunit.client.1.smithi194.stdout:0/373: mknod d6/d2b/d35/d48/d60/d72/c7b 0 2024-02-20T08:06:08.878 INFO:tasks.workunit.client.1.smithi194.stdout:6/512: truncate df/d18/d19/d1d/d28/d5e/f69 2820529 0 2024-02-20T08:06:08.879 INFO:tasks.workunit.client.1.smithi194.stdout:6/513: dread - df/f92 zero size 2024-02-20T08:06:08.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/358: creat d2/d14/d18/d45/d4e/d6c/f7d x:0 0 0 2024-02-20T08:06:08.883 INFO:tasks.workunit.client.1.smithi194.stdout:1/428: symlink d2/d1a/d26/d3d/d71/l8a 0 2024-02-20T08:06:08.887 INFO:tasks.workunit.client.1.smithi194.stdout:7/433: creat d11/d2d/d38/d4a/d27/f7f x:0 0 0 2024-02-20T08:06:08.889 INFO:tasks.workunit.client.1.smithi194.stdout:9/422: creat d4/d8b/f8f x:0 0 0 2024-02-20T08:06:08.889 INFO:tasks.workunit.client.1.smithi194.stdout:2/401: write df/f21 [3915078,61784] 0 2024-02-20T08:06:08.891 INFO:tasks.workunit.client.1.smithi194.stdout:9/423: dread d4/d20/d43/d51/f5f [0,4194304] 0 2024-02-20T08:06:08.892 INFO:tasks.workunit.client.1.smithi194.stdout:9/424: fsync d4/d20/d41/f7c 0 2024-02-20T08:06:08.892 INFO:tasks.workunit.client.1.smithi194.stdout:5/363: write d4/d20/d2b/f2c [4785937,45075] 0 2024-02-20T08:06:08.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/367: symlink d5/df/l6d 0 2024-02-20T08:06:08.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:08 smithi194 ceph-mon[37804]: pgmap v53: 65 pgs: 65 active+clean; 1.7 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.3 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-02-20T08:06:08.894 INFO:tasks.workunit.client.1.smithi194.stdout:5/364: write d4/d6/d11/f31 [8023299,24017] 0 2024-02-20T08:06:08.894 INFO:tasks.workunit.client.1.smithi194.stdout:5/365: chown d4/d6/d11/d15 244072 1 2024-02-20T08:06:08.897 INFO:tasks.workunit.client.1.smithi194.stdout:0/374: symlink d6/d2b/l7c 0 2024-02-20T08:06:08.900 INFO:tasks.workunit.client.1.smithi194.stdout:6/514: mkdir df/d18/d19/d1d/d28/d46/d5a/d6b/d83/da5 0 2024-02-20T08:06:08.903 INFO:tasks.workunit.client.1.smithi194.stdout:8/359: write d2/f5b [1213708,34373] 0 2024-02-20T08:06:08.903 INFO:tasks.workunit.client.1.smithi194.stdout:8/360: readlink d2/d14/d18/l4b 0 2024-02-20T08:06:08.907 INFO:tasks.workunit.client.1.smithi194.stdout:2/402: dread f5 [0,4194304] 0 2024-02-20T08:06:08.910 INFO:tasks.workunit.client.1.smithi194.stdout:7/434: creat d11/d2d/d38/d4a/d27/d51/f80 x:0 0 0 2024-02-20T08:06:08.911 INFO:tasks.workunit.client.1.smithi194.stdout:7/435: chown d11/d2d/d38/d4a/d27/f73 15224 1 2024-02-20T08:06:08.916 INFO:tasks.workunit.client.1.smithi194.stdout:7/436: dwrite d11/d2d/d38/d5a/f5c [4194304,4194304] 0 2024-02-20T08:06:08.920 INFO:tasks.workunit.client.1.smithi194.stdout:5/366: creat d4/f6e x:0 0 0 2024-02-20T08:06:08.921 INFO:tasks.workunit.client.1.smithi194.stdout:5/367: truncate d4/d6/f48 5021707 0 2024-02-20T08:06:08.922 INFO:tasks.workunit.client.1.smithi194.stdout:0/375: symlink d6/d2b/d35/d42/d1e/d45/l7d 0 2024-02-20T08:06:08.925 INFO:tasks.workunit.client.1.smithi194.stdout:6/515: dread df/f13 [0,4194304] 0 2024-02-20T08:06:08.927 INFO:tasks.workunit.client.1.smithi194.stdout:8/361: unlink d2/f41 0 2024-02-20T08:06:08.928 INFO:tasks.workunit.client.1.smithi194.stdout:8/362: dread - d2/d14/d18/d45/f6b zero size 2024-02-20T08:06:08.938 INFO:tasks.workunit.client.1.smithi194.stdout:9/425: getdents d4/d37/d4f 0 2024-02-20T08:06:08.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/363: dread d2/f37 [0,4194304] 0 2024-02-20T08:06:08.944 INFO:tasks.workunit.client.1.smithi194.stdout:3/368: symlink d5/l6e 0 2024-02-20T08:06:08.944 INFO:tasks.workunit.client.1.smithi194.stdout:8/364: chown d2/d14/d18/l77 2008 1 2024-02-20T08:06:08.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/365: readlink d2/d14/d18/l3e 0 2024-02-20T08:06:08.948 INFO:tasks.workunit.client.1.smithi194.stdout:5/368: rmdir d4 39 2024-02-20T08:06:08.954 INFO:tasks.workunit.client.1.smithi194.stdout:0/376: mknod d6/d2b/d35/d42/d1e/c7e 0 2024-02-20T08:06:08.954 INFO:tasks.workunit.client.1.smithi194.stdout:0/377: chown d6/d2b/d35/d42/f74 0 1 2024-02-20T08:06:08.956 INFO:tasks.workunit.client.1.smithi194.stdout:6/516: creat df/d18/d19/d1d/d28/d46/d5a/fa6 x:0 0 0 2024-02-20T08:06:08.959 INFO:tasks.workunit.client.1.smithi194.stdout:4/353: rename d0/d2/ca to d0/d2/c68 0 2024-02-20T08:06:08.959 INFO:tasks.workunit.client.1.smithi194.stdout:3/369: dread d5/d10/d17/d1d/f1e [0,4194304] 0 2024-02-20T08:06:08.962 INFO:tasks.workunit.client.1.smithi194.stdout:2/403: symlink df/d14/l7d 0 2024-02-20T08:06:08.963 INFO:tasks.workunit.client.1.smithi194.stdout:2/404: chown df/d14/d24 2013 1 2024-02-20T08:06:08.963 INFO:tasks.workunit.client.1.smithi194.stdout:2/405: chown df/c40 41572 1 2024-02-20T08:06:08.971 INFO:tasks.workunit.client.1.smithi194.stdout:6/517: mkdir df/d18/d19/d1d/d28/d5e/da7 0 2024-02-20T08:06:08.972 INFO:tasks.workunit.client.1.smithi194.stdout:1/429: getdents d2/d1a/d26/d3d 0 2024-02-20T08:06:08.975 INFO:tasks.workunit.client.1.smithi194.stdout:4/354: dread d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:08.975 INFO:tasks.workunit.client.1.smithi194.stdout:3/370: symlink d5/d10/d16/l6f 0 2024-02-20T08:06:08.979 INFO:tasks.workunit.client.1.smithi194.stdout:8/366: symlink d2/d14/d18/d45/d4e/d6c/d78/l7e 0 2024-02-20T08:06:08.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/518: rename df/d18/d19/d1d/d76/da1 to df/d42/da8 0 2024-02-20T08:06:08.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/437: getdents d11/d2d/d38/d4a/d53 0 2024-02-20T08:06:08.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/406: mknod df/d5b/c7e 0 2024-02-20T08:06:08.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/407: dread - df/d14/d24/d56/f7c zero size 2024-02-20T08:06:08.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/408: readlink df/d14/d24/l3d 0 2024-02-20T08:06:08.991 INFO:tasks.workunit.client.1.smithi194.stdout:8/367: creat d2/d14/d18/f7f x:0 0 0 2024-02-20T08:06:08.999 INFO:tasks.workunit.client.1.smithi194.stdout:5/369: truncate d4/d6/d11/d2f/f52 3595219 0 2024-02-20T08:06:09.001 INFO:tasks.workunit.client.1.smithi194.stdout:3/371: truncate d5/fe 4571682 0 2024-02-20T08:06:09.005 INFO:tasks.workunit.client.1.smithi194.stdout:1/430: dwrite d2/d8/df/f65 [0,4194304] 0 2024-02-20T08:06:09.006 INFO:tasks.workunit.client.1.smithi194.stdout:1/431: fsync d2/d8/d12/f55 0 2024-02-20T08:06:09.007 INFO:tasks.workunit.client.1.smithi194.stdout:2/409: creat df/d14/d19/d5c/d60/f7f x:0 0 0 2024-02-20T08:06:09.008 INFO:tasks.workunit.client.1.smithi194.stdout:4/355: truncate d0/d10/d1c/d4d/f38 1986856 0 2024-02-20T08:06:09.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/356: write d0/d10/f22 [3526828,19157] 0 2024-02-20T08:06:09.011 INFO:tasks.workunit.client.1.smithi194.stdout:0/378: getdents d6/d2b/d35 0 2024-02-20T08:06:09.013 INFO:tasks.workunit.client.1.smithi194.stdout:6/519: creat df/d18/d19/d1d/d99/fa9 x:0 0 0 2024-02-20T08:06:09.013 INFO:tasks.workunit.client.1.smithi194.stdout:5/370: symlink d4/d20/l6f 0 2024-02-20T08:06:09.017 INFO:tasks.workunit.client.1.smithi194.stdout:8/368: mkdir d2/d80 0 2024-02-20T08:06:09.017 INFO:tasks.workunit.client.1.smithi194.stdout:1/432: dwrite d2/d1a/d26/f6a [0,4194304] 0 2024-02-20T08:06:09.019 INFO:tasks.workunit.client.1.smithi194.stdout:8/369: write d2/f31 [300786,13526] 0 2024-02-20T08:06:09.022 INFO:tasks.workunit.client.1.smithi194.stdout:8/370: write d2/d14/f49 [2101722,51767] 0 2024-02-20T08:06:09.024 INFO:tasks.workunit.client.1.smithi194.stdout:4/357: write d0/f19 [5043547,4924] 0 2024-02-20T08:06:09.025 INFO:tasks.workunit.client.1.smithi194.stdout:8/371: chown d2/d14/d18/l4b 173952 1 2024-02-20T08:06:09.025 INFO:tasks.workunit.client.1.smithi194.stdout:0/379: dread d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:09.029 INFO:tasks.workunit.client.1.smithi194.stdout:0/380: write d6/d2b/d35/f38 [3105506,117265] 0 2024-02-20T08:06:09.032 INFO:tasks.workunit.client.1.smithi194.stdout:1/433: mknod d2/d8/dc/c8b 0 2024-02-20T08:06:09.034 INFO:tasks.workunit.client.1.smithi194.stdout:4/358: mkdir d0/df/d41/d69 0 2024-02-20T08:06:09.034 INFO:tasks.workunit.client.1.smithi194.stdout:7/438: dwrite d11/d2d/f24 [0,4194304] 0 2024-02-20T08:06:09.035 INFO:tasks.workunit.client.1.smithi194.stdout:2/410: dread df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:09.036 INFO:tasks.workunit.client.1.smithi194.stdout:1/434: write d2/f36 [4418708,99754] 0 2024-02-20T08:06:09.036 INFO:tasks.workunit.client.1.smithi194.stdout:8/372: creat d2/d4d/f81 x:0 0 0 2024-02-20T08:06:09.039 INFO:tasks.workunit.client.1.smithi194.stdout:5/371: unlink d4/d6/c18 0 2024-02-20T08:06:09.045 INFO:tasks.workunit.client.1.smithi194.stdout:2/411: dread df/d14/f66 [0,4194304] 0 2024-02-20T08:06:09.046 INFO:tasks.workunit.client.1.smithi194.stdout:7/439: dwrite d11/d2d/d38/d37/f4b [4194304,4194304] 0 2024-02-20T08:06:09.048 INFO:tasks.workunit.client.1.smithi194.stdout:3/372: dread d5/f34 [0,4194304] 0 2024-02-20T08:06:09.048 INFO:tasks.workunit.client.1.smithi194.stdout:2/412: chown df/d14/d24/c49 218 1 2024-02-20T08:06:09.049 INFO:tasks.workunit.client.1.smithi194.stdout:5/372: unlink d4/d6/d11/d15/l1d 0 2024-02-20T08:06:09.049 INFO:tasks.workunit.client.1.smithi194.stdout:0/381: mkdir d6/d2b/d35/d39/d55/d59/d77/d7f 0 2024-02-20T08:06:09.052 INFO:tasks.workunit.client.1.smithi194.stdout:0/382: chown d6/d2b/d35/d39/d55/f69 199 1 2024-02-20T08:06:09.052 INFO:tasks.workunit.client.1.smithi194.stdout:8/373: mknod d2/d14/c82 0 2024-02-20T08:06:09.053 INFO:tasks.workunit.client.1.smithi194.stdout:5/373: write d4/d6/d11/d2f/f49 [928772,127061] 0 2024-02-20T08:06:09.056 INFO:tasks.workunit.client.1.smithi194.stdout:3/373: write d5/f34 [3509721,77912] 0 2024-02-20T08:06:09.059 INFO:tasks.workunit.client.1.smithi194.stdout:8/374: chown d2/d4d/l65 270269801 1 2024-02-20T08:06:09.064 INFO:tasks.workunit.client.1.smithi194.stdout:4/359: dread d0/f2d [0,4194304] 0 2024-02-20T08:06:09.064 INFO:tasks.workunit.client.1.smithi194.stdout:7/440: dwrite d11/d2d/d38/d5a/f5c [0,4194304] 0 2024-02-20T08:06:09.064 INFO:tasks.workunit.client.1.smithi194.stdout:5/374: mknod d4/d6/d11/d15/c70 0 2024-02-20T08:06:09.064 INFO:tasks.workunit.client.1.smithi194.stdout:6/520: dread df/d18/d19/f1a [0,4194304] 0 2024-02-20T08:06:09.070 INFO:tasks.workunit.client.1.smithi194.stdout:1/435: dread d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:09.070 INFO:tasks.workunit.client.1.smithi194.stdout:2/413: rename df/d14/d24/d56/d73 to df/d14/d80 0 2024-02-20T08:06:09.071 INFO:tasks.workunit.client.1.smithi194.stdout:0/383: rename d6/d2b/d35/d48/d60/d72 to d6/d2b/d35/d48/d60/d72/d80 22 2024-02-20T08:06:09.074 INFO:tasks.workunit.client.1.smithi194.stdout:8/375: dwrite d2/d14/f24 [0,4194304] 0 2024-02-20T08:06:09.074 INFO:tasks.workunit.client.1.smithi194.stdout:3/374: symlink d5/d10/d17/d1d/d3d/l70 0 2024-02-20T08:06:09.075 INFO:tasks.workunit.client.1.smithi194.stdout:1/436: write d2/d8/dc/d34/f4c [645418,90867] 0 2024-02-20T08:06:09.076 INFO:tasks.workunit.client.1.smithi194.stdout:7/441: mkdir d11/d2d/d38/d4a/d53/d81 0 2024-02-20T08:06:09.076 INFO:tasks.workunit.client.1.smithi194.stdout:6/521: dread df/f13 [0,4194304] 0 2024-02-20T08:06:09.076 INFO:tasks.workunit.client.1.smithi194.stdout:0/384: chown d6/d2b/d35/d39/l3b 0 1 2024-02-20T08:06:09.079 INFO:tasks.workunit.client.1.smithi194.stdout:5/375: rename d4/d6/d11/f31 to d4/d6/d11/d2f/f71 0 2024-02-20T08:06:09.083 INFO:tasks.workunit.client.1.smithi194.stdout:1/437: stat d2/d8/df/l37 0 2024-02-20T08:06:09.086 INFO:tasks.workunit.client.1.smithi194.stdout:4/360: dwrite d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:09.087 INFO:tasks.workunit.client.1.smithi194.stdout:2/414: rename df/d14/d24/d6e to df/d14/d24/d56/d6b/d81 0 2024-02-20T08:06:09.089 INFO:tasks.workunit.client.1.smithi194.stdout:0/385: symlink d6/d2b/d35/d42/d1e/d45/d58/l81 0 2024-02-20T08:06:09.091 INFO:tasks.workunit.client.1.smithi194.stdout:1/438: dread d2/d8/dc/d34/f4c [0,4194304] 0 2024-02-20T08:06:09.091 INFO:tasks.workunit.client.1.smithi194.stdout:7/442: dwrite d11/d2d/d38/d4a/d27/f7f [0,4194304] 0 2024-02-20T08:06:09.095 INFO:tasks.workunit.client.1.smithi194.stdout:8/376: link d2/d4d/f6e d2/d14/d18/f83 0 2024-02-20T08:06:09.095 INFO:tasks.workunit.client.1.smithi194.stdout:4/361: dwrite d0/d2/f35 [4194304,4194304] 0 2024-02-20T08:06:09.100 INFO:tasks.workunit.client.1.smithi194.stdout:5/376: mknod d4/d6/d11/d2f/d56/d65/c72 0 2024-02-20T08:06:09.106 INFO:tasks.workunit.client.1.smithi194.stdout:3/375: dread d5/df/d60/f40 [0,4194304] 0 2024-02-20T08:06:09.114 INFO:tasks.workunit.client.1.smithi194.stdout:0/386: symlink d6/d2b/l82 0 2024-02-20T08:06:09.117 INFO:tasks.workunit.client.1.smithi194.stdout:2/415: dwrite fc [0,4194304] 0 2024-02-20T08:06:09.118 INFO:tasks.workunit.client.1.smithi194.stdout:7/443: rmdir d11/d2d/d38/d5a/d6b 39 2024-02-20T08:06:09.120 INFO:tasks.workunit.client.1.smithi194.stdout:0/387: dread d6/f3d [0,4194304] 0 2024-02-20T08:06:09.120 INFO:tasks.workunit.client.1.smithi194.stdout:7/444: dread d11/d2d/d38/d4a/d60/f75 [0,4194304] 0 2024-02-20T08:06:09.121 INFO:tasks.workunit.client.1.smithi194.stdout:8/377: readlink d2/d14/d18/d45/l62 0 2024-02-20T08:06:09.122 INFO:tasks.workunit.client.1.smithi194.stdout:8/378: dread - d2/d14/d18/d45/d4e/d6c/f7d zero size 2024-02-20T08:06:09.123 INFO:tasks.workunit.client.1.smithi194.stdout:9/426: sync 2024-02-20T08:06:09.124 INFO:tasks.workunit.client.1.smithi194.stdout:6/522: symlink df/d18/d19/d1d/d28/d46/d5a/d6b/d83/d93/laa 0 2024-02-20T08:06:09.127 INFO:tasks.workunit.client.1.smithi194.stdout:7/445: dwrite d11/d2d/f24 [0,4194304] 0 2024-02-20T08:06:09.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/376: creat d5/d10/d17/d1d/d56/f71 x:0 0 0 2024-02-20T08:06:09.128 INFO:tasks.workunit.client.1.smithi194.stdout:3/377: fsync d5/d10/d16/f5a 0 2024-02-20T08:06:09.130 INFO:tasks.workunit.client.1.smithi194.stdout:5/377: dwrite d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:09.136 INFO:tasks.workunit.client.1.smithi194.stdout:0/388: rename d6/d2b/d35/d42/f1b to d6/d2b/d35/d42/d1e/d3c/d43/f83 0 2024-02-20T08:06:09.137 INFO:tasks.workunit.client.1.smithi194.stdout:0/389: dread - d6/d2b/d35/d39/d55/f69 zero size 2024-02-20T08:06:09.140 INFO:tasks.workunit.client.1.smithi194.stdout:7/446: dread d11/d2d/d38/d37/f4b [4194304,4194304] 0 2024-02-20T08:06:09.142 INFO:tasks.workunit.client.1.smithi194.stdout:8/379: symlink d2/d14/d18/d45/d4e/d6c/l84 0 2024-02-20T08:06:09.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/416: mknod df/d14/d24/c82 0 2024-02-20T08:06:09.147 INFO:tasks.workunit.client.1.smithi194.stdout:1/439: write d2/d8/f85 [1415463,79044] 0 2024-02-20T08:06:09.147 INFO:tasks.workunit.client.1.smithi194.stdout:2/417: stat df/l59 0 2024-02-20T08:06:09.147 INFO:tasks.workunit.client.1.smithi194.stdout:1/440: chown d2/d1a 69047 1 2024-02-20T08:06:09.147 INFO:tasks.workunit.client.1.smithi194.stdout:2/418: fdatasync df/d14/d24/f48 0 2024-02-20T08:06:09.148 INFO:tasks.workunit.client.1.smithi194.stdout:4/362: link d0/d5c/d60/f39 d0/d2/f6a 0 2024-02-20T08:06:09.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/378: fsync d4/d6/d11/d15/f2a 0 2024-02-20T08:06:09.151 INFO:tasks.workunit.client.1.smithi194.stdout:9/427: fdatasync d4/d20/d5c/f31 0 2024-02-20T08:06:09.153 INFO:tasks.workunit.client.1.smithi194.stdout:0/390: symlink d6/d2b/d35/d42/d1e/l84 0 2024-02-20T08:06:09.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/447: unlink d11/d2d/d38/d4a/d60/f75 0 2024-02-20T08:06:09.166 INFO:tasks.workunit.client.1.smithi194.stdout:5/379: read d4/d6/d11/d15/d28/d46/f54 [3559842,26458] 0 2024-02-20T08:06:09.166 INFO:tasks.workunit.client.1.smithi194.stdout:3/378: fsync d5/d10/f52 0 2024-02-20T08:06:09.168 INFO:tasks.workunit.client.1.smithi194.stdout:9/428: dread - d4/d2d/d42/d4e/d6e/d88/f8e zero size 2024-02-20T08:06:09.169 INFO:tasks.workunit.client.1.smithi194.stdout:9/429: chown d4/d2d/d42/c8c 21 1 2024-02-20T08:06:09.169 INFO:tasks.workunit.client.1.smithi194.stdout:0/391: unlink d6/l37 0 2024-02-20T08:06:09.172 INFO:tasks.workunit.client.1.smithi194.stdout:2/419: creat df/d14/d19/d5c/d78/f83 x:0 0 0 2024-02-20T08:06:09.173 INFO:tasks.workunit.client.1.smithi194.stdout:5/380: creat d4/f73 x:0 0 0 2024-02-20T08:06:09.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/392: dwrite d6/d2b/d35/d39/d55/f6d [0,4194304] 0 2024-02-20T08:06:09.176 INFO:tasks.workunit.client.1.smithi194.stdout:4/363: mkdir d0/d2/d6b 0 2024-02-20T08:06:09.176 INFO:tasks.workunit.client.1.smithi194.stdout:4/364: chown d0/df/c52 1687 1 2024-02-20T08:06:09.180 INFO:tasks.workunit.client.1.smithi194.stdout:6/523: rename df/d18/d19 to df/dab 0 2024-02-20T08:06:09.183 INFO:tasks.workunit.client.1.smithi194.stdout:9/430: chown d4/c18 198 1 2024-02-20T08:06:09.187 INFO:tasks.workunit.client.1.smithi194.stdout:2/420: symlink df/d14/d19/d5c/l84 0 2024-02-20T08:06:09.188 INFO:tasks.workunit.client.1.smithi194.stdout:2/421: write df/d14/d19/d5c/d78/f83 [63299,26522] 0 2024-02-20T08:06:09.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/422: write df/f72 [728757,10765] 0 2024-02-20T08:06:09.190 INFO:tasks.workunit.client.1.smithi194.stdout:2/423: chown df/l33 7322 1 2024-02-20T08:06:09.190 INFO:tasks.workunit.client.1.smithi194.stdout:0/393: symlink d6/d2b/d35/l85 0 2024-02-20T08:06:09.195 INFO:tasks.workunit.client.1.smithi194.stdout:0/394: dwrite d6/d2b/f50 [0,4194304] 0 2024-02-20T08:06:09.199 INFO:tasks.workunit.client.1.smithi194.stdout:1/441: rename d2/d8/dc to d2/d1a/d26/d3d/d71/d8c 0 2024-02-20T08:06:09.201 INFO:tasks.workunit.client.1.smithi194.stdout:6/524: mknod df/d42/cac 0 2024-02-20T08:06:09.209 INFO:tasks.workunit.client.1.smithi194.stdout:0/395: mknod d6/d2b/d35/d42/d1e/d45/c86 0 2024-02-20T08:06:09.214 INFO:tasks.workunit.client.1.smithi194.stdout:3/379: rename d5/d10/d16/l21 to d5/d10/d62/l72 0 2024-02-20T08:06:09.215 INFO:tasks.workunit.client.1.smithi194.stdout:6/525: chown c3 1414268020 1 2024-02-20T08:06:09.215 INFO:tasks.workunit.client.1.smithi194.stdout:2/424: fdatasync df/d14/d24/f6c 0 2024-02-20T08:06:09.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/396: truncate d6/d2b/d35/d42/f24 2415960 0 2024-02-20T08:06:09.217 INFO:tasks.workunit.client.1.smithi194.stdout:1/442: symlink d2/d1a/l8d 0 2024-02-20T08:06:09.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/397: stat d6/d2b/d35/d42/d1e/d45/l4d 0 2024-02-20T08:06:09.219 INFO:tasks.workunit.client.1.smithi194.stdout:0/398: chown d6/d2b/d35/d42/d1e/c7e 257282 1 2024-02-20T08:06:09.220 INFO:tasks.workunit.client.1.smithi194.stdout:3/380: mkdir d5/d10/d28/d41/d73 0 2024-02-20T08:06:09.223 INFO:tasks.workunit.client.1.smithi194.stdout:6/526: creat df/d42/da8/fad x:0 0 0 2024-02-20T08:06:09.223 INFO:tasks.workunit.client.1.smithi194.stdout:1/443: dwrite d2/d8/d12/f55 [0,4194304] 0 2024-02-20T08:06:09.224 INFO:tasks.workunit.client.1.smithi194.stdout:2/425: mkdir df/d14/d80/d85 0 2024-02-20T08:06:09.225 INFO:tasks.workunit.client.1.smithi194.stdout:2/426: stat df/d14/f32 0 2024-02-20T08:06:09.229 INFO:tasks.workunit.client.1.smithi194.stdout:2/427: dread df/d14/d24/f4e [0,4194304] 0 2024-02-20T08:06:09.230 INFO:tasks.workunit.client.1.smithi194.stdout:5/381: rename d4/d20/c5d to d4/d20/d2b/c74 0 2024-02-20T08:06:09.232 INFO:tasks.workunit.client.1.smithi194.stdout:5/382: dread d4/d20/d2b/f4b [0,4194304] 0 2024-02-20T08:06:09.238 INFO:tasks.workunit.client.1.smithi194.stdout:5/383: dwrite d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:09.238 INFO:tasks.workunit.client.1.smithi194.stdout:3/381: mkdir d5/d10/d17/d1d/d56/d74 0 2024-02-20T08:06:09.239 INFO:tasks.workunit.client.1.smithi194.stdout:1/444: symlink d2/d48/l8e 0 2024-02-20T08:06:09.240 INFO:tasks.workunit.client.1.smithi194.stdout:3/382: readlink d5/d10/d28/l46 0 2024-02-20T08:06:09.241 INFO:tasks.workunit.client.1.smithi194.stdout:6/527: mkdir df/dab/d1d/d28/d46/dae 0 2024-02-20T08:06:09.241 INFO:tasks.workunit.client.1.smithi194.stdout:1/445: read d2/d1a/d61/f67 [68109,98270] 0 2024-02-20T08:06:09.249 INFO:tasks.workunit.client.1.smithi194.stdout:2/428: dread df/d14/d19/d5c/d60/d63/f62 [0,4194304] 0 2024-02-20T08:06:09.253 INFO:tasks.workunit.client.1.smithi194.stdout:3/383: unlink d5/df/l6d 0 2024-02-20T08:06:09.259 INFO:tasks.workunit.client.1.smithi194.stdout:6/528: mknod df/dab/d1d/d28/d2b/caf 0 2024-02-20T08:06:09.260 INFO:tasks.workunit.client.1.smithi194.stdout:1/446: symlink d2/d1a/d61/d7d/l8f 0 2024-02-20T08:06:09.263 INFO:tasks.workunit.client.1.smithi194.stdout:9/431: rename d4/d55/d77 to d4/d1b/d90 0 2024-02-20T08:06:09.267 INFO:tasks.workunit.client.1.smithi194.stdout:0/399: dread d6/d2b/f63 [0,4194304] 0 2024-02-20T08:06:09.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/429: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:09.268 INFO:tasks.workunit.client.1.smithi194.stdout:9/432: dread d4/d1b/d79/f89 [0,4194304] 0 2024-02-20T08:06:09.272 INFO:tasks.workunit.client.1.smithi194.stdout:6/529: mknod df/dab/d1d/d28/d2b/d9b/cb0 0 2024-02-20T08:06:09.272 INFO:tasks.workunit.client.1.smithi194.stdout:3/384: write d5/df/d30/f36 [5221490,100045] 0 2024-02-20T08:06:09.314 INFO:tasks.workunit.client.1.smithi194.stdout:0/400: creat d6/d2b/d35/d42/d1e/d45/d58/f87 x:0 0 0 2024-02-20T08:06:09.315 INFO:tasks.workunit.client.1.smithi194.stdout:2/430: creat df/d14/d80/d85/f86 x:0 0 0 2024-02-20T08:06:09.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/431: write df/f2b [3578202,37877] 0 2024-02-20T08:06:09.316 INFO:tasks.workunit.client.1.smithi194.stdout:9/433: mkdir d4/d37/d4f/d91 0 2024-02-20T08:06:09.317 INFO:tasks.workunit.client.1.smithi194.stdout:2/432: chown df/f4f 37812963 1 2024-02-20T08:06:09.318 INFO:tasks.workunit.client.1.smithi194.stdout:1/447: getdents d2 0 2024-02-20T08:06:09.319 INFO:tasks.workunit.client.1.smithi194.stdout:6/530: creat df/dab/d1d/d28/d2b/d80/fb1 x:0 0 0 2024-02-20T08:06:09.320 INFO:tasks.workunit.client.1.smithi194.stdout:9/434: truncate d4/d20/d43/f47 1651471 0 2024-02-20T08:06:09.320 INFO:tasks.workunit.client.1.smithi194.stdout:1/448: fsync d2/d8/df/f24 0 2024-02-20T08:06:09.324 INFO:tasks.workunit.client.1.smithi194.stdout:5/384: rename d4/d6/dd/f36 to d4/d6/f75 0 2024-02-20T08:06:09.324 INFO:tasks.workunit.client.1.smithi194.stdout:3/385: dwrite d5/df/d60/f40 [0,4194304] 0 2024-02-20T08:06:09.325 INFO:tasks.workunit.client.1.smithi194.stdout:1/449: dread - d2/d1a/d26/d3d/d71/d8c/d34/f78 zero size 2024-02-20T08:06:09.325 INFO:tasks.workunit.client.1.smithi194.stdout:5/385: stat d4/d6/d11/d2f/f49 0 2024-02-20T08:06:09.328 INFO:tasks.workunit.client.1.smithi194.stdout:6/531: chown df/dab/d1d/d28/c58 3 1 2024-02-20T08:06:09.328 INFO:tasks.workunit.client.1.smithi194.stdout:5/386: fdatasync d4/d6/d11/d2f/d56/d65/d53/f64 0 2024-02-20T08:06:09.328 INFO:tasks.workunit.client.1.smithi194.stdout:2/433: dwrite df/d14/f22 [4194304,4194304] 0 2024-02-20T08:06:09.328 INFO:tasks.workunit.client.1.smithi194.stdout:6/532: dread - df/dab/f54 zero size 2024-02-20T08:06:09.333 INFO:tasks.workunit.client.1.smithi194.stdout:9/435: mknod d4/d2d/d42/d4e/d6e/c92 0 2024-02-20T08:06:09.334 INFO:tasks.workunit.client.1.smithi194.stdout:9/436: write d4/d2d/d59/f5b [549788,124300] 0 2024-02-20T08:06:09.340 INFO:tasks.workunit.client.1.smithi194.stdout:2/434: creat df/d14/d24/d56/d6b/d81/f87 x:0 0 0 2024-02-20T08:06:09.342 INFO:tasks.workunit.client.1.smithi194.stdout:9/437: stat d4/d20/d5c/l5d 0 2024-02-20T08:06:09.345 INFO:tasks.workunit.client.1.smithi194.stdout:0/401: rename d6/d2b/d35/d42/d1e/d45/d58/f6e to d6/f88 0 2024-02-20T08:06:09.349 INFO:tasks.workunit.client.1.smithi194.stdout:1/450: getdents d2/d1a/d26/d45 0 2024-02-20T08:06:09.350 INFO:tasks.workunit.client.1.smithi194.stdout:0/402: rmdir d6/d2b/d35/d42/d1e/d3c/d43 39 2024-02-20T08:06:09.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/435: dwrite df/d14/d24/d56/d6b/d81/f87 [0,4194304] 0 2024-02-20T08:06:09.351 INFO:tasks.workunit.client.1.smithi194.stdout:9/438: dwrite d4/d20/d5c/f3e [0,4194304] 0 2024-02-20T08:06:09.353 INFO:tasks.workunit.client.1.smithi194.stdout:0/403: stat d6/d2b/d35/d42/d1e/d45 0 2024-02-20T08:06:09.358 INFO:tasks.workunit.client.1.smithi194.stdout:2/436: symlink df/d14/d19/d5c/l88 0 2024-02-20T08:06:09.358 INFO:tasks.workunit.client.1.smithi194.stdout:2/437: stat df/l59 0 2024-02-20T08:06:09.361 INFO:tasks.workunit.client.1.smithi194.stdout:9/439: fdatasync d4/d20/d43/f63 0 2024-02-20T08:06:09.361 INFO:tasks.workunit.client.1.smithi194.stdout:9/440: chown d4/d2d/l66 1798856 1 2024-02-20T08:06:09.362 INFO:tasks.workunit.client.1.smithi194.stdout:9/441: write d4/d1b/f36 [5069567,76486] 0 2024-02-20T08:06:09.369 INFO:tasks.workunit.client.1.smithi194.stdout:5/387: dread d4/d6/d11/d15/d28/f39 [0,4194304] 0 2024-02-20T08:06:09.369 INFO:tasks.workunit.client.1.smithi194.stdout:5/388: chown d4/d6/d11/d15/d28/d46/f3f 39359577 1 2024-02-20T08:06:09.372 INFO:tasks.workunit.client.1.smithi194.stdout:2/438: rename df/d14/d19/f23 to df/d5b/d61/f89 0 2024-02-20T08:06:09.373 INFO:tasks.workunit.client.1.smithi194.stdout:0/404: creat d6/d2b/d35/d39/d55/d59/d77/d7f/f89 x:0 0 0 2024-02-20T08:06:09.375 INFO:tasks.workunit.client.1.smithi194.stdout:9/442: rmdir d4/d20/d43/d51 39 2024-02-20T08:06:09.375 INFO:tasks.workunit.client.1.smithi194.stdout:5/389: rmdir d4/d6/d11 39 2024-02-20T08:06:09.378 INFO:tasks.workunit.client.1.smithi194.stdout:9/443: unlink d4/c54 0 2024-02-20T08:06:09.380 INFO:tasks.workunit.client.1.smithi194.stdout:1/451: truncate d2/d48/f64 388737 0 2024-02-20T08:06:09.381 INFO:tasks.workunit.client.1.smithi194.stdout:1/452: readlink d2/d8/l27 0 2024-02-20T08:06:09.382 INFO:tasks.workunit.client.1.smithi194.stdout:2/439: mknod df/c8a 0 2024-02-20T08:06:09.382 INFO:tasks.workunit.client.1.smithi194.stdout:1/453: write d2/d1a/d26/d45/f4a [594740,84560] 0 2024-02-20T08:06:09.385 INFO:tasks.workunit.client.1.smithi194.stdout:9/444: mknod d4/d2d/d59/c93 0 2024-02-20T08:06:09.386 INFO:tasks.workunit.client.1.smithi194.stdout:5/390: truncate d4/d6/dd/d25/f59 1359302 0 2024-02-20T08:06:09.387 INFO:tasks.workunit.client.1.smithi194.stdout:2/440: creat df/d5b/d61/f8b x:0 0 0 2024-02-20T08:06:09.388 INFO:tasks.workunit.client.1.smithi194.stdout:2/441: chown df/d14/d24/c49 1277341 1 2024-02-20T08:06:09.388 INFO:tasks.workunit.client.1.smithi194.stdout:1/454: creat d2/d1a/d26/d57/f90 x:0 0 0 2024-02-20T08:06:09.392 INFO:tasks.workunit.client.1.smithi194.stdout:9/445: rename d4/d20/d5c/f2c to d4/de/f94 0 2024-02-20T08:06:09.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/442: dwrite df/d14/d24/f48 [0,4194304] 0 2024-02-20T08:06:09.398 INFO:tasks.workunit.client.1.smithi194.stdout:0/405: getdents d6/d2b/d35/d42 0 2024-02-20T08:06:09.404 INFO:tasks.workunit.client.1.smithi194.stdout:2/443: mknod df/d14/d24/d56/d6b/d81/c8c 0 2024-02-20T08:06:09.405 INFO:tasks.workunit.client.1.smithi194.stdout:2/444: write df/f72 [1152464,54893] 0 2024-02-20T08:06:09.405 INFO:tasks.workunit.client.1.smithi194.stdout:2/445: stat df/d14/f6a 0 2024-02-20T08:06:09.407 INFO:tasks.workunit.client.1.smithi194.stdout:5/391: rename d4/d6/d11/l58 to d4/d6/d11/d15/d28/d46/l76 0 2024-02-20T08:06:09.413 INFO:tasks.workunit.client.1.smithi194.stdout:1/455: mknod d2/d8/c91 0 2024-02-20T08:06:09.422 INFO:tasks.workunit.client.1.smithi194.stdout:2/446: rmdir df/d14/d24/d56/d6b/d81 39 2024-02-20T08:06:09.423 INFO:tasks.workunit.client.1.smithi194.stdout:9/446: symlink d4/d20/d43/d51/d6a/l95 0 2024-02-20T08:06:09.424 INFO:tasks.workunit.client.1.smithi194.stdout:9/447: chown d4/d20/d5c/l5d 204 1 2024-02-20T08:06:09.426 INFO:tasks.workunit.client.1.smithi194.stdout:1/456: symlink d2/d1a/d26/d3d/d82/l92 0 2024-02-20T08:06:09.428 INFO:tasks.workunit.client.1.smithi194.stdout:2/447: rename df/d3a/l3b to df/d14/d19/d5c/d78/l8d 0 2024-02-20T08:06:09.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/448: dread - df/d14/d19/d5c/d60/f67 zero size 2024-02-20T08:06:09.430 INFO:tasks.workunit.client.1.smithi194.stdout:9/448: unlink d4/d1b/d2e/f7f 0 2024-02-20T08:06:09.431 INFO:tasks.workunit.client.1.smithi194.stdout:1/457: mknod d2/d1a/d61/c93 0 2024-02-20T08:06:09.431 INFO:tasks.workunit.client.1.smithi194.stdout:0/406: dwrite d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:09.432 INFO:tasks.workunit.client.1.smithi194.stdout:1/458: read d2/d8/df/f65 [3904397,98953] 0 2024-02-20T08:06:09.437 INFO:tasks.workunit.client.1.smithi194.stdout:2/449: mkdir df/d14/d80/d85/d8e 0 2024-02-20T08:06:09.438 INFO:tasks.workunit.client.1.smithi194.stdout:9/449: creat d4/de/f96 x:0 0 0 2024-02-20T08:06:09.440 INFO:tasks.workunit.client.1.smithi194.stdout:5/392: dread d4/fc [0,4194304] 0 2024-02-20T08:06:09.444 INFO:tasks.workunit.client.1.smithi194.stdout:5/393: rename d4/d6/d11/d2f/d56 to d4/d6/d11/d2f/d77 0 2024-02-20T08:06:09.445 INFO:tasks.workunit.client.1.smithi194.stdout:5/394: chown d4/fc 20031 1 2024-02-20T08:06:09.448 INFO:tasks.workunit.client.1.smithi194.stdout:2/450: creat df/d14/f8f x:0 0 0 2024-02-20T08:06:09.450 INFO:tasks.workunit.client.1.smithi194.stdout:5/395: write d4/d20/d2b/f2c [2856587,65709] 0 2024-02-20T08:06:09.451 INFO:tasks.workunit.client.1.smithi194.stdout:0/407: getdents d6/d2b/d35/d39/d55/d59/d77 0 2024-02-20T08:06:09.452 INFO:tasks.workunit.client.1.smithi194.stdout:9/450: getdents d4/d37/d4f 0 2024-02-20T08:06:09.452 INFO:tasks.workunit.client.1.smithi194.stdout:0/408: write d6/d2b/d35/d39/d55/f69 [503284,92089] 0 2024-02-20T08:06:09.455 INFO:tasks.workunit.client.1.smithi194.stdout:5/396: rename d4/d6/d11/d69 to d4/d6/dd/d25/d78 0 2024-02-20T08:06:09.457 INFO:tasks.workunit.client.1.smithi194.stdout:9/451: dwrite d4/d1b/d2e/f30 [4194304,4194304] 0 2024-02-20T08:06:09.460 INFO:tasks.workunit.client.1.smithi194.stdout:0/409: creat d6/d2b/d35/d42/d1e/d3c/f8a x:0 0 0 2024-02-20T08:06:09.469 INFO:tasks.workunit.client.1.smithi194.stdout:5/397: dread d4/d6/d11/d15/d28/d46/f3e [0,4194304] 0 2024-02-20T08:06:09.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/410: creat d6/d2b/d35/d42/d1e/d3c/d43/d62/f8b x:0 0 0 2024-02-20T08:06:09.474 INFO:tasks.workunit.client.1.smithi194.stdout:9/452: getdents d4/d1b 0 2024-02-20T08:06:09.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/398: rename d4/d6/d5b to d4/d20/d2b/d79 0 2024-02-20T08:06:09.480 INFO:tasks.workunit.client.1.smithi194.stdout:9/453: symlink d4/d2d/l97 0 2024-02-20T08:06:09.482 INFO:tasks.workunit.client.1.smithi194.stdout:5/399: dwrite d4/d20/d2b/f43 [0,4194304] 0 2024-02-20T08:06:09.488 INFO:tasks.workunit.client.1.smithi194.stdout:9/454: rename d4/d2d/d42/d4e/d6e/c92 to d4/d1b/d90/c98 0 2024-02-20T08:06:09.488 INFO:tasks.workunit.client.1.smithi194.stdout:2/451: truncate f5 8008404 0 2024-02-20T08:06:09.489 INFO:tasks.workunit.client.1.smithi194.stdout:2/452: fdatasync df/d3a/f53 0 2024-02-20T08:06:09.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/455: write d4/d1b/d2e/f45 [576045,47451] 0 2024-02-20T08:06:09.499 INFO:tasks.workunit.client.1.smithi194.stdout:5/400: rename d4/d6/d11/d15/d28/d46/f3f to d4/d6/d11/d2f/d77/f7a 0 2024-02-20T08:06:09.500 INFO:tasks.workunit.client.1.smithi194.stdout:5/401: chown d4/d6/dd/d25 13478673 1 2024-02-20T08:06:09.508 INFO:tasks.workunit.client.1.smithi194.stdout:5/402: unlink d4/d6/d11/d15/f2a 0 2024-02-20T08:06:09.515 INFO:tasks.workunit.client.1.smithi194.stdout:9/456: symlink d4/l99 0 2024-02-20T08:06:09.537 INFO:tasks.workunit.client.1.smithi194.stdout:0/411: dwrite d6/f3d [0,4194304] 0 2024-02-20T08:06:09.539 INFO:tasks.workunit.client.1.smithi194.stdout:0/412: dread - d6/d2b/d35/d42/d1e/d3c/f8a zero size 2024-02-20T08:06:09.541 INFO:tasks.workunit.client.1.smithi194.stdout:5/403: dread d4/d6/dd/d25/f6a [0,4194304] 0 2024-02-20T08:06:09.541 INFO:tasks.workunit.client.1.smithi194.stdout:8/380: sync 2024-02-20T08:06:09.542 INFO:tasks.workunit.client.1.smithi194.stdout:0/413: dread d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:09.545 INFO:tasks.workunit.client.1.smithi194.stdout:5/404: readlink d4/d6/dd/l4e 0 2024-02-20T08:06:09.546 INFO:tasks.workunit.client.1.smithi194.stdout:8/381: symlink d2/l85 0 2024-02-20T08:06:09.546 INFO:tasks.workunit.client.1.smithi194.stdout:5/405: chown d4/d6/d11/d15/d28 117 1 2024-02-20T08:06:09.549 INFO:tasks.workunit.client.1.smithi194.stdout:8/382: creat d2/d4d/f86 x:0 0 0 2024-02-20T08:06:09.550 INFO:tasks.workunit.client.1.smithi194.stdout:5/406: symlink d4/d20/d2b/l7b 0 2024-02-20T08:06:09.553 INFO:tasks.workunit.client.1.smithi194.stdout:8/383: rmdir d2/d14/d18/d45 39 2024-02-20T08:06:09.556 INFO:tasks.workunit.client.1.smithi194.stdout:5/407: creat d4/d6/f7c x:0 0 0 2024-02-20T08:06:09.558 INFO:tasks.workunit.client.1.smithi194.stdout:8/384: dwrite d2/f31 [0,4194304] 0 2024-02-20T08:06:09.561 INFO:tasks.workunit.client.1.smithi194.stdout:5/408: unlink d4/d20/l6f 0 2024-02-20T08:06:09.564 INFO:tasks.workunit.client.1.smithi194.stdout:5/409: mkdir d4/d6/dd/d25/d7d 0 2024-02-20T08:06:09.564 INFO:tasks.workunit.client.1.smithi194.stdout:2/453: write df/d14/d24/f35 [1956586,61806] 0 2024-02-20T08:06:09.566 INFO:tasks.workunit.client.1.smithi194.stdout:5/410: chown d4/d6/d11/d2f/f49 573370461 1 2024-02-20T08:06:09.566 INFO:tasks.workunit.client.1.smithi194.stdout:8/385: getdents d2/d14 0 2024-02-20T08:06:09.569 INFO:tasks.workunit.client.1.smithi194.stdout:2/454: creat df/d14/d19/d5c/d78/f90 x:0 0 0 2024-02-20T08:06:09.569 INFO:tasks.workunit.client.1.smithi194.stdout:2/455: readlink df/d5b/d61/l6f 0 2024-02-20T08:06:09.570 INFO:tasks.workunit.client.1.smithi194.stdout:2/456: fsync df/d14/f8f 0 2024-02-20T08:06:09.570 INFO:tasks.workunit.client.1.smithi194.stdout:5/411: fdatasync d4/d6/d11/d15/d28/d46/f3e 0 2024-02-20T08:06:09.571 INFO:tasks.workunit.client.1.smithi194.stdout:5/412: chown d4/d6/f1f 1055289516 1 2024-02-20T08:06:09.571 INFO:tasks.workunit.client.1.smithi194.stdout:9/457: truncate d4/de/f94 1424623 0 2024-02-20T08:06:09.572 INFO:tasks.workunit.client.1.smithi194.stdout:2/457: symlink df/d14/d24/d56/l91 0 2024-02-20T08:06:09.574 INFO:tasks.workunit.client.1.smithi194.stdout:9/458: chown d4/d1b/d90/c98 3740 1 2024-02-20T08:06:09.575 INFO:tasks.workunit.client.1.smithi194.stdout:2/458: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:09.582 INFO:tasks.workunit.client.1.smithi194.stdout:2/459: rename df/d14/d80/d85/d8e to df/d14/d19/d5c/d60/d63/d92 0 2024-02-20T08:06:09.583 INFO:tasks.workunit.client.1.smithi194.stdout:0/414: truncate d6/d2b/d35/d39/f67 318919 0 2024-02-20T08:06:09.584 INFO:tasks.workunit.client.1.smithi194.stdout:0/415: chown d6/d2b/d35/d42/d1e/d45/d58/l6c 367925027 1 2024-02-20T08:06:09.585 INFO:tasks.workunit.client.1.smithi194.stdout:0/416: write d6/d2b/d35/d42/f74 [227369,120686] 0 2024-02-20T08:06:09.586 INFO:tasks.workunit.client.1.smithi194.stdout:5/413: getdents d4/d6 0 2024-02-20T08:06:09.589 INFO:tasks.workunit.client.1.smithi194.stdout:2/460: fdatasync df/d14/f6a 0 2024-02-20T08:06:09.593 INFO:tasks.workunit.client.1.smithi194.stdout:9/459: getdents d4/d37 0 2024-02-20T08:06:09.598 INFO:tasks.workunit.client.1.smithi194.stdout:2/461: symlink df/d14/d19/l93 0 2024-02-20T08:06:09.600 INFO:tasks.workunit.client.1.smithi194.stdout:9/460: mknod d4/d20/d43/d51/c9a 0 2024-02-20T08:06:09.603 INFO:tasks.workunit.client.1.smithi194.stdout:5/414: link d4/f6e d4/d6/d11/f7e 0 2024-02-20T08:06:09.608 INFO:tasks.workunit.client.1.smithi194.stdout:5/415: symlink d4/d6/d11/d15/d28/d46/l7f 0 2024-02-20T08:06:09.610 INFO:tasks.workunit.client.1.smithi194.stdout:5/416: symlink d4/d20/d2b/d5c/l80 0 2024-02-20T08:06:09.612 INFO:tasks.workunit.client.1.smithi194.stdout:5/417: fsync d4/d6/dd/d25/f6a 0 2024-02-20T08:06:09.612 INFO:tasks.workunit.client.1.smithi194.stdout:9/461: truncate d4/de/f27 781258 0 2024-02-20T08:06:09.613 INFO:tasks.workunit.client.1.smithi194.stdout:0/417: dread d6/d2b/d35/d42/d1e/f27 [0,4194304] 0 2024-02-20T08:06:09.614 INFO:tasks.workunit.client.1.smithi194.stdout:9/462: mknod d4/d37/d38/c9b 0 2024-02-20T08:06:09.628 INFO:tasks.workunit.client.1.smithi194.stdout:5/418: write d4/d6/f5e [1373099,41871] 0 2024-02-20T08:06:09.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/463: link d4/d20/d43/d51/f52 d4/d37/d4f/d91/f9c 0 2024-02-20T08:06:09.632 INFO:tasks.workunit.client.1.smithi194.stdout:9/464: mknod d4/d8b/c9d 0 2024-02-20T08:06:09.637 INFO:tasks.workunit.client.1.smithi194.stdout:9/465: dwrite d4/f12 [0,4194304] 0 2024-02-20T08:06:09.639 INFO:tasks.workunit.client.1.smithi194.stdout:9/466: chown d4/d20/d41/c65 204903 1 2024-02-20T08:06:09.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/418: dread d6/d2b/d35/f7a [4194304,4194304] 0 2024-02-20T08:06:09.639 INFO:tasks.workunit.client.1.smithi194.stdout:9/467: chown d4/d1b/f4a 33 1 2024-02-20T08:06:09.640 INFO:tasks.workunit.client.1.smithi194.stdout:9/468: chown d4/d1b/f72 137415955 1 2024-02-20T08:06:09.642 INFO:tasks.workunit.client.1.smithi194.stdout:9/469: write d4/de/f2a [586333,10879] 0 2024-02-20T08:06:09.643 INFO:tasks.workunit.client.1.smithi194.stdout:5/419: link d4/d6/fa d4/d20/d2b/d79/f81 0 2024-02-20T08:06:09.645 INFO:tasks.workunit.client.1.smithi194.stdout:9/470: fdatasync d4/d20/d43/d51/f3b 0 2024-02-20T08:06:09.645 INFO:tasks.workunit.client.1.smithi194.stdout:4/365: sync 2024-02-20T08:06:09.645 INFO:tasks.workunit.client.1.smithi194.stdout:7/448: sync 2024-02-20T08:06:09.647 INFO:tasks.workunit.client.1.smithi194.stdout:0/419: dwrite d6/d2b/d35/d42/f28 [0,4194304] 0 2024-02-20T08:06:09.648 INFO:tasks.workunit.client.1.smithi194.stdout:4/366: write d0/d2/fe [1257725,121776] 0 2024-02-20T08:06:09.650 INFO:tasks.workunit.client.1.smithi194.stdout:5/420: dread d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:09.664 INFO:tasks.workunit.client.1.smithi194.stdout:0/420: rename d6/d2b/d35/d42/d1e/d45/d58/l6c to d6/d2b/d35/d48/l8c 0 2024-02-20T08:06:09.669 INFO:tasks.workunit.client.1.smithi194.stdout:9/471: unlink d4/d20/d41/f76 0 2024-02-20T08:06:09.671 INFO:tasks.workunit.client.1.smithi194.stdout:4/367: symlink d0/d2/l6c 0 2024-02-20T08:06:09.675 INFO:tasks.workunit.client.1.smithi194.stdout:5/421: link d4/d6/dd/d3a/l6d d4/d6/d11/d2f/d77/d65/d53/l82 0 2024-02-20T08:06:09.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/472: dwrite d4/de/f7b [0,4194304] 0 2024-02-20T08:06:09.676 INFO:tasks.workunit.client.1.smithi194.stdout:9/473: stat d4/d20/l69 0 2024-02-20T08:06:09.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/368: creat d0/d4f/f6d x:0 0 0 2024-02-20T08:06:09.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/474: creat d4/d2d/f9e x:0 0 0 2024-02-20T08:06:09.682 INFO:tasks.workunit.client.1.smithi194.stdout:4/369: creat d0/d5c/d60/f6e x:0 0 0 2024-02-20T08:06:09.683 INFO:tasks.workunit.client.1.smithi194.stdout:9/475: readlink d4/d2d/d42/d4e/d6e/l7a 0 2024-02-20T08:06:09.684 INFO:tasks.workunit.client.1.smithi194.stdout:5/422: dwrite d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:09.689 INFO:tasks.workunit.client.1.smithi194.stdout:9/476: creat d4/d20/d41/f9f x:0 0 0 2024-02-20T08:06:09.689 INFO:tasks.workunit.client.1.smithi194.stdout:5/423: chown d4/d6/d11/c35 721 1 2024-02-20T08:06:09.690 INFO:tasks.workunit.client.1.smithi194.stdout:0/421: dread d6/d2b/d35/d39/d55/f56 [0,4194304] 0 2024-02-20T08:06:09.698 INFO:tasks.workunit.client.1.smithi194.stdout:5/424: rename d4/d6/dd/d25/f6a to d4/d20/d2b/d79/f83 0 2024-02-20T08:06:09.698 INFO:tasks.workunit.client.1.smithi194.stdout:4/370: write d0/d2/f6a [645893,24449] 0 2024-02-20T08:06:09.700 INFO:tasks.workunit.client.1.smithi194.stdout:9/477: symlink d4/d20/d5c/la0 0 2024-02-20T08:06:09.707 INFO:tasks.workunit.client.1.smithi194.stdout:5/425: write d4/d6/d11/d2f/d77/f7a [352489,22906] 0 2024-02-20T08:06:09.708 INFO:tasks.workunit.client.1.smithi194.stdout:5/426: chown d4/d6 32007 1 2024-02-20T08:06:09.713 INFO:tasks.workunit.client.1.smithi194.stdout:5/427: dwrite d4/d6/f5e [0,4194304] 0 2024-02-20T08:06:09.714 INFO:tasks.workunit.client.1.smithi194.stdout:0/422: truncate d6/d2b/d35/d42/d1e/d3c/f68 4044039 0 2024-02-20T08:06:09.718 INFO:tasks.workunit.client.1.smithi194.stdout:5/428: mknod d4/d6/d11/d2f/d77/c84 0 2024-02-20T08:06:09.719 INFO:tasks.workunit.client.1.smithi194.stdout:5/429: chown d4/f6e 0 1 2024-02-20T08:06:09.721 INFO:tasks.workunit.client.1.smithi194.stdout:5/430: dread - d4/f73 zero size 2024-02-20T08:06:09.721 INFO:tasks.workunit.client.1.smithi194.stdout:4/371: dwrite d0/d10/d1c/d4d/d2f/f31 [0,4194304] 0 2024-02-20T08:06:09.722 INFO:tasks.workunit.client.1.smithi194.stdout:4/372: readlink d0/d10/d1c/d21/l43 0 2024-02-20T08:06:09.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/423: link d6/d2b/d35/f4c d6/d2b/d35/d42/d1e/d45/d58/f8d 0 2024-02-20T08:06:09.731 INFO:tasks.workunit.client.1.smithi194.stdout:0/424: write d6/d2b/f3a [1587725,120284] 0 2024-02-20T08:06:09.731 INFO:tasks.workunit.client.1.smithi194.stdout:9/478: dwrite d4/de/f94 [0,4194304] 0 2024-02-20T08:06:09.736 INFO:tasks.workunit.client.1.smithi194.stdout:0/425: rmdir d6/d2b/d35/d42/d1e/d3c/d43/d62 39 2024-02-20T08:06:09.737 INFO:tasks.workunit.client.1.smithi194.stdout:0/426: dread - d6/d2b/d35/d42/d1e/d3c/d43/f6b zero size 2024-02-20T08:06:09.739 INFO:tasks.workunit.client.1.smithi194.stdout:9/479: unlink d4/d20/d43/d51/f3b 0 2024-02-20T08:06:09.741 INFO:tasks.workunit.client.1.smithi194.stdout:0/427: creat d6/d2b/d35/d39/f8e x:0 0 0 2024-02-20T08:06:09.742 INFO:tasks.workunit.client.1.smithi194.stdout:0/428: write d6/d2b/d35/d42/f16 [6602972,92689] 0 2024-02-20T08:06:09.750 INFO:tasks.workunit.client.1.smithi194.stdout:0/429: mkdir d6/d2b/d35/d39/d8f 0 2024-02-20T08:06:09.754 INFO:tasks.workunit.client.1.smithi194.stdout:9/480: mknod d4/ca1 0 2024-02-20T08:06:09.754 INFO:tasks.workunit.client.1.smithi194.stdout:5/431: dread d4/fb [0,4194304] 0 2024-02-20T08:06:09.758 INFO:tasks.workunit.client.1.smithi194.stdout:1/459: sync 2024-02-20T08:06:09.758 INFO:tasks.workunit.client.1.smithi194.stdout:6/533: sync 2024-02-20T08:06:09.758 INFO:tasks.workunit.client.1.smithi194.stdout:3/386: sync 2024-02-20T08:06:09.758 INFO:tasks.workunit.client.1.smithi194.stdout:0/430: rmdir d6/d2b/d35/d48/d60 39 2024-02-20T08:06:09.763 INFO:tasks.workunit.client.1.smithi194.stdout:1/460: symlink d2/d8/d60/l94 0 2024-02-20T08:06:09.770 INFO:tasks.workunit.client.1.smithi194.stdout:5/432: truncate d4/d6/d11/d15/d28/d46/f3e 1666072 0 2024-02-20T08:06:09.772 INFO:tasks.workunit.client.1.smithi194.stdout:1/461: mknod d2/d1a/d61/d68/c95 0 2024-02-20T08:06:09.775 INFO:tasks.workunit.client.1.smithi194.stdout:6/534: dread df/dab/d1d/d76/f87 [0,4194304] 0 2024-02-20T08:06:09.779 INFO:tasks.workunit.client.1.smithi194.stdout:3/387: rmdir d5/d10/d17/d1d/d56/d74 0 2024-02-20T08:06:09.783 INFO:tasks.workunit.client.1.smithi194.stdout:6/535: mkdir df/dab/d1d/d28/db2 0 2024-02-20T08:06:09.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/481: dwrite d4/d1b/d79/f44 [0,4194304] 0 2024-02-20T08:06:09.784 INFO:tasks.workunit.client.1.smithi194.stdout:3/388: chown d5/fa 193 1 2024-02-20T08:06:09.785 INFO:tasks.workunit.client.1.smithi194.stdout:3/389: stat d5/d10/d17/d1d/d56 0 2024-02-20T08:06:09.786 INFO:tasks.workunit.client.1.smithi194.stdout:9/482: mknod d4/de/ca2 0 2024-02-20T08:06:09.788 INFO:tasks.workunit.client.1.smithi194.stdout:6/536: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/db3 0 2024-02-20T08:06:09.791 INFO:tasks.workunit.client.1.smithi194.stdout:5/433: truncate d4/d20/d2b/d79/f83 2304768 0 2024-02-20T08:06:09.792 INFO:tasks.workunit.client.1.smithi194.stdout:9/483: dread d4/d2d/d59/f5b [0,4194304] 0 2024-02-20T08:06:09.792 INFO:tasks.workunit.client.1.smithi194.stdout:5/434: fdatasync d4/d6/d11/d2f/f49 0 2024-02-20T08:06:09.793 INFO:tasks.workunit.client.1.smithi194.stdout:9/484: dread - d4/d20/d43/d51/f71 zero size 2024-02-20T08:06:09.797 INFO:tasks.workunit.client.1.smithi194.stdout:6/537: creat df/d42/d86/fb4 x:0 0 0 2024-02-20T08:06:09.807 INFO:tasks.workunit.client.1.smithi194.stdout:3/390: dwrite d5/fe [0,4194304] 0 2024-02-20T08:06:09.807 INFO:tasks.workunit.client.1.smithi194.stdout:6/538: rename df/c47 to df/dab/d1d/d76/cb5 0 2024-02-20T08:06:09.809 INFO:tasks.workunit.client.1.smithi194.stdout:9/485: link d4/l25 d4/d20/d41/la3 0 2024-02-20T08:06:09.810 INFO:tasks.workunit.client.1.smithi194.stdout:9/486: readlink d4/d20/l69 0 2024-02-20T08:06:09.811 INFO:tasks.workunit.client.1.smithi194.stdout:6/539: mknod df/dab/d1d/d28/d2b/d94/d96/cb6 0 2024-02-20T08:06:09.812 INFO:tasks.workunit.client.1.smithi194.stdout:6/540: dread - df/d18/f81 zero size 2024-02-20T08:06:09.812 INFO:tasks.workunit.client.1.smithi194.stdout:5/435: truncate d4/d20/d2b/f2c 3273310 0 2024-02-20T08:06:09.814 INFO:tasks.workunit.client.1.smithi194.stdout:9/487: fsync d4/d2d/d42/d4e/d6e/d88/f8e 0 2024-02-20T08:06:09.817 INFO:tasks.workunit.client.1.smithi194.stdout:5/436: rename d4/d6/d11/d2f/d77/d65 to d4/d6/d11/d15/d28/d85 0 2024-02-20T08:06:09.821 INFO:tasks.workunit.client.1.smithi194.stdout:5/437: dread d4/d20/d2b/f43 [0,4194304] 0 2024-02-20T08:06:09.822 INFO:tasks.workunit.client.1.smithi194.stdout:3/391: dread d5/d10/d28/f53 [0,4194304] 0 2024-02-20T08:06:09.826 INFO:tasks.workunit.client.1.smithi194.stdout:3/392: mkdir d5/df/d75 0 2024-02-20T08:06:09.833 INFO:tasks.workunit.client.1.smithi194.stdout:9/488: write d4/f12 [3391029,12267] 0 2024-02-20T08:06:09.833 INFO:tasks.workunit.client.1.smithi194.stdout:9/489: chown d4/d1b 214255 1 2024-02-20T08:06:09.834 INFO:tasks.workunit.client.1.smithi194.stdout:9/490: readlink d4/l33 0 2024-02-20T08:06:09.836 INFO:tasks.workunit.client.1.smithi194.stdout:3/393: creat d5/df/f76 x:0 0 0 2024-02-20T08:06:09.836 INFO:tasks.workunit.client.1.smithi194.stdout:3/394: dread - d5/df/f76 zero size 2024-02-20T08:06:09.837 INFO:tasks.workunit.client.1.smithi194.stdout:6/541: truncate df/dab/d1d/d28/d2b/f7c 1549138 0 2024-02-20T08:06:09.838 INFO:tasks.workunit.client.1.smithi194.stdout:9/491: unlink d4/d1b/c60 0 2024-02-20T08:06:09.839 INFO:tasks.workunit.client.1.smithi194.stdout:5/438: write d4/d20/d2b/d79/f60 [561503,114587] 0 2024-02-20T08:06:09.841 INFO:tasks.workunit.client.1.smithi194.stdout:9/492: creat d4/d8b/fa4 x:0 0 0 2024-02-20T08:06:09.842 INFO:tasks.workunit.client.1.smithi194.stdout:3/395: mkdir d5/df/d77 0 2024-02-20T08:06:09.843 INFO:tasks.workunit.client.1.smithi194.stdout:6/542: dwrite df/dab/d1d/d28/d2b/f51 [0,4194304] 0 2024-02-20T08:06:09.843 INFO:tasks.workunit.client.1.smithi194.stdout:5/439: write d4/fb [4734456,72803] 0 2024-02-20T08:06:09.844 INFO:tasks.workunit.client.1.smithi194.stdout:3/396: write d5/d10/d16/f5a [3047008,73569] 0 2024-02-20T08:06:09.846 INFO:tasks.workunit.client.1.smithi194.stdout:3/397: chown d5/d10/d16/l2b 21315 1 2024-02-20T08:06:09.846 INFO:tasks.workunit.client.1.smithi194.stdout:5/440: rmdir d4/d6/dd 39 2024-02-20T08:06:09.852 INFO:tasks.workunit.client.1.smithi194.stdout:6/543: creat df/dab/d1d/d28/d2b/d80/fb7 x:0 0 0 2024-02-20T08:06:09.852 INFO:tasks.workunit.client.1.smithi194.stdout:3/398: rmdir d5/d10/d62 39 2024-02-20T08:06:09.854 INFO:tasks.workunit.client.1.smithi194.stdout:9/493: rmdir d4/d1b 39 2024-02-20T08:06:09.860 INFO:tasks.workunit.client.1.smithi194.stdout:2/462: sync 2024-02-20T08:06:09.860 INFO:tasks.workunit.client.1.smithi194.stdout:8/386: sync 2024-02-20T08:06:09.860 INFO:tasks.workunit.client.1.smithi194.stdout:7/449: sync 2024-02-20T08:06:09.863 INFO:tasks.workunit.client.1.smithi194.stdout:9/494: mknod d4/d1b/d90/ca5 0 2024-02-20T08:06:09.864 INFO:tasks.workunit.client.1.smithi194.stdout:5/441: dwrite d4/d6/d11/d15/d28/d85/d53/f64 [0,4194304] 0 2024-02-20T08:06:09.864 INFO:tasks.workunit.client.1.smithi194.stdout:7/450: dread - d11/d2d/d38/d5a/d5e/f6a zero size 2024-02-20T08:06:09.865 INFO:tasks.workunit.client.1.smithi194.stdout:9/495: chown d4/de/ca2 1364 1 2024-02-20T08:06:09.865 INFO:tasks.workunit.client.1.smithi194.stdout:2/463: creat df/d14/d19/d5c/f94 x:0 0 0 2024-02-20T08:06:09.865 INFO:tasks.workunit.client.1.smithi194.stdout:5/442: write d4/d6/d11/d15/f26 [1540822,16135] 0 2024-02-20T08:06:09.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/451: unlink d11/d2d/d38/d4a/l79 0 2024-02-20T08:06:09.869 INFO:tasks.workunit.client.1.smithi194.stdout:9/496: creat d4/d55/fa6 x:0 0 0 2024-02-20T08:06:09.870 INFO:tasks.workunit.client.1.smithi194.stdout:7/452: readlink d11/d2d/d38/d37/d3c/l7e 0 2024-02-20T08:06:09.870 INFO:tasks.workunit.client.1.smithi194.stdout:7/453: stat fd 0 2024-02-20T08:06:09.871 INFO:tasks.workunit.client.1.smithi194.stdout:8/387: getdents d2/d14/d18/d45/d7b 0 2024-02-20T08:06:09.871 INFO:tasks.workunit.client.1.smithi194.stdout:5/443: write d4/d6/f1f [608720,126030] 0 2024-02-20T08:06:09.871 INFO:tasks.workunit.client.1.smithi194.stdout:2/464: mknod df/d14/d19/d5c/d60/c95 0 2024-02-20T08:06:09.874 INFO:tasks.workunit.client.1.smithi194.stdout:9/497: unlink d4/d20/d43/f63 0 2024-02-20T08:06:09.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/388: dwrite d2/d14/d18/f4a [0,4194304] 0 2024-02-20T08:06:09.876 INFO:tasks.workunit.client.1.smithi194.stdout:9/498: write d4/d20/f80 [633733,11551] 0 2024-02-20T08:06:09.877 INFO:tasks.workunit.client.1.smithi194.stdout:9/499: readlink d4/d20/d5c/l5d 0 2024-02-20T08:06:09.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/454: read d11/f2c [1005563,93303] 0 2024-02-20T08:06:09.878 INFO:tasks.workunit.client.1.smithi194.stdout:9/500: stat d4/d8b/fa4 0 2024-02-20T08:06:09.882 INFO:tasks.workunit.client.1.smithi194.stdout:8/389: rename d2/f9 to d2/d14/d18/d45/d4e/d6c/d78/f87 0 2024-02-20T08:06:09.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/455: creat d11/d2d/d38/d37/d43/f82 x:0 0 0 2024-02-20T08:06:09.885 INFO:tasks.workunit.client.1.smithi194.stdout:5/444: mkdir d4/d6/dd/d3a/d86 0 2024-02-20T08:06:09.890 INFO:tasks.workunit.client.1.smithi194.stdout:7/456: mknod d11/d2d/d38/d37/d3c/c83 0 2024-02-20T08:06:09.891 INFO:tasks.workunit.client.1.smithi194.stdout:5/445: mknod d4/d20/d2b/d5c/c87 0 2024-02-20T08:06:09.893 INFO:tasks.workunit.client.1.smithi194.stdout:7/457: rename d11/d3b to d11/d2d/d38/d4a/d27/d51/d84 0 2024-02-20T08:06:09.895 INFO:tasks.workunit.client.1.smithi194.stdout:7/458: mknod d11/d2d/d38/d37/d43/d7b/c85 0 2024-02-20T08:06:09.898 INFO:tasks.workunit.client.1.smithi194.stdout:8/390: getdents d2/d14/d18/d45 0 2024-02-20T08:06:09.902 INFO:tasks.workunit.client.1.smithi194.stdout:5/446: getdents d4/d6 0 2024-02-20T08:06:09.906 INFO:tasks.workunit.client.1.smithi194.stdout:7/459: creat d11/d2d/d38/d4a/d53/d81/f86 x:0 0 0 2024-02-20T08:06:09.910 INFO:tasks.workunit.client.1.smithi194.stdout:5/447: mknod d4/d6/dd/d25/d78/c88 0 2024-02-20T08:06:09.911 INFO:tasks.workunit.client.1.smithi194.stdout:2/465: write df/d14/d24/f6c [1777860,86973] 0 2024-02-20T08:06:09.920 INFO:tasks.workunit.client.1.smithi194.stdout:5/448: creat d4/d6/d11/d15/d28/d46/f89 x:0 0 0 2024-02-20T08:06:09.921 INFO:tasks.workunit.client.1.smithi194.stdout:5/449: fdatasync d4/f73 0 2024-02-20T08:06:09.923 INFO:tasks.workunit.client.1.smithi194.stdout:9/501: dwrite d4/d1b/d79/f89 [0,4194304] 0 2024-02-20T08:06:09.924 INFO:tasks.workunit.client.1.smithi194.stdout:9/502: fsync d4/d2d/f9e 0 2024-02-20T08:06:09.926 INFO:tasks.workunit.client.1.smithi194.stdout:2/466: write df/d14/d19/d5c/d60/d63/f62 [3091909,59687] 0 2024-02-20T08:06:09.931 INFO:tasks.workunit.client.1.smithi194.stdout:5/450: mkdir d4/d6/d11/d15/d28/d46/d8a 0 2024-02-20T08:06:09.932 INFO:tasks.workunit.client.1.smithi194.stdout:8/391: write d2/fa [3186665,109000] 0 2024-02-20T08:06:09.934 INFO:tasks.workunit.client.1.smithi194.stdout:2/467: dwrite df/f72 [0,4194304] 0 2024-02-20T08:06:09.940 INFO:tasks.workunit.client.1.smithi194.stdout:5/451: dwrite d4/d20/d2b/f2c [0,4194304] 0 2024-02-20T08:06:09.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/392: creat d2/d14/d18/d45/d4e/d6c/d78/f88 x:0 0 0 2024-02-20T08:06:09.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/393: stat d2/d14/f2b 0 2024-02-20T08:06:09.948 INFO:tasks.workunit.client.1.smithi194.stdout:7/460: dwrite d11/d2d/d38/d37/f4f [0,4194304] 0 2024-02-20T08:06:09.950 INFO:tasks.workunit.client.1.smithi194.stdout:7/461: write d11/d2d/d38/d37/f4f [1534884,29973] 0 2024-02-20T08:06:09.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/394: unlink d2/d14/d18/d45/c46 0 2024-02-20T08:06:09.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/452: truncate d4/d6/d11/d2f/f52 2516404 0 2024-02-20T08:06:09.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/453: fdatasync d4/d6/dd/d25/f29 0 2024-02-20T08:06:09.961 INFO:tasks.workunit.client.1.smithi194.stdout:5/454: write d4/d20/d2b/f4b [841609,32073] 0 2024-02-20T08:06:09.962 INFO:tasks.workunit.client.1.smithi194.stdout:7/462: rmdir d11/d2d/d38/d5a 39 2024-02-20T08:06:09.964 INFO:tasks.workunit.client.1.smithi194.stdout:9/503: rmdir d4/d1b/d79 39 2024-02-20T08:06:09.967 INFO:tasks.workunit.client.1.smithi194.stdout:7/463: fdatasync d11/d6e/f78 0 2024-02-20T08:06:09.968 INFO:tasks.workunit.client.1.smithi194.stdout:8/395: symlink d2/l89 0 2024-02-20T08:06:09.970 INFO:tasks.workunit.client.1.smithi194.stdout:2/468: getdents df/d14/d19/d5c/d78 0 2024-02-20T08:06:09.971 INFO:tasks.workunit.client.1.smithi194.stdout:4/373: sync 2024-02-20T08:06:09.973 INFO:tasks.workunit.client.1.smithi194.stdout:7/464: creat d11/d6e/f87 x:0 0 0 2024-02-20T08:06:09.975 INFO:tasks.workunit.client.1.smithi194.stdout:9/504: mknod d4/d20/ca7 0 2024-02-20T08:06:09.979 INFO:tasks.workunit.client.1.smithi194.stdout:4/374: mknod d0/d5c/d60/c6f 0 2024-02-20T08:06:09.989 INFO:tasks.workunit.client.1.smithi194.stdout:5/455: dwrite d4/d6/d11/d2f/f4d [0,4194304] 0 2024-02-20T08:06:09.990 INFO:tasks.workunit.client.1.smithi194.stdout:7/465: link d11/d6e/c72 d11/d2d/d38/d4a/d60/c88 0 2024-02-20T08:06:09.992 INFO:tasks.workunit.client.1.smithi194.stdout:9/505: creat d4/fa8 x:0 0 0 2024-02-20T08:06:09.995 INFO:tasks.workunit.client.1.smithi194.stdout:2/469: getdents df/d14/d24/d56/d6b 0 2024-02-20T08:06:09.996 INFO:tasks.workunit.client.1.smithi194.stdout:2/470: stat df/d3a/f53 0 2024-02-20T08:06:09.996 INFO:tasks.workunit.client.1.smithi194.stdout:8/396: dread d2/d14/d18/d45/d4e/f64 [0,4194304] 0 2024-02-20T08:06:09.997 INFO:tasks.workunit.client.1.smithi194.stdout:8/397: truncate d2/d14/d18/f61 134325 0 2024-02-20T08:06:09.998 INFO:tasks.workunit.client.1.smithi194.stdout:8/398: readlink d2/d14/l68 0 2024-02-20T08:06:09.998 INFO:tasks.workunit.client.1.smithi194.stdout:7/466: rmdir d11/d2d 39 2024-02-20T08:06:10.003 INFO:tasks.workunit.client.1.smithi194.stdout:4/375: dread d0/d10/d1c/d4d/f38 [0,4194304] 0 2024-02-20T08:06:10.004 INFO:tasks.workunit.client.1.smithi194.stdout:4/376: read - d0/d10/d1c/d21/d62/f67 zero size 2024-02-20T08:06:10.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/506: mkdir d4/d20/d43/da9 0 2024-02-20T08:06:10.008 INFO:tasks.workunit.client.1.smithi194.stdout:9/507: dread - d4/f7e zero size 2024-02-20T08:06:10.008 INFO:tasks.workunit.client.1.smithi194.stdout:0/431: sync 2024-02-20T08:06:10.011 INFO:tasks.workunit.client.1.smithi194.stdout:4/377: rmdir d0/d10/d1c/d4d 39 2024-02-20T08:06:10.012 INFO:tasks.workunit.client.1.smithi194.stdout:4/378: fsync d0/df/d41/f66 0 2024-02-20T08:06:10.014 INFO:tasks.workunit.client.1.smithi194.stdout:8/399: symlink d2/d14/d18/d45/d4e/l8a 0 2024-02-20T08:06:10.020 INFO:tasks.workunit.client.1.smithi194.stdout:2/471: truncate df/d14/f1d 6548567 0 2024-02-20T08:06:10.020 INFO:tasks.workunit.client.1.smithi194.stdout:5/456: dwrite d4/d6/fa [0,4194304] 0 2024-02-20T08:06:10.025 INFO:tasks.workunit.client.1.smithi194.stdout:8/400: fsync d2/f37 0 2024-02-20T08:06:10.027 INFO:tasks.workunit.client.1.smithi194.stdout:0/432: write d6/d2b/d35/d42/f15 [1264847,6223] 0 2024-02-20T08:06:10.028 INFO:tasks.workunit.client.1.smithi194.stdout:5/457: dwrite d4/d6/d11/d15/d28/d46/f89 [0,4194304] 0 2024-02-20T08:06:10.030 INFO:tasks.workunit.client.1.smithi194.stdout:7/467: link d11/d2d/d38/d5a/d6b/f71 d11/d2d/d38/d4a/d27/d51/f89 0 2024-02-20T08:06:10.032 INFO:tasks.workunit.client.1.smithi194.stdout:5/458: write d4/f73 [238186,87717] 0 2024-02-20T08:06:10.032 INFO:tasks.workunit.client.1.smithi194.stdout:4/379: dread d0/d10/d1c/d4d/d2f/f31 [0,4194304] 0 2024-02-20T08:06:10.034 INFO:tasks.workunit.client.1.smithi194.stdout:2/472: rmdir df/d14/d24 39 2024-02-20T08:06:10.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/401: dwrite d2/d14/d18/f61 [0,4194304] 0 2024-02-20T08:06:10.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/508: unlink d4/d1b/d79/f44 0 2024-02-20T08:06:10.049 INFO:tasks.workunit.client.1.smithi194.stdout:7/468: creat d11/d2d/f8a x:0 0 0 2024-02-20T08:06:10.052 INFO:tasks.workunit.client.1.smithi194.stdout:4/380: write d0/df/f13 [1986926,5822] 0 2024-02-20T08:06:10.053 INFO:tasks.workunit.client.1.smithi194.stdout:4/381: chown d0/df/l56 1212382 1 2024-02-20T08:06:10.054 INFO:tasks.workunit.client.1.smithi194.stdout:3/399: sync 2024-02-20T08:06:10.054 INFO:tasks.workunit.client.1.smithi194.stdout:1/462: sync 2024-02-20T08:06:10.054 INFO:tasks.workunit.client.1.smithi194.stdout:6/544: sync 2024-02-20T08:06:10.055 INFO:tasks.workunit.client.1.smithi194.stdout:5/459: unlink d4/d6/d11/d2f/f49 0 2024-02-20T08:06:10.057 INFO:tasks.workunit.client.1.smithi194.stdout:6/545: stat df/dab/d1d/d28/d46/d5a/fa6 0 2024-02-20T08:06:10.058 INFO:tasks.workunit.client.1.smithi194.stdout:1/463: write d2/d1a/d26/d3d/d71/d8c/d34/f78 [726075,31437] 0 2024-02-20T08:06:10.060 INFO:tasks.workunit.client.1.smithi194.stdout:6/546: write df/dab/f54 [185726,3451] 0 2024-02-20T08:06:10.063 INFO:tasks.workunit.client.1.smithi194.stdout:2/473: dwrite df/d14/d24/d56/f7c [0,4194304] 0 2024-02-20T08:06:10.063 INFO:tasks.workunit.client.1.smithi194.stdout:1/464: write d2/d1a/d26/d57/f5d [689379,87306] 0 2024-02-20T08:06:10.064 INFO:tasks.workunit.client.1.smithi194.stdout:0/433: unlink d6/d2b/d35/d48/d60/d72/c7b 0 2024-02-20T08:06:10.067 INFO:tasks.workunit.client.1.smithi194.stdout:2/474: write df/d14/d24/d56/f7c [2556296,66152] 0 2024-02-20T08:06:10.067 INFO:tasks.workunit.client.1.smithi194.stdout:0/434: write d6/f1a [2675652,125932] 0 2024-02-20T08:06:10.067 INFO:tasks.workunit.client.1.smithi194.stdout:1/465: chown d2/d1a/d26/d3d/d71/d8c/d34/c54 3801082 1 2024-02-20T08:06:10.067 INFO:tasks.workunit.client.1.smithi194.stdout:0/435: chown d6/d2b/l82 2365402 1 2024-02-20T08:06:10.068 INFO:tasks.workunit.client.1.smithi194.stdout:2/475: chown df/d14/l3e 6959148 1 2024-02-20T08:06:10.068 INFO:tasks.workunit.client.1.smithi194.stdout:0/436: chown d6/d2b/d35/d42/d1e/d3c 3781 1 2024-02-20T08:06:10.070 INFO:tasks.workunit.client.1.smithi194.stdout:0/437: write d6/d2b/d35/d39/f8e [458648,14157] 0 2024-02-20T08:06:10.074 INFO:tasks.workunit.client.1.smithi194.stdout:4/382: unlink d0/d10/d1c/d21/d46/f58 0 2024-02-20T08:06:10.075 INFO:tasks.workunit.client.1.smithi194.stdout:6/547: dread df/f3c [0,4194304] 0 2024-02-20T08:06:10.076 INFO:tasks.workunit.client.1.smithi194.stdout:0/438: dread d6/d2b/d35/d42/f5b [0,4194304] 0 2024-02-20T08:06:10.077 INFO:tasks.workunit.client.1.smithi194.stdout:0/439: chown d6/d2b/c54 11033 1 2024-02-20T08:06:10.078 INFO:tasks.workunit.client.1.smithi194.stdout:9/509: mkdir d4/d20/d43/daa 0 2024-02-20T08:06:10.078 INFO:tasks.workunit.client.1.smithi194.stdout:9/510: chown d4/d20/f82 2061 1 2024-02-20T08:06:10.081 INFO:tasks.workunit.client.1.smithi194.stdout:5/460: rename d4/d6/d11/d15/d28/d46 to d4/d6/dd/d25/d78/d8b 0 2024-02-20T08:06:10.088 INFO:tasks.workunit.client.1.smithi194.stdout:2/476: mkdir df/d14/d19/d96 0 2024-02-20T08:06:10.088 INFO:tasks.workunit.client.1.smithi194.stdout:7/469: truncate d11/d2d/d38/d4a/d27/d51/d84/f6f 2902713 0 2024-02-20T08:06:10.089 INFO:tasks.workunit.client.1.smithi194.stdout:7/470: chown d11/d2d/d38/d4a/d27/f76 6804661 1 2024-02-20T08:06:10.093 INFO:tasks.workunit.client.1.smithi194.stdout:7/471: read d11/d2d/d38/d4a/d27/f4e [593043,70031] 0 2024-02-20T08:06:10.096 INFO:tasks.workunit.client.1.smithi194.stdout:4/383: write d0/d10/d1c/d4d/d2f/f3a [4103830,66739] 0 2024-02-20T08:06:10.097 INFO:tasks.workunit.client.1.smithi194.stdout:6/548: creat df/d42/d86/fb8 x:0 0 0 2024-02-20T08:06:10.103 INFO:tasks.workunit.client.1.smithi194.stdout:5/461: symlink d4/d6/d11/d15/l8c 0 2024-02-20T08:06:10.104 INFO:tasks.workunit.client.1.smithi194.stdout:1/466: mknod d2/d1a/d26/d3d/d71/d8c/d77/c96 0 2024-02-20T08:06:10.106 INFO:tasks.workunit.client.1.smithi194.stdout:7/472: creat d11/d2d/d38/d4a/d60/f8b x:0 0 0 2024-02-20T08:06:10.109 INFO:tasks.workunit.client.1.smithi194.stdout:3/400: truncate d5/d10/d16/f3a 4282660 0 2024-02-20T08:06:10.110 INFO:tasks.workunit.client.1.smithi194.stdout:6/549: truncate df/dab/f4a 4773493 0 2024-02-20T08:06:10.111 INFO:tasks.workunit.client.1.smithi194.stdout:6/550: fsync df/f3c 0 2024-02-20T08:06:10.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/551: write df/d18/f40 [2056666,90690] 0 2024-02-20T08:06:10.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/467: creat d2/d8/d60/f97 x:0 0 0 2024-02-20T08:06:10.120 INFO:tasks.workunit.client.1.smithi194.stdout:4/384: dwrite d0/f34 [0,4194304] 0 2024-02-20T08:06:10.122 INFO:tasks.workunit.client.1.smithi194.stdout:7/473: stat d11/d6e/c72 0 2024-02-20T08:06:10.126 INFO:tasks.workunit.client.1.smithi194.stdout:3/401: rmdir d5/d10/d17/d1d/d56 39 2024-02-20T08:06:10.128 INFO:tasks.workunit.client.1.smithi194.stdout:9/511: dwrite d4/d1b/f74 [0,4194304] 0 2024-02-20T08:06:10.129 INFO:tasks.workunit.client.1.smithi194.stdout:9/512: fdatasync d4/d20/d43/f47 0 2024-02-20T08:06:10.132 INFO:tasks.workunit.client.1.smithi194.stdout:1/468: mkdir d2/d1a/d26/d45/d98 0 2024-02-20T08:06:10.133 INFO:tasks.workunit.client.1.smithi194.stdout:4/385: symlink d0/d5c/d60/l70 0 2024-02-20T08:06:10.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/386: write d0/d10/d1c/d4d/d2f/f3a [4630700,18193] 0 2024-02-20T08:06:10.144 INFO:tasks.workunit.client.1.smithi194.stdout:0/440: link d6/d2b/d35/d42/d1e/d3c/f71 d6/f90 0 2024-02-20T08:06:10.148 INFO:tasks.workunit.client.1.smithi194.stdout:7/474: creat d11/f8c x:0 0 0 2024-02-20T08:06:10.152 INFO:tasks.workunit.client.1.smithi194.stdout:7/475: mkdir d11/d2d/d38/d37/d3c/d8d 0 2024-02-20T08:06:10.153 INFO:tasks.workunit.client.1.smithi194.stdout:7/476: chown d11/d2d/d38/d4a/d53/f58 0 1 2024-02-20T08:06:10.155 INFO:tasks.workunit.client.1.smithi194.stdout:9/513: dread d4/de/f6d [0,4194304] 0 2024-02-20T08:06:10.157 INFO:tasks.workunit.client.1.smithi194.stdout:7/477: write d11/d2d/d38/d4a/d27/f39 [4739227,62609] 0 2024-02-20T08:06:10.157 INFO:tasks.workunit.client.1.smithi194.stdout:1/469: dread d2/d1a/d26/d3d/f4d [0,4194304] 0 2024-02-20T08:06:10.157 INFO:tasks.workunit.client.1.smithi194.stdout:0/441: symlink d6/d2b/d35/d42/d1e/d3c/d43/l91 0 2024-02-20T08:06:10.158 INFO:tasks.workunit.client.1.smithi194.stdout:3/402: link d5/c4e d5/d10/c78 0 2024-02-20T08:06:10.159 INFO:tasks.workunit.client.1.smithi194.stdout:7/478: chown d11/f35 0 1 2024-02-20T08:06:10.161 INFO:tasks.workunit.client.1.smithi194.stdout:6/552: dwrite df/dab/d1d/d28/d2b/f2e [0,4194304] 0 2024-02-20T08:06:10.161 INFO:tasks.workunit.client.1.smithi194.stdout:4/387: getdents d0/d5c/d60 0 2024-02-20T08:06:10.164 INFO:tasks.workunit.client.1.smithi194.stdout:7/479: dread - d11/d2d/d38/d4a/d60/f7d zero size 2024-02-20T08:06:10.165 INFO:tasks.workunit.client.1.smithi194.stdout:0/442: symlink d6/d2b/d35/d39/l92 0 2024-02-20T08:06:10.167 INFO:tasks.workunit.client.1.smithi194.stdout:1/470: dwrite d2/f36 [4194304,4194304] 0 2024-02-20T08:06:10.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/514: dwrite d4/d2d/d42/d4e/d6e/d88/f8e [0,4194304] 0 2024-02-20T08:06:10.169 INFO:tasks.workunit.client.1.smithi194.stdout:9/515: stat d4/d37/d38/l6c 0 2024-02-20T08:06:10.198 INFO:tasks.workunit.client.1.smithi194.stdout:7/480: rmdir d11/d2d/d38/d4a/d53/d81 39 2024-02-20T08:06:10.198 INFO:tasks.workunit.client.1.smithi194.stdout:3/403: creat d5/d10/d28/d41/d73/f79 x:0 0 0 2024-02-20T08:06:10.199 INFO:tasks.workunit.client.1.smithi194.stdout:9/516: truncate d4/d20/d5c/f31 853909 0 2024-02-20T08:06:10.203 INFO:tasks.workunit.client.1.smithi194.stdout:1/471: dwrite d2/d1a/d61/d7e/f86 [0,4194304] 0 2024-02-20T08:06:10.204 INFO:tasks.workunit.client.1.smithi194.stdout:9/517: mkdir d4/d37/dab 0 2024-02-20T08:06:10.206 INFO:tasks.workunit.client.1.smithi194.stdout:6/553: creat df/dab/d1d/d28/fb9 x:0 0 0 2024-02-20T08:06:10.207 INFO:tasks.workunit.client.1.smithi194.stdout:4/388: creat d0/d2/d3e/f71 x:0 0 0 2024-02-20T08:06:10.210 INFO:tasks.workunit.client.1.smithi194.stdout:7/481: dwrite d11/d6e/f87 [0,4194304] 0 2024-02-20T08:06:10.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/404: dwrite d5/d10/d16/f63 [0,4194304] 0 2024-02-20T08:06:10.211 INFO:tasks.workunit.client.1.smithi194.stdout:6/554: readlink df/dab/d1d/d28/d2b/l3d 0 2024-02-20T08:06:10.214 INFO:tasks.workunit.client.1.smithi194.stdout:1/472: rename d2/d1a/d26/f4e to d2/d8/d12/f99 0 2024-02-20T08:06:10.222 INFO:tasks.workunit.client.1.smithi194.stdout:6/555: mknod df/d42/cba 0 2024-02-20T08:06:10.222 INFO:tasks.workunit.client.1.smithi194.stdout:6/556: chown df/d42/cba 2012 1 2024-02-20T08:06:10.225 INFO:tasks.workunit.client.1.smithi194.stdout:7/482: rename d11/d2d/d38/d5a to d11/d2d/d38/d37/d43/d8e 0 2024-02-20T08:06:10.226 INFO:tasks.workunit.client.1.smithi194.stdout:7/483: fdatasync d11/d2d/d38/d4a/d53/f61 0 2024-02-20T08:06:10.228 INFO:tasks.workunit.client.1.smithi194.stdout:1/473: unlink d2/d1a/d26/d45/f4a 0 2024-02-20T08:06:10.230 INFO:tasks.workunit.client.1.smithi194.stdout:3/405: chown d5/d10/d62/l72 14292 1 2024-02-20T08:06:10.231 INFO:tasks.workunit.client.1.smithi194.stdout:6/557: chown df/dab/l8c 60043374 1 2024-02-20T08:06:10.231 INFO:tasks.workunit.client.1.smithi194.stdout:6/558: dread - df/f92 zero size 2024-02-20T08:06:10.233 INFO:tasks.workunit.client.1.smithi194.stdout:9/518: getdents d4/d8b 0 2024-02-20T08:06:10.235 INFO:tasks.workunit.client.1.smithi194.stdout:3/406: mknod d5/d10/c7a 0 2024-02-20T08:06:10.236 INFO:tasks.workunit.client.1.smithi194.stdout:3/407: chown d5/d10/d17/d1d/d3d 842676 1 2024-02-20T08:06:10.243 INFO:tasks.workunit.client.1.smithi194.stdout:7/484: getdents d11/d2d/d38/d4a/d27/d51/d84 0 2024-02-20T08:06:10.243 INFO:tasks.workunit.client.1.smithi194.stdout:4/389: truncate d0/d2/f2e 6831779 0 2024-02-20T08:06:10.246 INFO:tasks.workunit.client.1.smithi194.stdout:9/519: rename d4/d1b/f4a to d4/d37/dab/fac 0 2024-02-20T08:06:10.249 INFO:tasks.workunit.client.1.smithi194.stdout:6/559: getdents df/d42 0 2024-02-20T08:06:10.250 INFO:tasks.workunit.client.1.smithi194.stdout:4/390: dwrite d0/d5c/d60/f6e [0,4194304] 0 2024-02-20T08:06:10.254 INFO:tasks.workunit.client.1.smithi194.stdout:9/520: mknod d4/d2d/d42/d4e/d6e/cad 0 2024-02-20T08:06:10.255 INFO:tasks.workunit.client.1.smithi194.stdout:3/408: dwrite d5/df/f24 [4194304,4194304] 0 2024-02-20T08:06:10.255 INFO:tasks.workunit.client.1.smithi194.stdout:7/485: dread d11/d2d/d38/d4a/d27/f4e [0,4194304] 0 2024-02-20T08:06:10.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/391: dwrite d0/d10/d1c/d4d/d2f/f3a [0,4194304] 0 2024-02-20T08:06:10.259 INFO:tasks.workunit.client.1.smithi194.stdout:6/560: mkdir df/dab/d1d/d28/d46/d5a/d6b/dbb 0 2024-02-20T08:06:10.265 INFO:tasks.workunit.client.1.smithi194.stdout:3/409: unlink d5/df/d60/f40 0 2024-02-20T08:06:10.266 INFO:tasks.workunit.client.1.smithi194.stdout:3/410: dread - d5/d10/d17/d1d/d3d/f3e zero size 2024-02-20T08:06:10.266 INFO:tasks.workunit.client.1.smithi194.stdout:7/486: mknod d11/d2d/c8f 0 2024-02-20T08:06:10.267 INFO:tasks.workunit.client.1.smithi194.stdout:3/411: stat d5/d10/d28/d41/d73/f79 0 2024-02-20T08:06:10.269 INFO:tasks.workunit.client.1.smithi194.stdout:4/392: readlink d0/d2/l29 0 2024-02-20T08:06:10.271 INFO:tasks.workunit.client.1.smithi194.stdout:6/561: unlink df/d42/f4d 0 2024-02-20T08:06:10.276 INFO:tasks.workunit.client.1.smithi194.stdout:7/487: creat d11/d2d/d38/d37/f90 x:0 0 0 2024-02-20T08:06:10.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/412: mkdir d5/d10/d16/d7b 0 2024-02-20T08:06:10.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/521: link d4/d2d/d42/f81 d4/d20/d43/daa/fae 0 2024-02-20T08:06:10.279 INFO:tasks.workunit.client.1.smithi194.stdout:9/522: stat d4/de/c14 0 2024-02-20T08:06:10.280 INFO:tasks.workunit.client.1.smithi194.stdout:7/488: rmdir d11/d2d/d38/d37/d43/d7b 39 2024-02-20T08:06:10.283 INFO:tasks.workunit.client.1.smithi194.stdout:4/393: mkdir d0/df/d72 0 2024-02-20T08:06:10.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/413: read d5/df/f24 [1791517,2021] 0 2024-02-20T08:06:10.287 INFO:tasks.workunit.client.1.smithi194.stdout:9/523: creat d4/d37/d38/faf x:0 0 0 2024-02-20T08:06:10.288 INFO:tasks.workunit.client.1.smithi194.stdout:4/394: rename d0/df/d41/c4b to d0/df/d72/c73 0 2024-02-20T08:06:10.290 INFO:tasks.workunit.client.1.smithi194.stdout:6/562: rmdir df/dab/d1d/d28/d46/dae 0 2024-02-20T08:06:10.293 INFO:tasks.workunit.client.1.smithi194.stdout:7/489: mkdir d11/d2d/d38/d37/d43/d7b/d91 0 2024-02-20T08:06:10.294 INFO:tasks.workunit.client.1.smithi194.stdout:7/490: chown d11/d2d/d38/d4a/l17 18 1 2024-02-20T08:06:10.294 INFO:tasks.workunit.client.1.smithi194.stdout:7/491: fsync d11/d2d/f8a 0 2024-02-20T08:06:10.294 INFO:tasks.workunit.client.1.smithi194.stdout:7/492: chown d11/d2d/d38/d37/d3c 1056763460 1 2024-02-20T08:06:10.295 INFO:tasks.workunit.client.1.smithi194.stdout:7/493: readlink d11/d2d/d38/d4a/d27/l47 0 2024-02-20T08:06:10.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/395: mknod d0/df/d41/c74 0 2024-02-20T08:06:10.300 INFO:tasks.workunit.client.1.smithi194.stdout:4/396: dread d0/d10/d1c/d4d/f38 [0,4194304] 0 2024-02-20T08:06:10.300 INFO:tasks.workunit.client.1.smithi194.stdout:4/397: stat d0/f34 0 2024-02-20T08:06:10.300 INFO:tasks.workunit.client.1.smithi194.stdout:4/398: stat d0/d5c/d60/f6e 0 2024-02-20T08:06:10.301 INFO:tasks.workunit.client.1.smithi194.stdout:6/563: mknod df/d42/d86/cbc 0 2024-02-20T08:06:10.307 INFO:tasks.workunit.client.1.smithi194.stdout:9/524: rename d4/d20/d5c/lf to d4/d2d/d59/lb0 0 2024-02-20T08:06:10.308 INFO:tasks.workunit.client.1.smithi194.stdout:9/525: chown d4/d2d/d42/d4e/d6e/l7a 1808661500 1 2024-02-20T08:06:10.311 INFO:tasks.workunit.client.1.smithi194.stdout:4/399: unlink d0/d10/d1c/d21/l28 0 2024-02-20T08:06:10.312 INFO:tasks.workunit.client.1.smithi194.stdout:9/526: dwrite d4/fa8 [0,4194304] 0 2024-02-20T08:06:10.313 INFO:tasks.workunit.client.1.smithi194.stdout:6/564: symlink df/dab/d1d/d28/d2b/d94/lbd 0 2024-02-20T08:06:10.314 INFO:tasks.workunit.client.1.smithi194.stdout:9/527: write d4/de/f7b [3246517,41062] 0 2024-02-20T08:06:10.314 INFO:tasks.workunit.client.1.smithi194.stdout:3/414: creat d5/f7c x:0 0 0 2024-02-20T08:06:10.316 INFO:tasks.workunit.client.1.smithi194.stdout:3/415: readlink d5/l6e 0 2024-02-20T08:06:10.317 INFO:tasks.workunit.client.1.smithi194.stdout:4/400: creat d0/d10/d1c/d21/f75 x:0 0 0 2024-02-20T08:06:10.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/401: stat d0/d2/l29 0 2024-02-20T08:06:10.319 INFO:tasks.workunit.client.1.smithi194.stdout:4/402: write d0/f19 [3230465,60380] 0 2024-02-20T08:06:10.319 INFO:tasks.workunit.client.1.smithi194.stdout:5/462: sync 2024-02-20T08:06:10.319 INFO:tasks.workunit.client.1.smithi194.stdout:2/477: sync 2024-02-20T08:06:10.319 INFO:tasks.workunit.client.1.smithi194.stdout:8/402: sync 2024-02-20T08:06:10.322 INFO:tasks.workunit.client.1.smithi194.stdout:4/403: write d0/d10/d1c/d21/f57 [987111,27871] 0 2024-02-20T08:06:10.322 INFO:tasks.workunit.client.1.smithi194.stdout:5/463: read d4/d6/dd/d25/f59 [3425806,29938] 0 2024-02-20T08:06:10.322 INFO:tasks.workunit.client.1.smithi194.stdout:9/528: creat d4/d37/d38/fb1 x:0 0 0 2024-02-20T08:06:10.324 INFO:tasks.workunit.client.1.smithi194.stdout:6/565: mkdir df/dbe 0 2024-02-20T08:06:10.325 INFO:tasks.workunit.client.1.smithi194.stdout:6/566: rename df/dab/d1d to df/dab/d1d/d28/d2b/d94/d96/dbf 22 2024-02-20T08:06:10.326 INFO:tasks.workunit.client.1.smithi194.stdout:2/478: mkdir df/d14/d19/d5c/d97 0 2024-02-20T08:06:10.328 INFO:tasks.workunit.client.1.smithi194.stdout:7/494: getdents d11/d2d/d38/d37/d43 0 2024-02-20T08:06:10.330 INFO:tasks.workunit.client.1.smithi194.stdout:7/495: chown d11/d2d/d38/d4a/d27/d51 130216 1 2024-02-20T08:06:10.330 INFO:tasks.workunit.client.1.smithi194.stdout:3/416: creat d5/df/d75/f7d x:0 0 0 2024-02-20T08:06:10.330 INFO:tasks.workunit.client.1.smithi194.stdout:3/417: write d5/fa [5062442,122362] 0 2024-02-20T08:06:10.333 INFO:tasks.workunit.client.1.smithi194.stdout:9/529: write d4/d20/d5c/fc [632165,61724] 0 2024-02-20T08:06:10.335 INFO:tasks.workunit.client.1.smithi194.stdout:7/496: dread d11/d2d/d38/d4a/d27/f73 [0,4194304] 0 2024-02-20T08:06:10.338 INFO:tasks.workunit.client.1.smithi194.stdout:8/403: getdents d2/d14/d18/d45/d69 0 2024-02-20T08:06:10.340 INFO:tasks.workunit.client.1.smithi194.stdout:4/404: symlink d0/d2/d51/l76 0 2024-02-20T08:06:10.342 INFO:tasks.workunit.client.1.smithi194.stdout:2/479: dread df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:10.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/497: dwrite d11/d2d/d38/d37/d43/d8e/d5e/f6a [0,4194304] 0 2024-02-20T08:06:10.344 INFO:tasks.workunit.client.1.smithi194.stdout:0/443: sync 2024-02-20T08:06:10.344 INFO:tasks.workunit.client.1.smithi194.stdout:1/474: sync 2024-02-20T08:06:10.345 INFO:tasks.workunit.client.1.smithi194.stdout:5/464: creat d4/d6/d11/f8d x:0 0 0 2024-02-20T08:06:10.348 INFO:tasks.workunit.client.1.smithi194.stdout:7/498: truncate f5 13490219 0 2024-02-20T08:06:10.351 INFO:tasks.workunit.client.1.smithi194.stdout:0/444: readlink d6/d2b/d35/d42/l2d 0 2024-02-20T08:06:10.357 INFO:tasks.workunit.client.1.smithi194.stdout:9/530: dwrite d4/d37/dab/fac [0,4194304] 0 2024-02-20T08:06:10.358 INFO:tasks.workunit.client.1.smithi194.stdout:6/567: dread df/d42/f65 [0,4194304] 0 2024-02-20T08:06:10.359 INFO:tasks.workunit.client.1.smithi194.stdout:3/418: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:10.364 INFO:tasks.workunit.client.1.smithi194.stdout:0/445: mkdir d6/d93 0 2024-02-20T08:06:10.364 INFO:tasks.workunit.client.1.smithi194.stdout:4/405: dwrite d0/f19 [4194304,4194304] 0 2024-02-20T08:06:10.366 INFO:tasks.workunit.client.1.smithi194.stdout:3/419: write d5/fa [3905878,129803] 0 2024-02-20T08:06:10.367 INFO:tasks.workunit.client.1.smithi194.stdout:9/531: truncate d4/d8b/f8f 417192 0 2024-02-20T08:06:10.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/480: dwrite df/d14/d19/d5c/f5e [0,4194304] 0 2024-02-20T08:06:10.372 INFO:tasks.workunit.client.1.smithi194.stdout:7/499: dwrite d11/f12 [4194304,4194304] 0 2024-02-20T08:06:10.372 INFO:tasks.workunit.client.1.smithi194.stdout:5/465: dread d4/d20/d2b/d79/f60 [0,4194304] 0 2024-02-20T08:06:10.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/568: stat df/dab/d1d/d28/d46/d5a/d6b/c8a 0 2024-02-20T08:06:10.373 INFO:tasks.workunit.client.1.smithi194.stdout:1/475: rename d2/d8/d12/f55 to d2/d1a/f9a 0 2024-02-20T08:06:10.374 INFO:tasks.workunit.client.1.smithi194.stdout:3/420: dread - d5/d10/d16/f59 zero size 2024-02-20T08:06:10.375 INFO:tasks.workunit.client.1.smithi194.stdout:4/406: readlink d0/df/l40 0 2024-02-20T08:06:10.377 INFO:tasks.workunit.client.1.smithi194.stdout:1/476: write d2/d8/f83 [190715,91290] 0 2024-02-20T08:06:10.377 INFO:tasks.workunit.client.1.smithi194.stdout:4/407: readlink d0/df/l40 0 2024-02-20T08:06:10.381 INFO:tasks.workunit.client.1.smithi194.stdout:8/404: dwrite d2/d4d/f6e [0,4194304] 0 2024-02-20T08:06:10.381 INFO:tasks.workunit.client.1.smithi194.stdout:1/477: write d2/f36 [6605123,77776] 0 2024-02-20T08:06:10.383 INFO:tasks.workunit.client.1.smithi194.stdout:9/532: mknod d4/d2d/d42/d4e/d6e/d88/cb2 0 2024-02-20T08:06:10.385 INFO:tasks.workunit.client.1.smithi194.stdout:7/500: dwrite d11/f35 [0,4194304] 0 2024-02-20T08:06:10.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/481: mknod df/d14/d24/d56/c98 0 2024-02-20T08:06:10.391 INFO:tasks.workunit.client.1.smithi194.stdout:5/466: readlink d4/d6/d11/d15/d28/d85/d53/l82 0 2024-02-20T08:06:10.393 INFO:tasks.workunit.client.1.smithi194.stdout:6/569: creat df/dab/d1d/d28/d2b/d94/d96/fc0 x:0 0 0 2024-02-20T08:06:10.393 INFO:tasks.workunit.client.1.smithi194.stdout:5/467: write d4/fc [6283960,127194] 0 2024-02-20T08:06:10.396 INFO:tasks.workunit.client.1.smithi194.stdout:6/570: read - df/dab/d1d/d28/d46/d5a/d6b/f85 zero size 2024-02-20T08:06:10.396 INFO:tasks.workunit.client.1.smithi194.stdout:9/533: dwrite d4/d1b/f74 [0,4194304] 0 2024-02-20T08:06:10.396 INFO:tasks.workunit.client.1.smithi194.stdout:1/478: mknod d2/d1a/d61/d68/c9b 0 2024-02-20T08:06:10.400 INFO:tasks.workunit.client.1.smithi194.stdout:8/405: rename d2/l23 to d2/d14/d18/d45/d69/l8b 0 2024-02-20T08:06:10.400 INFO:tasks.workunit.client.1.smithi194.stdout:3/421: mknod d5/df/c7e 0 2024-02-20T08:06:10.403 INFO:tasks.workunit.client.1.smithi194.stdout:0/446: creat d6/d2b/d35/d42/d1e/d3c/f94 x:0 0 0 2024-02-20T08:06:10.403 INFO:tasks.workunit.client.1.smithi194.stdout:8/406: chown d2/d14/d18/f27 509247 1 2024-02-20T08:06:10.405 INFO:tasks.workunit.client.1.smithi194.stdout:5/468: rmdir d4 39 2024-02-20T08:06:10.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/571: rmdir df/dab/d1d/d28/d46/d5a/d6b/d83 39 2024-02-20T08:06:10.409 INFO:tasks.workunit.client.1.smithi194.stdout:9/534: dwrite d4/d20/f87 [0,4194304] 0 2024-02-20T08:06:10.410 INFO:tasks.workunit.client.1.smithi194.stdout:7/501: symlink d11/d2d/d38/d37/d43/d8e/l92 0 2024-02-20T08:06:10.414 INFO:tasks.workunit.client.1.smithi194.stdout:3/422: rename d5/f34 to d5/d10/d16/d7b/f7f 0 2024-02-20T08:06:10.415 INFO:tasks.workunit.client.1.smithi194.stdout:1/479: dwrite d2/d8/d12/f21 [0,4194304] 0 2024-02-20T08:06:10.415 INFO:tasks.workunit.client.1.smithi194.stdout:3/423: dread - d5/df/f76 zero size 2024-02-20T08:06:10.416 INFO:tasks.workunit.client.1.smithi194.stdout:3/424: chown d5/d10/d28/l46 133344 1 2024-02-20T08:06:10.423 INFO:tasks.workunit.client.1.smithi194.stdout:5/469: dread d4/f73 [0,4194304] 0 2024-02-20T08:06:10.424 INFO:tasks.workunit.client.1.smithi194.stdout:5/470: fsync d4/d6/d11/f8d 0 2024-02-20T08:06:10.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/471: stat d4/d6/f75 0 2024-02-20T08:06:10.436 INFO:tasks.workunit.client.1.smithi194.stdout:0/447: rename d6/d2b/d35/d39/d55/f56 to d6/d2b/d35/d39/d8f/f95 0 2024-02-20T08:06:10.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/480: creat d2/d1a/d61/f9c x:0 0 0 2024-02-20T08:06:10.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/481: write d2/f4b [582892,92589] 0 2024-02-20T08:06:10.441 INFO:tasks.workunit.client.1.smithi194.stdout:4/408: truncate d0/d10/d1c/f30 2492645 0 2024-02-20T08:06:10.444 INFO:tasks.workunit.client.1.smithi194.stdout:2/482: dwrite df/f41 [0,4194304] 0 2024-02-20T08:06:10.447 INFO:tasks.workunit.client.1.smithi194.stdout:8/407: truncate d2/d14/f34 2302583 0 2024-02-20T08:06:10.448 INFO:tasks.workunit.client.1.smithi194.stdout:8/408: dread - d2/d14/f76 zero size 2024-02-20T08:06:10.449 INFO:tasks.workunit.client.1.smithi194.stdout:6/572: creat df/dab/d1d/d28/d5e/da7/fc1 x:0 0 0 2024-02-20T08:06:10.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/535: symlink d4/d37/lb3 0 2024-02-20T08:06:10.452 INFO:tasks.workunit.client.1.smithi194.stdout:7/502: mkdir d11/d2d/d38/d4a/d93 0 2024-02-20T08:06:10.453 INFO:tasks.workunit.client.1.smithi194.stdout:6/573: write df/dab/d1d/d76/f8d [2218724,60502] 0 2024-02-20T08:06:10.454 INFO:tasks.workunit.client.1.smithi194.stdout:0/448: creat d6/d2b/f96 x:0 0 0 2024-02-20T08:06:10.454 INFO:tasks.workunit.client.1.smithi194.stdout:2/483: dwrite df/f41 [0,4194304] 0 2024-02-20T08:06:10.456 INFO:tasks.workunit.client.1.smithi194.stdout:0/449: stat d6/d2b/d35/d42/f74 0 2024-02-20T08:06:10.458 INFO:tasks.workunit.client.1.smithi194.stdout:5/472: dwrite d4/d6/dd/f2d [0,4194304] 0 2024-02-20T08:06:10.460 INFO:tasks.workunit.client.1.smithi194.stdout:8/409: dread d2/d14/d18/d45/d69/f71 [0,4194304] 0 2024-02-20T08:06:10.463 INFO:tasks.workunit.client.1.smithi194.stdout:1/482: unlink d2/d8/d60/f80 0 2024-02-20T08:06:10.465 INFO:tasks.workunit.client.1.smithi194.stdout:1/483: write d2/d1a/d61/f9c [978987,121240] 0 2024-02-20T08:06:10.466 INFO:tasks.workunit.client.1.smithi194.stdout:4/409: creat d0/df/d41/f77 x:0 0 0 2024-02-20T08:06:10.468 INFO:tasks.workunit.client.1.smithi194.stdout:4/410: fdatasync d0/d10/d1c/d21/f44 0 2024-02-20T08:06:10.468 INFO:tasks.workunit.client.1.smithi194.stdout:3/425: write d5/d10/d17/f38 [1463916,103038] 0 2024-02-20T08:06:10.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/536: readlink d4/d1b/l3d 0 2024-02-20T08:06:10.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/537: fdatasync d4/f5 0 2024-02-20T08:06:10.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/450: mkdir d6/d2b/d35/d42/d97 0 2024-02-20T08:06:10.483 INFO:tasks.workunit.client.1.smithi194.stdout:7/503: write d11/d2d/d38/d4a/d53/d81/f86 [66720,27794] 0 2024-02-20T08:06:10.484 INFO:tasks.workunit.client.1.smithi194.stdout:5/473: unlink d4/d6/d11/d15/d28/c30 0 2024-02-20T08:06:10.485 INFO:tasks.workunit.client.1.smithi194.stdout:5/474: chown d4/d6/d11/d15/d28/d85/c55 8652 1 2024-02-20T08:06:10.486 INFO:tasks.workunit.client.1.smithi194.stdout:1/484: symlink d2/d1a/d26/d3d/d71/l9d 0 2024-02-20T08:06:10.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/411: creat d0/d5c/d60/f78 x:0 0 0 2024-02-20T08:06:10.496 INFO:tasks.workunit.client.1.smithi194.stdout:9/538: mknod d4/d2d/d59/cb4 0 2024-02-20T08:06:10.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/574: symlink df/dab/lc2 0 2024-02-20T08:06:10.496 INFO:tasks.workunit.client.1.smithi194.stdout:4/412: fdatasync d0/df/f13 0 2024-02-20T08:06:10.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/575: dread - df/f92 zero size 2024-02-20T08:06:10.497 INFO:tasks.workunit.client.1.smithi194.stdout:5/475: fdatasync d4/d6/d11/f7e 0 2024-02-20T08:06:10.498 INFO:tasks.workunit.client.1.smithi194.stdout:1/485: mknod d2/d1a/d26/d57/d58/c9e 0 2024-02-20T08:06:10.506 INFO:tasks.workunit.client.1.smithi194.stdout:1/486: dwrite d2/d1a/d26/f2d [0,4194304] 0 2024-02-20T08:06:10.511 INFO:tasks.workunit.client.1.smithi194.stdout:8/410: creat d2/d14/d18/f8c x:0 0 0 2024-02-20T08:06:10.520 INFO:tasks.workunit.client.1.smithi194.stdout:8/411: dwrite d2/d14/f2c [4194304,4194304] 0 2024-02-20T08:06:10.524 INFO:tasks.workunit.client.1.smithi194.stdout:5/476: creat d4/d20/d2b/d79/f8e x:0 0 0 2024-02-20T08:06:10.527 INFO:tasks.workunit.client.1.smithi194.stdout:1/487: mkdir d2/d1a/d61/d9f 0 2024-02-20T08:06:10.528 INFO:tasks.workunit.client.1.smithi194.stdout:7/504: link d11/d2d/d38/d37/d3c/l7e d11/d2d/d38/d37/d43/l94 0 2024-02-20T08:06:10.529 INFO:tasks.workunit.client.1.smithi194.stdout:6/576: dwrite df/f13 [0,4194304] 0 2024-02-20T08:06:10.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/577: fsync df/d42/f4f 0 2024-02-20T08:06:10.533 INFO:tasks.workunit.client.1.smithi194.stdout:6/578: write df/d18/f81 [274518,91196] 0 2024-02-20T08:06:10.534 INFO:tasks.workunit.client.1.smithi194.stdout:4/413: mknod d0/d2/d3e/c79 0 2024-02-20T08:06:10.541 INFO:tasks.workunit.client.1.smithi194.stdout:3/426: getdents d5/d10/d17/d1d 0 2024-02-20T08:06:10.545 INFO:tasks.workunit.client.1.smithi194.stdout:5/477: dwrite d4/d20/d2b/f2c [0,4194304] 0 2024-02-20T08:06:10.547 INFO:tasks.workunit.client.1.smithi194.stdout:9/539: symlink d4/d37/d4f/d91/lb5 0 2024-02-20T08:06:10.553 INFO:tasks.workunit.client.1.smithi194.stdout:6/579: creat df/dab/d1d/d28/d2b/d94/fc3 x:0 0 0 2024-02-20T08:06:10.555 INFO:tasks.workunit.client.1.smithi194.stdout:8/412: symlink d2/l8d 0 2024-02-20T08:06:10.556 INFO:tasks.workunit.client.1.smithi194.stdout:3/427: mkdir d5/df/d30/d80 0 2024-02-20T08:06:10.557 INFO:tasks.workunit.client.1.smithi194.stdout:5/478: symlink d4/d6/l8f 0 2024-02-20T08:06:10.561 INFO:tasks.workunit.client.1.smithi194.stdout:6/580: mkdir df/dab/d1d/d28/d46/dc4 0 2024-02-20T08:06:10.561 INFO:tasks.workunit.client.1.smithi194.stdout:6/581: stat df/dab/d1d/d28/d5e/c5f 0 2024-02-20T08:06:10.562 INFO:tasks.workunit.client.1.smithi194.stdout:2/484: write f5 [6925022,38162] 0 2024-02-20T08:06:10.564 INFO:tasks.workunit.client.1.smithi194.stdout:4/414: rmdir d0/d2/d6b 0 2024-02-20T08:06:10.565 INFO:tasks.workunit.client.1.smithi194.stdout:4/415: truncate d0/d5c/d60/f78 660186 0 2024-02-20T08:06:10.566 INFO:tasks.workunit.client.1.smithi194.stdout:8/413: mkdir d2/d14/d18/d45/d7b/d8e 0 2024-02-20T08:06:10.566 INFO:tasks.workunit.client.1.smithi194.stdout:4/416: read - d0/d4f/f6d zero size 2024-02-20T08:06:10.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/428: mknod d5/c81 0 2024-02-20T08:06:10.567 INFO:tasks.workunit.client.1.smithi194.stdout:4/417: write d0/f34 [4759639,115490] 0 2024-02-20T08:06:10.569 INFO:tasks.workunit.client.1.smithi194.stdout:4/418: write d0/d4f/f6d [37300,99072] 0 2024-02-20T08:06:10.571 INFO:tasks.workunit.client.1.smithi194.stdout:9/540: getdents d4/d20/d43/d51 0 2024-02-20T08:06:10.572 INFO:tasks.workunit.client.1.smithi194.stdout:9/541: readlink d4/d20/d43/d51/l3f 0 2024-02-20T08:06:10.573 INFO:tasks.workunit.client.1.smithi194.stdout:6/582: creat df/dab/d1d/d28/d46/dc4/fc5 x:0 0 0 2024-02-20T08:06:10.574 INFO:tasks.workunit.client.1.smithi194.stdout:1/488: dread - d2/d1a/d26/f53 zero size 2024-02-20T08:06:10.576 INFO:tasks.workunit.client.1.smithi194.stdout:9/542: mkdir d4/d20/d41/db6 0 2024-02-20T08:06:10.577 INFO:tasks.workunit.client.1.smithi194.stdout:1/489: read - d2/d1a/d61/d68/f7c zero size 2024-02-20T08:06:10.578 INFO:tasks.workunit.client.1.smithi194.stdout:2/485: creat df/d14/d24/f99 x:0 0 0 2024-02-20T08:06:10.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/543: dread - d4/d20/d41/f9f zero size 2024-02-20T08:06:10.579 INFO:tasks.workunit.client.1.smithi194.stdout:8/414: link d2/d14/d18/d45/d4e/d6c/l84 d2/d80/l8f 0 2024-02-20T08:06:10.581 INFO:tasks.workunit.client.1.smithi194.stdout:2/486: chown df/d14/d19/l42 115115 1 2024-02-20T08:06:10.582 INFO:tasks.workunit.client.1.smithi194.stdout:9/544: fdatasync d4/d20/d43/f47 0 2024-02-20T08:06:10.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/583: dwrite df/d18/f40 [4194304,4194304] 0 2024-02-20T08:06:10.584 INFO:tasks.workunit.client.1.smithi194.stdout:8/415: mkdir d2/d14/d18/d45/d90 0 2024-02-20T08:06:10.584 INFO:tasks.workunit.client.1.smithi194.stdout:4/419: dwrite d0/f2d [0,4194304] 0 2024-02-20T08:06:10.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/505: write d11/d2d/d38/d37/f4b [3577964,75058] 0 2024-02-20T08:06:10.587 INFO:tasks.workunit.client.1.smithi194.stdout:7/506: chown d11/d2d/d38/d4a/d53/f58 92 1 2024-02-20T08:06:10.600 INFO:tasks.workunit.client.1.smithi194.stdout:8/416: creat d2/d14/d18/d45/d69/f91 x:0 0 0 2024-02-20T08:06:10.601 INFO:tasks.workunit.client.1.smithi194.stdout:7/507: rmdir d11/d2d/d38/d4a/d27 39 2024-02-20T08:06:10.608 INFO:tasks.workunit.client.1.smithi194.stdout:1/490: dread d2/d8/df/f24 [0,4194304] 0 2024-02-20T08:06:10.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/429: dwrite d5/d10/d16/f3a [0,4194304] 0 2024-02-20T08:06:10.614 INFO:tasks.workunit.client.1.smithi194.stdout:8/417: mkdir d2/d14/d18/d45/d90/d92 0 2024-02-20T08:06:10.616 INFO:tasks.workunit.client.1.smithi194.stdout:7/508: mkdir d11/d2d/d38/d95 0 2024-02-20T08:06:10.618 INFO:tasks.workunit.client.1.smithi194.stdout:9/545: write d4/d20/d43/daa/fae [290829,41619] 0 2024-02-20T08:06:10.618 INFO:tasks.workunit.client.1.smithi194.stdout:2/487: dwrite df/f72 [4194304,4194304] 0 2024-02-20T08:06:10.623 INFO:tasks.workunit.client.1.smithi194.stdout:4/420: dread d0/df/d11/f2b [0,4194304] 0 2024-02-20T08:06:10.624 INFO:tasks.workunit.client.1.smithi194.stdout:6/584: dwrite df/d42/f65 [0,4194304] 0 2024-02-20T08:06:10.624 INFO:tasks.workunit.client.1.smithi194.stdout:1/491: creat d2/d8/fa0 x:0 0 0 2024-02-20T08:06:10.625 INFO:tasks.workunit.client.1.smithi194.stdout:4/421: chown d0/d4f 422555 1 2024-02-20T08:06:10.625 INFO:tasks.workunit.client.1.smithi194.stdout:3/430: mknod d5/c82 0 2024-02-20T08:06:10.626 INFO:tasks.workunit.client.1.smithi194.stdout:3/431: dread - d5/df/d75/f7d zero size 2024-02-20T08:06:10.628 INFO:tasks.workunit.client.1.smithi194.stdout:6/585: rmdir df 39 2024-02-20T08:06:10.632 INFO:tasks.workunit.client.1.smithi194.stdout:4/422: dread d0/d5c/d60/f6e [0,4194304] 0 2024-02-20T08:06:10.632 INFO:tasks.workunit.client.1.smithi194.stdout:1/492: symlink d2/d8/d12/la1 0 2024-02-20T08:06:10.633 INFO:tasks.workunit.client.1.smithi194.stdout:4/423: chown d0/d4f/f6d 392884744 1 2024-02-20T08:06:10.633 INFO:tasks.workunit.client.1.smithi194.stdout:3/432: dwrite d5/df/f64 [0,4194304] 0 2024-02-20T08:06:10.637 INFO:tasks.workunit.client.1.smithi194.stdout:8/418: dread d2/f5b [0,4194304] 0 2024-02-20T08:06:10.640 INFO:tasks.workunit.client.1.smithi194.stdout:3/433: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:10.640 INFO:tasks.workunit.client.1.smithi194.stdout:7/509: creat d11/d2d/d38/d4a/d27/d51/d84/f96 x:0 0 0 2024-02-20T08:06:10.645 INFO:tasks.workunit.client.1.smithi194.stdout:8/419: creat d2/d14/d18/d45/d90/f93 x:0 0 0 2024-02-20T08:06:10.649 INFO:tasks.workunit.client.1.smithi194.stdout:7/510: dread d11/d2d/d38/d4a/d27/f73 [0,4194304] 0 2024-02-20T08:06:10.649 INFO:tasks.workunit.client.1.smithi194.stdout:2/488: dread f5 [4194304,4194304] 0 2024-02-20T08:06:10.649 INFO:tasks.workunit.client.1.smithi194.stdout:4/424: link d0/d2/d3e/f71 d0/d10/d1c/d4d/f7a 0 2024-02-20T08:06:10.651 INFO:tasks.workunit.client.1.smithi194.stdout:8/420: unlink d2/d14/d18/d45/d69/f71 0 2024-02-20T08:06:10.652 INFO:tasks.workunit.client.1.smithi194.stdout:3/434: mknod d5/d10/c83 0 2024-02-20T08:06:10.653 INFO:tasks.workunit.client.1.smithi194.stdout:1/493: rename d2/d1a/d26/d57/d58/c9e to d2/d1a/d26/ca2 0 2024-02-20T08:06:10.657 INFO:tasks.workunit.client.1.smithi194.stdout:1/494: dread d2/f36 [4194304,4194304] 0 2024-02-20T08:06:10.657 INFO:tasks.workunit.client.1.smithi194.stdout:4/425: creat d0/df/d11/f7b x:0 0 0 2024-02-20T08:06:10.661 INFO:tasks.workunit.client.1.smithi194.stdout:8/421: rename d2/d14/d18/f4a to d2/d14/d18/d45/f94 0 2024-02-20T08:06:10.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/495: dread d2/d1a/d26/d3d/f4d [0,4194304] 0 2024-02-20T08:06:10.661 INFO:tasks.workunit.client.1.smithi194.stdout:8/422: chown d2/d4d 3 1 2024-02-20T08:06:10.662 INFO:tasks.workunit.client.1.smithi194.stdout:6/586: dread df/dab/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:10.667 INFO:tasks.workunit.client.1.smithi194.stdout:3/435: rename d5/d10/d16/l57 to d5/df/d60/l84 0 2024-02-20T08:06:10.672 INFO:tasks.workunit.client.1.smithi194.stdout:8/423: creat d2/d14/d18/d45/f95 x:0 0 0 2024-02-20T08:06:10.672 INFO:tasks.workunit.client.1.smithi194.stdout:8/424: stat d2 0 2024-02-20T08:06:10.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/587: rmdir df/d42/d86 39 2024-02-20T08:06:10.676 INFO:tasks.workunit.client.1.smithi194.stdout:1/496: truncate d2/d8/d12/f2b 442199 0 2024-02-20T08:06:10.679 INFO:tasks.workunit.client.1.smithi194.stdout:6/588: dwrite df/dab/d1d/d28/d46/d5a/d6b/f85 [0,4194304] 0 2024-02-20T08:06:10.679 INFO:tasks.workunit.client.1.smithi194.stdout:7/511: creat d11/d2d/d38/d37/d43/d7b/d91/f97 x:0 0 0 2024-02-20T08:06:10.680 INFO:tasks.workunit.client.1.smithi194.stdout:2/489: dwrite df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:10.682 INFO:tasks.workunit.client.1.smithi194.stdout:8/425: symlink d2/d14/d18/d45/d4e/d6c/l96 0 2024-02-20T08:06:10.687 INFO:tasks.workunit.client.1.smithi194.stdout:4/426: dwrite d0/d5c/d60/f6e [0,4194304] 0 2024-02-20T08:06:10.690 INFO:tasks.workunit.client.1.smithi194.stdout:6/589: mkdir df/dab/d1d/d28/d46/dc6 0 2024-02-20T08:06:10.690 INFO:tasks.workunit.client.1.smithi194.stdout:4/427: readlink d0/d10/d1c/d21/l45 0 2024-02-20T08:06:10.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/512: creat d11/d2d/d38/d37/d43/d7b/d91/f98 x:0 0 0 2024-02-20T08:06:10.694 INFO:tasks.workunit.client.1.smithi194.stdout:8/426: dwrite d2/d14/f6a [0,4194304] 0 2024-02-20T08:06:10.697 INFO:tasks.workunit.client.1.smithi194.stdout:7/513: truncate d11/d2d/d38/d37/d43/d7b/d91/f97 796389 0 2024-02-20T08:06:10.697 INFO:tasks.workunit.client.1.smithi194.stdout:7/514: chown d11/d2d/d38/d4a/f21 13 1 2024-02-20T08:06:10.701 INFO:tasks.workunit.client.1.smithi194.stdout:4/428: rename d0/d10/d1c/d21/d46/f61 to d0/d5c/f7c 0 2024-02-20T08:06:10.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/436: link d5/df/d60/l5e d5/d10/d17/d1d/d56/l85 0 2024-02-20T08:06:10.702 INFO:tasks.workunit.client.1.smithi194.stdout:3/437: chown d5/d10/d62/l72 155688 1 2024-02-20T08:06:10.703 INFO:tasks.workunit.client.1.smithi194.stdout:4/429: write d0/df/d11/f7b [299779,105859] 0 2024-02-20T08:06:10.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/497: getdents d2/d1a/d26/d3d 0 2024-02-20T08:06:10.708 INFO:tasks.workunit.client.1.smithi194.stdout:6/590: mknod df/dbe/cc7 0 2024-02-20T08:06:10.715 INFO:tasks.workunit.client.1.smithi194.stdout:6/591: creat df/dab/d1d/d28/d46/d5a/fc8 x:0 0 0 2024-02-20T08:06:10.716 INFO:tasks.workunit.client.1.smithi194.stdout:8/427: symlink d2/d14/d18/l97 0 2024-02-20T08:06:10.716 INFO:tasks.workunit.client.1.smithi194.stdout:8/428: stat d2/d14/d18/d45/d7b/d8e 0 2024-02-20T08:06:10.717 INFO:tasks.workunit.client.1.smithi194.stdout:8/429: fdatasync d2/d14/d18/d45/f95 0 2024-02-20T08:06:10.720 INFO:tasks.workunit.client.1.smithi194.stdout:7/515: creat d11/f99 x:0 0 0 2024-02-20T08:06:10.723 INFO:tasks.workunit.client.1.smithi194.stdout:6/592: symlink df/dab/d1d/d28/lc9 0 2024-02-20T08:06:10.724 INFO:tasks.workunit.client.1.smithi194.stdout:4/430: link d0/cd d0/df/d41/d69/c7d 0 2024-02-20T08:06:10.725 INFO:tasks.workunit.client.1.smithi194.stdout:4/431: write d0/d10/d1c/d21/f57 [1858817,130696] 0 2024-02-20T08:06:10.725 INFO:tasks.workunit.client.1.smithi194.stdout:7/516: rmdir d11/d2d/d38/d37/d43/d8e/d6b 39 2024-02-20T08:06:10.728 INFO:tasks.workunit.client.1.smithi194.stdout:6/593: rename df/dab/d1d/d28/db2 to df/dab/d1d/d28/d46/dca 0 2024-02-20T08:06:10.729 INFO:tasks.workunit.client.1.smithi194.stdout:6/594: write df/dab/d1d/d28/d2b/d94/d96/fc0 [482213,99234] 0 2024-02-20T08:06:10.729 INFO:tasks.workunit.client.1.smithi194.stdout:8/430: getdents d2/d14/d18/d45/d90 0 2024-02-20T08:06:10.732 INFO:tasks.workunit.client.1.smithi194.stdout:2/490: dread df/d14/f1d [4194304,4194304] 0 2024-02-20T08:06:10.733 INFO:tasks.workunit.client.1.smithi194.stdout:2/491: chown df/f41 1194 1 2024-02-20T08:06:10.736 INFO:tasks.workunit.client.1.smithi194.stdout:7/517: mkdir d11/d2d/d38/d4a/d93/d9a 0 2024-02-20T08:06:10.738 INFO:tasks.workunit.client.1.smithi194.stdout:4/432: rename d0/df/d72/c73 to d0/d10/d1c/d21/d62/c7e 0 2024-02-20T08:06:10.741 INFO:tasks.workunit.client.1.smithi194.stdout:6/595: truncate df/f3c 4091488 0 2024-02-20T08:06:10.742 INFO:tasks.workunit.client.1.smithi194.stdout:6/596: chown df/d42/cac 15 1 2024-02-20T08:06:10.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/438: dwrite d5/df/f11 [0,4194304] 0 2024-02-20T08:06:10.745 INFO:tasks.workunit.client.1.smithi194.stdout:6/597: write df/dab/d1d/d28/d46/d5a/fa2 [623899,54311] 0 2024-02-20T08:06:10.746 INFO:tasks.workunit.client.1.smithi194.stdout:2/492: dread df/d14/d24/d56/d6b/d81/f87 [0,4194304] 0 2024-02-20T08:06:10.749 INFO:tasks.workunit.client.1.smithi194.stdout:8/431: rename d2/d4d to d2/d14/d18/d45/d4e/d6c/d78/d98 0 2024-02-20T08:06:10.753 INFO:tasks.workunit.client.1.smithi194.stdout:2/493: dwrite df/d14/d24/f35 [0,4194304] 0 2024-02-20T08:06:10.759 INFO:tasks.workunit.client.1.smithi194.stdout:4/433: creat d0/f7f x:0 0 0 2024-02-20T08:06:10.760 INFO:tasks.workunit.client.1.smithi194.stdout:7/518: dwrite d11/d2d/d38/d37/f4f [0,4194304] 0 2024-02-20T08:06:10.763 INFO:tasks.workunit.client.1.smithi194.stdout:6/598: mkdir df/dab/d1d/d28/d46/d5a/d6b/dcb 0 2024-02-20T08:06:10.764 INFO:tasks.workunit.client.1.smithi194.stdout:2/494: mkdir df/d14/d19/d5c/d97/d9a 0 2024-02-20T08:06:10.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/599: chown df/dab/d1d/d28/d2b/d94/d96/fc0 4907 1 2024-02-20T08:06:10.765 INFO:tasks.workunit.client.1.smithi194.stdout:2/495: write df/f4f [3472147,99255] 0 2024-02-20T08:06:10.766 INFO:tasks.workunit.client.1.smithi194.stdout:7/519: creat d11/d2d/d38/d37/d43/d7b/f9b x:0 0 0 2024-02-20T08:06:10.766 INFO:tasks.workunit.client.1.smithi194.stdout:2/496: chown df/d5b 463967 1 2024-02-20T08:06:10.768 INFO:tasks.workunit.client.1.smithi194.stdout:7/520: write f5 [12196846,37921] 0 2024-02-20T08:06:10.768 INFO:tasks.workunit.client.1.smithi194.stdout:4/434: mknod d0/df/d18/d5e/c80 0 2024-02-20T08:06:10.772 INFO:tasks.workunit.client.1.smithi194.stdout:4/435: dread d0/f32 [0,4194304] 0 2024-02-20T08:06:10.776 INFO:tasks.workunit.client.1.smithi194.stdout:6/600: mkdir df/dab/dcc 0 2024-02-20T08:06:10.777 INFO:tasks.workunit.client.1.smithi194.stdout:3/439: write d5/f6 [4045065,38955] 0 2024-02-20T08:06:10.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/521: mkdir d11/d2d/d38/d37/d43/d7b/d91/d9c 0 2024-02-20T08:06:10.779 INFO:tasks.workunit.client.1.smithi194.stdout:3/440: chown d5/d10/d17/d1d/c68 24533 1 2024-02-20T08:06:10.781 INFO:tasks.workunit.client.1.smithi194.stdout:8/432: dwrite d2/d14/f4c [0,4194304] 0 2024-02-20T08:06:10.781 INFO:tasks.workunit.client.1.smithi194.stdout:7/522: fdatasync d11/d2d/d38/d37/d43/d7b/f9b 0 2024-02-20T08:06:10.783 INFO:tasks.workunit.client.1.smithi194.stdout:6/601: creat df/dab/d1d/d28/d2b/d94/d96/fcd x:0 0 0 2024-02-20T08:06:10.785 INFO:tasks.workunit.client.1.smithi194.stdout:8/433: write d2/d14/d18/d45/d4e/d6c/d78/d98/f6e [1736566,10890] 0 2024-02-20T08:06:10.785 INFO:tasks.workunit.client.1.smithi194.stdout:7/523: write d11/d2d/d38/d37/d43/d7b/d91/f98 [413828,76923] 0 2024-02-20T08:06:10.786 INFO:tasks.workunit.client.1.smithi194.stdout:4/436: truncate d0/df/f13 4261706 0 2024-02-20T08:06:10.787 INFO:tasks.workunit.client.1.smithi194.stdout:7/524: dread - d11/f8c zero size 2024-02-20T08:06:10.788 INFO:tasks.workunit.client.1.smithi194.stdout:4/437: dread - d0/d4f/f53 zero size 2024-02-20T08:06:10.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/441: dwrite d5/df/d30/f36 [4194304,4194304] 0 2024-02-20T08:06:10.790 INFO:tasks.workunit.client.1.smithi194.stdout:3/442: write d5/fe [5562997,77046] 0 2024-02-20T08:06:10.796 INFO:tasks.workunit.client.1.smithi194.stdout:2/497: dread df/d14/d24/d56/f7c [0,4194304] 0 2024-02-20T08:06:10.797 INFO:tasks.workunit.client.1.smithi194.stdout:8/434: creat d2/d14/d18/d45/d7b/f99 x:0 0 0 2024-02-20T08:06:10.830 INFO:tasks.workunit.client.1.smithi194.stdout:4/438: creat d0/df/d41/f81 x:0 0 0 2024-02-20T08:06:10.831 INFO:tasks.workunit.client.1.smithi194.stdout:3/443: symlink d5/d10/d28/d41/d73/l86 0 2024-02-20T08:06:10.831 INFO:tasks.workunit.client.1.smithi194.stdout:6/602: rename df/d42/l79 to df/d42/d86/lce 0 2024-02-20T08:06:10.833 INFO:tasks.workunit.client.1.smithi194.stdout:4/439: truncate d0/d2/d3e/f71 571264 0 2024-02-20T08:06:10.835 INFO:tasks.workunit.client.1.smithi194.stdout:2/498: rename df/d14/d24/l3d to df/d14/d19/d5c/d60/d63/d92/l9b 0 2024-02-20T08:06:10.835 INFO:tasks.workunit.client.1.smithi194.stdout:2/499: chown df/d14/d19/d5c/d78/l8d 43681 1 2024-02-20T08:06:10.839 INFO:tasks.workunit.client.1.smithi194.stdout:2/500: mknod df/d14/d19/d5c/d60/c9c 0 2024-02-20T08:06:10.842 INFO:tasks.workunit.client.1.smithi194.stdout:3/444: link d5/d10/d17/d1d/f1e d5/df/d75/f87 0 2024-02-20T08:06:10.843 INFO:tasks.workunit.client.1.smithi194.stdout:8/435: link d2/d14/d18/d45/d4e/d6c/d78/d98/f86 d2/d14/d18/d45/d4e/d6c/d78/d98/f9a 0 2024-02-20T08:06:10.845 INFO:tasks.workunit.client.1.smithi194.stdout:2/501: symlink df/d14/d19/d5c/d78/l9d 0 2024-02-20T08:06:10.846 INFO:tasks.workunit.client.1.smithi194.stdout:8/436: truncate d2/d14/d18/f48 443500 0 2024-02-20T08:06:10.848 INFO:tasks.workunit.client.1.smithi194.stdout:6/603: rename df/dab/d1d/d76 to df/d42/dcf 0 2024-02-20T08:06:10.849 INFO:tasks.workunit.client.1.smithi194.stdout:2/502: unlink df/d14/f6a 0 2024-02-20T08:06:10.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/440: rename d0/d4f/f53 to d0/d5c/f82 0 2024-02-20T08:06:10.859 INFO:tasks.workunit.client.1.smithi194.stdout:3/445: dread d5/d10/d28/d41/f5c [0,4194304] 0 2024-02-20T08:06:10.862 INFO:tasks.workunit.client.1.smithi194.stdout:6/604: link df/f5d df/dab/fd0 0 2024-02-20T08:06:10.863 INFO:tasks.workunit.client.1.smithi194.stdout:6/605: fdatasync df/d18/f40 0 2024-02-20T08:06:10.870 INFO:tasks.workunit.client.1.smithi194.stdout:0/451: sync 2024-02-20T08:06:10.870 INFO:tasks.workunit.client.1.smithi194.stdout:5/479: sync 2024-02-20T08:06:10.873 INFO:tasks.workunit.client.1.smithi194.stdout:2/503: getdents df/d14/d24/d56/d6b/d81 0 2024-02-20T08:06:10.873 INFO:tasks.workunit.client.1.smithi194.stdout:2/504: dread - df/d14/d24/d56/d6b/d81/f79 zero size 2024-02-20T08:06:10.874 INFO:tasks.workunit.client.1.smithi194.stdout:2/505: read - df/d5b/d61/f8b zero size 2024-02-20T08:06:10.883 INFO:tasks.workunit.client.1.smithi194.stdout:2/506: mkdir df/d14/d24/d56/d6b/d9e 0 2024-02-20T08:06:10.883 INFO:tasks.workunit.client.1.smithi194.stdout:2/507: readlink df/d14/d19/d5c/d60/d63/l68 0 2024-02-20T08:06:10.886 INFO:tasks.workunit.client.1.smithi194.stdout:4/441: write d0/f32 [1919172,30340] 0 2024-02-20T08:06:10.886 INFO:tasks.workunit.client.1.smithi194.stdout:4/442: chown d0/d10 1951605 1 2024-02-20T08:06:10.898 INFO:tasks.workunit.client.1.smithi194.stdout:3/446: write d5/df/d75/f87 [5044999,44886] 0 2024-02-20T08:06:10.899 INFO:tasks.workunit.client.1.smithi194.stdout:6/606: creat df/d18/fd1 x:0 0 0 2024-02-20T08:06:10.899 INFO:tasks.workunit.client.1.smithi194.stdout:0/452: symlink d6/d2b/d35/d42/d1e/l98 0 2024-02-20T08:06:10.900 INFO:tasks.workunit.client.1.smithi194.stdout:3/447: chown d5/d10/c7a 323755104 1 2024-02-20T08:06:10.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/443: read d0/d2/fe [930365,20678] 0 2024-02-20T08:06:10.902 INFO:tasks.workunit.client.1.smithi194.stdout:6/607: chown df/dab/d1d/d28/d5e/da7/fc1 190472 1 2024-02-20T08:06:10.904 INFO:tasks.workunit.client.1.smithi194.stdout:3/448: read d5/f8 [4556490,2526] 0 2024-02-20T08:06:10.906 INFO:tasks.workunit.client.1.smithi194.stdout:8/437: dwrite d2/d14/d18/f48 [0,4194304] 0 2024-02-20T08:06:10.910 INFO:tasks.workunit.client.1.smithi194.stdout:4/444: dwrite d0/df/d41/f66 [0,4194304] 0 2024-02-20T08:06:10.913 INFO:tasks.workunit.client.1.smithi194.stdout:2/508: truncate f5 7878107 0 2024-02-20T08:06:10.915 INFO:tasks.workunit.client.1.smithi194.stdout:0/453: dread d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:10.921 INFO:tasks.workunit.client.1.smithi194.stdout:8/438: mkdir d2/d14/d18/d45/d69/d9b 0 2024-02-20T08:06:10.921 INFO:tasks.workunit.client.1.smithi194.stdout:8/439: chown d2/d14/d18/d45/d4e/d6c/d78/d98 4915354 1 2024-02-20T08:06:10.925 INFO:tasks.workunit.client.1.smithi194.stdout:4/445: creat d0/d10/f83 x:0 0 0 2024-02-20T08:06:10.926 INFO:tasks.workunit.client.1.smithi194.stdout:1/498: sync 2024-02-20T08:06:10.926 INFO:tasks.workunit.client.1.smithi194.stdout:9/546: sync 2024-02-20T08:06:10.926 INFO:tasks.workunit.client.1.smithi194.stdout:7/525: sync 2024-02-20T08:06:10.927 INFO:tasks.workunit.client.1.smithi194.stdout:7/526: chown d11/l41 184680 1 2024-02-20T08:06:10.927 INFO:tasks.workunit.client.1.smithi194.stdout:9/547: truncate d4/d20/f80 1541448 0 2024-02-20T08:06:10.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/454: symlink d6/d2b/d35/d39/d55/d59/d77/l99 0 2024-02-20T08:06:10.935 INFO:tasks.workunit.client.1.smithi194.stdout:6/608: creat df/dab/d1d/fd2 x:0 0 0 2024-02-20T08:06:10.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/548: mkdir d4/d20/d41/db7 0 2024-02-20T08:06:10.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/549: stat d4/f7e 0 2024-02-20T08:06:10.938 INFO:tasks.workunit.client.1.smithi194.stdout:0/455: mknod d6/d2b/d35/d42/d1e/c9a 0 2024-02-20T08:06:10.940 INFO:tasks.workunit.client.1.smithi194.stdout:8/440: rename d2/c67 to d2/d14/d18/d45/c9c 0 2024-02-20T08:06:10.941 INFO:tasks.workunit.client.1.smithi194.stdout:3/449: truncate d5/d10/d17/f38 1892371 0 2024-02-20T08:06:10.945 INFO:tasks.workunit.client.1.smithi194.stdout:0/456: dwrite d6/f18 [4194304,4194304] 0 2024-02-20T08:06:10.946 INFO:tasks.workunit.client.1.smithi194.stdout:7/527: mkdir d11/d2d/d38/d4a/d27/d51/d77/d9d 0 2024-02-20T08:06:10.948 INFO:tasks.workunit.client.1.smithi194.stdout:4/446: creat d0/df/f84 x:0 0 0 2024-02-20T08:06:10.950 INFO:tasks.workunit.client.1.smithi194.stdout:1/499: dread d2/d1a/f1d [0,4194304] 0 2024-02-20T08:06:10.951 INFO:tasks.workunit.client.1.smithi194.stdout:4/447: dread d0/d2/d3e/f71 [0,4194304] 0 2024-02-20T08:06:10.952 INFO:tasks.workunit.client.1.smithi194.stdout:2/509: dwrite df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:10.954 INFO:tasks.workunit.client.1.smithi194.stdout:6/609: creat df/dab/dcc/fd3 x:0 0 0 2024-02-20T08:06:10.960 INFO:tasks.workunit.client.1.smithi194.stdout:8/441: truncate d2/f2e 679595 0 2024-02-20T08:06:10.963 INFO:tasks.workunit.client.1.smithi194.stdout:7/528: rmdir d11/d2d/d38/d37/d43/d8e 39 2024-02-20T08:06:10.973 INFO:tasks.workunit.client.1.smithi194.stdout:5/480: sync 2024-02-20T08:06:10.973 INFO:tasks.workunit.client.1.smithi194.stdout:2/510: unlink df/d14/d19/l1e 0 2024-02-20T08:06:10.973 INFO:tasks.workunit.client.1.smithi194.stdout:5/481: chown d4/fb 185979446 1 2024-02-20T08:06:10.975 INFO:tasks.workunit.client.1.smithi194.stdout:3/450: symlink d5/d10/l88 0 2024-02-20T08:06:10.976 INFO:tasks.workunit.client.1.smithi194.stdout:8/442: symlink d2/d14/d18/d45/d69/l9d 0 2024-02-20T08:06:10.977 INFO:tasks.workunit.client.1.smithi194.stdout:3/451: write d5/d10/d17/d1d/d56/f71 [612405,88261] 0 2024-02-20T08:06:10.977 INFO:tasks.workunit.client.1.smithi194.stdout:8/443: readlink d2/l89 0 2024-02-20T08:06:10.978 INFO:tasks.workunit.client.1.smithi194.stdout:5/482: dread d4/d20/d2b/f4b [0,4194304] 0 2024-02-20T08:06:10.978 INFO:tasks.workunit.client.1.smithi194.stdout:0/457: unlink d6/d2b/d35/d42/d1e/d3c/d43/d62/f8b 0 2024-02-20T08:06:10.979 INFO:tasks.workunit.client.1.smithi194.stdout:3/452: write d5/fa [123332,8348] 0 2024-02-20T08:06:10.979 INFO:tasks.workunit.client.1.smithi194.stdout:7/529: unlink d11/d2d/d38/d4a/c36 0 2024-02-20T08:06:10.983 INFO:tasks.workunit.client.1.smithi194.stdout:6/610: dread df/d18/f49 [0,4194304] 0 2024-02-20T08:06:10.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/611: readlink df/dab/d1d/d28/lc9 0 2024-02-20T08:06:10.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/511: creat df/d14/d19/d5c/f9f x:0 0 0 2024-02-20T08:06:10.990 INFO:tasks.workunit.client.1.smithi194.stdout:1/500: write d2/d1a/d26/f40 [8166649,100320] 0 2024-02-20T08:06:10.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/483: write d4/d20/d2b/f43 [4146664,92620] 0 2024-02-20T08:06:10.995 INFO:tasks.workunit.client.1.smithi194.stdout:0/458: dread d6/d2b/d35/d42/d1e/f3f [0,4194304] 0 2024-02-20T08:06:10.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/459: chown d6/c14 197748 1 2024-02-20T08:06:10.996 INFO:tasks.workunit.client.1.smithi194.stdout:9/550: rename d4/de/f27 to d4/d37/fb8 0 2024-02-20T08:06:11.001 INFO:tasks.workunit.client.1.smithi194.stdout:7/530: dwrite d11/d2d/d38/d4a/d27/f2b [0,4194304] 0 2024-02-20T08:06:11.002 INFO:tasks.workunit.client.1.smithi194.stdout:6/612: mkdir df/dab/d1d/d28/d46/d5a/d7d/dd4 0 2024-02-20T08:06:11.002 INFO:tasks.workunit.client.1.smithi194.stdout:2/512: symlink df/d5b/d61/la0 0 2024-02-20T08:06:11.005 INFO:tasks.workunit.client.1.smithi194.stdout:1/501: symlink d2/la3 0 2024-02-20T08:06:11.007 INFO:tasks.workunit.client.1.smithi194.stdout:5/484: mkdir d4/d6/d11/d2f/d77/d90 0 2024-02-20T08:06:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:10 smithi123 ceph-mon[29383]: pgmap v54: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 129 MiB/s wr, 388 op/s 2024-02-20T08:06:11.009 INFO:tasks.workunit.client.1.smithi194.stdout:0/460: stat d6/d2b/d35/d48/f4a 0 2024-02-20T08:06:11.013 INFO:tasks.workunit.client.1.smithi194.stdout:4/448: getdents d0/df/d41 0 2024-02-20T08:06:11.014 INFO:tasks.workunit.client.1.smithi194.stdout:7/531: mknod d11/d6e/c9e 0 2024-02-20T08:06:11.015 INFO:tasks.workunit.client.1.smithi194.stdout:6/613: symlink df/dab/d1d/d28/d2b/d80/ld5 0 2024-02-20T08:06:11.016 INFO:tasks.workunit.client.1.smithi194.stdout:8/444: creat d2/f9e x:0 0 0 2024-02-20T08:06:11.018 INFO:tasks.workunit.client.1.smithi194.stdout:0/461: unlink d6/d2b/d35/d42/d1e/l84 0 2024-02-20T08:06:11.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/449: rename d0/d10/d1c/d63/c65 to d0/d10/d1c/d21/d46/c85 0 2024-02-20T08:06:11.020 INFO:tasks.workunit.client.1.smithi194.stdout:7/532: write d11/d2d/d38/d37/d3c/f42 [512260,62234] 0 2024-02-20T08:06:11.021 INFO:tasks.workunit.client.1.smithi194.stdout:5/485: symlink d4/d6/dd/d25/d7d/l91 0 2024-02-20T08:06:11.022 INFO:tasks.workunit.client.1.smithi194.stdout:7/533: fdatasync d11/d2d/d38/f22 0 2024-02-20T08:06:11.023 INFO:tasks.workunit.client.1.smithi194.stdout:5/486: chown d4/d6/d11/d2f/d77/c61 243 1 2024-02-20T08:06:11.024 INFO:tasks.workunit.client.1.smithi194.stdout:9/551: creat d4/d20/fb9 x:0 0 0 2024-02-20T08:06:11.025 INFO:tasks.workunit.client.1.smithi194.stdout:9/552: fsync d4/d1b/f74 0 2024-02-20T08:06:11.026 INFO:tasks.workunit.client.1.smithi194.stdout:4/450: creat d0/d10/d1c/d21/d46/f86 x:0 0 0 2024-02-20T08:06:11.026 INFO:tasks.workunit.client.1.smithi194.stdout:6/614: symlink df/dab/d1d/d28/d2b/ld6 0 2024-02-20T08:06:11.029 INFO:tasks.workunit.client.1.smithi194.stdout:8/445: mkdir d2/d14/d18/d45/d4e/d9f 0 2024-02-20T08:06:11.030 INFO:tasks.workunit.client.1.smithi194.stdout:0/462: mknod d6/d2b/d35/d42/d1e/d3c/d43/c9b 0 2024-02-20T08:06:11.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/446: write d2/d14/d18/f27 [698157,24096] 0 2024-02-20T08:06:11.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/534: dwrite d11/d2d/d38/d4a/d27/d51/d84/f3d [4194304,4194304] 0 2024-02-20T08:06:11.033 INFO:tasks.workunit.client.1.smithi194.stdout:5/487: mknod d4/d6/dd/d25/d78/c92 0 2024-02-20T08:06:11.034 INFO:tasks.workunit.client.1.smithi194.stdout:8/447: chown d2/d14/d18/l77 15189196 1 2024-02-20T08:06:11.035 INFO:tasks.workunit.client.1.smithi194.stdout:5/488: read - d4/d6/d11/f8d zero size 2024-02-20T08:06:11.035 INFO:tasks.workunit.client.1.smithi194.stdout:7/535: chown d11/d2d/d38/d4a/d60/f7d 30593 1 2024-02-20T08:06:11.035 INFO:tasks.workunit.client.1.smithi194.stdout:6/615: unlink df/d42/dcf/l8f 0 2024-02-20T08:06:11.039 INFO:tasks.workunit.client.1.smithi194.stdout:2/513: dread fc [0,4194304] 0 2024-02-20T08:06:11.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/502: chown d2/d1a/d26/d3d/d71/d8c/c7b 306268104 1 2024-02-20T08:06:11.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/536: truncate d11/d2d/d38/d4a/d60/f64 1031145 0 2024-02-20T08:06:11.048 INFO:tasks.workunit.client.1.smithi194.stdout:2/514: unlink df/d3a/f43 0 2024-02-20T08:06:11.049 INFO:tasks.workunit.client.1.smithi194.stdout:2/515: fdatasync fe 0 2024-02-20T08:06:11.051 INFO:tasks.workunit.client.1.smithi194.stdout:0/463: truncate d6/d2b/d35/d39/f67 1082853 0 2024-02-20T08:06:11.060 INFO:tasks.workunit.client.1.smithi194.stdout:5/489: mknod d4/d6/dd/d25/d78/d8b/d8a/c93 0 2024-02-20T08:06:11.063 INFO:tasks.workunit.client.1.smithi194.stdout:2/516: mkdir df/d14/d19/da1 0 2024-02-20T08:06:11.064 INFO:tasks.workunit.client.1.smithi194.stdout:1/503: unlink d2/d8/f3b 0 2024-02-20T08:06:11.066 INFO:tasks.workunit.client.1.smithi194.stdout:9/553: rename d4/d1b/l78 to d4/d20/lba 0 2024-02-20T08:06:11.067 INFO:tasks.workunit.client.1.smithi194.stdout:8/448: rmdir d2/d14/d18/d45/d7b/d8e 0 2024-02-20T08:06:11.067 INFO:tasks.workunit.client.1.smithi194.stdout:9/554: write d4/d20/f87 [3964534,28856] 0 2024-02-20T08:06:11.069 INFO:tasks.workunit.client.1.smithi194.stdout:9/555: truncate d4/d37/d38/faf 467068 0 2024-02-20T08:06:11.073 INFO:tasks.workunit.client.1.smithi194.stdout:1/504: creat d2/d1a/d61/d7e/fa4 x:0 0 0 2024-02-20T08:06:11.075 INFO:tasks.workunit.client.1.smithi194.stdout:8/449: dwrite d2/d14/d18/d45/d90/f93 [0,4194304] 0 2024-02-20T08:06:11.077 INFO:tasks.workunit.client.1.smithi194.stdout:0/464: rename d6/d2b/d35/d42/d1e/d3c/d43 to d6/d2b/d35/d9c 0 2024-02-20T08:06:11.078 INFO:tasks.workunit.client.1.smithi194.stdout:6/616: getdents df/d42/dcf 0 2024-02-20T08:06:11.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/517: dread df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:11.082 INFO:tasks.workunit.client.1.smithi194.stdout:2/518: chown df/d14/d24/c29 20 1 2024-02-20T08:06:11.092 INFO:tasks.workunit.client.1.smithi194.stdout:8/450: symlink d2/d14/d18/d45/d90/la0 0 2024-02-20T08:06:11.092 INFO:tasks.workunit.client.1.smithi194.stdout:0/465: write d6/d2b/d35/d39/d8f/f95 [5691707,5927] 0 2024-02-20T08:06:11.092 INFO:tasks.workunit.client.1.smithi194.stdout:0/466: write d6/d2b/d35/d39/d55/f69 [1075754,26180] 0 2024-02-20T08:06:11.093 INFO:tasks.workunit.client.1.smithi194.stdout:2/519: mkdir df/d14/d24/d56/da2 0 2024-02-20T08:06:11.093 INFO:tasks.workunit.client.1.smithi194.stdout:2/520: chown df/d14/d19/c4b 3127 1 2024-02-20T08:06:11.095 INFO:tasks.workunit.client.1.smithi194.stdout:0/467: mkdir d6/d2b/d35/d39/d55/d59/d77/d9d 0 2024-02-20T08:06:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:10 smithi194 ceph-mon[37804]: pgmap v54: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 129 MiB/s wr, 388 op/s 2024-02-20T08:06:11.146 INFO:tasks.workunit.client.1.smithi194.stdout:3/453: sync 2024-02-20T08:06:11.149 INFO:tasks.workunit.client.1.smithi194.stdout:1/505: creat d2/d1a/d26/fa5 x:0 0 0 2024-02-20T08:06:11.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/490: dwrite d4/d6/d11/d2f/f52 [0,4194304] 0 2024-02-20T08:06:11.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/617: truncate df/d42/dcf/f8d 894697 0 2024-02-20T08:06:11.150 INFO:tasks.workunit.client.1.smithi194.stdout:2/521: dwrite df/d14/f47 [0,4194304] 0 2024-02-20T08:06:11.151 INFO:tasks.workunit.client.1.smithi194.stdout:3/454: readlink d5/df/d25/l4b 0 2024-02-20T08:06:11.152 INFO:tasks.workunit.client.1.smithi194.stdout:8/451: truncate d2/f39 1515826 0 2024-02-20T08:06:11.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/618: dread - df/f92 zero size 2024-02-20T08:06:11.152 INFO:tasks.workunit.client.1.smithi194.stdout:1/506: dread - d2/d1a/d26/d45/f6e zero size 2024-02-20T08:06:11.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/491: write d4/d20/d2b/f2c [4708164,46522] 0 2024-02-20T08:06:11.158 INFO:tasks.workunit.client.1.smithi194.stdout:8/452: mknod d2/d14/ca1 0 2024-02-20T08:06:11.159 INFO:tasks.workunit.client.1.smithi194.stdout:0/468: dread d6/f29 [0,4194304] 0 2024-02-20T08:06:11.162 INFO:tasks.workunit.client.1.smithi194.stdout:3/455: rename d5/df/f11 to d5/df/d30/d80/f89 0 2024-02-20T08:06:11.164 INFO:tasks.workunit.client.1.smithi194.stdout:5/492: dread d4/fb [4194304,4194304] 0 2024-02-20T08:06:11.165 INFO:tasks.workunit.client.1.smithi194.stdout:3/456: read d5/d10/d16/f2d [914589,9762] 0 2024-02-20T08:06:11.165 INFO:tasks.workunit.client.1.smithi194.stdout:5/493: dread - d4/d6/f7c zero size 2024-02-20T08:06:11.170 INFO:tasks.workunit.client.1.smithi194.stdout:1/507: rename d2/d1a/d26/d3d/d71/d8c/d34/f4c to d2/d1a/d26/d45/fa6 0 2024-02-20T08:06:11.174 INFO:tasks.workunit.client.1.smithi194.stdout:5/494: creat d4/d6/d11/d2f/f94 x:0 0 0 2024-02-20T08:06:11.176 INFO:tasks.workunit.client.1.smithi194.stdout:1/508: readlink d2/d48/l8e 0 2024-02-20T08:06:11.176 INFO:tasks.workunit.client.1.smithi194.stdout:1/509: readlink d2/d1a/d61/d7d/l8f 0 2024-02-20T08:06:11.177 INFO:tasks.workunit.client.1.smithi194.stdout:3/457: dwrite d5/df/f24 [4194304,4194304] 0 2024-02-20T08:06:11.186 INFO:tasks.workunit.client.1.smithi194.stdout:5/495: symlink d4/d6/l95 0 2024-02-20T08:06:11.186 INFO:tasks.workunit.client.1.smithi194.stdout:5/496: fsync d4/fc 0 2024-02-20T08:06:11.189 INFO:tasks.workunit.client.1.smithi194.stdout:1/510: creat d2/d8/d60/fa7 x:0 0 0 2024-02-20T08:06:11.189 INFO:tasks.workunit.client.1.smithi194.stdout:1/511: chown d2/d1a/d61/d68/f89 483 1 2024-02-20T08:06:11.191 INFO:tasks.workunit.client.1.smithi194.stdout:2/522: getdents df/d14/d19/d5c/d60/d63/d92 0 2024-02-20T08:06:11.191 INFO:tasks.workunit.client.1.smithi194.stdout:1/512: read - d2/d1a/d26/d45/f6e zero size 2024-02-20T08:06:11.192 INFO:tasks.workunit.client.1.smithi194.stdout:6/619: dread df/d18/f33 [0,4194304] 0 2024-02-20T08:06:11.192 INFO:tasks.workunit.client.1.smithi194.stdout:2/523: write df/f21 [3800589,57544] 0 2024-02-20T08:06:11.193 INFO:tasks.workunit.client.1.smithi194.stdout:8/453: write d2/d14/d18/f27 [1009716,53632] 0 2024-02-20T08:06:11.194 INFO:tasks.workunit.client.1.smithi194.stdout:8/454: write d2/fa [5151811,72835] 0 2024-02-20T08:06:11.196 INFO:tasks.workunit.client.1.smithi194.stdout:0/469: getdents d6 0 2024-02-20T08:06:11.198 INFO:tasks.workunit.client.1.smithi194.stdout:5/497: fsync d4/d6/dd/d25/f59 0 2024-02-20T08:06:11.199 INFO:tasks.workunit.client.1.smithi194.stdout:2/524: dread df/d14/d24/f35 [0,4194304] 0 2024-02-20T08:06:11.201 INFO:tasks.workunit.client.1.smithi194.stdout:5/498: truncate d4/d6/dd/d25/f29 4744003 0 2024-02-20T08:06:11.203 INFO:tasks.workunit.client.1.smithi194.stdout:2/525: dread fc [0,4194304] 0 2024-02-20T08:06:11.203 INFO:tasks.workunit.client.1.smithi194.stdout:1/513: unlink d2/d1a/d61/d68/f7c 0 2024-02-20T08:06:11.204 INFO:tasks.workunit.client.1.smithi194.stdout:2/526: write df/d14/d24/f99 [1001892,71030] 0 2024-02-20T08:06:11.205 INFO:tasks.workunit.client.1.smithi194.stdout:5/499: dread d4/d20/d2b/d79/f60 [0,4194304] 0 2024-02-20T08:06:11.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/455: stat d2/d14/f15 0 2024-02-20T08:06:11.209 INFO:tasks.workunit.client.1.smithi194.stdout:3/458: dread d5/d10/d17/d1d/f1e [0,4194304] 0 2024-02-20T08:06:11.210 INFO:tasks.workunit.client.1.smithi194.stdout:5/500: dread d4/d6/f1f [0,4194304] 0 2024-02-20T08:06:11.218 INFO:tasks.workunit.client.1.smithi194.stdout:8/456: write d2/d14/f6a [5190919,117164] 0 2024-02-20T08:06:11.219 INFO:tasks.workunit.client.1.smithi194.stdout:0/470: getdents d6/d2b/d35/d42/d97 0 2024-02-20T08:06:11.220 INFO:tasks.workunit.client.1.smithi194.stdout:8/457: chown d2/d14/d18/d45/d90 532000 1 2024-02-20T08:06:11.222 INFO:tasks.workunit.client.1.smithi194.stdout:2/527: write fc [7072030,112595] 0 2024-02-20T08:06:11.222 INFO:tasks.workunit.client.1.smithi194.stdout:3/459: rename d5/df/d77 to d5/d10/d16/d8a 0 2024-02-20T08:06:11.223 INFO:tasks.workunit.client.1.smithi194.stdout:2/528: chown df/d14/d24/d56/c98 12745 1 2024-02-20T08:06:11.223 INFO:tasks.workunit.client.1.smithi194.stdout:2/529: stat df/l33 0 2024-02-20T08:06:11.226 INFO:tasks.workunit.client.1.smithi194.stdout:3/460: dread d5/d10/d28/d41/f5c [0,4194304] 0 2024-02-20T08:06:11.227 INFO:tasks.workunit.client.1.smithi194.stdout:1/514: dread d2/f42 [0,4194304] 0 2024-02-20T08:06:11.231 INFO:tasks.workunit.client.1.smithi194.stdout:8/458: write d2/d14/f2c [795892,34875] 0 2024-02-20T08:06:11.232 INFO:tasks.workunit.client.1.smithi194.stdout:8/459: read - d2/d14/d18/d45/f6b zero size 2024-02-20T08:06:11.232 INFO:tasks.workunit.client.1.smithi194.stdout:1/515: dwrite d2/d1a/d26/d3d/d71/d8c/d34/f50 [0,4194304] 0 2024-02-20T08:06:11.233 INFO:tasks.workunit.client.1.smithi194.stdout:0/471: creat d6/d2b/d35/d42/d1e/d45/d58/f9e x:0 0 0 2024-02-20T08:06:11.242 INFO:tasks.workunit.client.1.smithi194.stdout:5/501: truncate d4/d6/d11/d15/d28/d85/d53/f64 3403648 0 2024-02-20T08:06:11.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/461: truncate d5/d10/d16/f2d 2273615 0 2024-02-20T08:06:11.247 INFO:tasks.workunit.client.1.smithi194.stdout:3/462: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:11.268 INFO:tasks.workunit.client.1.smithi194.stdout:2/530: creat df/d14/d19/d5c/d97/d9a/fa3 x:0 0 0 2024-02-20T08:06:11.268 INFO:tasks.workunit.client.1.smithi194.stdout:5/502: mknod d4/d6/c96 0 2024-02-20T08:06:11.269 INFO:tasks.workunit.client.1.smithi194.stdout:1/516: dread d2/d1a/d26/d3d/d71/d8c/d34/f44 [0,4194304] 0 2024-02-20T08:06:11.274 INFO:tasks.workunit.client.1.smithi194.stdout:0/472: truncate d6/d2b/d35/d42/d1e/f27 1535249 0 2024-02-20T08:06:11.280 INFO:tasks.workunit.client.1.smithi194.stdout:0/473: dwrite d6/d2b/d35/d42/d1e/f2e [0,4194304] 0 2024-02-20T08:06:11.284 INFO:tasks.workunit.client.1.smithi194.stdout:5/503: truncate d4/d6/dd/d25/f59 1875073 0 2024-02-20T08:06:11.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/531: dwrite df/d14/f66 [0,4194304] 0 2024-02-20T08:06:11.285 INFO:tasks.workunit.client.1.smithi194.stdout:1/517: mknod d2/d1a/d26/d45/ca8 0 2024-02-20T08:06:11.286 INFO:tasks.workunit.client.1.smithi194.stdout:1/518: chown d2/d8/d60/d75 13997262 1 2024-02-20T08:06:11.291 INFO:tasks.workunit.client.1.smithi194.stdout:2/532: mknod df/d14/d19/d5c/d97/d9a/ca4 0 2024-02-20T08:06:11.292 INFO:tasks.workunit.client.1.smithi194.stdout:5/504: symlink d4/d6/dd/d25/d78/d8b/l97 0 2024-02-20T08:06:11.296 INFO:tasks.workunit.client.1.smithi194.stdout:5/505: dread - d4/d20/d2b/d79/f8e zero size 2024-02-20T08:06:11.296 INFO:tasks.workunit.client.1.smithi194.stdout:1/519: rename d2/d1a/d26/f32 to d2/d1a/d61/fa9 0 2024-02-20T08:06:11.296 INFO:tasks.workunit.client.1.smithi194.stdout:3/463: dread d5/df/d30/f36 [0,4194304] 0 2024-02-20T08:06:11.305 INFO:tasks.workunit.client.1.smithi194.stdout:2/533: write df/d14/d24/d56/f7c [2877981,42828] 0 2024-02-20T08:06:11.311 INFO:tasks.workunit.client.1.smithi194.stdout:5/506: creat d4/d6/dd/d25/d78/f98 x:0 0 0 2024-02-20T08:06:11.312 INFO:tasks.workunit.client.1.smithi194.stdout:1/520: unlink d2/d1a/f9a 0 2024-02-20T08:06:11.313 INFO:tasks.workunit.client.1.smithi194.stdout:1/521: dread - d2/d1a/d26/d57/f90 zero size 2024-02-20T08:06:11.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/534: rename df/d5b/d61/l6f to df/d5b/d61/la5 0 2024-02-20T08:06:11.318 INFO:tasks.workunit.client.1.smithi194.stdout:0/474: truncate d6/d2b/f50 1211996 0 2024-02-20T08:06:11.319 INFO:tasks.workunit.client.1.smithi194.stdout:1/522: symlink d2/d1a/d26/d3d/d82/laa 0 2024-02-20T08:06:11.320 INFO:tasks.workunit.client.1.smithi194.stdout:1/523: chown d2/d1a/d26/l87 3067 1 2024-02-20T08:06:11.321 INFO:tasks.workunit.client.1.smithi194.stdout:2/535: dwrite df/d14/d80/d85/f86 [0,4194304] 0 2024-02-20T08:06:11.323 INFO:tasks.workunit.client.1.smithi194.stdout:1/524: truncate d2/d1a/d26/d57/d58/f73 594242 0 2024-02-20T08:06:11.326 INFO:tasks.workunit.client.1.smithi194.stdout:3/464: mkdir d5/d10/d17/d1d/d3d/d8b 0 2024-02-20T08:06:11.330 INFO:tasks.workunit.client.1.smithi194.stdout:5/507: mkdir d4/d6/dd/d99 0 2024-02-20T08:06:11.331 INFO:tasks.workunit.client.1.smithi194.stdout:6/620: sync 2024-02-20T08:06:11.331 INFO:tasks.workunit.client.1.smithi194.stdout:4/451: sync 2024-02-20T08:06:11.331 INFO:tasks.workunit.client.1.smithi194.stdout:7/537: sync 2024-02-20T08:06:11.331 INFO:tasks.workunit.client.1.smithi194.stdout:9/556: sync 2024-02-20T08:06:11.331 INFO:tasks.workunit.client.1.smithi194.stdout:9/557: chown d4/d37/d4f 113159 1 2024-02-20T08:06:11.335 INFO:tasks.workunit.client.1.smithi194.stdout:1/525: mknod d2/d1a/d61/d7e/cab 0 2024-02-20T08:06:11.336 INFO:tasks.workunit.client.1.smithi194.stdout:3/465: mkdir d5/d10/d28/d41/d73/d8c 0 2024-02-20T08:06:11.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/508: dwrite d4/d6/dd/d25/d78/d8b/f24 [4194304,4194304] 0 2024-02-20T08:06:11.347 INFO:tasks.workunit.client.1.smithi194.stdout:9/558: rename d4/de/f16 to d4/d20/d43/daa/fbb 0 2024-02-20T08:06:11.347 INFO:tasks.workunit.client.1.smithi194.stdout:9/559: write d4/d20/d5c/f24 [306406,22458] 0 2024-02-20T08:06:11.350 INFO:tasks.workunit.client.1.smithi194.stdout:0/475: mkdir d6/d2b/d35/d9c/d9f 0 2024-02-20T08:06:11.350 INFO:tasks.workunit.client.1.smithi194.stdout:0/476: chown d6/f1a 82306067 1 2024-02-20T08:06:11.355 INFO:tasks.workunit.client.1.smithi194.stdout:1/526: unlink d2/d1a/d26/d3d/d71/d8c/d77/c96 0 2024-02-20T08:06:11.359 INFO:tasks.workunit.client.1.smithi194.stdout:7/538: creat d11/d2d/d38/d37/d43/d8e/d5e/f9f x:0 0 0 2024-02-20T08:06:11.360 INFO:tasks.workunit.client.1.smithi194.stdout:7/539: write d11/f12 [9920481,102389] 0 2024-02-20T08:06:11.362 INFO:tasks.workunit.client.1.smithi194.stdout:3/466: dwrite d5/df/d30/f36 [8388608,4194304] 0 2024-02-20T08:06:11.364 INFO:tasks.workunit.client.1.smithi194.stdout:5/509: creat d4/d6/dd/d3a/f9a x:0 0 0 2024-02-20T08:06:11.368 INFO:tasks.workunit.client.1.smithi194.stdout:2/536: truncate df/d14/d24/f2d 3865701 0 2024-02-20T08:06:11.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/537: read fc [4634087,17664] 0 2024-02-20T08:06:11.379 INFO:tasks.workunit.client.1.smithi194.stdout:5/510: mkdir d4/d20/d2b/d9b 0 2024-02-20T08:06:11.380 INFO:tasks.workunit.client.1.smithi194.stdout:1/527: dwrite d2/f84 [0,4194304] 0 2024-02-20T08:06:11.381 INFO:tasks.workunit.client.1.smithi194.stdout:7/540: dread fd [4194304,4194304] 0 2024-02-20T08:06:11.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/452: rmdir d0/d10/d1c/d63 0 2024-02-20T08:06:11.382 INFO:tasks.workunit.client.1.smithi194.stdout:7/541: dread - d11/d2d/d38/d4a/d27/f76 zero size 2024-02-20T08:06:11.386 INFO:tasks.workunit.client.1.smithi194.stdout:2/538: unlink df/d14/d24/f35 0 2024-02-20T08:06:11.389 INFO:tasks.workunit.client.1.smithi194.stdout:9/560: symlink d4/d1b/d2e/lbc 0 2024-02-20T08:06:11.390 INFO:tasks.workunit.client.1.smithi194.stdout:0/477: mkdir d6/d2b/d35/d42/d1e/d3c/da0 0 2024-02-20T08:06:11.391 INFO:tasks.workunit.client.1.smithi194.stdout:6/621: getdents df/d42/da8 0 2024-02-20T08:06:11.392 INFO:tasks.workunit.client.1.smithi194.stdout:6/622: write df/d42/f65 [2216203,88207] 0 2024-02-20T08:06:11.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/623: dread df/dab/d1d/d28/d46/d5a/d6b/f85 [0,4194304] 0 2024-02-20T08:06:11.397 INFO:tasks.workunit.client.1.smithi194.stdout:1/528: stat d2/l31 0 2024-02-20T08:06:11.397 INFO:tasks.workunit.client.1.smithi194.stdout:8/460: sync 2024-02-20T08:06:11.398 INFO:tasks.workunit.client.1.smithi194.stdout:5/511: symlink d4/d6/dd/d3a/l9c 0 2024-02-20T08:06:11.398 INFO:tasks.workunit.client.1.smithi194.stdout:6/624: write df/dab/d1d/d28/d46/d5a/f64 [1435605,85482] 0 2024-02-20T08:06:11.404 INFO:tasks.workunit.client.1.smithi194.stdout:5/512: dwrite d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:11.405 INFO:tasks.workunit.client.1.smithi194.stdout:6/625: dwrite df/d18/f81 [0,4194304] 0 2024-02-20T08:06:11.405 INFO:tasks.workunit.client.1.smithi194.stdout:2/539: fdatasync df/d14/d24/f4e 0 2024-02-20T08:06:11.418 INFO:tasks.workunit.client.1.smithi194.stdout:0/478: truncate d6/d2b/d35/d42/f30 5033989 0 2024-02-20T08:06:11.418 INFO:tasks.workunit.client.1.smithi194.stdout:6/626: dwrite df/d42/d86/fb8 [0,4194304] 0 2024-02-20T08:06:11.419 INFO:tasks.workunit.client.1.smithi194.stdout:7/542: mkdir d11/d2d/d38/d4a/d53/da0 0 2024-02-20T08:06:11.420 INFO:tasks.workunit.client.1.smithi194.stdout:9/561: dread d4/d1b/d2e/f30 [0,4194304] 0 2024-02-20T08:06:11.422 INFO:tasks.workunit.client.1.smithi194.stdout:6/627: truncate df/dab/d1d/d28/d46/d5a/fa2 787599 0 2024-02-20T08:06:11.428 INFO:tasks.workunit.client.1.smithi194.stdout:0/479: dread d6/d2b/d35/d39/d55/f69 [0,4194304] 0 2024-02-20T08:06:11.429 INFO:tasks.workunit.client.1.smithi194.stdout:0/480: write d6/f1a [1175862,123974] 0 2024-02-20T08:06:11.433 INFO:tasks.workunit.client.1.smithi194.stdout:5/513: dread d4/d20/d2b/f43 [0,4194304] 0 2024-02-20T08:06:11.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/467: getdents d5/d10/d16/d7b 0 2024-02-20T08:06:11.446 INFO:tasks.workunit.client.1.smithi194.stdout:9/562: truncate d4/d1b/f36 5256972 0 2024-02-20T08:06:11.447 INFO:tasks.workunit.client.1.smithi194.stdout:6/628: creat df/dab/d1d/d28/d46/fd7 x:0 0 0 2024-02-20T08:06:11.453 INFO:tasks.workunit.client.1.smithi194.stdout:5/514: fdatasync d4/d6/f48 0 2024-02-20T08:06:11.455 INFO:tasks.workunit.client.1.smithi194.stdout:4/453: getdents d0/d10/d1c/d21 0 2024-02-20T08:06:11.458 INFO:tasks.workunit.client.1.smithi194.stdout:6/629: fsync df/d18/f33 0 2024-02-20T08:06:11.460 INFO:tasks.workunit.client.1.smithi194.stdout:5/515: symlink d4/d6/dd/d3a/l9d 0 2024-02-20T08:06:11.461 INFO:tasks.workunit.client.1.smithi194.stdout:8/461: dwrite d2/f39 [0,4194304] 0 2024-02-20T08:06:11.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/516: write d4/f12 [669561,83520] 0 2024-02-20T08:06:11.463 INFO:tasks.workunit.client.1.smithi194.stdout:9/563: truncate d4/d37/d4f/d91/f9c 3971372 0 2024-02-20T08:06:11.464 INFO:tasks.workunit.client.1.smithi194.stdout:0/481: creat d6/d2b/d35/d48/fa1 x:0 0 0 2024-02-20T08:06:11.465 INFO:tasks.workunit.client.1.smithi194.stdout:7/543: dwrite d11/d2d/d38/f28 [4194304,4194304] 0 2024-02-20T08:06:11.466 INFO:tasks.workunit.client.1.smithi194.stdout:7/544: fsync d11/d2d/d38/f22 0 2024-02-20T08:06:11.467 INFO:tasks.workunit.client.1.smithi194.stdout:6/630: symlink df/dab/d1d/d28/d46/dca/ld8 0 2024-02-20T08:06:11.472 INFO:tasks.workunit.client.1.smithi194.stdout:9/564: dwrite d4/d20/d5c/f46 [0,4194304] 0 2024-02-20T08:06:11.483 INFO:tasks.workunit.client.1.smithi194.stdout:7/545: dwrite d11/d2d/d38/d37/d43/d8e/d5e/f6a [4194304,4194304] 0 2024-02-20T08:06:11.483 INFO:tasks.workunit.client.1.smithi194.stdout:2/540: dwrite df/d5b/d61/f89 [4194304,4194304] 0 2024-02-20T08:06:11.483 INFO:tasks.workunit.client.1.smithi194.stdout:5/517: creat d4/d6/dd/d3a/f9e x:0 0 0 2024-02-20T08:06:11.483 INFO:tasks.workunit.client.1.smithi194.stdout:8/462: chown d2/d14/f2b 7 1 2024-02-20T08:06:11.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/482: mkdir d6/d2b/d35/d42/d1e/da2 0 2024-02-20T08:06:11.485 INFO:tasks.workunit.client.1.smithi194.stdout:5/518: stat d4/d6/dd/d3a/l6d 0 2024-02-20T08:06:11.485 INFO:tasks.workunit.client.1.smithi194.stdout:2/541: chown df/d14/d19/d5c/d97/d9a/fa3 1 1 2024-02-20T08:06:11.486 INFO:tasks.workunit.client.1.smithi194.stdout:7/546: fdatasync d11/d2d/d38/d4a/d53/f61 0 2024-02-20T08:06:11.489 INFO:tasks.workunit.client.1.smithi194.stdout:6/631: symlink df/dab/d1d/d28/ld9 0 2024-02-20T08:06:11.492 INFO:tasks.workunit.client.1.smithi194.stdout:2/542: dwrite df/f4f [0,4194304] 0 2024-02-20T08:06:11.494 INFO:tasks.workunit.client.1.smithi194.stdout:8/463: fsync d2/d14/d18/d45/d4e/f5e 0 2024-02-20T08:06:11.499 INFO:tasks.workunit.client.1.smithi194.stdout:4/454: getdents d0/df/d18/d5e 0 2024-02-20T08:06:11.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/468: truncate d5/d10/d28/d41/f5c 4138598 0 2024-02-20T08:06:11.500 INFO:tasks.workunit.client.1.smithi194.stdout:4/455: fsync d0/f32 0 2024-02-20T08:06:11.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/543: dwrite df/f21 [0,4194304] 0 2024-02-20T08:06:11.505 INFO:tasks.workunit.client.1.smithi194.stdout:5/519: rename d4/d20/d2b/f43 to d4/f9f 0 2024-02-20T08:06:11.506 INFO:tasks.workunit.client.1.smithi194.stdout:7/547: write d11/f14 [3216276,112040] 0 2024-02-20T08:06:11.507 INFO:tasks.workunit.client.1.smithi194.stdout:5/520: stat d4/d6/dd/d25 0 2024-02-20T08:06:11.510 INFO:tasks.workunit.client.1.smithi194.stdout:5/521: chown d4/d6/dd/d3a/l9d 8905 1 2024-02-20T08:06:11.510 INFO:tasks.workunit.client.1.smithi194.stdout:7/548: read d11/d2d/d38/d37/d43/d8e/d5e/f6a [4360521,110763] 0 2024-02-20T08:06:11.515 INFO:tasks.workunit.client.1.smithi194.stdout:2/544: dread df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:11.516 INFO:tasks.workunit.client.1.smithi194.stdout:0/483: fsync d6/d2b/d35/f4c 0 2024-02-20T08:06:11.533 INFO:tasks.workunit.client.1.smithi194.stdout:6/632: dread df/dab/d1d/d28/d2b/f51 [0,4194304] 0 2024-02-20T08:06:11.544 INFO:tasks.workunit.client.1.smithi194.stdout:3/469: dread d5/d10/d17/d1d/f1e [8388608,4194304] 0 2024-02-20T08:06:11.547 INFO:tasks.workunit.client.1.smithi194.stdout:5/522: rename d4/d20/c51 to d4/d6/d11/d15/d28/d85/ca0 0 2024-02-20T08:06:11.548 INFO:tasks.workunit.client.1.smithi194.stdout:5/523: readlink d4/d6/dd/d25/d7d/l91 0 2024-02-20T08:06:11.557 INFO:tasks.workunit.client.1.smithi194.stdout:5/524: dwrite d4/d6/f7c [0,4194304] 0 2024-02-20T08:06:11.558 INFO:tasks.workunit.client.1.smithi194.stdout:5/525: dread - d4/d6/dd/d3a/f9a zero size 2024-02-20T08:06:11.569 INFO:tasks.workunit.client.1.smithi194.stdout:7/549: mknod d11/ca1 0 2024-02-20T08:06:11.571 INFO:tasks.workunit.client.1.smithi194.stdout:7/550: read d11/f35 [6092503,26208] 0 2024-02-20T08:06:11.572 INFO:tasks.workunit.client.1.smithi194.stdout:1/529: sync 2024-02-20T08:06:11.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/565: truncate d4/fa8 2410348 0 2024-02-20T08:06:11.582 INFO:tasks.workunit.client.1.smithi194.stdout:6/633: symlink df/dab/d1d/d28/lda 0 2024-02-20T08:06:11.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/634: write df/d42/f4f [3030709,60695] 0 2024-02-20T08:06:11.584 INFO:tasks.workunit.client.1.smithi194.stdout:6/635: readlink df/dab/d1d/l24 0 2024-02-20T08:06:11.585 INFO:tasks.workunit.client.1.smithi194.stdout:6/636: write df/dab/d1d/d28/f78 [368766,94738] 0 2024-02-20T08:06:11.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/470: mkdir d5/d10/d8d 0 2024-02-20T08:06:11.593 INFO:tasks.workunit.client.1.smithi194.stdout:5/526: dread d4/d6/dd/d25/d78/d8b/f3e [0,4194304] 0 2024-02-20T08:06:11.594 INFO:tasks.workunit.client.1.smithi194.stdout:8/464: getdents d2/d14/d18 0 2024-02-20T08:06:11.595 INFO:tasks.workunit.client.1.smithi194.stdout:4/456: getdents d0/d10/d1c/d4d/d2f 0 2024-02-20T08:06:11.596 INFO:tasks.workunit.client.1.smithi194.stdout:4/457: chown d0/df/d11 66912136 1 2024-02-20T08:06:11.599 INFO:tasks.workunit.client.1.smithi194.stdout:3/471: unlink d5/d10/d16/f2c 0 2024-02-20T08:06:11.601 INFO:tasks.workunit.client.1.smithi194.stdout:7/551: mknod d11/d2d/d38/d4a/d53/ca2 0 2024-02-20T08:06:11.601 INFO:tasks.workunit.client.1.smithi194.stdout:1/530: symlink d2/d1a/d61/d9f/lac 0 2024-02-20T08:06:11.602 INFO:tasks.workunit.client.1.smithi194.stdout:7/552: read - d11/d2d/d38/d4a/d60/f7d zero size 2024-02-20T08:06:11.602 INFO:tasks.workunit.client.1.smithi194.stdout:1/531: readlink d2/d1a/l8d 0 2024-02-20T08:06:11.602 INFO:tasks.workunit.client.1.smithi194.stdout:1/532: readlink d2/d1a/l8d 0 2024-02-20T08:06:11.602 INFO:tasks.workunit.client.1.smithi194.stdout:7/553: stat d11/d2d/d38/d4a/l17 0 2024-02-20T08:06:11.603 INFO:tasks.workunit.client.1.smithi194.stdout:2/545: write df/d14/f4c [1026488,54729] 0 2024-02-20T08:06:11.603 INFO:tasks.workunit.client.1.smithi194.stdout:5/527: symlink d4/d6/dd/d25/la1 0 2024-02-20T08:06:11.605 INFO:tasks.workunit.client.1.smithi194.stdout:4/458: creat d0/d10/d1c/d21/d46/f87 x:0 0 0 2024-02-20T08:06:11.606 INFO:tasks.workunit.client.1.smithi194.stdout:6/637: symlink df/dab/d1d/d28/d46/d5a/d6b/d83/d93/ldb 0 2024-02-20T08:06:11.606 INFO:tasks.workunit.client.1.smithi194.stdout:5/528: dread - d4/d20/d2b/d79/f8e zero size 2024-02-20T08:06:11.607 INFO:tasks.workunit.client.1.smithi194.stdout:3/472: rename d5/d10/d28/l46 to d5/df/d30/l8e 0 2024-02-20T08:06:11.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/566: creat d4/d20/d43/fbd x:0 0 0 2024-02-20T08:06:11.610 INFO:tasks.workunit.client.1.smithi194.stdout:7/554: dread d11/d2d/d38/d37/d43/d7b/d91/f98 [0,4194304] 0 2024-02-20T08:06:11.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/473: dread - d5/d10/d17/d1d/d3d/f3e zero size 2024-02-20T08:06:11.613 INFO:tasks.workunit.client.1.smithi194.stdout:0/484: dwrite d6/f29 [0,4194304] 0 2024-02-20T08:06:11.614 INFO:tasks.workunit.client.1.smithi194.stdout:1/533: dwrite d2/d1a/d26/d57/f5f [0,4194304] 0 2024-02-20T08:06:11.615 INFO:tasks.workunit.client.1.smithi194.stdout:0/485: fdatasync d6/d2b/d35/d9c/f6b 0 2024-02-20T08:06:11.618 INFO:tasks.workunit.client.1.smithi194.stdout:1/534: read - d2/d8/d60/fa7 zero size 2024-02-20T08:06:11.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/546: unlink df/d14/d19/d5c/d60/c95 0 2024-02-20T08:06:11.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/547: readlink df/d14/d19/d5c/d78/l8d 0 2024-02-20T08:06:11.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/529: dread d4/d6/d11/d15/d28/f39 [0,4194304] 0 2024-02-20T08:06:11.633 INFO:tasks.workunit.client.1.smithi194.stdout:5/530: write d4/d6/d11/d2f/f94 [852098,98276] 0 2024-02-20T08:06:11.641 INFO:tasks.workunit.client.1.smithi194.stdout:8/465: truncate d2/d14/f2c 2096956 0 2024-02-20T08:06:11.643 INFO:tasks.workunit.client.1.smithi194.stdout:7/555: creat d11/d2d/d38/d37/d43/d8e/d5e/fa3 x:0 0 0 2024-02-20T08:06:11.646 INFO:tasks.workunit.client.1.smithi194.stdout:0/486: fdatasync d6/d2b/d35/d42/d1e/f3f 0 2024-02-20T08:06:11.648 INFO:tasks.workunit.client.1.smithi194.stdout:8/466: dwrite d2/d14/d18/d45/d4e/f5e [0,4194304] 0 2024-02-20T08:06:11.649 INFO:tasks.workunit.client.1.smithi194.stdout:2/548: creat df/d14/d19/d5c/fa6 x:0 0 0 2024-02-20T08:06:11.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/556: dwrite d11/d2d/d38/d37/d43/d7b/f9b [0,4194304] 0 2024-02-20T08:06:11.653 INFO:tasks.workunit.client.1.smithi194.stdout:6/638: unlink df/dab/f22 0 2024-02-20T08:06:11.654 INFO:tasks.workunit.client.1.smithi194.stdout:4/459: mkdir d0/d5c/d60/d4a/d4e/d88 0 2024-02-20T08:06:11.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/474: symlink d5/d10/d8d/l8f 0 2024-02-20T08:06:11.665 INFO:tasks.workunit.client.1.smithi194.stdout:8/467: unlink d2/l89 0 2024-02-20T08:06:11.666 INFO:tasks.workunit.client.1.smithi194.stdout:8/468: chown d2/d14/d18/d45/d90 44747 1 2024-02-20T08:06:11.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/487: dwrite d6/d2b/d35/f7a [0,4194304] 0 2024-02-20T08:06:11.667 INFO:tasks.workunit.client.1.smithi194.stdout:2/549: symlink df/d14/d19/d5c/d60/la7 0 2024-02-20T08:06:11.673 INFO:tasks.workunit.client.1.smithi194.stdout:5/531: dread d4/fc [0,4194304] 0 2024-02-20T08:06:11.673 INFO:tasks.workunit.client.1.smithi194.stdout:5/532: chown d4/c2e 0 1 2024-02-20T08:06:11.676 INFO:tasks.workunit.client.1.smithi194.stdout:9/567: rename d4/d2d/d42/f81 to d4/d20/fbe 0 2024-02-20T08:06:11.680 INFO:tasks.workunit.client.1.smithi194.stdout:3/475: write d5/df/d30/d80/f89 [2794594,53797] 0 2024-02-20T08:06:11.681 INFO:tasks.workunit.client.1.smithi194.stdout:3/476: write d5/d10/f13 [3230559,94401] 0 2024-02-20T08:06:11.684 INFO:tasks.workunit.client.1.smithi194.stdout:8/469: dread d2/f2e [0,4194304] 0 2024-02-20T08:06:11.690 INFO:tasks.workunit.client.1.smithi194.stdout:6/639: link df/dab/d1d/d28/d46/d5a/fa6 df/dab/d1d/d28/d2b/d80/fdc 0 2024-02-20T08:06:11.692 INFO:tasks.workunit.client.1.smithi194.stdout:4/460: creat d0/d5c/d60/d4a/d4e/d88/f89 x:0 0 0 2024-02-20T08:06:11.699 INFO:tasks.workunit.client.1.smithi194.stdout:5/533: mknod d4/d6/dd/d25/d7d/ca2 0 2024-02-20T08:06:11.702 INFO:tasks.workunit.client.1.smithi194.stdout:5/534: write d4/d6/d11/d2f/f94 [1251387,118144] 0 2024-02-20T08:06:11.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/535: dwrite d2/d8/d12/f2c [0,4194304] 0 2024-02-20T08:06:11.705 INFO:tasks.workunit.client.1.smithi194.stdout:7/557: write d11/d2d/d38/d4a/d27/f4e [1613693,106685] 0 2024-02-20T08:06:11.706 INFO:tasks.workunit.client.1.smithi194.stdout:6/640: dread df/d18/f40 [4194304,4194304] 0 2024-02-20T08:06:11.708 INFO:tasks.workunit.client.1.smithi194.stdout:1/536: chown d2/d1a/d26/d45/ca8 7838 1 2024-02-20T08:06:11.711 INFO:tasks.workunit.client.1.smithi194.stdout:3/477: unlink d5/d10/d28/d41/c44 0 2024-02-20T08:06:11.718 INFO:tasks.workunit.client.1.smithi194.stdout:3/478: dwrite d5/df/f76 [0,4194304] 0 2024-02-20T08:06:11.719 INFO:tasks.workunit.client.1.smithi194.stdout:3/479: stat d5/d10/d28/c35 0 2024-02-20T08:06:11.720 INFO:tasks.workunit.client.1.smithi194.stdout:3/480: dread - d5/f7c zero size 2024-02-20T08:06:11.729 INFO:tasks.workunit.client.1.smithi194.stdout:9/568: unlink d4/d37/f62 0 2024-02-20T08:06:11.734 INFO:tasks.workunit.client.1.smithi194.stdout:5/535: creat d4/d6/dd/d25/d78/d8b/fa3 x:0 0 0 2024-02-20T08:06:11.738 INFO:tasks.workunit.client.1.smithi194.stdout:7/558: rmdir d11/d2d/d38/d37 39 2024-02-20T08:06:11.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/488: write d6/d2b/f50 [1438167,9268] 0 2024-02-20T08:06:11.739 INFO:tasks.workunit.client.1.smithi194.stdout:7/559: write d11/d2d/d38/d4a/d60/f8b [474751,103040] 0 2024-02-20T08:06:11.746 INFO:tasks.workunit.client.1.smithi194.stdout:8/470: mknod d2/d14/d18/d45/d4e/d9f/ca2 0 2024-02-20T08:06:11.748 INFO:tasks.workunit.client.1.smithi194.stdout:2/550: creat df/d14/d24/fa8 x:0 0 0 2024-02-20T08:06:11.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/536: dread d4/d6/dd/d25/d78/d8b/f54 [0,4194304] 0 2024-02-20T08:06:11.757 INFO:tasks.workunit.client.1.smithi194.stdout:9/569: mknod d4/d37/d4f/cbf 0 2024-02-20T08:06:11.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/570: readlink d4/d1b/d2e/lbc 0 2024-02-20T08:06:11.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/571: readlink d4/d20/d5c/l5d 0 2024-02-20T08:06:11.758 INFO:tasks.workunit.client.1.smithi194.stdout:0/489: unlink d6/d2b/l2c 0 2024-02-20T08:06:11.760 INFO:tasks.workunit.client.1.smithi194.stdout:9/572: write d4/d20/d5c/f3e [2353152,1076] 0 2024-02-20T08:06:11.760 INFO:tasks.workunit.client.1.smithi194.stdout:9/573: chown d4/d8b/c9d 6 1 2024-02-20T08:06:11.761 INFO:tasks.workunit.client.1.smithi194.stdout:8/471: rmdir d2/d14/d18/d45/d4e 39 2024-02-20T08:06:11.762 INFO:tasks.workunit.client.1.smithi194.stdout:2/551: fdatasync df/d14/f32 0 2024-02-20T08:06:11.765 INFO:tasks.workunit.client.1.smithi194.stdout:4/461: rename d0/c12 to d0/d2/d3e/c8a 0 2024-02-20T08:06:11.767 INFO:tasks.workunit.client.1.smithi194.stdout:3/481: getdents d5/d10/d28/d41/d73/d8c 0 2024-02-20T08:06:11.767 INFO:tasks.workunit.client.1.smithi194.stdout:8/472: dread d2/d14/d18/d45/d69/f6f [0,4194304] 0 2024-02-20T08:06:11.767 INFO:tasks.workunit.client.1.smithi194.stdout:6/641: fsync df/d18/f33 0 2024-02-20T08:06:11.769 INFO:tasks.workunit.client.1.smithi194.stdout:0/490: mkdir d6/d2b/d35/da3 0 2024-02-20T08:06:11.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.771+0000 7f0b6bfff700 1 -- 172.21.15.123:0/50737931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b64011480 con 0x7f0b740ff020 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 -- 172.21.15.123:0/50737931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 msgr2=0x7f0b74101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/50737931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b74101400 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0b640049c0 tx=0x7f0b64009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 -- 172.21.15.123:0/50737931 shutdown_connections 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/50737931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b74101400 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/50737931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b740fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.772+0000 7f0b7b34c700 1 -- 172.21.15.123:0/50737931 >> 172.21.15.123:0/50737931 conn(0x7f0b740f6840 msgr2=0x7f0b740f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.773+0000 7f0b7b34c700 1 -- 172.21.15.123:0/50737931 shutdown_connections 2024-02-20T08:06:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.773+0000 7f0b7b34c700 1 -- 172.21.15.123:0/50737931 wait complete. 2024-02-20T08:06:11.774 INFO:tasks.workunit.client.1.smithi194.stdout:9/574: rmdir d4/d20 39 2024-02-20T08:06:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.773+0000 7f0b7b34c700 1 Processor -- start 2024-02-20T08:06:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.773+0000 7f0b7b34c700 1 -- start start 2024-02-20T08:06:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b7b34c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b7b34c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b7410b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b7b34c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7410bfd0 con 0x7f0b740ff020 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b790e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b790e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:54752/0 (socket says 172.21.15.123:54752) 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b790e8700 1 -- 172.21.15.123:0/262615466 learned_addr learned my addr 172.21.15.123:0/262615466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.774+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7410c870 con 0x7f0b740fc670 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b788e7700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b7410b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b790e8700 1 -- 172.21.15.123:0/262615466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 msgr2=0x7f0b7410b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b790e8700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b7410b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b790e8700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64005040 con 0x7f0b740fc670 2024-02-20T08:06:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b790e8700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000eb40 tx=0x7f0b7000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b70007cc0 con 0x7f0b740fc670 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.775+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b7000f040 con 0x7f0b740fc670 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.776+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b7000cad0 con 0x7f0b740fc670 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.776+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7410caf0 con 0x7f0b740fc670 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.776+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7410cfe0 con 0x7f0b740fc670 2024-02-20T08:06:11.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.777+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b74105810 con 0x7f0b740fc670 2024-02-20T08:06:11.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.778+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 88916+0+0 (secure 0 0 0) 0x7f0b7000cc30 con 0x7f0b740fc670 2024-02-20T08:06:11.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.778+0000 7f0b69ffb700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 0x7f0b6006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:11.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.778+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0b70089540 con 0x7f0b740fc670 2024-02-20T08:06:11.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.778+0000 7f0b788e7700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 0x7f0b6006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:11.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.779+0000 7f0b788e7700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 0x7f0b6006d6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400d5c0 tx=0x7f0b64009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:11.783+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0b7004f620 con 0x7f0b740fc670 2024-02-20T08:06:11.787 INFO:tasks.workunit.client.1.smithi194.stdout:4/462: symlink d0/df/d41/l8b 0 2024-02-20T08:06:11.789 INFO:tasks.workunit.client.1.smithi194.stdout:4/463: read d0/d5c/d60/f39 [558581,34998] 0 2024-02-20T08:06:11.795 INFO:tasks.workunit.client.1.smithi194.stdout:2/552: dread fc [0,4194304] 0 2024-02-20T08:06:11.798 INFO:tasks.workunit.client.1.smithi194.stdout:9/575: write d4/d20/d43/f47 [999490,54655] 0 2024-02-20T08:06:11.801 INFO:tasks.workunit.client.1.smithi194.stdout:1/537: rename d2/l62 to d2/d1a/d61/d9f/lad 0 2024-02-20T08:06:11.803 INFO:tasks.workunit.client.1.smithi194.stdout:4/464: truncate d0/d2/d3e/f71 591882 0 2024-02-20T08:06:11.804 INFO:tasks.workunit.client.1.smithi194.stdout:4/465: write d0/f2d [4078839,86661] 0 2024-02-20T08:06:11.804 INFO:tasks.workunit.client.1.smithi194.stdout:3/482: truncate d5/d10/d17/f38 997719 0 2024-02-20T08:06:11.807 INFO:tasks.workunit.client.1.smithi194.stdout:2/553: rmdir df/d14/d19/d5c/d78 39 2024-02-20T08:06:11.807 INFO:tasks.workunit.client.1.smithi194.stdout:2/554: dread - df/d5b/d61/f8b zero size 2024-02-20T08:06:11.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/642: link df/dab/f7a df/dab/d1d/d28/d46/dca/fdd 0 2024-02-20T08:06:11.809 INFO:tasks.workunit.client.1.smithi194.stdout:0/491: mknod d6/d2b/d35/d39/d55/d59/d77/d9d/ca4 0 2024-02-20T08:06:11.810 INFO:tasks.workunit.client.1.smithi194.stdout:6/643: truncate df/d42/dcf/f87 4200083 0 2024-02-20T08:06:11.810 INFO:tasks.workunit.client.1.smithi194.stdout:5/537: getdents d4/d20 0 2024-02-20T08:06:11.811 INFO:tasks.workunit.client.1.smithi194.stdout:9/576: creat d4/d55/fc0 x:0 0 0 2024-02-20T08:06:11.814 INFO:tasks.workunit.client.1.smithi194.stdout:8/473: creat d2/fa3 x:0 0 0 2024-02-20T08:06:11.818 INFO:tasks.workunit.client.1.smithi194.stdout:4/466: creat d0/d10/d1c/d21/d46/f8c x:0 0 0 2024-02-20T08:06:11.820 INFO:tasks.workunit.client.1.smithi194.stdout:3/483: stat d5/d10/d28/c2e 0 2024-02-20T08:06:11.822 INFO:tasks.workunit.client.1.smithi194.stdout:0/492: symlink d6/d2b/d35/d39/d55/d59/la5 0 2024-02-20T08:06:11.824 INFO:tasks.workunit.client.1.smithi194.stdout:9/577: symlink d4/d8b/lc1 0 2024-02-20T08:06:11.826 INFO:tasks.workunit.client.1.smithi194.stdout:3/484: dwrite d5/df/f67 [0,4194304] 0 2024-02-20T08:06:11.827 INFO:tasks.workunit.client.1.smithi194.stdout:5/538: truncate d4/d6/f1f 1673919 0 2024-02-20T08:06:11.835 INFO:tasks.workunit.client.1.smithi194.stdout:0/493: dwrite d6/d2b/d35/d42/d1e/d45/d58/f9e [0,4194304] 0 2024-02-20T08:06:11.836 INFO:tasks.workunit.client.1.smithi194.stdout:6/644: dread df/dab/d1d/d28/d46/d5a/d6b/f85 [0,4194304] 0 2024-02-20T08:06:11.842 INFO:tasks.workunit.client.1.smithi194.stdout:1/538: dwrite d2/d8/d12/f52 [4194304,4194304] 0 2024-02-20T08:06:11.844 INFO:tasks.workunit.client.1.smithi194.stdout:3/485: dwrite d5/d10/d16/f59 [0,4194304] 0 2024-02-20T08:06:11.846 INFO:tasks.workunit.client.1.smithi194.stdout:0/494: unlink d6/d2b/d35/d39/f67 0 2024-02-20T08:06:11.846 INFO:tasks.workunit.client.1.smithi194.stdout:6/645: read - df/dab/d1d/d28/d5e/f82 zero size 2024-02-20T08:06:11.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/578: getdents d4/d2d/d42 0 2024-02-20T08:06:11.850 INFO:tasks.workunit.client.1.smithi194.stdout:3/486: rmdir d5/df/d60 39 2024-02-20T08:06:11.852 INFO:tasks.workunit.client.1.smithi194.stdout:3/487: readlink d5/df/d25/l4b 0 2024-02-20T08:06:11.854 INFO:tasks.workunit.client.1.smithi194.stdout:9/579: mkdir d4/d20/d41/dc2 0 2024-02-20T08:06:11.854 INFO:tasks.workunit.client.1.smithi194.stdout:4/467: dwrite d0/d2/fe [0,4194304] 0 2024-02-20T08:06:11.858 INFO:tasks.workunit.client.1.smithi194.stdout:1/539: symlink d2/d1a/d61/d7d/lae 0 2024-02-20T08:06:11.861 INFO:tasks.workunit.client.1.smithi194.stdout:3/488: symlink d5/d10/d16/d8a/l90 0 2024-02-20T08:06:11.863 INFO:tasks.workunit.client.1.smithi194.stdout:9/580: dwrite d4/d20/d5c/f3e [0,4194304] 0 2024-02-20T08:06:11.868 INFO:tasks.workunit.client.1.smithi194.stdout:1/540: creat d2/d1a/d26/d45/faf x:0 0 0 2024-02-20T08:06:11.868 INFO:tasks.workunit.client.1.smithi194.stdout:3/489: fdatasync d5/d10/d17/d1d/f6b 0 2024-02-20T08:06:11.869 INFO:tasks.workunit.client.1.smithi194.stdout:5/539: write d4/d6/d11/d15/d28/d85/d53/f64 [2659475,53734] 0 2024-02-20T08:06:11.869 INFO:tasks.workunit.client.1.smithi194.stdout:1/541: write d2/d8/d12/f21 [4504118,45814] 0 2024-02-20T08:06:11.870 INFO:tasks.workunit.client.1.smithi194.stdout:3/490: write d5/f7c [519974,49927] 0 2024-02-20T08:06:11.871 INFO:tasks.workunit.client.1.smithi194.stdout:1/542: chown d2/d1a/d26/d45/l5c 30465 1 2024-02-20T08:06:11.872 INFO:tasks.workunit.client.1.smithi194.stdout:1/543: stat d2/d8/l27 0 2024-02-20T08:06:11.875 INFO:tasks.workunit.client.1.smithi194.stdout:9/581: creat d4/d20/d41/fc3 x:0 0 0 2024-02-20T08:06:11.876 INFO:tasks.workunit.client.1.smithi194.stdout:9/582: fsync d4/d20/d43/d51/f85 0 2024-02-20T08:06:11.878 INFO:tasks.workunit.client.1.smithi194.stdout:5/540: chown d4/d6/f1f 1035 1 2024-02-20T08:06:11.879 INFO:tasks.workunit.client.1.smithi194.stdout:6/646: link df/d42/l97 df/dab/d1d/d28/lde 0 2024-02-20T08:06:11.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/544: fsync d2/f42 0 2024-02-20T08:06:11.880 INFO:tasks.workunit.client.1.smithi194.stdout:4/468: getdents d0/d10/d1c/d21 0 2024-02-20T08:06:11.881 INFO:tasks.workunit.client.1.smithi194.stdout:3/491: creat d5/d10/d17/d1d/d3d/f91 x:0 0 0 2024-02-20T08:06:11.882 INFO:tasks.workunit.client.1.smithi194.stdout:4/469: write d0/d5c/d60/f78 [4775,88214] 0 2024-02-20T08:06:11.882 INFO:tasks.workunit.client.1.smithi194.stdout:1/545: readlink d2/d1a/l47 0 2024-02-20T08:06:11.886 INFO:tasks.workunit.client.1.smithi194.stdout:5/541: link d4/d6/d11/d2f/c4c d4/d6/dd/d99/ca4 0 2024-02-20T08:06:11.887 INFO:tasks.workunit.client.1.smithi194.stdout:3/492: fsync d5/d10/d17/f38 0 2024-02-20T08:06:11.888 INFO:tasks.workunit.client.1.smithi194.stdout:1/546: fsync d2/d1a/d26/d45/fa6 0 2024-02-20T08:06:11.891 INFO:tasks.workunit.client.1.smithi194.stdout:5/542: mkdir d4/d6/da5 0 2024-02-20T08:06:11.893 INFO:tasks.workunit.client.1.smithi194.stdout:5/543: write d4/d6/f7c [4036154,86980] 0 2024-02-20T08:06:11.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/493: creat d5/d10/d8d/f92 x:0 0 0 2024-02-20T08:06:11.897 INFO:tasks.workunit.client.1.smithi194.stdout:1/547: dread d2/d1a/d26/d3d/d71/d8c/f14 [4194304,4194304] 0 2024-02-20T08:06:11.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/583: dread d4/d1b/d79/f89 [0,4194304] 0 2024-02-20T08:06:11.901 INFO:tasks.workunit.client.1.smithi194.stdout:6/647: dread df/dab/f2c [0,4194304] 0 2024-02-20T08:06:11.903 INFO:tasks.workunit.client.1.smithi194.stdout:3/494: rmdir d5/df 39 2024-02-20T08:06:11.904 INFO:tasks.workunit.client.1.smithi194.stdout:4/470: getdents d0/d10/d1c/d21 0 2024-02-20T08:06:11.907 INFO:tasks.workunit.client.1.smithi194.stdout:1/548: mkdir d2/d1a/d26/d3d/d71/d8c/d34/db0 0 2024-02-20T08:06:11.907 INFO:tasks.workunit.client.1.smithi194.stdout:5/544: fdatasync d4/d6/d11/d2f/f4d 0 2024-02-20T08:06:11.908 INFO:tasks.workunit.client.1.smithi194.stdout:5/545: readlink d4/d6/d11/d2f/l41 0 2024-02-20T08:06:11.910 INFO:tasks.workunit.client.1.smithi194.stdout:4/471: dwrite d0/d2/d3e/f5f [0,4194304] 0 2024-02-20T08:06:11.910 INFO:tasks.workunit.client.1.smithi194.stdout:3/495: mkdir d5/d10/d17/d1d/d93 0 2024-02-20T08:06:11.911 INFO:tasks.workunit.client.1.smithi194.stdout:4/472: write d0/f32 [1274652,117980] 0 2024-02-20T08:06:11.912 INFO:tasks.workunit.client.1.smithi194.stdout:1/549: write d2/f84 [5003868,99807] 0 2024-02-20T08:06:11.913 INFO:tasks.workunit.client.1.smithi194.stdout:1/550: stat d2/d1a/d26/d3d/d71/d8c/le 0 2024-02-20T08:06:11.918 INFO:tasks.workunit.client.1.smithi194.stdout:3/496: mkdir d5/d10/d16/d7b/d94 0 2024-02-20T08:06:11.919 INFO:tasks.workunit.client.1.smithi194.stdout:1/551: dwrite d2/d1a/d61/d7e/f86 [4194304,4194304] 0 2024-02-20T08:06:11.921 INFO:tasks.workunit.client.1.smithi194.stdout:1/552: write d2/d1a/d26/d57/d58/f73 [325739,102941] 0 2024-02-20T08:06:11.924 INFO:tasks.workunit.client.1.smithi194.stdout:3/497: creat d5/d10/d28/f95 x:0 0 0 2024-02-20T08:06:11.930 INFO:tasks.workunit.client.1.smithi194.stdout:1/553: rename d2/d1a/d26/d3d/d71/d8c/d34/l74 to d2/d1a/d61/d9f/lb1 0 2024-02-20T08:06:11.934 INFO:tasks.workunit.client.1.smithi194.stdout:5/546: getdents d4/d6/dd/d25/d78 0 2024-02-20T08:06:11.935 INFO:tasks.workunit.client.1.smithi194.stdout:5/547: stat d4/d6/d11/d2f/d77 0 2024-02-20T08:06:11.936 INFO:tasks.workunit.client.1.smithi194.stdout:1/554: dwrite d2/d1a/d26/f6a [0,4194304] 0 2024-02-20T08:06:11.938 INFO:tasks.workunit.client.1.smithi194.stdout:3/498: read d5/d10/d28/f45 [3998768,61219] 0 2024-02-20T08:06:11.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/555: chown d2/d1a/d26/ca2 58 1 2024-02-20T08:06:11.941 INFO:tasks.workunit.client.1.smithi194.stdout:5/548: creat d4/d6/d11/d15/d28/d85/d53/fa6 x:0 0 0 2024-02-20T08:06:11.945 INFO:tasks.workunit.client.1.smithi194.stdout:5/549: mkdir d4/d6/dd/d99/da7 0 2024-02-20T08:06:11.948 INFO:tasks.workunit.client.1.smithi194.stdout:5/550: symlink d4/d6/dd/d25/la8 0 2024-02-20T08:06:11.948 INFO:tasks.workunit.client.1.smithi194.stdout:1/556: link d2/d8/df/f65 d2/d48/fb2 0 2024-02-20T08:06:11.949 INFO:tasks.workunit.client.1.smithi194.stdout:1/557: dread - d2/d1a/d61/d7e/fa4 zero size 2024-02-20T08:06:11.950 INFO:tasks.workunit.client.1.smithi194.stdout:1/558: write d2/d8/d12/f81 [435515,69034] 0 2024-02-20T08:06:11.950 INFO:tasks.workunit.client.1.smithi194.stdout:5/551: creat d4/d6/d11/d2f/d77/fa9 x:0 0 0 2024-02-20T08:06:11.951 INFO:tasks.workunit.client.1.smithi194.stdout:1/559: write d2/d1a/d61/d68/f7f [665511,113896] 0 2024-02-20T08:06:11.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/552: dread d4/d6/d11/d15/f26 [0,4194304] 0 2024-02-20T08:06:11.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/553: creat d4/d20/faa x:0 0 0 2024-02-20T08:06:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:11 smithi123 ceph-mon[29383]: pgmap v55: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 128 MiB/s wr, 270 op/s 2024-02-20T08:06:12.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/648: write df/dab/d1d/d28/d2b/f7c [683382,66286] 0 2024-02-20T08:06:12.014 INFO:tasks.workunit.client.1.smithi194.stdout:9/584: truncate d4/d2d/d42/d4e/d6e/d88/f8e 2317077 0 2024-02-20T08:06:12.022 INFO:tasks.workunit.client.1.smithi194.stdout:4/473: dwrite d0/d5c/f7c [4194304,4194304] 0 2024-02-20T08:06:12.022 INFO:tasks.workunit.client.1.smithi194.stdout:4/474: readlink d0/d2/d51/l76 0 2024-02-20T08:06:12.023 INFO:tasks.workunit.client.1.smithi194.stdout:4/475: fsync d0/f2d 0 2024-02-20T08:06:12.030 INFO:tasks.workunit.client.1.smithi194.stdout:4/476: dwrite d0/df/f84 [0,4194304] 0 2024-02-20T08:06:12.031 INFO:tasks.workunit.client.1.smithi194.stdout:5/554: fsync d4/d20/faa 0 2024-02-20T08:06:12.032 INFO:tasks.workunit.client.1.smithi194.stdout:6/649: write df/dab/f1a [539537,8283] 0 2024-02-20T08:06:12.036 INFO:tasks.workunit.client.1.smithi194.stdout:6/650: readlink df/dab/d1d/d28/d46/d5a/d6b/d83/d93/ldb 0 2024-02-20T08:06:12.037 INFO:tasks.workunit.client.1.smithi194.stdout:1/560: dwrite d2/d48/fb2 [0,4194304] 0 2024-02-20T08:06:12.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/651: write df/d42/d86/fb4 [166368,105468] 0 2024-02-20T08:06:12.039 INFO:tasks.workunit.client.1.smithi194.stdout:5/555: truncate d4/d6/dd/d25/d78/d8b/f3e 685188 0 2024-02-20T08:06:12.042 INFO:tasks.workunit.client.1.smithi194.stdout:6/652: unlink df/dab/d1d/d28/c5b 0 2024-02-20T08:06:12.043 INFO:tasks.workunit.client.1.smithi194.stdout:1/561: mknod d2/d1a/d26/d3d/d71/d8c/d34/db0/cb3 0 2024-02-20T08:06:12.043 INFO:tasks.workunit.client.1.smithi194.stdout:6/653: chown df/dab/d1d/d99 0 1 2024-02-20T08:06:12.044 INFO:tasks.workunit.client.1.smithi194.stdout:1/562: chown d2/d8/d12/f41 94906818 1 2024-02-20T08:06:12.045 INFO:tasks.workunit.client.1.smithi194.stdout:1/563: write d2/d1a/d26/d57/d58/f73 [1464805,55940] 0 2024-02-20T08:06:12.047 INFO:tasks.workunit.client.1.smithi194.stdout:6/654: creat df/dab/d1d/fdf x:0 0 0 2024-02-20T08:06:12.049 INFO:tasks.workunit.client.1.smithi194.stdout:6/655: creat df/dbe/fe0 x:0 0 0 2024-02-20T08:06:12.050 INFO:tasks.workunit.client.1.smithi194.stdout:1/564: getdents d2/d1a/d26/d3d/d71/d8c 0 2024-02-20T08:06:12.053 INFO:tasks.workunit.client.1.smithi194.stdout:6/656: unlink df/dab/d1d/d28/d46/d5a/fa6 0 2024-02-20T08:06:12.056 INFO:tasks.workunit.client.1.smithi194.stdout:6/657: rename df/d42/cba to df/dab/d1d/d99/ce1 0 2024-02-20T08:06:12.057 INFO:tasks.workunit.client.1.smithi194.stdout:1/565: creat d2/d1a/fb4 x:0 0 0 2024-02-20T08:06:12.058 INFO:tasks.workunit.client.1.smithi194.stdout:3/499: write d5/d10/d17/d1d/f20 [4711626,71476] 0 2024-02-20T08:06:12.059 INFO:tasks.workunit.client.1.smithi194.stdout:1/566: readlink d2/d8/d60/l94 0 2024-02-20T08:06:12.060 INFO:tasks.workunit.client.1.smithi194.stdout:1/567: write d2/d1a/d61/d7e/fa4 [28588,16376] 0 2024-02-20T08:06:12.063 INFO:tasks.workunit.client.1.smithi194.stdout:3/500: mknod d5/d10/d17/d1d/d56/c96 0 2024-02-20T08:06:12.064 INFO:tasks.workunit.client.1.smithi194.stdout:1/568: mkdir d2/d8/d60/d75/db5 0 2024-02-20T08:06:12.070 INFO:tasks.workunit.client.1.smithi194.stdout:3/501: truncate d5/df/d25/f27 4146385 0 2024-02-20T08:06:12.074 INFO:tasks.workunit.client.1.smithi194.stdout:1/569: rmdir d2/d1a/d26/d3d/d71/d8c/d77 0 2024-02-20T08:06:12.076 INFO:tasks.workunit.client.1.smithi194.stdout:3/502: readlink d5/d10/d17/d1d/l54 0 2024-02-20T08:06:12.077 INFO:tasks.workunit.client.1.smithi194.stdout:5/556: dread d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:12.077 INFO:tasks.workunit.client.1.smithi194.stdout:6/658: dread df/dab/d1d/d28/f78 [0,4194304] 0 2024-02-20T08:06:12.077 INFO:tasks.workunit.client.1.smithi194.stdout:4/477: dread d0/f2d [0,4194304] 0 2024-02-20T08:06:12.078 INFO:tasks.workunit.client.1.smithi194.stdout:6/659: read - df/d42/da8/fad zero size 2024-02-20T08:06:12.083 INFO:tasks.workunit.client.1.smithi194.stdout:1/570: creat d2/d1a/d61/fb6 x:0 0 0 2024-02-20T08:06:12.083 INFO:tasks.workunit.client.1.smithi194.stdout:3/503: dwrite d5/df/f67 [0,4194304] 0 2024-02-20T08:06:12.088 INFO:tasks.workunit.client.1.smithi194.stdout:5/557: dread d4/d6/d11/d2f/f94 [0,4194304] 0 2024-02-20T08:06:12.092 INFO:tasks.workunit.client.1.smithi194.stdout:6/660: rename df/dab/d1d/d28/d46/d5a/d6b/d83/d93/laa to df/dab/d1d/d28/d2b/d80/le2 0 2024-02-20T08:06:12.092 INFO:tasks.workunit.client.1.smithi194.stdout:6/661: write df/f92 [435610,46999] 0 2024-02-20T08:06:12.096 INFO:tasks.workunit.client.1.smithi194.stdout:3/504: mknod d5/d10/d8d/c97 0 2024-02-20T08:06:12.099 INFO:tasks.workunit.client.1.smithi194.stdout:1/571: mkdir d2/d1a/d61/d68/db7 0 2024-02-20T08:06:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.100+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b7402b310 con 0x7f0b6006b230 2024-02-20T08:06:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.101+0000 7f0b69ffb700 1 -- 172.21.15.123:0/262615466 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f0b7402b310 con 0x7f0b6006b230 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 msgr2=0x7f0b6006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 0x7f0b6006d6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400d5c0 tx=0x7f0b64009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 msgr2=0x7f0b7410b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000eb40 tx=0x7f0b7000b040 comp rx=0 tx=0).stop 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 shutdown_connections 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f0b6006b230 0x7f0b6006d6e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740fc670 0x7f0b7410b490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 --2- 172.21.15.123:0/262615466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b740ff020 0x7f0b7410b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 >> 172.21.15.123:0/262615466 conn(0x7f0b740f6840 msgr2=0x7f0b740f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 shutdown_connections 2024-02-20T08:06:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.104+0000 7f0b7b34c700 1 -- 172.21.15.123:0/262615466 wait complete. 2024-02-20T08:06:12.111 INFO:tasks.workunit.client.1.smithi194.stdout:3/505: creat d5/d10/d28/f98 x:0 0 0 2024-02-20T08:06:12.112 INFO:tasks.workunit.client.1.smithi194.stdout:3/506: read d5/d10/f52 [47170,53856] 0 2024-02-20T08:06:12.120 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:06:12.124 INFO:tasks.workunit.client.1.smithi194.stdout:4/478: write d0/d10/d1c/f30 [2856824,18441] 0 2024-02-20T08:06:12.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/662: write df/dab/d1d/d28/d5e/f82 [217974,99375] 0 2024-02-20T08:06:12.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/479: read - d0/d5c/d60/d4a/d4e/d88/f89 zero size 2024-02-20T08:06:12.136 INFO:tasks.workunit.client.1.smithi194.stdout:1/572: truncate d2/d8/d12/f43 456175 0 2024-02-20T08:06:12.136 INFO:tasks.workunit.client.1.smithi194.stdout:1/573: fsync d2/d1a/d26/d57/d58/f73 0 2024-02-20T08:06:12.136 INFO:tasks.workunit.client.1.smithi194.stdout:6/663: rmdir df/dab/d1d/d28/d2b 39 2024-02-20T08:06:12.143 INFO:tasks.workunit.client.1.smithi194.stdout:7/560: sync 2024-02-20T08:06:12.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/474: sync 2024-02-20T08:06:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:11 smithi194 ceph-mon[37804]: pgmap v55: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 128 MiB/s wr, 270 op/s 2024-02-20T08:06:12.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/558: truncate d4/d6/dd/d25/d78/d8b/f3e 1251711 0 2024-02-20T08:06:12.152 INFO:tasks.workunit.client.1.smithi194.stdout:3/507: getdents d5/d10/d28/d41/d73 0 2024-02-20T08:06:12.153 INFO:tasks.workunit.client.1.smithi194.stdout:8/475: creat d2/d14/d18/d45/d7b/fa4 x:0 0 0 2024-02-20T08:06:12.156 INFO:tasks.workunit.client.1.smithi194.stdout:1/574: rename d2/d48/f64 to d2/d8/d60/fb8 0 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2366301368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fc7f0 msgr2=0x7fbd680fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2366301368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fc7f0 0x7fbd680fcc40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004940 tx=0x7fbd58009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2366301368 shutdown_connections 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2366301368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fc7f0 0x7fbd680fcc40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2366301368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fb5e0 0x7fbd680fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2366301368 >> 172.21.15.123:0/2366301368 conn(0x7fbd680f6ca0 msgr2=0x7fbd680f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2366301368 shutdown_connections 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2366301368 wait complete. 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.241+0000 7fbd6f7a3700 1 Processor -- start 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6f7a3700 1 -- start start 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6f7a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6f7a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 0x7fbd6810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6f7a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6810d510 con 0x7fbd680fb5e0 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6f7a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6810dd00 con 0x7fbd680fc7f0 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46074/0 (socket says 172.21.15.123:46074) 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 -- 172.21.15.123:0/2243166842 learned_addr learned my addr 172.21.15.123:0/2243166842 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6cd3e700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 0x7fbd6810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 -- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 msgr2=0x7fbd6810ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 0x7fbd6810ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6d53f700 1 -- 172.21.15.123:0/2243166842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58005040 con 0x7fbd680fb5e0 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.242+0000 7fbd6cd3e700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 0x7fbd6810ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd6d53f700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b790 tx=0x7fbd64009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd6400f6f0 con 0x7fbd680fb5e0 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6810dfe0 con 0x7fbd680fb5e0 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd6400fd20 con 0x7fbd680fb5e0 2024-02-20T08:06:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd640103a0 con 0x7fbd680fb5e0 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.243+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6810e520 con 0x7fbd680fb5e0 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.244+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6804bed0 con 0x7fbd680fb5e0 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.245+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 25) v1 ==== 88916+0+0 (secure 0 0 0) 0x7fbd64011400 con 0x7fbd680fb5e0 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.245+0000 7fbd5dffb700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 0x7fbd5406f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.245+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbd64089940 con 0x7fbd680fb5e0 2024-02-20T08:06:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.246+0000 7fbd6cd3e700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 0x7fbd5406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.246+0000 7fbd6cd3e700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 0x7fbd5406f880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004f90 tx=0x7fbd58009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:12.249 INFO:tasks.workunit.client.1.smithi194.stdout:5/559: rmdir d4/d6/d11/d2f 39 2024-02-20T08:06:12.250 INFO:tasks.workunit.client.1.smithi194.stdout:6/664: creat df/fe3 x:0 0 0 2024-02-20T08:06:12.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/476: write d2/d14/d18/f40 [969232,33079] 0 2024-02-20T08:06:12.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.254+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbd640576a0 con 0x7fbd680fb5e0 2024-02-20T08:06:12.255 INFO:tasks.workunit.client.1.smithi194.stdout:1/575: rename d2/d1a/d26/d3d/d71/d8c/c6d to d2/d1a/d26/d3d/d82/cb9 0 2024-02-20T08:06:12.255 INFO:tasks.workunit.client.1.smithi194.stdout:7/561: dread d11/f1f [0,4194304] 0 2024-02-20T08:06:12.257 INFO:tasks.workunit.client.1.smithi194.stdout:7/562: write d11/d2d/d38/d4a/d27/f4e [1935800,17584] 0 2024-02-20T08:06:12.261 INFO:tasks.workunit.client.1.smithi194.stdout:3/508: dread d5/df/f64 [0,4194304] 0 2024-02-20T08:06:12.271 INFO:tasks.workunit.client.1.smithi194.stdout:3/509: mknod d5/d10/d8d/c99 0 2024-02-20T08:06:12.276 INFO:tasks.workunit.client.1.smithi194.stdout:8/477: mknod d2/d14/d18/d45/d4e/d6c/d78/ca5 0 2024-02-20T08:06:12.277 INFO:tasks.workunit.client.1.smithi194.stdout:2/555: sync 2024-02-20T08:06:12.278 INFO:tasks.workunit.client.1.smithi194.stdout:0/495: sync 2024-02-20T08:06:12.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/585: sync 2024-02-20T08:06:12.278 INFO:tasks.workunit.client.1.smithi194.stdout:5/560: link d4/d20/l47 d4/d6/dd/d3a/d86/lab 0 2024-02-20T08:06:12.279 INFO:tasks.workunit.client.1.smithi194.stdout:2/556: dread - df/d14/d24/d56/d6b/d81/f79 zero size 2024-02-20T08:06:12.280 INFO:tasks.workunit.client.1.smithi194.stdout:5/561: write d4/d6/dd/d25/d78/d8b/f24 [7144225,96365] 0 2024-02-20T08:06:12.281 INFO:tasks.workunit.client.1.smithi194.stdout:8/478: rmdir d2/d80 39 2024-02-20T08:06:12.283 INFO:tasks.workunit.client.1.smithi194.stdout:3/510: mkdir d5/df/d9a 0 2024-02-20T08:06:12.285 INFO:tasks.workunit.client.1.smithi194.stdout:9/586: fsync d4/d1b/d2e/f61 0 2024-02-20T08:06:12.286 INFO:tasks.workunit.client.1.smithi194.stdout:9/587: read d4/d1b/d2e/f30 [5881485,106872] 0 2024-02-20T08:06:12.287 INFO:tasks.workunit.client.1.smithi194.stdout:6/665: link df/dab/d1d/d28/ld9 df/dab/d1d/d28/d2b/d9b/le4 0 2024-02-20T08:06:12.290 INFO:tasks.workunit.client.1.smithi194.stdout:5/562: read - d4/d6/d11/d2f/d77/fa9 zero size 2024-02-20T08:06:12.294 INFO:tasks.workunit.client.1.smithi194.stdout:3/511: rmdir d5/d10/d8d 39 2024-02-20T08:06:12.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/496: mkdir d6/d2b/d35/d9c/d9f/da6 0 2024-02-20T08:06:12.301 INFO:tasks.workunit.client.1.smithi194.stdout:0/497: read d6/d2b/d35/d42/f24 [980753,48326] 0 2024-02-20T08:06:12.308 INFO:tasks.workunit.client.1.smithi194.stdout:9/588: dwrite d4/d1b/d79/f89 [0,4194304] 0 2024-02-20T08:06:12.308 INFO:tasks.workunit.client.1.smithi194.stdout:3/512: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:12.309 INFO:tasks.workunit.client.1.smithi194.stdout:5/563: creat d4/d20/d2b/d79/fac x:0 0 0 2024-02-20T08:06:12.309 INFO:tasks.workunit.client.1.smithi194.stdout:9/589: fdatasync d4/d20/f80 0 2024-02-20T08:06:12.310 INFO:tasks.workunit.client.1.smithi194.stdout:5/564: read - d4/d6/dd/d25/d78/d8b/fa3 zero size 2024-02-20T08:06:12.315 INFO:tasks.workunit.client.1.smithi194.stdout:2/557: creat df/fa9 x:0 0 0 2024-02-20T08:06:12.316 INFO:tasks.workunit.client.1.smithi194.stdout:9/590: readlink d4/d20/d5c/l4b 0 2024-02-20T08:06:12.316 INFO:tasks.workunit.client.1.smithi194.stdout:8/479: dread d2/f37 [0,4194304] 0 2024-02-20T08:06:12.319 INFO:tasks.workunit.client.1.smithi194.stdout:6/666: dwrite df/dab/f7a [0,4194304] 0 2024-02-20T08:06:12.333 INFO:tasks.workunit.client.1.smithi194.stdout:0/498: write d6/d2b/d35/d42/d1e/f27 [1568255,90557] 0 2024-02-20T08:06:12.334 INFO:tasks.workunit.client.1.smithi194.stdout:2/558: creat df/d14/faa x:0 0 0 2024-02-20T08:06:12.335 INFO:tasks.workunit.client.1.smithi194.stdout:2/559: chown df/d5b/c76 0 1 2024-02-20T08:06:12.336 INFO:tasks.workunit.client.1.smithi194.stdout:9/591: write d4/f68 [1297536,14672] 0 2024-02-20T08:06:12.337 INFO:tasks.workunit.client.1.smithi194.stdout:9/592: fdatasync d4/d20/d43/fbd 0 2024-02-20T08:06:12.339 INFO:tasks.workunit.client.1.smithi194.stdout:0/499: creat d6/d2b/d35/d39/d55/d59/d77/fa7 x:0 0 0 2024-02-20T08:06:12.339 INFO:tasks.workunit.client.1.smithi194.stdout:6/667: mknod df/dab/d1d/d28/d2b/d80/ce5 0 2024-02-20T08:06:12.340 INFO:tasks.workunit.client.1.smithi194.stdout:2/560: rmdir df/d14/d19/d5c/d60/d63/d92 39 2024-02-20T08:06:12.341 INFO:tasks.workunit.client.1.smithi194.stdout:0/500: chown d6/d2b/d35/f73 0 1 2024-02-20T08:06:12.341 INFO:tasks.workunit.client.1.smithi194.stdout:9/593: mkdir d4/de/dc4 0 2024-02-20T08:06:12.344 INFO:tasks.workunit.client.1.smithi194.stdout:9/594: fdatasync d4/d55/fa6 0 2024-02-20T08:06:12.344 INFO:tasks.workunit.client.1.smithi194.stdout:5/565: dwrite d4/d20/d2b/d79/f83 [0,4194304] 0 2024-02-20T08:06:12.348 INFO:tasks.workunit.client.1.smithi194.stdout:8/480: dwrite d2/d14/d18/d45/d4e/d6c/d78/d98/f86 [0,4194304] 0 2024-02-20T08:06:12.351 INFO:tasks.workunit.client.1.smithi194.stdout:0/501: mknod d6/d2b/d35/d39/d8f/ca8 0 2024-02-20T08:06:12.355 INFO:tasks.workunit.client.1.smithi194.stdout:9/595: symlink d4/d37/dab/lc5 0 2024-02-20T08:06:12.357 INFO:tasks.workunit.client.1.smithi194.stdout:6/668: dwrite df/dab/d1d/d28/d2b/f2e [0,4194304] 0 2024-02-20T08:06:12.358 INFO:tasks.workunit.client.1.smithi194.stdout:5/566: dread d4/d6/d11/d15/f26 [0,4194304] 0 2024-02-20T08:06:12.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/596: dread - d4/d55/fa6 zero size 2024-02-20T08:06:12.359 INFO:tasks.workunit.client.1.smithi194.stdout:2/561: dwrite df/f21 [4194304,4194304] 0 2024-02-20T08:06:12.366 INFO:tasks.workunit.client.1.smithi194.stdout:6/669: creat df/dab/dcc/fe6 x:0 0 0 2024-02-20T08:06:12.367 INFO:tasks.workunit.client.1.smithi194.stdout:9/597: symlink d4/d1b/d2e/lc6 0 2024-02-20T08:06:12.370 INFO:tasks.workunit.client.1.smithi194.stdout:2/562: dwrite df/d14/d24/f48 [4194304,4194304] 0 2024-02-20T08:06:12.374 INFO:tasks.workunit.client.1.smithi194.stdout:8/481: link d2/d14/d18/d45/d4e/d6c/d78/d98/f6e d2/d80/fa6 0 2024-02-20T08:06:12.376 INFO:tasks.workunit.client.1.smithi194.stdout:4/480: sync 2024-02-20T08:06:12.378 INFO:tasks.workunit.client.1.smithi194.stdout:5/567: dwrite d4/d6/d11/d2f/f94 [0,4194304] 0 2024-02-20T08:06:12.380 INFO:tasks.workunit.client.1.smithi194.stdout:6/670: fsync df/d42/dcf/f8d 0 2024-02-20T08:06:12.386 INFO:tasks.workunit.client.1.smithi194.stdout:2/563: unlink df/d14/d19/d5c/d78/l8d 0 2024-02-20T08:06:12.395 INFO:tasks.workunit.client.1.smithi194.stdout:5/568: mknod d4/d6/dd/d25/d7d/cad 0 2024-02-20T08:06:12.396 INFO:tasks.workunit.client.1.smithi194.stdout:5/569: write d4/d20/d2b/d79/f83 [5194786,30326] 0 2024-02-20T08:06:12.401 INFO:tasks.workunit.client.1.smithi194.stdout:9/598: rmdir d4/d20/d41/dc2 0 2024-02-20T08:06:12.404 INFO:tasks.workunit.client.1.smithi194.stdout:2/564: symlink df/d14/d19/lab 0 2024-02-20T08:06:12.404 INFO:tasks.workunit.client.1.smithi194.stdout:0/502: dwrite d6/d2b/d35/d42/d1e/d3c/f68 [0,4194304] 0 2024-02-20T08:06:12.407 INFO:tasks.workunit.client.1.smithi194.stdout:0/503: truncate d6/d2b/d35/d42/d1e/d45/f51 121535 0 2024-02-20T08:06:12.416 INFO:tasks.workunit.client.1.smithi194.stdout:0/504: symlink d6/d2b/d35/d48/d60/d72/la9 0 2024-02-20T08:06:12.417 INFO:tasks.workunit.client.1.smithi194.stdout:8/482: dread d2/d14/f4c [0,4194304] 0 2024-02-20T08:06:12.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/671: write df/f5d [338966,34908] 0 2024-02-20T08:06:12.417 INFO:tasks.workunit.client.1.smithi194.stdout:4/481: dwrite d0/d10/d1c/d4d/d2f/f3d [0,4194304] 0 2024-02-20T08:06:12.419 INFO:tasks.workunit.client.1.smithi194.stdout:8/483: chown d2/fa3 2077 1 2024-02-20T08:06:12.420 INFO:tasks.workunit.client.1.smithi194.stdout:2/565: symlink df/d14/d19/d5c/d60/d63/lac 0 2024-02-20T08:06:12.421 INFO:tasks.workunit.client.1.smithi194.stdout:2/566: write df/f4f [1562251,7577] 0 2024-02-20T08:06:12.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/482: rmdir d0/d2/d3e 39 2024-02-20T08:06:12.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/483: chown d0/d2/d51/l76 7694829 1 2024-02-20T08:06:12.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/672: creat df/dab/d1d/d28/d46/fe7 x:0 0 0 2024-02-20T08:06:12.436 INFO:tasks.workunit.client.1.smithi194.stdout:1/576: sync 2024-02-20T08:06:12.441 INFO:tasks.workunit.client.1.smithi194.stdout:0/505: rename d6/d2b/d35/d39/d55/d59 to d6/d2b/d35/d42/d1e/d45/daa 0 2024-02-20T08:06:12.444 INFO:tasks.workunit.client.1.smithi194.stdout:2/567: mknod df/d14/d24/d56/d6b/cad 0 2024-02-20T08:06:12.448 INFO:tasks.workunit.client.1.smithi194.stdout:5/570: getdents d4/d6/dd/d25/d78/d8b/d8a 0 2024-02-20T08:06:12.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/599: getdents d4/d2d/d42/d4e/d6e/d88 0 2024-02-20T08:06:12.453 INFO:tasks.workunit.client.1.smithi194.stdout:4/484: chown d0/d2/d3e/f5f 5447438 1 2024-02-20T08:06:12.456 INFO:tasks.workunit.client.1.smithi194.stdout:1/577: mknod d2/d1a/d61/d7e/cba 0 2024-02-20T08:06:12.456 INFO:tasks.workunit.client.1.smithi194.stdout:8/484: mknod d2/d14/d18/d45/d4e/ca7 0 2024-02-20T08:06:12.460 INFO:tasks.workunit.client.1.smithi194.stdout:2/568: rename fe to df/d14/d19/d5c/d78/fae 0 2024-02-20T08:06:12.460 INFO:tasks.workunit.client.1.smithi194.stdout:2/569: chown df/d14/d19/d5c/f9f 12617458 1 2024-02-20T08:06:12.461 INFO:tasks.workunit.client.1.smithi194.stdout:5/571: truncate d4/d6/f48 1074641 0 2024-02-20T08:06:12.461 INFO:tasks.workunit.client.1.smithi194.stdout:0/506: dread d6/f29 [0,4194304] 0 2024-02-20T08:06:12.462 INFO:tasks.workunit.client.1.smithi194.stdout:2/570: write df/d14/f47 [4396397,111018] 0 2024-02-20T08:06:12.463 INFO:tasks.workunit.client.1.smithi194.stdout:5/572: dread - d4/d6/d11/d15/d28/d85/d53/fa6 zero size 2024-02-20T08:06:12.464 INFO:tasks.workunit.client.1.smithi194.stdout:2/571: write df/d14/d24/fa8 [818469,120696] 0 2024-02-20T08:06:12.470 INFO:tasks.workunit.client.1.smithi194.stdout:6/673: dwrite df/dab/d1d/d28/d2b/d80/fb1 [0,4194304] 0 2024-02-20T08:06:12.470 INFO:tasks.workunit.client.1.smithi194.stdout:8/485: fsync d2/d14/f76 0 2024-02-20T08:06:12.477 INFO:tasks.workunit.client.1.smithi194.stdout:9/600: fsync d4/fa8 0 2024-02-20T08:06:12.479 INFO:tasks.workunit.client.1.smithi194.stdout:2/572: truncate fc 5832994 0 2024-02-20T08:06:12.481 INFO:tasks.workunit.client.1.smithi194.stdout:0/507: truncate d6/d2b/d35/d42/d1e/d45/d58/f8d 2063779 0 2024-02-20T08:06:12.483 INFO:tasks.workunit.client.1.smithi194.stdout:9/601: dwrite d4/d1b/f74 [0,4194304] 0 2024-02-20T08:06:12.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/508: chown d6/d2b/d35/d42/d1e/d3c/f8a 821640 1 2024-02-20T08:06:12.484 INFO:tasks.workunit.client.1.smithi194.stdout:3/513: sync 2024-02-20T08:06:12.484 INFO:tasks.workunit.client.1.smithi194.stdout:7/563: sync 2024-02-20T08:06:12.486 INFO:tasks.workunit.client.1.smithi194.stdout:0/509: chown d6/d2b/d35/d42/d1e/d3c/da0 4 1 2024-02-20T08:06:12.489 INFO:tasks.workunit.client.1.smithi194.stdout:2/573: dwrite df/d14/d80/d85/f86 [4194304,4194304] 0 2024-02-20T08:06:12.490 INFO:tasks.workunit.client.1.smithi194.stdout:5/573: fsync d4/d6/f48 0 2024-02-20T08:06:12.496 INFO:tasks.workunit.client.1.smithi194.stdout:9/602: rmdir d4/d20/d41 39 2024-02-20T08:06:12.497 INFO:tasks.workunit.client.1.smithi194.stdout:7/564: creat d11/d2d/fa4 x:0 0 0 2024-02-20T08:06:12.497 INFO:tasks.workunit.client.1.smithi194.stdout:9/603: chown d4/de/ca2 165634 1 2024-02-20T08:06:12.505 INFO:tasks.workunit.client.1.smithi194.stdout:2/574: creat df/d14/d19/faf x:0 0 0 2024-02-20T08:06:12.506 INFO:tasks.workunit.client.1.smithi194.stdout:5/574: symlink d4/d20/d2b/d79/lae 0 2024-02-20T08:06:12.507 INFO:tasks.workunit.client.1.smithi194.stdout:4/485: getdents d0/d10/d1c/d21/d62 0 2024-02-20T08:06:12.507 INFO:tasks.workunit.client.1.smithi194.stdout:2/575: read df/f41 [2142721,823] 0 2024-02-20T08:06:12.509 INFO:tasks.workunit.client.1.smithi194.stdout:0/510: dread d6/d2b/d35/d39/d55/f69 [0,4194304] 0 2024-02-20T08:06:12.512 INFO:tasks.workunit.client.1.smithi194.stdout:0/511: dread d6/d2b/d35/d39/d55/f69 [0,4194304] 0 2024-02-20T08:06:12.515 INFO:tasks.workunit.client.1.smithi194.stdout:2/576: dwrite df/d14/d19/d5c/d78/f83 [0,4194304] 0 2024-02-20T08:06:12.524 INFO:tasks.workunit.client.1.smithi194.stdout:1/578: link d2/d8/d60/l88 d2/d1a/d26/d3d/d71/d8c/lbb 0 2024-02-20T08:06:12.527 INFO:tasks.workunit.client.1.smithi194.stdout:7/565: rename d11/d2d/f24 to d11/d2d/d38/d4a/d53/da0/fa5 0 2024-02-20T08:06:12.530 INFO:tasks.workunit.client.1.smithi194.stdout:8/486: creat d2/d14/d18/d45/d4e/fa8 x:0 0 0 2024-02-20T08:06:12.533 INFO:tasks.workunit.client.1.smithi194.stdout:7/566: dwrite d11/d2d/d38/d4a/f21 [0,4194304] 0 2024-02-20T08:06:12.533 INFO:tasks.workunit.client.1.smithi194.stdout:6/674: creat df/dab/d1d/fe8 x:0 0 0 2024-02-20T08:06:12.538 INFO:tasks.workunit.client.1.smithi194.stdout:5/575: write d4/d6/f48 [561503,117237] 0 2024-02-20T08:06:12.538 INFO:tasks.workunit.client.1.smithi194.stdout:4/486: mknod d0/d5c/d60/d4a/c8d 0 2024-02-20T08:06:12.540 INFO:tasks.workunit.client.1.smithi194.stdout:6/675: dwrite df/dab/fd0 [0,4194304] 0 2024-02-20T08:06:12.540 INFO:tasks.workunit.client.1.smithi194.stdout:2/577: dread df/d14/d24/f48 [0,4194304] 0 2024-02-20T08:06:12.541 INFO:tasks.workunit.client.1.smithi194.stdout:4/487: fdatasync d0/d5c/d60/f6e 0 2024-02-20T08:06:12.542 INFO:tasks.workunit.client.1.smithi194.stdout:6/676: chown df/d42/dcf/f87 21270923 1 2024-02-20T08:06:12.543 INFO:tasks.workunit.client.1.smithi194.stdout:4/488: readlink d0/d2/l6c 0 2024-02-20T08:06:12.545 INFO:tasks.workunit.client.1.smithi194.stdout:9/604: unlink d4/d1b/d90/l84 0 2024-02-20T08:06:12.549 INFO:tasks.workunit.client.1.smithi194.stdout:0/512: creat d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/fab x:0 0 0 2024-02-20T08:06:12.552 INFO:tasks.workunit.client.1.smithi194.stdout:0/513: fsync d6/d2b/d35/f53 0 2024-02-20T08:06:12.553 INFO:tasks.workunit.client.1.smithi194.stdout:5/576: dwrite d4/d6/d11/d2f/d77/fa9 [0,4194304] 0 2024-02-20T08:06:12.554 INFO:tasks.workunit.client.1.smithi194.stdout:1/579: rename d2/d1a/d26/d3d/d71/d8c/d34/c54 to d2/d48/cbc 0 2024-02-20T08:06:12.556 INFO:tasks.workunit.client.1.smithi194.stdout:8/487: rmdir d2/d14/d18/d45/d7b 39 2024-02-20T08:06:12.557 INFO:tasks.workunit.client.1.smithi194.stdout:3/514: dwrite d5/d10/d17/f38 [0,4194304] 0 2024-02-20T08:06:12.557 INFO:tasks.workunit.client.1.smithi194.stdout:6/677: dwrite df/dab/f54 [0,4194304] 0 2024-02-20T08:06:12.561 INFO:tasks.workunit.client.1.smithi194.stdout:6/678: chown df/dab/f7a 1791121 1 2024-02-20T08:06:12.561 INFO:tasks.workunit.client.1.smithi194.stdout:8/488: chown f1 1667 1 2024-02-20T08:06:12.566 INFO:tasks.workunit.client.1.smithi194.stdout:6/679: stat df/dab/d1d/d28/d46/d5a/d6b/d83/d93/ldb 0 2024-02-20T08:06:12.567 INFO:tasks.workunit.client.1.smithi194.stdout:0/514: dwrite d6/f1a [4194304,4194304] 0 2024-02-20T08:06:12.568 INFO:tasks.workunit.client.1.smithi194.stdout:0/515: readlink d6/d2b/l78 0 2024-02-20T08:06:12.574 INFO:tasks.workunit.client.1.smithi194.stdout:2/578: write df/d14/d19/d5c/d78/fae [4729727,55977] 0 2024-02-20T08:06:12.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/489: symlink d0/d10/l8e 0 2024-02-20T08:06:12.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/567: symlink d11/d2d/d38/d4a/d53/la6 0 2024-02-20T08:06:12.588 INFO:tasks.workunit.client.1.smithi194.stdout:3/515: fdatasync d5/d10/d8d/f92 0 2024-02-20T08:06:12.591 INFO:tasks.workunit.client.1.smithi194.stdout:6/680: write df/dab/d1d/d28/f78 [2896025,82348] 0 2024-02-20T08:06:12.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/516: mknod d6/d2b/d35/d48/d60/d72/cac 0 2024-02-20T08:06:12.592 INFO:tasks.workunit.client.1.smithi194.stdout:6/681: chown df/dab/lc2 496970978 1 2024-02-20T08:06:12.593 INFO:tasks.workunit.client.1.smithi194.stdout:2/579: unlink df/d14/d24/c49 0 2024-02-20T08:06:12.594 INFO:tasks.workunit.client.1.smithi194.stdout:0/517: readlink d6/d2b/d35/d42/d1e/d3c/l64 0 2024-02-20T08:06:12.594 INFO:tasks.workunit.client.1.smithi194.stdout:3/516: dwrite d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:12.595 INFO:tasks.workunit.client.1.smithi194.stdout:0/518: chown d6/d2b/d35/d39/d8f 3454478 1 2024-02-20T08:06:12.596 INFO:tasks.workunit.client.1.smithi194.stdout:0/519: stat d6/d2b/d35/d42/d1e/l98 0 2024-02-20T08:06:12.604 INFO:tasks.workunit.client.1.smithi194.stdout:0/520: dwrite d6/d2b/d35/d42/d1e/d3c/f68 [0,4194304] 0 2024-02-20T08:06:12.619 INFO:tasks.workunit.client.1.smithi194.stdout:2/580: unlink df/d14/l64 0 2024-02-20T08:06:12.626 INFO:tasks.workunit.client.1.smithi194.stdout:9/605: creat d4/d20/d41/db7/fc7 x:0 0 0 2024-02-20T08:06:12.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.627+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd6810e990 con 0x7fbd5406d3d0 2024-02-20T08:06:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.630+0000 7fbd5dffb700 1 -- 172.21.15.123:0/2243166842 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fbd6810e990 con 0x7fbd5406d3d0 2024-02-20T08:06:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 msgr2=0x7fbd5406f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 0x7fbd5406f880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004f90 tx=0x7fbd58009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 msgr2=0x7fbd6810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b790 tx=0x7fbd64009220 comp rx=0 tx=0).stop 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 shutdown_connections 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fbd5406d3d0 0x7fbd5406f880 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004f90 tx=0x7fbd58009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd680fb5e0 0x7fbd6810c940 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 --2- 172.21.15.123:0/2243166842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd680fc7f0 0x7fbd6810ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.634+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 >> 172.21.15.123:0/2243166842 conn(0x7fbd680f6ca0 msgr2=0x7fbd680f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:12.638 INFO:tasks.workunit.client.1.smithi194.stdout:0/521: creat d6/fad x:0 0 0 2024-02-20T08:06:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.637+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 shutdown_connections 2024-02-20T08:06:12.640 INFO:tasks.workunit.client.1.smithi194.stdout:2/581: rmdir df/d14/d80 39 2024-02-20T08:06:12.641 INFO:tasks.workunit.client.1.smithi194.stdout:2/582: fdatasync df/d14/f47 0 2024-02-20T08:06:12.642 INFO:tasks.workunit.client.1.smithi194.stdout:0/522: dread d6/d2b/d35/d39/f8e [0,4194304] 0 2024-02-20T08:06:12.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.642+0000 7fbd6f7a3700 1 -- 172.21.15.123:0/2243166842 wait complete. 2024-02-20T08:06:12.644 INFO:tasks.workunit.client.1.smithi194.stdout:4/490: rename d0/d2/l29 to d0/df/l8f 0 2024-02-20T08:06:12.647 INFO:tasks.workunit.client.1.smithi194.stdout:3/517: creat d5/d10/d16/d7b/d94/f9b x:0 0 0 2024-02-20T08:06:12.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/568: symlink d11/d2d/d38/d37/d43/d8e/d6b/la7 0 2024-02-20T08:06:12.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/569: read - d11/d2d/f8a zero size 2024-02-20T08:06:12.655 INFO:tasks.workunit.client.1.smithi194.stdout:5/577: truncate d4/d6/d11/d2f/f68 190088 0 2024-02-20T08:06:12.660 INFO:tasks.workunit.client.1.smithi194.stdout:9/606: dread d4/f5 [0,4194304] 0 2024-02-20T08:06:12.661 INFO:tasks.workunit.client.1.smithi194.stdout:9/607: truncate d4/d8b/fa4 966161 0 2024-02-20T08:06:12.661 INFO:tasks.workunit.client.1.smithi194.stdout:0/523: creat d6/d2b/d35/fae x:0 0 0 2024-02-20T08:06:12.662 INFO:tasks.workunit.client.1.smithi194.stdout:0/524: write d6/d2b/d35/d42/d1e/d45/d58/f9e [2487340,4704] 0 2024-02-20T08:06:12.663 INFO:tasks.workunit.client.1.smithi194.stdout:6/682: write df/dab/d1d/d28/d5e/f69 [1831753,70638] 0 2024-02-20T08:06:12.665 INFO:tasks.workunit.client.1.smithi194.stdout:2/583: rename df/d14/f1d to df/d14/d19/d96/fb0 0 2024-02-20T08:06:12.668 INFO:tasks.workunit.client.1.smithi194.stdout:8/489: link d2/d14/d18/d45/d69/l8b d2/d14/d18/d45/d7b/la9 0 2024-02-20T08:06:12.673 INFO:tasks.workunit.client.1.smithi194.stdout:9/608: mkdir d4/d2d/dc8 0 2024-02-20T08:06:12.674 INFO:tasks.workunit.client.1.smithi194.stdout:9/609: truncate d4/d20/fbe 1294035 0 2024-02-20T08:06:12.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/610: read - d4/d20/d41/db7/fc7 zero size 2024-02-20T08:06:12.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/611: fsync d4/d20/f82 0 2024-02-20T08:06:12.682 INFO:tasks.workunit.client.1.smithi194.stdout:2/584: dread df/d14/d24/d56/f7c [0,4194304] 0 2024-02-20T08:06:12.683 INFO:tasks.workunit.client.1.smithi194.stdout:2/585: write df/d14/f32 [5413,94322] 0 2024-02-20T08:06:12.684 INFO:tasks.workunit.client.1.smithi194.stdout:2/586: fdatasync df/d14/d19/d5c/fa6 0 2024-02-20T08:06:12.692 INFO:tasks.workunit.client.1.smithi194.stdout:8/490: symlink d2/d14/d18/d45/d4e/d6c/d78/laa 0 2024-02-20T08:06:12.692 INFO:tasks.workunit.client.1.smithi194.stdout:5/578: write d4/d6/f1f [628383,52467] 0 2024-02-20T08:06:12.693 INFO:tasks.workunit.client.1.smithi194.stdout:5/579: readlink d4/d6/dd/d3a/l9d 0 2024-02-20T08:06:12.697 INFO:tasks.workunit.client.1.smithi194.stdout:0/525: getdents d6/d2b/d35/d9c/d9f/da6 0 2024-02-20T08:06:12.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/518: truncate d5/df/f76 2478996 0 2024-02-20T08:06:12.702 INFO:tasks.workunit.client.1.smithi194.stdout:7/570: truncate d11/d2d/d38/d37/d3c/f4c 2896459 0 2024-02-20T08:06:12.706 INFO:tasks.workunit.client.1.smithi194.stdout:6/683: truncate df/dab/f2c 1604118 0 2024-02-20T08:06:12.713 INFO:tasks.workunit.client.1.smithi194.stdout:6/684: dwrite df/dab/d1d/fdf [0,4194304] 0 2024-02-20T08:06:12.718 INFO:tasks.workunit.client.1.smithi194.stdout:4/491: getdents d0 0 2024-02-20T08:06:12.724 INFO:tasks.workunit.client.1.smithi194.stdout:4/492: dread d0/d10/d1c/d4d/d2f/f3d [0,4194304] 0 2024-02-20T08:06:12.724 INFO:tasks.workunit.client.1.smithi194.stdout:7/571: mknod d11/d2d/d38/d4a/d27/ca8 0 2024-02-20T08:06:12.724 INFO:tasks.workunit.client.1.smithi194.stdout:2/587: symlink df/lb1 0 2024-02-20T08:06:12.728 INFO:tasks.workunit.client.1.smithi194.stdout:0/526: dwrite d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:12.728 INFO:tasks.workunit.client.1.smithi194.stdout:8/491: link d2/f39 d2/d14/d18/d45/d4e/d9f/fab 0 2024-02-20T08:06:12.771 INFO:tasks.workunit.client.1.smithi194.stdout:9/612: creat d4/d20/d5c/fc9 x:0 0 0 2024-02-20T08:06:12.772 INFO:tasks.workunit.client.1.smithi194.stdout:2/588: rename df/d14/d19/da1 to df/d3a/db2 0 2024-02-20T08:06:12.777 INFO:tasks.workunit.client.1.smithi194.stdout:7/572: dread d11/d2d/d38/d37/d43/d7b/d91/f98 [0,4194304] 0 2024-02-20T08:06:12.777 INFO:tasks.workunit.client.1.smithi194.stdout:1/580: sync 2024-02-20T08:06:12.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/573: readlink d11/l6c 0 2024-02-20T08:06:12.781 INFO:tasks.workunit.client.1.smithi194.stdout:9/613: dwrite d4/d20/d41/fc3 [0,4194304] 0 2024-02-20T08:06:12.781 INFO:tasks.workunit.client.1.smithi194.stdout:7/574: write d11/d2d/d38/d4a/d27/f4e [2630542,54223] 0 2024-02-20T08:06:12.782 INFO:tasks.workunit.client.1.smithi194.stdout:2/589: dwrite df/d14/d19/d5c/d97/d9a/fa3 [0,4194304] 0 2024-02-20T08:06:12.782 INFO:tasks.workunit.client.1.smithi194.stdout:5/580: getdents d4/d20/d2b 0 2024-02-20T08:06:12.784 INFO:tasks.workunit.client.1.smithi194.stdout:2/590: readlink df/d5b/d61/la0 0 2024-02-20T08:06:12.790 INFO:tasks.workunit.client.1.smithi194.stdout:7/575: dwrite d11/d2d/d38/d4a/d60/f64 [0,4194304] 0 2024-02-20T08:06:12.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/492: write d2/f2e [730263,72564] 0 2024-02-20T08:06:12.794 INFO:tasks.workunit.client.1.smithi194.stdout:3/519: getdents d5 0 2024-02-20T08:06:12.795 INFO:tasks.workunit.client.1.smithi194.stdout:3/520: chown d5/d10/d28/d41/d73/d8c 1981392 1 2024-02-20T08:06:12.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/581: mknod d4/d6/caf 0 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3921715222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fcef0 msgr2=0x7fb1bc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3921715222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fcef0 0x7fb1bc0fd320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8004970 tx=0x7fb1b8009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3921715222 shutdown_connections 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3921715222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3921715222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fcef0 0x7fb1bc0fd320 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8004970 tx=0x7fb1b8009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.813+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3921715222 >> 172.21.15.123:0/3921715222 conn(0x7fb1bc0f8620 msgr2=0x7fb1bc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:12.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.814+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3921715222 shutdown_connections 2024-02-20T08:06:12.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.814+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3921715222 wait complete. 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 Processor -- start 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 -- start start 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 0x7fb1bc10ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc10e4a0 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c41bc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc10e5e0 con 0x7fb1bc0fe0e0 2024-02-20T08:06:12.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.815+0000 7fb1c1f58700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1f58700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc10daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:54782/0 (socket says 172.21.15.123:54782) 2024-02-20T08:06:12.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1f58700 1 -- 172.21.15.123:0/3933403384 learned_addr learned my addr 172.21.15.123:0/3933403384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:12.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1757700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 0x7fb1bc10ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1757700 1 -- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 msgr2=0x7fb1bc10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1757700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.816+0000 7fb1c1757700 1 -- 172.21.15.123:0/3933403384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8005040 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1c1757700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 0x7fb1bc10ee80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac002820 tx=0x7fb1ac004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ac007cc0 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc10f4e0 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1ac00f040 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ac013920 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.817+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc10f9f0 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.819 INFO:tasks.workunit.client.1.smithi194.stdout:0/527: creat d6/d2b/d35/d42/d1e/d3c/faf x:0 0 0 2024-02-20T08:06:12.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.819+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc04bed0 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.819+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 25) v1 ==== 88916+0+0 (secure 0 0 0) 0x7fb1ac013b80 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.819+0000 7fb1b27fc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 0x7fb1a806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:12.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.819+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb1ac089860 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.820+0000 7fb1c1f58700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 0x7fb1a806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:12.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.820+0000 7fb1c1f58700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 0x7fb1a806d740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800b800 tx=0x7fb1b8009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:12.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/576: creat d11/d2d/d38/d37/d43/d8e/d6b/fa9 x:0 0 0 2024-02-20T08:06:12.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/685: write df/d18/f49 [1513700,35264] 0 2024-02-20T08:06:12.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/577: stat d11/l41 0 2024-02-20T08:06:12.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/581: symlink d2/d1a/d26/lbd 0 2024-02-20T08:06:12.826 INFO:tasks.workunit.client.1.smithi194.stdout:1/582: readlink d2/d48/l6f 0 2024-02-20T08:06:12.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:12.827+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb1ac057540 con 0x7fb1bc10dfe0 2024-02-20T08:06:12.827 INFO:tasks.workunit.client.1.smithi194.stdout:8/493: dwrite d2/f1f [0,4194304] 0 2024-02-20T08:06:12.828 INFO:tasks.workunit.client.1.smithi194.stdout:5/582: mkdir d4/d6/d11/d15/d28/d85/d53/db0 0 2024-02-20T08:06:12.832 INFO:tasks.workunit.client.1.smithi194.stdout:7/578: creat d11/d2d/d38/d4a/d53/da0/faa x:0 0 0 2024-02-20T08:06:12.836 INFO:tasks.workunit.client.1.smithi194.stdout:6/686: dread df/d42/f4f [0,4194304] 0 2024-02-20T08:06:12.838 INFO:tasks.workunit.client.1.smithi194.stdout:9/614: creat d4/d20/d5c/fca x:0 0 0 2024-02-20T08:06:12.845 INFO:tasks.workunit.client.1.smithi194.stdout:5/583: mknod d4/d6/dd/d3a/cb1 0 2024-02-20T08:06:12.847 INFO:tasks.workunit.client.1.smithi194.stdout:7/579: dread d11/d2d/d38/f22 [0,4194304] 0 2024-02-20T08:06:12.848 INFO:tasks.workunit.client.1.smithi194.stdout:7/580: truncate d11/d2d/d38/d4a/d27/f76 200404 0 2024-02-20T08:06:12.849 INFO:tasks.workunit.client.1.smithi194.stdout:2/591: write df/d14/d19/d96/fb0 [4418729,38261] 0 2024-02-20T08:06:12.851 INFO:tasks.workunit.client.1.smithi194.stdout:8/494: mknod d2/d14/d18/d45/d4e/d6c/d78/cac 0 2024-02-20T08:06:12.853 INFO:tasks.workunit.client.1.smithi194.stdout:0/528: mknod d6/d2b/d35/d9c/cb0 0 2024-02-20T08:06:12.853 INFO:tasks.workunit.client.1.smithi194.stdout:7/581: dwrite d11/f1a [0,4194304] 0 2024-02-20T08:06:12.857 INFO:tasks.workunit.client.1.smithi194.stdout:1/583: write d2/d1a/d26/d3d/d71/d8c/f46 [1065129,10665] 0 2024-02-20T08:06:12.858 INFO:tasks.workunit.client.1.smithi194.stdout:6/687: truncate df/dab/d1d/d28/d2b/d80/fb7 819126 0 2024-02-20T08:06:12.863 INFO:tasks.workunit.client.1.smithi194.stdout:5/584: creat d4/d6/d11/d2f/fb2 x:0 0 0 2024-02-20T08:06:12.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/592: symlink df/d14/d19/d5c/d97/d9a/lb3 0 2024-02-20T08:06:12.868 INFO:tasks.workunit.client.1.smithi194.stdout:5/585: dread d4/d6/f75 [0,4194304] 0 2024-02-20T08:06:12.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/495: fsync d2/f5b 0 2024-02-20T08:06:12.868 INFO:tasks.workunit.client.1.smithi194.stdout:2/593: fdatasync df/d3a/f53 0 2024-02-20T08:06:12.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/496: fdatasync d2/f9e 0 2024-02-20T08:06:12.870 INFO:tasks.workunit.client.1.smithi194.stdout:0/529: unlink d6/d2b/f96 0 2024-02-20T08:06:12.871 INFO:tasks.workunit.client.1.smithi194.stdout:8/497: write d2/d14/d18/d45/d4e/d6c/d78/d98/f86 [1582265,36531] 0 2024-02-20T08:06:12.871 INFO:tasks.workunit.client.1.smithi194.stdout:8/498: readlink d2/l8d 0 2024-02-20T08:06:12.872 INFO:tasks.workunit.client.1.smithi194.stdout:8/499: chown d2/d14/d18/d45/d4e/d6c/d78/laa 65489706 1 2024-02-20T08:06:12.874 INFO:tasks.workunit.client.1.smithi194.stdout:3/521: getdents d5/d10 0 2024-02-20T08:06:12.875 INFO:tasks.workunit.client.1.smithi194.stdout:1/584: mkdir d2/d1a/d61/d7e/dbe 0 2024-02-20T08:06:12.875 INFO:tasks.workunit.client.1.smithi194.stdout:1/585: chown d2/f42 83402 1 2024-02-20T08:06:12.878 INFO:tasks.workunit.client.1.smithi194.stdout:9/615: fsync d4/d1b/f72 0 2024-02-20T08:06:12.879 INFO:tasks.workunit.client.1.smithi194.stdout:9/616: write d4/de/f2a [1067044,42553] 0 2024-02-20T08:06:12.886 INFO:tasks.workunit.client.1.smithi194.stdout:2/594: symlink df/d14/d24/d56/d6b/lb4 0 2024-02-20T08:06:12.887 INFO:tasks.workunit.client.1.smithi194.stdout:2/595: write df/f72 [3808107,87899] 0 2024-02-20T08:06:12.888 INFO:tasks.workunit.client.1.smithi194.stdout:2/596: read - df/d14/d19/d5c/d78/f90 zero size 2024-02-20T08:06:12.888 INFO:tasks.workunit.client.1.smithi194.stdout:5/586: rename d4/d6/dd/d25/d78/d8b/fa3 to d4/d6/fb3 0 2024-02-20T08:06:12.889 INFO:tasks.workunit.client.1.smithi194.stdout:0/530: rename d6 to d6/d2b/d35/d42/d1e/d45/d58/db1 22 2024-02-20T08:06:12.892 INFO:tasks.workunit.client.1.smithi194.stdout:7/582: symlink d11/d2d/d38/d37/d3c/d8d/lab 0 2024-02-20T08:06:12.893 INFO:tasks.workunit.client.1.smithi194.stdout:8/500: mknod d2/d14/d18/cad 0 2024-02-20T08:06:12.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/522: mknod d5/d10/d16/d7b/d94/c9c 0 2024-02-20T08:06:12.895 INFO:tasks.workunit.client.1.smithi194.stdout:1/586: mkdir d2/d1a/d61/d7d/dbf 0 2024-02-20T08:06:12.905 INFO:tasks.workunit.client.1.smithi194.stdout:9/617: mkdir d4/d20/d43/daa/dcb 0 2024-02-20T08:06:12.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:12 smithi123 ceph-mon[29383]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:12.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:12 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:12.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:12 smithi123 ceph-mon[29383]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:12.913 INFO:tasks.workunit.client.1.smithi194.stdout:6/688: truncate df/dab/d1d/d28/d46/d5a/f71 1139619 0 2024-02-20T08:06:12.915 INFO:tasks.workunit.client.1.smithi194.stdout:2/597: mknod df/d3a/db2/cb5 0 2024-02-20T08:06:12.921 INFO:tasks.workunit.client.1.smithi194.stdout:5/587: rename d4/d6/d11/d15/d28/d85/d53/f64 to d4/d6/dd/d25/d78/d8b/fb4 0 2024-02-20T08:06:12.922 INFO:tasks.workunit.client.1.smithi194.stdout:8/501: write d2/d14/f24 [4830540,49772] 0 2024-02-20T08:06:12.923 INFO:tasks.workunit.client.1.smithi194.stdout:3/523: symlink d5/d10/d17/l9d 0 2024-02-20T08:06:12.923 INFO:tasks.workunit.client.1.smithi194.stdout:5/588: write d4/d6/dd/d25/d78/d8b/f24 [8346573,81768] 0 2024-02-20T08:06:12.934 INFO:tasks.workunit.client.1.smithi194.stdout:7/583: symlink d11/lac 0 2024-02-20T08:06:12.935 INFO:tasks.workunit.client.1.smithi194.stdout:9/618: rename d4/d20/d5c/f24 to d4/de/dc4/fcc 0 2024-02-20T08:06:12.935 INFO:tasks.workunit.client.1.smithi194.stdout:6/689: getdents df/dab/d1d/d28/d46/d5a/d6b/d83/db3 0 2024-02-20T08:06:12.938 INFO:tasks.workunit.client.1.smithi194.stdout:6/690: write df/dab/d1d/fdf [593633,36486] 0 2024-02-20T08:06:12.951 INFO:tasks.workunit.client.1.smithi194.stdout:0/531: getdents d6/d2b/d35/d42/d1e/d45/daa/d77 0 2024-02-20T08:06:12.955 INFO:tasks.workunit.client.1.smithi194.stdout:5/589: dread d4/d6/fa [0,4194304] 0 2024-02-20T08:06:12.956 INFO:tasks.workunit.client.1.smithi194.stdout:5/590: chown d4/d6/d11/d15/d28/f39 466749 1 2024-02-20T08:06:12.956 INFO:tasks.workunit.client.1.smithi194.stdout:9/619: unlink d4/d20/d41/fc3 0 2024-02-20T08:06:12.956 INFO:tasks.workunit.client.1.smithi194.stdout:0/532: dwrite d6/f1a [4194304,4194304] 0 2024-02-20T08:06:12.957 INFO:tasks.workunit.client.1.smithi194.stdout:5/591: chown d4/d6/dd/d3a/l9c 20549101 1 2024-02-20T08:06:12.963 INFO:tasks.workunit.client.1.smithi194.stdout:5/592: dwrite d4/d6/d11/d2f/d77/fa9 [0,4194304] 0 2024-02-20T08:06:12.964 INFO:tasks.workunit.client.1.smithi194.stdout:7/584: creat d11/d2d/d38/d4a/d53/d81/fad x:0 0 0 2024-02-20T08:06:12.966 INFO:tasks.workunit.client.1.smithi194.stdout:2/598: write df/d14/d24/f2d [266811,73362] 0 2024-02-20T08:06:12.967 INFO:tasks.workunit.client.1.smithi194.stdout:2/599: chown df/d14/d19/c4b 0 1 2024-02-20T08:06:12.970 INFO:tasks.workunit.client.1.smithi194.stdout:2/600: fdatasync df/d14/d24/d56/d6b/d81/f79 0 2024-02-20T08:06:12.971 INFO:tasks.workunit.client.1.smithi194.stdout:7/585: dwrite d11/d2d/d38/d37/d3c/f42 [0,4194304] 0 2024-02-20T08:06:12.974 INFO:tasks.workunit.client.1.smithi194.stdout:6/691: dwrite df/d18/f77 [0,4194304] 0 2024-02-20T08:06:12.984 INFO:tasks.workunit.client.1.smithi194.stdout:9/620: chown d4/d37/fb8 3444257 1 2024-02-20T08:06:12.985 INFO:tasks.workunit.client.1.smithi194.stdout:8/502: truncate d2/d14/f24 2652762 0 2024-02-20T08:06:12.986 INFO:tasks.workunit.client.1.smithi194.stdout:0/533: creat d6/d2b/d35/d48/d60/fb2 x:0 0 0 2024-02-20T08:06:12.990 INFO:tasks.workunit.client.1.smithi194.stdout:5/593: creat d4/d6/dd/d25/fb5 x:0 0 0 2024-02-20T08:06:12.990 INFO:tasks.workunit.client.1.smithi194.stdout:5/594: write d4/fc [3288859,128793] 0 2024-02-20T08:06:12.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/595: write d4/d6/dd/d25/f29 [938394,31615] 0 2024-02-20T08:06:12.992 INFO:tasks.workunit.client.1.smithi194.stdout:5/596: fsync d4/d6/dd/d3a/f9e 0 2024-02-20T08:06:12.998 INFO:tasks.workunit.client.1.smithi194.stdout:0/534: mknod d6/d2b/d35/d42/d1e/d45/daa/d77/cb3 0 2024-02-20T08:06:12.999 INFO:tasks.workunit.client.1.smithi194.stdout:0/535: chown d6/d2b/d35/d42/d1e/d45/daa/d77/d7f 67694 1 2024-02-20T08:06:13.001 INFO:tasks.workunit.client.1.smithi194.stdout:5/597: truncate d4/d6/d11/f7e 36721 0 2024-02-20T08:06:13.002 INFO:tasks.workunit.client.1.smithi194.stdout:5/598: stat d4/d6/d11/d15/d28/d85 0 2024-02-20T08:06:13.002 INFO:tasks.workunit.client.1.smithi194.stdout:2/601: symlink df/d14/d24/d56/d6b/d9e/lb6 0 2024-02-20T08:06:13.004 INFO:tasks.workunit.client.1.smithi194.stdout:4/493: sync 2024-02-20T08:06:13.004 INFO:tasks.workunit.client.1.smithi194.stdout:4/494: truncate d0/d10/f83 741097 0 2024-02-20T08:06:13.005 INFO:tasks.workunit.client.1.smithi194.stdout:6/692: creat df/dab/d1d/d28/d46/d5a/d7d/dd4/fe9 x:0 0 0 2024-02-20T08:06:13.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/621: unlink d4/d37/d4f/d91/f9c 0 2024-02-20T08:06:13.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/503: fdatasync d2/d14/d18/d45/d4e/d6c/d78/d98/f86 0 2024-02-20T08:06:13.013 INFO:tasks.workunit.client.1.smithi194.stdout:2/602: mkdir df/d14/d24/d56/d6b/db7 0 2024-02-20T08:06:13.014 INFO:tasks.workunit.client.1.smithi194.stdout:2/603: fsync df/d14/d24/fa8 0 2024-02-20T08:06:13.014 INFO:tasks.workunit.client.1.smithi194.stdout:5/599: mkdir d4/d6/dd/d25/d78/d8b/d8a/db6 0 2024-02-20T08:06:13.015 INFO:tasks.workunit.client.1.smithi194.stdout:3/524: truncate d5/d10/d28/f45 8111049 0 2024-02-20T08:06:13.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/495: unlink d0/d10/d1c/d21/f75 0 2024-02-20T08:06:13.020 INFO:tasks.workunit.client.1.smithi194.stdout:4/496: write d0/d2/f35 [7584124,59340] 0 2024-02-20T08:06:13.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/497: write d0/f7f [228380,104988] 0 2024-02-20T08:06:13.021 INFO:tasks.workunit.client.1.smithi194.stdout:7/586: rename d11/d2d/d38/d4a/c45 to d11/d2d/d38/d37/d43/d8e/cae 0 2024-02-20T08:06:13.026 INFO:tasks.workunit.client.1.smithi194.stdout:6/693: creat df/dab/d1d/d28/d46/d5a/d6b/d83/fea x:0 0 0 2024-02-20T08:06:13.028 INFO:tasks.workunit.client.1.smithi194.stdout:6/694: write df/dab/d1d/d28/d2b/d80/fb1 [3264829,68631] 0 2024-02-20T08:06:13.029 INFO:tasks.workunit.client.1.smithi194.stdout:6/695: chown df/dab/d1d/d28/d46/d5a/d7d/dd4/fe9 107990 1 2024-02-20T08:06:13.031 INFO:tasks.workunit.client.1.smithi194.stdout:0/536: mknod d6/d2b/d35/d9c/cb4 0 2024-02-20T08:06:13.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/525: mkdir d5/d9e 0 2024-02-20T08:06:13.052 INFO:tasks.workunit.client.1.smithi194.stdout:4/498: creat d0/d10/d1c/d4d/f90 x:0 0 0 2024-02-20T08:06:13.052 INFO:tasks.workunit.client.1.smithi194.stdout:1/587: sync 2024-02-20T08:06:13.052 INFO:tasks.workunit.client.1.smithi194.stdout:1/588: chown d2/d8/f85 738 1 2024-02-20T08:06:13.053 INFO:tasks.workunit.client.1.smithi194.stdout:7/587: creat d11/d2d/d38/d4a/d27/d51/d77/faf x:0 0 0 2024-02-20T08:06:13.058 INFO:tasks.workunit.client.1.smithi194.stdout:1/589: dwrite d2/d1a/d26/f40 [0,4194304] 0 2024-02-20T08:06:13.060 INFO:tasks.workunit.client.1.smithi194.stdout:6/696: rmdir df/d42/dcf 39 2024-02-20T08:06:13.061 INFO:tasks.workunit.client.1.smithi194.stdout:6/697: write df/d42/f65 [2856771,55240] 0 2024-02-20T08:06:13.062 INFO:tasks.workunit.client.1.smithi194.stdout:6/698: dread - df/dab/d1d/d28/fb9 zero size 2024-02-20T08:06:13.072 INFO:tasks.workunit.client.1.smithi194.stdout:3/526: creat d5/df/d25/f9f x:0 0 0 2024-02-20T08:06:13.075 INFO:tasks.workunit.client.1.smithi194.stdout:3/527: read - d5/d10/d28/d41/d73/f79 zero size 2024-02-20T08:06:13.076 INFO:tasks.workunit.client.1.smithi194.stdout:5/600: dwrite d4/d20/d2b/f2c [0,4194304] 0 2024-02-20T08:06:13.082 INFO:tasks.workunit.client.1.smithi194.stdout:8/504: creat d2/d14/d18/d45/d4e/fae x:0 0 0 2024-02-20T08:06:13.084 INFO:tasks.workunit.client.1.smithi194.stdout:2/604: truncate df/f21 3512163 0 2024-02-20T08:06:13.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/605: write df/d14/f32 [4723306,106002] 0 2024-02-20T08:06:13.088 INFO:tasks.workunit.client.1.smithi194.stdout:8/505: dwrite d2/d14/f6a [0,4194304] 0 2024-02-20T08:06:13.090 INFO:tasks.workunit.client.1.smithi194.stdout:3/528: chown d5/df/f76 732 1 2024-02-20T08:06:13.092 INFO:tasks.workunit.client.1.smithi194.stdout:7/588: rename cb to d11/d2d/d38/d37/d43/d7b/d91/d9c/cb0 0 2024-02-20T08:06:13.092 INFO:tasks.workunit.client.1.smithi194.stdout:4/499: dwrite d0/d5c/d60/f39 [0,4194304] 0 2024-02-20T08:06:13.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/622: getdents d4/d1b/d79 0 2024-02-20T08:06:13.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/623: chown d4/d2d/d59 9 1 2024-02-20T08:06:13.100 INFO:tasks.workunit.client.1.smithi194.stdout:0/537: truncate d6/d2b/d35/d42/d1e/d3c/f68 1303298 0 2024-02-20T08:06:13.100 INFO:tasks.workunit.client.1.smithi194.stdout:0/538: dread - d6/d2b/d35/d48/fa1 zero size 2024-02-20T08:06:13.104 INFO:tasks.workunit.client.1.smithi194.stdout:8/506: mkdir d2/d14/d18/d45/d69/daf 0 2024-02-20T08:06:13.106 INFO:tasks.workunit.client.1.smithi194.stdout:8/507: write d2/f31 [2374462,72186] 0 2024-02-20T08:06:13.108 INFO:tasks.workunit.client.1.smithi194.stdout:0/539: dwrite d6/d2b/d35/f53 [0,4194304] 0 2024-02-20T08:06:13.110 INFO:tasks.workunit.client.1.smithi194.stdout:0/540: write d6/d2b/d35/d9c/f5f [803333,5765] 0 2024-02-20T08:06:13.112 INFO:tasks.workunit.client.1.smithi194.stdout:2/606: mkdir df/d14/d80/d85/db8 0 2024-02-20T08:06:13.113 INFO:tasks.workunit.client.1.smithi194.stdout:2/607: stat df/d14/d24/d56/c98 0 2024-02-20T08:06:13.115 INFO:tasks.workunit.client.1.smithi194.stdout:2/608: write df/d14/d19/d5c/d60/f7f [773231,114378] 0 2024-02-20T08:06:13.120 INFO:tasks.workunit.client.1.smithi194.stdout:5/601: link d4/d6/dd/d25/la8 d4/d6/dd/d3a/d86/lb7 0 2024-02-20T08:06:13.127 INFO:tasks.workunit.client.1.smithi194.stdout:8/508: symlink d2/d14/d18/d45/d4e/d6c/lb0 0 2024-02-20T08:06:13.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/500: link d0/df/d41/f66 d0/df/d41/d69/f91 0 2024-02-20T08:06:13.132 INFO:tasks.workunit.client.1.smithi194.stdout:3/529: truncate d5/d10/d16/f59 2032495 0 2024-02-20T08:06:13.135 INFO:tasks.workunit.client.1.smithi194.stdout:5/602: symlink d4/d6/d11/d15/d28/lb8 0 2024-02-20T08:06:13.135 INFO:tasks.workunit.client.1.smithi194.stdout:2/609: dread df/d14/d24/d56/f7c [0,4194304] 0 2024-02-20T08:06:13.137 INFO:tasks.workunit.client.1.smithi194.stdout:1/590: rename d2/d1a/d26/f6a to d2/d1a/fc0 0 2024-02-20T08:06:13.140 INFO:tasks.workunit.client.1.smithi194.stdout:4/501: mknod d0/df/d11/c92 0 2024-02-20T08:06:13.140 INFO:tasks.workunit.client.1.smithi194.stdout:3/530: mknod d5/d10/d28/ca0 0 2024-02-20T08:06:13.141 INFO:tasks.workunit.client.1.smithi194.stdout:3/531: fdatasync d5/d10/d16/f63 0 2024-02-20T08:06:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:12 smithi194 ceph-mon[37804]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:12 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:12 smithi194 ceph-mon[37804]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:13.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/610: dread df/d14/d24/f2d [0,4194304] 0 2024-02-20T08:06:13.149 INFO:tasks.workunit.client.1.smithi194.stdout:6/699: rename df/dab/d1d/d28/d5e/c5f to df/d42/dcf/ceb 0 2024-02-20T08:06:13.155 INFO:tasks.workunit.client.1.smithi194.stdout:8/509: dread d2/d14/d18/f61 [0,4194304] 0 2024-02-20T08:06:13.158 INFO:tasks.workunit.client.1.smithi194.stdout:1/591: unlink d2/d1a/d26/d3d/d82/l92 0 2024-02-20T08:06:13.158 INFO:tasks.workunit.client.1.smithi194.stdout:4/502: dread d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:13.162 INFO:tasks.workunit.client.1.smithi194.stdout:0/541: write d6/d2b/d35/d42/d1e/d45/d58/f8d [1237386,100402] 0 2024-02-20T08:06:13.163 INFO:tasks.workunit.client.1.smithi194.stdout:5/603: symlink d4/d6/da5/lb9 0 2024-02-20T08:06:13.168 INFO:tasks.workunit.client.1.smithi194.stdout:7/589: rename d11/d2d/d38/d4a/d27/f4e to d11/d2d/d38/d37/d43/d7b/d91/fb1 0 2024-02-20T08:06:13.170 INFO:tasks.workunit.client.1.smithi194.stdout:7/590: read d11/d2d/d38/d37/f59 [1913494,13610] 0 2024-02-20T08:06:13.173 INFO:tasks.workunit.client.1.smithi194.stdout:9/624: link d4/d20/d5c/f31 d4/d20/d5c/fcd 0 2024-02-20T08:06:13.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/625: read d4/d1b/d79/f89 [2383953,82225] 0 2024-02-20T08:06:13.176 INFO:tasks.workunit.client.1.smithi194.stdout:3/532: symlink d5/d10/d17/d1d/la1 0 2024-02-20T08:06:13.177 INFO:tasks.workunit.client.1.smithi194.stdout:7/591: dwrite d11/d2d/d38/d4a/f62 [0,4194304] 0 2024-02-20T08:06:13.179 INFO:tasks.workunit.client.1.smithi194.stdout:9/626: stat d4/d20/d43/f47 0 2024-02-20T08:06:13.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/604: creat d4/d6/dd/d25/d7d/fba x:0 0 0 2024-02-20T08:06:13.180 INFO:tasks.workunit.client.1.smithi194.stdout:0/542: chown d6/d2b/d35/d42/f16 149 1 2024-02-20T08:06:13.184 INFO:tasks.workunit.client.1.smithi194.stdout:5/605: fdatasync d4/d20/faa 0 2024-02-20T08:06:13.185 INFO:tasks.workunit.client.1.smithi194.stdout:4/503: rename d0/d2/d3e/f5f to d0/d10/d1c/d21/d62/f93 0 2024-02-20T08:06:13.186 INFO:tasks.workunit.client.1.smithi194.stdout:6/700: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec 0 2024-02-20T08:06:13.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.187+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1bc102ac0 con 0x7fb1a806b290 2024-02-20T08:06:13.188 INFO:tasks.workunit.client.1.smithi194.stdout:8/510: dwrite d2/d14/d18/f7f [0,4194304] 0 2024-02-20T08:06:13.192 INFO:tasks.workunit.client.1.smithi194.stdout:2/611: dwrite df/d14/d24/f4e [0,4194304] 0 2024-02-20T08:06:13.193 INFO:tasks.workunit.client.1.smithi194.stdout:2/612: stat df/d14/d19/d5c 0 2024-02-20T08:06:13.194 INFO:tasks.workunit.client.1.smithi194.stdout:7/592: creat d11/d2d/fb2 x:0 0 0 2024-02-20T08:06:13.195 INFO:tasks.workunit.client.1.smithi194.stdout:3/533: creat d5/d10/d62/fa2 x:0 0 0 2024-02-20T08:06:13.195 INFO:tasks.workunit.client.1.smithi194.stdout:6/701: dread df/f5d [0,4194304] 0 2024-02-20T08:06:13.198 INFO:tasks.workunit.client.1.smithi194.stdout:3/534: dread - d5/d10/d62/fa2 zero size 2024-02-20T08:06:13.199 INFO:tasks.workunit.client.1.smithi194.stdout:7/593: truncate d11/d2d/fa4 669230 0 2024-02-20T08:06:13.202 INFO:tasks.workunit.client.1.smithi194.stdout:3/535: chown d5/df/f67 1645197352 1 2024-02-20T08:06:13.203 INFO:tasks.workunit.client.1.smithi194.stdout:5/606: chown d4/d20/l47 0 1 2024-02-20T08:06:13.206 INFO:tasks.workunit.client.1.smithi194.stdout:4/504: truncate d0/df/f3b 1821831 0 2024-02-20T08:06:13.206 INFO:tasks.workunit.client.1.smithi194.stdout:0/543: rename d6/d2b/d35/d42/d1e/c36 to d6/d2b/d35/d39/d8f/cb5 0 2024-02-20T08:06:13.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.206+0000 7fb1b27fc700 1 -- 172.21.15.123:0/3933403384 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb1bc102ac0 con 0x7fb1a806b290 2024-02-20T08:06:13.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/511: rmdir d2/d14/d18/d45/d7b 39 2024-02-20T08:06:13.207 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:06:13.207 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (74s) 0s ago 9m 17.2M - 0.25.0 c8568f914cd2 a5c1c8e46fd5 2024-02-20T08:06:13.207 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (10m) 0s ago 10m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (8m) 96s ago 8m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (31s) 0s ago 9m 76.3M - 9.4.7 954c08fa6188 4b8d379a3806 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (4m) 0s ago 4m 12.0M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (3m) 0s ago 3m 232M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (3m) 96s ago 3m 14.3M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (3m) 96s ago 3m 12.0M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (8s) 0s ago 11m 89.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (114s) 96s ago 8m 488M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 915e6082ff57 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (11m) 0s ago 11m 52.7M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (8m) 96s ago 8m 39.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (81s) 0s ago 9m 15.5M - 1.5.0 0da6a335fe13 1dba37793143 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 starting - - - - 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (7m) 0s ago 7m 173M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (7m) 0s ago 7m 177M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:06:13.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (6m) 0s ago 6m 132M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:06:13.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (6m) 96s ago 6m 55.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:06:13.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (5m) 96s ago 5m 51.0M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:06:13.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (5m) 96s ago 5m 49.9M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:06:13.209 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (17s) 0s ago 9m 42.0M - 2.43.0 a07b618ecd1d 4686fac5a0d4 2024-02-20T08:06:13.209 INFO:tasks.workunit.client.1.smithi194.stdout:9/627: creat d4/d37/dab/fce x:0 0 0 2024-02-20T08:06:13.209 INFO:tasks.workunit.client.1.smithi194.stdout:1/592: creat d2/d1a/fc1 x:0 0 0 2024-02-20T08:06:13.210 INFO:tasks.workunit.client.1.smithi194.stdout:5/607: truncate d4/d20/d2b/d79/fac 1026817 0 2024-02-20T08:06:13.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 msgr2=0x7fb1a806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 0x7fb1a806d740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800b800 tx=0x7fb1b8009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 msgr2=0x7fb1bc10ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 0x7fb1bc10ee80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac002820 tx=0x7fb1ac004570 comp rx=0 tx=0).stop 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 shutdown_connections 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7fb1a806b290 0x7fb1a806d740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc0fe0e0 0x7fb1bc10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 --2- 172.21.15.123:0/3933403384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1bc10dfe0 0x7fb1bc10ee80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 >> 172.21.15.123:0/3933403384 conn(0x7fb1bc0f8620 msgr2=0x7fb1bc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 shutdown_connections 2024-02-20T08:06:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.210+0000 7fb1c41bc700 1 -- 172.21.15.123:0/3933403384 wait complete. 2024-02-20T08:06:13.212 INFO:tasks.workunit.client.1.smithi194.stdout:2/613: creat df/d5b/fb9 x:0 0 0 2024-02-20T08:06:13.212 INFO:tasks.workunit.client.1.smithi194.stdout:7/594: chown d11/d2d/d38/d4a/d53/ca2 107203 1 2024-02-20T08:06:13.212 INFO:tasks.workunit.client.1.smithi194.stdout:3/536: rename d5/df/f76 to d5/df/d60/fa3 0 2024-02-20T08:06:13.212 INFO:tasks.workunit.client.1.smithi194.stdout:6/702: dwrite df/fe3 [0,4194304] 0 2024-02-20T08:06:13.217 INFO:tasks.workunit.client.1.smithi194.stdout:9/628: readlink d4/d20/d41/la3 0 2024-02-20T08:06:13.220 INFO:tasks.workunit.client.1.smithi194.stdout:1/593: unlink d2/d1a/d26/d3d/d71/d8c/le 0 2024-02-20T08:06:13.221 INFO:tasks.workunit.client.1.smithi194.stdout:8/512: mknod d2/d14/d18/d45/d4e/d6c/d78/d98/cb1 0 2024-02-20T08:06:13.223 INFO:tasks.workunit.client.1.smithi194.stdout:8/513: chown d2/f1f 14 1 2024-02-20T08:06:13.226 INFO:tasks.workunit.client.1.smithi194.stdout:8/514: truncate d2/d14/f15 784711 0 2024-02-20T08:06:13.226 INFO:tasks.workunit.client.1.smithi194.stdout:7/595: dwrite d11/d2d/d38/d4a/d53/da0/faa [0,4194304] 0 2024-02-20T08:06:13.228 INFO:tasks.workunit.client.1.smithi194.stdout:5/608: creat d4/d20/d2b/d5c/fbb x:0 0 0 2024-02-20T08:06:13.229 INFO:tasks.workunit.client.1.smithi194.stdout:2/614: fdatasync df/d14/d24/d56/f7c 0 2024-02-20T08:06:13.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/609: read d4/f12 [3781787,94789] 0 2024-02-20T08:06:13.236 INFO:tasks.workunit.client.1.smithi194.stdout:3/537: write d5/d10/d17/d1d/d56/f71 [707402,41126] 0 2024-02-20T08:06:13.236 INFO:tasks.workunit.client.1.smithi194.stdout:0/544: getdents d6/d2b/d35/d42/d97 0 2024-02-20T08:06:13.238 INFO:tasks.workunit.client.1.smithi194.stdout:4/505: dread d0/d10/d1c/d4d/d2f/f3a [0,4194304] 0 2024-02-20T08:06:13.239 INFO:tasks.workunit.client.1.smithi194.stdout:0/545: truncate d6/d2b/d35/fae 166232 0 2024-02-20T08:06:13.241 INFO:tasks.workunit.client.1.smithi194.stdout:9/629: symlink d4/d20/d41/lcf 0 2024-02-20T08:06:13.242 INFO:tasks.workunit.client.1.smithi194.stdout:1/594: symlink d2/d1a/d61/d7d/lc2 0 2024-02-20T08:06:13.242 INFO:tasks.workunit.client.1.smithi194.stdout:9/630: readlink d4/d1b/d2e/lbc 0 2024-02-20T08:06:13.243 INFO:tasks.workunit.client.1.smithi194.stdout:1/595: write d2/d1a/d26/d57/f90 [793736,110533] 0 2024-02-20T08:06:13.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/515: creat d2/d14/d18/d45/d90/fb2 x:0 0 0 2024-02-20T08:06:13.248 INFO:tasks.workunit.client.1.smithi194.stdout:8/516: stat d2/c25 0 2024-02-20T08:06:13.253 INFO:tasks.workunit.client.1.smithi194.stdout:6/703: dread df/d18/f33 [0,4194304] 0 2024-02-20T08:06:13.256 INFO:tasks.workunit.client.1.smithi194.stdout:4/506: dread d0/d10/f22 [0,4194304] 0 2024-02-20T08:06:13.257 INFO:tasks.workunit.client.1.smithi194.stdout:4/507: chown d0/d2/d3e 138351 1 2024-02-20T08:06:13.257 INFO:tasks.workunit.client.1.smithi194.stdout:5/610: write d4/d6/fa [1150684,88069] 0 2024-02-20T08:06:13.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/538: mknod d5/d10/d16/d7b/d94/ca4 0 2024-02-20T08:06:13.260 INFO:tasks.workunit.client.1.smithi194.stdout:4/508: dread d0/d2/f6a [0,4194304] 0 2024-02-20T08:06:13.261 INFO:tasks.workunit.client.1.smithi194.stdout:3/539: fsync d5/d10/d8d/f92 0 2024-02-20T08:06:13.261 INFO:tasks.workunit.client.1.smithi194.stdout:0/546: creat d6/d2b/d35/d42/d1e/d45/d58/fb6 x:0 0 0 2024-02-20T08:06:13.261 INFO:tasks.workunit.client.1.smithi194.stdout:4/509: chown d0/df/d18 56 1 2024-02-20T08:06:13.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/510: dread d0/d10/f22 [0,4194304] 0 2024-02-20T08:06:13.265 INFO:tasks.workunit.client.1.smithi194.stdout:4/511: readlink d0/d2/l6c 0 2024-02-20T08:06:13.267 INFO:tasks.workunit.client.1.smithi194.stdout:4/512: read d0/d10/d1c/d21/d62/f93 [1969758,101934] 0 2024-02-20T08:06:13.270 INFO:tasks.workunit.client.1.smithi194.stdout:2/615: mknod df/cba 0 2024-02-20T08:06:13.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/631: mkdir d4/d20/d5c/dd0 0 2024-02-20T08:06:13.279 INFO:tasks.workunit.client.1.smithi194.stdout:0/547: dread d6/f17 [4194304,4194304] 0 2024-02-20T08:06:13.282 INFO:tasks.workunit.client.1.smithi194.stdout:1/596: creat d2/d8/d60/d75/db5/fc3 x:0 0 0 2024-02-20T08:06:13.282 INFO:tasks.workunit.client.1.smithi194.stdout:5/611: dwrite d4/d6/fb3 [0,4194304] 0 2024-02-20T08:06:13.282 INFO:tasks.workunit.client.1.smithi194.stdout:8/517: mkdir d2/d14/d18/d45/d69/daf/db3 0 2024-02-20T08:06:13.283 INFO:tasks.workunit.client.1.smithi194.stdout:5/612: fdatasync d4/d20/d2b/d79/f60 0 2024-02-20T08:06:13.285 INFO:tasks.workunit.client.1.smithi194.stdout:2/616: creat df/d14/d24/d56/d6b/d81/fbb x:0 0 0 2024-02-20T08:06:13.289 INFO:tasks.workunit.client.1.smithi194.stdout:7/596: link d11/d2d/d38/d37/d43/d8e/d5e/fa3 d11/d2d/d38/d4a/d53/fb3 0 2024-02-20T08:06:13.291 INFO:tasks.workunit.client.1.smithi194.stdout:7/597: truncate d11/d2d/d38/d4a/d60/f8b 1272917 0 2024-02-20T08:06:13.292 INFO:tasks.workunit.client.1.smithi194.stdout:3/540: getdents d5/d10/d28/d41/d73/d8c 0 2024-02-20T08:06:13.292 INFO:tasks.workunit.client.1.smithi194.stdout:3/541: chown d5/df/l32 7286 1 2024-02-20T08:06:13.298 INFO:tasks.workunit.client.1.smithi194.stdout:0/548: symlink d6/d2b/d35/d42/d1e/d45/daa/lb7 0 2024-02-20T08:06:13.299 INFO:tasks.workunit.client.1.smithi194.stdout:1/597: chown d2/f7 261840 1 2024-02-20T08:06:13.303 INFO:tasks.workunit.client.1.smithi194.stdout:8/518: mknod d2/d14/d18/d45/d69/cb4 0 2024-02-20T08:06:13.307 INFO:tasks.workunit.client.1.smithi194.stdout:2/617: creat df/d14/d24/d56/d6b/fbc x:0 0 0 2024-02-20T08:06:13.308 INFO:tasks.workunit.client.1.smithi194.stdout:2/618: truncate df/d14/d19/faf 396399 0 2024-02-20T08:06:13.309 INFO:tasks.workunit.client.1.smithi194.stdout:6/704: rename df/dab/d1d/d28/d46/dca to df/ded 0 2024-02-20T08:06:13.313 INFO:tasks.workunit.client.1.smithi194.stdout:7/598: creat d11/d2d/d38/d4a/d27/d51/d84/fb4 x:0 0 0 2024-02-20T08:06:13.314 INFO:tasks.workunit.client.1.smithi194.stdout:9/632: link d4/d37/dab/fce d4/d37/d4f/fd1 0 2024-02-20T08:06:13.320 INFO:tasks.workunit.client.1.smithi194.stdout:2/619: truncate df/d14/d24/f2d 1182761 0 2024-02-20T08:06:13.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/599: chown d11/d2d/d38/d4a/d27/d51/l68 42673 1 2024-02-20T08:06:13.324 INFO:tasks.workunit.client.1.smithi194.stdout:1/598: symlink d2/d1a/d61/d7d/dbf/lc4 0 2024-02-20T08:06:13.325 INFO:tasks.workunit.client.1.smithi194.stdout:8/519: mkdir d2/db5 0 2024-02-20T08:06:13.327 INFO:tasks.workunit.client.1.smithi194.stdout:6/705: symlink df/dab/d1d/d28/d46/d5a/d6b/lee 0 2024-02-20T08:06:13.328 INFO:tasks.workunit.client.1.smithi194.stdout:6/706: chown df/dab/d1d/d28/d2b 106 1 2024-02-20T08:06:13.328 INFO:tasks.workunit.client.1.smithi194.stdout:2/620: creat df/d5b/d61/fbd x:0 0 0 2024-02-20T08:06:13.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/513: rename d0/d5c/d60/d4a/c8d to d0/d10/d1c/c94 0 2024-02-20T08:06:13.335 INFO:tasks.workunit.client.1.smithi194.stdout:7/600: creat d11/d2d/d38/d95/fb5 x:0 0 0 2024-02-20T08:06:13.335 INFO:tasks.workunit.client.1.smithi194.stdout:0/549: getdents d6/d2b/d35/d48/d60/d72 0 2024-02-20T08:06:13.336 INFO:tasks.workunit.client.1.smithi194.stdout:7/601: dread - d11/d2d/d38/d37/f90 zero size 2024-02-20T08:06:13.337 INFO:tasks.workunit.client.1.smithi194.stdout:2/621: unlink df/d14/d19/d5c/d78/f83 0 2024-02-20T08:06:13.337 INFO:tasks.workunit.client.1.smithi194.stdout:7/602: write d11/d2d/f8a [745266,65512] 0 2024-02-20T08:06:13.339 INFO:tasks.workunit.client.1.smithi194.stdout:2/622: write df/d14/d19/d5c/d60/f7f [208757,66611] 0 2024-02-20T08:06:13.340 INFO:tasks.workunit.client.1.smithi194.stdout:4/514: write d0/d5c/d60/f39 [375682,13356] 0 2024-02-20T08:06:13.341 INFO:tasks.workunit.client.1.smithi194.stdout:2/623: write df/d14/d24/f4e [2088439,68140] 0 2024-02-20T08:06:13.343 INFO:tasks.workunit.client.1.smithi194.stdout:0/550: rename d6/d2b/d35/d42/d1e/c57 to d6/d2b/d35/d42/d1e/da2/cb8 0 2024-02-20T08:06:13.345 INFO:tasks.workunit.client.1.smithi194.stdout:6/707: mkdir df/dab/d1d/d28/d46/d5a/d6b/def 0 2024-02-20T08:06:13.347 INFO:tasks.workunit.client.1.smithi194.stdout:1/599: creat d2/d8/fc5 x:0 0 0 2024-02-20T08:06:13.350 INFO:tasks.workunit.client.1.smithi194.stdout:7/603: creat d11/d2d/d38/d37/d3c/d8d/fb6 x:0 0 0 2024-02-20T08:06:13.350 INFO:tasks.workunit.client.1.smithi194.stdout:7/604: rename d11 to d11/d2d/d38/d4a/d53/da0/db7 22 2024-02-20T08:06:13.354 INFO:tasks.workunit.client.1.smithi194.stdout:3/542: dread d5/df/f64 [0,4194304] 0 2024-02-20T08:06:13.355 INFO:tasks.workunit.client.1.smithi194.stdout:2/624: truncate df/f41 4111434 0 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 -- 172.21.15.123:0/2046390236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fb5e0 msgr2=0x7f203c0fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 --2- 172.21.15.123:0/2046390236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fb5e0 0x7f203c0fb9f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2038004940 tx=0x7f2038009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 -- 172.21.15.123:0/2046390236 shutdown_connections 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 --2- 172.21.15.123:0/2046390236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fc7f0 0x7f203c0fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 --2- 172.21.15.123:0/2046390236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fb5e0 0x7f203c0fb9f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 -- 172.21.15.123:0/2046390236 >> 172.21.15.123:0/2046390236 conn(0x7f203c0f6ca0 msgr2=0x7f203c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 -- 172.21.15.123:0/2046390236 shutdown_connections 2024-02-20T08:06:13.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.356+0000 7f2043d64700 1 -- 172.21.15.123:0/2046390236 wait complete. 2024-02-20T08:06:13.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 Processor -- start 2024-02-20T08:06:13.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 -- start start 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 0x7f203c110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 0x7f203c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0fe810 con 0x7f203c0fc7f0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2043d64700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0fe950 con 0x7f203c0fb5e0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f20412ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 0x7f203c112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f2041b00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 0x7f203c110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f20412ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 0x7f203c112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46106/0 (socket says 172.21.15.123:46106) 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.357+0000 7f20412ff700 1 -- 172.21.15.123:0/687866575 learned_addr learned my addr 172.21.15.123:0/687866575 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2041b00700 1 -- 172.21.15.123:0/687866575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 msgr2=0x7f203c112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2041b00700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 0x7f203c112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2041b00700 1 -- 172.21.15.123:0/687866575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038005040 con 0x7f203c0fb5e0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2041b00700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 0x7f203c110630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f203800b0d0 tx=0x7f2038009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800e070 con 0x7f203c0fb5e0 2024-02-20T08:06:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f203801c400 con 0x7f203c0fb5e0 2024-02-20T08:06:13.360 INFO:tasks.workunit.client.1.smithi194.stdout:0/551: unlink d6/d2b/d35/d39/d55/f6d 0 2024-02-20T08:06:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800b650 con 0x7f203c0fb5e0 2024-02-20T08:06:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c113180 con 0x7f203c0fb5e0 2024-02-20T08:06:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.358+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c10c680 con 0x7f203c0fb5e0 2024-02-20T08:06:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.359+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c04bed0 con 0x7f203c0fb5e0 2024-02-20T08:06:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.360+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 88916+0+0 (secure 0 0 0) 0x7f203801ca50 con 0x7f203c0fb5e0 2024-02-20T08:06:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.361+0000 7f20327fc700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 0x7f202806d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:13.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.361+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f203808b100 con 0x7f203c0fb5e0 2024-02-20T08:06:13.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.361+0000 7f20412ff700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 0x7f202806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:13.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.362+0000 7f20412ff700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 0x7f202806d670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f202c0041d0 tx=0x7f202c00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:13.364 INFO:tasks.workunit.client.1.smithi194.stdout:3/543: mknod d5/d10/d16/d7b/ca5 0 2024-02-20T08:06:13.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.366+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f20380553f0 con 0x7f203c0fb5e0 2024-02-20T08:06:13.369 INFO:tasks.workunit.client.1.smithi194.stdout:6/708: getdents df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec 0 2024-02-20T08:06:13.370 INFO:tasks.workunit.client.1.smithi194.stdout:6/709: read - df/dab/d1d/d28/d2b/d94/d96/fcd zero size 2024-02-20T08:06:13.370 INFO:tasks.workunit.client.1.smithi194.stdout:0/552: dread d6/f1a [0,4194304] 0 2024-02-20T08:06:13.371 INFO:tasks.workunit.client.1.smithi194.stdout:6/710: dread - df/dab/d1d/fe8 zero size 2024-02-20T08:06:13.371 INFO:tasks.workunit.client.1.smithi194.stdout:1/600: mkdir d2/d1a/d26/d45/d98/dc6 0 2024-02-20T08:06:13.374 INFO:tasks.workunit.client.1.smithi194.stdout:5/613: truncate d4/d6/d11/d2f/f71 332958 0 2024-02-20T08:06:13.382 INFO:tasks.workunit.client.1.smithi194.stdout:9/633: dwrite d4/d1b/d2e/f61 [0,4194304] 0 2024-02-20T08:06:13.386 INFO:tasks.workunit.client.1.smithi194.stdout:4/515: getdents d0/d10/d1c/d21/d62 0 2024-02-20T08:06:13.390 INFO:tasks.workunit.client.1.smithi194.stdout:8/520: write d2/d80/fa6 [4175333,19353] 0 2024-02-20T08:06:13.399 INFO:tasks.workunit.client.1.smithi194.stdout:2/625: creat df/d14/fbe x:0 0 0 2024-02-20T08:06:13.401 INFO:tasks.workunit.client.1.smithi194.stdout:3/544: mkdir d5/d10/d28/d41/d73/d8c/da6 0 2024-02-20T08:06:13.404 INFO:tasks.workunit.client.1.smithi194.stdout:0/553: fdatasync d6/f3d 0 2024-02-20T08:06:13.410 INFO:tasks.workunit.client.1.smithi194.stdout:4/516: mknod d0/d10/d1c/d21/c95 0 2024-02-20T08:06:13.416 INFO:tasks.workunit.client.1.smithi194.stdout:1/601: creat d2/d1a/d26/d45/d98/dc6/fc7 x:0 0 0 2024-02-20T08:06:13.423 INFO:tasks.workunit.client.1.smithi194.stdout:6/711: write df/d42/dcf/f8d [1820265,73955] 0 2024-02-20T08:06:13.424 INFO:tasks.workunit.client.1.smithi194.stdout:5/614: write d4/d6/d11/d2f/f4d [1037567,128899] 0 2024-02-20T08:06:13.427 INFO:tasks.workunit.client.1.smithi194.stdout:0/554: mknod d6/d2b/cb9 0 2024-02-20T08:06:13.430 INFO:tasks.workunit.client.1.smithi194.stdout:9/634: unlink d4/d1b/l70 0 2024-02-20T08:06:13.495 INFO:tasks.workunit.client.1.smithi194.stdout:1/602: truncate d2/d8/df/f29 1421760 0 2024-02-20T08:06:13.501 INFO:tasks.workunit.client.1.smithi194.stdout:2/626: creat df/d14/d19/d5c/d60/d63/d92/fbf x:0 0 0 2024-02-20T08:06:13.514 INFO:tasks.workunit.client.1.smithi194.stdout:4/517: link d0/d10/d1c/d21/d62/f67 d0/d10/d1c/d21/f96 0 2024-02-20T08:06:13.539 INFO:tasks.workunit.client.1.smithi194.stdout:7/605: sync 2024-02-20T08:06:13.540 INFO:tasks.workunit.client.1.smithi194.stdout:7/606: chown d11/d2d/d38/d37/d43/d7b/c85 15750288 1 2024-02-20T08:06:13.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/615: mkdir d4/d6/dd/d25/d78/d8b/d8a/db6/dbc 0 2024-02-20T08:06:13.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/627: mknod df/d14/d19/d96/cc0 0 2024-02-20T08:06:13.573 INFO:tasks.workunit.client.1.smithi194.stdout:9/635: truncate d4/d20/f80 1418761 0 2024-02-20T08:06:13.575 INFO:tasks.workunit.client.1.smithi194.stdout:8/521: getdents d2/d80 0 2024-02-20T08:06:13.578 INFO:tasks.workunit.client.1.smithi194.stdout:1/603: link d2/d1a/d26/d3d/f4d d2/d1a/d61/d68/db7/fc8 0 2024-02-20T08:06:13.580 INFO:tasks.workunit.client.1.smithi194.stdout:7/607: mknod d11/d2d/d38/d37/d43/d8e/d6b/cb8 0 2024-02-20T08:06:13.581 INFO:tasks.workunit.client.1.smithi194.stdout:3/545: link d5/df/d60/l5e d5/d10/d16/d8a/la7 0 2024-02-20T08:06:13.582 INFO:tasks.workunit.client.1.smithi194.stdout:4/518: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:13.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/616: chown d4/d6/dd/d25/d78/d8b/f3e 888 1 2024-02-20T08:06:13.584 INFO:tasks.workunit.client.1.smithi194.stdout:4/519: read d0/f7f [64922,40504] 0 2024-02-20T08:06:13.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/617: write d4/fc [7265208,13372] 0 2024-02-20T08:06:13.587 INFO:tasks.workunit.client.1.smithi194.stdout:6/712: sync 2024-02-20T08:06:13.590 INFO:tasks.workunit.client.1.smithi194.stdout:8/522: fdatasync d2/d14/d18/d45/d4e/d6c/d78/f87 0 2024-02-20T08:06:13.591 INFO:tasks.workunit.client.1.smithi194.stdout:8/523: write d2/f2e [491728,61017] 0 2024-02-20T08:06:13.599 INFO:tasks.workunit.client.1.smithi194.stdout:3/546: write d5/d10/d17/d1d/f20 [4214154,130423] 0 2024-02-20T08:06:13.600 INFO:tasks.workunit.client.1.smithi194.stdout:3/547: dread - d5/d10/d62/fa2 zero size 2024-02-20T08:06:13.601 INFO:tasks.workunit.client.1.smithi194.stdout:3/548: truncate d5/d10/d28/f6c 1036780 0 2024-02-20T08:06:13.602 INFO:tasks.workunit.client.1.smithi194.stdout:2/628: mkdir df/d14/d24/d56/d6b/db7/dc1 0 2024-02-20T08:06:13.603 INFO:tasks.workunit.client.1.smithi194.stdout:2/629: fsync df/d5b/d61/f89 0 2024-02-20T08:06:13.604 INFO:tasks.workunit.client.1.smithi194.stdout:4/520: chown d0/d10/d1c/d21/d46/c85 838764414 1 2024-02-20T08:06:13.605 INFO:tasks.workunit.client.1.smithi194.stdout:2/630: write df/d14/d19/d5c/d60/f7f [1687007,126013] 0 2024-02-20T08:06:13.605 INFO:tasks.workunit.client.1.smithi194.stdout:5/618: creat d4/d6/dd/d25/d7d/fbd x:0 0 0 2024-02-20T08:06:13.608 INFO:tasks.workunit.client.1.smithi194.stdout:4/521: chown d0/d5c/d60/f78 14459 1 2024-02-20T08:06:13.609 INFO:tasks.workunit.client.1.smithi194.stdout:3/549: dwrite d5/f6 [4194304,4194304] 0 2024-02-20T08:06:13.609 INFO:tasks.workunit.client.1.smithi194.stdout:5/619: chown d4/d6/f5e 122968 1 2024-02-20T08:06:13.610 INFO:tasks.workunit.client.1.smithi194.stdout:3/550: fsync d5/df/d25/f9f 0 2024-02-20T08:06:13.621 INFO:tasks.workunit.client.1.smithi194.stdout:9/636: rmdir d4/d20/d43/da9 0 2024-02-20T08:06:13.625 INFO:tasks.workunit.client.1.smithi194.stdout:5/620: creat d4/d6/dd/d25/d7d/fbe x:0 0 0 2024-02-20T08:06:13.628 INFO:tasks.workunit.client.1.smithi194.stdout:8/524: creat d2/d14/d18/d45/d7b/fb6 x:0 0 0 2024-02-20T08:06:13.630 INFO:tasks.workunit.client.1.smithi194.stdout:7/608: link d11/d2d/f8a d11/fb9 0 2024-02-20T08:06:13.633 INFO:tasks.workunit.client.1.smithi194.stdout:6/713: creat df/dab/d1d/ff0 x:0 0 0 2024-02-20T08:06:13.636 INFO:tasks.workunit.client.1.smithi194.stdout:8/525: dwrite d2/d14/d18/d45/d4e/fa8 [0,4194304] 0 2024-02-20T08:06:13.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/555: write d6/f3d [554236,26832] 0 2024-02-20T08:06:13.641 INFO:tasks.workunit.client.1.smithi194.stdout:7/609: dwrite d11/d2d/fb2 [0,4194304] 0 2024-02-20T08:06:13.644 INFO:tasks.workunit.client.1.smithi194.stdout:6/714: readlink df/dab/d1d/d28/ld9 0 2024-02-20T08:06:13.646 INFO:tasks.workunit.client.1.smithi194.stdout:3/551: dwrite d5/d10/d17/d1d/f1e [8388608,4194304] 0 2024-02-20T08:06:13.649 INFO:tasks.workunit.client.1.smithi194.stdout:5/621: getdents d4/d6/dd/d99/da7 0 2024-02-20T08:06:13.661 INFO:tasks.workunit.client.1.smithi194.stdout:7/610: symlink d11/d2d/d38/d4a/d27/d51/d77/d9d/lba 0 2024-02-20T08:06:13.662 INFO:tasks.workunit.client.1.smithi194.stdout:7/611: chown d11/d2d/d38/d37/f4f 1207 1 2024-02-20T08:06:13.665 INFO:tasks.workunit.client.1.smithi194.stdout:7/612: dread d11/d2d/d38/d37/d43/d7b/d91/f98 [0,4194304] 0 2024-02-20T08:06:13.667 INFO:tasks.workunit.client.1.smithi194.stdout:7/613: read d11/d2d/d38/d37/d3c/f42 [1832795,57240] 0 2024-02-20T08:06:13.668 INFO:tasks.workunit.client.1.smithi194.stdout:6/715: rmdir df/dab/d1d/d28/d46/d5a/d6b/def 0 2024-02-20T08:06:13.669 INFO:tasks.workunit.client.1.smithi194.stdout:7/614: read - d11/d2d/d38/d4a/d53/f61 zero size 2024-02-20T08:06:13.670 INFO:tasks.workunit.client.1.smithi194.stdout:7/615: stat d11/d2d/d38/d37/d43/d8e/d5e 0 2024-02-20T08:06:13.677 INFO:tasks.workunit.client.1.smithi194.stdout:3/552: getdents d5/d10/d28/d41 0 2024-02-20T08:06:13.678 INFO:tasks.workunit.client.1.smithi194.stdout:7/616: dwrite d11/d2d/d38/d95/fb5 [0,4194304] 0 2024-02-20T08:06:13.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/553: truncate d5/d10/d17/d1d/f6b 929325 0 2024-02-20T08:06:13.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/554: readlink d5/d10/d16/l2b 0 2024-02-20T08:06:13.690 INFO:tasks.workunit.client.1.smithi194.stdout:7/617: write d11/d2d/d38/d37/d43/d8e/d5e/f6a [211318,105626] 0 2024-02-20T08:06:13.699 INFO:tasks.workunit.client.1.smithi194.stdout:5/622: dread d4/d6/dd/d25/d78/d8b/f54 [0,4194304] 0 2024-02-20T08:06:13.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/555: write d5/d10/d17/d1d/d3d/f91 [702944,119406] 0 2024-02-20T08:06:13.706 INFO:tasks.workunit.client.1.smithi194.stdout:3/556: creat d5/d10/d17/fa8 x:0 0 0 2024-02-20T08:06:13.707 INFO:tasks.workunit.client.1.smithi194.stdout:3/557: chown d5/d10/d16/f63 1584032 1 2024-02-20T08:06:13.716 INFO:tasks.workunit.client.1.smithi194.stdout:3/558: dwrite d5/d10/d16/f3a [0,4194304] 0 2024-02-20T08:06:13.720 INFO:tasks.workunit.client.1.smithi194.stdout:3/559: write d5/d10/d62/fa2 [908451,58132] 0 2024-02-20T08:06:13.723 INFO:tasks.workunit.client.1.smithi194.stdout:3/560: fsync d5/d10/d17/d1d/d3d/f91 0 2024-02-20T08:06:13.729 INFO:tasks.workunit.client.1.smithi194.stdout:1/604: rename d2/d1a to d2/d8/d12/dc9 0 2024-02-20T08:06:13.732 INFO:tasks.workunit.client.1.smithi194.stdout:3/561: dwrite d5/df/d25/f9f [0,4194304] 0 2024-02-20T08:06:13.736 INFO:tasks.workunit.client.1.smithi194.stdout:2/631: rename df/d14/faa to df/d14/d24/d56/d6b/db7/dc1/fc2 0 2024-02-20T08:06:13.737 INFO:tasks.workunit.client.1.smithi194.stdout:3/562: mknod d5/d10/d28/d41/ca9 0 2024-02-20T08:06:13.740 INFO:tasks.workunit.client.1.smithi194.stdout:8/526: rename d2/d14/d18/d45/f6b to d2/d14/d18/d45/d69/fb7 0 2024-02-20T08:06:13.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/563: read d5/d10/d16/f59 [1787845,92928] 0 2024-02-20T08:06:13.745 INFO:tasks.workunit.client.1.smithi194.stdout:7/618: dread d11/d2d/d38/d4a/d27/f7f [0,4194304] 0 2024-02-20T08:06:13.749 INFO:tasks.workunit.client.1.smithi194.stdout:3/564: mkdir d5/d10/d17/d1d/d3d/daa 0 2024-02-20T08:06:13.751 INFO:tasks.workunit.client.1.smithi194.stdout:7/619: dread d11/f1f [4194304,4194304] 0 2024-02-20T08:06:13.753 INFO:tasks.workunit.client.1.smithi194.stdout:7/620: fsync d11/d2d/d38/d37/d43/d8e/d6b/fa9 0 2024-02-20T08:06:13.760 INFO:tasks.workunit.client.1.smithi194.stdout:4/522: write d0/df/f13 [2212816,24185] 0 2024-02-20T08:06:13.762 INFO:tasks.workunit.client.1.smithi194.stdout:3/565: dread d5/d10/d17/d1d/f20 [0,4194304] 0 2024-02-20T08:06:13.763 INFO:tasks.workunit.client.1.smithi194.stdout:3/566: write d5/d10/d8d/f92 [76602,51653] 0 2024-02-20T08:06:13.766 INFO:tasks.workunit.client.1.smithi194.stdout:3/567: rmdir d5/df/d75 39 2024-02-20T08:06:13.768 INFO:tasks.workunit.client.1.smithi194.stdout:0/556: rename d6/d2b/l7c to d6/d2b/d35/d42/d1e/d3c/da0/lba 0 2024-02-20T08:06:13.770 INFO:tasks.workunit.client.1.smithi194.stdout:3/568: fdatasync d5/df/d75/f7d 0 2024-02-20T08:06:13.772 INFO:tasks.workunit.client.1.smithi194.stdout:2/632: rename df/d14/l7d to df/d14/d80/lc3 0 2024-02-20T08:06:13.773 INFO:tasks.workunit.client.1.smithi194.stdout:9/637: write d4/d20/d43/daa/fbb [2256120,81842] 0 2024-02-20T08:06:13.774 INFO:tasks.workunit.client.1.smithi194.stdout:3/569: dread d5/df/d75/f87 [8388608,4194304] 0 2024-02-20T08:06:13.774 INFO:tasks.workunit.client.1.smithi194.stdout:4/523: dread d0/d10/d1c/f5a [0,4194304] 0 2024-02-20T08:06:13.776 INFO:tasks.workunit.client.1.smithi194.stdout:0/557: symlink d6/d2b/d35/d9c/lbb 0 2024-02-20T08:06:13.782 INFO:tasks.workunit.client.1.smithi194.stdout:9/638: mkdir d4/d20/d43/d51/d6a/dd2 0 2024-02-20T08:06:13.782 INFO:tasks.workunit.client.1.smithi194.stdout:4/524: dread d0/f7f [0,4194304] 0 2024-02-20T08:06:13.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/639: fsync d4/d37/d38/faf 0 2024-02-20T08:06:13.783 INFO:tasks.workunit.client.1.smithi194.stdout:4/525: chown d0/df/d41/f77 20166 1 2024-02-20T08:06:13.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/640: stat d4/d20/fb9 0 2024-02-20T08:06:13.784 INFO:tasks.workunit.client.1.smithi194.stdout:4/526: stat d0/d10/d1c/d21/f96 0 2024-02-20T08:06:13.784 INFO:tasks.workunit.client.1.smithi194.stdout:9/641: read d4/d8b/f8f [109918,74735] 0 2024-02-20T08:06:13.785 INFO:tasks.workunit.client.1.smithi194.stdout:9/642: readlink d4/d20/d41/la3 0 2024-02-20T08:06:13.786 INFO:tasks.workunit.client.1.smithi194.stdout:3/570: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:13.788 INFO:tasks.workunit.client.1.smithi194.stdout:3/571: read d5/d10/d16/f5a [1019291,20079] 0 2024-02-20T08:06:13.792 INFO:tasks.workunit.client.1.smithi194.stdout:9/643: creat d4/d37/dab/fd3 x:0 0 0 2024-02-20T08:06:13.796 INFO:tasks.workunit.client.1.smithi194.stdout:3/572: read d5/f8 [3497420,30648] 0 2024-02-20T08:06:13.797 INFO:tasks.workunit.client.1.smithi194.stdout:2/633: getdents df/d14/d24/d56/d6b/d9e 0 2024-02-20T08:06:13.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/716: dwrite df/dab/d1d/d28/d5e/f75 [0,4194304] 0 2024-02-20T08:06:13.800 INFO:tasks.workunit.client.1.smithi194.stdout:9/644: mknod d4/d2d/d59/cd4 0 2024-02-20T08:06:13.802 INFO:tasks.workunit.client.1.smithi194.stdout:0/558: getdents d6/d2b/d35/d42/d1e/d45/daa/d77/d9d 0 2024-02-20T08:06:13.805 INFO:tasks.workunit.client.1.smithi194.stdout:2/634: dread df/d14/d24/f99 [0,4194304] 0 2024-02-20T08:06:13.806 INFO:tasks.workunit.client.1.smithi194.stdout:5/623: sync 2024-02-20T08:06:13.809 INFO:tasks.workunit.client.1.smithi194.stdout:3/573: rename d5/d10/d17/d1d/f1e to d5/d10/d17/fab 0 2024-02-20T08:06:13.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/624: dwrite d4/d20/d2b/d79/f81 [8388608,4194304] 0 2024-02-20T08:06:13.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/625: readlink d4/d6/dd/d3a/l9c 0 2024-02-20T08:06:13.819 INFO:tasks.workunit.client.1.smithi194.stdout:8/527: getdents d2/d14/d18/d45/d69 0 2024-02-20T08:06:13.820 INFO:tasks.workunit.client.1.smithi194.stdout:4/527: getdents d0/d10 0 2024-02-20T08:06:13.825 INFO:tasks.workunit.client.1.smithi194.stdout:0/559: rmdir d6/d2b/d35/d42/d1e/d45/daa/d77/d9d 39 2024-02-20T08:06:13.825 INFO:tasks.workunit.client.1.smithi194.stdout:0/560: fdatasync d6/d2b/d35/d42/d1e/d45/f51 0 2024-02-20T08:06:13.830 INFO:tasks.workunit.client.1.smithi194.stdout:2/635: rmdir df/d14/d19/d5c/d97/d9a 39 2024-02-20T08:06:13.832 INFO:tasks.workunit.client.1.smithi194.stdout:7/621: dwrite d11/d2d/d38/d4a/d53/fb3 [0,4194304] 0 2024-02-20T08:06:13.838 INFO:tasks.workunit.client.1.smithi194.stdout:1/605: chown d2/d8/d12/dc9/d26/ca2 0 1 2024-02-20T08:06:13.839 INFO:tasks.workunit.client.1.smithi194.stdout:1/606: write d2/d8/fc5 [526431,118743] 0 2024-02-20T08:06:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.841+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f203c10c8f0 con 0x7f203c0fb5e0 2024-02-20T08:06:13.842 INFO:tasks.workunit.client.1.smithi194.stdout:5/626: creat d4/d6/d11/d2f/fbf x:0 0 0 2024-02-20T08:06:13.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.841+0000 7f20327fc700 1 -- 172.21.15.123:0/687866575 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f2038058ab0 con 0x7f203c0fb5e0 2024-02-20T08:06:13.843 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:06:13.843 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:06:13.843 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:13.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 13, 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:06:13.845 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:06:13.846 INFO:tasks.workunit.client.1.smithi194.stdout:4/528: dread d0/df/d18/f37 [0,4194304] 0 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 msgr2=0x7f202806d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 0x7f202806d670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f202c0041d0 tx=0x7f202c00b040 comp rx=0 tx=0).stop 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 msgr2=0x7f203c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 0x7f203c110630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f203800b0d0 tx=0x7f2038009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 shutdown_connections 2024-02-20T08:06:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7f202806b1c0 0x7f202806d670 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f203c0fb5e0 0x7f203c110630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 --2- 172.21.15.123:0/687866575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f203c0fc7f0 0x7f203c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 >> 172.21.15.123:0/687866575 conn(0x7f203c0f6ca0 msgr2=0x7f203c0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 shutdown_connections 2024-02-20T08:06:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:13.844+0000 7f2043d64700 1 -- 172.21.15.123:0/687866575 wait complete. 2024-02-20T08:06:13.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/636: read df/f41 [2972535,110448] 0 2024-02-20T08:06:13.850 INFO:tasks.workunit.client.1.smithi194.stdout:7/622: truncate d11/d2d/d38/d4a/d27/f73 727173 0 2024-02-20T08:06:13.851 INFO:tasks.workunit.client.1.smithi194.stdout:3/574: symlink d5/d10/d17/d1d/d3d/lac 0 2024-02-20T08:06:13.860 INFO:tasks.workunit.client.1.smithi194.stdout:1/607: rename d2/la3 to d2/d8/d12/dc9/d61/d68/lca 0 2024-02-20T08:06:13.862 INFO:tasks.workunit.client.1.smithi194.stdout:9/645: getdents d4/d2d/d42 0 2024-02-20T08:06:13.863 INFO:tasks.workunit.client.1.smithi194.stdout:9/646: write d4/d20/d41/f9f [422982,115532] 0 2024-02-20T08:06:13.864 INFO:tasks.workunit.client.1.smithi194.stdout:8/528: mknod d2/d14/d18/d45/d69/d9b/cb8 0 2024-02-20T08:06:13.867 INFO:tasks.workunit.client.1.smithi194.stdout:5/627: symlink d4/d6/dd/d25/d78/d8b/lc0 0 2024-02-20T08:06:13.868 INFO:tasks.workunit.client.1.smithi194.stdout:0/561: link d6/d2b/d35/d9c/f83 d6/d2b/d35/fbc 0 2024-02-20T08:06:13.869 INFO:tasks.workunit.client.1.smithi194.stdout:9/647: dwrite d4/d1b/d2e/f61 [0,4194304] 0 2024-02-20T08:06:13.870 INFO:tasks.workunit.client.1.smithi194.stdout:0/562: chown d6/d2b/d35/d9c/f83 36 1 2024-02-20T08:06:13.871 INFO:tasks.workunit.client.1.smithi194.stdout:2/637: unlink df/d5b/fb9 0 2024-02-20T08:06:13.874 INFO:tasks.workunit.client.1.smithi194.stdout:7/623: mkdir d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb 0 2024-02-20T08:06:13.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/575: mkdir d5/d10/d16/d7b/d94/dad 0 2024-02-20T08:06:13.878 INFO:tasks.workunit.client.1.smithi194.stdout:6/717: getdents df/dab/d1d/d28/d2b 0 2024-02-20T08:06:13.881 INFO:tasks.workunit.client.1.smithi194.stdout:3/576: dread d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:13.881 INFO:tasks.workunit.client.1.smithi194.stdout:4/529: rename d0/d5c/d60/d4a/d4e/d88 to d0/df/d72/d97 0 2024-02-20T08:06:13.890 INFO:tasks.workunit.client.1.smithi194.stdout:9/648: write d4/d2d/d59/f5b [539433,53894] 0 2024-02-20T08:06:13.893 INFO:tasks.workunit.client.1.smithi194.stdout:5/628: dwrite d4/f9f [0,4194304] 0 2024-02-20T08:06:13.895 INFO:tasks.workunit.client.1.smithi194.stdout:7/624: creat d11/d2d/d38/d4a/d53/da0/fbc x:0 0 0 2024-02-20T08:06:13.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/529: write d2/f37 [2104556,73790] 0 2024-02-20T08:06:13.897 INFO:tasks.workunit.client.1.smithi194.stdout:6/718: mknod df/dab/d1d/d99/cf1 0 2024-02-20T08:06:13.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/530: mknod d0/d5c/d60/d4a/d4e/c98 0 2024-02-20T08:06:13.900 INFO:tasks.workunit.client.1.smithi194.stdout:1/608: fdatasync d2/d8/d12/f21 0 2024-02-20T08:06:13.903 INFO:tasks.workunit.client.1.smithi194.stdout:9/649: dwrite d4/d2d/d59/f5b [0,4194304] 0 2024-02-20T08:06:13.903 INFO:tasks.workunit.client.1.smithi194.stdout:2/638: symlink df/lc4 0 2024-02-20T08:06:13.907 INFO:tasks.workunit.client.1.smithi194.stdout:5/629: creat d4/d6/fc1 x:0 0 0 2024-02-20T08:06:13.908 INFO:tasks.workunit.client.1.smithi194.stdout:3/577: mknod d5/d10/d17/d1d/d3d/daa/cae 0 2024-02-20T08:06:13.911 INFO:tasks.workunit.client.1.smithi194.stdout:8/530: creat d2/d14/d18/d45/d4e/d9f/fb9 x:0 0 0 2024-02-20T08:06:13.912 INFO:tasks.workunit.client.1.smithi194.stdout:8/531: dread - d2/d14/d18/d45/d90/fb2 zero size 2024-02-20T08:06:13.915 INFO:tasks.workunit.client.1.smithi194.stdout:1/609: mknod d2/d8/df/ccb 0 2024-02-20T08:06:13.916 INFO:tasks.workunit.client.1.smithi194.stdout:4/531: creat d0/d10/d1c/d21/d46/f99 x:0 0 0 2024-02-20T08:06:13.916 INFO:tasks.workunit.client.1.smithi194.stdout:4/532: stat d0/d10 0 2024-02-20T08:06:13.920 INFO:tasks.workunit.client.1.smithi194.stdout:5/630: symlink d4/d20/d2b/lc2 0 2024-02-20T08:06:13.921 INFO:tasks.workunit.client.1.smithi194.stdout:1/610: dwrite d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [0,4194304] 0 2024-02-20T08:06:13.922 INFO:tasks.workunit.client.1.smithi194.stdout:1/611: fdatasync d2/d8/df/f65 0 2024-02-20T08:06:13.923 INFO:tasks.workunit.client.1.smithi194.stdout:3/578: creat d5/d10/d17/d1d/d56/faf x:0 0 0 2024-02-20T08:06:13.932 INFO:tasks.workunit.client.1.smithi194.stdout:2/639: truncate f5 1959789 0 2024-02-20T08:06:13.937 INFO:tasks.workunit.client.1.smithi194.stdout:6/719: creat df/dab/d1d/ff2 x:0 0 0 2024-02-20T08:06:13.939 INFO:tasks.workunit.client.1.smithi194.stdout:1/612: mkdir d2/d8/d12/dc9/d26/d3d/d71/d8c/dcc 0 2024-02-20T08:06:13.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/613: dread - d2/d8/d12/dc9/fb4 zero size 2024-02-20T08:06:13.940 INFO:tasks.workunit.client.1.smithi194.stdout:3/579: creat d5/d10/d28/fb0 x:0 0 0 2024-02-20T08:06:13.941 INFO:tasks.workunit.client.1.smithi194.stdout:3/580: write d5/d10/d17/fa8 [965918,37595] 0 2024-02-20T08:06:13.943 INFO:tasks.workunit.client.1.smithi194.stdout:5/631: dread d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:13.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/532: mknod d2/db5/cba 0 2024-02-20T08:06:13.944 INFO:tasks.workunit.client.1.smithi194.stdout:5/632: chown d4/d20/d2b/d79/f60 4280706 1 2024-02-20T08:06:13.946 INFO:tasks.workunit.client.1.smithi194.stdout:7/625: rename d11/d2d/d38/d4a/d53/l74 to d11/d2d/d38/d37/d43/lbd 0 2024-02-20T08:06:13.946 INFO:tasks.workunit.client.1.smithi194.stdout:1/614: dread d2/d8/d12/dc9/d61/f9c [0,4194304] 0 2024-02-20T08:06:13.950 INFO:tasks.workunit.client.1.smithi194.stdout:2/640: mknod df/d14/d19/d96/cc5 0 2024-02-20T08:06:13.964 INFO:tasks.workunit.client.1.smithi194.stdout:8/533: creat d2/d80/fbb x:0 0 0 2024-02-20T08:06:13.965 INFO:tasks.workunit.client.1.smithi194.stdout:1/615: write d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [4921194,11885] 0 2024-02-20T08:06:13.968 INFO:tasks.workunit.client.1.smithi194.stdout:9/650: rename d4/l25 to d4/d20/d41/db6/ld5 0 2024-02-20T08:06:13.970 INFO:tasks.workunit.client.1.smithi194.stdout:9/651: write d4/d20/d5c/fc9 [181597,78045] 0 2024-02-20T08:06:13.971 INFO:tasks.workunit.client.1.smithi194.stdout:9/652: write d4/d1b/f74 [3331622,35086] 0 2024-02-20T08:06:13.972 INFO:tasks.workunit.client.1.smithi194.stdout:9/653: dread - d4/d55/fc0 zero size 2024-02-20T08:06:13.974 INFO:tasks.workunit.client.1.smithi194.stdout:3/581: dread d5/df/d25/f27 [0,4194304] 0 2024-02-20T08:06:13.974 INFO:tasks.workunit.client.1.smithi194.stdout:7/626: creat d11/d2d/d38/d95/fbe x:0 0 0 2024-02-20T08:06:13.975 INFO:tasks.workunit.client.1.smithi194.stdout:3/582: readlink d5/df/l32 0 2024-02-20T08:06:13.980 INFO:tasks.workunit.client.1.smithi194.stdout:0/563: sync 2024-02-20T08:06:13.984 INFO:tasks.workunit.client.1.smithi194.stdout:4/533: write d0/d2/d3e/f3f [2460796,108794] 0 2024-02-20T08:06:13.989 INFO:tasks.workunit.client.1.smithi194.stdout:5/633: mkdir d4/d6/dd/d3a/d86/dc3 0 2024-02-20T08:06:13.992 INFO:tasks.workunit.client.1.smithi194.stdout:8/534: rmdir d2/d14/d18/d45/d90 39 2024-02-20T08:06:13.993 INFO:tasks.workunit.client.1.smithi194.stdout:1/616: fsync d2/d8/d12/dc9/d26/d3d/d71/f7a 0 2024-02-20T08:06:13.995 INFO:tasks.workunit.client.1.smithi194.stdout:6/720: dwrite df/dab/d1d/d28/d2b/f3e [0,4194304] 0 2024-02-20T08:06:13.998 INFO:tasks.workunit.client.1.smithi194.stdout:1/617: fsync d2/d8/d12/dc9/d61/d7e/f86 0 2024-02-20T08:06:14.000 INFO:tasks.workunit.client.1.smithi194.stdout:5/634: dwrite d4/fc [4194304,4194304] 0 2024-02-20T08:06:14.001 INFO:tasks.workunit.client.1.smithi194.stdout:1/618: dread - d2/d8/d12/dc9/d61/d68/f89 zero size 2024-02-20T08:06:14.002 INFO:tasks.workunit.client.1.smithi194.stdout:4/534: dread d0/d5c/f7c [4194304,4194304] 0 2024-02-20T08:06:14.003 INFO:tasks.workunit.client.1.smithi194.stdout:5/635: dread - d4/d6/d11/d15/d28/d85/d53/fa6 zero size 2024-02-20T08:06:14.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 -- 172.21.15.123:0/1553824901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fe1d0 msgr2=0x7faaa8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:14.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/1553824901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fe1d0 0x7faaa8100650 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faaa4004940 tx=0x7faaa4009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:14.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 -- 172.21.15.123:0/1553824901 shutdown_connections 2024-02-20T08:06:14.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/1553824901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fe1d0 0x7faaa8100650 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/1553824901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fb870 0x7faaa80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.014+0000 7faaaf9cf700 1 -- 172.21.15.123:0/1553824901 >> 172.21.15.123:0/1553824901 conn(0x7faaa80f74e0 msgr2=0x7faaa80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.015+0000 7faaaf9cf700 1 -- 172.21.15.123:0/1553824901 shutdown_connections 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.015+0000 7faaaf9cf700 1 -- 172.21.15.123:0/1553824901 wait complete. 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 Processor -- start 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 -- start start 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 0x7faaa81142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81150b0 con 0x7faaa80fb870 2024-02-20T08:06:14.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaaf9cf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8115220 con 0x7faaa80fe1d0 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaad76b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaad76b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46130/0 (socket says 172.21.15.123:46130) 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaad76b700 1 -- 172.21.15.123:0/3528556292 learned_addr learned my addr 172.21.15.123:0/3528556292 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.016+0000 7faaacf6a700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 0x7faaa81142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaacf6a700 1 -- 172.21.15.123:0/3528556292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 msgr2=0x7faaa8113d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaacf6a700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaacf6a700 1 -- 172.21.15.123:0/3528556292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4005040 con 0x7faaa80fe1d0 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaad76b700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaacf6a700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 0x7faaa81142c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faaa400b3b0 tx=0x7faaa4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:14.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa400e040 con 0x7faaa80fe1d0 2024-02-20T08:06:14.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.017+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa81154a0 con 0x7faaa80fe1d0 2024-02-20T08:06:14.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.018+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faaa400be90 con 0x7faaa80fe1d0 2024-02-20T08:06:14.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.018+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa81159e0 con 0x7faaa80fe1d0 2024-02-20T08:06:14.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.018+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa4025760 con 0x7faaa80fe1d0 2024-02-20T08:06:14.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/641: dwrite df/d14/d24/f99 [0,4194304] 0 2024-02-20T08:06:14.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.019+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa80fb1a0 con 0x7faaa80fe1d0 2024-02-20T08:06:14.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.019+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 88916+0+0 (secure 0 0 0) 0x7faaa4013bf0 con 0x7faaa80fe1d0 2024-02-20T08:06:14.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.020+0000 7faa9dffb700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 0x7faa9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:14.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.020+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faaa408afe0 con 0x7faaa80fe1d0 2024-02-20T08:06:14.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.020+0000 7faaad76b700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 0x7faa9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:14.022 INFO:tasks.workunit.client.1.smithi194.stdout:8/535: mkdir d2/d14/d18/d45/d4e/d6c/d78/dbc 0 2024-02-20T08:06:14.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.022+0000 7faaad76b700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 0x7faa9406d680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaa8114b40 tx=0x7faa98009250 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:14.024 INFO:tasks.workunit.client.1.smithi194.stdout:8/536: write d2/d14/d18/d45/d7b/fa4 [676582,23569] 0 2024-02-20T08:06:14.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.027+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7faaa4055210 con 0x7faaa80fe1d0 2024-02-20T08:06:14.029 INFO:tasks.workunit.client.1.smithi194.stdout:0/564: write d6/d2b/d35/d39/f8e [655698,9578] 0 2024-02-20T08:06:14.032 INFO:tasks.workunit.client.1.smithi194.stdout:3/583: link d5/d10/d16/f3a d5/d10/d28/d41/d73/d8c/fb1 0 2024-02-20T08:06:14.037 INFO:tasks.workunit.client.1.smithi194.stdout:7/627: dwrite d11/d2d/d38/d37/d43/d7b/d91/f98 [0,4194304] 0 2024-02-20T08:06:14.038 INFO:tasks.workunit.client.1.smithi194.stdout:4/535: dwrite d0/d10/f22 [4194304,4194304] 0 2024-02-20T08:06:14.040 INFO:tasks.workunit.client.1.smithi194.stdout:2/642: creat df/d14/d24/d56/fc6 x:0 0 0 2024-02-20T08:06:14.041 INFO:tasks.workunit.client.1.smithi194.stdout:2/643: chown df/d14/f4c 3 1 2024-02-20T08:06:14.043 INFO:tasks.workunit.client.1.smithi194.stdout:6/721: creat df/dab/d1d/d28/d46/d5a/d6b/dcb/ff3 x:0 0 0 2024-02-20T08:06:14.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/722: write df/dab/d1d/fdf [1972502,72625] 0 2024-02-20T08:06:14.053 INFO:tasks.workunit.client.1.smithi194.stdout:4/536: creat d0/df/d72/f9a x:0 0 0 2024-02-20T08:06:14.054 INFO:tasks.workunit.client.1.smithi194.stdout:7/628: rename d11/d2d/d38/d4a/d60/f7d to d11/d2d/d38/d4a/d60/fbf 0 2024-02-20T08:06:14.055 INFO:tasks.workunit.client.1.smithi194.stdout:7/629: chown d11/d2d/fa4 96091 1 2024-02-20T08:06:14.056 INFO:tasks.workunit.client.1.smithi194.stdout:9/654: rename d4/d20/d43/d51/c29 to d4/d37/cd6 0 2024-02-20T08:06:14.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/537: truncate d0/df/d72/f9a 864675 0 2024-02-20T08:06:14.058 INFO:tasks.workunit.client.1.smithi194.stdout:3/584: dread d5/df/f24 [4194304,4194304] 0 2024-02-20T08:06:14.059 INFO:tasks.workunit.client.1.smithi194.stdout:3/585: chown d5/df 3 1 2024-02-20T08:06:14.065 INFO:tasks.workunit.client.1.smithi194.stdout:4/538: fsync d0/f7f 0 2024-02-20T08:06:14.067 INFO:tasks.workunit.client.1.smithi194.stdout:5/636: rename d4/d6/d11/d15 to d4/d6/dd/d25/d78/d8b/d8a/dc4 0 2024-02-20T08:06:14.068 INFO:tasks.workunit.client.1.smithi194.stdout:5/637: chown d4/d6/fa 31228 1 2024-02-20T08:06:14.069 INFO:tasks.workunit.client.1.smithi194.stdout:5/638: chown d4/d6/dd/d25/d78/d8b/fb4 149142227 1 2024-02-20T08:06:14.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/630: mknod d11/d2d/d38/d37/d43/d7b/cc0 0 2024-02-20T08:06:14.070 INFO:tasks.workunit.client.1.smithi194.stdout:1/619: link d2/d8/d12/dc9/d26/c39 d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/db0/ccd 0 2024-02-20T08:06:14.071 INFO:tasks.workunit.client.1.smithi194.stdout:7/631: chown d11/d2d/d38/d4a/d27/d51 32892963 1 2024-02-20T08:06:14.073 INFO:tasks.workunit.client.1.smithi194.stdout:9/655: mknod d4/d2d/d42/d4e/cd7 0 2024-02-20T08:06:14.076 INFO:tasks.workunit.client.1.smithi194.stdout:3/586: mkdir d5/d10/d62/db2 0 2024-02-20T08:06:14.082 INFO:tasks.workunit.client.1.smithi194.stdout:1/620: rmdir d2/d8/d12/dc9/d26 39 2024-02-20T08:06:14.086 INFO:tasks.workunit.client.1.smithi194.stdout:9/656: symlink d4/d20/d41/db6/ld8 0 2024-02-20T08:06:14.087 INFO:tasks.workunit.client.1.smithi194.stdout:6/723: link df/c70 df/dab/d1d/d28/d46/d5a/d6b/d83/cf4 0 2024-02-20T08:06:14.088 INFO:tasks.workunit.client.1.smithi194.stdout:4/539: creat d0/df/d41/d69/f9b x:0 0 0 2024-02-20T08:06:14.090 INFO:tasks.workunit.client.1.smithi194.stdout:4/540: write d0/d10/d1c/d21/d46/f86 [159896,115334] 0 2024-02-20T08:06:14.091 INFO:tasks.workunit.client.1.smithi194.stdout:4/541: write d0/f19 [4335362,49452] 0 2024-02-20T08:06:14.093 INFO:tasks.workunit.client.1.smithi194.stdout:5/639: unlink d4/d6/d11/d2f/c4c 0 2024-02-20T08:06:14.093 INFO:tasks.workunit.client.1.smithi194.stdout:4/542: write d0/df/d11/f2b [7548298,122627] 0 2024-02-20T08:06:14.096 INFO:tasks.workunit.client.1.smithi194.stdout:4/543: chown d0/df/d41/d69/f91 59 1 2024-02-20T08:06:14.099 INFO:tasks.workunit.client.1.smithi194.stdout:9/657: creat d4/d8b/fd9 x:0 0 0 2024-02-20T08:06:14.099 INFO:tasks.workunit.client.1.smithi194.stdout:4/544: write d0/d10/d1c/d21/d46/f99 [961876,2646] 0 2024-02-20T08:06:14.103 INFO:tasks.workunit.client.1.smithi194.stdout:6/724: dread df/dab/d1d/fdf [0,4194304] 0 2024-02-20T08:06:14.103 INFO:tasks.workunit.client.1.smithi194.stdout:7/632: dwrite d11/fb9 [0,4194304] 0 2024-02-20T08:06:14.104 INFO:tasks.workunit.client.1.smithi194.stdout:7/633: read - d11/f8c zero size 2024-02-20T08:06:14.105 INFO:tasks.workunit.client.1.smithi194.stdout:0/565: rename d6/d2b/d35/d42/d1e/d3c/f94 to d6/d2b/d35/d48/fbd 0 2024-02-20T08:06:14.108 INFO:tasks.workunit.client.1.smithi194.stdout:0/566: write d6/d2b/d35/d42/f16 [4169984,70580] 0 2024-02-20T08:06:14.112 INFO:tasks.workunit.client.1.smithi194.stdout:9/658: dread d4/d20/fbe [0,4194304] 0 2024-02-20T08:06:14.112 INFO:tasks.workunit.client.1.smithi194.stdout:8/537: sync 2024-02-20T08:06:14.126 INFO:tasks.workunit.client.1.smithi194.stdout:4/545: write d0/d10/d1c/d4d/d2f/f31 [401260,112706] 0 2024-02-20T08:06:14.127 INFO:tasks.workunit.client.1.smithi194.stdout:4/546: stat d0/d10/d1c/f30 0 2024-02-20T08:06:14.130 INFO:tasks.workunit.client.1.smithi194.stdout:0/567: mkdir d6/dbe 0 2024-02-20T08:06:14.131 INFO:tasks.workunit.client.1.smithi194.stdout:8/538: write d2/d14/d18/f61 [4838115,15195] 0 2024-02-20T08:06:14.132 INFO:tasks.workunit.client.1.smithi194.stdout:9/659: creat d4/d2d/d42/d4e/fda x:0 0 0 2024-02-20T08:06:14.138 INFO:tasks.workunit.client.1.smithi194.stdout:6/725: symlink df/dab/d1d/d28/d46/d5a/d6b/d83/db3/lf5 0 2024-02-20T08:06:14.139 INFO:tasks.workunit.client.1.smithi194.stdout:6/726: read df/fe3 [2050141,58248] 0 2024-02-20T08:06:14.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/547: mkdir d0/d2/d51/d9c 0 2024-02-20T08:06:14.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/539: dread d2/d14/d18/d45/d4e/d6c/d78/f87 [0,4194304] 0 2024-02-20T08:06:14.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/640: link d4/d20/d2b/c74 d4/d20/d2b/d79/cc5 0 2024-02-20T08:06:14.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/641: stat d4/d6/dd/d3a/c45 0 2024-02-20T08:06:14.155 INFO:tasks.workunit.client.1.smithi194.stdout:7/634: truncate d11/f12 3023469 0 2024-02-20T08:06:14.156 INFO:tasks.workunit.client.1.smithi194.stdout:0/568: mkdir d6/d2b/d35/d39/d8f/dbf 0 2024-02-20T08:06:14.160 INFO:tasks.workunit.client.1.smithi194.stdout:6/727: mknod df/dab/d1d/d28/d46/cf6 0 2024-02-20T08:06:14.162 INFO:tasks.workunit.client.1.smithi194.stdout:6/728: read - df/dab/d1d/d28/d2b/d94/fc3 zero size 2024-02-20T08:06:14.163 INFO:tasks.workunit.client.1.smithi194.stdout:6/729: read - df/dab/d1d/d28/d46/d5a/fc8 zero size 2024-02-20T08:06:14.164 INFO:tasks.workunit.client.1.smithi194.stdout:2/644: rename df/d14/d24/d56/fc6 to df/d5b/fc7 0 2024-02-20T08:06:14.166 INFO:tasks.workunit.client.1.smithi194.stdout:4/548: mkdir d0/d9d 0 2024-02-20T08:06:14.169 INFO:tasks.workunit.client.1.smithi194.stdout:0/569: dread d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:14.170 INFO:tasks.workunit.client.1.smithi194.stdout:0/570: dread - d6/f88 zero size 2024-02-20T08:06:14.171 INFO:tasks.workunit.client.1.smithi194.stdout:0/571: fsync d6/d2b/d35/d9c/f6b 0 2024-02-20T08:06:14.173 INFO:tasks.workunit.client.1.smithi194.stdout:7/635: creat d11/d2d/d38/d37/d3c/d8d/fc1 x:0 0 0 2024-02-20T08:06:14.177 INFO:tasks.workunit.client.1.smithi194.stdout:8/540: dread d2/d14/f5d [0,4194304] 0 2024-02-20T08:06:14.179 INFO:tasks.workunit.client.1.smithi194.stdout:8/541: truncate d2/d14/d18/d45/d4e/d6c/d78/f88 780924 0 2024-02-20T08:06:14.180 INFO:tasks.workunit.client.1.smithi194.stdout:3/587: rename d5/df/d75/f7d to d5/d10/d28/fb3 0 2024-02-20T08:06:14.184 INFO:tasks.workunit.client.1.smithi194.stdout:4/549: unlink d0/df/d18/f37 0 2024-02-20T08:06:14.189 INFO:tasks.workunit.client.1.smithi194.stdout:0/572: dread d6/d2b/d35/d42/d1e/f5a [0,4194304] 0 2024-02-20T08:06:14.190 INFO:tasks.workunit.client.1.smithi194.stdout:9/660: creat d4/d1b/fdb x:0 0 0 2024-02-20T08:06:14.194 INFO:tasks.workunit.client.1.smithi194.stdout:6/730: mkdir df/dab/d1d/d28/d46/d5a/d6b/dbb/df7 0 2024-02-20T08:06:14.198 INFO:tasks.workunit.client.1.smithi194.stdout:7/636: write d11/f35 [6102195,56866] 0 2024-02-20T08:06:14.201 INFO:tasks.workunit.client.1.smithi194.stdout:1/621: rename d2/d8/d12/dc9/d61/d68/c95 to d2/d8/d12/dc9/d26/d3d/d71/d8c/dcc/cce 0 2024-02-20T08:06:14.201 INFO:tasks.workunit.client.1.smithi194.stdout:3/588: mkdir d5/d10/d28/db4 0 2024-02-20T08:06:14.204 INFO:tasks.workunit.client.1.smithi194.stdout:2/645: mkdir df/d14/d19/d5c/d97/dc8 0 2024-02-20T08:06:14.204 INFO:tasks.workunit.client.1.smithi194.stdout:3/589: read d5/df/d30/f36 [9399348,30481] 0 2024-02-20T08:06:14.205 INFO:tasks.workunit.client.1.smithi194.stdout:5/642: link d4/d6/dd/d3a/l9c d4/d20/d2b/lc6 0 2024-02-20T08:06:14.206 INFO:tasks.workunit.client.1.smithi194.stdout:7/637: dwrite d11/d2d/d38/d37/f90 [0,4194304] 0 2024-02-20T08:06:14.206 INFO:tasks.workunit.client.1.smithi194.stdout:0/573: truncate d6/d2b/d35/f73 570927 0 2024-02-20T08:06:14.207 INFO:tasks.workunit.client.1.smithi194.stdout:2/646: chown df/d5b/d61/c69 1374135 1 2024-02-20T08:06:14.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/542: symlink d2/d14/d18/d45/d90/lbd 0 2024-02-20T08:06:14.208 INFO:tasks.workunit.client.1.smithi194.stdout:7/638: stat d11/f35 0 2024-02-20T08:06:14.216 INFO:tasks.workunit.client.1.smithi194.stdout:7/639: write d11/d2d/d38/d4a/d27/d51/d84/f96 [731667,77236] 0 2024-02-20T08:06:14.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/640: read d11/d2d/d38/d37/f4f [1205223,61028] 0 2024-02-20T08:06:14.223 INFO:tasks.workunit.client.1.smithi194.stdout:8/543: dwrite d2/fa [8388608,4194304] 0 2024-02-20T08:06:14.224 INFO:tasks.workunit.client.1.smithi194.stdout:6/731: dwrite df/d18/fd1 [0,4194304] 0 2024-02-20T08:06:14.226 INFO:tasks.workunit.client.1.smithi194.stdout:7/641: stat d11/d2d/d38/d37/d3c/d8d/lab 0 2024-02-20T08:06:14.232 INFO:tasks.workunit.client.1.smithi194.stdout:3/590: dwrite d5/d10/d17/f5b [0,4194304] 0 2024-02-20T08:06:14.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/643: dread d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/f66 [0,4194304] 0 2024-02-20T08:06:14.237 INFO:tasks.workunit.client.1.smithi194.stdout:9/661: creat d4/d20/d43/fdc x:0 0 0 2024-02-20T08:06:14.244 INFO:tasks.workunit.client.1.smithi194.stdout:7/642: mkdir d11/d2d/d38/d4a/d27/dc2 0 2024-02-20T08:06:14.248 INFO:tasks.workunit.client.1.smithi194.stdout:4/550: dwrite d0/d10/d1c/d4d/f7a [0,4194304] 0 2024-02-20T08:06:14.248 INFO:tasks.workunit.client.1.smithi194.stdout:9/662: mknod d4/d1b/d79/cdd 0 2024-02-20T08:06:14.248 INFO:tasks.workunit.client.1.smithi194.stdout:6/732: dwrite df/d18/f77 [4194304,4194304] 0 2024-02-20T08:06:14.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/544: mkdir d2/d14/d18/d45/d4e/dbe 0 2024-02-20T08:06:14.251 INFO:tasks.workunit.client.1.smithi194.stdout:2/647: getdents df/d14/d19 0 2024-02-20T08:06:14.253 INFO:tasks.workunit.client.1.smithi194.stdout:1/622: dwrite d2/d8/d12/dc9/d26/d3d/d71/d8c/f19 [0,4194304] 0 2024-02-20T08:06:14.253 INFO:tasks.workunit.client.1.smithi194.stdout:3/591: truncate d5/d10/d17/d1d/d56/faf 535186 0 2024-02-20T08:06:14.255 INFO:tasks.workunit.client.1.smithi194.stdout:9/663: rmdir d4/de/dc4 39 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: pgmap v56: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 53 MiB/s rd, 202 MiB/s wr, 444 op/s 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:14 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/687866575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:06:14.259 INFO:tasks.workunit.client.1.smithi194.stdout:8/545: fsync d2/d14/d18/d45/d4e/d6c/f7d 0 2024-02-20T08:06:14.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/551: mknod d0/df/c9e 0 2024-02-20T08:06:14.260 INFO:tasks.workunit.client.1.smithi194.stdout:9/664: chown d4/d1b/d2e/f61 624 1 2024-02-20T08:06:14.260 INFO:tasks.workunit.client.1.smithi194.stdout:7/643: truncate d11/d2d/d38/d4a/d27/d51/d77/faf 117904 0 2024-02-20T08:06:14.262 INFO:tasks.workunit.client.1.smithi194.stdout:5/644: dread d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/f66 [0,4194304] 0 2024-02-20T08:06:14.264 INFO:tasks.workunit.client.1.smithi194.stdout:3/592: rmdir d5/df/d25 39 2024-02-20T08:06:14.264 INFO:tasks.workunit.client.1.smithi194.stdout:6/733: dwrite df/dab/d1d/d28/d5e/f69 [0,4194304] 0 2024-02-20T08:06:14.274 INFO:tasks.workunit.client.1.smithi194.stdout:3/593: dwrite d5/fa [4194304,4194304] 0 2024-02-20T08:06:14.274 INFO:tasks.workunit.client.1.smithi194.stdout:6/734: dwrite df/d18/f49 [0,4194304] 0 2024-02-20T08:06:14.278 INFO:tasks.workunit.client.1.smithi194.stdout:4/552: symlink d0/df/d41/d69/l9f 0 2024-02-20T08:06:14.279 INFO:tasks.workunit.client.1.smithi194.stdout:9/665: dread - d4/d1b/f72 zero size 2024-02-20T08:06:14.279 INFO:tasks.workunit.client.1.smithi194.stdout:0/574: truncate d6/d2b/d35/d42/d1e/f27 462238 0 2024-02-20T08:06:14.280 INFO:tasks.workunit.client.1.smithi194.stdout:4/553: read - d0/d10/d1c/d4d/f90 zero size 2024-02-20T08:06:14.282 INFO:tasks.workunit.client.1.smithi194.stdout:9/666: write d4/d37/dab/fd3 [230161,77821] 0 2024-02-20T08:06:14.283 INFO:tasks.workunit.client.1.smithi194.stdout:8/546: unlink d2/d14/d18/d45/c79 0 2024-02-20T08:06:14.283 INFO:tasks.workunit.client.1.smithi194.stdout:4/554: write d0/df/d11/f2b [4066414,84345] 0 2024-02-20T08:06:14.284 INFO:tasks.workunit.client.1.smithi194.stdout:7/644: creat d11/d2d/d38/d37/d3c/d8d/fc3 x:0 0 0 2024-02-20T08:06:14.286 INFO:tasks.workunit.client.1.smithi194.stdout:4/555: stat d0/f32 0 2024-02-20T08:06:14.291 INFO:tasks.workunit.client.1.smithi194.stdout:2/648: creat df/d14/d19/d5c/d97/dc8/fc9 x:0 0 0 2024-02-20T08:06:14.294 INFO:tasks.workunit.client.1.smithi194.stdout:1/623: write d2/d8/df/f29 [397555,87605] 0 2024-02-20T08:06:14.297 INFO:tasks.workunit.client.1.smithi194.stdout:3/594: unlink d5/d10/d16/l6f 0 2024-02-20T08:06:14.298 INFO:tasks.workunit.client.1.smithi194.stdout:3/595: fsync d5/fe 0 2024-02-20T08:06:14.299 INFO:tasks.workunit.client.1.smithi194.stdout:0/575: fsync d6/d2b/d35/fbc 0 2024-02-20T08:06:14.302 INFO:tasks.workunit.client.1.smithi194.stdout:1/624: dwrite d2/d8/d12/dc9/d61/f67 [0,4194304] 0 2024-02-20T08:06:14.310 INFO:tasks.workunit.client.1.smithi194.stdout:7/645: unlink d11/d2d/d38/d4a/d27/d51/l68 0 2024-02-20T08:06:14.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/556: symlink d0/d4f/la0 0 2024-02-20T08:06:14.318 INFO:tasks.workunit.client.1.smithi194.stdout:6/735: unlink df/d18/f81 0 2024-02-20T08:06:14.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/557: dwrite d0/df/d72/d97/f89 [0,4194304] 0 2024-02-20T08:06:14.326 INFO:tasks.workunit.client.1.smithi194.stdout:8/547: write d2/f39 [114761,89177] 0 2024-02-20T08:06:14.328 INFO:tasks.workunit.client.1.smithi194.stdout:9/667: mknod d4/de/cde 0 2024-02-20T08:06:14.330 INFO:tasks.workunit.client.1.smithi194.stdout:3/596: mknod d5/d10/d28/d41/d73/cb5 0 2024-02-20T08:06:14.335 INFO:tasks.workunit.client.1.smithi194.stdout:7/646: rmdir d11/d2d/d38/d4a 39 2024-02-20T08:06:14.337 INFO:tasks.workunit.client.1.smithi194.stdout:2/649: link df/d14/d19/d96/fb0 df/d14/d19/d5c/d60/fca 0 2024-02-20T08:06:14.340 INFO:tasks.workunit.client.1.smithi194.stdout:4/558: symlink d0/df/d11/la1 0 2024-02-20T08:06:14.342 INFO:tasks.workunit.client.1.smithi194.stdout:4/559: write d0/df/d41/f81 [572185,130328] 0 2024-02-20T08:06:14.344 INFO:tasks.workunit.client.1.smithi194.stdout:4/560: fsync d0/d2/d3e/f3f 0 2024-02-20T08:06:14.349 INFO:tasks.workunit.client.1.smithi194.stdout:5/645: getdents d4/d6 0 2024-02-20T08:06:14.351 INFO:tasks.workunit.client.1.smithi194.stdout:0/576: dwrite d6/d2b/d35/f73 [0,4194304] 0 2024-02-20T08:06:14.352 INFO:tasks.workunit.client.1.smithi194.stdout:8/548: symlink d2/d14/d18/lbf 0 2024-02-20T08:06:14.352 INFO:tasks.workunit.client.1.smithi194.stdout:7/647: truncate d11/d2d/d38/d4a/d27/d51/d84/f6d 3731459 0 2024-02-20T08:06:14.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/648: dread - d11/f8c zero size 2024-02-20T08:06:14.358 INFO:tasks.workunit.client.1.smithi194.stdout:7/649: dread d11/d2d/d38/d4a/d53/fb3 [0,4194304] 0 2024-02-20T08:06:14.360 INFO:tasks.workunit.client.1.smithi194.stdout:3/597: link d5/df/f24 d5/d10/d17/d1d/d93/fb6 0 2024-02-20T08:06:14.364 INFO:tasks.workunit.client.1.smithi194.stdout:7/650: dwrite d11/d2d/d38/d4a/f21 [0,4194304] 0 2024-02-20T08:06:14.365 INFO:tasks.workunit.client.1.smithi194.stdout:5/646: unlink d4/d20/d2b/c5a 0 2024-02-20T08:06:14.367 INFO:tasks.workunit.client.1.smithi194.stdout:2/650: unlink df/d14/d24/f2d 0 2024-02-20T08:06:14.369 INFO:tasks.workunit.client.1.smithi194.stdout:8/549: chown d2/d80/l8f 3 1 2024-02-20T08:06:14.372 INFO:tasks.workunit.client.1.smithi194.stdout:0/577: mknod d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/cc0 0 2024-02-20T08:06:14.379 INFO:tasks.workunit.client.1.smithi194.stdout:4/561: link d0/d10/d1c/d21/f44 d0/d2/d51/fa2 0 2024-02-20T08:06:14.380 INFO:tasks.workunit.client.1.smithi194.stdout:4/562: write d0/d10/d1c/d21/d46/f99 [1249817,70078] 0 2024-02-20T08:06:14.383 INFO:tasks.workunit.client.1.smithi194.stdout:9/668: rename d4/d2d to d4/d37/ddf 0 2024-02-20T08:06:14.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.385+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 --> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa8115da0 con 0x7faa9406b1d0 2024-02-20T08:06:14.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.391+0000 7faa9dffb700 1 -- 172.21.15.123:0/3528556292 <== mgr.24375 v2:172.21.15.194:6828/987094579 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7faaa8115da0 con 0x7faa9406b1d0 2024-02-20T08:06:14.391 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:06:14.391 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:06:14.391 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/2 daemons upgraded", 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading mgr daemons", 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:06:14.392 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: pgmap v56: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 53 MiB/s rd, 202 MiB/s wr, 444 op/s 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:14 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/687866575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 msgr2=0x7faa9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 0x7faa9406d680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaa8114b40 tx=0x7faa98009250 comp rx=0 tx=0).stop 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 msgr2=0x7faaa81142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 0x7faaa81142c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faaa400b3b0 tx=0x7faaa4009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 shutdown_connections 2024-02-20T08:06:14.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:6828/987094579,v1:172.21.15.194:6829/987094579] conn(0x7faa9406b1d0 0x7faa9406d680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaa80fb870 0x7faaa8113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 --2- 172.21.15.123:0/3528556292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa80fe1d0 0x7faaa81142c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:14.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 >> 172.21.15.123:0/3528556292 conn(0x7faaa80f74e0 msgr2=0x7faaa80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:14.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 shutdown_connections 2024-02-20T08:06:14.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:14.394+0000 7faaaf9cf700 1 -- 172.21.15.123:0/3528556292 wait complete. 2024-02-20T08:06:14.400 INFO:tasks.workunit.client.1.smithi194.stdout:4/563: symlink d0/df/d41/la3 0 2024-02-20T08:06:14.401 INFO:tasks.workunit.client.1.smithi194.stdout:8/550: dwrite d2/d14/d18/f48 [0,4194304] 0 2024-02-20T08:06:14.404 INFO:tasks.workunit.client.1.smithi194.stdout:0/578: rename d6/d2b/d35/d48/d60/d72 to d6/d2b/d35/d9c/d62/dc1 0 2024-02-20T08:06:14.405 INFO:tasks.workunit.client.1.smithi194.stdout:0/579: chown d6/d2b/d35/d48 713 1 2024-02-20T08:06:14.405 INFO:tasks.workunit.client.1.smithi194.stdout:8/551: truncate d2/d14/d18/d45/d4e/d6c/d78/d98/f81 128421 0 2024-02-20T08:06:14.406 INFO:tasks.workunit.client.1.smithi194.stdout:0/580: chown d6/d2b/d35/d42/d1e/d45/d58 1647 1 2024-02-20T08:06:14.413 INFO:tasks.workunit.client.1.smithi194.stdout:3/598: fdatasync d5/df/d25/f27 0 2024-02-20T08:06:14.414 INFO:tasks.workunit.client.1.smithi194.stdout:7/651: creat d11/d2d/d38/d4a/d27/dc2/fc4 x:0 0 0 2024-02-20T08:06:14.414 INFO:tasks.workunit.client.1.smithi194.stdout:2/651: link df/d14/d19/d5c/f5e df/d14/d19/d5c/d60/d63/d92/fcb 0 2024-02-20T08:06:14.424 INFO:tasks.workunit.client.1.smithi194.stdout:8/552: dread d2/f3b [0,4194304] 0 2024-02-20T08:06:14.425 INFO:tasks.workunit.client.1.smithi194.stdout:3/599: mkdir d5/d10/d17/d1d/d56/db7 0 2024-02-20T08:06:14.426 INFO:tasks.workunit.client.1.smithi194.stdout:2/652: symlink df/d14/d19/lcc 0 2024-02-20T08:06:14.429 INFO:tasks.workunit.client.1.smithi194.stdout:7/652: rename d11/d2d/d38/d4a/d27/dc2 to d11/d2d/d38/d37/d43/d7b/dc5 0 2024-02-20T08:06:14.430 INFO:tasks.workunit.client.1.smithi194.stdout:5/647: dwrite d4/d6/dd/d25/d78/d8b/f24 [0,4194304] 0 2024-02-20T08:06:14.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/648: chown d4/d6/dd/d25/d78/c88 2020373 1 2024-02-20T08:06:14.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/649: chown d4/d20 2 1 2024-02-20T08:06:14.432 INFO:tasks.workunit.client.1.smithi194.stdout:9/669: truncate d4/d37/dab/fac 4164342 0 2024-02-20T08:06:14.433 INFO:tasks.workunit.client.1.smithi194.stdout:8/553: mkdir d2/d14/d18/d45/d7b/dc0 0 2024-02-20T08:06:14.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/581: write d6/d2b/d35/d42/d1e/d45/f70 [666706,88677] 0 2024-02-20T08:06:14.448 INFO:tasks.workunit.client.1.smithi194.stdout:7/653: mkdir d11/d6e/dc6 0 2024-02-20T08:06:14.449 INFO:tasks.workunit.client.1.smithi194.stdout:5/650: creat d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/d85/fc7 x:0 0 0 2024-02-20T08:06:14.450 INFO:tasks.workunit.client.1.smithi194.stdout:1/625: sync 2024-02-20T08:06:14.454 INFO:tasks.workunit.client.1.smithi194.stdout:8/554: read d2/d14/f34 [582867,81878] 0 2024-02-20T08:06:14.457 INFO:tasks.workunit.client.1.smithi194.stdout:0/582: creat d6/d2b/d35/d39/fc2 x:0 0 0 2024-02-20T08:06:14.461 INFO:tasks.workunit.client.1.smithi194.stdout:4/564: link d0/d2/f2e d0/df/d18/fa4 0 2024-02-20T08:06:14.462 INFO:tasks.workunit.client.1.smithi194.stdout:2/653: dread df/d14/d24/f48 [0,4194304] 0 2024-02-20T08:06:14.463 INFO:tasks.workunit.client.1.smithi194.stdout:5/651: creat d4/d6/dd/d25/fc8 x:0 0 0 2024-02-20T08:06:14.526 INFO:tasks.workunit.client.1.smithi194.stdout:0/583: mknod d6/d2b/d35/d9c/d62/cc3 0 2024-02-20T08:06:14.527 INFO:tasks.workunit.client.1.smithi194.stdout:2/654: creat df/d3a/db2/fcd x:0 0 0 2024-02-20T08:06:14.527 INFO:tasks.workunit.client.1.smithi194.stdout:9/670: truncate d4/d20/d5c/f3e 3290074 0 2024-02-20T08:06:14.529 INFO:tasks.workunit.client.1.smithi194.stdout:9/671: chown d4/d20/d43/d51/f71 209211 1 2024-02-20T08:06:14.531 INFO:tasks.workunit.client.1.smithi194.stdout:4/565: dwrite d0/df/d41/d69/f91 [0,4194304] 0 2024-02-20T08:06:14.536 INFO:tasks.workunit.client.1.smithi194.stdout:8/555: symlink d2/d14/d18/d45/d7b/dc0/lc1 0 2024-02-20T08:06:14.538 INFO:tasks.workunit.client.1.smithi194.stdout:3/600: getdents d5/d10/d17/d1d/d3d/daa 0 2024-02-20T08:06:14.540 INFO:tasks.workunit.client.1.smithi194.stdout:5/652: unlink d4/d6/dd/d3a/l9c 0 2024-02-20T08:06:14.542 INFO:tasks.workunit.client.1.smithi194.stdout:2/655: mkdir df/d5b/d61/dce 0 2024-02-20T08:06:14.543 INFO:tasks.workunit.client.1.smithi194.stdout:2/656: chown df/d14/d19/d5c 2939602 1 2024-02-20T08:06:14.545 INFO:tasks.workunit.client.1.smithi194.stdout:4/566: rmdir d0 39 2024-02-20T08:06:14.547 INFO:tasks.workunit.client.1.smithi194.stdout:2/657: mknod df/d14/d24/d56/ccf 0 2024-02-20T08:06:14.548 INFO:tasks.workunit.client.1.smithi194.stdout:8/556: mknod d2/d14/d18/d45/d4e/dbe/cc2 0 2024-02-20T08:06:14.552 INFO:tasks.workunit.client.1.smithi194.stdout:3/601: symlink d5/d10/d16/d7b/d94/dad/lb8 0 2024-02-20T08:06:14.555 INFO:tasks.workunit.client.1.smithi194.stdout:0/584: dread d6/d2b/d35/d42/d1e/f27 [0,4194304] 0 2024-02-20T08:06:14.557 INFO:tasks.workunit.client.1.smithi194.stdout:2/658: creat df/d3a/fd0 x:0 0 0 2024-02-20T08:06:14.560 INFO:tasks.workunit.client.1.smithi194.stdout:8/557: mkdir d2/d14/d18/d45/d4e/dbe/dc3 0 2024-02-20T08:06:14.560 INFO:tasks.workunit.client.1.smithi194.stdout:8/558: fsync d2/d14/d18/d45/d4e/d6c/d78/d98/f81 0 2024-02-20T08:06:14.561 INFO:tasks.workunit.client.1.smithi194.stdout:4/567: truncate d0/d10/d1c/f5a 3820526 0 2024-02-20T08:06:14.562 INFO:tasks.workunit.client.1.smithi194.stdout:3/602: mkdir d5/d10/d16/d7b/d94/dad/db9 0 2024-02-20T08:06:14.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/659: symlink df/d14/d80/d85/ld1 0 2024-02-20T08:06:14.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/660: dread - df/d14/d24/d56/d6b/d81/fbb zero size 2024-02-20T08:06:14.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/661: chown df/d14/d24/d56/d6b 302681 1 2024-02-20T08:06:14.568 INFO:tasks.workunit.client.1.smithi194.stdout:4/568: rename d0/df/c52 to d0/d5c/d60/d4a/d4e/ca5 0 2024-02-20T08:06:14.569 INFO:tasks.workunit.client.1.smithi194.stdout:5/653: link d4/d6/dd/d25/d78/d8b/d8a/dc4/c23 d4/d6/dd/cc9 0 2024-02-20T08:06:14.571 INFO:tasks.workunit.client.1.smithi194.stdout:8/559: mkdir d2/d14/dc4 0 2024-02-20T08:06:14.572 INFO:tasks.workunit.client.1.smithi194.stdout:2/662: dwrite df/f72 [4194304,4194304] 0 2024-02-20T08:06:14.573 INFO:tasks.workunit.client.1.smithi194.stdout:3/603: creat d5/d9e/fba x:0 0 0 2024-02-20T08:06:14.573 INFO:tasks.workunit.client.1.smithi194.stdout:3/604: chown d5/d10/d62/l72 457673 1 2024-02-20T08:06:14.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/605: chown d5/df/d30 13 1 2024-02-20T08:06:14.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/569: fsync d0/d10/d1c/d21/f96 0 2024-02-20T08:06:14.575 INFO:tasks.workunit.client.1.smithi194.stdout:4/570: readlink d0/df/d41/la3 0 2024-02-20T08:06:14.581 INFO:tasks.workunit.client.1.smithi194.stdout:5/654: getdents d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/d85/d53/db0 0 2024-02-20T08:06:14.581 INFO:tasks.workunit.client.1.smithi194.stdout:9/672: dwrite d4/d20/d5c/fcd [0,4194304] 0 2024-02-20T08:06:14.583 INFO:tasks.workunit.client.1.smithi194.stdout:4/571: symlink d0/df/d18/la6 0 2024-02-20T08:06:14.595 INFO:tasks.workunit.client.1.smithi194.stdout:2/663: mkdir df/d14/d24/dd2 0 2024-02-20T08:06:14.596 INFO:tasks.workunit.client.1.smithi194.stdout:3/606: unlink d5/d10/d17/d1d/d56/l85 0 2024-02-20T08:06:14.597 INFO:tasks.workunit.client.1.smithi194.stdout:3/607: stat d5/d10/d17/d1d/d3d/daa 0 2024-02-20T08:06:14.598 INFO:tasks.workunit.client.1.smithi194.stdout:6/736: sync 2024-02-20T08:06:14.599 INFO:tasks.workunit.client.1.smithi194.stdout:0/585: dwrite d6/d2b/d35/d42/d1e/d45/d58/f87 [0,4194304] 0 2024-02-20T08:06:14.605 INFO:tasks.workunit.client.1.smithi194.stdout:4/572: dread d0/d2/fe [0,4194304] 0 2024-02-20T08:06:14.620 INFO:tasks.workunit.client.1.smithi194.stdout:0/586: symlink d6/lc4 0 2024-02-20T08:06:14.624 INFO:tasks.workunit.client.1.smithi194.stdout:5/655: mknod d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/d85/d53/db0/cca 0 2024-02-20T08:06:14.625 INFO:tasks.workunit.client.1.smithi194.stdout:4/573: mknod d0/df/d41/d69/ca7 0 2024-02-20T08:06:14.627 INFO:tasks.workunit.client.1.smithi194.stdout:5/656: truncate d4/d6/dd/d25/f29 4909854 0 2024-02-20T08:06:14.627 INFO:tasks.workunit.client.1.smithi194.stdout:8/560: rename d2/d14/d18/d45/d69/cb4 to d2/d14/d18/cc5 0 2024-02-20T08:06:14.628 INFO:tasks.workunit.client.1.smithi194.stdout:9/673: dwrite d4/d37/d4f/fd1 [0,4194304] 0 2024-02-20T08:06:14.629 INFO:tasks.workunit.client.1.smithi194.stdout:3/608: write d5/d10/d16/f3a [4065745,75970] 0 2024-02-20T08:06:14.630 INFO:tasks.workunit.client.1.smithi194.stdout:9/674: stat d4/d20/d43/daa/fbb 0 2024-02-20T08:06:14.635 INFO:tasks.workunit.client.1.smithi194.stdout:4/574: creat d0/d2/d51/fa8 x:0 0 0 2024-02-20T08:06:14.636 INFO:tasks.workunit.client.1.smithi194.stdout:8/561: dwrite d2/d14/d18/d45/d4e/f64 [0,4194304] 0 2024-02-20T08:06:14.639 INFO:tasks.workunit.client.1.smithi194.stdout:5/657: write d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/f39 [3348454,20705] 0 2024-02-20T08:06:14.640 INFO:tasks.workunit.client.1.smithi194.stdout:9/675: dwrite d4/d20/d43/fbd [0,4194304] 0 2024-02-20T08:06:14.640 INFO:tasks.workunit.client.1.smithi194.stdout:3/609: creat d5/d10/d28/d41/d73/fbb x:0 0 0 2024-02-20T08:06:14.641 INFO:tasks.workunit.client.1.smithi194.stdout:5/658: chown d4/d6/dd/d25/d78/d8b/lc0 67 1 2024-02-20T08:06:14.641 INFO:tasks.workunit.client.1.smithi194.stdout:3/610: chown d5/d10/d8d/c99 5 1 2024-02-20T08:06:14.642 INFO:tasks.workunit.client.1.smithi194.stdout:3/611: chown d5/d10/d16/f5a 651611810 1 2024-02-20T08:06:14.643 INFO:tasks.workunit.client.1.smithi194.stdout:2/664: getdents df/d14/d19/d96 0 2024-02-20T08:06:14.645 INFO:tasks.workunit.client.1.smithi194.stdout:3/612: write d5/d10/d28/d41/d73/f79 [150049,49712] 0 2024-02-20T08:06:14.650 INFO:tasks.workunit.client.1.smithi194.stdout:4/575: creat d0/d5c/d60/d4a/d4e/fa9 x:0 0 0 2024-02-20T08:06:14.650 INFO:tasks.workunit.client.1.smithi194.stdout:6/737: getdents df/ded 0 2024-02-20T08:06:14.651 INFO:tasks.workunit.client.1.smithi194.stdout:6/738: chown c3 1731515 1 2024-02-20T08:06:14.652 INFO:tasks.workunit.client.1.smithi194.stdout:4/576: dread - d0/d10/d1c/d21/d62/f67 zero size 2024-02-20T08:06:14.653 INFO:tasks.workunit.client.1.smithi194.stdout:6/739: readlink df/dab/d1d/d28/d2b/ld6 0 2024-02-20T08:06:14.654 INFO:tasks.workunit.client.1.smithi194.stdout:9/676: mkdir d4/d1b/d2e/de0 0 2024-02-20T08:06:14.655 INFO:tasks.workunit.client.1.smithi194.stdout:2/665: creat df/d5b/d61/fd3 x:0 0 0 2024-02-20T08:06:14.657 INFO:tasks.workunit.client.1.smithi194.stdout:2/666: chown df/l33 5222194 1 2024-02-20T08:06:14.657 INFO:tasks.workunit.client.1.smithi194.stdout:0/587: dwrite d6/d2b/d35/d9c/f83 [0,4194304] 0 2024-02-20T08:06:14.660 INFO:tasks.workunit.client.1.smithi194.stdout:3/613: mknod d5/df/d9a/cbc 0 2024-02-20T08:06:14.660 INFO:tasks.workunit.client.1.smithi194.stdout:5/659: mkdir d4/d6/dd/d99/dcb 0 2024-02-20T08:06:14.664 INFO:tasks.workunit.client.1.smithi194.stdout:8/562: link d2/c43 d2/d14/d18/d45/d4e/d6c/cc6 0 2024-02-20T08:06:14.665 INFO:tasks.workunit.client.1.smithi194.stdout:5/660: read - d4/d6/dd/d25/d7d/fbe zero size 2024-02-20T08:06:14.666 INFO:tasks.workunit.client.1.smithi194.stdout:8/563: chown f1 4748 1 2024-02-20T08:06:14.667 INFO:tasks.workunit.client.1.smithi194.stdout:9/677: fsync d4/d20/d43/d51/f52 0 2024-02-20T08:06:14.669 INFO:tasks.workunit.client.1.smithi194.stdout:3/614: truncate d5/d10/d28/d41/d73/f79 461943 0 2024-02-20T08:06:14.673 INFO:tasks.workunit.client.1.smithi194.stdout:2/667: dwrite df/d14/d19/d5c/d60/f7f [0,4194304] 0 2024-02-20T08:06:14.674 INFO:tasks.workunit.client.1.smithi194.stdout:5/661: chown d4/d6/dd/d25/d78/d8b/fb4 7301674 1 2024-02-20T08:06:14.675 INFO:tasks.workunit.client.1.smithi194.stdout:0/588: dwrite d6/d2b/d35/d9c/f83 [0,4194304] 0 2024-02-20T08:06:14.683 INFO:tasks.workunit.client.1.smithi194.stdout:9/678: dread d4/d1b/d2e/f61 [0,4194304] 0 2024-02-20T08:06:14.685 INFO:tasks.workunit.client.1.smithi194.stdout:5/662: symlink d4/d6/d11/d2f/d77/lcc 0 2024-02-20T08:06:14.689 INFO:tasks.workunit.client.1.smithi194.stdout:3/615: dwrite d5/df/f67 [4194304,4194304] 0 2024-02-20T08:06:14.694 INFO:tasks.workunit.client.1.smithi194.stdout:2/668: dwrite df/d14/d80/d85/f86 [0,4194304] 0 2024-02-20T08:06:14.695 INFO:tasks.workunit.client.1.smithi194.stdout:6/740: dwrite df/dab/fd0 [4194304,4194304] 0 2024-02-20T08:06:14.699 INFO:tasks.workunit.client.1.smithi194.stdout:6/741: dread - df/dab/dcc/fe6 zero size 2024-02-20T08:06:14.703 INFO:tasks.workunit.client.1.smithi194.stdout:2/669: chown df/d5b/d61/f8b 58 1 2024-02-20T08:06:14.704 INFO:tasks.workunit.client.1.smithi194.stdout:4/577: dread d0/d5c/d60/f39 [0,4194304] 0 2024-02-20T08:06:14.704 INFO:tasks.workunit.client.1.smithi194.stdout:0/589: dread d6/d2b/d35/d42/f74 [0,4194304] 0 2024-02-20T08:06:14.708 INFO:tasks.workunit.client.1.smithi194.stdout:6/742: symlink df/dab/d1d/d28/d46/dc4/lf8 0 2024-02-20T08:06:14.709 INFO:tasks.workunit.client.1.smithi194.stdout:4/578: dread d0/d5c/d60/f78 [0,4194304] 0 2024-02-20T08:06:14.709 INFO:tasks.workunit.client.1.smithi194.stdout:9/679: dread d4/d37/fb8 [0,4194304] 0 2024-02-20T08:06:14.709 INFO:tasks.workunit.client.1.smithi194.stdout:2/670: mknod df/d14/d19/d5c/d60/d63/d92/cd4 0 2024-02-20T08:06:14.711 INFO:tasks.workunit.client.1.smithi194.stdout:4/579: truncate d0/d5c/d60/d4a/d4e/fa9 277234 0 2024-02-20T08:06:14.712 INFO:tasks.workunit.client.1.smithi194.stdout:2/671: unlink df/f2b 0 2024-02-20T08:06:14.713 INFO:tasks.workunit.client.1.smithi194.stdout:9/680: mknod d4/d1b/d2e/ce1 0 2024-02-20T08:06:14.715 INFO:tasks.workunit.client.1.smithi194.stdout:4/580: read d0/d10/d1c/d21/f57 [1178632,44210] 0 2024-02-20T08:06:14.716 INFO:tasks.workunit.client.1.smithi194.stdout:2/672: chown df/d14/d19/d5c/d60/d63/l68 14159 1 2024-02-20T08:06:14.716 INFO:tasks.workunit.client.1.smithi194.stdout:0/590: dwrite d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:14.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/681: mkdir d4/d37/de2 0 2024-02-20T08:06:14.719 INFO:tasks.workunit.client.1.smithi194.stdout:6/743: truncate df/dab/d1d/d28/d46/d5a/f71 1826610 0 2024-02-20T08:06:14.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/591: dwrite d6/d2b/d35/d42/d1e/d45/d58/f8d [0,4194304] 0 2024-02-20T08:06:14.732 INFO:tasks.workunit.client.1.smithi194.stdout:3/616: dwrite d5/f8 [4194304,4194304] 0 2024-02-20T08:06:14.734 INFO:tasks.workunit.client.1.smithi194.stdout:6/744: dread df/dab/d1d/d28/d5e/f69 [0,4194304] 0 2024-02-20T08:06:14.735 INFO:tasks.workunit.client.1.smithi194.stdout:7/654: sync 2024-02-20T08:06:14.738 INFO:tasks.workunit.client.1.smithi194.stdout:9/682: dwrite d4/d1b/d2e/f30 [4194304,4194304] 0 2024-02-20T08:06:14.738 INFO:tasks.workunit.client.1.smithi194.stdout:3/617: write d5/d10/d16/f3a [3960305,130831] 0 2024-02-20T08:06:14.744 INFO:tasks.workunit.client.1.smithi194.stdout:5/663: dread d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/f39 [0,4194304] 0 2024-02-20T08:06:14.745 INFO:tasks.workunit.client.1.smithi194.stdout:9/683: symlink d4/d37/ddf/d59/le3 0 2024-02-20T08:06:14.746 INFO:tasks.workunit.client.1.smithi194.stdout:0/592: fsync d6/d2b/d35/d42/d1e/d45/d58/f8d 0 2024-02-20T08:06:14.747 INFO:tasks.workunit.client.1.smithi194.stdout:4/581: truncate d0/df/f13 2005786 0 2024-02-20T08:06:14.747 INFO:tasks.workunit.client.1.smithi194.stdout:5/664: fdatasync d4/d6/dd/d25/d78/f98 0 2024-02-20T08:06:14.749 INFO:tasks.workunit.client.1.smithi194.stdout:5/665: readlink d4/d6/l95 0 2024-02-20T08:06:14.750 INFO:tasks.workunit.client.1.smithi194.stdout:4/582: stat d0/d5c/d60/f78 0 2024-02-20T08:06:14.752 INFO:tasks.workunit.client.1.smithi194.stdout:7/655: dread d11/d2d/d38/d37/d43/d8e/d5e/fa3 [0,4194304] 0 2024-02-20T08:06:14.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/684: creat d4/d37/d38/fe4 x:0 0 0 2024-02-20T08:06:14.753 INFO:tasks.workunit.client.1.smithi194.stdout:4/583: write d0/df/f84 [1355998,111982] 0 2024-02-20T08:06:14.754 INFO:tasks.workunit.client.1.smithi194.stdout:7/656: stat d11/l6c 0 2024-02-20T08:06:14.755 INFO:tasks.workunit.client.1.smithi194.stdout:2/673: dwrite fc [0,4194304] 0 2024-02-20T08:06:14.755 INFO:tasks.workunit.client.1.smithi194.stdout:0/593: mknod d6/d2b/d35/d42/d1e/d45/cc5 0 2024-02-20T08:06:14.756 INFO:tasks.workunit.client.1.smithi194.stdout:4/584: readlink d0/df/d41/la3 0 2024-02-20T08:06:14.760 INFO:tasks.workunit.client.1.smithi194.stdout:5/666: dwrite d4/d6/f5e [0,4194304] 0 2024-02-20T08:06:14.762 INFO:tasks.workunit.client.1.smithi194.stdout:3/618: getdents d5/df/d75 0 2024-02-20T08:06:14.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/745: link df/dab/d1d/d28/d2b/d80/le2 df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/lf9 0 2024-02-20T08:06:14.766 INFO:tasks.workunit.client.1.smithi194.stdout:8/564: sync 2024-02-20T08:06:14.766 INFO:tasks.workunit.client.1.smithi194.stdout:1/626: sync 2024-02-20T08:06:14.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/667: mkdir d4/d6/dd/d25/d7d/dcd 0 2024-02-20T08:06:14.775 INFO:tasks.workunit.client.1.smithi194.stdout:9/685: symlink d4/d37/de2/le5 0 2024-02-20T08:06:14.776 INFO:tasks.workunit.client.1.smithi194.stdout:9/686: write d4/d20/d5c/fc9 [264621,95598] 0 2024-02-20T08:06:14.778 INFO:tasks.workunit.client.1.smithi194.stdout:9/687: chown d4/d37/ddf/d59/c93 4 1 2024-02-20T08:06:14.782 INFO:tasks.workunit.client.1.smithi194.stdout:6/746: rename df/dab/d1d/d28/d2b/d9b/cb0 to df/dbe/cfa 0 2024-02-20T08:06:14.782 INFO:tasks.workunit.client.1.smithi194.stdout:7/657: write d11/d2d/d38/d37/d43/d8e/f5d [3427236,12658] 0 2024-02-20T08:06:14.784 INFO:tasks.workunit.client.1.smithi194.stdout:0/594: mknod d6/d2b/d35/d9c/d9f/da6/cc6 0 2024-02-20T08:06:14.789 INFO:tasks.workunit.client.1.smithi194.stdout:2/674: dwrite df/d14/d24/f48 [0,4194304] 0 2024-02-20T08:06:14.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/619: truncate d5/d10/d16/f2d 297763 0 2024-02-20T08:06:14.790 INFO:tasks.workunit.client.1.smithi194.stdout:0/595: dread d6/d2b/d35/f73 [0,4194304] 0 2024-02-20T08:06:14.791 INFO:tasks.workunit.client.1.smithi194.stdout:0/596: fsync d6/d2b/d35/d42/f15 0 2024-02-20T08:06:14.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/565: rename d2/d14/d18/d45/d4e/d6c to d2/d14/d18/d45/d7b/dc7 0 2024-02-20T08:06:14.795 INFO:tasks.workunit.client.1.smithi194.stdout:4/585: dread d0/d5c/d60/f6e [0,4194304] 0 2024-02-20T08:06:14.796 INFO:tasks.workunit.client.1.smithi194.stdout:7/658: creat d11/d2d/d38/d37/d3c/fc7 x:0 0 0 2024-02-20T08:06:14.797 INFO:tasks.workunit.client.1.smithi194.stdout:4/586: write d0/d5c/f7c [6239160,25704] 0 2024-02-20T08:06:14.797 INFO:tasks.workunit.client.1.smithi194.stdout:9/688: dwrite d4/d1b/d2e/f61 [0,4194304] 0 2024-02-20T08:06:14.798 INFO:tasks.workunit.client.1.smithi194.stdout:9/689: stat d4/d37/ddf/d59/cd4 0 2024-02-20T08:06:14.801 INFO:tasks.workunit.client.1.smithi194.stdout:5/668: dread - d4/d20/d2b/d79/f8e zero size 2024-02-20T08:06:14.810 INFO:tasks.workunit.client.1.smithi194.stdout:6/747: fsync df/dab/d1d/d28/d2b/d80/fdc 0 2024-02-20T08:06:14.811 INFO:tasks.workunit.client.1.smithi194.stdout:0/597: dwrite d6/f17 [0,4194304] 0 2024-02-20T08:06:14.811 INFO:tasks.workunit.client.1.smithi194.stdout:6/748: dread - df/dab/dcc/fe6 zero size 2024-02-20T08:06:14.812 INFO:tasks.workunit.client.1.smithi194.stdout:6/749: read df/fe3 [277555,55313] 0 2024-02-20T08:06:14.817 INFO:tasks.workunit.client.1.smithi194.stdout:7/659: mkdir d11/d2d/d38/d37/d43/d7b/dc5/dc8 0 2024-02-20T08:06:14.818 INFO:tasks.workunit.client.1.smithi194.stdout:7/660: readlink d11/d2d/d38/d4a/l19 0 2024-02-20T08:06:14.818 INFO:tasks.workunit.client.1.smithi194.stdout:4/587: mkdir d0/df/d41/d69/daa 0 2024-02-20T08:06:14.820 INFO:tasks.workunit.client.1.smithi194.stdout:5/669: symlink d4/d6/dd/d25/d78/d8b/d8a/dc4/d28/lce 0 2024-02-20T08:06:14.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/661: truncate d11/d2d/d38/d4a/d53/da0/fbc 231998 0 2024-02-20T08:06:14.824 INFO:tasks.workunit.client.1.smithi194.stdout:1/627: rename d2/d8/d12/dc9/d26/d3d/d82/cb9 to d2/d8/d12/dc9/d26/d3d/d71/ccf 0 2024-02-20T08:06:14.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/670: dwrite d4/d6/d11/d2f/f52 [0,4194304] 0 2024-02-20T08:06:14.826 INFO:tasks.workunit.client.1.smithi194.stdout:1/628: write d2/d8/df/f29 [874252,74402] 0 2024-02-20T08:06:14.826 INFO:tasks.workunit.client.1.smithi194.stdout:5/671: chown d4/d20/d2b/d79/cc5 0 1 2024-02-20T08:06:14.828 INFO:tasks.workunit.client.1.smithi194.stdout:8/566: creat d2/d14/d18/d45/d4e/dbe/dc3/fc8 x:0 0 0 2024-02-20T08:06:14.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/675: creat df/d14/d19/d5c/fd5 x:0 0 0 2024-02-20T08:06:14.836 INFO:tasks.workunit.client.1.smithi194.stdout:5/672: dwrite d4/d6/dd/d25/d7d/fbd [0,4194304] 0 2024-02-20T08:06:14.837 INFO:tasks.workunit.client.1.smithi194.stdout:7/662: mkdir d11/d2d/d38/d37/d3c/d8d/dc9 0 2024-02-20T08:06:14.838 INFO:tasks.workunit.client.1.smithi194.stdout:5/673: write d4/d6/dd/d25/d78/d8b/f24 [5087111,10490] 0 2024-02-20T08:06:14.839 INFO:tasks.workunit.client.1.smithi194.stdout:3/620: rename d5/df/d60/c4c to d5/d10/d28/d41/d73/d8c/cbd 0 2024-02-20T08:06:14.851 INFO:tasks.workunit.client.1.smithi194.stdout:9/690: link d4/d37/ddf/f9e d4/d20/d43/fe6 0 2024-02-20T08:06:14.851 INFO:tasks.workunit.client.1.smithi194.stdout:6/750: dread df/dab/f54 [0,4194304] 0 2024-02-20T08:06:14.852 INFO:tasks.workunit.client.1.smithi194.stdout:9/691: chown d4/d1b/d90/c98 13820 1 2024-02-20T08:06:14.852 INFO:tasks.workunit.client.1.smithi194.stdout:9/692: fsync d4/d8b/fd9 0 2024-02-20T08:06:14.853 INFO:tasks.workunit.client.1.smithi194.stdout:8/567: symlink d2/d14/d18/d45/d4e/dbe/dc3/lc9 0 2024-02-20T08:06:14.859 INFO:tasks.workunit.client.1.smithi194.stdout:7/663: dread d11/d2d/d38/d37/d43/d8e/d5e/f6a [4194304,4194304] 0 2024-02-20T08:06:14.866 INFO:tasks.workunit.client.1.smithi194.stdout:9/693: symlink d4/d1b/d79/le7 0 2024-02-20T08:06:14.867 INFO:tasks.workunit.client.1.smithi194.stdout:0/598: truncate d6/d2b/d35/d42/d1e/d45/d58/f9e 1610281 0 2024-02-20T08:06:14.868 INFO:tasks.workunit.client.1.smithi194.stdout:9/694: dread d4/d37/dab/fd3 [0,4194304] 0 2024-02-20T08:06:14.869 INFO:tasks.workunit.client.1.smithi194.stdout:9/695: write d4/d20/d5c/fcd [303362,28558] 0 2024-02-20T08:06:14.871 INFO:tasks.workunit.client.1.smithi194.stdout:2/676: link df/d14/d19/f2a df/d5b/d61/dce/fd6 0 2024-02-20T08:06:14.874 INFO:tasks.workunit.client.1.smithi194.stdout:5/674: mknod d4/d6/dd/d25/d78/d8b/d8a/db6/dbc/ccf 0 2024-02-20T08:06:14.875 INFO:tasks.workunit.client.1.smithi194.stdout:6/751: write df/dab/d1d/f23 [3660638,16954] 0 2024-02-20T08:06:14.875 INFO:tasks.workunit.client.1.smithi194.stdout:3/621: getdents d5/d10/d28/db4 0 2024-02-20T08:06:14.876 INFO:tasks.workunit.client.1.smithi194.stdout:6/752: chown df 4629510 1 2024-02-20T08:06:14.876 INFO:tasks.workunit.client.1.smithi194.stdout:7/664: creat d11/d2d/d38/d37/d43/d7b/d91/fca x:0 0 0 2024-02-20T08:06:14.877 INFO:tasks.workunit.client.1.smithi194.stdout:1/629: link d2/d8/d12/dc9/d61/d7d/dbf/lc4 d2/d8/d12/dc9/d61/d9f/ld0 0 2024-02-20T08:06:14.879 INFO:tasks.workunit.client.1.smithi194.stdout:7/665: chown d11/d2d/d38/d4a/d27/d51/d84/f6d 10394838 1 2024-02-20T08:06:14.882 INFO:tasks.workunit.client.1.smithi194.stdout:2/677: mkdir df/d14/d24/d56/d6b/db7/dc1/dd7 0 2024-02-20T08:06:14.883 INFO:tasks.workunit.client.1.smithi194.stdout:6/753: dwrite df/dab/fd0 [4194304,4194304] 0 2024-02-20T08:06:14.883 INFO:tasks.workunit.client.1.smithi194.stdout:4/588: rename d0/df/d18/d5e/c80 to d0/d10/d1c/cab 0 2024-02-20T08:06:14.885 INFO:tasks.workunit.client.1.smithi194.stdout:6/754: dread - df/dab/d1d/d28/d46/d5a/fc8 zero size 2024-02-20T08:06:14.895 INFO:tasks.workunit.client.1.smithi194.stdout:3/622: mknod d5/d10/d16/d7b/cbe 0 2024-02-20T08:06:14.898 INFO:tasks.workunit.client.1.smithi194.stdout:9/696: creat d4/d37/ddf/dc8/fe8 x:0 0 0 2024-02-20T08:06:14.899 INFO:tasks.workunit.client.1.smithi194.stdout:9/697: chown d4/d37/ddf/d42/d4e 1 1 2024-02-20T08:06:14.899 INFO:tasks.workunit.client.1.smithi194.stdout:8/568: dwrite d2/d14/f5c [0,4194304] 0 2024-02-20T08:06:14.904 INFO:tasks.workunit.client.1.smithi194.stdout:7/666: creat d11/d2d/d38/d37/d43/d7b/fcb x:0 0 0 2024-02-20T08:06:14.905 INFO:tasks.workunit.client.1.smithi194.stdout:2/678: fsync df/d14/d24/d56/d6b/db7/dc1/fc2 0 2024-02-20T08:06:14.905 INFO:tasks.workunit.client.1.smithi194.stdout:7/667: fdatasync d11/d2d/d38/d37/d43/d7b/d91/f98 0 2024-02-20T08:06:14.906 INFO:tasks.workunit.client.1.smithi194.stdout:7/668: chown d11/d2d/d38/d37/d43/d8e/d6b/fa9 10106308 1 2024-02-20T08:06:14.907 INFO:tasks.workunit.client.1.smithi194.stdout:1/630: rename d2/d8/df/l18 to d2/d8/d12/dc9/d26/d3d/d71/ld1 0 2024-02-20T08:06:14.909 INFO:tasks.workunit.client.1.smithi194.stdout:6/755: fdatasync fe 0 2024-02-20T08:06:14.912 INFO:tasks.workunit.client.1.smithi194.stdout:3/623: chown d5/d10/d17/d1d/c68 175961388 1 2024-02-20T08:06:14.913 INFO:tasks.workunit.client.1.smithi194.stdout:8/569: readlink d2/d14/l20 0 2024-02-20T08:06:14.916 INFO:tasks.workunit.client.1.smithi194.stdout:2/679: mknod df/d3a/db2/cd8 0 2024-02-20T08:06:14.919 INFO:tasks.workunit.client.1.smithi194.stdout:1/631: dwrite d2/d8/fc5 [0,4194304] 0 2024-02-20T08:06:14.921 INFO:tasks.workunit.client.1.smithi194.stdout:2/680: chown df/d14/d24/d56/d6b/d81/f79 1980759 1 2024-02-20T08:06:14.925 INFO:tasks.workunit.client.1.smithi194.stdout:4/589: dwrite d0/d10/d1c/d4d/d2f/f3a [4194304,4194304] 0 2024-02-20T08:06:14.925 INFO:tasks.workunit.client.1.smithi194.stdout:2/681: stat df/d14/d24/f48 0 2024-02-20T08:06:14.927 INFO:tasks.workunit.client.1.smithi194.stdout:5/675: creat d4/d6/dd/fd0 x:0 0 0 2024-02-20T08:06:14.927 INFO:tasks.workunit.client.1.smithi194.stdout:6/756: dwrite df/dab/d1d/d28/d46/d5a/f64 [0,4194304] 0 2024-02-20T08:06:14.930 INFO:tasks.workunit.client.1.smithi194.stdout:6/757: write df/dab/d1d/d28/d2b/f3e [5091587,17389] 0 2024-02-20T08:06:14.931 INFO:tasks.workunit.client.1.smithi194.stdout:3/624: symlink d5/d10/d8d/lbf 0 2024-02-20T08:06:14.938 INFO:tasks.workunit.client.1.smithi194.stdout:7/669: symlink d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb/lcc 0 2024-02-20T08:06:14.939 INFO:tasks.workunit.client.1.smithi194.stdout:4/590: read d0/d10/d1c/d21/d62/f93 [3053874,51024] 0 2024-02-20T08:06:14.948 INFO:tasks.workunit.client.1.smithi194.stdout:1/632: creat d2/d8/d12/dc9/d61/d7d/dbf/fd2 x:0 0 0 2024-02-20T08:06:14.949 INFO:tasks.workunit.client.1.smithi194.stdout:2/682: mknod df/d14/d19/d5c/d60/cd9 0 2024-02-20T08:06:14.950 INFO:tasks.workunit.client.1.smithi194.stdout:9/698: truncate d4/d37/dab/fce 3126315 0 2024-02-20T08:06:14.950 INFO:tasks.workunit.client.1.smithi194.stdout:9/699: fsync d4/d55/fc0 0 2024-02-20T08:06:14.951 INFO:tasks.workunit.client.1.smithi194.stdout:5/676: rmdir d4/d6/dd/d25/d78/d8b/d8a/db6/dbc 39 2024-02-20T08:06:14.952 INFO:tasks.workunit.client.1.smithi194.stdout:5/677: chown d4/d6/dd/d3a/d86/lab 5576259 1 2024-02-20T08:06:14.952 INFO:tasks.workunit.client.1.smithi194.stdout:6/758: symlink df/dab/dcc/lfb 0 2024-02-20T08:06:14.953 INFO:tasks.workunit.client.1.smithi194.stdout:5/678: chown d4/d6/dd/d3a/l6d 613538635 1 2024-02-20T08:06:14.954 INFO:tasks.workunit.client.1.smithi194.stdout:3/625: fsync d5/df/f24 0 2024-02-20T08:06:14.954 INFO:tasks.workunit.client.1.smithi194.stdout:7/670: creat d11/d2d/d38/d37/d43/d7b/d91/d9c/fcd x:0 0 0 2024-02-20T08:06:14.956 INFO:tasks.workunit.client.1.smithi194.stdout:5/679: write d4/d6/d11/d2f/f52 [629847,115420] 0 2024-02-20T08:06:14.957 INFO:tasks.workunit.client.1.smithi194.stdout:8/570: symlink d2/d14/dc4/lca 0 2024-02-20T08:06:14.957 INFO:tasks.workunit.client.1.smithi194.stdout:7/671: chown d11/d2d/d38/d37/d43/d7b/dc5 7622833 1 2024-02-20T08:06:14.958 INFO:tasks.workunit.client.1.smithi194.stdout:5/680: chown d4/d6/d11/d2f/f4d 982350638 1 2024-02-20T08:06:14.959 INFO:tasks.workunit.client.1.smithi194.stdout:1/633: creat d2/d8/d60/d75/fd3 x:0 0 0 2024-02-20T08:06:14.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/681: chown d4/d6/d11/d2f/f52 1 1 2024-02-20T08:06:14.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/682: write d4/d20/d2b/d79/f60 [1980743,33771] 0 2024-02-20T08:06:14.965 INFO:tasks.workunit.client.1.smithi194.stdout:0/599: sync 2024-02-20T08:06:14.967 INFO:tasks.workunit.client.1.smithi194.stdout:4/591: creat d0/d9d/fac x:0 0 0 2024-02-20T08:06:14.973 INFO:tasks.workunit.client.1.smithi194.stdout:0/600: dwrite d6/d2b/d35/d42/d1e/d3c/f68 [0,4194304] 0 2024-02-20T08:06:14.974 INFO:tasks.workunit.client.1.smithi194.stdout:3/626: dread d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:14.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/627: write d5/d10/d28/fb0 [617740,88166] 0 2024-02-20T08:06:14.979 INFO:tasks.workunit.client.1.smithi194.stdout:3/628: dread d5/d10/d17/d1d/d56/faf [0,4194304] 0 2024-02-20T08:06:14.981 INFO:tasks.workunit.client.1.smithi194.stdout:1/634: symlink d2/d8/d12/dc9/d61/ld4 0 2024-02-20T08:06:14.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/571: dread d2/d14/d18/d45/d4e/fa8 [0,4194304] 0 2024-02-20T08:06:14.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/572: chown d2/d14/d18/d45/d7b/fb6 8026274 1 2024-02-20T08:06:14.984 INFO:tasks.workunit.client.1.smithi194.stdout:8/573: write d2/d14/d18/d45/f95 [759963,34136] 0 2024-02-20T08:06:14.985 INFO:tasks.workunit.client.1.smithi194.stdout:7/672: dread fd [4194304,4194304] 0 2024-02-20T08:06:14.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/574: chown d2/d14/d18/d45/d90/lbd 2144889984 1 2024-02-20T08:06:14.986 INFO:tasks.workunit.client.1.smithi194.stdout:4/592: rename d0/df/d18/d5e to d0/d5c/d60/d4a/dad 0 2024-02-20T08:06:14.987 INFO:tasks.workunit.client.1.smithi194.stdout:4/593: chown d0/d10/d1c/d4d/d2f 4208 1 2024-02-20T08:06:14.988 INFO:tasks.workunit.client.1.smithi194.stdout:0/601: creat d6/d2b/fc7 x:0 0 0 2024-02-20T08:06:14.988 INFO:tasks.workunit.client.1.smithi194.stdout:0/602: stat d6/d2b/f3a 0 2024-02-20T08:06:14.989 INFO:tasks.workunit.client.1.smithi194.stdout:4/594: truncate d0/d10/d1c/d21/d46/f99 1972657 0 2024-02-20T08:06:14.993 INFO:tasks.workunit.client.1.smithi194.stdout:3/629: creat d5/d10/d28/d41/fc0 x:0 0 0 2024-02-20T08:06:14.993 INFO:tasks.workunit.client.1.smithi194.stdout:3/630: readlink d5/d10/d17/d1d/d3d/l70 0 2024-02-20T08:06:14.994 INFO:tasks.workunit.client.1.smithi194.stdout:3/631: chown d5/d10/f13 0 1 2024-02-20T08:06:14.994 INFO:tasks.workunit.client.1.smithi194.stdout:1/635: creat d2/d8/d12/dc9/d26/d3d/d82/fd5 x:0 0 0 2024-02-20T08:06:14.998 INFO:tasks.workunit.client.1.smithi194.stdout:8/575: symlink d2/d14/d18/d45/d4e/dbe/dc3/lcb 0 2024-02-20T08:06:15.000 INFO:tasks.workunit.client.1.smithi194.stdout:4/595: creat d0/d5c/fae x:0 0 0 2024-02-20T08:06:15.001 INFO:tasks.workunit.client.1.smithi194.stdout:4/596: readlink d0/df/d18/la6 0 2024-02-20T08:06:15.002 INFO:tasks.workunit.client.1.smithi194.stdout:4/597: stat d0/d10/d1c/d21/f96 0 2024-02-20T08:06:15.002 INFO:tasks.workunit.client.1.smithi194.stdout:5/683: mkdir d4/d6/dd/d99/dd1 0 2024-02-20T08:06:15.003 INFO:tasks.workunit.client.1.smithi194.stdout:7/673: mkdir d11/d2d/d38/dce 0 2024-02-20T08:06:15.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/576: symlink d2/d14/d18/d45/d69/d9b/lcc 0 2024-02-20T08:06:15.005 INFO:tasks.workunit.client.1.smithi194.stdout:6/759: link df/dab/d1d/d28/d2b/l34 df/dab/d1d/d28/d2b/d80/lfc 0 2024-02-20T08:06:15.005 INFO:tasks.workunit.client.1.smithi194.stdout:7/674: write d11/d2d/d38/d37/d43/d7b/d91/f97 [621033,52642] 0 2024-02-20T08:06:15.008 INFO:tasks.workunit.client.1.smithi194.stdout:3/632: symlink d5/d10/d17/d1d/d3d/lc1 0 2024-02-20T08:06:15.009 INFO:tasks.workunit.client.1.smithi194.stdout:1/636: mknod d2/d8/d12/dc9/cd6 0 2024-02-20T08:06:15.009 INFO:tasks.workunit.client.1.smithi194.stdout:7/675: write d11/d2d/d38/d4a/d53/d81/f86 [151196,89248] 0 2024-02-20T08:06:15.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/598: fsync d0/d2/f6a 0 2024-02-20T08:06:15.010 INFO:tasks.workunit.client.1.smithi194.stdout:5/684: dwrite d4/d6/f1f [0,4194304] 0 2024-02-20T08:06:15.013 INFO:tasks.workunit.client.1.smithi194.stdout:5/685: write d4/d20/d2b/d79/f83 [4576519,47325] 0 2024-02-20T08:06:15.014 INFO:tasks.workunit.client.1.smithi194.stdout:0/603: link d6/d2b/d35/d48/f4a d6/d2b/d35/d42/d1e/d45/daa/fc8 0 2024-02-20T08:06:15.016 INFO:tasks.workunit.client.1.smithi194.stdout:6/760: write df/dab/f54 [774447,22499] 0 2024-02-20T08:06:15.018 INFO:tasks.workunit.client.1.smithi194.stdout:6/761: dread - df/dab/d1d/d28/d46/d5a/fc8 zero size 2024-02-20T08:06:15.022 INFO:tasks.workunit.client.1.smithi194.stdout:1/637: read d2/d8/d12/dc9/d61/f9c [663089,22639] 0 2024-02-20T08:06:15.024 INFO:tasks.workunit.client.1.smithi194.stdout:0/604: dwrite d6/d2b/d35/d42/d1e/d45/f51 [0,4194304] 0 2024-02-20T08:06:15.024 INFO:tasks.workunit.client.1.smithi194.stdout:7/676: creat d11/d2d/d38/d37/d3c/d8d/fcf x:0 0 0 2024-02-20T08:06:15.026 INFO:tasks.workunit.client.1.smithi194.stdout:8/577: dread d2/d80/fa6 [0,4194304] 0 2024-02-20T08:06:15.029 INFO:tasks.workunit.client.1.smithi194.stdout:5/686: unlink d4/d20/d2b/l7b 0 2024-02-20T08:06:15.031 INFO:tasks.workunit.client.1.smithi194.stdout:0/605: rmdir d6/d2b/d35/d9c 39 2024-02-20T08:06:15.032 INFO:tasks.workunit.client.1.smithi194.stdout:6/762: dwrite df/dab/d1d/d28/d2b/d94/fc3 [0,4194304] 0 2024-02-20T08:06:15.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/700: sync 2024-02-20T08:06:15.042 INFO:tasks.workunit.client.1.smithi194.stdout:2/683: sync 2024-02-20T08:06:15.042 INFO:tasks.workunit.client.1.smithi194.stdout:7/677: dread d11/d6e/f78 [0,4194304] 0 2024-02-20T08:06:15.042 INFO:tasks.workunit.client.1.smithi194.stdout:1/638: dwrite d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [0,4194304] 0 2024-02-20T08:06:15.045 INFO:tasks.workunit.client.1.smithi194.stdout:3/633: dread d5/df/d60/fa3 [0,4194304] 0 2024-02-20T08:06:15.046 INFO:tasks.workunit.client.1.smithi194.stdout:0/606: dwrite d6/d2b/f50 [0,4194304] 0 2024-02-20T08:06:15.046 INFO:tasks.workunit.client.1.smithi194.stdout:2/684: write df/d5b/d61/f89 [2740060,3989] 0 2024-02-20T08:06:15.046 INFO:tasks.workunit.client.1.smithi194.stdout:8/578: creat d2/d14/d18/d45/fcd x:0 0 0 2024-02-20T08:06:15.051 INFO:tasks.workunit.client.1.smithi194.stdout:5/687: symlink d4/d6/dd/d99/dd1/ld2 0 2024-02-20T08:06:15.053 INFO:tasks.workunit.client.1.smithi194.stdout:6/763: rename df/dab/f29 to df/d42/da8/ffd 0 2024-02-20T08:06:15.057 INFO:tasks.workunit.client.1.smithi194.stdout:3/634: mkdir d5/d10/d17/dc2 0 2024-02-20T08:06:15.058 INFO:tasks.workunit.client.1.smithi194.stdout:4/599: dwrite d0/f7f [0,4194304] 0 2024-02-20T08:06:15.060 INFO:tasks.workunit.client.1.smithi194.stdout:1/639: dread d2/d8/d12/dc9/d61/d68/f7f [0,4194304] 0 2024-02-20T08:06:15.066 INFO:tasks.workunit.client.1.smithi194.stdout:0/607: unlink d6/d2b/d35/d48/fa1 0 2024-02-20T08:06:15.074 INFO:tasks.workunit.client.1.smithi194.stdout:6/764: rmdir df/dab/d1d/d28/d2b 39 2024-02-20T08:06:15.079 INFO:tasks.workunit.client.1.smithi194.stdout:3/635: unlink d5/d10/d17/d1d/d3d/lac 0 2024-02-20T08:06:15.079 INFO:tasks.workunit.client.1.smithi194.stdout:3/636: fsync d5/df/d30/d80/f89 0 2024-02-20T08:06:15.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/685: mkdir df/d5b/d61/dce/dda 0 2024-02-20T08:06:15.081 INFO:tasks.workunit.client.1.smithi194.stdout:7/678: truncate d11/d2d/fb2 361055 0 2024-02-20T08:06:15.082 INFO:tasks.workunit.client.1.smithi194.stdout:4/600: symlink d0/df/d72/laf 0 2024-02-20T08:06:15.082 INFO:tasks.workunit.client.1.smithi194.stdout:4/601: fdatasync d0/f2d 0 2024-02-20T08:06:15.086 INFO:tasks.workunit.client.1.smithi194.stdout:1/640: symlink d2/d8/d12/dc9/d26/d57/ld7 0 2024-02-20T08:06:15.090 INFO:tasks.workunit.client.1.smithi194.stdout:0/608: rmdir d6/d2b/d35/d48/d60 39 2024-02-20T08:06:15.092 INFO:tasks.workunit.client.1.smithi194.stdout:5/688: symlink d4/d6/dd/d25/d7d/dcd/ld3 0 2024-02-20T08:06:15.093 INFO:tasks.workunit.client.1.smithi194.stdout:5/689: chown d4/f73 1031114 1 2024-02-20T08:06:15.094 INFO:tasks.workunit.client.1.smithi194.stdout:8/579: truncate d2/f2e 457889 0 2024-02-20T08:06:15.096 INFO:tasks.workunit.client.1.smithi194.stdout:9/701: link d4/d37/dab/lc5 d4/d37/d4f/le9 0 2024-02-20T08:06:15.100 INFO:tasks.workunit.client.1.smithi194.stdout:3/637: fdatasync d5/d10/d28/fb3 0 2024-02-20T08:06:15.101 INFO:tasks.workunit.client.1.smithi194.stdout:3/638: chown d5/d10/d17/d1d/d3d/daa 338407 1 2024-02-20T08:06:15.101 INFO:tasks.workunit.client.1.smithi194.stdout:3/639: fdatasync d5/d10/d17/d1d/d56/f71 0 2024-02-20T08:06:15.103 INFO:tasks.workunit.client.1.smithi194.stdout:2/686: chown df/d5b/d61/la5 13590 1 2024-02-20T08:06:15.108 INFO:tasks.workunit.client.1.smithi194.stdout:1/641: symlink d2/d8/df/ld8 0 2024-02-20T08:06:15.111 INFO:tasks.workunit.client.1.smithi194.stdout:5/690: mknod d4/d6/d11/d2f/d77/cd4 0 2024-02-20T08:06:15.115 INFO:tasks.workunit.client.1.smithi194.stdout:6/765: creat df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/ffe x:0 0 0 2024-02-20T08:06:15.116 INFO:tasks.workunit.client.1.smithi194.stdout:9/702: mknod d4/d1b/d2e/cea 0 2024-02-20T08:06:15.118 INFO:tasks.workunit.client.1.smithi194.stdout:8/580: dread d2/d14/d18/f27 [0,4194304] 0 2024-02-20T08:06:15.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/581: read - d2/d80/fbb zero size 2024-02-20T08:06:15.120 INFO:tasks.workunit.client.1.smithi194.stdout:7/679: dread d11/d2d/d38/d4a/d53/f58 [0,4194304] 0 2024-02-20T08:06:15.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/766: dwrite df/d42/da8/fad [0,4194304] 0 2024-02-20T08:06:15.125 INFO:tasks.workunit.client.1.smithi194.stdout:1/642: readlink d2/d8/d12/dc9/d61/d9f/lad 0 2024-02-20T08:06:15.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/767: truncate df/d42/f65 4801317 0 2024-02-20T08:06:15.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/680: dwrite d11/d2d/d38/d37/f90 [4194304,4194304] 0 2024-02-20T08:06:15.135 INFO:tasks.workunit.client.1.smithi194.stdout:6/768: dwrite df/dab/f1a [4194304,4194304] 0 2024-02-20T08:06:15.135 INFO:tasks.workunit.client.1.smithi194.stdout:5/691: creat d4/d6/dd/d25/d78/d8b/d8a/fd5 x:0 0 0 2024-02-20T08:06:15.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/692: dwrite d4/d20/faa [0,4194304] 0 2024-02-20T08:06:15.152 INFO:tasks.workunit.client.1.smithi194.stdout:2/687: write df/d5b/d61/dce/fd6 [1053562,108879] 0 2024-02-20T08:06:15.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/602: write d0/d2/f2e [2411734,68186] 0 2024-02-20T08:06:15.157 INFO:tasks.workunit.client.1.smithi194.stdout:0/609: truncate d6/d2b/d35/f53 2742214 0 2024-02-20T08:06:15.164 INFO:tasks.workunit.client.1.smithi194.stdout:6/769: creat df/dab/d1d/d28/d46/d5a/d6b/d83/fff x:0 0 0 2024-02-20T08:06:15.166 INFO:tasks.workunit.client.1.smithi194.stdout:3/640: truncate d5/d10/d62/fa2 312913 0 2024-02-20T08:06:15.167 INFO:tasks.workunit.client.1.smithi194.stdout:5/693: creat d4/d6/dd/d3a/fd6 x:0 0 0 2024-02-20T08:06:15.168 INFO:tasks.workunit.client.1.smithi194.stdout:8/582: mkdir d2/d14/d18/d45/d69/daf/db3/dce 0 2024-02-20T08:06:15.168 INFO:tasks.workunit.client.1.smithi194.stdout:8/583: readlink d2/d14/d18/d45/d4e/dbe/dc3/lcb 0 2024-02-20T08:06:15.170 INFO:tasks.workunit.client.1.smithi194.stdout:4/603: write d0/d10/d1c/d21/d62/f93 [2605950,74186] 0 2024-02-20T08:06:15.172 INFO:tasks.workunit.client.1.smithi194.stdout:1/643: rename d2/d8/d60/d75/fd3 to d2/d48/fd9 0 2024-02-20T08:06:15.175 INFO:tasks.workunit.client.1.smithi194.stdout:7/681: write d11/d2d/d38/d37/f4f [2420949,55575] 0 2024-02-20T08:06:15.176 INFO:tasks.workunit.client.1.smithi194.stdout:6/770: readlink df/dab/d1d/d28/d2b/d94/lbd 0 2024-02-20T08:06:15.176 INFO:tasks.workunit.client.1.smithi194.stdout:6/771: chown df/dab/d1d/d28/c6a 16640 1 2024-02-20T08:06:15.177 INFO:tasks.workunit.client.1.smithi194.stdout:6/772: chown df/dab/d1d/l3a 13450798 1 2024-02-20T08:06:15.178 INFO:tasks.workunit.client.1.smithi194.stdout:3/641: mknod d5/df/d30/cc3 0 2024-02-20T08:06:15.179 INFO:tasks.workunit.client.1.smithi194.stdout:3/642: readlink d5/d10/d17/d1d/d56/l5f 0 2024-02-20T08:06:15.182 INFO:tasks.workunit.client.1.smithi194.stdout:2/688: mknod df/d14/d24/dd2/cdb 0 2024-02-20T08:06:15.183 INFO:tasks.workunit.client.1.smithi194.stdout:2/689: dread - df/d14/d24/d56/d6b/db7/dc1/fc2 zero size 2024-02-20T08:06:15.184 INFO:tasks.workunit.client.1.smithi194.stdout:2/690: stat df/d14/d19/f2a 0 2024-02-20T08:06:15.184 INFO:tasks.workunit.client.1.smithi194.stdout:4/604: stat d0/d10/d1c/f5a 0 2024-02-20T08:06:15.186 INFO:tasks.workunit.client.1.smithi194.stdout:2/691: write df/d14/d19/d5c/d60/d63/f62 [4562231,47013] 0 2024-02-20T08:06:15.191 INFO:tasks.workunit.client.1.smithi194.stdout:2/692: dwrite df/d14/d24/d56/d6b/d81/f79 [0,4194304] 0 2024-02-20T08:06:15.197 INFO:tasks.workunit.client.1.smithi194.stdout:1/644: rmdir d2/d8 39 2024-02-20T08:06:15.198 INFO:tasks.workunit.client.1.smithi194.stdout:6/773: dread df/d42/d86/fb8 [0,4194304] 0 2024-02-20T08:06:15.200 INFO:tasks.workunit.client.1.smithi194.stdout:7/682: symlink d11/d2d/d38/d95/ld0 0 2024-02-20T08:06:15.201 INFO:tasks.workunit.client.1.smithi194.stdout:7/683: truncate d11/d2d/d38/d4a/d60/fbf 64843 0 2024-02-20T08:06:15.205 INFO:tasks.workunit.client.1.smithi194.stdout:9/703: getdents d4/d20 0 2024-02-20T08:06:15.209 INFO:tasks.workunit.client.1.smithi194.stdout:5/694: mknod d4/d20/d2b/d5c/cd7 0 2024-02-20T08:06:15.209 INFO:tasks.workunit.client.1.smithi194.stdout:5/695: chown d4/d6/fa 212567458 1 2024-02-20T08:06:15.218 INFO:tasks.workunit.client.1.smithi194.stdout:4/605: mkdir d0/d5c/d60/d4a/dad/db0 0 2024-02-20T08:06:15.219 INFO:tasks.workunit.client.1.smithi194.stdout:3/643: write d5/df/d60/fa3 [1329674,23906] 0 2024-02-20T08:06:15.220 INFO:tasks.workunit.client.1.smithi194.stdout:3/644: dread - d5/d10/d28/d41/fc0 zero size 2024-02-20T08:06:15.221 INFO:tasks.workunit.client.1.smithi194.stdout:3/645: write d5/f8 [6913939,36918] 0 2024-02-20T08:06:15.222 INFO:tasks.workunit.client.1.smithi194.stdout:3/646: chown d5/c82 25676646 1 2024-02-20T08:06:15.232 INFO:tasks.workunit.client.1.smithi194.stdout:6/774: symlink df/dab/d1d/d99/l100 0 2024-02-20T08:06:15.237 INFO:tasks.workunit.client.1.smithi194.stdout:9/704: unlink d4/d1b/d90/ca5 0 2024-02-20T08:06:15.242 INFO:tasks.workunit.client.1.smithi194.stdout:4/606: creat d0/d5c/d60/d4a/dad/fb1 x:0 0 0 2024-02-20T08:06:15.245 INFO:tasks.workunit.client.1.smithi194.stdout:7/684: dwrite d11/d2d/d38/d4a/d53/f58 [0,4194304] 0 2024-02-20T08:06:15.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/584: rename d2/d14/d18/d45/d4e/d9f/fab to d2/d14/d18/fcf 0 2024-02-20T08:06:15.255 INFO:tasks.workunit.client.1.smithi194.stdout:1/645: unlink d2/d8/df/f29 0 2024-02-20T08:06:15.258 INFO:tasks.workunit.client.1.smithi194.stdout:6/775: creat df/dbe/f101 x:0 0 0 2024-02-20T08:06:15.258 INFO:tasks.workunit.client.1.smithi194.stdout:6/776: truncate df/f92 504125 0 2024-02-20T08:06:15.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/647: write d5/d10/d28/d41/f5c [2028102,19031] 0 2024-02-20T08:06:15.265 INFO:tasks.workunit.client.1.smithi194.stdout:4/607: creat d0/d10/d1c/d4d/d2f/fb2 x:0 0 0 2024-02-20T08:06:15.269 INFO:tasks.workunit.client.1.smithi194.stdout:7/685: mkdir d11/d2d/d38/d37/d3c/dd1 0 2024-02-20T08:06:15.274 INFO:tasks.workunit.client.1.smithi194.stdout:5/696: dwrite d4/d6/d11/f7e [0,4194304] 0 2024-02-20T08:06:15.274 INFO:tasks.workunit.client.1.smithi194.stdout:8/585: creat d2/d14/d18/d45/d69/daf/db3/fd0 x:0 0 0 2024-02-20T08:06:15.276 INFO:tasks.workunit.client.1.smithi194.stdout:8/586: dread - d2/d14/d18/d45/d90/fb2 zero size 2024-02-20T08:06:15.280 INFO:tasks.workunit.client.1.smithi194.stdout:1/646: dread d2/d8/f3c [0,4194304] 0 2024-02-20T08:06:15.282 INFO:tasks.workunit.client.1.smithi194.stdout:8/587: dwrite d2/d14/d18/d45/d4e/dbe/dc3/fc8 [0,4194304] 0 2024-02-20T08:06:15.285 INFO:tasks.workunit.client.1.smithi194.stdout:9/705: mkdir d4/deb 0 2024-02-20T08:06:15.287 INFO:tasks.workunit.client.1.smithi194.stdout:9/706: stat d4/d1b/d90/c98 0 2024-02-20T08:06:15.290 INFO:tasks.workunit.client.1.smithi194.stdout:7/686: write d11/d2d/d38/d4a/d27/f7f [4574910,109821] 0 2024-02-20T08:06:15.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/693: getdents df/d14/d24/d56/d6b/db7 0 2024-02-20T08:06:15.297 INFO:tasks.workunit.client.1.smithi194.stdout:7/687: dwrite d11/d2d/d38/d37/d43/d8e/d5e/f9f [0,4194304] 0 2024-02-20T08:06:15.299 INFO:tasks.workunit.client.1.smithi194.stdout:3/648: creat d5/d10/d17/dc2/fc4 x:0 0 0 2024-02-20T08:06:15.302 INFO:tasks.workunit.client.1.smithi194.stdout:8/588: mkdir d2/d80/dd1 0 2024-02-20T08:06:15.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/707: fdatasync d4/d37/dab/fd3 0 2024-02-20T08:06:15.311 INFO:tasks.workunit.client.1.smithi194.stdout:0/610: rename d6/d2b/d35/d9c/d62/dc1/la9 to d6/d2b/d35/lc9 0 2024-02-20T08:06:15.312 INFO:tasks.workunit.client.1.smithi194.stdout:2/694: rmdir df/d5b 39 2024-02-20T08:06:15.313 INFO:tasks.workunit.client.1.smithi194.stdout:2/695: readlink df/d14/d80/d85/ld1 0 2024-02-20T08:06:15.319 INFO:tasks.workunit.client.1.smithi194.stdout:6/777: creat df/dab/f102 x:0 0 0 2024-02-20T08:06:15.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/688: rmdir d11/d2d/d38/d37/d3c 39 2024-02-20T08:06:15.323 INFO:tasks.workunit.client.1.smithi194.stdout:3/649: creat d5/d10/fc5 x:0 0 0 2024-02-20T08:06:15.323 INFO:tasks.workunit.client.1.smithi194.stdout:8/589: fdatasync d2/d14/d18/d45/d4e/fa8 0 2024-02-20T08:06:15.325 INFO:tasks.workunit.client.1.smithi194.stdout:8/590: write d2/d14/d18/d45/d7b/dc7/f7d [358541,118829] 0 2024-02-20T08:06:15.327 INFO:tasks.workunit.client.1.smithi194.stdout:5/697: rename d4/c2e to d4/d20/d2b/d5c/cd8 0 2024-02-20T08:06:15.330 INFO:tasks.workunit.client.1.smithi194.stdout:7/689: write d11/d2d/d38/d37/f59 [3217101,66770] 0 2024-02-20T08:06:15.332 INFO:tasks.workunit.client.1.smithi194.stdout:8/591: fdatasync d2/d80/fa6 0 2024-02-20T08:06:15.334 INFO:tasks.workunit.client.1.smithi194.stdout:1/647: rename d2/d8/d12/dc9/d61/f67 to d2/d8/d12/dc9/d26/d3d/fda 0 2024-02-20T08:06:15.335 INFO:tasks.workunit.client.1.smithi194.stdout:4/608: truncate d0/f19 1959207 0 2024-02-20T08:06:15.336 INFO:tasks.workunit.client.1.smithi194.stdout:4/609: fdatasync d0/d5c/d60/d4a/d4e/fa9 0 2024-02-20T08:06:15.336 INFO:tasks.workunit.client.1.smithi194.stdout:5/698: mknod d4/d6/dd/d25/d7d/dcd/cd9 0 2024-02-20T08:06:15.337 INFO:tasks.workunit.client.1.smithi194.stdout:4/610: chown d0/d10/d1c/d21/d46/f86 186930 1 2024-02-20T08:06:15.337 INFO:tasks.workunit.client.1.smithi194.stdout:5/699: read d4/fb [4317540,80089] 0 2024-02-20T08:06:15.338 INFO:tasks.workunit.client.1.smithi194.stdout:5/700: chown d4/d20/d2b/d79/lae 219 1 2024-02-20T08:06:15.339 INFO:tasks.workunit.client.1.smithi194.stdout:7/690: write d11/d2d/d38/d4a/d60/fbf [1105413,111919] 0 2024-02-20T08:06:15.341 INFO:tasks.workunit.client.1.smithi194.stdout:8/592: readlink d2/d14/d18/d45/d7b/la9 0 2024-02-20T08:06:15.348 INFO:tasks.workunit.client.1.smithi194.stdout:0/611: write d6/f29 [3476892,46434] 0 2024-02-20T08:06:15.349 INFO:tasks.workunit.client.1.smithi194.stdout:5/701: dread d4/d20/d2b/d79/f60 [0,4194304] 0 2024-02-20T08:06:15.350 INFO:tasks.workunit.client.1.smithi194.stdout:5/702: write d4/d6/d11/d2f/d77/f7a [13267,60714] 0 2024-02-20T08:06:15.351 INFO:tasks.workunit.client.1.smithi194.stdout:1/648: unlink d2/d8/d12/dc9/d61/d7e/f86 0 2024-02-20T08:06:15.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/649: readlink d2/d8/df/ld8 0 2024-02-20T08:06:15.354 INFO:tasks.workunit.client.1.smithi194.stdout:1/650: read d2/d8/d12/dc9/fc0 [744199,103886] 0 2024-02-20T08:06:15.355 INFO:tasks.workunit.client.1.smithi194.stdout:1/651: chown d2/d8/d12/dc9/d61/d7d/dbf/lc4 57774010 1 2024-02-20T08:06:15.356 INFO:tasks.workunit.client.1.smithi194.stdout:1/652: readlink d2/d8/d12/dc9/d61/d9f/ld0 0 2024-02-20T08:06:15.357 INFO:tasks.workunit.client.1.smithi194.stdout:7/691: creat d11/d2d/d38/d37/d43/d7b/fd2 x:0 0 0 2024-02-20T08:06:15.365 INFO:tasks.workunit.client.1.smithi194.stdout:5/703: creat d4/d6/da5/fda x:0 0 0 2024-02-20T08:06:15.365 INFO:tasks.workunit.client.1.smithi194.stdout:5/704: write d4/d6/d11/d2f/fbf [419787,53142] 0 2024-02-20T08:06:15.367 INFO:tasks.workunit.client.1.smithi194.stdout:1/653: mknod d2/d8/d12/dc9/d26/d3d/d82/cdb 0 2024-02-20T08:06:15.375 INFO:tasks.workunit.client.1.smithi194.stdout:0/612: mknod d6/d2b/d35/d42/cca 0 2024-02-20T08:06:15.376 INFO:tasks.workunit.client.1.smithi194.stdout:5/705: unlink d4/d20/l47 0 2024-02-20T08:06:15.378 INFO:tasks.workunit.client.1.smithi194.stdout:4/611: truncate d0/d2/f2e 2389950 0 2024-02-20T08:06:15.378 INFO:tasks.workunit.client.1.smithi194.stdout:5/706: dread - d4/d6/dd/d25/d7d/fbe zero size 2024-02-20T08:06:15.381 INFO:tasks.workunit.client.1.smithi194.stdout:8/593: truncate d2/d14/d18/f83 2064066 0 2024-02-20T08:06:15.381 INFO:tasks.workunit.client.1.smithi194.stdout:0/613: dwrite d6/d2b/d35/d39/d8f/f95 [8388608,4194304] 0 2024-02-20T08:06:15.384 INFO:tasks.workunit.client.1.smithi194.stdout:1/654: symlink d2/ldc 0 2024-02-20T08:06:15.386 INFO:tasks.workunit.client.1.smithi194.stdout:4/612: unlink d0/d10/d1c/d21/d46/c85 0 2024-02-20T08:06:15.387 INFO:tasks.workunit.client.1.smithi194.stdout:1/655: chown d2/d8/d12/dc9/d26/d3d/d71 1365876892 1 2024-02-20T08:06:15.387 INFO:tasks.workunit.client.1.smithi194.stdout:5/707: dwrite d4/d20/d2b/d79/f81 [8388608,4194304] 0 2024-02-20T08:06:15.392 INFO:tasks.workunit.client.1.smithi194.stdout:0/614: dread d6/d2b/d35/d42/d1e/d45/f51 [0,4194304] 0 2024-02-20T08:06:15.392 INFO:tasks.workunit.client.1.smithi194.stdout:3/650: link d5/df/d30/l8e d5/d10/d16/d7b/lc6 0 2024-02-20T08:06:15.393 INFO:tasks.workunit.client.1.smithi194.stdout:1/656: chown d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/c51 25778217 1 2024-02-20T08:06:15.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:15 smithi194 ceph-mon[37804]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:15.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:15 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:15.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:15 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:15.395 INFO:tasks.workunit.client.1.smithi194.stdout:7/692: getdents d11/d2d/d38 0 2024-02-20T08:06:15.398 INFO:tasks.workunit.client.1.smithi194.stdout:4/613: dwrite d0/d2/d3e/f3f [0,4194304] 0 2024-02-20T08:06:15.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/651: dwrite d5/d10/d17/f38 [0,4194304] 0 2024-02-20T08:06:15.420 INFO:tasks.workunit.client.1.smithi194.stdout:4/614: symlink d0/d10/d1c/d21/d46/lb3 0 2024-02-20T08:06:15.421 INFO:tasks.workunit.client.1.smithi194.stdout:4/615: fdatasync d0/f7f 0 2024-02-20T08:06:15.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/708: truncate d4/d6/d11/d2f/f71 3135498 0 2024-02-20T08:06:15.429 INFO:tasks.workunit.client.1.smithi194.stdout:3/652: read d5/d10/d28/f45 [545192,129239] 0 2024-02-20T08:06:15.430 INFO:tasks.workunit.client.1.smithi194.stdout:3/653: write d5/d10/d17/d1d/f6b [1604041,107744] 0 2024-02-20T08:06:15.433 INFO:tasks.workunit.client.1.smithi194.stdout:8/594: rename d2/d14/d18/d45/d4e/c7a to d2/d14/d18/cd2 0 2024-02-20T08:06:15.440 INFO:tasks.workunit.client.1.smithi194.stdout:7/693: symlink d11/d2d/d38/d37/d3c/d8d/dc9/ld3 0 2024-02-20T08:06:15.441 INFO:tasks.workunit.client.1.smithi194.stdout:7/694: write d11/d2d/d38/d95/fbe [349444,69186] 0 2024-02-20T08:06:15.443 INFO:tasks.workunit.client.1.smithi194.stdout:7/695: truncate d11/d2d/d38/d37/d43/d7b/d91/d9c/fcd 614568 0 2024-02-20T08:06:15.444 INFO:tasks.workunit.client.1.smithi194.stdout:4/616: link d0/df/d11/f2b d0/df/d11/fb4 0 2024-02-20T08:06:15.444 INFO:tasks.workunit.client.1.smithi194.stdout:7/696: write d11/d2d/d38/d4a/f21 [4781527,42487] 0 2024-02-20T08:06:15.445 INFO:tasks.workunit.client.1.smithi194.stdout:4/617: read d0/f34 [1066436,37520] 0 2024-02-20T08:06:15.448 INFO:tasks.workunit.client.1.smithi194.stdout:9/708: sync 2024-02-20T08:06:15.451 INFO:tasks.workunit.client.1.smithi194.stdout:7/697: dread d11/d2d/d38/d4a/d53/f58 [0,4194304] 0 2024-02-20T08:06:15.452 INFO:tasks.workunit.client.1.smithi194.stdout:0/615: rename d6/f18 to d6/d2b/d35/d39/d8f/fcb 0 2024-02-20T08:06:15.453 INFO:tasks.workunit.client.1.smithi194.stdout:1/657: getdents d2/d8/d60/d75/db5 0 2024-02-20T08:06:15.454 INFO:tasks.workunit.client.1.smithi194.stdout:4/618: dwrite d0/df/d41/f81 [0,4194304] 0 2024-02-20T08:06:15.455 INFO:tasks.workunit.client.1.smithi194.stdout:1/658: chown d2/d8/d12/dc9/d26/d3d/d71/f66 45911 1 2024-02-20T08:06:15.462 INFO:tasks.workunit.client.1.smithi194.stdout:3/654: link d5/d10/d28/fb0 d5/d10/d28/d41/fc7 0 2024-02-20T08:06:15.462 INFO:tasks.workunit.client.1.smithi194.stdout:4/619: dwrite d0/d4f/f6d [0,4194304] 0 2024-02-20T08:06:15.468 INFO:tasks.workunit.client.1.smithi194.stdout:7/698: creat d11/d2d/d38/d4a/d53/d81/fd4 x:0 0 0 2024-02-20T08:06:15.469 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:15 smithi123 ceph-mon[29383]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:15.469 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:15 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:15.469 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:15 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:15.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/616: mknod d6/d2b/d35/d9c/d62/dc1/ccc 0 2024-02-20T08:06:15.469 INFO:tasks.workunit.client.1.smithi194.stdout:7/699: dread - d11/d2d/d38/f7a zero size 2024-02-20T08:06:15.470 INFO:tasks.workunit.client.1.smithi194.stdout:4/620: dwrite d0/d5c/d60/d4a/dad/fb1 [0,4194304] 0 2024-02-20T08:06:15.471 INFO:tasks.workunit.client.1.smithi194.stdout:7/700: dread - d11/d2d/d38/d37/d3c/d8d/fb6 zero size 2024-02-20T08:06:15.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/617: write d6/d2b/d35/d42/d1e/d3c/f8a [906982,99442] 0 2024-02-20T08:06:15.474 INFO:tasks.workunit.client.1.smithi194.stdout:1/659: truncate d2/d8/d12/dc9/d61/f9c 1435769 0 2024-02-20T08:06:15.476 INFO:tasks.workunit.client.1.smithi194.stdout:3/655: rename d5/c82 to d5/d10/d17/d1d/d93/cc8 0 2024-02-20T08:06:15.486 INFO:tasks.workunit.client.1.smithi194.stdout:1/660: readlink d2/d8/d12/dc9/d61/d9f/lb1 0 2024-02-20T08:06:15.491 INFO:tasks.workunit.client.1.smithi194.stdout:5/709: rmdir d4/d6/dd/d3a/d86/dc3 0 2024-02-20T08:06:15.492 INFO:tasks.workunit.client.1.smithi194.stdout:9/709: dread d4/d20/f87 [0,4194304] 0 2024-02-20T08:06:15.493 INFO:tasks.workunit.client.1.smithi194.stdout:4/621: dread d0/df/f84 [0,4194304] 0 2024-02-20T08:06:15.493 INFO:tasks.workunit.client.1.smithi194.stdout:7/701: dwrite d11/d2d/d38/d4a/d53/da0/fa5 [4194304,4194304] 0 2024-02-20T08:06:15.493 INFO:tasks.workunit.client.1.smithi194.stdout:9/710: chown d4/d37/de2/le5 75 1 2024-02-20T08:06:15.495 INFO:tasks.workunit.client.1.smithi194.stdout:7/702: chown d11/d2d/d38/d4a/d53/fb3 228 1 2024-02-20T08:06:15.498 INFO:tasks.workunit.client.1.smithi194.stdout:3/656: fsync d5/d10/f4d 0 2024-02-20T08:06:15.500 INFO:tasks.workunit.client.1.smithi194.stdout:3/657: chown d5/d10/d28/d41/d73/fbb 7119 1 2024-02-20T08:06:15.512 INFO:tasks.workunit.client.1.smithi194.stdout:1/661: truncate d2/d8/d12/dc9/d26/d3d/d71/d8c/f56 616380 0 2024-02-20T08:06:15.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/711: fsync d4/de/dc4/fcc 0 2024-02-20T08:06:15.525 INFO:tasks.workunit.client.1.smithi194.stdout:3/658: rename d5/c4f to d5/d10/d28/d41/d73/cc9 0 2024-02-20T08:06:15.525 INFO:tasks.workunit.client.1.smithi194.stdout:3/659: chown d5/df/d30 6 1 2024-02-20T08:06:15.527 INFO:tasks.workunit.client.1.smithi194.stdout:6/778: sync 2024-02-20T08:06:15.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/696: sync 2024-02-20T08:06:15.535 INFO:tasks.workunit.client.1.smithi194.stdout:6/779: write df/dab/d1d/ff0 [579684,10734] 0 2024-02-20T08:06:15.536 INFO:tasks.workunit.client.1.smithi194.stdout:6/780: readlink df/ded/ld8 0 2024-02-20T08:06:15.537 INFO:tasks.workunit.client.1.smithi194.stdout:4/622: dread d0/d2/f35 [4194304,4194304] 0 2024-02-20T08:06:15.562 INFO:tasks.workunit.client.1.smithi194.stdout:0/618: truncate d6/d2b/d35/f7a 6679828 0 2024-02-20T08:06:15.563 INFO:tasks.workunit.client.1.smithi194.stdout:0/619: stat d6/f3d 0 2024-02-20T08:06:15.563 INFO:tasks.workunit.client.1.smithi194.stdout:9/712: symlink d4/d20/d43/d51/d6a/dd2/lec 0 2024-02-20T08:06:15.563 INFO:tasks.workunit.client.1.smithi194.stdout:0/620: readlink d6/d2b/d35/d9c/lbb 0 2024-02-20T08:06:15.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/662: creat d2/d8/fdd x:0 0 0 2024-02-20T08:06:15.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/663: chown d2/d8/d12/dc9 2114143 1 2024-02-20T08:06:15.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/710: getdents d4/d6/dd/d25/d78/d8b/d8a/db6/dbc 0 2024-02-20T08:06:15.567 INFO:tasks.workunit.client.1.smithi194.stdout:5/711: write d4/d6/da5/fda [679340,101379] 0 2024-02-20T08:06:15.567 INFO:tasks.workunit.client.1.smithi194.stdout:6/781: mkdir df/dab/d1d/d28/d2b/d103 0 2024-02-20T08:06:15.568 INFO:tasks.workunit.client.1.smithi194.stdout:8/595: sync 2024-02-20T08:06:15.569 INFO:tasks.workunit.client.1.smithi194.stdout:8/596: stat d2/d80 0 2024-02-20T08:06:15.569 INFO:tasks.workunit.client.1.smithi194.stdout:5/712: stat d4/d6/dd/d25/d78/d8b/d8a/db6/dbc/ccf 0 2024-02-20T08:06:15.572 INFO:tasks.workunit.client.1.smithi194.stdout:2/697: truncate df/d14/f47 2836093 0 2024-02-20T08:06:15.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/660: creat d5/d10/fca x:0 0 0 2024-02-20T08:06:15.574 INFO:tasks.workunit.client.1.smithi194.stdout:6/782: write df/dab/d1d/d28/d5e/f69 [2583782,30741] 0 2024-02-20T08:06:15.580 INFO:tasks.workunit.client.1.smithi194.stdout:0/621: link d6/d2b/d35/d42/d1e/d3c/f71 d6/d2b/d35/d39/d8f/fcd 0 2024-02-20T08:06:15.582 INFO:tasks.workunit.client.1.smithi194.stdout:1/664: mkdir d2/d8/d12/dc9/dde 0 2024-02-20T08:06:15.585 INFO:tasks.workunit.client.1.smithi194.stdout:3/661: dread d5/d10/d28/f6c [0,4194304] 0 2024-02-20T08:06:15.587 INFO:tasks.workunit.client.1.smithi194.stdout:7/703: dwrite d11/f12 [0,4194304] 0 2024-02-20T08:06:15.599 INFO:tasks.workunit.client.1.smithi194.stdout:2/698: rename df/d14/d19/d5c/d78/l9d to df/d14/d24/ldc 0 2024-02-20T08:06:15.599 INFO:tasks.workunit.client.1.smithi194.stdout:8/597: dread d2/d14/d18/d45/d4e/f5e [0,4194304] 0 2024-02-20T08:06:15.602 INFO:tasks.workunit.client.1.smithi194.stdout:8/598: write d2/d14/d18/d45/f95 [1458879,73956] 0 2024-02-20T08:06:15.605 INFO:tasks.workunit.client.1.smithi194.stdout:5/713: rename d4/d20/d2b/d5c to d4/d20/d2b/d9b/ddb 0 2024-02-20T08:06:15.607 INFO:tasks.workunit.client.1.smithi194.stdout:7/704: truncate d11/d2d/d38/d37/f4b 970924 0 2024-02-20T08:06:15.608 INFO:tasks.workunit.client.1.smithi194.stdout:1/665: dread d2/d8/d12/dc9/d61/f9c [0,4194304] 0 2024-02-20T08:06:15.609 INFO:tasks.workunit.client.1.smithi194.stdout:3/662: dwrite d5/d10/d17/fa8 [0,4194304] 0 2024-02-20T08:06:15.611 INFO:tasks.workunit.client.1.smithi194.stdout:5/714: creat d4/d20/fdc x:0 0 0 2024-02-20T08:06:15.612 INFO:tasks.workunit.client.1.smithi194.stdout:8/599: creat d2/d14/d18/d45/d69/d9b/fd3 x:0 0 0 2024-02-20T08:06:15.614 INFO:tasks.workunit.client.1.smithi194.stdout:6/783: dread df/d42/f65 [0,4194304] 0 2024-02-20T08:06:15.616 INFO:tasks.workunit.client.1.smithi194.stdout:7/705: dwrite d11/d2d/f8a [0,4194304] 0 2024-02-20T08:06:15.617 INFO:tasks.workunit.client.1.smithi194.stdout:6/784: dread - df/dab/d1d/fd2 zero size 2024-02-20T08:06:15.621 INFO:tasks.workunit.client.1.smithi194.stdout:4/623: write d0/df/d11/f2b [3598685,70200] 0 2024-02-20T08:06:15.621 INFO:tasks.workunit.client.1.smithi194.stdout:1/666: mkdir d2/d8/d12/dc9/d26/d3d/ddf 0 2024-02-20T08:06:15.623 INFO:tasks.workunit.client.1.smithi194.stdout:9/713: write d4/d20/d41/f7c [41261,108810] 0 2024-02-20T08:06:15.625 INFO:tasks.workunit.client.1.smithi194.stdout:6/785: write df/dab/d1d/d28/d46/d5a/d6b/dcb/ff3 [441900,23224] 0 2024-02-20T08:06:15.630 INFO:tasks.workunit.client.1.smithi194.stdout:4/624: fdatasync d0/d10/d1c/d21/f96 0 2024-02-20T08:06:15.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/699: dread df/f4f [0,4194304] 0 2024-02-20T08:06:15.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/715: dread d4/d6/dd/d25/d78/d8b/d8a/dc4/f26 [0,4194304] 0 2024-02-20T08:06:15.633 INFO:tasks.workunit.client.1.smithi194.stdout:1/667: dread d2/d8/d12/dc9/d61/d7e/fa4 [0,4194304] 0 2024-02-20T08:06:15.637 INFO:tasks.workunit.client.1.smithi194.stdout:9/714: rename d4/d20/f80 to d4/d20/d41/fed 0 2024-02-20T08:06:15.644 INFO:tasks.workunit.client.1.smithi194.stdout:4/625: symlink d0/d5c/d60/d4a/lb5 0 2024-02-20T08:06:15.650 INFO:tasks.workunit.client.1.smithi194.stdout:5/716: mknod d4/d6/dd/d25/d78/d8b/d8a/dc4/cdd 0 2024-02-20T08:06:15.653 INFO:tasks.workunit.client.1.smithi194.stdout:1/668: fdatasync d2/d8/d12/dc9/d26/d3d/d71/f7a 0 2024-02-20T08:06:15.653 INFO:tasks.workunit.client.1.smithi194.stdout:3/663: truncate d5/d10/f13 3787352 0 2024-02-20T08:06:15.654 INFO:tasks.workunit.client.1.smithi194.stdout:8/600: link d2/d14/d18/d45/c9c d2/d14/d18/d45/d69/daf/cd4 0 2024-02-20T08:06:15.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/706: dread d11/d2d/d38/d37/d43/d8e/f5c [4194304,4194304] 0 2024-02-20T08:06:15.658 INFO:tasks.workunit.client.1.smithi194.stdout:6/786: mkdir df/dab/d1d/d28/d2b/d103/d104 0 2024-02-20T08:06:15.658 INFO:tasks.workunit.client.1.smithi194.stdout:6/787: readlink df/dab/d1d/d28/d2b/l60 0 2024-02-20T08:06:15.659 INFO:tasks.workunit.client.1.smithi194.stdout:2/700: rename df/d14/d24/d56/d6b/db7 to df/d14/d19/d5c/d97/d9a/ddd 0 2024-02-20T08:06:15.665 INFO:tasks.workunit.client.1.smithi194.stdout:1/669: mkdir d2/d8/d60/de0 0 2024-02-20T08:06:15.666 INFO:tasks.workunit.client.1.smithi194.stdout:7/707: write f5 [4435057,95470] 0 2024-02-20T08:06:15.667 INFO:tasks.workunit.client.1.smithi194.stdout:4/626: mknod d0/d2/d3e/cb6 0 2024-02-20T08:06:15.674 INFO:tasks.workunit.client.1.smithi194.stdout:5/717: creat d4/d6/dd/d25/d78/d8b/d8a/db6/fde x:0 0 0 2024-02-20T08:06:15.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/708: creat d11/d2d/d38/d4a/d27/d51/d77/fd5 x:0 0 0 2024-02-20T08:06:15.676 INFO:tasks.workunit.client.1.smithi194.stdout:4/627: dread d0/d10/d1c/d21/f57 [0,4194304] 0 2024-02-20T08:06:15.676 INFO:tasks.workunit.client.1.smithi194.stdout:7/709: fdatasync d11/f35 0 2024-02-20T08:06:15.676 INFO:tasks.workunit.client.1.smithi194.stdout:1/670: unlink d2/d8/d12/dc9/d26/d3d/d71/d8c/f56 0 2024-02-20T08:06:15.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/628: read - d0/d10/d1c/d21/d46/f8c zero size 2024-02-20T08:06:15.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/664: write d5/df/d25/f27 [3636453,112521] 0 2024-02-20T08:06:15.681 INFO:tasks.workunit.client.1.smithi194.stdout:5/718: dwrite d4/d6/d11/f8d [0,4194304] 0 2024-02-20T08:06:15.681 INFO:tasks.workunit.client.1.smithi194.stdout:8/601: rename d2/d14/c50 to d2/d14/d18/cd5 0 2024-02-20T08:06:15.685 INFO:tasks.workunit.client.1.smithi194.stdout:8/602: write d2/d14/d18/d45/d4e/dbe/dc3/fc8 [3396202,72206] 0 2024-02-20T08:06:15.685 INFO:tasks.workunit.client.1.smithi194.stdout:1/671: write d2/d8/d12/dc9/f1d [2540504,49599] 0 2024-02-20T08:06:15.685 INFO:tasks.workunit.client.1.smithi194.stdout:2/701: getdents df/d14/d24/d56/d6b 0 2024-02-20T08:06:15.686 INFO:tasks.workunit.client.1.smithi194.stdout:8/603: chown d2/f31 105520858 1 2024-02-20T08:06:15.690 INFO:tasks.workunit.client.1.smithi194.stdout:3/665: unlink d5/f6 0 2024-02-20T08:06:15.691 INFO:tasks.workunit.client.1.smithi194.stdout:3/666: fsync d5/d10/fc5 0 2024-02-20T08:06:15.694 INFO:tasks.workunit.client.1.smithi194.stdout:2/702: rmdir df/d14/d19/d5c/d60/d63 39 2024-02-20T08:06:15.695 INFO:tasks.workunit.client.1.smithi194.stdout:2/703: chown df/d14/l31 1567994 1 2024-02-20T08:06:15.695 INFO:tasks.workunit.client.1.smithi194.stdout:2/704: fdatasync df/d14/f66 0 2024-02-20T08:06:15.702 INFO:tasks.workunit.client.1.smithi194.stdout:3/667: write d5/d10/d16/f3a [3465589,1190] 0 2024-02-20T08:06:15.703 INFO:tasks.workunit.client.1.smithi194.stdout:6/788: rename df/d18/f55 to df/dab/d1d/d28/d46/d5a/d6b/dcb/f105 0 2024-02-20T08:06:15.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/668: chown d5/d10/d17/dc2 8707 1 2024-02-20T08:06:15.707 INFO:tasks.workunit.client.1.smithi194.stdout:8/604: mkdir d2/d14/d18/d45/d90/d92/dd6 0 2024-02-20T08:06:15.708 INFO:tasks.workunit.client.1.smithi194.stdout:1/672: dwrite d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f6b [0,4194304] 0 2024-02-20T08:06:15.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/710: getdents d11/d2d/d38/d4a/d53 0 2024-02-20T08:06:15.720 INFO:tasks.workunit.client.1.smithi194.stdout:8/605: fsync d2/f39 0 2024-02-20T08:06:15.723 INFO:tasks.workunit.client.1.smithi194.stdout:6/789: write df/dab/d1d/d28/d2b/d94/d96/fc0 [1276644,98587] 0 2024-02-20T08:06:15.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/669: dread d5/df/d25/f27 [0,4194304] 0 2024-02-20T08:06:15.724 INFO:tasks.workunit.client.1.smithi194.stdout:2/705: dwrite df/d14/d19/d5c/f94 [0,4194304] 0 2024-02-20T08:06:15.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/673: dwrite d2/d8/d60/d75/db5/fc3 [0,4194304] 0 2024-02-20T08:06:15.726 INFO:tasks.workunit.client.1.smithi194.stdout:9/715: sync 2024-02-20T08:06:15.726 INFO:tasks.workunit.client.1.smithi194.stdout:0/622: sync 2024-02-20T08:06:15.734 INFO:tasks.workunit.client.1.smithi194.stdout:3/670: chown d5/d10/d28/fb0 836330 1 2024-02-20T08:06:15.734 INFO:tasks.workunit.client.1.smithi194.stdout:4/629: rename d0/d2/d51/fa2 to d0/d10/d1c/fb7 0 2024-02-20T08:06:15.734 INFO:tasks.workunit.client.1.smithi194.stdout:8/606: creat d2/d14/d18/d45/d69/daf/fd7 x:0 0 0 2024-02-20T08:06:15.736 INFO:tasks.workunit.client.1.smithi194.stdout:0/623: unlink d6/d2b/d35/d42/d1e/d3c/f71 0 2024-02-20T08:06:15.737 INFO:tasks.workunit.client.1.smithi194.stdout:0/624: readlink d6/d2b/d35/d48/l61 0 2024-02-20T08:06:15.738 INFO:tasks.workunit.client.1.smithi194.stdout:3/671: truncate d5/d10/d8d/f92 1052576 0 2024-02-20T08:06:15.740 INFO:tasks.workunit.client.1.smithi194.stdout:9/716: readlink d4/d20/d43/d51/d6a/l95 0 2024-02-20T08:06:15.740 INFO:tasks.workunit.client.1.smithi194.stdout:8/607: creat d2/d80/fd8 x:0 0 0 2024-02-20T08:06:15.741 INFO:tasks.workunit.client.1.smithi194.stdout:2/706: creat df/d14/d80/d85/db8/fde x:0 0 0 2024-02-20T08:06:15.742 INFO:tasks.workunit.client.1.smithi194.stdout:2/707: fdatasync df/d3a/fd0 0 2024-02-20T08:06:15.742 INFO:tasks.workunit.client.1.smithi194.stdout:0/625: creat d6/d2b/d35/d39/fce x:0 0 0 2024-02-20T08:06:15.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/672: write d5/d10/d16/d7b/f7f [3037025,1999] 0 2024-02-20T08:06:15.747 INFO:tasks.workunit.client.1.smithi194.stdout:5/719: rename d4/d6/dd/d25/d78/d8b/d8a to d4/d20/d2b/ddf 0 2024-02-20T08:06:15.749 INFO:tasks.workunit.client.1.smithi194.stdout:8/608: mkdir d2/dd9 0 2024-02-20T08:06:15.749 INFO:tasks.workunit.client.1.smithi194.stdout:2/708: chown df/d14/d19/d5c/d60/d63/d92/fcb 581667832 1 2024-02-20T08:06:15.750 INFO:tasks.workunit.client.1.smithi194.stdout:8/609: stat d2/d14/d18/d45/d4e/dbe 0 2024-02-20T08:06:15.751 INFO:tasks.workunit.client.1.smithi194.stdout:3/673: mkdir d5/df/d25/dcb 0 2024-02-20T08:06:15.751 INFO:tasks.workunit.client.1.smithi194.stdout:8/610: stat d2/d14/d18/d45/l62 0 2024-02-20T08:06:15.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/717: mknod d4/d1b/d2e/de0/cee 0 2024-02-20T08:06:15.754 INFO:tasks.workunit.client.1.smithi194.stdout:7/711: rename d11/d2d/d38/d4a/d27/d51/d77/fd5 to d11/d2d/d38/d4a/d93/d9a/fd6 0 2024-02-20T08:06:15.757 INFO:tasks.workunit.client.1.smithi194.stdout:0/626: fdatasync d6/d2b/d35/d39/d8f/fcd 0 2024-02-20T08:06:15.758 INFO:tasks.workunit.client.1.smithi194.stdout:6/790: dread df/d18/f40 [0,4194304] 0 2024-02-20T08:06:15.761 INFO:tasks.workunit.client.1.smithi194.stdout:4/630: rename d0/d5c/d60/f39 to d0/d10/d1c/d21/fb8 0 2024-02-20T08:06:15.762 INFO:tasks.workunit.client.1.smithi194.stdout:4/631: chown d0/d2/fe 0 1 2024-02-20T08:06:15.762 INFO:tasks.workunit.client.1.smithi194.stdout:5/720: creat d4/d6/dd/fe0 x:0 0 0 2024-02-20T08:06:15.764 INFO:tasks.workunit.client.1.smithi194.stdout:8/611: fsync d2/d14/d18/d45/d69/daf/fd7 0 2024-02-20T08:06:15.765 INFO:tasks.workunit.client.1.smithi194.stdout:7/712: rename d11/d2d/d38/d4a/l17 to d11/d2d/d38/d95/ld7 0 2024-02-20T08:06:15.767 INFO:tasks.workunit.client.1.smithi194.stdout:3/674: link d5/d10/d16/d7b/d94/ca4 d5/d10/d28/d41/d73/d8c/ccc 0 2024-02-20T08:06:15.769 INFO:tasks.workunit.client.1.smithi194.stdout:5/721: rmdir d4/d6/dd/d25/d78 39 2024-02-20T08:06:15.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/791: symlink df/dab/d1d/d28/d2b/d103/d104/l106 0 2024-02-20T08:06:15.770 INFO:tasks.workunit.client.1.smithi194.stdout:1/674: write d2/d8/d12/f99 [955058,78009] 0 2024-02-20T08:06:15.772 INFO:tasks.workunit.client.1.smithi194.stdout:4/632: dwrite d0/d10/d1c/d4d/f90 [0,4194304] 0 2024-02-20T08:06:15.772 INFO:tasks.workunit.client.1.smithi194.stdout:7/713: mknod d11/d2d/d38/d37/d43/d8e/d5e/cd8 0 2024-02-20T08:06:15.775 INFO:tasks.workunit.client.1.smithi194.stdout:3/675: symlink d5/d10/d16/lcd 0 2024-02-20T08:06:15.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/676: chown d5/df/d30 1267 1 2024-02-20T08:06:15.777 INFO:tasks.workunit.client.1.smithi194.stdout:1/675: mkdir d2/d8/d12/dc9/d26/d3d/de1 0 2024-02-20T08:06:15.786 INFO:tasks.workunit.client.1.smithi194.stdout:8/612: link d2/d14/d18/d45/d69/fb7 d2/d80/fda 0 2024-02-20T08:06:15.786 INFO:tasks.workunit.client.1.smithi194.stdout:7/714: rename d11/d2d/d38/d4a/f62 to d11/d2d/d38/d37/d3c/d8d/dc9/fd9 0 2024-02-20T08:06:15.787 INFO:tasks.workunit.client.1.smithi194.stdout:2/709: write df/d14/f8f [733675,76399] 0 2024-02-20T08:06:15.787 INFO:tasks.workunit.client.1.smithi194.stdout:4/633: dread d0/d4f/f6d [0,4194304] 0 2024-02-20T08:06:15.791 INFO:tasks.workunit.client.1.smithi194.stdout:5/722: dread d4/f73 [0,4194304] 0 2024-02-20T08:06:15.791 INFO:tasks.workunit.client.1.smithi194.stdout:4/634: chown d0/df/c50 3 1 2024-02-20T08:06:15.792 INFO:tasks.workunit.client.1.smithi194.stdout:7/715: chown d11/d6e/c72 1066 1 2024-02-20T08:06:15.792 INFO:tasks.workunit.client.1.smithi194.stdout:4/635: readlink d0/df/d41/la3 0 2024-02-20T08:06:15.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/676: creat d2/d8/d12/dc9/d26/d3d/fe2 x:0 0 0 2024-02-20T08:06:15.793 INFO:tasks.workunit.client.1.smithi194.stdout:0/627: write d6/d2b/d35/d42/f28 [1104950,8100] 0 2024-02-20T08:06:15.794 INFO:tasks.workunit.client.1.smithi194.stdout:4/636: dread - d0/df/d41/d69/f9b zero size 2024-02-20T08:06:15.795 INFO:tasks.workunit.client.1.smithi194.stdout:8/613: creat d2/d14/d18/d45/d7b/dc0/fdb x:0 0 0 2024-02-20T08:06:15.796 INFO:tasks.workunit.client.1.smithi194.stdout:3/677: mknod d5/d10/d17/d1d/d56/cce 0 2024-02-20T08:06:15.797 INFO:tasks.workunit.client.1.smithi194.stdout:9/718: dwrite d4/d37/ddf/d42/d4e/d6e/d88/f8e [0,4194304] 0 2024-02-20T08:06:15.798 INFO:tasks.workunit.client.1.smithi194.stdout:3/678: write d5/d10/fca [329191,23455] 0 2024-02-20T08:06:15.799 INFO:tasks.workunit.client.1.smithi194.stdout:7/716: rmdir d11/d2d/d38/d4a/d53/d81 39 2024-02-20T08:06:15.802 INFO:tasks.workunit.client.1.smithi194.stdout:8/614: symlink d2/db5/ldc 0 2024-02-20T08:06:15.804 INFO:tasks.workunit.client.1.smithi194.stdout:8/615: read d2/d14/d18/d45/d7b/dc7/d78/d98/f81 [14564,10546] 0 2024-02-20T08:06:15.805 INFO:tasks.workunit.client.1.smithi194.stdout:7/717: dwrite d11/d2d/d38/d37/d3c/fc7 [0,4194304] 0 2024-02-20T08:06:15.813 INFO:tasks.workunit.client.1.smithi194.stdout:4/637: symlink d0/d10/d1c/d21/d46/lb9 0 2024-02-20T08:06:15.814 INFO:tasks.workunit.client.1.smithi194.stdout:9/719: rmdir d4/de 39 2024-02-20T08:06:15.817 INFO:tasks.workunit.client.1.smithi194.stdout:2/710: truncate df/f72 7523317 0 2024-02-20T08:06:15.818 INFO:tasks.workunit.client.1.smithi194.stdout:0/628: mkdir d6/d93/dcf 0 2024-02-20T08:06:15.820 INFO:tasks.workunit.client.1.smithi194.stdout:8/616: symlink d2/d14/d18/d45/d69/d9b/ldd 0 2024-02-20T08:06:15.821 INFO:tasks.workunit.client.1.smithi194.stdout:8/617: readlink d2/d14/d18/d45/d7b/dc7/l84 0 2024-02-20T08:06:15.822 INFO:tasks.workunit.client.1.smithi194.stdout:5/723: mknod d4/d6/dd/d99/da7/ce1 0 2024-02-20T08:06:15.822 INFO:tasks.workunit.client.1.smithi194.stdout:8/618: stat d2/d80/fd8 0 2024-02-20T08:06:15.823 INFO:tasks.workunit.client.1.smithi194.stdout:8/619: write d2/f31 [4869632,93753] 0 2024-02-20T08:06:15.828 INFO:tasks.workunit.client.1.smithi194.stdout:7/718: link d11/d2d/d38/d95/fbe d11/d2d/d38/d4a/d93/fda 0 2024-02-20T08:06:15.831 INFO:tasks.workunit.client.1.smithi194.stdout:1/677: rename d2/d8/d12/f52 to d2/d8/d12/dc9/d26/fe3 0 2024-02-20T08:06:15.834 INFO:tasks.workunit.client.1.smithi194.stdout:5/724: rmdir d4/d20/d2b/d79 39 2024-02-20T08:06:15.837 INFO:tasks.workunit.client.1.smithi194.stdout:2/711: symlink df/d14/d24/d56/da2/ldf 0 2024-02-20T08:06:15.844 INFO:tasks.workunit.client.1.smithi194.stdout:0/629: mkdir d6/d2b/d35/d9c/dd0 0 2024-02-20T08:06:15.845 INFO:tasks.workunit.client.1.smithi194.stdout:0/630: stat d6/d2b/d35/d42/d1e/l98 0 2024-02-20T08:06:15.846 INFO:tasks.workunit.client.1.smithi194.stdout:1/678: write d2/d8/d12/dc9/d26/d3d/fda [2588093,65569] 0 2024-02-20T08:06:15.847 INFO:tasks.workunit.client.1.smithi194.stdout:9/720: mkdir d4/d20/d5c/dd0/def 0 2024-02-20T08:06:15.850 INFO:tasks.workunit.client.1.smithi194.stdout:7/719: rename d11/d2d/d38/d37/d43/c49 to d11/d2d/d38/d37/d3c/dd1/cdb 0 2024-02-20T08:06:15.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/638: getdents d0/d10/d1c 0 2024-02-20T08:06:15.853 INFO:tasks.workunit.client.1.smithi194.stdout:1/679: mknod d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/db0/ce4 0 2024-02-20T08:06:15.855 INFO:tasks.workunit.client.1.smithi194.stdout:9/721: mkdir d4/d1b/d90/df0 0 2024-02-20T08:06:15.855 INFO:tasks.workunit.client.1.smithi194.stdout:0/631: dread d6/d2b/d35/d42/d1e/f23 [0,4194304] 0 2024-02-20T08:06:15.855 INFO:tasks.workunit.client.1.smithi194.stdout:3/679: link d5/d10/d28/d41/d73/d8c/cbd d5/d10/d17/d1d/ccf 0 2024-02-20T08:06:15.857 INFO:tasks.workunit.client.1.smithi194.stdout:3/680: chown d5/d10/d17/l3c 541748 1 2024-02-20T08:06:15.857 INFO:tasks.workunit.client.1.smithi194.stdout:0/632: write d6/d2b/d35/d42/f28 [1418894,112360] 0 2024-02-20T08:06:15.857 INFO:tasks.workunit.client.1.smithi194.stdout:8/620: creat d2/d14/d18/fde x:0 0 0 2024-02-20T08:06:15.894 INFO:tasks.workunit.client.1.smithi194.stdout:6/792: sync 2024-02-20T08:06:15.894 INFO:tasks.workunit.client.1.smithi194.stdout:5/725: rename d4/d20/d2b/ddf/dc4/d28/d85/d53 to d4/d6/dd/d25/d7d/de2 0 2024-02-20T08:06:15.895 INFO:tasks.workunit.client.1.smithi194.stdout:7/720: mknod d11/d2d/d38/d4a/d27/d51/d77/d9d/cdc 0 2024-02-20T08:06:15.896 INFO:tasks.workunit.client.1.smithi194.stdout:3/681: creat d5/df/d60/fd0 x:0 0 0 2024-02-20T08:06:15.896 INFO:tasks.workunit.client.1.smithi194.stdout:0/633: rmdir d6/d93 39 2024-02-20T08:06:15.896 INFO:tasks.workunit.client.1.smithi194.stdout:4/639: dwrite d0/d5c/d60/d4a/dad/fb1 [0,4194304] 0 2024-02-20T08:06:15.901 INFO:tasks.workunit.client.1.smithi194.stdout:0/634: chown d6/d2b/d35/d39/fc2 121706095 1 2024-02-20T08:06:15.902 INFO:tasks.workunit.client.1.smithi194.stdout:9/722: dwrite d4/d37/d38/faf [0,4194304] 0 2024-02-20T08:06:15.922 INFO:tasks.workunit.client.1.smithi194.stdout:8/621: dread d2/d14/f5c [0,4194304] 0 2024-02-20T08:06:15.923 INFO:tasks.workunit.client.1.smithi194.stdout:8/622: chown d2/d14/d18/d45/d7b/dc0/lc1 1344523 1 2024-02-20T08:06:15.925 INFO:tasks.workunit.client.1.smithi194.stdout:7/721: dread d11/f1a [0,4194304] 0 2024-02-20T08:06:15.926 INFO:tasks.workunit.client.1.smithi194.stdout:3/682: rmdir d5/d10/d17/d1d/d56 39 2024-02-20T08:06:15.931 INFO:tasks.workunit.client.1.smithi194.stdout:4/640: rename d0/df/d18 to d0/df/d11/dba 0 2024-02-20T08:06:15.931 INFO:tasks.workunit.client.1.smithi194.stdout:4/641: chown d0/d9d 7 1 2024-02-20T08:06:15.933 INFO:tasks.workunit.client.1.smithi194.stdout:9/723: creat d4/d8b/ff1 x:0 0 0 2024-02-20T08:06:15.937 INFO:tasks.workunit.client.1.smithi194.stdout:4/642: dwrite d0/d5c/d60/d4a/dad/fb1 [0,4194304] 0 2024-02-20T08:06:15.944 INFO:tasks.workunit.client.1.smithi194.stdout:6/793: creat df/d18/f107 x:0 0 0 2024-02-20T08:06:15.948 INFO:tasks.workunit.client.1.smithi194.stdout:9/724: fdatasync d4/d37/f86 0 2024-02-20T08:06:15.950 INFO:tasks.workunit.client.1.smithi194.stdout:3/683: getdents d5/d10/d17/d1d/d3d/daa 0 2024-02-20T08:06:15.951 INFO:tasks.workunit.client.1.smithi194.stdout:0/635: rename d6/d2b/d35/d42/d1e/d45/c52 to d6/d2b/d35/d42/d1e/d45/daa/d77/cd1 0 2024-02-20T08:06:15.952 INFO:tasks.workunit.client.1.smithi194.stdout:4/643: dwrite d0/d10/d1c/d21/fb8 [0,4194304] 0 2024-02-20T08:06:15.955 INFO:tasks.workunit.client.1.smithi194.stdout:6/794: dwrite df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/ffe [0,4194304] 0 2024-02-20T08:06:15.958 INFO:tasks.workunit.client.1.smithi194.stdout:8/623: rename d2/d14/d18/f48 to d2/d14/d18/d45/d90/d92/fdf 0 2024-02-20T08:06:15.960 INFO:tasks.workunit.client.1.smithi194.stdout:6/795: chown df/f5d 399 1 2024-02-20T08:06:15.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/712: sync 2024-02-20T08:06:15.966 INFO:tasks.workunit.client.1.smithi194.stdout:7/722: rename d11/f14 to d11/d2d/d38/d37/d43/d7b/dc5/fdd 0 2024-02-20T08:06:15.971 INFO:tasks.workunit.client.1.smithi194.stdout:9/725: dwrite d4/d37/ddf/dc8/fe8 [0,4194304] 0 2024-02-20T08:06:15.971 INFO:tasks.workunit.client.1.smithi194.stdout:8/624: write d2/d14/f5c [4490378,3851] 0 2024-02-20T08:06:15.973 INFO:tasks.workunit.client.1.smithi194.stdout:7/723: fdatasync d11/f35 0 2024-02-20T08:06:15.973 INFO:tasks.workunit.client.1.smithi194.stdout:4/644: dwrite d0/d10/d1c/d21/fb8 [0,4194304] 0 2024-02-20T08:06:15.973 INFO:tasks.workunit.client.1.smithi194.stdout:0/636: dwrite d6/d2b/fc7 [0,4194304] 0 2024-02-20T08:06:15.977 INFO:tasks.workunit.client.1.smithi194.stdout:3/684: dread d5/d10/d16/f2d [0,4194304] 0 2024-02-20T08:06:15.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/796: creat df/dab/d1d/d28/d46/d5a/d6b/d83/d93/f108 x:0 0 0 2024-02-20T08:06:15.981 INFO:tasks.workunit.client.1.smithi194.stdout:3/685: readlink d5/df/d25/l29 0 2024-02-20T08:06:15.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/625: readlink d2/d14/d18/l77 0 2024-02-20T08:06:15.983 INFO:tasks.workunit.client.1.smithi194.stdout:2/713: dwrite df/d14/d19/f2a [0,4194304] 0 2024-02-20T08:06:15.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/714: readlink df/l38 0 2024-02-20T08:06:15.985 INFO:tasks.workunit.client.1.smithi194.stdout:3/686: fdatasync d5/d10/fca 0 2024-02-20T08:06:15.986 INFO:tasks.workunit.client.1.smithi194.stdout:9/726: mknod d4/d37/cf2 0 2024-02-20T08:06:15.987 INFO:tasks.workunit.client.1.smithi194.stdout:8/626: chown d2/c25 791 1 2024-02-20T08:06:15.988 INFO:tasks.workunit.client.1.smithi194.stdout:9/727: chown d4/d20/d5c/fcd 1015321 1 2024-02-20T08:06:15.992 INFO:tasks.workunit.client.1.smithi194.stdout:2/715: fsync df/f4f 0 2024-02-20T08:06:15.996 INFO:tasks.workunit.client.1.smithi194.stdout:5/726: sync 2024-02-20T08:06:15.996 INFO:tasks.workunit.client.1.smithi194.stdout:1/680: sync 2024-02-20T08:06:15.999 INFO:tasks.workunit.client.1.smithi194.stdout:7/724: dwrite d11/d2d/d38/d37/d43/d8e/d5e/fa3 [4194304,4194304] 0 2024-02-20T08:06:16.000 INFO:tasks.workunit.client.1.smithi194.stdout:9/728: creat d4/d37/ddf/d59/ff3 x:0 0 0 2024-02-20T08:06:16.001 INFO:tasks.workunit.client.1.smithi194.stdout:8/627: rename d2/d14/d18/l3e to d2/d80/dd1/le0 0 2024-02-20T08:06:16.002 INFO:tasks.workunit.client.1.smithi194.stdout:1/681: fsync d2/d8/d12/dc9/d26/f40 0 2024-02-20T08:06:16.003 INFO:tasks.workunit.client.1.smithi194.stdout:9/729: readlink d4/d20/d5c/l4b 0 2024-02-20T08:06:16.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/628: chown d2/d14/d18/f61 139629384 1 2024-02-20T08:06:16.004 INFO:tasks.workunit.client.1.smithi194.stdout:7/725: mkdir d11/d2d/d38/d4a/dde 0 2024-02-20T08:06:16.005 INFO:tasks.workunit.client.1.smithi194.stdout:5/727: truncate d4/d6/dd/d25/d7d/fba 675709 0 2024-02-20T08:06:16.005 INFO:tasks.workunit.client.1.smithi194.stdout:5/728: stat d4/d6/dd/d25/d7d/dcd/cd9 0 2024-02-20T08:06:16.006 INFO:tasks.workunit.client.1.smithi194.stdout:5/729: chown d4/d6/dd/d3a 1850 1 2024-02-20T08:06:16.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/730: stat d4/de/c1c 0 2024-02-20T08:06:16.007 INFO:tasks.workunit.client.1.smithi194.stdout:4/645: dread d0/d10/d1c/d4d/f38 [0,4194304] 0 2024-02-20T08:06:16.008 INFO:tasks.workunit.client.1.smithi194.stdout:8/629: readlink d2/d14/d18/l1a 0 2024-02-20T08:06:16.009 INFO:tasks.workunit.client.1.smithi194.stdout:7/726: stat l4 0 2024-02-20T08:06:16.009 INFO:tasks.workunit.client.1.smithi194.stdout:5/730: mknod d4/ce3 0 2024-02-20T08:06:16.011 INFO:tasks.workunit.client.1.smithi194.stdout:5/731: readlink d4/d6/dd/l4e 0 2024-02-20T08:06:16.011 INFO:tasks.workunit.client.1.smithi194.stdout:9/731: read d4/d37/ddf/d59/f5b [1814677,27163] 0 2024-02-20T08:06:16.011 INFO:tasks.workunit.client.1.smithi194.stdout:4/646: mkdir d0/df/d11/dbb 0 2024-02-20T08:06:16.012 INFO:tasks.workunit.client.1.smithi194.stdout:8/630: write d2/d14/d18/d45/d4e/f5e [300186,60892] 0 2024-02-20T08:06:16.017 INFO:tasks.workunit.client.1.smithi194.stdout:9/732: mknod d4/d20/d41/cf4 0 2024-02-20T08:06:16.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/647: rename d0/d10/d1c/d21/d46/c59 to d0/df/d41/cbc 0 2024-02-20T08:06:16.020 INFO:tasks.workunit.client.1.smithi194.stdout:8/631: rmdir d2/d14/d18/d45/d69/d9b 39 2024-02-20T08:06:16.021 INFO:tasks.workunit.client.1.smithi194.stdout:8/632: chown d2/f1f 98 1 2024-02-20T08:06:16.022 INFO:tasks.workunit.client.1.smithi194.stdout:5/732: creat d4/d20/d2b/fe4 x:0 0 0 2024-02-20T08:06:16.022 INFO:tasks.workunit.client.1.smithi194.stdout:0/637: dread d6/d2b/d35/d42/d1e/f2e [0,4194304] 0 2024-02-20T08:06:16.022 INFO:tasks.workunit.client.1.smithi194.stdout:8/633: chown d2/d14/d18/fcf 459919 1 2024-02-20T08:06:16.023 INFO:tasks.workunit.client.1.smithi194.stdout:9/733: creat d4/d20/d41/db6/ff5 x:0 0 0 2024-02-20T08:06:16.025 INFO:tasks.workunit.client.1.smithi194.stdout:5/733: chown d4/d20/d2b/ddf/dc4/d28/d85/ca0 497802 1 2024-02-20T08:06:16.025 INFO:tasks.workunit.client.1.smithi194.stdout:3/687: write d5/d10/d28/fb0 [159578,32778] 0 2024-02-20T08:06:16.029 INFO:tasks.workunit.client.1.smithi194.stdout:8/634: rename d2/d14/d18/l1a to d2/d14/d18/d45/d4e/dbe/dc3/le1 0 2024-02-20T08:06:16.031 INFO:tasks.workunit.client.1.smithi194.stdout:6/797: write df/dab/d1d/d28/d46/d5a/d6b/dcb/f105 [1980166,99327] 0 2024-02-20T08:06:16.034 INFO:tasks.workunit.client.1.smithi194.stdout:0/638: link d6/d2b/d35/d42/d1e/d3c/l64 d6/dbe/ld2 0 2024-02-20T08:06:16.034 INFO:tasks.workunit.client.1.smithi194.stdout:9/734: dwrite d4/d1b/d2e/f30 [0,4194304] 0 2024-02-20T08:06:16.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/635: rename d2/d14/d18/d45/d4e/f5e to d2/d80/dd1/fe2 0 2024-02-20T08:06:16.038 INFO:tasks.workunit.client.1.smithi194.stdout:3/688: dwrite d5/df/d30/d80/f89 [0,4194304] 0 2024-02-20T08:06:16.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/727: write d11/d2d/d38/d4a/d93/fda [295090,48824] 0 2024-02-20T08:06:16.040 INFO:tasks.workunit.client.1.smithi194.stdout:2/716: dwrite df/d14/d19/d5c/d60/f7f [4194304,4194304] 0 2024-02-20T08:06:16.049 INFO:tasks.workunit.client.1.smithi194.stdout:9/735: mkdir d4/d37/ddf/d42/d4e/d6e/d88/df6 0 2024-02-20T08:06:16.052 INFO:tasks.workunit.client.1.smithi194.stdout:0/639: mkdir d6/d2b/d35/d42/d1e/d45/daa/d77/d9d/dd3 0 2024-02-20T08:06:16.052 INFO:tasks.workunit.client.1.smithi194.stdout:6/798: truncate df/dab/d1d/d28/d46/f6c 1719095 0 2024-02-20T08:06:16.055 INFO:tasks.workunit.client.1.smithi194.stdout:0/640: chown d6/d2b/d35/d42/d1e/d45/c4b 612170657 1 2024-02-20T08:06:16.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/648: dread d0/df/d11/f2b [0,4194304] 0 2024-02-20T08:06:16.057 INFO:tasks.workunit.client.1.smithi194.stdout:0/641: truncate d6/d2b/d35/d9c/f6b 607722 0 2024-02-20T08:06:16.057 INFO:tasks.workunit.client.1.smithi194.stdout:5/734: rename d4/d6/dd/d25/d78/c88 to d4/d20/d2b/ddf/db6/ce5 0 2024-02-20T08:06:16.059 INFO:tasks.workunit.client.1.smithi194.stdout:0/642: truncate d6/d2b/d35/d42/f16 9372444 0 2024-02-20T08:06:16.060 INFO:tasks.workunit.client.1.smithi194.stdout:8/636: creat d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 x:0 0 0 2024-02-20T08:06:16.062 INFO:tasks.workunit.client.1.smithi194.stdout:3/689: dread d5/d10/d17/d1d/d56/f71 [0,4194304] 0 2024-02-20T08:06:16.065 INFO:tasks.workunit.client.1.smithi194.stdout:5/735: chown d4/d20/d2b/lc2 4 1 2024-02-20T08:06:16.066 INFO:tasks.workunit.client.1.smithi194.stdout:5/736: dread - d4/d6/dd/d25/d78/f98 zero size 2024-02-20T08:06:16.066 INFO:tasks.workunit.client.1.smithi194.stdout:9/736: dwrite d4/d20/fbe [0,4194304] 0 2024-02-20T08:06:16.067 INFO:tasks.workunit.client.1.smithi194.stdout:6/799: rename df/d42/da8 to df/dab/d1d/d28/d46/d109 0 2024-02-20T08:06:16.069 INFO:tasks.workunit.client.1.smithi194.stdout:5/737: write d4/d6/dd/d25/d7d/fba [616452,57125] 0 2024-02-20T08:06:16.077 INFO:tasks.workunit.client.1.smithi194.stdout:4/649: rename d0/df/l56 to d0/df/d41/d69/daa/lbd 0 2024-02-20T08:06:16.078 INFO:tasks.workunit.client.1.smithi194.stdout:9/737: creat d4/d20/d43/daa/ff7 x:0 0 0 2024-02-20T08:06:16.079 INFO:tasks.workunit.client.1.smithi194.stdout:9/738: truncate d4/d55/fa6 684043 0 2024-02-20T08:06:16.082 INFO:tasks.workunit.client.1.smithi194.stdout:6/800: creat df/dab/d1d/d28/d46/d5a/f10a x:0 0 0 2024-02-20T08:06:16.084 INFO:tasks.workunit.client.1.smithi194.stdout:0/643: link d6/d2b/d35/d42/f16 d6/d2b/d35/d39/d8f/fd4 0 2024-02-20T08:06:16.084 INFO:tasks.workunit.client.1.smithi194.stdout:9/739: dread d4/de/f6d [4194304,4194304] 0 2024-02-20T08:06:16.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/717: link df/f72 df/d5b/d61/fe0 0 2024-02-20T08:06:16.093 INFO:tasks.workunit.client.1.smithi194.stdout:3/690: creat d5/d10/d28/d41/d73/d8c/da6/fd1 x:0 0 0 2024-02-20T08:06:16.097 INFO:tasks.workunit.client.1.smithi194.stdout:8/637: rmdir d2/d14/d18/d45/d90/d92/dd6 0 2024-02-20T08:06:16.101 INFO:tasks.workunit.client.1.smithi194.stdout:9/740: creat d4/d8b/ff8 x:0 0 0 2024-02-20T08:06:16.102 INFO:tasks.workunit.client.1.smithi194.stdout:8/638: dwrite d2/f31 [0,4194304] 0 2024-02-20T08:06:16.103 INFO:tasks.workunit.client.1.smithi194.stdout:5/738: mkdir d4/d6/dd/d99/de6 0 2024-02-20T08:06:16.103 INFO:tasks.workunit.client.1.smithi194.stdout:8/639: dread - d2/d14/d18/d45/d69/daf/db3/fd0 zero size 2024-02-20T08:06:16.105 INFO:tasks.workunit.client.1.smithi194.stdout:4/650: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:16.106 INFO:tasks.workunit.client.1.smithi194.stdout:2/718: creat df/d14/d80/d85/db8/fe1 x:0 0 0 2024-02-20T08:06:16.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/691: mkdir d5/d10/d28/dd2 0 2024-02-20T08:06:16.108 INFO:tasks.workunit.client.1.smithi194.stdout:6/801: symlink df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/l10b 0 2024-02-20T08:06:16.111 INFO:tasks.workunit.client.1.smithi194.stdout:9/741: fsync d4/d37/d38/fb1 0 2024-02-20T08:06:16.113 INFO:tasks.workunit.client.1.smithi194.stdout:5/739: creat d4/fe7 x:0 0 0 2024-02-20T08:06:16.115 INFO:tasks.workunit.client.1.smithi194.stdout:4/651: mkdir d0/d5c/d60/d4a/d4e/dbe 0 2024-02-20T08:06:16.120 INFO:tasks.workunit.client.1.smithi194.stdout:9/742: symlink d4/d37/d4f/lf9 0 2024-02-20T08:06:16.121 INFO:tasks.workunit.client.1.smithi194.stdout:0/644: rmdir d6/d2b/d35/d42/d1e/d45/daa/d77/d9d/dd3 0 2024-02-20T08:06:16.122 INFO:tasks.workunit.client.1.smithi194.stdout:4/652: dwrite d0/d10/d1c/d4d/d2f/fb2 [0,4194304] 0 2024-02-20T08:06:16.129 INFO:tasks.workunit.client.1.smithi194.stdout:0/645: dread d6/d2b/d35/d39/d55/f69 [0,4194304] 0 2024-02-20T08:06:16.129 INFO:tasks.workunit.client.1.smithi194.stdout:9/743: creat d4/d20/d43/d51/ffa x:0 0 0 2024-02-20T08:06:16.131 INFO:tasks.workunit.client.1.smithi194.stdout:8/640: creat d2/fe4 x:0 0 0 2024-02-20T08:06:16.134 INFO:tasks.workunit.client.1.smithi194.stdout:5/740: fdatasync d4/d20/d2b/f2c 0 2024-02-20T08:06:16.135 INFO:tasks.workunit.client.1.smithi194.stdout:5/741: fdatasync d4/d6/d11/d2f/d77/f7a 0 2024-02-20T08:06:16.136 INFO:tasks.workunit.client.1.smithi194.stdout:3/692: getdents d5/d10/d62/db2 0 2024-02-20T08:06:16.138 INFO:tasks.workunit.client.1.smithi194.stdout:8/641: rename d2/c32 to d2/d14/d18/d45/d90/d92/ce5 0 2024-02-20T08:06:16.138 INFO:tasks.workunit.client.1.smithi194.stdout:4/653: mknod d0/d5c/d60/d4a/dad/db0/cbf 0 2024-02-20T08:06:16.149 INFO:tasks.workunit.client.1.smithi194.stdout:1/682: sync 2024-02-20T08:06:16.150 INFO:tasks.workunit.client.1.smithi194.stdout:8/642: chown d2/d14/d18/d45/fcd 13344 1 2024-02-20T08:06:16.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/802: truncate df/dab/d1d/d28/d46/f6c 1925467 0 2024-02-20T08:06:16.151 INFO:tasks.workunit.client.1.smithi194.stdout:2/719: dwrite df/d14/d19/d5c/f5e [0,4194304] 0 2024-02-20T08:06:16.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/654: creat d0/d10/d1c/d21/d46/fc0 x:0 0 0 2024-02-20T08:06:16.154 INFO:tasks.workunit.client.1.smithi194.stdout:2/720: write df/d14/d24/d56/d6b/fbc [584276,90785] 0 2024-02-20T08:06:16.236 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: pgmap v57: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 152 MiB/s wr, 326 op/s 2024-02-20T08:06:16.236 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: Standby manager daemon smithi123.kwyrtl restarted 2024-02-20T08:06:16.236 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: Standby manager daemon smithi123.kwyrtl started 2024-02-20T08:06:16.236 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/crt"}]: dispatch 2024-02-20T08:06:16.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:06:16.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/key"}]: dispatch 2024-02-20T08:06:16.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:16 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:06:16.251 INFO:tasks.workunit.client.1.smithi194.stdout:5/742: mkdir d4/d20/d2b/de8 0 2024-02-20T08:06:16.252 INFO:tasks.workunit.client.1.smithi194.stdout:1/683: chown d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f50 9804294 1 2024-02-20T08:06:16.252 INFO:tasks.workunit.client.1.smithi194.stdout:8/643: mknod d2/d14/d18/d45/d7b/dc7/ce6 0 2024-02-20T08:06:16.252 INFO:tasks.workunit.client.1.smithi194.stdout:6/803: unlink df/dab/d1d/d28/d46/d5a/d6b/d83/db3/lf5 0 2024-02-20T08:06:16.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/721: chown df/d5b/d61/f8b 0 1 2024-02-20T08:06:16.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/646: dread d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:16.255 INFO:tasks.workunit.client.1.smithi194.stdout:1/684: dread d2/d8/f3c [0,4194304] 0 2024-02-20T08:06:16.257 INFO:tasks.workunit.client.1.smithi194.stdout:3/693: getdents d5/d10/d28 0 2024-02-20T08:06:16.257 INFO:tasks.workunit.client.1.smithi194.stdout:8/644: write d2/d14/d18/d45/d4e/dbe/dc3/fc8 [3759249,54767] 0 2024-02-20T08:06:16.259 INFO:tasks.workunit.client.1.smithi194.stdout:3/694: readlink d5/d10/d17/l3c 0 2024-02-20T08:06:16.261 INFO:tasks.workunit.client.1.smithi194.stdout:6/804: mknod df/dab/d1d/d28/d46/d5a/c10c 0 2024-02-20T08:06:16.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/655: dwrite d0/d10/d1c/d21/d46/f8c [0,4194304] 0 2024-02-20T08:06:16.265 INFO:tasks.workunit.client.1.smithi194.stdout:5/743: dwrite d4/d6/d11/d2f/f4d [0,4194304] 0 2024-02-20T08:06:16.265 INFO:tasks.workunit.client.1.smithi194.stdout:6/805: chown df/dab/d1d/d28/d46/d5a/d6b/d83/da5 19 1 2024-02-20T08:06:16.267 INFO:tasks.workunit.client.1.smithi194.stdout:5/744: readlink d4/d6/dd/d25/la1 0 2024-02-20T08:06:16.270 INFO:tasks.workunit.client.1.smithi194.stdout:3/695: rename d5/d10/d17/d1d/d56 to d5/d10/d28/dd3 0 2024-02-20T08:06:16.270 INFO:tasks.workunit.client.1.smithi194.stdout:5/745: chown d4/d6/caf 2125 1 2024-02-20T08:06:16.270 INFO:tasks.workunit.client.1.smithi194.stdout:1/685: link d2/d8/d12/f21 d2/d8/d12/dc9/d26/d45/d98/dc6/fe5 0 2024-02-20T08:06:16.271 INFO:tasks.workunit.client.1.smithi194.stdout:3/696: fsync d5/d10/d28/dd3/f71 0 2024-02-20T08:06:16.273 INFO:tasks.workunit.client.1.smithi194.stdout:7/728: sync 2024-02-20T08:06:16.273 INFO:tasks.workunit.client.1.smithi194.stdout:4/656: mknod d0/d5c/cc1 0 2024-02-20T08:06:16.273 INFO:tasks.workunit.client.1.smithi194.stdout:0/647: truncate d6/d2b/d35/d48/f4a 742297 0 2024-02-20T08:06:16.275 INFO:tasks.workunit.client.1.smithi194.stdout:3/697: creat d5/d10/d17/fd4 x:0 0 0 2024-02-20T08:06:16.276 INFO:tasks.workunit.client.1.smithi194.stdout:1/686: mknod d2/d8/d12/dc9/ce6 0 2024-02-20T08:06:16.281 INFO:tasks.workunit.client.1.smithi194.stdout:5/746: dwrite d4/d6/dd/d3a/fd6 [0,4194304] 0 2024-02-20T08:06:16.283 INFO:tasks.workunit.client.1.smithi194.stdout:8/645: dread d2/d14/f34 [0,4194304] 0 2024-02-20T08:06:16.284 INFO:tasks.workunit.client.1.smithi194.stdout:7/729: creat d11/d2d/d38/d4a/d27/d51/fdf x:0 0 0 2024-02-20T08:06:16.284 INFO:tasks.workunit.client.1.smithi194.stdout:0/648: truncate d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/fab 940781 0 2024-02-20T08:06:16.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/698: readlink d5/d10/d17/d1d/l26 0 2024-02-20T08:06:16.287 INFO:tasks.workunit.client.1.smithi194.stdout:4/657: dwrite d0/d10/d1c/d21/fb8 [0,4194304] 0 2024-02-20T08:06:16.290 INFO:tasks.workunit.client.1.smithi194.stdout:6/806: truncate df/dab/d1d/d28/d2b/d80/fdc 746922 0 2024-02-20T08:06:16.292 INFO:tasks.workunit.client.1.smithi194.stdout:8/646: rmdir d2/d14/d18/d45/d69 39 2024-02-20T08:06:16.293 INFO:tasks.workunit.client.1.smithi194.stdout:1/687: dread d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f6b [0,4194304] 0 2024-02-20T08:06:16.297 INFO:tasks.workunit.client.1.smithi194.stdout:0/649: dwrite d6/d2b/d35/d39/fce [0,4194304] 0 2024-02-20T08:06:16.301 INFO:tasks.workunit.client.1.smithi194.stdout:6/807: dwrite df/dab/f102 [0,4194304] 0 2024-02-20T08:06:16.303 INFO:tasks.workunit.client.1.smithi194.stdout:3/699: symlink d5/df/d9a/ld5 0 2024-02-20T08:06:16.303 INFO:tasks.workunit.client.1.smithi194.stdout:6/808: fsync df/dab/d1d/d28/d5e/f69 0 2024-02-20T08:06:16.309 INFO:tasks.workunit.client.1.smithi194.stdout:8/647: chown d2/d14/d18/d45/d69 1599395389 1 2024-02-20T08:06:16.309 INFO:tasks.workunit.client.1.smithi194.stdout:5/747: creat d4/d6/d11/d2f/d77/d90/fe9 x:0 0 0 2024-02-20T08:06:16.311 INFO:tasks.workunit.client.1.smithi194.stdout:7/730: truncate d11/d2d/d38/d4a/d53/d81/f86 478425 0 2024-02-20T08:06:16.312 INFO:tasks.workunit.client.1.smithi194.stdout:3/700: mknod d5/df/d30/cd6 0 2024-02-20T08:06:16.312 INFO:tasks.workunit.client.1.smithi194.stdout:7/731: readlink d11/lac 0 2024-02-20T08:06:16.313 INFO:tasks.workunit.client.1.smithi194.stdout:1/688: mknod d2/d8/d12/dc9/d61/d68/db7/ce7 0 2024-02-20T08:06:16.314 INFO:tasks.workunit.client.1.smithi194.stdout:6/809: readlink df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/lf9 0 2024-02-20T08:06:16.315 INFO:tasks.workunit.client.1.smithi194.stdout:5/748: mknod d4/d20/d2b/d9b/ddb/cea 0 2024-02-20T08:06:16.316 INFO:tasks.workunit.client.1.smithi194.stdout:8/648: creat d2/d14/d18/d45/d4e/dbe/dc3/fe7 x:0 0 0 2024-02-20T08:06:16.316 INFO:tasks.workunit.client.1.smithi194.stdout:6/810: write df/dab/fd0 [5004230,118128] 0 2024-02-20T08:06:16.317 INFO:tasks.workunit.client.1.smithi194.stdout:0/650: getdents d6/d2b/d35/d9c/d62 0 2024-02-20T08:06:16.317 INFO:tasks.workunit.client.1.smithi194.stdout:3/701: mknod d5/df/d25/dcb/cd7 0 2024-02-20T08:06:16.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/749: truncate d4/d6/dd/fd0 378380 0 2024-02-20T08:06:16.318 INFO:tasks.workunit.client.1.smithi194.stdout:1/689: mknod d2/d8/d12/dc9/d26/d45/d98/ce8 0 2024-02-20T08:06:16.320 INFO:tasks.workunit.client.1.smithi194.stdout:8/649: creat d2/d14/d18/d45/d4e/d9f/fe8 x:0 0 0 2024-02-20T08:06:16.320 INFO:tasks.workunit.client.1.smithi194.stdout:7/732: link d11/d6e/c9e d11/d2d/d38/d4a/d27/d51/d77/ce0 0 2024-02-20T08:06:16.320 INFO:tasks.workunit.client.1.smithi194.stdout:1/690: dread - d2/d8/d12/dc9/fb4 zero size 2024-02-20T08:06:16.322 INFO:tasks.workunit.client.1.smithi194.stdout:8/650: chown d2/db5/cba 0 1 2024-02-20T08:06:16.322 INFO:tasks.workunit.client.1.smithi194.stdout:3/702: symlink d5/d10/d17/d1d/ld8 0 2024-02-20T08:06:16.323 INFO:tasks.workunit.client.1.smithi194.stdout:1/691: chown d2/d8/d12/dc9/d26/d3d/f4d 17387 1 2024-02-20T08:06:16.324 INFO:tasks.workunit.client.1.smithi194.stdout:8/651: dread - d2/d14/d18/d45/d4e/fae zero size 2024-02-20T08:06:16.325 INFO:tasks.workunit.client.1.smithi194.stdout:6/811: getdents df/dab/d1d/d28/d46/d5a/d7d 0 2024-02-20T08:06:16.326 INFO:tasks.workunit.client.1.smithi194.stdout:7/733: rename d11/d2d/d38/d4a/d53/la6 to d11/d2d/d38/d4a/d93/le1 0 2024-02-20T08:06:16.328 INFO:tasks.workunit.client.1.smithi194.stdout:8/652: symlink d2/d14/d18/d45/d90/d92/le9 0 2024-02-20T08:06:16.328 INFO:tasks.workunit.client.1.smithi194.stdout:3/703: truncate d5/d10/d17/d1d/d93/fb6 9390089 0 2024-02-20T08:06:16.329 INFO:tasks.workunit.client.1.smithi194.stdout:6/812: readlink df/dab/d1d/d28/d2b/l3d 0 2024-02-20T08:06:16.329 INFO:tasks.workunit.client.1.smithi194.stdout:0/651: link d6/d2b/d35/d42/d1e/d45/daa/d77/d9d/ca4 d6/d2b/d35/d42/cd5 0 2024-02-20T08:06:16.330 INFO:tasks.workunit.client.1.smithi194.stdout:0/652: chown d6/d2b/d35/d39 0 1 2024-02-20T08:06:16.331 INFO:tasks.workunit.client.1.smithi194.stdout:7/734: mkdir d11/d2d/d38/d4a/d27/d51/d77/de2 0 2024-02-20T08:06:16.332 INFO:tasks.workunit.client.1.smithi194.stdout:3/704: creat d5/d10/d28/d41/fd9 x:0 0 0 2024-02-20T08:06:16.337 INFO:tasks.workunit.client.1.smithi194.stdout:3/705: symlink d5/df/d30/lda 0 2024-02-20T08:06:16.337 INFO:tasks.workunit.client.1.smithi194.stdout:0/653: truncate d6/d2b/d35/d39/d8f/fd4 7041151 0 2024-02-20T08:06:16.339 INFO:tasks.workunit.client.1.smithi194.stdout:6/813: creat df/dab/d1d/d28/f10d x:0 0 0 2024-02-20T08:06:16.339 INFO:tasks.workunit.client.1.smithi194.stdout:7/735: dwrite d11/d2d/d38/d37/d43/d7b/f9b [4194304,4194304] 0 2024-02-20T08:06:16.340 INFO:tasks.workunit.client.1.smithi194.stdout:7/736: chown c10 608 1 2024-02-20T08:06:16.342 INFO:tasks.workunit.client.1.smithi194.stdout:0/654: rmdir d6/d2b/d35/d39 39 2024-02-20T08:06:16.342 INFO:tasks.workunit.client.1.smithi194.stdout:3/706: creat d5/fdb x:0 0 0 2024-02-20T08:06:16.344 INFO:tasks.workunit.client.1.smithi194.stdout:4/658: truncate d0/d10/d1c/d21/d46/f99 1825271 0 2024-02-20T08:06:16.345 INFO:tasks.workunit.client.1.smithi194.stdout:6/814: mknod df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/c10e 0 2024-02-20T08:06:16.347 INFO:tasks.workunit.client.1.smithi194.stdout:7/737: creat d11/d2d/d38/d4a/d93/fe3 x:0 0 0 2024-02-20T08:06:16.349 INFO:tasks.workunit.client.1.smithi194.stdout:7/738: readlink d11/d2d/d38/d37/l46 0 2024-02-20T08:06:16.349 INFO:tasks.workunit.client.1.smithi194.stdout:1/692: dread d2/d8/d12/dc9/d61/d68/db7/fc8 [0,4194304] 0 2024-02-20T08:06:16.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/693: write d2/d8/fc5 [1189187,62244] 0 2024-02-20T08:06:16.352 INFO:tasks.workunit.client.1.smithi194.stdout:0/655: mknod d6/d2b/d35/d42/d1e/d3c/cd6 0 2024-02-20T08:06:16.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/722: sync 2024-02-20T08:06:16.353 INFO:tasks.workunit.client.1.smithi194.stdout:9/744: sync 2024-02-20T08:06:16.355 INFO:tasks.workunit.client.1.smithi194.stdout:3/707: dwrite d5/d10/d28/fb0 [0,4194304] 0 2024-02-20T08:06:16.355 INFO:tasks.workunit.client.1.smithi194.stdout:1/694: read d2/d8/f3c [46977,87664] 0 2024-02-20T08:06:16.356 INFO:tasks.workunit.client.1.smithi194.stdout:6/815: read df/dab/d1d/d28/f2d [848840,29544] 0 2024-02-20T08:06:16.363 INFO:tasks.workunit.client.1.smithi194.stdout:0/656: creat d6/dbe/fd7 x:0 0 0 2024-02-20T08:06:16.364 INFO:tasks.workunit.client.1.smithi194.stdout:5/750: dwrite d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:16.365 INFO:tasks.workunit.client.1.smithi194.stdout:3/708: rmdir d5/df/d9a 39 2024-02-20T08:06:16.367 INFO:tasks.workunit.client.1.smithi194.stdout:7/739: rmdir d11/d2d/d38/dce 0 2024-02-20T08:06:16.368 INFO:tasks.workunit.client.1.smithi194.stdout:3/709: chown d5/d10/d28/f53 25 1 2024-02-20T08:06:16.369 INFO:tasks.workunit.client.1.smithi194.stdout:8/653: dwrite d2/d14/d18/f83 [0,4194304] 0 2024-02-20T08:06:16.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/659: dwrite d0/df/f13 [0,4194304] 0 2024-02-20T08:06:16.382 INFO:tasks.workunit.client.1.smithi194.stdout:8/654: dwrite d2/d14/d18/d45/d90/fb2 [0,4194304] 0 2024-02-20T08:06:16.392 INFO:tasks.workunit.client.1.smithi194.stdout:4/660: dwrite d0/d2/d3e/f3f [0,4194304] 0 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: pgmap v57: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 152 MiB/s wr, 326 op/s 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: Standby manager daemon smithi123.kwyrtl restarted 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: Standby manager daemon smithi123.kwyrtl started 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/crt"}]: dispatch 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi123.kwyrtl/key"}]: dispatch 2024-02-20T08:06:16.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:16 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:06:16.398 INFO:tasks.workunit.client.1.smithi194.stdout:4/661: dread d0/df/f13 [0,4194304] 0 2024-02-20T08:06:16.417 INFO:tasks.workunit.client.1.smithi194.stdout:2/723: write df/d14/d19/d5c/d60/f67 [144901,98587] 0 2024-02-20T08:06:16.418 INFO:tasks.workunit.client.1.smithi194.stdout:3/710: fdatasync d5/d10/d28/dd3/faf 0 2024-02-20T08:06:16.419 INFO:tasks.workunit.client.1.smithi194.stdout:3/711: chown d5/d10/d16/l2b 79928 1 2024-02-20T08:06:16.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/712: fdatasync d5/fdb 0 2024-02-20T08:06:16.423 INFO:tasks.workunit.client.1.smithi194.stdout:6/816: write df/f3c [4340015,101688] 0 2024-02-20T08:06:16.423 INFO:tasks.workunit.client.1.smithi194.stdout:0/657: write d6/f90 [1611620,73073] 0 2024-02-20T08:06:16.429 INFO:tasks.workunit.client.1.smithi194.stdout:1/695: truncate d2/d8/d12/dc9/d26/d57/f5f 1118644 0 2024-02-20T08:06:16.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/662: dread d0/d10/d1c/f5a [0,4194304] 0 2024-02-20T08:06:16.431 INFO:tasks.workunit.client.1.smithi194.stdout:0/658: dwrite d6/d2b/d35/d42/d1e/d3c/faf [0,4194304] 0 2024-02-20T08:06:16.433 INFO:tasks.workunit.client.1.smithi194.stdout:2/724: truncate df/f41 3712067 0 2024-02-20T08:06:16.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/663: read d0/d10/d1c/d21/d46/f8c [2591657,126945] 0 2024-02-20T08:06:16.434 INFO:tasks.workunit.client.1.smithi194.stdout:2/725: chown c2 65010 1 2024-02-20T08:06:16.435 INFO:tasks.workunit.client.1.smithi194.stdout:2/726: write df/d14/d24/f99 [4540016,63317] 0 2024-02-20T08:06:16.443 INFO:tasks.workunit.client.1.smithi194.stdout:3/713: dwrite d5/d10/d28/dd3/faf [0,4194304] 0 2024-02-20T08:06:16.445 INFO:tasks.workunit.client.1.smithi194.stdout:3/714: read d5/fa [7000546,60364] 0 2024-02-20T08:06:16.446 INFO:tasks.workunit.client.1.smithi194.stdout:6/817: mkdir df/dab/d1d/d28/d46/d5a/d7d/dd4/d10f 0 2024-02-20T08:06:16.452 INFO:tasks.workunit.client.1.smithi194.stdout:9/745: sync 2024-02-20T08:06:16.458 INFO:tasks.workunit.client.1.smithi194.stdout:8/655: truncate d2/f31 4442222 0 2024-02-20T08:06:16.460 INFO:tasks.workunit.client.1.smithi194.stdout:1/696: creat d2/d8/d12/dc9/d61/d7e/fe9 x:0 0 0 2024-02-20T08:06:16.462 INFO:tasks.workunit.client.1.smithi194.stdout:0/659: unlink d6/d2b/d35/d9c/f83 0 2024-02-20T08:06:16.465 INFO:tasks.workunit.client.1.smithi194.stdout:4/664: rename d0/df/d72/f9a to d0/d4f/fc2 0 2024-02-20T08:06:16.466 INFO:tasks.workunit.client.1.smithi194.stdout:2/727: rmdir df/d14/d19/d5c/d60/d63 39 2024-02-20T08:06:16.466 INFO:tasks.workunit.client.1.smithi194.stdout:1/697: dwrite d2/d8/d12/dc9/d61/fb6 [0,4194304] 0 2024-02-20T08:06:16.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/751: getdents d4/d20/d2b/ddf/dc4 0 2024-02-20T08:06:16.478 INFO:tasks.workunit.client.1.smithi194.stdout:2/728: dread df/d14/d24/f4e [0,4194304] 0 2024-02-20T08:06:16.479 INFO:tasks.workunit.client.1.smithi194.stdout:2/729: truncate df/f4f 5185891 0 2024-02-20T08:06:16.482 INFO:tasks.workunit.client.1.smithi194.stdout:6/818: rmdir df 39 2024-02-20T08:06:16.484 INFO:tasks.workunit.client.1.smithi194.stdout:9/746: truncate d4/de/f7b 478120 0 2024-02-20T08:06:16.485 INFO:tasks.workunit.client.1.smithi194.stdout:9/747: write d4/d20/d43/f47 [23749,129011] 0 2024-02-20T08:06:16.486 INFO:tasks.workunit.client.1.smithi194.stdout:8/656: mkdir d2/d14/d18/d45/d69/daf/dea 0 2024-02-20T08:06:16.490 INFO:tasks.workunit.client.1.smithi194.stdout:8/657: dread d2/d14/d18/d45/f95 [0,4194304] 0 2024-02-20T08:06:16.492 INFO:tasks.workunit.client.1.smithi194.stdout:4/665: creat d0/d10/d1c/d21/d46/fc3 x:0 0 0 2024-02-20T08:06:16.494 INFO:tasks.workunit.client.1.smithi194.stdout:1/698: write d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f6b [2991018,21854] 0 2024-02-20T08:06:16.500 INFO:tasks.workunit.client.1.smithi194.stdout:5/752: fsync d4/d6/dd/d25/d78/d8b/f3e 0 2024-02-20T08:06:16.501 INFO:tasks.workunit.client.1.smithi194.stdout:3/715: truncate d5/df/f24 4744592 0 2024-02-20T08:06:16.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/730: mknod df/d3a/ce2 0 2024-02-20T08:06:16.504 INFO:tasks.workunit.client.1.smithi194.stdout:2/731: write df/d14/d19/faf [1198302,25482] 0 2024-02-20T08:06:16.505 INFO:tasks.workunit.client.1.smithi194.stdout:5/753: dread d4/d6/da5/fda [0,4194304] 0 2024-02-20T08:06:16.506 INFO:tasks.workunit.client.1.smithi194.stdout:5/754: dread - d4/d6/dd/fe0 zero size 2024-02-20T08:06:16.509 INFO:tasks.workunit.client.1.smithi194.stdout:0/660: creat d6/d93/fd8 x:0 0 0 2024-02-20T08:06:16.510 INFO:tasks.workunit.client.1.smithi194.stdout:8/658: readlink d2/d14/l56 0 2024-02-20T08:06:16.510 INFO:tasks.workunit.client.1.smithi194.stdout:1/699: dread d2/d8/d12/dc9/d26/d45/d98/dc6/fe5 [0,4194304] 0 2024-02-20T08:06:16.516 INFO:tasks.workunit.client.1.smithi194.stdout:4/666: dwrite d0/d10/f22 [4194304,4194304] 0 2024-02-20T08:06:16.518 INFO:tasks.workunit.client.1.smithi194.stdout:4/667: write d0/d10/d1c/d4d/d2f/f31 [3900655,64603] 0 2024-02-20T08:06:16.539 INFO:tasks.workunit.client.1.smithi194.stdout:6/819: rename df/dab/d1d/d28/d2b/l3d to df/dab/d1d/d28/d46/d5a/d6b/d83/d93/l110 0 2024-02-20T08:06:16.541 INFO:tasks.workunit.client.1.smithi194.stdout:6/820: chown df/dab/d1d/d28/d46/dc6 4 1 2024-02-20T08:06:16.541 INFO:tasks.workunit.client.1.smithi194.stdout:5/755: unlink d4/d20/d2b/lc2 0 2024-02-20T08:06:16.554 INFO:tasks.workunit.client.1.smithi194.stdout:1/700: mkdir d2/d8/d12/dc9/d26/d45/d98/dea 0 2024-02-20T08:06:16.561 INFO:tasks.workunit.client.1.smithi194.stdout:1/701: dwrite d2/d8/d12/dc9/d26/d57/d58/f73 [0,4194304] 0 2024-02-20T08:06:16.561 INFO:tasks.workunit.client.1.smithi194.stdout:4/668: dread d0/d10/d1c/d21/f44 [0,4194304] 0 2024-02-20T08:06:16.563 INFO:tasks.workunit.client.1.smithi194.stdout:3/716: unlink d5/df/c33 0 2024-02-20T08:06:16.563 INFO:tasks.workunit.client.1.smithi194.stdout:4/669: dread - d0/df/d41/d69/f9b zero size 2024-02-20T08:06:16.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/702: chown d2/d8/d12/dc9/d61/d9f/ld0 18 1 2024-02-20T08:06:16.565 INFO:tasks.workunit.client.1.smithi194.stdout:3/717: chown d5/d10/d28/f98 7947 1 2024-02-20T08:06:16.565 INFO:tasks.workunit.client.1.smithi194.stdout:3/718: readlink d5/l6e 0 2024-02-20T08:06:16.566 INFO:tasks.workunit.client.1.smithi194.stdout:1/703: chown d2/d8/d12/dc9/d26/l87 1 1 2024-02-20T08:06:16.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/719: dread - d5/d10/d17/d1d/d3d/f3e zero size 2024-02-20T08:06:16.570 INFO:tasks.workunit.client.1.smithi194.stdout:3/720: chown d5/d10/d17/d1d/d3d/f91 7289580 1 2024-02-20T08:06:16.571 INFO:tasks.workunit.client.1.smithi194.stdout:4/670: dwrite d0/d9d/fac [0,4194304] 0 2024-02-20T08:06:16.572 INFO:tasks.workunit.client.1.smithi194.stdout:4/671: fdatasync d0/d5c/f7c 0 2024-02-20T08:06:16.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/672: dread - d0/d2/d51/fa8 zero size 2024-02-20T08:06:16.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/673: read d0/d5c/d60/d4a/d4e/fa9 [170488,68856] 0 2024-02-20T08:06:16.579 INFO:tasks.workunit.client.1.smithi194.stdout:3/721: dwrite d5/d10/d16/f63 [0,4194304] 0 2024-02-20T08:06:16.580 INFO:tasks.workunit.client.1.smithi194.stdout:3/722: write d5/d10/d28/d41/d73/fbb [369123,104913] 0 2024-02-20T08:06:16.590 INFO:tasks.workunit.client.1.smithi194.stdout:8/659: dwrite d2/d80/fda [0,4194304] 0 2024-02-20T08:06:16.599 INFO:tasks.workunit.client.1.smithi194.stdout:2/732: dwrite df/f21 [0,4194304] 0 2024-02-20T08:06:16.601 INFO:tasks.workunit.client.1.smithi194.stdout:6/821: creat df/dab/d1d/d28/d2b/d103/d104/f111 x:0 0 0 2024-02-20T08:06:16.602 INFO:tasks.workunit.client.1.smithi194.stdout:9/748: link d4/d37/ddf/l97 d4/d37/de2/lfb 0 2024-02-20T08:06:16.604 INFO:tasks.workunit.client.1.smithi194.stdout:7/740: link d11/d2d/d38/d4a/d53/l66 d11/d2d/d38/le4 0 2024-02-20T08:06:16.606 INFO:tasks.workunit.client.1.smithi194.stdout:1/704: symlink d2/d8/d12/leb 0 2024-02-20T08:06:16.608 INFO:tasks.workunit.client.1.smithi194.stdout:5/756: read d4/d6/dd/d25/d78/d8b/f24 [2121353,6192] 0 2024-02-20T08:06:16.611 INFO:tasks.workunit.client.1.smithi194.stdout:3/723: rmdir d5/d10 39 2024-02-20T08:06:16.611 INFO:tasks.workunit.client.1.smithi194.stdout:5/757: chown d4/d20/d2b/ddf/dc4/d28/d85/fc7 45190 1 2024-02-20T08:06:16.612 INFO:tasks.workunit.client.1.smithi194.stdout:0/661: unlink d6/d2b/d35/d9c/f6b 0 2024-02-20T08:06:16.613 INFO:tasks.workunit.client.1.smithi194.stdout:6/822: fsync df/dab/d1d/d28/d2b/f2e 0 2024-02-20T08:06:16.615 INFO:tasks.workunit.client.1.smithi194.stdout:9/749: rename d4/d37/fb8 to d4/d1b/d90/ffc 0 2024-02-20T08:06:16.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/705: creat d2/d8/d12/dc9/d61/d7d/dbf/fec x:0 0 0 2024-02-20T08:06:16.618 INFO:tasks.workunit.client.1.smithi194.stdout:8/660: symlink d2/d14/d18/d45/d69/leb 0 2024-02-20T08:06:16.622 INFO:tasks.workunit.client.1.smithi194.stdout:1/706: dwrite d2/d8/d12/f2c [0,4194304] 0 2024-02-20T08:06:16.623 INFO:tasks.workunit.client.1.smithi194.stdout:9/750: truncate d4/d20/d5c/fc 5052032 0 2024-02-20T08:06:16.624 INFO:tasks.workunit.client.1.smithi194.stdout:3/724: symlink d5/ldc 0 2024-02-20T08:06:16.625 INFO:tasks.workunit.client.1.smithi194.stdout:5/758: symlink d4/d6/dd/d99/de6/leb 0 2024-02-20T08:06:16.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/661: truncate d2/d14/d18/d45/d69/f91 383230 0 2024-02-20T08:06:16.627 INFO:tasks.workunit.client.1.smithi194.stdout:8/662: read - d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 zero size 2024-02-20T08:06:16.632 INFO:tasks.workunit.client.1.smithi194.stdout:4/674: getdents d0/d2 0 2024-02-20T08:06:16.636 INFO:tasks.workunit.client.1.smithi194.stdout:9/751: rename d4/f19 to d4/d37/ddf/d42/d4e/d6e/ffd 0 2024-02-20T08:06:16.637 INFO:tasks.workunit.client.1.smithi194.stdout:0/662: dread d6/d2b/d35/d42/d1e/d45/daa/fc8 [0,4194304] 0 2024-02-20T08:06:16.637 INFO:tasks.workunit.client.1.smithi194.stdout:0/663: readlink d6/lc4 0 2024-02-20T08:06:16.640 INFO:tasks.workunit.client.1.smithi194.stdout:7/741: creat d11/d2d/d38/d37/fe5 x:0 0 0 2024-02-20T08:06:16.640 INFO:tasks.workunit.client.1.smithi194.stdout:2/733: write df/d14/d19/d5c/f65 [288830,15948] 0 2024-02-20T08:06:16.650 INFO:tasks.workunit.client.1.smithi194.stdout:4/675: rename d0/d2/l6c to d0/d2/d51/d9c/lc4 0 2024-02-20T08:06:16.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/742: stat d11/d2d/d38/d4a/d27/d51/d84/fb4 0 2024-02-20T08:06:16.656 INFO:tasks.workunit.client.1.smithi194.stdout:6/823: truncate df/dab/d1d/d28/d2b/d94/d96/fc0 488566 0 2024-02-20T08:06:16.656 INFO:tasks.workunit.client.1.smithi194.stdout:2/734: fsync df/d14/f22 0 2024-02-20T08:06:16.658 INFO:tasks.workunit.client.1.smithi194.stdout:1/707: rmdir d2/d8/d12/dc9/d26/d45/d98/dea 0 2024-02-20T08:06:16.662 INFO:tasks.workunit.client.1.smithi194.stdout:6/824: dwrite df/d42/dcf/f87 [0,4194304] 0 2024-02-20T08:06:16.664 INFO:tasks.workunit.client.1.smithi194.stdout:2/735: dwrite df/d3a/db2/fcd [0,4194304] 0 2024-02-20T08:06:16.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/708: readlink d2/l2a 0 2024-02-20T08:06:16.674 INFO:tasks.workunit.client.1.smithi194.stdout:0/664: write d6/d2b/d35/d42/f5b [1815253,71965] 0 2024-02-20T08:06:16.676 INFO:tasks.workunit.client.1.smithi194.stdout:0/665: dread - d6/d2b/d35/d42/d1e/d45/daa/d77/fa7 zero size 2024-02-20T08:06:16.676 INFO:tasks.workunit.client.1.smithi194.stdout:5/759: getdents d4/d6/dd/d25/d7d/de2/db0 0 2024-02-20T08:06:16.677 INFO:tasks.workunit.client.1.smithi194.stdout:0/666: chown d6/lc4 1030586817 1 2024-02-20T08:06:16.679 INFO:tasks.workunit.client.1.smithi194.stdout:4/676: readlink d0/d2/d51/l76 0 2024-02-20T08:06:16.679 INFO:tasks.workunit.client.1.smithi194.stdout:5/760: chown d4/d20/d2b/d9b/ddb/cea 53320 1 2024-02-20T08:06:16.679 INFO:tasks.workunit.client.1.smithi194.stdout:6/825: mkdir df/dab/d1d/d28/d5e/d112 0 2024-02-20T08:06:16.680 INFO:tasks.workunit.client.1.smithi194.stdout:2/736: write df/d14/d19/d5c/d60/d63/d92/fcb [4840864,25411] 0 2024-02-20T08:06:16.682 INFO:tasks.workunit.client.1.smithi194.stdout:2/737: chown df/d3a/db2/fcd 173735 1 2024-02-20T08:06:16.684 INFO:tasks.workunit.client.1.smithi194.stdout:3/725: rename d5/d10/d17/d1d/d3d/lc1 to d5/df/ldd 0 2024-02-20T08:06:16.684 INFO:tasks.workunit.client.1.smithi194.stdout:0/667: rmdir d6/d2b/d35/d9c/d62 39 2024-02-20T08:06:16.687 INFO:tasks.workunit.client.1.smithi194.stdout:4/677: creat d0/d5c/d60/fc5 x:0 0 0 2024-02-20T08:06:16.687 INFO:tasks.workunit.client.1.smithi194.stdout:4/678: chown d0/d9d 30840138 1 2024-02-20T08:06:16.688 INFO:tasks.workunit.client.1.smithi194.stdout:9/752: getdents d4/d20/d43/d51/d6a/dd2 0 2024-02-20T08:06:16.689 INFO:tasks.workunit.client.1.smithi194.stdout:6/826: creat df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/f113 x:0 0 0 2024-02-20T08:06:16.690 INFO:tasks.workunit.client.1.smithi194.stdout:2/738: mkdir df/d14/d19/de3 0 2024-02-20T08:06:16.691 INFO:tasks.workunit.client.1.smithi194.stdout:8/663: rename d2/l85 to d2/d14/d18/d45/d69/d9b/lec 0 2024-02-20T08:06:16.691 INFO:tasks.workunit.client.1.smithi194.stdout:2/739: dread - df/d5b/d61/f8b zero size 2024-02-20T08:06:16.692 INFO:tasks.workunit.client.1.smithi194.stdout:3/726: unlink d5/df/d25/l29 0 2024-02-20T08:06:16.694 INFO:tasks.workunit.client.1.smithi194.stdout:4/679: creat d0/d5c/fc6 x:0 0 0 2024-02-20T08:06:16.695 INFO:tasks.workunit.client.1.smithi194.stdout:9/753: dwrite d4/de/f2a [0,4194304] 0 2024-02-20T08:06:16.696 INFO:tasks.workunit.client.1.smithi194.stdout:4/680: dread - d0/d10/d1c/d21/d46/fc0 zero size 2024-02-20T08:06:16.697 INFO:tasks.workunit.client.1.smithi194.stdout:7/743: dread d11/d2d/d38/d4a/d53/f58 [0,4194304] 0 2024-02-20T08:06:16.697 INFO:tasks.workunit.client.1.smithi194.stdout:9/754: fdatasync d4/d20/d43/daa/fae 0 2024-02-20T08:06:16.699 INFO:tasks.workunit.client.1.smithi194.stdout:6/827: creat df/dab/d1d/d28/d46/d5a/d6b/dbb/f114 x:0 0 0 2024-02-20T08:06:16.700 INFO:tasks.workunit.client.1.smithi194.stdout:2/740: creat df/d5b/d61/fe4 x:0 0 0 2024-02-20T08:06:16.701 INFO:tasks.workunit.client.1.smithi194.stdout:2/741: write fc [4158969,111002] 0 2024-02-20T08:06:16.704 INFO:tasks.workunit.client.1.smithi194.stdout:0/668: mkdir d6/d2b/d35/d9c/d62/dd9 0 2024-02-20T08:06:16.706 INFO:tasks.workunit.client.1.smithi194.stdout:3/727: mknod d5/df/d30/d80/cde 0 2024-02-20T08:06:16.707 INFO:tasks.workunit.client.1.smithi194.stdout:5/761: creat d4/d6/d11/fec x:0 0 0 2024-02-20T08:06:16.707 INFO:tasks.workunit.client.1.smithi194.stdout:2/742: dwrite df/d14/d80/d85/db8/fde [0,4194304] 0 2024-02-20T08:06:16.710 INFO:tasks.workunit.client.1.smithi194.stdout:1/709: getdents d2/d8/d12/dc9/d26/d3d/d82 0 2024-02-20T08:06:16.714 INFO:tasks.workunit.client.1.smithi194.stdout:9/755: mkdir d4/d1b/d2e/dfe 0 2024-02-20T08:06:16.716 INFO:tasks.workunit.client.1.smithi194.stdout:3/728: dwrite d5/d10/d16/d7b/d94/f9b [0,4194304] 0 2024-02-20T08:06:16.718 INFO:tasks.workunit.client.1.smithi194.stdout:8/664: write d2/d14/d18/d45/d90/f93 [2805067,99667] 0 2024-02-20T08:06:16.723 INFO:tasks.workunit.client.1.smithi194.stdout:0/669: unlink d6/d2b/d35/d42/d1e/d3c/c44 0 2024-02-20T08:06:16.724 INFO:tasks.workunit.client.1.smithi194.stdout:5/762: write d4/fb [4445662,128934] 0 2024-02-20T08:06:16.728 INFO:tasks.workunit.client.1.smithi194.stdout:1/710: fsync d2/d8/d12/dc9/d26/f53 0 2024-02-20T08:06:16.729 INFO:tasks.workunit.client.1.smithi194.stdout:1/711: readlink d2/d8/df/ld8 0 2024-02-20T08:06:16.730 INFO:tasks.workunit.client.1.smithi194.stdout:4/681: dwrite d0/f34 [0,4194304] 0 2024-02-20T08:06:16.730 INFO:tasks.workunit.client.1.smithi194.stdout:7/744: creat d11/d2d/d38/d4a/d27/d51/d77/de2/fe6 x:0 0 0 2024-02-20T08:06:16.731 INFO:tasks.workunit.client.1.smithi194.stdout:4/682: read d0/d10/d1c/d4d/f38 [8488,128538] 0 2024-02-20T08:06:16.731 INFO:tasks.workunit.client.1.smithi194.stdout:4/683: readlink d0/df/d41/l8b 0 2024-02-20T08:06:16.734 INFO:tasks.workunit.client.1.smithi194.stdout:6/828: rename df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/f113 to df/ded/f115 0 2024-02-20T08:06:16.735 INFO:tasks.workunit.client.1.smithi194.stdout:2/743: symlink df/d14/d19/de3/le5 0 2024-02-20T08:06:16.736 INFO:tasks.workunit.client.1.smithi194.stdout:6/829: chown df/ded/ld8 37157024 1 2024-02-20T08:06:16.737 INFO:tasks.workunit.client.1.smithi194.stdout:2/744: write df/fa9 [267287,83839] 0 2024-02-20T08:06:16.737 INFO:tasks.workunit.client.1.smithi194.stdout:5/763: dread d4/d6/da5/fda [0,4194304] 0 2024-02-20T08:06:16.740 INFO:tasks.workunit.client.1.smithi194.stdout:5/764: chown d4/d6/d11/d2f/f71 352 1 2024-02-20T08:06:16.740 INFO:tasks.workunit.client.1.smithi194.stdout:5/765: readlink d4/d6/d11/d2f/l41 0 2024-02-20T08:06:16.742 INFO:tasks.workunit.client.1.smithi194.stdout:9/756: creat d4/d1b/d90/df0/fff x:0 0 0 2024-02-20T08:06:16.743 INFO:tasks.workunit.client.1.smithi194.stdout:3/729: creat d5/d10/d16/d7b/d94/dad/db9/fdf x:0 0 0 2024-02-20T08:06:16.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/730: chown d5/d10/d16/d8a/l90 1794 1 2024-02-20T08:06:16.744 INFO:tasks.workunit.client.1.smithi194.stdout:4/684: unlink d0/d10/d1c/d21/d62/f67 0 2024-02-20T08:06:16.745 INFO:tasks.workunit.client.1.smithi194.stdout:0/670: mkdir d6/dda 0 2024-02-20T08:06:16.746 INFO:tasks.workunit.client.1.smithi194.stdout:6/830: rmdir df/dab/d1d/d28/d46/d5a/d6b 39 2024-02-20T08:06:16.749 INFO:tasks.workunit.client.1.smithi194.stdout:5/766: symlink d4/d6/dd/d25/d7d/led 0 2024-02-20T08:06:16.751 INFO:tasks.workunit.client.1.smithi194.stdout:9/757: creat d4/d20/d41/db7/f100 x:0 0 0 2024-02-20T08:06:16.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/758: chown d4/d1b/d79/f89 1358 1 2024-02-20T08:06:16.755 INFO:tasks.workunit.client.1.smithi194.stdout:3/731: mknod d5/d10/d16/d8a/ce0 0 2024-02-20T08:06:16.755 INFO:tasks.workunit.client.1.smithi194.stdout:5/767: dwrite d4/d6/f1f [0,4194304] 0 2024-02-20T08:06:16.757 INFO:tasks.workunit.client.1.smithi194.stdout:6/831: stat df/d18/c32 0 2024-02-20T08:06:16.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/665: dread d2/d14/d18/fcf [0,4194304] 0 2024-02-20T08:06:16.757 INFO:tasks.workunit.client.1.smithi194.stdout:0/671: creat d6/d2b/d35/d42/d1e/d3c/da0/fdb x:0 0 0 2024-02-20T08:06:16.760 INFO:tasks.workunit.client.1.smithi194.stdout:1/712: truncate d2/f42 393559 0 2024-02-20T08:06:16.764 INFO:tasks.workunit.client.1.smithi194.stdout:0/672: chown d6/d2b/d35/d42/d1e/d45/d58 496250081 1 2024-02-20T08:06:16.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/832: write df/dab/d1d/d28/fb9 [315070,122220] 0 2024-02-20T08:06:16.764 INFO:tasks.workunit.client.1.smithi194.stdout:9/759: dwrite d4/d20/d43/daa/fbb [0,4194304] 0 2024-02-20T08:06:16.766 INFO:tasks.workunit.client.1.smithi194.stdout:1/713: chown d2/d8/d12/dc9/d26/d57/ld7 13993789 1 2024-02-20T08:06:16.771 INFO:tasks.workunit.client.1.smithi194.stdout:5/768: dwrite d4/d6/dd/fe0 [0,4194304] 0 2024-02-20T08:06:16.773 INFO:tasks.workunit.client.1.smithi194.stdout:2/745: rmdir df/d5b/d61/dce/dda 0 2024-02-20T08:06:16.774 INFO:tasks.workunit.client.1.smithi194.stdout:2/746: write df/d14/d24/d56/d6b/d81/f79 [3428711,3760] 0 2024-02-20T08:06:16.781 INFO:tasks.workunit.client.1.smithi194.stdout:3/732: dread d5/df/d25/f9f [0,4194304] 0 2024-02-20T08:06:16.785 INFO:tasks.workunit.client.1.smithi194.stdout:4/685: write d0/d2/f1f [2389528,89684] 0 2024-02-20T08:06:16.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/714: mknod d2/d8/d60/ced 0 2024-02-20T08:06:16.795 INFO:tasks.workunit.client.1.smithi194.stdout:6/833: mkdir df/dab/d1d/d28/d46/d5a/d7d/dd4/d116 0 2024-02-20T08:06:16.802 INFO:tasks.workunit.client.1.smithi194.stdout:2/747: dread df/d14/d19/d5c/d60/d63/f62 [0,4194304] 0 2024-02-20T08:06:16.805 INFO:tasks.workunit.client.1.smithi194.stdout:8/666: creat d2/dd9/fed x:0 0 0 2024-02-20T08:06:16.805 INFO:tasks.workunit.client.1.smithi194.stdout:5/769: dread d4/d6/fa [8388608,4194304] 0 2024-02-20T08:06:16.808 INFO:tasks.workunit.client.1.smithi194.stdout:8/667: read d2/d14/d18/d45/d90/f93 [979888,20094] 0 2024-02-20T08:06:16.808 INFO:tasks.workunit.client.1.smithi194.stdout:0/673: mknod d6/d93/dcf/cdc 0 2024-02-20T08:06:16.809 INFO:tasks.workunit.client.1.smithi194.stdout:2/748: dwrite df/fa9 [0,4194304] 0 2024-02-20T08:06:16.812 INFO:tasks.workunit.client.1.smithi194.stdout:2/749: write df/d5b/d61/f8b [107499,102677] 0 2024-02-20T08:06:16.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/770: dread d4/d6/f5e [0,4194304] 0 2024-02-20T08:06:16.831 INFO:tasks.workunit.client.1.smithi194.stdout:5/771: dread d4/d6/dd/d25/f29 [0,4194304] 0 2024-02-20T08:06:16.895 INFO:tasks.workunit.client.1.smithi194.stdout:9/760: link d4/d8b/fd9 d4/d20/d5c/dd0/def/f101 0 2024-02-20T08:06:16.897 INFO:tasks.workunit.client.1.smithi194.stdout:9/761: write d4/d20/d43/f47 [1782681,17138] 0 2024-02-20T08:06:16.897 INFO:tasks.workunit.client.1.smithi194.stdout:4/686: sync 2024-02-20T08:06:16.897 INFO:tasks.workunit.client.1.smithi194.stdout:7/745: sync 2024-02-20T08:06:16.898 INFO:tasks.workunit.client.1.smithi194.stdout:9/762: fdatasync d4/d1b/d90/df0/fff 0 2024-02-20T08:06:16.899 INFO:tasks.workunit.client.1.smithi194.stdout:9/763: chown d4/de/dc4/fcc 0 1 2024-02-20T08:06:16.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/764: chown d4/d37/ddf/d59/cd4 132576623 1 2024-02-20T08:06:16.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/765: chown d4/d37/ddf/d59/c93 0 1 2024-02-20T08:06:16.901 INFO:tasks.workunit.client.1.smithi194.stdout:1/715: write d2/d8/d12/dc9/d26/d3d/d71/f7a [741297,20735] 0 2024-02-20T08:06:16.906 INFO:tasks.workunit.client.1.smithi194.stdout:8/668: mkdir d2/d14/d18/d45/d7b/dc7/d78/dbc/dee 0 2024-02-20T08:06:16.907 INFO:tasks.workunit.client.1.smithi194.stdout:8/669: dread d2/d14/d18/d45/d7b/dc7/d78/d98/f81 [0,4194304] 0 2024-02-20T08:06:16.909 INFO:tasks.workunit.client.1.smithi194.stdout:2/750: rename df/d14/d19/d5c/d60/d63/l68 to df/d14/d24/d56/le6 0 2024-02-20T08:06:16.909 INFO:tasks.workunit.client.1.smithi194.stdout:2/751: readlink df/l59 0 2024-02-20T08:06:16.910 INFO:tasks.workunit.client.1.smithi194.stdout:2/752: truncate df/d5b/d61/fbd 782634 0 2024-02-20T08:06:16.911 INFO:tasks.workunit.client.1.smithi194.stdout:2/753: chown df/d14/d24/c82 3051 1 2024-02-20T08:06:16.913 INFO:tasks.workunit.client.1.smithi194.stdout:4/687: creat d0/df/d41/fc7 x:0 0 0 2024-02-20T08:06:16.914 INFO:tasks.workunit.client.1.smithi194.stdout:7/746: write d11/d2d/d38/d4a/d53/da0/fbc [400805,11019] 0 2024-02-20T08:06:16.915 INFO:tasks.workunit.client.1.smithi194.stdout:7/747: fsync d11/d2d/d38/d37/d43/d8e/f5d 0 2024-02-20T08:06:16.916 INFO:tasks.workunit.client.1.smithi194.stdout:7/748: chown d11/d2d/d38/d4a/d53/l66 83 1 2024-02-20T08:06:16.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/766: symlink d4/d37/ddf/d42/d4e/d6e/l102 0 2024-02-20T08:06:16.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/767: stat d4/d20/d41/l6b 0 2024-02-20T08:06:16.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/768: chown d4/ca1 6 1 2024-02-20T08:06:16.919 INFO:tasks.workunit.client.1.smithi194.stdout:1/716: write d2/d48/fd9 [717395,79575] 0 2024-02-20T08:06:16.923 INFO:tasks.workunit.client.1.smithi194.stdout:0/674: creat d6/d2b/d35/d9c/dd0/fdd x:0 0 0 2024-02-20T08:06:16.924 INFO:tasks.workunit.client.1.smithi194.stdout:3/733: link d5/df/d30/f36 d5/d10/d28/d41/fe1 0 2024-02-20T08:06:16.925 INFO:tasks.workunit.client.1.smithi194.stdout:8/670: mknod d2/d80/cef 0 2024-02-20T08:06:16.926 INFO:tasks.workunit.client.1.smithi194.stdout:1/717: dwrite d2/d8/d12/dc9/d61/d68/f89 [0,4194304] 0 2024-02-20T08:06:16.927 INFO:tasks.workunit.client.1.smithi194.stdout:3/734: write d5/d10/d28/dd3/f71 [138520,31830] 0 2024-02-20T08:06:16.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/772: dwrite d4/d6/dd/d25/d78/d8b/f89 [0,4194304] 0 2024-02-20T08:06:16.931 INFO:tasks.workunit.client.1.smithi194.stdout:9/769: symlink d4/d20/d43/d51/d6a/l103 0 2024-02-20T08:06:16.935 INFO:tasks.workunit.client.1.smithi194.stdout:6/834: link df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/c10e df/dab/d1d/d28/d46/d5a/d6b/d83/d93/c117 0 2024-02-20T08:06:16.935 INFO:tasks.workunit.client.1.smithi194.stdout:2/754: mknod df/d14/d19/d5c/d60/d63/ce7 0 2024-02-20T08:06:16.940 INFO:tasks.workunit.client.1.smithi194.stdout:3/735: creat d5/d10/d16/d7b/fe2 x:0 0 0 2024-02-20T08:06:16.940 INFO:tasks.workunit.client.1.smithi194.stdout:2/755: readlink df/d14/d24/d56/da2/ldf 0 2024-02-20T08:06:16.941 INFO:tasks.workunit.client.1.smithi194.stdout:4/688: unlink d0/d10/d1c/d21/fb8 0 2024-02-20T08:06:16.945 INFO:tasks.workunit.client.1.smithi194.stdout:3/736: creat d5/d10/d28/d41/d73/d8c/fe3 x:0 0 0 2024-02-20T08:06:16.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/671: dwrite d2/d80/dd1/fe2 [0,4194304] 0 2024-02-20T08:06:16.945 INFO:tasks.workunit.client.1.smithi194.stdout:1/718: dwrite d2/d8/d12/dc9/fc0 [0,4194304] 0 2024-02-20T08:06:16.948 INFO:tasks.workunit.client.1.smithi194.stdout:0/675: creat d6/d2b/d35/d39/d55/fde x:0 0 0 2024-02-20T08:06:16.951 INFO:tasks.workunit.client.1.smithi194.stdout:8/672: mknod d2/d14/d18/d45/d90/d92/cf0 0 2024-02-20T08:06:16.956 INFO:tasks.workunit.client.1.smithi194.stdout:4/689: creat d0/d2/fc8 x:0 0 0 2024-02-20T08:06:16.958 INFO:tasks.workunit.client.1.smithi194.stdout:0/676: chown d6/d2b/d35/d42/l10 177 1 2024-02-20T08:06:16.959 INFO:tasks.workunit.client.1.smithi194.stdout:3/737: dwrite d5/d10/d17/d1d/f6b [0,4194304] 0 2024-02-20T08:06:16.959 INFO:tasks.workunit.client.1.smithi194.stdout:1/719: dread d2/d8/d12/dc9/d26/d3d/d71/d8c/f46 [0,4194304] 0 2024-02-20T08:06:16.966 INFO:tasks.workunit.client.1.smithi194.stdout:0/677: stat d6/d2b/d35/f53 0 2024-02-20T08:06:16.971 INFO:tasks.workunit.client.1.smithi194.stdout:0/678: read d6/d2b/d35/fae [150697,12741] 0 2024-02-20T08:06:16.973 INFO:tasks.workunit.client.1.smithi194.stdout:9/770: rename d4/d20/d43/d51/d6a to d4/d20/d43/daa/dcb/d104 0 2024-02-20T08:06:16.976 INFO:tasks.workunit.client.1.smithi194.stdout:9/771: chown d4/d37/ddf/d59/c93 28 1 2024-02-20T08:06:16.976 INFO:tasks.workunit.client.1.smithi194.stdout:6/835: dread df/d18/f77 [4194304,4194304] 0 2024-02-20T08:06:16.976 INFO:tasks.workunit.client.1.smithi194.stdout:0/679: mknod d6/d2b/d35/d42/d1e/d3c/cdf 0 2024-02-20T08:06:16.977 INFO:tasks.workunit.client.1.smithi194.stdout:4/690: dwrite d0/d2/f35 [4194304,4194304] 0 2024-02-20T08:06:16.978 INFO:tasks.workunit.client.1.smithi194.stdout:9/772: mknod d4/d20/d41/c105 0 2024-02-20T08:06:16.980 INFO:tasks.workunit.client.1.smithi194.stdout:3/738: rename d5/d10/d16/d7b/d94/c9c to d5/ce4 0 2024-02-20T08:06:16.982 INFO:tasks.workunit.client.1.smithi194.stdout:4/691: dread d0/d10/f22 [4194304,4194304] 0 2024-02-20T08:06:16.984 INFO:tasks.workunit.client.1.smithi194.stdout:2/756: dread df/f72 [0,4194304] 0 2024-02-20T08:06:16.996 INFO:tasks.workunit.client.1.smithi194.stdout:3/739: rmdir d5/d10/d17/dc2 39 2024-02-20T08:06:16.996 INFO:tasks.workunit.client.1.smithi194.stdout:5/773: truncate d4/d20/d2b/d79/f81 7602336 0 2024-02-20T08:06:16.998 INFO:tasks.workunit.client.1.smithi194.stdout:8/673: write d2/d14/f2c [745079,114122] 0 2024-02-20T08:06:16.998 INFO:tasks.workunit.client.1.smithi194.stdout:2/757: chown df/d14/d19/l42 4887947 1 2024-02-20T08:06:16.999 INFO:tasks.workunit.client.1.smithi194.stdout:0/680: creat d6/d2b/d35/d42/fe0 x:0 0 0 2024-02-20T08:06:17.000 INFO:tasks.workunit.client.1.smithi194.stdout:3/740: symlink d5/d10/d16/d7b/le5 0 2024-02-20T08:06:17.003 INFO:tasks.workunit.client.1.smithi194.stdout:5/774: mkdir d4/d6/d11/d2f/dee 0 2024-02-20T08:06:17.007 INFO:tasks.workunit.client.1.smithi194.stdout:0/681: creat d6/d2b/d35/d9c/d62/fe1 x:0 0 0 2024-02-20T08:06:17.008 INFO:tasks.workunit.client.1.smithi194.stdout:1/720: dwrite d2/d8/d12/dc9/d26/d45/f6e [0,4194304] 0 2024-02-20T08:06:17.009 INFO:tasks.workunit.client.1.smithi194.stdout:4/692: dwrite d0/d10/d1c/d4d/d2f/f3a [8388608,4194304] 0 2024-02-20T08:06:17.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/674: chown d2/d14/d18/d45/d4e/dbe/dc3/fc8 2964307 1 2024-02-20T08:06:17.011 INFO:tasks.workunit.client.1.smithi194.stdout:2/758: rename df/d14/d80/d85/db8/fe1 to df/d14/d19/d5c/d78/fe8 0 2024-02-20T08:06:17.015 INFO:tasks.workunit.client.1.smithi194.stdout:4/693: write d0/d10/d1c/d4d/d2f/f31 [8443406,78151] 0 2024-02-20T08:06:17.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/759: creat df/d3a/fe9 x:0 0 0 2024-02-20T08:06:17.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/694: mkdir d0/df/d72/dc9 0 2024-02-20T08:06:17.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/760: fdatasync df/d14/d19/d5c/d60/f7f 0 2024-02-20T08:06:17.022 INFO:tasks.workunit.client.1.smithi194.stdout:3/741: write d5/d10/d16/f5a [4904075,95677] 0 2024-02-20T08:06:17.022 INFO:tasks.workunit.client.1.smithi194.stdout:5/775: dwrite d4/d6/dd/d3a/fd6 [0,4194304] 0 2024-02-20T08:06:17.025 INFO:tasks.workunit.client.1.smithi194.stdout:9/773: dread d4/d37/dab/fce [0,4194304] 0 2024-02-20T08:06:17.031 INFO:tasks.workunit.client.1.smithi194.stdout:7/749: sync 2024-02-20T08:06:17.033 INFO:tasks.workunit.client.1.smithi194.stdout:1/721: dwrite d2/d8/d12/dc9/d61/fa9 [0,4194304] 0 2024-02-20T08:06:17.034 INFO:tasks.workunit.client.1.smithi194.stdout:9/774: dwrite d4/d8b/fa4 [0,4194304] 0 2024-02-20T08:06:17.035 INFO:tasks.workunit.client.1.smithi194.stdout:7/750: write d11/d2d/d38/d37/d3c/fc7 [3072593,52547] 0 2024-02-20T08:06:17.036 INFO:tasks.workunit.client.1.smithi194.stdout:9/775: chown d4/d37/d38/c9b 442 1 2024-02-20T08:06:17.037 INFO:tasks.workunit.client.1.smithi194.stdout:3/742: symlink d5/d10/d16/d7b/le6 0 2024-02-20T08:06:17.045 INFO:tasks.workunit.client.1.smithi194.stdout:0/682: unlink d6/d2b/d35/d42/d1e/d45/d58/f9e 0 2024-02-20T08:06:17.047 INFO:tasks.workunit.client.1.smithi194.stdout:3/743: dread d5/d10/d28/dd3/f71 [0,4194304] 0 2024-02-20T08:06:17.047 INFO:tasks.workunit.client.1.smithi194.stdout:8/675: creat d2/d14/ff1 x:0 0 0 2024-02-20T08:06:17.051 INFO:tasks.workunit.client.1.smithi194.stdout:0/683: write d6/d2b/d35/d9c/d62/fe1 [702848,65604] 0 2024-02-20T08:06:17.051 INFO:tasks.workunit.client.1.smithi194.stdout:9/776: dwrite d4/d20/d5c/f31 [0,4194304] 0 2024-02-20T08:06:17.052 INFO:tasks.workunit.client.1.smithi194.stdout:5/776: rmdir d4/d6/dd/d99/dcb 0 2024-02-20T08:06:17.053 INFO:tasks.workunit.client.1.smithi194.stdout:9/777: truncate d4/d55/fc0 140160 0 2024-02-20T08:06:17.054 INFO:tasks.workunit.client.1.smithi194.stdout:2/761: getdents df/d14/d24/d56/d6b 0 2024-02-20T08:06:17.055 INFO:tasks.workunit.client.1.smithi194.stdout:3/744: symlink d5/d10/d16/d7b/d94/le7 0 2024-02-20T08:06:17.056 INFO:tasks.workunit.client.1.smithi194.stdout:3/745: write d5/fe [4182071,33709] 0 2024-02-20T08:06:17.058 INFO:tasks.workunit.client.1.smithi194.stdout:4/695: truncate d0/d10/d1c/d21/d46/f99 94601 0 2024-02-20T08:06:17.058 INFO:tasks.workunit.client.1.smithi194.stdout:6/836: sync 2024-02-20T08:06:17.060 INFO:tasks.workunit.client.1.smithi194.stdout:7/751: rename d11/d2d/d38/d37/d43/d8e/d5e to d11/d2d/d38/d37/d43/de7 0 2024-02-20T08:06:17.060 INFO:tasks.workunit.client.1.smithi194.stdout:3/746: dread - d5/d10/d28/d41/fc0 zero size 2024-02-20T08:06:17.061 INFO:tasks.workunit.client.1.smithi194.stdout:9/778: mknod d4/d1b/d90/c106 0 2024-02-20T08:06:17.062 INFO:tasks.workunit.client.1.smithi194.stdout:1/722: getdents d2/d8/d12/dc9/d26/d45/d98/dc6 0 2024-02-20T08:06:17.063 INFO:tasks.workunit.client.1.smithi194.stdout:0/684: rename d6/dda to d6/dbe/de2 0 2024-02-20T08:06:17.064 INFO:tasks.workunit.client.1.smithi194.stdout:3/747: dread - d5/d10/fc5 zero size 2024-02-20T08:06:17.064 INFO:tasks.workunit.client.1.smithi194.stdout:9/779: chown d4/de/f96 8079115 1 2024-02-20T08:06:17.065 INFO:tasks.workunit.client.1.smithi194.stdout:4/696: getdents d0/d10 0 2024-02-20T08:06:17.066 INFO:tasks.workunit.client.1.smithi194.stdout:7/752: creat d11/d2d/d38/d4a/d27/d51/d77/de2/fe8 x:0 0 0 2024-02-20T08:06:17.068 INFO:tasks.workunit.client.1.smithi194.stdout:2/762: dwrite df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:17.068 INFO:tasks.workunit.client.1.smithi194.stdout:2/763: chown df/d14 3061032 1 2024-02-20T08:06:17.071 INFO:tasks.workunit.client.1.smithi194.stdout:5/777: rename d4/d6/d11/d2f/fbf to d4/d6/dd/fef 0 2024-02-20T08:06:17.072 INFO:tasks.workunit.client.1.smithi194.stdout:9/780: fdatasync d4/d20/fb9 0 2024-02-20T08:06:17.081 INFO:tasks.workunit.client.1.smithi194.stdout:5/778: unlink d4/d6/da5/lb9 0 2024-02-20T08:06:17.082 INFO:tasks.workunit.client.1.smithi194.stdout:2/764: dread df/d14/f4c [0,4194304] 0 2024-02-20T08:06:17.082 INFO:tasks.workunit.client.1.smithi194.stdout:5/779: dread - d4/d20/d2b/ddf/db6/fde zero size 2024-02-20T08:06:17.086 INFO:tasks.workunit.client.1.smithi194.stdout:7/753: rmdir d11/d2d/d38/d37/d43/d7b/dc5/dc8 0 2024-02-20T08:06:17.087 INFO:tasks.workunit.client.1.smithi194.stdout:4/697: dread d0/df/d41/d69/f91 [0,4194304] 0 2024-02-20T08:06:17.092 INFO:tasks.workunit.client.1.smithi194.stdout:1/723: rename d2/d8/fb to d2/d8/d12/dc9/d26/fee 0 2024-02-20T08:06:17.092 INFO:tasks.workunit.client.1.smithi194.stdout:5/780: mkdir d4/d6/dd/d25/d7d/dcd/df0 0 2024-02-20T08:06:17.093 INFO:tasks.workunit.client.1.smithi194.stdout:7/754: dwrite d11/d2d/d38/d37/d43/de7/f9f [0,4194304] 0 2024-02-20T08:06:17.098 INFO:tasks.workunit.client.1.smithi194.stdout:1/724: readlink d2/d8/d60/l88 0 2024-02-20T08:06:17.098 INFO:tasks.workunit.client.1.smithi194.stdout:7/755: creat d11/d2d/d38/d37/d43/d7b/d91/fe9 x:0 0 0 2024-02-20T08:06:17.098 INFO:tasks.workunit.client.1.smithi194.stdout:3/748: dread d5/df/f67 [4194304,4194304] 0 2024-02-20T08:06:17.100 INFO:tasks.workunit.client.1.smithi194.stdout:1/725: fsync d2/d8/d12/dc9/d26/d45/f6e 0 2024-02-20T08:06:17.101 INFO:tasks.workunit.client.1.smithi194.stdout:9/781: getdents d4/d20/d41 0 2024-02-20T08:06:17.104 INFO:tasks.workunit.client.1.smithi194.stdout:4/698: mknod d0/d2/cca 0 2024-02-20T08:06:17.104 INFO:tasks.workunit.client.1.smithi194.stdout:2/765: dread df/d14/d24/f6c [0,4194304] 0 2024-02-20T08:06:17.105 INFO:tasks.workunit.client.1.smithi194.stdout:4/699: fdatasync d0/d5c/f7c 0 2024-02-20T08:06:17.105 INFO:tasks.workunit.client.1.smithi194.stdout:7/756: dread d11/d2d/d38/d37/d43/de7/f9f [0,4194304] 0 2024-02-20T08:06:17.106 INFO:tasks.workunit.client.1.smithi194.stdout:4/700: chown d0/df/d41/f77 24449 1 2024-02-20T08:06:17.107 INFO:tasks.workunit.client.1.smithi194.stdout:2/766: truncate df/d5b/d61/fe4 414233 0 2024-02-20T08:06:17.108 INFO:tasks.workunit.client.1.smithi194.stdout:3/749: mkdir d5/d10/d28/d41/d73/d8c/de8 0 2024-02-20T08:06:17.110 INFO:tasks.workunit.client.1.smithi194.stdout:9/782: dread d4/de/f6d [4194304,4194304] 0 2024-02-20T08:06:17.111 INFO:tasks.workunit.client.1.smithi194.stdout:1/726: truncate d2/d8/d12/dc9/d26/f53 648340 0 2024-02-20T08:06:17.113 INFO:tasks.workunit.client.1.smithi194.stdout:7/757: rmdir d11/d2d/d38/d4a 39 2024-02-20T08:06:17.113 INFO:tasks.workunit.client.1.smithi194.stdout:3/750: dread d5/d10/d17/d1d/d3d/f91 [0,4194304] 0 2024-02-20T08:06:17.114 INFO:tasks.workunit.client.1.smithi194.stdout:3/751: chown d5/d10/d62/c6a 9920695 1 2024-02-20T08:06:17.115 INFO:tasks.workunit.client.1.smithi194.stdout:4/701: mknod d0/df/d41/d69/daa/ccb 0 2024-02-20T08:06:17.115 INFO:tasks.workunit.client.1.smithi194.stdout:2/767: rmdir df/d14/d24/d56/d6b/d9e 39 2024-02-20T08:06:17.119 INFO:tasks.workunit.client.1.smithi194.stdout:1/727: write d2/d8/d12/dc9/d26/fe3 [8219849,113778] 0 2024-02-20T08:06:17.120 INFO:tasks.workunit.client.1.smithi194.stdout:9/783: mkdir d4/d1b/d107 0 2024-02-20T08:06:17.121 INFO:tasks.workunit.client.1.smithi194.stdout:7/758: mkdir d11/d2d/d38/d4a/d60/dea 0 2024-02-20T08:06:17.123 INFO:tasks.workunit.client.1.smithi194.stdout:7/759: chown d11/d6e/c72 53218 1 2024-02-20T08:06:17.123 INFO:tasks.workunit.client.1.smithi194.stdout:2/768: dwrite df/d14/d80/d85/f86 [4194304,4194304] 0 2024-02-20T08:06:17.133 INFO:tasks.workunit.client.1.smithi194.stdout:4/702: dread d0/f7f [0,4194304] 0 2024-02-20T08:06:17.138 INFO:tasks.workunit.client.1.smithi194.stdout:4/703: dwrite d0/d10/d1c/d4d/f90 [0,4194304] 0 2024-02-20T08:06:17.140 INFO:tasks.workunit.client.1.smithi194.stdout:3/752: rename d5/df/d9a/ld5 to d5/df/d30/d80/le9 0 2024-02-20T08:06:17.142 INFO:tasks.workunit.client.1.smithi194.stdout:9/784: mknod d4/d37/ddf/d42/c108 0 2024-02-20T08:06:17.143 INFO:tasks.workunit.client.1.smithi194.stdout:9/785: write d4/d20/d41/db6/ff5 [711883,49840] 0 2024-02-20T08:06:17.149 INFO:tasks.workunit.client.1.smithi194.stdout:1/728: rename d2/d8/d12/dc9/d61/d7d/dbf/lc4 to d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/lef 0 2024-02-20T08:06:17.150 INFO:tasks.workunit.client.1.smithi194.stdout:1/729: write d2/d8/d12/dc9/fc0 [5060020,117499] 0 2024-02-20T08:06:17.150 INFO:tasks.workunit.client.1.smithi194.stdout:3/753: fsync d5/d10/d17/dc2/fc4 0 2024-02-20T08:06:17.152 INFO:tasks.workunit.client.1.smithi194.stdout:1/730: stat d2/d8/d12/dc9/d61/d68/db7/fc8 0 2024-02-20T08:06:17.153 INFO:tasks.workunit.client.1.smithi194.stdout:9/786: rmdir d4/d1b/d79 39 2024-02-20T08:06:17.153 INFO:tasks.workunit.client.1.smithi194.stdout:9/787: fsync d4/d1b/fdb 0 2024-02-20T08:06:17.154 INFO:tasks.workunit.client.1.smithi194.stdout:9/788: readlink d4/d1b/d2e/lbc 0 2024-02-20T08:06:17.155 INFO:tasks.workunit.client.1.smithi194.stdout:9/789: dread - d4/d37/d38/fe4 zero size 2024-02-20T08:06:17.155 INFO:tasks.workunit.client.1.smithi194.stdout:9/790: dread - d4/d37/ddf/d59/ff3 zero size 2024-02-20T08:06:17.160 INFO:tasks.workunit.client.1.smithi194.stdout:2/769: creat df/d14/d19/d5c/d60/fea x:0 0 0 2024-02-20T08:06:17.160 INFO:tasks.workunit.client.1.smithi194.stdout:2/770: stat df/d5b 0 2024-02-20T08:06:17.161 INFO:tasks.workunit.client.1.smithi194.stdout:1/731: symlink d2/d8/d60/d75/lf0 0 2024-02-20T08:06:17.163 INFO:tasks.workunit.client.1.smithi194.stdout:9/791: chown d4/d1b/d79 1850 1 2024-02-20T08:06:17.163 INFO:tasks.workunit.client.1.smithi194.stdout:8/676: sync 2024-02-20T08:06:17.164 INFO:tasks.workunit.client.1.smithi194.stdout:7/760: rename d11/d2d/d38/d4a/d93/le1 to d11/d2d/d38/d4a/d93/d9a/leb 0 2024-02-20T08:06:17.165 INFO:tasks.workunit.client.1.smithi194.stdout:8/677: write d2/d14/d18/d45/d7b/dc0/fdb [471917,115754] 0 2024-02-20T08:06:17.165 INFO:tasks.workunit.client.1.smithi194.stdout:3/754: mkdir d5/d10/d28/dd3/db7/dea 0 2024-02-20T08:06:17.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/761: chown d11/d2d/d38/d4a/d27/f2b 122525 1 2024-02-20T08:06:17.167 INFO:tasks.workunit.client.1.smithi194.stdout:4/704: mkdir d0/d2/d3e/dcc 0 2024-02-20T08:06:17.170 INFO:tasks.workunit.client.1.smithi194.stdout:9/792: creat d4/d37/ddf/d42/d4e/d6e/f109 x:0 0 0 2024-02-20T08:06:17.171 INFO:tasks.workunit.client.1.smithi194.stdout:2/771: dwrite df/d14/d19/d5c/d78/fe8 [0,4194304] 0 2024-02-20T08:06:17.172 INFO:tasks.workunit.client.1.smithi194.stdout:8/678: creat d2/d14/d18/d45/d90/ff2 x:0 0 0 2024-02-20T08:06:17.205 INFO:tasks.workunit.client.1.smithi194.stdout:8/679: mkdir d2/d14/d18/d45/d7b/dc0/df3 0 2024-02-20T08:06:17.206 INFO:tasks.workunit.client.1.smithi194.stdout:1/732: write d2/d8/d12/dc9/d26/d3d/d71/f66 [239047,6223] 0 2024-02-20T08:06:17.206 INFO:tasks.workunit.client.1.smithi194.stdout:7/762: symlink d11/d2d/d38/d95/lec 0 2024-02-20T08:06:17.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/680: write d2/d80/fda [4256754,67757] 0 2024-02-20T08:06:17.208 INFO:tasks.workunit.client.1.smithi194.stdout:3/755: creat d5/d10/d17/feb x:0 0 0 2024-02-20T08:06:17.212 INFO:tasks.workunit.client.1.smithi194.stdout:8/681: readlink d2/d14/d18/d45/d4e/dbe/dc3/le1 0 2024-02-20T08:06:17.214 INFO:tasks.workunit.client.1.smithi194.stdout:2/772: getdents df/d14/d80/d85 0 2024-02-20T08:06:17.215 INFO:tasks.workunit.client.1.smithi194.stdout:8/682: write d2/d14/d18/fcf [2248964,28468] 0 2024-02-20T08:06:17.217 INFO:tasks.workunit.client.1.smithi194.stdout:9/793: dread d4/d20/fbe [0,4194304] 0 2024-02-20T08:06:17.217 INFO:tasks.workunit.client.1.smithi194.stdout:2/773: chown df/d14/d19/d5c/d60/d63/d92/l9b 0 1 2024-02-20T08:06:17.219 INFO:tasks.workunit.client.1.smithi194.stdout:7/763: dwrite d11/d2d/d38/d4a/d53/fb3 [0,4194304] 0 2024-02-20T08:06:17.220 INFO:tasks.workunit.client.1.smithi194.stdout:8/683: mknod d2/d14/d18/d45/d7b/dc7/cf4 0 2024-02-20T08:06:17.226 INFO:tasks.workunit.client.1.smithi194.stdout:9/794: creat d4/d20/d5c/dd0/def/f10a x:0 0 0 2024-02-20T08:06:17.227 INFO:tasks.workunit.client.1.smithi194.stdout:8/684: creat d2/d14/d18/d45/d4e/d9f/ff5 x:0 0 0 2024-02-20T08:06:17.227 INFO:tasks.workunit.client.1.smithi194.stdout:9/795: chown d4/d37/dab 119 1 2024-02-20T08:06:17.232 INFO:tasks.workunit.client.1.smithi194.stdout:3/756: dread d5/d10/d28/f53 [0,4194304] 0 2024-02-20T08:06:17.232 INFO:tasks.workunit.client.1.smithi194.stdout:9/796: symlink d4/d37/d4f/l10b 0 2024-02-20T08:06:17.232 INFO:tasks.workunit.client.1.smithi194.stdout:9/797: dread - d4/d37/ddf/d42/d4e/fda zero size 2024-02-20T08:06:17.232 INFO:tasks.workunit.client.1.smithi194.stdout:9/798: dread - d4/d37/d38/fb1 zero size 2024-02-20T08:06:17.234 INFO:tasks.workunit.client.1.smithi194.stdout:8/685: link d2/f9e d2/d14/d18/d45/d69/daf/ff6 0 2024-02-20T08:06:17.234 INFO:tasks.workunit.client.1.smithi194.stdout:3/757: symlink d5/d10/d62/db2/lec 0 2024-02-20T08:06:17.236 INFO:tasks.workunit.client.1.smithi194.stdout:9/799: mknod d4/d1b/d90/df0/c10c 0 2024-02-20T08:06:17.236 INFO:tasks.workunit.client.1.smithi194.stdout:9/800: chown d4/d20/d43 30 1 2024-02-20T08:06:17.238 INFO:tasks.workunit.client.1.smithi194.stdout:8/686: creat d2/d14/d18/d45/d4e/d9f/ff7 x:0 0 0 2024-02-20T08:06:17.239 INFO:tasks.workunit.client.1.smithi194.stdout:3/758: rename d5/d10/d17/d1d/d3d to d5/d10/d28/d41/d73/d8c/da6/ded 0 2024-02-20T08:06:17.240 INFO:tasks.workunit.client.1.smithi194.stdout:8/687: write d2/d14/d18/d45/d7b/dc7/d78/f87 [342504,102594] 0 2024-02-20T08:06:17.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/759: unlink d5/d10/d8d/f92 0 2024-02-20T08:06:17.246 INFO:tasks.workunit.client.1.smithi194.stdout:7/764: dread d11/d2d/d38/f22 [0,4194304] 0 2024-02-20T08:06:17.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/688: creat d2/db5/ff8 x:0 0 0 2024-02-20T08:06:17.248 INFO:tasks.workunit.client.1.smithi194.stdout:2/774: dread df/d14/d19/d5c/d97/d9a/fa3 [0,4194304] 0 2024-02-20T08:06:17.248 INFO:tasks.workunit.client.1.smithi194.stdout:7/765: readlink d11/d2d/d38/d4a/l19 0 2024-02-20T08:06:17.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/775: write df/d3a/f53 [1428243,64133] 0 2024-02-20T08:06:17.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/689: write d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 [109200,112626] 0 2024-02-20T08:06:17.252 INFO:tasks.workunit.client.1.smithi194.stdout:9/801: write d4/d20/d5c/f3e [1843197,120121] 0 2024-02-20T08:06:17.255 INFO:tasks.workunit.client.1.smithi194.stdout:7/766: truncate d11/d2d/d38/d37/d43/d7b/d91/fe9 363969 0 2024-02-20T08:06:17.256 INFO:tasks.workunit.client.1.smithi194.stdout:2/776: dread df/f4f [4194304,4194304] 0 2024-02-20T08:06:17.258 INFO:tasks.workunit.client.1.smithi194.stdout:2/777: read - df/d14/d19/d5c/fd5 zero size 2024-02-20T08:06:17.262 INFO:tasks.workunit.client.1.smithi194.stdout:8/690: unlink d2/d14/d18/d45/d90/f93 0 2024-02-20T08:06:17.262 INFO:tasks.workunit.client.1.smithi194.stdout:3/760: dread d5/d10/d28/d41/d73/d8c/fb1 [0,4194304] 0 2024-02-20T08:06:17.268 INFO:tasks.workunit.client.1.smithi194.stdout:9/802: dread d4/d37/d38/faf [0,4194304] 0 2024-02-20T08:06:17.269 INFO:tasks.workunit.client.1.smithi194.stdout:3/761: symlink d5/df/d60/lee 0 2024-02-20T08:06:17.269 INFO:tasks.workunit.client.1.smithi194.stdout:9/803: write d4/d20/d43/f47 [460584,64166] 0 2024-02-20T08:06:17.271 INFO:tasks.workunit.client.1.smithi194.stdout:2/778: write df/d14/d24/f4e [1058120,67205] 0 2024-02-20T08:06:17.272 INFO:tasks.workunit.client.1.smithi194.stdout:6/837: sync 2024-02-20T08:06:17.272 INFO:tasks.workunit.client.1.smithi194.stdout:5/781: sync 2024-02-20T08:06:17.272 INFO:tasks.workunit.client.1.smithi194.stdout:4/705: sync 2024-02-20T08:06:17.272 INFO:tasks.workunit.client.1.smithi194.stdout:0/685: sync 2024-02-20T08:06:17.273 INFO:tasks.workunit.client.1.smithi194.stdout:5/782: write d4/d6/f7c [2535010,2246] 0 2024-02-20T08:06:17.274 INFO:tasks.workunit.client.1.smithi194.stdout:0/686: write d6/dbe/fd7 [879005,126698] 0 2024-02-20T08:06:17.277 INFO:tasks.workunit.client.1.smithi194.stdout:9/804: fdatasync d4/d20/fb9 0 2024-02-20T08:06:17.277 INFO:tasks.workunit.client.1.smithi194.stdout:5/783: read d4/fc [3005382,122526] 0 2024-02-20T08:06:17.277 INFO:tasks.workunit.client.1.smithi194.stdout:0/687: read d6/f90 [3902883,49946] 0 2024-02-20T08:06:17.279 INFO:tasks.workunit.client.1.smithi194.stdout:2/779: rename df/d5b/fc7 to df/d14/d80/feb 0 2024-02-20T08:06:17.281 INFO:tasks.workunit.client.1.smithi194.stdout:2/780: truncate df/d14/d19/d5c/d78/f90 477398 0 2024-02-20T08:06:17.281 INFO:tasks.workunit.client.1.smithi194.stdout:2/781: fdatasync df/d14/d24/f4e 0 2024-02-20T08:06:17.285 INFO:tasks.workunit.client.1.smithi194.stdout:8/691: dread d2/d14/f6a [0,4194304] 0 2024-02-20T08:06:17.292 INFO:tasks.workunit.client.1.smithi194.stdout:7/767: getdents d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb 0 2024-02-20T08:06:17.292 INFO:tasks.workunit.client.1.smithi194.stdout:5/784: creat d4/d6/da5/ff1 x:0 0 0 2024-02-20T08:06:17.294 INFO:tasks.workunit.client.1.smithi194.stdout:3/762: truncate d5/df/f64 1616153 0 2024-02-20T08:06:17.295 INFO:tasks.workunit.client.1.smithi194.stdout:9/805: creat d4/d1b/d2e/de0/f10d x:0 0 0 2024-02-20T08:06:17.295 INFO:tasks.workunit.client.1.smithi194.stdout:9/806: chown d4/d20/d41 61 1 2024-02-20T08:06:17.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/692: mknod d2/d14/d18/d45/d69/d9b/cf9 0 2024-02-20T08:06:17.302 INFO:tasks.workunit.client.1.smithi194.stdout:9/807: dwrite d4/d20/fbe [4194304,4194304] 0 2024-02-20T08:06:17.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/808: chown d4/d20/d5c/f46 0 1 2024-02-20T08:06:17.305 INFO:tasks.workunit.client.1.smithi194.stdout:6/838: truncate df/f92 19657 0 2024-02-20T08:06:17.309 INFO:tasks.workunit.client.1.smithi194.stdout:0/688: mkdir d6/d2b/d35/d9c/de3 0 2024-02-20T08:06:17.309 INFO:tasks.workunit.client.1.smithi194.stdout:0/689: fsync d6/dbe/fd7 0 2024-02-20T08:06:17.310 INFO:tasks.workunit.client.1.smithi194.stdout:0/690: dread - d6/f88 zero size 2024-02-20T08:06:17.311 INFO:tasks.workunit.client.1.smithi194.stdout:3/763: mkdir d5/d10/d28/dd3/db7/def 0 2024-02-20T08:06:17.314 INFO:tasks.workunit.client.1.smithi194.stdout:4/706: creat d0/df/fcd x:0 0 0 2024-02-20T08:06:17.315 INFO:tasks.workunit.client.1.smithi194.stdout:8/693: creat d2/d14/d18/d45/d4e/d9f/ffa x:0 0 0 2024-02-20T08:06:17.316 INFO:tasks.workunit.client.1.smithi194.stdout:8/694: fdatasync d2/d80/fbb 0 2024-02-20T08:06:17.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/695: readlink d2/d14/d18/d45/d4e/dbe/dc3/lcb 0 2024-02-20T08:06:17.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/785: write d4/d20/d2b/d79/f60 [3743103,91324] 0 2024-02-20T08:06:17.319 INFO:tasks.workunit.client.1.smithi194.stdout:8/696: chown d2/d80/fd8 384567972 1 2024-02-20T08:06:17.320 INFO:tasks.workunit.client.1.smithi194.stdout:9/809: rename d4/d1b/d90/df0/fff to d4/d1b/d2e/f10e 0 2024-02-20T08:06:17.320 INFO:tasks.workunit.client.1.smithi194.stdout:9/810: stat d4/de/ca2 0 2024-02-20T08:06:17.322 INFO:tasks.workunit.client.1.smithi194.stdout:8/697: fsync d2/d14/d18/d45/d69/f6f 0 2024-02-20T08:06:17.324 INFO:tasks.workunit.client.1.smithi194.stdout:0/691: creat d6/d93/fe4 x:0 0 0 2024-02-20T08:06:17.326 INFO:tasks.workunit.client.1.smithi194.stdout:3/764: write d5/fa [3938190,126883] 0 2024-02-20T08:06:17.330 INFO:tasks.workunit.client.1.smithi194.stdout:4/707: fsync d0/d10/d1c/d4d/f38 0 2024-02-20T08:06:17.331 INFO:tasks.workunit.client.1.smithi194.stdout:6/839: dread df/d42/d86/fb8 [0,4194304] 0 2024-02-20T08:06:17.334 INFO:tasks.workunit.client.1.smithi194.stdout:3/765: dwrite d5/d10/d28/d41/fd9 [0,4194304] 0 2024-02-20T08:06:17.336 INFO:tasks.workunit.client.1.smithi194.stdout:8/698: creat d2/d14/d18/d45/d69/daf/db3/ffb x:0 0 0 2024-02-20T08:06:17.336 INFO:tasks.workunit.client.1.smithi194.stdout:0/692: fdatasync d6/f88 0 2024-02-20T08:06:17.338 INFO:tasks.workunit.client.1.smithi194.stdout:7/768: dwrite d11/d2d/d38/f28 [0,4194304] 0 2024-02-20T08:06:17.338 INFO:tasks.workunit.client.1.smithi194.stdout:8/699: stat d2/d14/d18/d45/d7b/dc7/f7d 0 2024-02-20T08:06:17.341 INFO:tasks.workunit.client.1.smithi194.stdout:8/700: read - d2/d14/d18/d45/fcd zero size 2024-02-20T08:06:17.342 INFO:tasks.workunit.client.1.smithi194.stdout:8/701: readlink d2/l53 0 2024-02-20T08:06:17.342 INFO:tasks.workunit.client.1.smithi194.stdout:4/708: mknod d0/df/d72/d97/cce 0 2024-02-20T08:06:17.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/769: unlink d11/d2d/d38/d4a/d53/l66 0 2024-02-20T08:06:17.346 INFO:tasks.workunit.client.1.smithi194.stdout:8/702: read d2/d14/d18/f7f [1984603,48656] 0 2024-02-20T08:06:17.348 INFO:tasks.workunit.client.1.smithi194.stdout:5/786: creat d4/d6/dd/d99/ff2 x:0 0 0 2024-02-20T08:06:17.348 INFO:tasks.workunit.client.1.smithi194.stdout:8/703: chown d2/d14/d18/d45/d7b/dc7/d78/d98/f9a 1474675935 1 2024-02-20T08:06:17.349 INFO:tasks.workunit.client.1.smithi194.stdout:8/704: write d2/d14/d18/d45/d90/fb2 [986759,33622] 0 2024-02-20T08:06:17.350 INFO:tasks.workunit.client.1.smithi194.stdout:3/766: mknod d5/d10/d28/dd2/cf0 0 2024-02-20T08:06:17.352 INFO:tasks.workunit.client.1.smithi194.stdout:7/770: dread d11/d6e/f78 [0,4194304] 0 2024-02-20T08:06:17.357 INFO:tasks.workunit.client.1.smithi194.stdout:5/787: rename d4/d6/dd/d25/d78/d8b/c63 to d4/d6/dd/d99/dd1/cf3 0 2024-02-20T08:06:17.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/811: write d4/de/f7b [811113,107832] 0 2024-02-20T08:06:17.360 INFO:tasks.workunit.client.1.smithi194.stdout:4/709: dwrite d0/d10/d1c/d21/d46/f8c [0,4194304] 0 2024-02-20T08:06:17.363 INFO:tasks.workunit.client.1.smithi194.stdout:1/733: sync 2024-02-20T08:06:17.365 INFO:tasks.workunit.client.1.smithi194.stdout:0/693: dwrite d6/d2b/d35/d42/d1e/d45/d58/f8d [4194304,4194304] 0 2024-02-20T08:06:17.375 INFO:tasks.workunit.client.1.smithi194.stdout:3/767: getdents d5/d10/d28/dd3/db7/dea 0 2024-02-20T08:06:17.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/812: mkdir d4/d20/d43/daa/dcb/d104/dd2/d10f 0 2024-02-20T08:06:17.377 INFO:tasks.workunit.client.1.smithi194.stdout:9/813: write d4/d1b/fdb [637757,92065] 0 2024-02-20T08:06:17.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:17 smithi194 ceph-mon[37804]: mgrmap e26: smithi194.pvhorj(active, since 108s), standbys: smithi123.kwyrtl 2024-02-20T08:06:17.416 INFO:tasks.workunit.client.1.smithi194.stdout:7/771: mknod d11/d2d/d38/d4a/d53/ced 0 2024-02-20T08:06:17.416 INFO:tasks.workunit.client.1.smithi194.stdout:6/840: truncate df/dab/d1d/d28/d2b/f51 570040 0 2024-02-20T08:06:17.417 INFO:tasks.workunit.client.1.smithi194.stdout:7/772: read d11/d2d/f8a [805642,86438] 0 2024-02-20T08:06:17.420 INFO:tasks.workunit.client.1.smithi194.stdout:0/694: mkdir d6/d2b/d35/d9c/dd0/de5 0 2024-02-20T08:06:17.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/710: dwrite d0/d10/d1c/d21/d62/f93 [4194304,4194304] 0 2024-02-20T08:06:17.424 INFO:tasks.workunit.client.1.smithi194.stdout:8/705: rmdir d2/d14/d18/d45/d7b/dc7/d78/dbc/dee 0 2024-02-20T08:06:17.429 INFO:tasks.workunit.client.1.smithi194.stdout:9/814: creat d4/de/dc4/f110 x:0 0 0 2024-02-20T08:06:17.430 INFO:tasks.workunit.client.1.smithi194.stdout:1/734: dwrite d2/d8/d12/dc9/d26/d57/f5d [0,4194304] 0 2024-02-20T08:06:17.437 INFO:tasks.workunit.client.1.smithi194.stdout:6/841: symlink df/dab/d1d/d28/d46/d5a/d6b/dcb/l118 0 2024-02-20T08:06:17.438 INFO:tasks.workunit.client.1.smithi194.stdout:2/782: sync 2024-02-20T08:06:17.440 INFO:tasks.workunit.client.1.smithi194.stdout:0/695: creat d6/d2b/d35/d42/d1e/d45/fe6 x:0 0 0 2024-02-20T08:06:17.441 INFO:tasks.workunit.client.1.smithi194.stdout:8/706: creat d2/d14/d18/d45/d4e/d9f/ffc x:0 0 0 2024-02-20T08:06:17.444 INFO:tasks.workunit.client.1.smithi194.stdout:8/707: write d2/d14/d18/d45/d4e/dbe/dc3/fc8 [2250189,108211] 0 2024-02-20T08:06:17.448 INFO:tasks.workunit.client.1.smithi194.stdout:1/735: rename d2/d8/d12/dc9/d26/d45/d98/dc6/fe5 to d2/d8/d60/de0/ff1 0 2024-02-20T08:06:17.449 INFO:tasks.workunit.client.1.smithi194.stdout:1/736: chown d2/d8/d12/dc9/d61/d9f/lac 3693 1 2024-02-20T08:06:17.452 INFO:tasks.workunit.client.1.smithi194.stdout:7/773: chown d11/d2d/d38/d4a/d93 523731441 1 2024-02-20T08:06:17.453 INFO:tasks.workunit.client.1.smithi194.stdout:2/783: symlink df/d3a/lec 0 2024-02-20T08:06:17.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-20T08:06:17.459 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-20T08:06:17.460 INFO:tasks.workunit.client.1.smithi194.stdout:4/711: truncate d0/d10/d1c/d21/f96 1029476 0 2024-02-20T08:06:17.460 INFO:tasks.workunit.client.1.smithi194.stdout:4/712: dread - d0/d5c/fae zero size 2024-02-20T08:06:17.463 INFO:tasks.workunit.client.1.smithi194.stdout:6/842: symlink df/dab/d1d/d28/d2b/l119 0 2024-02-20T08:06:17.466 INFO:tasks.workunit.client.1.smithi194.stdout:3/768: link d5/df/d30/d80/le9 d5/d10/d28/d41/d73/d8c/lf1 0 2024-02-20T08:06:17.468 INFO:tasks.workunit.client.1.smithi194.stdout:8/708: mkdir d2/dfd 0 2024-02-20T08:06:17.472 INFO:tasks.workunit.client.1.smithi194.stdout:8/709: dread - d2/d14/d18/d45/d69/daf/db3/fd0 zero size 2024-02-20T08:06:17.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/696: creat d6/d2b/d35/d9c/fe7 x:0 0 0 2024-02-20T08:06:17.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/769: dwrite d5/d10/d28/d41/f5c [4194304,4194304] 0 2024-02-20T08:06:17.475 INFO:tasks.workunit.client.1.smithi194.stdout:8/710: write d2/d14/d18/d45/d7b/fb6 [795005,84111] 0 2024-02-20T08:06:17.476 INFO:tasks.workunit.client.1.smithi194.stdout:7/774: link d11/d2d/d38/d37/d3c/d8d/fc3 d11/d2d/d38/d37/d3c/fee 0 2024-02-20T08:06:17.476 INFO:tasks.workunit.client.1.smithi194.stdout:3/770: stat d5/df/d25/dcb/cd7 0 2024-02-20T08:06:17.477 INFO:tasks.workunit.client.1.smithi194.stdout:9/815: truncate d4/d8b/fa4 2501754 0 2024-02-20T08:06:17.478 INFO:tasks.workunit.client.1.smithi194.stdout:2/784: getdents df/d14/d19/de3 0 2024-02-20T08:06:17.480 INFO:tasks.workunit.client.1.smithi194.stdout:5/788: sync 2024-02-20T08:06:17.484 INFO:tasks.workunit.client.1.smithi194.stdout:6/843: dread df/d18/f40 [0,4194304] 0 2024-02-20T08:06:17.484 INFO:tasks.workunit.client.1.smithi194.stdout:7/775: mkdir d11/d2d/d38/d4a/d60/def 0 2024-02-20T08:06:17.486 INFO:tasks.workunit.client.1.smithi194.stdout:9/816: creat d4/d1b/d90/df0/f111 x:0 0 0 2024-02-20T08:06:17.487 INFO:tasks.workunit.client.1.smithi194.stdout:4/713: dread d0/d2/f1f [0,4194304] 0 2024-02-20T08:06:17.487 INFO:tasks.workunit.client.1.smithi194.stdout:3/771: dwrite d5/d10/d28/d41/d73/f79 [0,4194304] 0 2024-02-20T08:06:17.487 INFO:tasks.workunit.client.1.smithi194.stdout:5/789: chown d4/d20/d2b/d9b/ddb/l80 855795025 1 2024-02-20T08:06:17.488 INFO:tasks.workunit.client.1.smithi194.stdout:6/844: truncate df/d42/d86/fb4 1066650 0 2024-02-20T08:06:17.489 INFO:tasks.workunit.client.1.smithi194.stdout:2/785: symlink df/d14/d19/d5c/led 0 2024-02-20T08:06:17.490 INFO:tasks.workunit.client.1.smithi194.stdout:2/786: chown df/d14/d19/d5c/d78 37734 1 2024-02-20T08:06:17.490 INFO:tasks.workunit.client.1.smithi194.stdout:7/776: creat d11/d2d/d38/d37/d3c/ff0 x:0 0 0 2024-02-20T08:06:17.492 INFO:tasks.workunit.client.1.smithi194.stdout:9/817: mknod d4/d20/d5c/dd0/def/c112 0 2024-02-20T08:06:17.494 INFO:tasks.workunit.client.1.smithi194.stdout:4/714: creat d0/d2/d51/fcf x:0 0 0 2024-02-20T08:06:17.497 INFO:tasks.workunit.client.1.smithi194.stdout:4/715: fdatasync d0/d5c/d60/d4a/d4e/fa9 0 2024-02-20T08:06:17.498 INFO:tasks.workunit.client.1.smithi194.stdout:1/737: dwrite d2/d8/d12/f43 [0,4194304] 0 2024-02-20T08:06:17.499 INFO:tasks.workunit.client.1.smithi194.stdout:7/777: creat d11/d2d/d38/d37/d3c/dd1/ff1 x:0 0 0 2024-02-20T08:06:17.506 INFO:tasks.workunit.client.1.smithi194.stdout:7/778: mknod d11/d2d/d38/d4a/d53/d81/cf2 0 2024-02-20T08:06:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:17 smithi123 ceph-mon[29383]: mgrmap e26: smithi194.pvhorj(active, since 108s), standbys: smithi123.kwyrtl 2024-02-20T08:06:17.508 INFO:tasks.workunit.client.1.smithi194.stdout:2/787: rename df/d14/d19/d5c/d97/dc8/fc9 to df/fee 0 2024-02-20T08:06:17.512 INFO:tasks.workunit.client.1.smithi194.stdout:4/716: dwrite d0/d10/d1c/d21/d46/fc3 [0,4194304] 0 2024-02-20T08:06:17.519 INFO:tasks.workunit.client.1.smithi194.stdout:8/711: dwrite d2/d14/f34 [0,4194304] 0 2024-02-20T08:06:17.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/712: chown d2/d14/d18/d45/d4e/d9f/ff7 63945573 1 2024-02-20T08:06:17.524 INFO:tasks.workunit.client.1.smithi194.stdout:3/772: dread d5/d10/d17/d1d/f22 [4194304,4194304] 0 2024-02-20T08:06:17.525 INFO:tasks.workunit.client.1.smithi194.stdout:8/713: chown d2/d14/d18/d45/d69/daf/fd7 33 1 2024-02-20T08:06:17.525 INFO:tasks.workunit.client.1.smithi194.stdout:2/788: mknod df/d14/d19/d5c/d60/d63/cef 0 2024-02-20T08:06:17.527 INFO:tasks.workunit.client.1.smithi194.stdout:0/697: dwrite d6/d2b/d35/d42/d1e/f23 [0,4194304] 0 2024-02-20T08:06:17.528 INFO:tasks.workunit.client.1.smithi194.stdout:5/790: truncate d4/d6/fb3 913534 0 2024-02-20T08:06:17.528 INFO:tasks.workunit.client.1.smithi194.stdout:6/845: truncate df/dab/f102 1267403 0 2024-02-20T08:06:17.529 INFO:tasks.workunit.client.1.smithi194.stdout:2/789: readlink df/d14/d19/lab 0 2024-02-20T08:06:17.530 INFO:tasks.workunit.client.1.smithi194.stdout:9/818: dread d4/d37/ddf/d59/f5b [0,4194304] 0 2024-02-20T08:06:17.531 INFO:tasks.workunit.client.1.smithi194.stdout:2/790: chown df/d3a/ce2 44554950 1 2024-02-20T08:06:17.538 INFO:tasks.workunit.client.1.smithi194.stdout:2/791: creat df/d14/d80/ff0 x:0 0 0 2024-02-20T08:06:17.538 INFO:tasks.workunit.client.1.smithi194.stdout:1/738: write d2/d8/d12/dc9/d26/d45/fa6 [432320,98266] 0 2024-02-20T08:06:17.545 INFO:tasks.workunit.client.1.smithi194.stdout:3/773: mkdir d5/d10/df2 0 2024-02-20T08:06:17.546 INFO:tasks.workunit.client.1.smithi194.stdout:5/791: dread d4/d6/d11/d2f/d77/f7a [0,4194304] 0 2024-02-20T08:06:17.546 INFO:tasks.workunit.client.1.smithi194.stdout:0/698: fsync d6/d2b/d35/f38 0 2024-02-20T08:06:17.546 INFO:tasks.workunit.client.1.smithi194.stdout:8/714: mknod d2/d14/d18/d45/d7b/dc0/df3/cfe 0 2024-02-20T08:06:17.548 INFO:tasks.workunit.client.1.smithi194.stdout:6/846: mknod df/dab/d1d/d28/d46/d5a/d6b/c11a 0 2024-02-20T08:06:17.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/717: getdents d0/d10/d1c 0 2024-02-20T08:06:17.551 INFO:tasks.workunit.client.1.smithi194.stdout:1/739: truncate d2/d8/d12/dc9/f1d 4818896 0 2024-02-20T08:06:17.553 INFO:tasks.workunit.client.1.smithi194.stdout:8/715: fsync d2/d14/d18/d45/d69/d9b/fd3 0 2024-02-20T08:06:17.556 INFO:tasks.workunit.client.1.smithi194.stdout:2/792: dwrite f5 [0,4194304] 0 2024-02-20T08:06:17.558 INFO:tasks.workunit.client.1.smithi194.stdout:8/716: truncate d2/f9e 122122 0 2024-02-20T08:06:17.578 INFO:tasks.workunit.client.1.smithi194.stdout:7/779: dread d11/d2d/d38/d4a/f21 [0,4194304] 0 2024-02-20T08:06:17.578 INFO:tasks.workunit.client.1.smithi194.stdout:9/819: dwrite d4/d20/d5c/dd0/def/f101 [0,4194304] 0 2024-02-20T08:06:17.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/820: chown d4/d37/d4f/d91 59654051 1 2024-02-20T08:06:17.586 INFO:tasks.workunit.client.1.smithi194.stdout:7/780: dwrite d11/d2d/d38/d4a/d27/d51/f89 [0,4194304] 0 2024-02-20T08:06:17.588 INFO:tasks.workunit.client.1.smithi194.stdout:0/699: mknod d6/d2b/d35/d42/d1e/d45/daa/ce8 0 2024-02-20T08:06:17.588 INFO:tasks.workunit.client.1.smithi194.stdout:4/718: dread - d0/d2/fc8 zero size 2024-02-20T08:06:17.589 INFO:tasks.workunit.client.1.smithi194.stdout:0/700: chown d6/d2b/c54 62 1 2024-02-20T08:06:17.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/774: rename d5/d10/d28/d41/d73/d8c/da6/ded/d8b to d5/d10/d28/d41/d73/d8c/de8/df3 0 2024-02-20T08:06:17.592 INFO:tasks.workunit.client.1.smithi194.stdout:1/740: creat d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/ff2 x:0 0 0 2024-02-20T08:06:17.594 INFO:tasks.workunit.client.1.smithi194.stdout:3/775: dread d5/d10/d28/d41/d73/d8c/da6/ded/f91 [0,4194304] 0 2024-02-20T08:06:17.594 INFO:tasks.workunit.client.1.smithi194.stdout:6/847: symlink df/dab/d1d/d28/d46/d5a/d7d/dd4/l11b 0 2024-02-20T08:06:17.595 INFO:tasks.workunit.client.1.smithi194.stdout:8/717: creat d2/d14/d18/d45/d7b/dc0/df3/fff x:0 0 0 2024-02-20T08:06:17.596 INFO:tasks.workunit.client.1.smithi194.stdout:8/718: chown d2/d14/d18/d45/d4e/d9f/ff7 11480 1 2024-02-20T08:06:17.598 INFO:tasks.workunit.client.1.smithi194.stdout:9/821: mknod d4/d1b/d79/c113 0 2024-02-20T08:06:17.600 INFO:tasks.workunit.client.1.smithi194.stdout:8/719: read d2/d14/d18/d45/d90/fb2 [2297053,82638] 0 2024-02-20T08:06:17.602 INFO:tasks.workunit.client.1.smithi194.stdout:5/792: unlink d4/d6/d11/d2f/c37 0 2024-02-20T08:06:17.603 INFO:tasks.workunit.client.1.smithi194.stdout:4/719: fdatasync d0/df/d11/f7b 0 2024-02-20T08:06:17.604 INFO:tasks.workunit.client.1.smithi194.stdout:2/793: mkdir df/d14/d19/d5c/d97/df1 0 2024-02-20T08:06:17.605 INFO:tasks.workunit.client.1.smithi194.stdout:4/720: fdatasync d0/d10/d1c/d4d/d2f/f3a 0 2024-02-20T08:06:17.605 INFO:tasks.workunit.client.1.smithi194.stdout:4/721: readlink d0/df/d41/la3 0 2024-02-20T08:06:17.606 INFO:tasks.workunit.client.1.smithi194.stdout:3/776: mkdir d5/d10/d28/d41/df4 0 2024-02-20T08:06:17.606 INFO:tasks.workunit.client.1.smithi194.stdout:4/722: dread - d0/df/fcd zero size 2024-02-20T08:06:17.607 INFO:tasks.workunit.client.1.smithi194.stdout:5/793: read d4/d20/d2b/d79/f60 [346027,111038] 0 2024-02-20T08:06:17.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/822: rename d4/d37/ddf/d42/d4e/d6e/l102 to d4/d20/d41/db7/l114 0 2024-02-20T08:06:17.611 INFO:tasks.workunit.client.1.smithi194.stdout:2/794: dwrite df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:17.614 INFO:tasks.workunit.client.1.smithi194.stdout:0/701: mkdir d6/d2b/d35/d39/d55/de9 0 2024-02-20T08:06:17.615 INFO:tasks.workunit.client.1.smithi194.stdout:4/723: dwrite d0/d10/d1c/d4d/d2f/f31 [0,4194304] 0 2024-02-20T08:06:17.617 INFO:tasks.workunit.client.1.smithi194.stdout:0/702: stat d6/d2b/d35/d42/d1e/d45/daa/ce8 0 2024-02-20T08:06:17.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/741: mknod d2/d8/d12/dc9/d61/d7e/dbe/cf3 0 2024-02-20T08:06:17.617 INFO:tasks.workunit.client.1.smithi194.stdout:3/777: creat d5/df/d75/ff5 x:0 0 0 2024-02-20T08:06:17.623 INFO:tasks.workunit.client.1.smithi194.stdout:7/781: link c10 d11/d2d/d38/d37/d3c/dd1/cf3 0 2024-02-20T08:06:17.626 INFO:tasks.workunit.client.1.smithi194.stdout:2/795: dread df/f72 [0,4194304] 0 2024-02-20T08:06:17.626 INFO:tasks.workunit.client.1.smithi194.stdout:2/796: readlink df/d14/l58 0 2024-02-20T08:06:17.627 INFO:tasks.workunit.client.1.smithi194.stdout:2/797: fsync df/d14/d19/d5c/d60/d63/d92/fcb 0 2024-02-20T08:06:17.631 INFO:tasks.workunit.client.1.smithi194.stdout:3/778: symlink d5/d10/d17/d1d/d93/lf6 0 2024-02-20T08:06:17.634 INFO:tasks.workunit.client.1.smithi194.stdout:1/742: mknod d2/d8/d12/dc9/d26/d57/cf4 0 2024-02-20T08:06:17.636 INFO:tasks.workunit.client.1.smithi194.stdout:5/794: mknod d4/d6/dd/d25/d7d/dcd/df0/cf4 0 2024-02-20T08:06:17.640 INFO:tasks.workunit.client.1.smithi194.stdout:7/782: fsync d11/f99 0 2024-02-20T08:06:17.641 INFO:tasks.workunit.client.1.smithi194.stdout:9/823: getdents d4/deb 0 2024-02-20T08:06:17.641 INFO:tasks.workunit.client.1.smithi194.stdout:9/824: write d4/d1b/d2e/f30 [7504615,58651] 0 2024-02-20T08:06:17.645 INFO:tasks.workunit.client.1.smithi194.stdout:5/795: rename d4/d6 to d4/d6/dd/d25/df5 22 2024-02-20T08:06:17.648 INFO:tasks.workunit.client.1.smithi194.stdout:7/783: chown d11/d2d/d38/f7a 894 1 2024-02-20T08:06:17.649 INFO:tasks.workunit.client.1.smithi194.stdout:5/796: dread - d4/d6/dd/d25/d7d/fbe zero size 2024-02-20T08:06:17.649 INFO:tasks.workunit.client.1.smithi194.stdout:8/720: getdents d2/d14/d18/d45/d4e 0 2024-02-20T08:06:17.651 INFO:tasks.workunit.client.1.smithi194.stdout:9/825: dwrite d4/d20/d41/f9f [0,4194304] 0 2024-02-20T08:06:17.653 INFO:tasks.workunit.client.1.smithi194.stdout:3/779: fsync d5/d10/d17/d1d/f20 0 2024-02-20T08:06:17.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/848: dwrite df/dab/d1d/d28/d46/d5a/f71 [0,4194304] 0 2024-02-20T08:06:17.656 INFO:tasks.workunit.client.1.smithi194.stdout:2/798: getdents df/d14/d19/d5c/d60/d63 0 2024-02-20T08:06:17.656 INFO:tasks.workunit.client.1.smithi194.stdout:7/784: fsync d11/d2d/d38/d95/fb5 0 2024-02-20T08:06:17.657 INFO:tasks.workunit.client.1.smithi194.stdout:9/826: chown d4/d20/d5c/f46 8864 1 2024-02-20T08:06:17.658 INFO:tasks.workunit.client.1.smithi194.stdout:0/703: dread d6/d2b/d35/fbc [0,4194304] 0 2024-02-20T08:06:17.659 INFO:tasks.workunit.client.1.smithi194.stdout:1/743: write d2/d8/d12/f2b [1567193,60375] 0 2024-02-20T08:06:17.663 INFO:tasks.workunit.client.1.smithi194.stdout:3/780: creat d5/d10/d28/dd2/ff7 x:0 0 0 2024-02-20T08:06:17.665 INFO:tasks.workunit.client.1.smithi194.stdout:4/724: dwrite d0/d2/fe [4194304,4194304] 0 2024-02-20T08:06:17.669 INFO:tasks.workunit.client.1.smithi194.stdout:9/827: symlink d4/d37/de2/l115 0 2024-02-20T08:06:17.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/849: mknod df/dab/d1d/d28/d2b/d94/d96/c11c 0 2024-02-20T08:06:17.673 INFO:tasks.workunit.client.1.smithi194.stdout:4/725: stat d0/d2/d3e/cb6 0 2024-02-20T08:06:17.673 INFO:tasks.workunit.client.1.smithi194.stdout:3/781: readlink d5/l23 0 2024-02-20T08:06:17.675 INFO:tasks.workunit.client.1.smithi194.stdout:0/704: write d6/d2b/d35/d39/d8f/f95 [5379621,38406] 0 2024-02-20T08:06:17.675 INFO:tasks.workunit.client.1.smithi194.stdout:5/797: dwrite d4/d6/da5/ff1 [0,4194304] 0 2024-02-20T08:06:17.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/726: rename d0 to d0/d10/d1c/d21/d46/dd0 22 2024-02-20T08:06:17.683 INFO:tasks.workunit.client.1.smithi194.stdout:5/798: dread - d4/d6/d11/d2f/d77/d90/fe9 zero size 2024-02-20T08:06:17.684 INFO:tasks.workunit.client.1.smithi194.stdout:8/721: dwrite d2/d14/d18/d45/fcd [0,4194304] 0 2024-02-20T08:06:17.684 INFO:tasks.workunit.client.1.smithi194.stdout:9/828: read d4/d20/d43/daa/fae [2734418,16280] 0 2024-02-20T08:06:17.685 INFO:tasks.workunit.client.1.smithi194.stdout:7/785: dwrite d11/d2d/d38/d37/f4f [4194304,4194304] 0 2024-02-20T08:06:17.687 INFO:tasks.workunit.client.1.smithi194.stdout:5/799: chown d4/d20/d2b/ddf/dc4/d28/d85 1936609219 1 2024-02-20T08:06:17.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/722: dwrite d2/d14/d18/d45/d4e/d9f/ffc [0,4194304] 0 2024-02-20T08:06:17.709 INFO:tasks.workunit.client.1.smithi194.stdout:2/799: creat df/d14/d19/d5c/d97/d9a/ddd/dc1/ff2 x:0 0 0 2024-02-20T08:06:17.714 INFO:tasks.workunit.client.1.smithi194.stdout:3/782: symlink d5/d10/d16/lf8 0 2024-02-20T08:06:17.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/829: creat d4/d37/d38/f116 x:0 0 0 2024-02-20T08:06:17.719 INFO:tasks.workunit.client.1.smithi194.stdout:9/830: write d4/d37/d38/f116 [622637,73780] 0 2024-02-20T08:06:17.720 INFO:tasks.workunit.client.1.smithi194.stdout:4/727: mkdir d0/df/d72/d97/dd1 0 2024-02-20T08:06:17.721 INFO:tasks.workunit.client.1.smithi194.stdout:5/800: unlink d4/d6/dd/d25/d7d/fbd 0 2024-02-20T08:06:17.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/744: mknod d2/d8/d12/dc9/d26/d3d/de1/cf5 0 2024-02-20T08:06:17.725 INFO:tasks.workunit.client.1.smithi194.stdout:5/801: write d4/d6/dd/d3a/fd6 [1294080,18030] 0 2024-02-20T08:06:17.727 INFO:tasks.workunit.client.1.smithi194.stdout:7/786: dwrite d11/d2d/d38/d37/d43/d7b/dc5/fdd [0,4194304] 0 2024-02-20T08:06:17.729 INFO:tasks.workunit.client.1.smithi194.stdout:9/831: dread d4/d37/d38/faf [0,4194304] 0 2024-02-20T08:06:17.730 INFO:tasks.workunit.client.1.smithi194.stdout:5/802: chown d4/d6/dd/d25/d7d/de2 308016538 1 2024-02-20T08:06:17.731 INFO:tasks.workunit.client.1.smithi194.stdout:6/850: rename df/d42/dcf/ceb to df/dab/d1d/d28/d46/d5a/d6b/dbb/c11d 0 2024-02-20T08:06:17.733 INFO:tasks.workunit.client.1.smithi194.stdout:2/800: write df/f72 [4500585,53335] 0 2024-02-20T08:06:17.733 INFO:tasks.workunit.client.1.smithi194.stdout:7/787: stat d11/d2d/d38/d4a/d27/d51/fdf 0 2024-02-20T08:06:17.734 INFO:tasks.workunit.client.1.smithi194.stdout:8/723: dwrite d2/d14/d18/d45/d90/d92/fdf [0,4194304] 0 2024-02-20T08:06:17.734 INFO:tasks.workunit.client.1.smithi194.stdout:9/832: read d4/d20/d5c/fc9 [19079,47380] 0 2024-02-20T08:06:17.735 INFO:tasks.workunit.client.1.smithi194.stdout:2/801: stat df/fee 0 2024-02-20T08:06:17.735 INFO:tasks.workunit.client.1.smithi194.stdout:4/728: creat d0/d10/d1c/d4d/d2f/fd2 x:0 0 0 2024-02-20T08:06:17.737 INFO:tasks.workunit.client.1.smithi194.stdout:5/803: stat d4/d20/d2b/ddf/dc4/d28/d85/c55 0 2024-02-20T08:06:17.738 INFO:tasks.workunit.client.1.smithi194.stdout:8/724: chown d2/d14/d18/f7f 2 1 2024-02-20T08:06:17.739 INFO:tasks.workunit.client.1.smithi194.stdout:4/729: fdatasync d0/d10/d1c/d4d/d2f/f31 0 2024-02-20T08:06:17.742 INFO:tasks.workunit.client.1.smithi194.stdout:8/725: fsync d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 0 2024-02-20T08:06:17.743 INFO:tasks.workunit.client.1.smithi194.stdout:0/705: dwrite d6/d2b/d35/f7a [4194304,4194304] 0 2024-02-20T08:06:17.747 INFO:tasks.workunit.client.1.smithi194.stdout:0/706: chown d6/d2b/d35/d42/d1e/f27 1 1 2024-02-20T08:06:17.747 INFO:tasks.workunit.client.1.smithi194.stdout:7/788: dread d11/d2d/d38/d37/d43/d7b/dc5/fdd [0,4194304] 0 2024-02-20T08:06:17.748 INFO:tasks.workunit.client.1.smithi194.stdout:2/802: readlink df/d14/d80/lc3 0 2024-02-20T08:06:17.748 INFO:tasks.workunit.client.1.smithi194.stdout:0/707: chown d6/d2b/d35/d42 2 1 2024-02-20T08:06:17.749 INFO:tasks.workunit.client.1.smithi194.stdout:0/708: read d6/f1a [2736805,29239] 0 2024-02-20T08:06:17.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/789: write d11/d2d/fa4 [115333,125398] 0 2024-02-20T08:06:17.749 INFO:tasks.workunit.client.1.smithi194.stdout:6/851: creat df/dab/d1d/d28/d46/d5a/d7d/dd4/f11e x:0 0 0 2024-02-20T08:06:17.750 INFO:tasks.workunit.client.1.smithi194.stdout:6/852: chown df/f13 1256808414 1 2024-02-20T08:06:17.750 INFO:tasks.workunit.client.1.smithi194.stdout:5/804: readlink d4/d6/dd/lf 0 2024-02-20T08:06:17.751 INFO:tasks.workunit.client.1.smithi194.stdout:6/853: read - df/dbe/f101 zero size 2024-02-20T08:06:17.752 INFO:tasks.workunit.client.1.smithi194.stdout:4/730: creat d0/df/d41/fd3 x:0 0 0 2024-02-20T08:06:17.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/805: truncate d4/d6/dd/d25/d7d/fba 956118 0 2024-02-20T08:06:17.755 INFO:tasks.workunit.client.1.smithi194.stdout:3/783: rename d5/d10/d17/d1d/d93/fb6 to d5/d10/d28/d41/d73/d8c/ff9 0 2024-02-20T08:06:17.755 INFO:tasks.workunit.client.1.smithi194.stdout:6/854: dread df/dab/d1d/d28/d46/d5a/d6b/dcb/ff3 [0,4194304] 0 2024-02-20T08:06:17.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/833: unlink d4/d20/l26 0 2024-02-20T08:06:17.757 INFO:tasks.workunit.client.1.smithi194.stdout:3/784: dread - d5/d10/d16/d7b/d94/dad/db9/fdf zero size 2024-02-20T08:06:17.758 INFO:tasks.workunit.client.1.smithi194.stdout:8/726: unlink d2/d14/d18/d45/d4e/dbe/dc3/le1 0 2024-02-20T08:06:17.762 INFO:tasks.workunit.client.1.smithi194.stdout:7/790: mknod d11/d2d/d38/d4a/d27/d51/d77/d9d/cf4 0 2024-02-20T08:06:17.762 INFO:tasks.workunit.client.1.smithi194.stdout:5/806: dwrite d4/d6/dd/d25/fc8 [0,4194304] 0 2024-02-20T08:06:17.766 INFO:tasks.workunit.client.1.smithi194.stdout:9/834: rmdir d4/d20/d43/daa 39 2024-02-20T08:06:17.768 INFO:tasks.workunit.client.1.smithi194.stdout:8/727: dwrite d2/d14/d18/d45/d69/daf/db3/fd0 [0,4194304] 0 2024-02-20T08:06:17.771 INFO:tasks.workunit.client.1.smithi194.stdout:2/803: symlink df/d14/d19/d5c/d60/lf3 0 2024-02-20T08:06:17.772 INFO:tasks.workunit.client.1.smithi194.stdout:3/785: symlink d5/d10/d28/dd3/db7/lfa 0 2024-02-20T08:06:17.772 INFO:tasks.workunit.client.1.smithi194.stdout:2/804: dread - df/d3a/fd0 zero size 2024-02-20T08:06:17.773 INFO:tasks.workunit.client.1.smithi194.stdout:7/791: dwrite d11/d2d/d38/d4a/d53/da0/faa [0,4194304] 0 2024-02-20T08:06:17.774 INFO:tasks.workunit.client.1.smithi194.stdout:0/709: dread - d6/d2b/d35/d48/d60/fb2 zero size 2024-02-20T08:06:17.776 INFO:tasks.workunit.client.1.smithi194.stdout:4/731: creat d0/df/d72/dc9/fd4 x:0 0 0 2024-02-20T08:06:17.780 INFO:tasks.workunit.client.1.smithi194.stdout:0/710: truncate d6/d93/fd8 13665 0 2024-02-20T08:06:17.786 INFO:tasks.workunit.client.1.smithi194.stdout:4/732: dread d0/df/d11/f7b [0,4194304] 0 2024-02-20T08:06:17.787 INFO:tasks.workunit.client.1.smithi194.stdout:2/805: rename df/d14/d19/l93 to df/d14/d19/d5c/d97/d9a/ddd/lf4 0 2024-02-20T08:06:17.787 INFO:tasks.workunit.client.1.smithi194.stdout:3/786: dwrite d5/d10/d17/f5b [4194304,4194304] 0 2024-02-20T08:06:17.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/728: mknod d2/d14/d18/d45/c100 0 2024-02-20T08:06:17.795 INFO:tasks.workunit.client.1.smithi194.stdout:9/835: dread d4/d20/d43/daa/fae [0,4194304] 0 2024-02-20T08:06:17.797 INFO:tasks.workunit.client.1.smithi194.stdout:4/733: mkdir d0/d5c/d60/d4a/dd5 0 2024-02-20T08:06:17.798 INFO:tasks.workunit.client.1.smithi194.stdout:3/787: stat d5/d10/c7a 0 2024-02-20T08:06:17.803 INFO:tasks.workunit.client.1.smithi194.stdout:9/836: dwrite d4/d20/d41/db7/f100 [0,4194304] 0 2024-02-20T08:06:17.806 INFO:tasks.workunit.client.1.smithi194.stdout:6/855: getdents df/dab/d1d/d28/d46 0 2024-02-20T08:06:17.806 INFO:tasks.workunit.client.1.smithi194.stdout:8/729: mknod d2/d14/d18/d45/d69/d9b/c101 0 2024-02-20T08:06:17.808 INFO:tasks.workunit.client.1.smithi194.stdout:4/734: mknod d0/cd6 0 2024-02-20T08:06:17.811 INFO:tasks.workunit.client.1.smithi194.stdout:5/807: getdents d4/d6/dd/d25 0 2024-02-20T08:06:17.811 INFO:tasks.workunit.client.1.smithi194.stdout:3/788: dwrite d5/d10/d28/fb0 [0,4194304] 0 2024-02-20T08:06:17.815 INFO:tasks.workunit.client.1.smithi194.stdout:3/789: write d5/d10/d28/fb3 [91494,50777] 0 2024-02-20T08:06:17.817 INFO:tasks.workunit.client.1.smithi194.stdout:0/711: dwrite d6/d2b/d35/d42/f30 [4194304,4194304] 0 2024-02-20T08:06:17.874 INFO:tasks.workunit.client.1.smithi194.stdout:1/745: sync 2024-02-20T08:06:17.876 INFO:tasks.workunit.client.1.smithi194.stdout:2/806: truncate df/d14/d19/d5c/d60/f7f 1921452 0 2024-02-20T08:06:17.877 INFO:tasks.workunit.client.1.smithi194.stdout:2/807: fsync df/d14/d19/d5c/d78/f90 0 2024-02-20T08:06:17.877 INFO:tasks.workunit.client.1.smithi194.stdout:9/837: read - d4/d20/d43/d51/f71 zero size 2024-02-20T08:06:17.877 INFO:tasks.workunit.client.1.smithi194.stdout:6/856: truncate df/dab/f4a 3137906 0 2024-02-20T08:06:17.889 INFO:tasks.workunit.client.1.smithi194.stdout:7/792: truncate d11/d2d/d38/d37/d43/de7/f9f 2581031 0 2024-02-20T08:06:17.891 INFO:tasks.workunit.client.1.smithi194.stdout:7/793: write d11/d2d/d38/d37/fe5 [316136,35760] 0 2024-02-20T08:06:17.892 INFO:tasks.workunit.client.1.smithi194.stdout:3/790: creat d5/df/d25/ffb x:0 0 0 2024-02-20T08:06:17.895 INFO:tasks.workunit.client.1.smithi194.stdout:0/712: unlink d6/d2b/d35/d9c/d62/fe1 0 2024-02-20T08:06:17.895 INFO:tasks.workunit.client.1.smithi194.stdout:5/808: dwrite d4/fc [4194304,4194304] 0 2024-02-20T08:06:17.898 INFO:tasks.workunit.client.1.smithi194.stdout:0/713: chown d6/d2b/d35/d42/d1e/d45/daa/fc8 2 1 2024-02-20T08:06:17.899 INFO:tasks.workunit.client.1.smithi194.stdout:9/838: dread - d4/d20/f82 zero size 2024-02-20T08:06:17.900 INFO:tasks.workunit.client.1.smithi194.stdout:3/791: dwrite d5/d10/d28/d41/fc7 [4194304,4194304] 0 2024-02-20T08:06:17.902 INFO:tasks.workunit.client.1.smithi194.stdout:0/714: truncate d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/fab 976379 0 2024-02-20T08:06:17.903 INFO:tasks.workunit.client.1.smithi194.stdout:4/735: mkdir d0/d5c/d60/d4a/dd5/dd7 0 2024-02-20T08:06:17.905 INFO:tasks.workunit.client.1.smithi194.stdout:4/736: readlink d0/d4f/la0 0 2024-02-20T08:06:17.908 INFO:tasks.workunit.client.1.smithi194.stdout:9/839: dwrite d4/d20/f82 [0,4194304] 0 2024-02-20T08:06:17.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/794: rename d11/d2d/d38/d37/d3c/d8d/dc9/ld3 to d11/d2d/d38/d4a/dde/lf5 0 2024-02-20T08:06:17.914 INFO:tasks.workunit.client.1.smithi194.stdout:4/737: dwrite d0/f2d [0,4194304] 0 2024-02-20T08:06:17.924 INFO:tasks.workunit.client.1.smithi194.stdout:8/730: truncate d2/f9e 7388 0 2024-02-20T08:06:17.931 INFO:tasks.workunit.client.1.smithi194.stdout:5/809: rename d4/fb to d4/d6/dd/d25/d78/d8b/ff6 0 2024-02-20T08:06:17.932 INFO:tasks.workunit.client.1.smithi194.stdout:1/746: write d2/f42 [416545,128918] 0 2024-02-20T08:06:17.934 INFO:tasks.workunit.client.1.smithi194.stdout:2/808: rename df/d14/l17 to df/d14/lf5 0 2024-02-20T08:06:17.936 INFO:tasks.workunit.client.1.smithi194.stdout:6/857: creat df/d42/f11f x:0 0 0 2024-02-20T08:06:17.936 INFO:tasks.workunit.client.1.smithi194.stdout:8/731: creat d2/d14/d18/d45/d7b/f102 x:0 0 0 2024-02-20T08:06:17.937 INFO:tasks.workunit.client.1.smithi194.stdout:6/858: write df/d18/f49 [3991832,92785] 0 2024-02-20T08:06:17.938 INFO:tasks.workunit.client.1.smithi194.stdout:8/732: fsync d2/d14/d18/d45/d4e/dbe/dc3/fe7 0 2024-02-20T08:06:17.940 INFO:tasks.workunit.client.1.smithi194.stdout:4/738: dread d0/d2/d3e/f3f [0,4194304] 0 2024-02-20T08:06:17.942 INFO:tasks.workunit.client.1.smithi194.stdout:7/795: creat d11/d6e/dc6/ff6 x:0 0 0 2024-02-20T08:06:17.948 INFO:tasks.workunit.client.1.smithi194.stdout:6/859: creat df/dab/d1d/d28/d46/d5a/d6b/d83/db3/f120 x:0 0 0 2024-02-20T08:06:17.950 INFO:tasks.workunit.client.1.smithi194.stdout:8/733: symlink d2/d14/d18/d45/d4e/d9f/l103 0 2024-02-20T08:06:17.951 INFO:tasks.workunit.client.1.smithi194.stdout:6/860: chown df/d18/f107 1784306 1 2024-02-20T08:06:17.953 INFO:tasks.workunit.client.1.smithi194.stdout:7/796: dwrite d11/d2d/d38/d37/d43/d7b/fd2 [0,4194304] 0 2024-02-20T08:06:17.953 INFO:tasks.workunit.client.1.smithi194.stdout:3/792: dwrite d5/d10/d28/f95 [0,4194304] 0 2024-02-20T08:06:17.956 INFO:tasks.workunit.client.1.smithi194.stdout:3/793: fsync d5/d10/d28/fb3 0 2024-02-20T08:06:17.960 INFO:tasks.workunit.client.1.smithi194.stdout:4/739: dwrite d0/df/f84 [0,4194304] 0 2024-02-20T08:06:17.961 INFO:tasks.workunit.client.1.smithi194.stdout:5/810: link d4/l3c d4/d6/dd/d25/d7d/de2/db0/lf7 0 2024-02-20T08:06:17.961 INFO:tasks.workunit.client.1.smithi194.stdout:2/809: dread df/d14/d19/d5c/f94 [0,4194304] 0 2024-02-20T08:06:17.962 INFO:tasks.workunit.client.1.smithi194.stdout:4/740: readlink d0/df/d41/l8b 0 2024-02-20T08:06:17.962 INFO:tasks.workunit.client.1.smithi194.stdout:8/734: creat d2/d14/d18/d45/d4e/f104 x:0 0 0 2024-02-20T08:06:17.964 INFO:tasks.workunit.client.1.smithi194.stdout:2/810: write df/d14/d80/d85/f86 [4729781,66552] 0 2024-02-20T08:06:17.964 INFO:tasks.workunit.client.1.smithi194.stdout:0/715: link d6/d2b/d35/d39/d8f/fd4 d6/d2b/d35/d48/fea 0 2024-02-20T08:06:17.966 INFO:tasks.workunit.client.1.smithi194.stdout:1/747: write d2/d8/f83 [86971,106858] 0 2024-02-20T08:06:17.968 INFO:tasks.workunit.client.1.smithi194.stdout:6/861: mknod df/dab/d1d/d28/d46/d5a/d6b/d83/db3/c121 0 2024-02-20T08:06:17.973 INFO:tasks.workunit.client.1.smithi194.stdout:8/735: dwrite d2/d14/d18/d45/d90/d92/fdf [0,4194304] 0 2024-02-20T08:06:17.975 INFO:tasks.workunit.client.1.smithi194.stdout:2/811: dwrite df/d5b/d61/f8b [0,4194304] 0 2024-02-20T08:06:17.978 INFO:tasks.workunit.client.1.smithi194.stdout:2/812: fdatasync df/d14/d19/d5c/fd5 0 2024-02-20T08:06:17.979 INFO:tasks.workunit.client.1.smithi194.stdout:2/813: chown df/d14/d24/l3c 5170 1 2024-02-20T08:06:17.981 INFO:tasks.workunit.client.1.smithi194.stdout:9/840: sync 2024-02-20T08:06:17.983 INFO:tasks.workunit.client.1.smithi194.stdout:0/716: rename d6/d2b/d35/d42/f5b to d6/d2b/d35/d39/d8f/dbf/feb 0 2024-02-20T08:06:17.987 INFO:tasks.workunit.client.1.smithi194.stdout:5/811: unlink d4/d20/d2b/c74 0 2024-02-20T08:06:17.989 INFO:tasks.workunit.client.1.smithi194.stdout:9/841: dwrite d4/d20/d5c/dd0/def/f10a [0,4194304] 0 2024-02-20T08:06:17.992 INFO:tasks.workunit.client.1.smithi194.stdout:0/717: dwrite d6/f90 [4194304,4194304] 0 2024-02-20T08:06:17.992 INFO:tasks.workunit.client.1.smithi194.stdout:7/797: creat d11/ff7 x:0 0 0 2024-02-20T08:06:17.997 INFO:tasks.workunit.client.1.smithi194.stdout:1/748: mknod d2/d8/cf6 0 2024-02-20T08:06:17.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/814: creat df/d14/d19/d5c/d97/dc8/ff6 x:0 0 0 2024-02-20T08:06:18.001 INFO:tasks.workunit.client.1.smithi194.stdout:5/812: mkdir d4/d20/d2b/ddf/db6/dbc/df8 0 2024-02-20T08:06:18.008 INFO:tasks.workunit.client.1.smithi194.stdout:4/741: dwrite d0/d10/d1c/f5a [0,4194304] 0 2024-02-20T08:06:18.011 INFO:tasks.workunit.client.1.smithi194.stdout:7/798: dwrite d11/f12 [0,4194304] 0 2024-02-20T08:06:18.012 INFO:tasks.workunit.client.1.smithi194.stdout:9/842: dread d4/d20/d5c/dd0/def/f101 [0,4194304] 0 2024-02-20T08:06:18.014 INFO:tasks.workunit.client.1.smithi194.stdout:0/718: mknod d6/d2b/d35/d39/cec 0 2024-02-20T08:06:18.015 INFO:tasks.workunit.client.1.smithi194.stdout:6/862: dwrite df/dab/dcc/fd3 [0,4194304] 0 2024-02-20T08:06:18.020 INFO:tasks.workunit.client.1.smithi194.stdout:6/863: readlink df/dab/l8c 0 2024-02-20T08:06:18.023 INFO:tasks.workunit.client.1.smithi194.stdout:1/749: stat d2/d8/d60/fb8 0 2024-02-20T08:06:18.023 INFO:tasks.workunit.client.1.smithi194.stdout:5/813: unlink d4/ce3 0 2024-02-20T08:06:18.026 INFO:tasks.workunit.client.1.smithi194.stdout:7/799: write d11/d2d/d38/d37/f90 [6258242,51928] 0 2024-02-20T08:06:18.027 INFO:tasks.workunit.client.1.smithi194.stdout:0/719: write d6/d2b/d35/d42/d1e/d45/d58/f8d [6989774,112058] 0 2024-02-20T08:06:18.027 INFO:tasks.workunit.client.1.smithi194.stdout:8/736: dwrite d2/d14/d18/d45/f95 [0,4194304] 0 2024-02-20T08:06:18.030 INFO:tasks.workunit.client.1.smithi194.stdout:4/742: symlink d0/d2/d3e/dcc/ld8 0 2024-02-20T08:06:18.031 INFO:tasks.workunit.client.1.smithi194.stdout:5/814: chown d4/d6/dd/d99/da7/ce1 4 1 2024-02-20T08:06:18.032 INFO:tasks.workunit.client.1.smithi194.stdout:6/864: read df/dab/f102 [1115761,51401] 0 2024-02-20T08:06:18.033 INFO:tasks.workunit.client.1.smithi194.stdout:0/720: chown d6/d2b/d35/d42/d1e/d3c/l64 53431 1 2024-02-20T08:06:18.033 INFO:tasks.workunit.client.1.smithi194.stdout:4/743: chown d0/d5c/d60/d4a/dd5/dd7 20 1 2024-02-20T08:06:18.034 INFO:tasks.workunit.client.1.smithi194.stdout:9/843: link d4/d37/ddf/d59/c93 d4/d20/c117 0 2024-02-20T08:06:18.035 INFO:tasks.workunit.client.1.smithi194.stdout:7/800: link d11/d6e/c72 d11/d2d/d38/d4a/d60/dea/cf8 0 2024-02-20T08:06:18.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/737: truncate d2/d14/d18/f8c 962845 0 2024-02-20T08:06:18.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/801: dread - d11/d2d/d38/d4a/d93/fe3 zero size 2024-02-20T08:06:18.040 INFO:tasks.workunit.client.1.smithi194.stdout:2/815: dread df/d14/d19/d5c/d60/fca [0,4194304] 0 2024-02-20T08:06:18.041 INFO:tasks.workunit.client.1.smithi194.stdout:2/816: stat df/d14/d19/d5c 0 2024-02-20T08:06:18.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/844: creat d4/d37/f118 x:0 0 0 2024-02-20T08:06:18.044 INFO:tasks.workunit.client.1.smithi194.stdout:8/738: creat d2/d14/d18/d45/d7b/dc7/d78/dbc/f105 x:0 0 0 2024-02-20T08:06:18.045 INFO:tasks.workunit.client.1.smithi194.stdout:7/802: creat d11/d2d/d38/d4a/d53/da0/ff9 x:0 0 0 2024-02-20T08:06:18.047 INFO:tasks.workunit.client.1.smithi194.stdout:8/739: chown d2/d14/d18/f61 28 1 2024-02-20T08:06:18.047 INFO:tasks.workunit.client.1.smithi194.stdout:0/721: rename d6/d2b/d35/d42/l6f to d6/d2b/d35/d42/d1e/d45/d58/led 0 2024-02-20T08:06:18.048 INFO:tasks.workunit.client.1.smithi194.stdout:9/845: dread d4/d20/fbe [4194304,4194304] 0 2024-02-20T08:06:18.050 INFO:tasks.workunit.client.1.smithi194.stdout:7/803: symlink d11/d2d/d38/d4a/d60/def/lfa 0 2024-02-20T08:06:18.053 INFO:tasks.workunit.client.1.smithi194.stdout:0/722: creat d6/fee x:0 0 0 2024-02-20T08:06:18.053 INFO:tasks.workunit.client.1.smithi194.stdout:7/804: chown d11/d2d/d38/d4a/l3e 121749 1 2024-02-20T08:06:18.054 INFO:tasks.workunit.client.1.smithi194.stdout:9/846: mkdir d4/d20/d43/daa/dcb/d119 0 2024-02-20T08:06:18.054 INFO:tasks.workunit.client.1.smithi194.stdout:3/794: dread d5/fa [0,4194304] 0 2024-02-20T08:06:18.055 INFO:tasks.workunit.client.1.smithi194.stdout:7/805: readlink d11/d2d/d38/d37/d43/d8e/l92 0 2024-02-20T08:06:18.055 INFO:tasks.workunit.client.1.smithi194.stdout:9/847: dread - d4/d37/ddf/d42/d4e/d6e/f109 zero size 2024-02-20T08:06:18.063 INFO:tasks.workunit.client.1.smithi194.stdout:1/750: write d2/d8/d60/fb8 [919456,48472] 0 2024-02-20T08:06:18.068 INFO:tasks.workunit.client.1.smithi194.stdout:5/815: truncate d4/f9f 2974990 0 2024-02-20T08:06:18.068 INFO:tasks.workunit.client.1.smithi194.stdout:6/865: dread df/dab/f54 [0,4194304] 0 2024-02-20T08:06:18.070 INFO:tasks.workunit.client.1.smithi194.stdout:3/795: mkdir d5/d10/df2/dfc 0 2024-02-20T08:06:18.072 INFO:tasks.workunit.client.1.smithi194.stdout:6/866: truncate df/d18/f107 133513 0 2024-02-20T08:06:18.072 INFO:tasks.workunit.client.1.smithi194.stdout:1/751: dwrite d2/d8/d12/dc9/fb4 [0,4194304] 0 2024-02-20T08:06:18.074 INFO:tasks.workunit.client.1.smithi194.stdout:8/740: write d2/d14/f3c [996727,128837] 0 2024-02-20T08:06:18.075 INFO:tasks.workunit.client.1.smithi194.stdout:9/848: dread d4/fa8 [0,4194304] 0 2024-02-20T08:06:18.079 INFO:tasks.workunit.client.1.smithi194.stdout:6/867: dread - df/dab/d1d/d28/d46/fe7 zero size 2024-02-20T08:06:18.080 INFO:tasks.workunit.client.1.smithi194.stdout:8/741: rmdir d2/d14/d18/d45/d7b/dc7 39 2024-02-20T08:06:18.081 INFO:tasks.workunit.client.1.smithi194.stdout:0/723: truncate d6/d2b/d35/d42/f30 4198767 0 2024-02-20T08:06:18.082 INFO:tasks.workunit.client.1.smithi194.stdout:7/806: dread d11/d2d/d38/d37/f59 [0,4194304] 0 2024-02-20T08:06:18.084 INFO:tasks.workunit.client.1.smithi194.stdout:1/752: unlink d2/f84 0 2024-02-20T08:06:18.087 INFO:tasks.workunit.client.1.smithi194.stdout:3/796: dwrite d5/d10/d17/f38 [4194304,4194304] 0 2024-02-20T08:06:18.088 INFO:tasks.workunit.client.1.smithi194.stdout:9/849: creat d4/d1b/d90/f11a x:0 0 0 2024-02-20T08:06:18.090 INFO:tasks.workunit.client.1.smithi194.stdout:6/868: symlink df/dab/d1d/d28/d2b/d103/d104/l122 0 2024-02-20T08:06:18.090 INFO:tasks.workunit.client.1.smithi194.stdout:5/816: dwrite d4/d6/dd/d25/f29 [4194304,4194304] 0 2024-02-20T08:06:18.091 INFO:tasks.workunit.client.1.smithi194.stdout:1/753: chown d2/d8/d12/dc9/d26/d3d/d71/f66 94551029 1 2024-02-20T08:06:18.096 INFO:tasks.workunit.client.1.smithi194.stdout:8/742: dwrite d2/d14/f34 [0,4194304] 0 2024-02-20T08:06:18.101 INFO:tasks.workunit.client.1.smithi194.stdout:9/850: rename d4/d20/d43/fdc to d4/d37/d4f/f11b 0 2024-02-20T08:06:18.102 INFO:tasks.workunit.client.1.smithi194.stdout:5/817: symlink d4/d6/dd/d25/d7d/de2/lf9 0 2024-02-20T08:06:18.104 INFO:tasks.workunit.client.1.smithi194.stdout:0/724: creat d6/d2b/d35/d9c/fef x:0 0 0 2024-02-20T08:06:18.105 INFO:tasks.workunit.client.1.smithi194.stdout:6/869: truncate df/dab/f102 1360262 0 2024-02-20T08:06:18.109 INFO:tasks.workunit.client.1.smithi194.stdout:7/807: link d11/d2d/d38/d4a/d53/fb3 d11/d2d/d38/d37/d3c/d8d/dc9/ffb 0 2024-02-20T08:06:18.110 INFO:tasks.workunit.client.1.smithi194.stdout:7/808: chown d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb/lcc 761991 1 2024-02-20T08:06:18.112 INFO:tasks.workunit.client.1.smithi194.stdout:7/809: write d11/d2d/d38/d4a/d60/fbf [1614801,8410] 0 2024-02-20T08:06:18.113 INFO:tasks.workunit.client.1.smithi194.stdout:7/810: stat d11/d2d/d38/d37/d43/d8e/f5c 0 2024-02-20T08:06:18.116 INFO:tasks.workunit.client.1.smithi194.stdout:5/818: mknod d4/d20/d2b/d9b/ddb/cfa 0 2024-02-20T08:06:18.118 INFO:tasks.workunit.client.1.smithi194.stdout:5/819: stat d4/d6/dd/fd0 0 2024-02-20T08:06:18.119 INFO:tasks.workunit.client.1.smithi194.stdout:1/754: write d2/d8/d12/dc9/d26/f2d [366986,26228] 0 2024-02-20T08:06:18.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/743: dwrite d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 [0,4194304] 0 2024-02-20T08:06:18.119 INFO:tasks.workunit.client.1.smithi194.stdout:6/870: fdatasync df/d18/f40 0 2024-02-20T08:06:18.123 INFO:tasks.workunit.client.1.smithi194.stdout:7/811: dwrite d11/d2d/d38/d37/f90 [4194304,4194304] 0 2024-02-20T08:06:18.123 INFO:tasks.workunit.client.1.smithi194.stdout:3/797: creat d5/d10/d17/d1d/ffd x:0 0 0 2024-02-20T08:06:18.125 INFO:tasks.workunit.client.1.smithi194.stdout:8/744: read d2/d14/d18/d45/f95 [2628208,24906] 0 2024-02-20T08:06:18.126 INFO:tasks.workunit.client.1.smithi194.stdout:3/798: fsync d5/d10/d28/dd2/ff7 0 2024-02-20T08:06:18.127 INFO:tasks.workunit.client.1.smithi194.stdout:9/851: rename d4/f5 to d4/deb/f11c 0 2024-02-20T08:06:18.133 INFO:tasks.workunit.client.1.smithi194.stdout:6/871: dread df/dab/d1d/d28/d2b/d80/fdc [0,4194304] 0 2024-02-20T08:06:18.135 INFO:tasks.workunit.client.1.smithi194.stdout:1/755: creat d2/d8/d12/dc9/d61/d68/db7/ff7 x:0 0 0 2024-02-20T08:06:18.136 INFO:tasks.workunit.client.1.smithi194.stdout:7/812: symlink d11/d2d/d38/d4a/d53/d81/lfc 0 2024-02-20T08:06:18.139 INFO:tasks.workunit.client.1.smithi194.stdout:3/799: write d5/d10/d28/d41/d73/d8c/fb1 [2192642,8140] 0 2024-02-20T08:06:18.140 INFO:tasks.workunit.client.1.smithi194.stdout:9/852: mkdir d4/d20/d5c/dd0/def/d11d 0 2024-02-20T08:06:18.142 INFO:tasks.workunit.client.1.smithi194.stdout:9/853: chown d4/d37/ddf/d42/d4e/d6e 4994 1 2024-02-20T08:06:18.144 INFO:tasks.workunit.client.1.smithi194.stdout:7/813: dwrite d11/d6e/dc6/ff6 [0,4194304] 0 2024-02-20T08:06:18.150 INFO:tasks.workunit.client.1.smithi194.stdout:8/745: dread d2/d14/f5c [0,4194304] 0 2024-02-20T08:06:18.152 INFO:tasks.workunit.client.1.smithi194.stdout:3/800: symlink d5/d10/d28/d41/d73/d8c/da6/ded/daa/lfe 0 2024-02-20T08:06:18.153 INFO:tasks.workunit.client.1.smithi194.stdout:3/801: truncate d5/d10/d28/fb3 401692 0 2024-02-20T08:06:18.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/820: creat d4/d20/d2b/ffb x:0 0 0 2024-02-20T08:06:18.155 INFO:tasks.workunit.client.1.smithi194.stdout:7/814: creat d11/d2d/d38/d4a/d53/d81/ffd x:0 0 0 2024-02-20T08:06:18.157 INFO:tasks.workunit.client.1.smithi194.stdout:7/815: write d11/d2d/d38/d37/d3c/d8d/fcf [735233,120459] 0 2024-02-20T08:06:18.164 INFO:tasks.workunit.client.1.smithi194.stdout:1/756: truncate d2/d8/d12/dc9/d26/d3d/fda 898801 0 2024-02-20T08:06:18.166 INFO:tasks.workunit.client.1.smithi194.stdout:6/872: rename df/dab/d1d/d28/d46/d5a/d6b/dbb/f114 to df/dab/d1d/d28/d46/d5a/d6b/f123 0 2024-02-20T08:06:18.167 INFO:tasks.workunit.client.1.smithi194.stdout:4/744: sync 2024-02-20T08:06:18.167 INFO:tasks.workunit.client.1.smithi194.stdout:2/817: sync 2024-02-20T08:06:18.167 INFO:tasks.workunit.client.1.smithi194.stdout:8/746: mkdir d2/d14/d18/d45/d69/d106 0 2024-02-20T08:06:18.167 INFO:tasks.workunit.client.1.smithi194.stdout:6/873: stat df/d42/c6e 0 2024-02-20T08:06:18.167 INFO:tasks.workunit.client.1.smithi194.stdout:7/816: read d11/d6e/f87 [3038779,3369] 0 2024-02-20T08:06:18.168 INFO:tasks.workunit.client.1.smithi194.stdout:0/725: dread d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:18.169 INFO:tasks.workunit.client.1.smithi194.stdout:2/818: read - df/fee zero size 2024-02-20T08:06:18.170 INFO:tasks.workunit.client.1.smithi194.stdout:1/757: mknod d2/d8/d12/dc9/d26/d57/d58/cf8 0 2024-02-20T08:06:18.171 INFO:tasks.workunit.client.1.smithi194.stdout:3/802: dwrite d5/d10/d28/f6c [0,4194304] 0 2024-02-20T08:06:18.173 INFO:tasks.workunit.client.1.smithi194.stdout:7/817: write d11/d2d/d38/d4a/d93/fe3 [177844,93151] 0 2024-02-20T08:06:18.173 INFO:tasks.workunit.client.1.smithi194.stdout:2/819: chown df/d14/d80/d85/db8/fde 11 1 2024-02-20T08:06:18.173 INFO:tasks.workunit.client.1.smithi194.stdout:9/854: link d4/d20/d5c/l5d d4/deb/l11e 0 2024-02-20T08:06:18.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/855: fsync d4/d20/d43/d51/ffa 0 2024-02-20T08:06:18.176 INFO:tasks.workunit.client.1.smithi194.stdout:2/820: dread - df/d14/d19/d5c/fd5 zero size 2024-02-20T08:06:18.177 INFO:tasks.workunit.client.1.smithi194.stdout:7/818: truncate d11/d2d/d38/d4a/d27/f76 1045256 0 2024-02-20T08:06:18.179 INFO:tasks.workunit.client.1.smithi194.stdout:4/745: fdatasync d0/df/d11/f7b 0 2024-02-20T08:06:18.180 INFO:tasks.workunit.client.1.smithi194.stdout:0/726: truncate d6/d2b/f63 2861209 0 2024-02-20T08:06:18.182 INFO:tasks.workunit.client.1.smithi194.stdout:6/874: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/da5/d124 0 2024-02-20T08:06:18.183 INFO:tasks.workunit.client.1.smithi194.stdout:1/758: creat d2/d8/df/ff9 x:0 0 0 2024-02-20T08:06:18.184 INFO:tasks.workunit.client.1.smithi194.stdout:2/821: dwrite df/d14/f66 [0,4194304] 0 2024-02-20T08:06:18.185 INFO:tasks.workunit.client.1.smithi194.stdout:3/803: creat d5/d10/d16/d7b/d94/fff x:0 0 0 2024-02-20T08:06:18.187 INFO:tasks.workunit.client.1.smithi194.stdout:8/747: fdatasync d2/d14/d18/d45/d4e/d9f/ff5 0 2024-02-20T08:06:18.187 INFO:tasks.workunit.client.1.smithi194.stdout:3/804: chown d5/d10/d16/f3a 9 1 2024-02-20T08:06:18.188 INFO:tasks.workunit.client.1.smithi194.stdout:9/856: mkdir d4/d37/ddf/dc8/d11f 0 2024-02-20T08:06:18.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/821: dwrite d4/d20/d2b/d79/f81 [4194304,4194304] 0 2024-02-20T08:06:18.191 INFO:tasks.workunit.client.1.smithi194.stdout:9/857: chown d4/d1b/d2e/lc6 8398310 1 2024-02-20T08:06:18.191 INFO:tasks.workunit.client.1.smithi194.stdout:4/746: creat d0/d10/d1c/d4d/fd9 x:0 0 0 2024-02-20T08:06:18.192 INFO:tasks.workunit.client.1.smithi194.stdout:0/727: rename d6/d2b/d35/d9c/dd0 to d6/d2b/d35/d39/df0 0 2024-02-20T08:06:18.194 INFO:tasks.workunit.client.1.smithi194.stdout:6/875: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/d93/d125 0 2024-02-20T08:06:18.196 INFO:tasks.workunit.client.1.smithi194.stdout:1/759: write d2/d8/d60/de0/ff1 [1909915,75498] 0 2024-02-20T08:06:18.199 INFO:tasks.workunit.client.1.smithi194.stdout:2/822: mknod df/d14/d19/cf7 0 2024-02-20T08:06:18.200 INFO:tasks.workunit.client.1.smithi194.stdout:2/823: fdatasync df/d14/d19/d5c/d60/d63/d92/fbf 0 2024-02-20T08:06:18.203 INFO:tasks.workunit.client.1.smithi194.stdout:7/819: link d11/d2d/d38/d37/d43/d7b/d91/fca d11/d6e/dc6/ffe 0 2024-02-20T08:06:18.206 INFO:tasks.workunit.client.1.smithi194.stdout:3/805: creat d5/d10/d28/d41/d73/d8c/f100 x:0 0 0 2024-02-20T08:06:18.207 INFO:tasks.workunit.client.1.smithi194.stdout:5/822: rmdir d4/d6 39 2024-02-20T08:06:18.208 INFO:tasks.workunit.client.1.smithi194.stdout:4/747: symlink d0/d10/lda 0 2024-02-20T08:06:18.209 INFO:tasks.workunit.client.1.smithi194.stdout:4/748: chown d0/d2/d3e/f71 24889496 1 2024-02-20T08:06:18.215 INFO:tasks.workunit.client.1.smithi194.stdout:9/858: mknod d4/d20/d5c/dd0/def/d11d/c120 0 2024-02-20T08:06:18.216 INFO:tasks.workunit.client.1.smithi194.stdout:9/859: dread - d4/d20/d43/d51/ffa zero size 2024-02-20T08:06:18.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/728: write d6/d2b/d35/d42/d1e/f5a [1720808,73159] 0 2024-02-20T08:06:18.218 INFO:tasks.workunit.client.1.smithi194.stdout:9/860: dread - d4/d1b/d90/f11a zero size 2024-02-20T08:06:18.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/729: stat d6/d2b/d35/d9c/d62/dc1 0 2024-02-20T08:06:18.219 INFO:tasks.workunit.client.1.smithi194.stdout:9/861: chown d4/d20/f82 483949 1 2024-02-20T08:06:18.220 INFO:tasks.workunit.client.1.smithi194.stdout:2/824: mkdir df/d14/d19/d5c/d60/df8 0 2024-02-20T08:06:18.222 INFO:tasks.workunit.client.1.smithi194.stdout:8/748: link d2/d14/d18/f83 d2/d14/d18/d45/d4e/dbe/f107 0 2024-02-20T08:06:18.223 INFO:tasks.workunit.client.1.smithi194.stdout:4/749: mkdir d0/d5c/d60/d4a/d4e/dbe/ddb 0 2024-02-20T08:06:18.225 INFO:tasks.workunit.client.1.smithi194.stdout:6/876: creat df/f126 x:0 0 0 2024-02-20T08:06:18.225 INFO:tasks.workunit.client.1.smithi194.stdout:9/862: mknod d4/deb/c121 0 2024-02-20T08:06:18.227 INFO:tasks.workunit.client.1.smithi194.stdout:0/730: symlink d6/d2b/d35/d42/d1e/d45/d58/lf1 0 2024-02-20T08:06:18.228 INFO:tasks.workunit.client.1.smithi194.stdout:8/749: rename d2/d14/l20 to d2/d14/d18/d45/d69/daf/dea/l108 0 2024-02-20T08:06:18.229 INFO:tasks.workunit.client.1.smithi194.stdout:1/760: dread d2/d8/d12/dc9/d26/f2d [0,4194304] 0 2024-02-20T08:06:18.231 INFO:tasks.workunit.client.1.smithi194.stdout:9/863: chown d4/d37/ddf/d42/d4e/d6e/d88/cb2 195094 1 2024-02-20T08:06:18.231 INFO:tasks.workunit.client.1.smithi194.stdout:2/825: dread df/d14/d24/f6c [0,4194304] 0 2024-02-20T08:06:18.231 INFO:tasks.workunit.client.1.smithi194.stdout:6/877: unlink df/dab/d1d/d28/d46/d5a/d6b/dbb/df7/l10b 0 2024-02-20T08:06:18.231 INFO:tasks.workunit.client.1.smithi194.stdout:0/731: symlink d6/dbe/lf2 0 2024-02-20T08:06:18.235 INFO:tasks.workunit.client.1.smithi194.stdout:7/820: dwrite d11/d2d/d38/d37/d43/f82 [0,4194304] 0 2024-02-20T08:06:18.235 INFO:tasks.workunit.client.1.smithi194.stdout:9/864: write d4/d37/ddf/d59/f5b [4521597,3968] 0 2024-02-20T08:06:18.239 INFO:tasks.workunit.client.1.smithi194.stdout:6/878: creat df/dab/d1d/d28/d46/f127 x:0 0 0 2024-02-20T08:06:18.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/826: mkdir df/d14/d19/d5c/d97/d9a/ddd/df9 0 2024-02-20T08:06:18.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/750: dwrite d2/d14/d18/d45/d7b/dc7/d78/d98/f86 [4194304,4194304] 0 2024-02-20T08:06:18.242 INFO:tasks.workunit.client.1.smithi194.stdout:0/732: dwrite d6/d2b/d35/d42/f28 [0,4194304] 0 2024-02-20T08:06:18.244 INFO:tasks.workunit.client.1.smithi194.stdout:1/761: creat d2/d8/d12/dc9/d26/d3d/ddf/ffa x:0 0 0 2024-02-20T08:06:18.244 INFO:tasks.workunit.client.1.smithi194.stdout:8/751: dread - d2/d14/d18/d45/d7b/dc7/d78/dbc/f105 zero size 2024-02-20T08:06:18.245 INFO:tasks.workunit.client.1.smithi194.stdout:1/762: dread - d2/d8/d12/dc9/fc1 zero size 2024-02-20T08:06:18.246 INFO:tasks.workunit.client.1.smithi194.stdout:9/865: unlink d4/d8b/fd9 0 2024-02-20T08:06:18.251 INFO:tasks.workunit.client.1.smithi194.stdout:7/821: mkdir d11/d2d/d38/d37/d43/d8e/d6b/dff 0 2024-02-20T08:06:18.258 INFO:tasks.workunit.client.1.smithi194.stdout:0/733: creat d6/d2b/ff3 x:0 0 0 2024-02-20T08:06:18.259 INFO:tasks.workunit.client.1.smithi194.stdout:8/752: creat d2/d14/d18/d45/d69/d9b/f109 x:0 0 0 2024-02-20T08:06:18.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/763: symlink d2/d8/d12/dc9/d61/d68/lfb 0 2024-02-20T08:06:18.263 INFO:tasks.workunit.client.1.smithi194.stdout:9/866: creat d4/d37/d4f/d91/f122 x:0 0 0 2024-02-20T08:06:18.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/764: chown d2/d8/d12/dc9/d61/d7e/fe9 15980 1 2024-02-20T08:06:18.271 INFO:tasks.workunit.client.1.smithi194.stdout:7/822: mkdir d11/d2d/d38/d37/d100 0 2024-02-20T08:06:18.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/823: write d11/d2d/d38/d4a/d27/d51/d77/de2/fe6 [62089,105107] 0 2024-02-20T08:06:18.275 INFO:tasks.workunit.client.1.smithi194.stdout:1/765: truncate d2/f36 2834814 0 2024-02-20T08:06:18.277 INFO:tasks.workunit.client.1.smithi194.stdout:0/734: dwrite d6/d2b/d35/d48/f4a [0,4194304] 0 2024-02-20T08:06:18.279 INFO:tasks.workunit.client.1.smithi194.stdout:7/824: dread - d11/d2d/d38/d4a/d27/d51/d84/fb4 zero size 2024-02-20T08:06:18.279 INFO:tasks.workunit.client.1.smithi194.stdout:2/827: getdents df/d14 0 2024-02-20T08:06:18.280 INFO:tasks.workunit.client.1.smithi194.stdout:6/879: getdents df/dab/d1d/d28/d2b/d80 0 2024-02-20T08:06:18.282 INFO:tasks.workunit.client.1.smithi194.stdout:6/880: chown df/dab/d1d/d28/d2b/d103/d104 337602 1 2024-02-20T08:06:18.286 INFO:tasks.workunit.client.1.smithi194.stdout:7/825: truncate d11/d2d/d38/d4a/d27/d51/d84/fb4 370559 0 2024-02-20T08:06:18.288 INFO:tasks.workunit.client.1.smithi194.stdout:0/735: dwrite d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:18.290 INFO:tasks.workunit.client.1.smithi194.stdout:7/826: write d11/d2d/d38/d4a/d93/fe3 [540156,110157] 0 2024-02-20T08:06:18.290 INFO:tasks.workunit.client.1.smithi194.stdout:1/766: mkdir d2/d8/d12/dc9/d26/dfc 0 2024-02-20T08:06:18.291 INFO:tasks.workunit.client.1.smithi194.stdout:2/828: dwrite df/d14/d19/d5c/f65 [0,4194304] 0 2024-02-20T08:06:18.293 INFO:tasks.workunit.client.1.smithi194.stdout:1/767: chown d2/d8/d12/dc9/d26/d45/l5c 479 1 2024-02-20T08:06:18.298 INFO:tasks.workunit.client.1.smithi194.stdout:8/753: dread d2/f31 [0,4194304] 0 2024-02-20T08:06:18.298 INFO:tasks.workunit.client.1.smithi194.stdout:6/881: fsync df/d42/f72 0 2024-02-20T08:06:18.306 INFO:tasks.workunit.client.1.smithi194.stdout:8/754: creat d2/d14/d18/d45/d4e/dbe/dc3/f10a x:0 0 0 2024-02-20T08:06:18.322 INFO:tasks.workunit.client.1.smithi194.stdout:9/867: rename d4/d20/d5c/dd0/def/f101 to d4/d20/d43/f123 0 2024-02-20T08:06:18.323 INFO:tasks.workunit.client.1.smithi194.stdout:8/755: read - d2/d14/d18/d45/d7b/dc7/d78/dbc/f105 zero size 2024-02-20T08:06:18.324 INFO:tasks.workunit.client.1.smithi194.stdout:6/882: rmdir df/dab/d1d/d28/d2b/d9b 39 2024-02-20T08:06:18.327 INFO:tasks.workunit.client.1.smithi194.stdout:0/736: dwrite d6/d2b/d35/d42/f16 [0,4194304] 0 2024-02-20T08:06:18.329 INFO:tasks.workunit.client.1.smithi194.stdout:1/768: dread d2/d8/d12/dc9/d61/fa9 [0,4194304] 0 2024-02-20T08:06:18.329 INFO:tasks.workunit.client.1.smithi194.stdout:9/868: fsync d4/d1b/d2e/f10e 0 2024-02-20T08:06:18.332 INFO:tasks.workunit.client.1.smithi194.stdout:2/829: rename df/d14/d24/f48 to df/d5b/ffa 0 2024-02-20T08:06:18.336 INFO:tasks.workunit.client.1.smithi194.stdout:1/769: rename d2/d8/d12/dc9/d61/d7d/dbf/fd2 to d2/d8/d12/dc9/d26/d57/ffd 0 2024-02-20T08:06:18.338 INFO:tasks.workunit.client.1.smithi194.stdout:0/737: getdents d6/d2b/d35/d42/d1e/d3c/da0 0 2024-02-20T08:06:18.340 INFO:tasks.workunit.client.1.smithi194.stdout:0/738: write d6/d2b/d35/d39/fc2 [882932,66891] 0 2024-02-20T08:06:18.341 INFO:tasks.workunit.client.1.smithi194.stdout:2/830: rename df/d14/d19/d5c/d60/d63/d92/fbf to df/d3a/db2/ffb 0 2024-02-20T08:06:18.343 INFO:tasks.workunit.client.1.smithi194.stdout:9/869: dwrite d4/d20/d5c/dd0/def/f10a [0,4194304] 0 2024-02-20T08:06:18.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/831: write df/d5b/d61/dce/fd6 [4916369,66259] 0 2024-02-20T08:06:18.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/870: fsync d4/d20/d41/db7/fc7 0 2024-02-20T08:06:18.347 INFO:tasks.workunit.client.1.smithi194.stdout:6/883: dread df/dab/d1d/d28/d2b/d80/fb1 [0,4194304] 0 2024-02-20T08:06:18.348 INFO:tasks.workunit.client.1.smithi194.stdout:1/770: write d2/d8/d12/dc9/d26/f2d [4064179,126507] 0 2024-02-20T08:06:18.348 INFO:tasks.workunit.client.1.smithi194.stdout:0/739: symlink d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/lf4 0 2024-02-20T08:06:18.354 INFO:tasks.workunit.client.1.smithi194.stdout:9/871: read d4/d37/ddf/d59/f5b [644475,86150] 0 2024-02-20T08:06:18.354 INFO:tasks.workunit.client.1.smithi194.stdout:9/872: chown d4/d37/d4f/d91/f122 7247649 1 2024-02-20T08:06:18.356 INFO:tasks.workunit.client.1.smithi194.stdout:0/740: fsync d6/d2b/d35/f4c 0 2024-02-20T08:06:18.357 INFO:tasks.workunit.client.1.smithi194.stdout:2/832: mknod df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/cfc 0 2024-02-20T08:06:18.358 INFO:tasks.workunit.client.1.smithi194.stdout:1/771: mknod d2/cfe 0 2024-02-20T08:06:18.359 INFO:tasks.workunit.client.1.smithi194.stdout:3/806: sync 2024-02-20T08:06:18.362 INFO:tasks.workunit.client.1.smithi194.stdout:2/833: mknod df/d5b/d61/dce/cfd 0 2024-02-20T08:06:18.362 INFO:tasks.workunit.client.1.smithi194.stdout:0/741: dwrite d6/d2b/d35/d39/d8f/fcd [4194304,4194304] 0 2024-02-20T08:06:18.362 INFO:tasks.workunit.client.1.smithi194.stdout:2/834: chown df/d14/d80/d85/ld1 0 1 2024-02-20T08:06:18.364 INFO:tasks.workunit.client.1.smithi194.stdout:1/772: creat d2/d8/d12/dc9/d26/d45/d98/fff x:0 0 0 2024-02-20T08:06:18.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/835: write df/d14/d19/d5c/f65 [4542430,17985] 0 2024-02-20T08:06:18.365 INFO:tasks.workunit.client.1.smithi194.stdout:3/807: mkdir d5/d10/d17/dc2/d101 0 2024-02-20T08:06:18.368 INFO:tasks.workunit.client.1.smithi194.stdout:6/884: getdents df/dab/d1d/d28/d46/d109 0 2024-02-20T08:06:18.370 INFO:tasks.workunit.client.1.smithi194.stdout:1/773: mknod d2/d8/d60/d75/c100 0 2024-02-20T08:06:18.372 INFO:tasks.workunit.client.1.smithi194.stdout:2/836: symlink df/d3a/db2/lfe 0 2024-02-20T08:06:18.373 INFO:tasks.workunit.client.1.smithi194.stdout:2/837: stat df/d14/d19/d5c/d78/fe8 0 2024-02-20T08:06:18.373 INFO:tasks.workunit.client.1.smithi194.stdout:9/873: link d4/d1b/d2e/f45 d4/d37/ddf/d42/d4e/d6e/d88/df6/f124 0 2024-02-20T08:06:18.374 INFO:tasks.workunit.client.1.smithi194.stdout:6/885: dwrite df/d42/dcf/f8d [0,4194304] 0 2024-02-20T08:06:18.376 INFO:tasks.workunit.client.1.smithi194.stdout:3/808: mknod d5/d10/d28/dd3/db7/def/c102 0 2024-02-20T08:06:18.376 INFO:tasks.workunit.client.1.smithi194.stdout:2/838: truncate df/d14/d80/feb 631755 0 2024-02-20T08:06:18.377 INFO:tasks.workunit.client.1.smithi194.stdout:9/874: rmdir d4/d20/d43/daa/dcb/d104/dd2 39 2024-02-20T08:06:18.377 INFO:tasks.workunit.client.1.smithi194.stdout:2/839: chown df/d5b/d61/fe0 0 1 2024-02-20T08:06:18.380 INFO:tasks.workunit.client.1.smithi194.stdout:0/742: fdatasync d6/d2b/d35/d42/d1e/d45/d58/f8d 0 2024-02-20T08:06:18.383 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:18 smithi123 ceph-mon[29383]: pgmap v58: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 152 MiB/s wr, 326 op/s 2024-02-20T08:06:18.388 INFO:tasks.workunit.client.1.smithi194.stdout:3/809: link d5/d10/fca d5/d10/d28/d41/d73/f103 0 2024-02-20T08:06:18.388 INFO:tasks.workunit.client.1.smithi194.stdout:0/743: truncate d6/d2b/d35/d42/d1e/f27 640853 0 2024-02-20T08:06:18.393 INFO:tasks.workunit.client.1.smithi194.stdout:6/886: rmdir df/dab/d1d/d28/d46/d5a/d6b/d83/da5/d124 0 2024-02-20T08:06:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:18 smithi194 ceph-mon[37804]: pgmap v58: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 152 MiB/s wr, 326 op/s 2024-02-20T08:06:18.394 INFO:tasks.workunit.client.1.smithi194.stdout:0/744: dwrite d6/fad [0,4194304] 0 2024-02-20T08:06:18.395 INFO:tasks.workunit.client.1.smithi194.stdout:0/745: stat d6/d2b/d35/d9c 0 2024-02-20T08:06:18.395 INFO:tasks.workunit.client.1.smithi194.stdout:6/887: chown df/dab/d1d/d28/d46/d5a/d6b/d83/fea 1 1 2024-02-20T08:06:18.396 INFO:tasks.workunit.client.1.smithi194.stdout:6/888: chown df/dab/d1d/d28/d2b/l119 14344 1 2024-02-20T08:06:18.398 INFO:tasks.workunit.client.1.smithi194.stdout:3/810: mkdir d5/d10/d28/db4/d104 0 2024-02-20T08:06:18.399 INFO:tasks.workunit.client.1.smithi194.stdout:6/889: mkdir df/dab/d1d/d28/d2b/d80/d128 0 2024-02-20T08:06:18.400 INFO:tasks.workunit.client.1.smithi194.stdout:0/746: truncate d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/f89 25155 0 2024-02-20T08:06:18.402 INFO:tasks.workunit.client.1.smithi194.stdout:3/811: symlink d5/d10/df2/l105 0 2024-02-20T08:06:18.403 INFO:tasks.workunit.client.1.smithi194.stdout:3/812: readlink d5/d10/d17/l3c 0 2024-02-20T08:06:18.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/774: dwrite d2/d8/d12/dc9/d61/d68/db7/fc8 [0,4194304] 0 2024-02-20T08:06:18.405 INFO:tasks.workunit.client.1.smithi194.stdout:1/775: write d2/d8/d12/dc9/d26/d45/fa6 [1319112,84906] 0 2024-02-20T08:06:18.406 INFO:tasks.workunit.client.1.smithi194.stdout:6/890: mknod df/dab/d1d/d28/d2b/c129 0 2024-02-20T08:06:18.410 INFO:tasks.workunit.client.1.smithi194.stdout:3/813: mknod d5/d10/d62/c106 0 2024-02-20T08:06:18.414 INFO:tasks.workunit.client.1.smithi194.stdout:0/747: creat d6/d2b/d35/d48/ff5 x:0 0 0 2024-02-20T08:06:18.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/891: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/d12a 0 2024-02-20T08:06:18.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/892: chown df/f3c 2606727 1 2024-02-20T08:06:18.420 INFO:tasks.workunit.client.1.smithi194.stdout:0/748: creat d6/d2b/d35/d42/d1e/d45/daa/ff6 x:0 0 0 2024-02-20T08:06:18.420 INFO:tasks.workunit.client.1.smithi194.stdout:1/776: dwrite d2/d8/d12/dc9/d26/d57/ffd [0,4194304] 0 2024-02-20T08:06:18.421 INFO:tasks.workunit.client.1.smithi194.stdout:1/777: write d2/d8/f85 [3113545,106769] 0 2024-02-20T08:06:18.422 INFO:tasks.workunit.client.1.smithi194.stdout:1/778: write d2/d8/d12/dc9/f1d [3824558,44018] 0 2024-02-20T08:06:18.424 INFO:tasks.workunit.client.1.smithi194.stdout:0/749: mkdir d6/d2b/d35/d9c/d62/dc1/df7 0 2024-02-20T08:06:18.426 INFO:tasks.workunit.client.1.smithi194.stdout:0/750: read d6/d2b/f50 [1013880,72087] 0 2024-02-20T08:06:18.432 INFO:tasks.workunit.client.1.smithi194.stdout:1/779: creat d2/d8/d12/dc9/d61/d68/db7/f101 x:0 0 0 2024-02-20T08:06:18.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/814: link d5/d10/f52 d5/d10/d16/d7b/f107 0 2024-02-20T08:06:18.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/780: creat d2/d8/d12/dc9/d61/d7e/f102 x:0 0 0 2024-02-20T08:06:18.440 INFO:tasks.workunit.client.1.smithi194.stdout:1/781: write d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [5963342,83670] 0 2024-02-20T08:06:18.508 INFO:tasks.workunit.client.1.smithi194.stdout:4/750: sync 2024-02-20T08:06:18.509 INFO:tasks.workunit.client.1.smithi194.stdout:5/823: sync 2024-02-20T08:06:18.512 INFO:tasks.workunit.client.1.smithi194.stdout:1/782: symlink d2/d8/d12/dc9/d61/d7e/l103 0 2024-02-20T08:06:18.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/783: write d2/d8/d12/dc9/d61/d68/f89 [4598628,119356] 0 2024-02-20T08:06:18.516 INFO:tasks.workunit.client.1.smithi194.stdout:1/784: truncate d2/d8/d12/dc9/fc1 881433 0 2024-02-20T08:06:18.516 INFO:tasks.workunit.client.1.smithi194.stdout:5/824: truncate d4/d6/dd/d25/d7d/fbe 1047298 0 2024-02-20T08:06:18.517 INFO:tasks.workunit.client.1.smithi194.stdout:4/751: mkdir d0/df/d11/dbb/ddc 0 2024-02-20T08:06:18.518 INFO:tasks.workunit.client.1.smithi194.stdout:4/752: chown d0/df/d11/dba/c5b 144785 1 2024-02-20T08:06:18.520 INFO:tasks.workunit.client.1.smithi194.stdout:1/785: dread d2/d8/d12/dc9/d26/f2d [0,4194304] 0 2024-02-20T08:06:18.521 INFO:tasks.workunit.client.1.smithi194.stdout:5/825: read d4/d6/d11/d2f/d77/fa9 [2615099,40605] 0 2024-02-20T08:06:18.521 INFO:tasks.workunit.client.1.smithi194.stdout:1/786: chown d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/c51 37193 1 2024-02-20T08:06:18.525 INFO:tasks.workunit.client.1.smithi194.stdout:4/753: rmdir d0/d10/d1c 39 2024-02-20T08:06:18.528 INFO:tasks.workunit.client.1.smithi194.stdout:0/751: write d6/d2b/d35/d42/d1e/f3f [4465129,74953] 0 2024-02-20T08:06:18.528 INFO:tasks.workunit.client.1.smithi194.stdout:0/752: fsync d6/f3d 0 2024-02-20T08:06:18.531 INFO:tasks.workunit.client.1.smithi194.stdout:1/787: truncate d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f44 3455188 0 2024-02-20T08:06:18.540 INFO:tasks.workunit.client.1.smithi194.stdout:0/753: dread d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:18.541 INFO:tasks.workunit.client.1.smithi194.stdout:0/754: chown d6/d2b/d35/d39/f8e 1 1 2024-02-20T08:06:18.543 INFO:tasks.workunit.client.1.smithi194.stdout:4/754: mknod d0/d10/cdd 0 2024-02-20T08:06:18.549 INFO:tasks.workunit.client.1.smithi194.stdout:1/788: creat d2/d8/d60/de0/f104 x:0 0 0 2024-02-20T08:06:18.550 INFO:tasks.workunit.client.1.smithi194.stdout:5/826: rename d4/d20/faa to d4/d6/dd/ffc 0 2024-02-20T08:06:18.551 INFO:tasks.workunit.client.1.smithi194.stdout:0/755: mkdir d6/d2b/d35/d42/d1e/d45/df8 0 2024-02-20T08:06:18.556 INFO:tasks.workunit.client.1.smithi194.stdout:1/789: dwrite d2/d8/d12/dc9/d26/d3d/ddf/ffa [0,4194304] 0 2024-02-20T08:06:18.557 INFO:tasks.workunit.client.1.smithi194.stdout:1/790: readlink d2/d8/d12/leb 0 2024-02-20T08:06:18.558 INFO:tasks.workunit.client.1.smithi194.stdout:0/756: dwrite d6/d2b/d35/d42/f16 [4194304,4194304] 0 2024-02-20T08:06:18.575 INFO:tasks.workunit.client.1.smithi194.stdout:8/756: sync 2024-02-20T08:06:18.575 INFO:tasks.workunit.client.1.smithi194.stdout:7/827: sync 2024-02-20T08:06:18.575 INFO:tasks.workunit.client.1.smithi194.stdout:8/757: chown d2/d14/d18 19504 1 2024-02-20T08:06:18.577 INFO:tasks.workunit.client.1.smithi194.stdout:0/757: dread d6/d2b/d35/d42/d1e/f3f [0,4194304] 0 2024-02-20T08:06:18.578 INFO:tasks.workunit.client.1.smithi194.stdout:0/758: chown d6/d2b/d35/d42/cca 248066604 1 2024-02-20T08:06:18.581 INFO:tasks.workunit.client.1.smithi194.stdout:0/759: dread d6/d2b/d35/d48/f4a [0,4194304] 0 2024-02-20T08:06:18.585 INFO:tasks.workunit.client.1.smithi194.stdout:5/827: write d4/d6/dd/d3a/f9e [354571,105358] 0 2024-02-20T08:06:18.591 INFO:tasks.workunit.client.1.smithi194.stdout:1/791: dread - d2/d8/d60/fa7 zero size 2024-02-20T08:06:18.592 INFO:tasks.workunit.client.1.smithi194.stdout:1/792: read - d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/ff2 zero size 2024-02-20T08:06:18.594 INFO:tasks.workunit.client.1.smithi194.stdout:4/755: dread d0/d10/d1c/d21/f57 [0,4194304] 0 2024-02-20T08:06:18.595 INFO:tasks.workunit.client.1.smithi194.stdout:8/758: creat d2/d14/d18/d45/d69/daf/f10b x:0 0 0 2024-02-20T08:06:18.598 INFO:tasks.workunit.client.1.smithi194.stdout:5/828: symlink d4/d20/d2b/ddf/dc4/d28/lfd 0 2024-02-20T08:06:18.602 INFO:tasks.workunit.client.1.smithi194.stdout:1/793: dread d2/d8/d12/dc9/f3f [0,4194304] 0 2024-02-20T08:06:18.603 INFO:tasks.workunit.client.1.smithi194.stdout:4/756: chown d0/df/d41/d69/c7d 1106 1 2024-02-20T08:06:18.604 INFO:tasks.workunit.client.1.smithi194.stdout:4/757: write d0/d5c/d60/fc5 [504258,36922] 0 2024-02-20T08:06:18.605 INFO:tasks.workunit.client.1.smithi194.stdout:8/759: chown d2/d14/f5d 6977 1 2024-02-20T08:06:18.607 INFO:tasks.workunit.client.1.smithi194.stdout:0/760: mkdir d6/d2b/d35/d48/df9 0 2024-02-20T08:06:18.613 INFO:tasks.workunit.client.1.smithi194.stdout:0/761: mknod d6/d2b/d35/d9c/d62/dc1/df7/cfa 0 2024-02-20T08:06:18.618 INFO:tasks.workunit.client.1.smithi194.stdout:5/829: rename d4/d6/dd/d25/d78/d8b/lc0 to d4/d6/dd/d25/d7d/lfe 0 2024-02-20T08:06:18.619 INFO:tasks.workunit.client.1.smithi194.stdout:5/830: chown d4/d6/d11/d2f/d77/d90/fe9 209245 1 2024-02-20T08:06:18.623 INFO:tasks.workunit.client.1.smithi194.stdout:5/831: chown d4/d6/d11/f7e 22169391 1 2024-02-20T08:06:18.623 INFO:tasks.workunit.client.1.smithi194.stdout:5/832: read d4/d6/da5/fda [191320,39868] 0 2024-02-20T08:06:18.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/875: sync 2024-02-20T08:06:18.648 INFO:tasks.workunit.client.1.smithi194.stdout:6/893: sync 2024-02-20T08:06:18.648 INFO:tasks.workunit.client.1.smithi194.stdout:2/840: sync 2024-02-20T08:06:18.654 INFO:tasks.workunit.client.1.smithi194.stdout:2/841: dwrite df/d14/d19/d5c/d60/f67 [0,4194304] 0 2024-02-20T08:06:18.654 INFO:tasks.workunit.client.1.smithi194.stdout:2/842: stat df/d3a/ce2 0 2024-02-20T08:06:18.659 INFO:tasks.workunit.client.1.smithi194.stdout:6/894: dread df/d18/f49 [0,4194304] 0 2024-02-20T08:06:18.674 INFO:tasks.workunit.client.1.smithi194.stdout:9/876: mknod d4/d20/d41/db7/c125 0 2024-02-20T08:06:18.690 INFO:tasks.workunit.client.1.smithi194.stdout:1/794: sync 2024-02-20T08:06:18.696 INFO:tasks.workunit.client.1.smithi194.stdout:2/843: rmdir df/d3a/db2 39 2024-02-20T08:06:18.698 INFO:tasks.workunit.client.1.smithi194.stdout:2/844: write df/d14/d24/d56/d6b/fbc [896319,65801] 0 2024-02-20T08:06:18.699 INFO:tasks.workunit.client.1.smithi194.stdout:6/895: fsync df/dab/d1d/d28/d2b/f3e 0 2024-02-20T08:06:18.706 INFO:tasks.workunit.client.1.smithi194.stdout:1/795: symlink d2/d8/d12/dc9/d26/d3d/d71/d8c/l105 0 2024-02-20T08:06:18.708 INFO:tasks.workunit.client.1.smithi194.stdout:9/877: read d4/d20/d41/f7c [62957,120819] 0 2024-02-20T08:06:18.711 INFO:tasks.workunit.client.1.smithi194.stdout:2/845: creat df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/fff x:0 0 0 2024-02-20T08:06:18.713 INFO:tasks.workunit.client.1.smithi194.stdout:6/896: creat df/dab/d1d/d28/d46/d5a/d6b/d83/d93/f12b x:0 0 0 2024-02-20T08:06:18.716 INFO:tasks.workunit.client.1.smithi194.stdout:9/878: stat d4/d20/d43/daa/dcb/d104/dd2/d10f 0 2024-02-20T08:06:18.719 INFO:tasks.workunit.client.1.smithi194.stdout:2/846: unlink df/d14/f8f 0 2024-02-20T08:06:18.733 INFO:tasks.workunit.client.1.smithi194.stdout:8/760: rename d2/dd9 to d2/d80/dd1/d10c 0 2024-02-20T08:06:18.735 INFO:tasks.workunit.client.1.smithi194.stdout:0/762: rename d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/fab to d6/d2b/d35/d48/df9/ffb 0 2024-02-20T08:06:18.737 INFO:tasks.workunit.client.1.smithi194.stdout:8/761: symlink d2/d14/d18/d45/d7b/dc7/l10d 0 2024-02-20T08:06:18.740 INFO:tasks.workunit.client.1.smithi194.stdout:6/897: rename df/dab/d1d/d28/d46/d5a/d6b/dbb/df7 to df/dbe/d12c 0 2024-02-20T08:06:18.740 INFO:tasks.workunit.client.1.smithi194.stdout:8/762: write d2/d14/d18/d45/d69/daf/db3/ffb [643228,33207] 0 2024-02-20T08:06:18.741 INFO:tasks.workunit.client.1.smithi194.stdout:5/833: sync 2024-02-20T08:06:18.741 INFO:tasks.workunit.client.1.smithi194.stdout:0/763: dwrite d6/d2b/d35/d48/d60/fb2 [0,4194304] 0 2024-02-20T08:06:18.744 INFO:tasks.workunit.client.1.smithi194.stdout:8/763: stat d2/d14/d18/d45/d69/d9b/f109 0 2024-02-20T08:06:18.744 INFO:tasks.workunit.client.1.smithi194.stdout:5/834: write d4/d6/f7c [285173,24094] 0 2024-02-20T08:06:18.746 INFO:tasks.workunit.client.1.smithi194.stdout:6/898: getdents df/ded 0 2024-02-20T08:06:18.747 INFO:tasks.workunit.client.1.smithi194.stdout:7/828: dwrite d11/d2d/d38/d4a/d27/d51/d84/f6f [0,4194304] 0 2024-02-20T08:06:18.748 INFO:tasks.workunit.client.1.smithi194.stdout:8/764: creat d2/d14/d18/d45/d4e/d9f/f10e x:0 0 0 2024-02-20T08:06:18.749 INFO:tasks.workunit.client.1.smithi194.stdout:5/835: rmdir d4/d6/d11/d2f/d77/d90 39 2024-02-20T08:06:18.750 INFO:tasks.workunit.client.1.smithi194.stdout:7/829: write d11/d2d/d38/d4a/d27/d51/d84/f6f [3705274,891] 0 2024-02-20T08:06:18.752 INFO:tasks.workunit.client.1.smithi194.stdout:0/764: creat d6/d2b/d35/d9c/ffc x:0 0 0 2024-02-20T08:06:18.754 INFO:tasks.workunit.client.1.smithi194.stdout:4/758: truncate d0/d4f/f6d 1073621 0 2024-02-20T08:06:18.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/899: symlink df/dab/d1d/d28/d46/d5a/l12d 0 2024-02-20T08:06:18.758 INFO:tasks.workunit.client.1.smithi194.stdout:1/796: sync 2024-02-20T08:06:18.758 INFO:tasks.workunit.client.1.smithi194.stdout:5/836: dwrite d4/f6e [0,4194304] 0 2024-02-20T08:06:18.759 INFO:tasks.workunit.client.1.smithi194.stdout:0/765: fdatasync d6/d2b/d35/d48/f4a 0 2024-02-20T08:06:18.761 INFO:tasks.workunit.client.1.smithi194.stdout:7/830: unlink d11/d2d/d38/d4a/d53/c5f 0 2024-02-20T08:06:18.762 INFO:tasks.workunit.client.1.smithi194.stdout:7/831: read d11/d2d/d38/d37/f90 [4713626,16650] 0 2024-02-20T08:06:18.765 INFO:tasks.workunit.client.1.smithi194.stdout:4/759: rename d0/d5c/d60/d4a/dd5 to d0/d5c/d60/d4a/d4e/dbe/ddb/dde 0 2024-02-20T08:06:18.769 INFO:tasks.workunit.client.1.smithi194.stdout:5/837: creat d4/d6/dd/d25/d78/d8b/fff x:0 0 0 2024-02-20T08:06:18.770 INFO:tasks.workunit.client.1.smithi194.stdout:7/832: dwrite d11/d2d/d38/d4a/d60/fbf [0,4194304] 0 2024-02-20T08:06:18.770 INFO:tasks.workunit.client.1.smithi194.stdout:8/765: getdents d2/d14/d18/d45/d90/d92 0 2024-02-20T08:06:18.780 INFO:tasks.workunit.client.1.smithi194.stdout:6/900: rename df/dab/d1d/d28/d2b/f7c to df/dbe/f12e 0 2024-02-20T08:06:18.781 INFO:tasks.workunit.client.1.smithi194.stdout:3/815: rmdir d5/d10/d17 39 2024-02-20T08:06:18.781 INFO:tasks.workunit.client.1.smithi194.stdout:4/760: write d0/d10/d1c/d21/f44 [4186128,62148] 0 2024-02-20T08:06:18.783 INFO:tasks.workunit.client.1.smithi194.stdout:7/833: symlink d11/d2d/d38/d4a/d60/dea/l101 0 2024-02-20T08:06:18.783 INFO:tasks.workunit.client.1.smithi194.stdout:5/838: dwrite d4/fe7 [0,4194304] 0 2024-02-20T08:06:18.786 INFO:tasks.workunit.client.1.smithi194.stdout:3/816: chown d5/d10/d17/fd4 481606 1 2024-02-20T08:06:18.786 INFO:tasks.workunit.client.1.smithi194.stdout:6/901: mknod df/dab/d1d/d28/d2b/d94/d96/c12f 0 2024-02-20T08:06:18.787 INFO:tasks.workunit.client.1.smithi194.stdout:0/766: dread d6/f29 [0,4194304] 0 2024-02-20T08:06:18.787 INFO:tasks.workunit.client.1.smithi194.stdout:8/766: dwrite d2/d80/fda [0,4194304] 0 2024-02-20T08:06:18.795 INFO:tasks.workunit.client.1.smithi194.stdout:3/817: symlink d5/df/d25/dcb/l108 0 2024-02-20T08:06:18.796 INFO:tasks.workunit.client.1.smithi194.stdout:5/839: mkdir d4/d6/d11/d2f/d77/d90/d100 0 2024-02-20T08:06:18.797 INFO:tasks.workunit.client.1.smithi194.stdout:3/818: dread - d5/d10/d17/dc2/fc4 zero size 2024-02-20T08:06:18.798 INFO:tasks.workunit.client.1.smithi194.stdout:4/761: dwrite d0/d10/d1c/d21/d62/f93 [4194304,4194304] 0 2024-02-20T08:06:18.799 INFO:tasks.workunit.client.1.smithi194.stdout:5/840: fdatasync d4/d6/dd/d25/d7d/de2/fa6 0 2024-02-20T08:06:18.799 INFO:tasks.workunit.client.1.smithi194.stdout:6/902: mkdir df/dab/d1d/d28/d46/d5a/d6b/d83/d93/d130 0 2024-02-20T08:06:18.800 INFO:tasks.workunit.client.1.smithi194.stdout:8/767: dread d2/d14/d18/d45/d69/fb7 [0,4194304] 0 2024-02-20T08:06:18.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/834: creat d11/d2d/d38/d37/f102 x:0 0 0 2024-02-20T08:06:18.806 INFO:tasks.workunit.client.1.smithi194.stdout:9/879: dwrite d4/d37/ddf/f9e [0,4194304] 0 2024-02-20T08:06:18.809 INFO:tasks.workunit.client.1.smithi194.stdout:2/847: write df/d14/f66 [2071233,4941] 0 2024-02-20T08:06:18.815 INFO:tasks.workunit.client.1.smithi194.stdout:4/762: rename d0/d5c/f7c to d0/d4f/fdf 0 2024-02-20T08:06:18.816 INFO:tasks.workunit.client.1.smithi194.stdout:4/763: chown d0/d2/d51/d9c 8 1 2024-02-20T08:06:18.816 INFO:tasks.workunit.client.1.smithi194.stdout:3/819: dwrite d5/df/d25/f27 [0,4194304] 0 2024-02-20T08:06:18.817 INFO:tasks.workunit.client.1.smithi194.stdout:4/764: fdatasync d0/df/d41/fc7 0 2024-02-20T08:06:18.818 INFO:tasks.workunit.client.1.smithi194.stdout:8/768: symlink d2/d14/d18/d45/d7b/dc7/d78/dbc/l10f 0 2024-02-20T08:06:18.822 INFO:tasks.workunit.client.1.smithi194.stdout:5/841: truncate d4/d20/d2b/d9b/ddb/fbb 717336 0 2024-02-20T08:06:18.827 INFO:tasks.workunit.client.1.smithi194.stdout:9/880: rmdir d4/d1b/d90 39 2024-02-20T08:06:18.833 INFO:tasks.workunit.client.1.smithi194.stdout:6/903: rename df/dab/d1d/d28/d46/d109/ffd to df/dab/d1d/d28/d5e/da7/f131 0 2024-02-20T08:06:18.837 INFO:tasks.workunit.client.1.smithi194.stdout:8/769: chown d2/d14/d18/l2f 7041 1 2024-02-20T08:06:18.838 INFO:tasks.workunit.client.1.smithi194.stdout:5/842: mkdir d4/d6/dd/d3a/d101 0 2024-02-20T08:06:18.839 INFO:tasks.workunit.client.1.smithi194.stdout:5/843: stat d4/d6/d11/d2f/d77/d90/d100 0 2024-02-20T08:06:18.841 INFO:tasks.workunit.client.1.smithi194.stdout:9/881: mknod d4/d1b/d2e/de0/c126 0 2024-02-20T08:06:18.848 INFO:tasks.workunit.client.1.smithi194.stdout:6/904: unlink df/dab/d1d/fd2 0 2024-02-20T08:06:18.853 INFO:tasks.workunit.client.1.smithi194.stdout:3/820: dread d5/d10/d17/d1d/f20 [0,4194304] 0 2024-02-20T08:06:18.853 INFO:tasks.workunit.client.1.smithi194.stdout:9/882: symlink d4/d37/d38/l127 0 2024-02-20T08:06:18.859 INFO:tasks.workunit.client.1.smithi194.stdout:1/797: sync 2024-02-20T08:06:18.862 INFO:tasks.workunit.client.1.smithi194.stdout:9/883: truncate d4/f7e 51521 0 2024-02-20T08:06:18.863 INFO:tasks.workunit.client.1.smithi194.stdout:4/765: getdents d0/d2 0 2024-02-20T08:06:18.863 INFO:tasks.workunit.client.1.smithi194.stdout:3/821: dread d5/d10/d62/fa2 [0,4194304] 0 2024-02-20T08:06:18.866 INFO:tasks.workunit.client.1.smithi194.stdout:2/848: dread df/d14/d80/d85/f86 [4194304,4194304] 0 2024-02-20T08:06:18.868 INFO:tasks.workunit.client.1.smithi194.stdout:9/884: write d4/d1b/d90/f11a [992997,44860] 0 2024-02-20T08:06:18.868 INFO:tasks.workunit.client.1.smithi194.stdout:4/766: unlink d0/cd6 0 2024-02-20T08:06:18.874 INFO:tasks.workunit.client.1.smithi194.stdout:1/798: dwrite d2/d8/d12/dc9/d26/d3d/d71/f66 [0,4194304] 0 2024-02-20T08:06:18.874 INFO:tasks.workunit.client.1.smithi194.stdout:7/835: dwrite d11/d2d/d38/d37/d43/de7/f9f [0,4194304] 0 2024-02-20T08:06:18.878 INFO:tasks.workunit.client.1.smithi194.stdout:9/885: write d4/d37/d4f/f11b [243758,36615] 0 2024-02-20T08:06:18.880 INFO:tasks.workunit.client.1.smithi194.stdout:6/905: dread df/dab/d1d/d28/d2b/d94/d96/f9c [0,4194304] 0 2024-02-20T08:06:18.882 INFO:tasks.workunit.client.1.smithi194.stdout:2/849: mkdir df/d14/d19/d5c/d97/d9a/ddd/d100 0 2024-02-20T08:06:18.883 INFO:tasks.workunit.client.1.smithi194.stdout:5/844: dwrite d4/f73 [0,4194304] 0 2024-02-20T08:06:18.884 INFO:tasks.workunit.client.1.smithi194.stdout:6/906: fdatasync df/dab/f1a 0 2024-02-20T08:06:18.885 INFO:tasks.workunit.client.1.smithi194.stdout:7/836: write d11/d2d/d38/d4a/d27/d51/d77/faf [1051357,24711] 0 2024-02-20T08:06:18.886 INFO:tasks.workunit.client.1.smithi194.stdout:8/770: dwrite d2/d14/d18/f8c [0,4194304] 0 2024-02-20T08:06:18.888 INFO:tasks.workunit.client.1.smithi194.stdout:4/767: link d0/d2/fe d0/d4f/fe0 0 2024-02-20T08:06:18.891 INFO:tasks.workunit.client.1.smithi194.stdout:0/767: sync 2024-02-20T08:06:18.891 INFO:tasks.workunit.client.1.smithi194.stdout:7/837: fsync d11/d2d/d38/d4a/d27/d51/fdf 0 2024-02-20T08:06:18.892 INFO:tasks.workunit.client.1.smithi194.stdout:2/850: readlink df/d14/d19/d5c/d60/lf3 0 2024-02-20T08:06:18.892 INFO:tasks.workunit.client.1.smithi194.stdout:7/838: chown d11/d2d 111861473 1 2024-02-20T08:06:18.894 INFO:tasks.workunit.client.1.smithi194.stdout:0/768: dread - d6/fee zero size 2024-02-20T08:06:18.896 INFO:tasks.workunit.client.1.smithi194.stdout:3/822: dwrite d5/f7c [0,4194304] 0 2024-02-20T08:06:18.897 INFO:tasks.workunit.client.1.smithi194.stdout:5/845: creat d4/d6/da5/f102 x:0 0 0 2024-02-20T08:06:18.904 INFO:tasks.workunit.client.1.smithi194.stdout:9/886: dread d4/d20/d43/fe6 [0,4194304] 0 2024-02-20T08:06:18.907 INFO:tasks.workunit.client.1.smithi194.stdout:7/839: rmdir d11/d2d/d38/d4a/d93 39 2024-02-20T08:06:18.907 INFO:tasks.workunit.client.1.smithi194.stdout:3/823: write d5/df/d60/fd0 [507043,51432] 0 2024-02-20T08:06:18.907 INFO:tasks.workunit.client.1.smithi194.stdout:8/771: creat d2/d14/d18/d45/d4e/d9f/f110 x:0 0 0 2024-02-20T08:06:18.909 INFO:tasks.workunit.client.1.smithi194.stdout:5/846: creat d4/d6/dd/d25/d7d/f103 x:0 0 0 2024-02-20T08:06:18.909 INFO:tasks.workunit.client.1.smithi194.stdout:1/799: dwrite d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f6b [0,4194304] 0 2024-02-20T08:06:18.909 INFO:tasks.workunit.client.1.smithi194.stdout:3/824: chown d5/df/d9a 1 1 2024-02-20T08:06:18.911 INFO:tasks.workunit.client.1.smithi194.stdout:9/887: mknod d4/d37/ddf/d42/c128 0 2024-02-20T08:06:18.913 INFO:tasks.workunit.client.1.smithi194.stdout:3/825: write d5/fdb [76842,42634] 0 2024-02-20T08:06:18.915 INFO:tasks.workunit.client.1.smithi194.stdout:8/772: fsync d2/d14/d18/d45/d69/d9b/fd3 0 2024-02-20T08:06:18.915 INFO:tasks.workunit.client.1.smithi194.stdout:2/851: dwrite df/d5b/d61/f8b [0,4194304] 0 2024-02-20T08:06:18.915 INFO:tasks.workunit.client.1.smithi194.stdout:6/907: link df/dab/d1d/d28/d46/d5a/d6b/c6d df/dab/d1d/d28/d5e/d112/c132 0 2024-02-20T08:06:18.919 INFO:tasks.workunit.client.1.smithi194.stdout:9/888: chown d4/d20/d43/daa/dcb/d104/dd2 4777523 1 2024-02-20T08:06:18.919 INFO:tasks.workunit.client.1.smithi194.stdout:8/773: fsync d2/d14/d18/d45/d7b/dc0/fdb 0 2024-02-20T08:06:18.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/847: fdatasync d4/d20/d2b/d9b/ddb/fbb 0 2024-02-20T08:06:18.920 INFO:tasks.workunit.client.1.smithi194.stdout:3/826: write d5/d10/d28/d41/d73/f79 [3290446,119944] 0 2024-02-20T08:06:18.923 INFO:tasks.workunit.client.1.smithi194.stdout:2/852: dread - df/d14/d19/d5c/f9f zero size 2024-02-20T08:06:18.923 INFO:tasks.workunit.client.1.smithi194.stdout:5/848: write d4/d6/dd/d25/d78/f98 [989404,44988] 0 2024-02-20T08:06:18.925 INFO:tasks.workunit.client.1.smithi194.stdout:9/889: rmdir d4/d20/d43/d51 39 2024-02-20T08:06:18.927 INFO:tasks.workunit.client.1.smithi194.stdout:8/774: mknod d2/d14/d18/c111 0 2024-02-20T08:06:18.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/849: creat d4/d20/d2b/ddf/dc4/d28/d85/f104 x:0 0 0 2024-02-20T08:06:18.929 INFO:tasks.workunit.client.1.smithi194.stdout:3/827: mkdir d5/d10/d28/d41/d73/d8c/da6/ded/d109 0 2024-02-20T08:06:18.929 INFO:tasks.workunit.client.1.smithi194.stdout:9/890: mkdir d4/d20/d43/daa/d129 0 2024-02-20T08:06:18.930 INFO:tasks.workunit.client.1.smithi194.stdout:5/850: write d4/d6/d11/d2f/d77/d90/fe9 [917395,130682] 0 2024-02-20T08:06:18.931 INFO:tasks.workunit.client.1.smithi194.stdout:9/891: truncate d4/d8b/ff8 375422 0 2024-02-20T08:06:18.940 INFO:tasks.workunit.client.1.smithi194.stdout:0/769: dread d6/d2b/d35/d42/d1e/d3c/f68 [0,4194304] 0 2024-02-20T08:06:18.941 INFO:tasks.workunit.client.1.smithi194.stdout:0/770: chown d6/d2b/d35/d48/df9/ffb 39 1 2024-02-20T08:06:18.942 INFO:tasks.workunit.client.1.smithi194.stdout:0/771: write d6/f90 [1358657,56530] 0 2024-02-20T08:06:18.943 INFO:tasks.workunit.client.1.smithi194.stdout:6/908: mknod df/dab/d1d/d28/d2b/d80/c133 0 2024-02-20T08:06:18.943 INFO:tasks.workunit.client.1.smithi194.stdout:4/768: sync 2024-02-20T08:06:18.943 INFO:tasks.workunit.client.1.smithi194.stdout:0/772: chown d6/fee 36 1 2024-02-20T08:06:18.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/775: rename d2/d14/d18/d45/d4e/d9f/l103 to d2/d14/d18/d45/d69/d106/l112 0 2024-02-20T08:06:18.946 INFO:tasks.workunit.client.1.smithi194.stdout:5/851: mknod d4/d20/c105 0 2024-02-20T08:06:18.947 INFO:tasks.workunit.client.1.smithi194.stdout:8/776: read - d2/d14/d18/d45/d4e/d9f/f10e zero size 2024-02-20T08:06:18.947 INFO:tasks.workunit.client.1.smithi194.stdout:5/852: fsync d4/d6/f7c 0 2024-02-20T08:06:18.950 INFO:tasks.workunit.client.1.smithi194.stdout:3/828: creat d5/d10/d28/dd3/db7/dea/f10a x:0 0 0 2024-02-20T08:06:18.950 INFO:tasks.workunit.client.1.smithi194.stdout:2/853: dread df/fa9 [0,4194304] 0 2024-02-20T08:06:18.951 INFO:tasks.workunit.client.1.smithi194.stdout:3/829: fdatasync d5/d10/d17/feb 0 2024-02-20T08:06:18.953 INFO:tasks.workunit.client.1.smithi194.stdout:4/769: truncate d0/d10/d1c/d4d/d2f/f3d 354487 0 2024-02-20T08:06:18.954 INFO:tasks.workunit.client.1.smithi194.stdout:7/840: write d11/f99 [686422,35688] 0 2024-02-20T08:06:18.956 INFO:tasks.workunit.client.1.smithi194.stdout:5/853: dread d4/d20/d2b/ddf/dc4/f26 [0,4194304] 0 2024-02-20T08:06:18.957 INFO:tasks.workunit.client.1.smithi194.stdout:7/841: write d11/d2d/d38/d37/d43/f82 [3969001,128075] 0 2024-02-20T08:06:18.959 INFO:tasks.workunit.client.1.smithi194.stdout:2/854: dwrite fc [0,4194304] 0 2024-02-20T08:06:18.962 INFO:tasks.workunit.client.1.smithi194.stdout:3/830: mknod d5/d10/d28/dd3/c10b 0 2024-02-20T08:06:18.964 INFO:tasks.workunit.client.1.smithi194.stdout:1/800: dwrite d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f50 [0,4194304] 0 2024-02-20T08:06:18.969 INFO:tasks.workunit.client.1.smithi194.stdout:0/773: dread d6/d2b/d35/d42/d1e/d45/d58/f87 [0,4194304] 0 2024-02-20T08:06:18.971 INFO:tasks.workunit.client.1.smithi194.stdout:6/909: write df/dab/d1d/d28/f78 [173474,26967] 0 2024-02-20T08:06:18.973 INFO:tasks.workunit.client.1.smithi194.stdout:7/842: creat d11/d2d/d38/d37/d43/de7/f103 x:0 0 0 2024-02-20T08:06:18.975 INFO:tasks.workunit.client.1.smithi194.stdout:7/843: stat d11/d2d/fa4 0 2024-02-20T08:06:18.976 INFO:tasks.workunit.client.1.smithi194.stdout:4/770: dwrite d0/d4f/fc2 [0,4194304] 0 2024-02-20T08:06:18.977 INFO:tasks.workunit.client.1.smithi194.stdout:3/831: dwrite d5/d10/d16/d7b/fe2 [0,4194304] 0 2024-02-20T08:06:18.978 INFO:tasks.workunit.client.1.smithi194.stdout:1/801: chown d2/d8/d12/dc9/d26/c39 60706 1 2024-02-20T08:06:18.980 INFO:tasks.workunit.client.1.smithi194.stdout:0/774: fsync d6/d2b/d35/fae 0 2024-02-20T08:06:18.985 INFO:tasks.workunit.client.1.smithi194.stdout:9/892: dwrite d4/deb/f11c [0,4194304] 0 2024-02-20T08:06:18.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/910: creat df/dbe/f134 x:0 0 0 2024-02-20T08:06:18.989 INFO:tasks.workunit.client.1.smithi194.stdout:8/777: truncate d2/d14/f5c 3517000 0 2024-02-20T08:06:18.989 INFO:tasks.workunit.client.1.smithi194.stdout:0/775: dread d6/d2b/d35/d39/fc2 [0,4194304] 0 2024-02-20T08:06:18.993 INFO:tasks.workunit.client.1.smithi194.stdout:4/771: symlink d0/d5c/d60/le1 0 2024-02-20T08:06:18.999 INFO:tasks.workunit.client.1.smithi194.stdout:7/844: dwrite d11/d2d/d38/d37/d43/d7b/d91/fb1 [0,4194304] 0 2024-02-20T08:06:19.001 INFO:tasks.workunit.client.1.smithi194.stdout:3/832: creat d5/df/d30/d80/f10c x:0 0 0 2024-02-20T08:06:19.002 INFO:tasks.workunit.client.1.smithi194.stdout:1/802: symlink d2/d8/d12/dc9/d61/l106 0 2024-02-20T08:06:19.006 INFO:tasks.workunit.client.1.smithi194.stdout:7/845: dwrite d11/f99 [0,4194304] 0 2024-02-20T08:06:19.007 INFO:tasks.workunit.client.1.smithi194.stdout:0/776: rmdir d6/d2b/d35/d42/d1e/d45/daa/d77/d9d 39 2024-02-20T08:06:19.008 INFO:tasks.workunit.client.1.smithi194.stdout:0/777: chown d6/d2b/d35/d42/f16 22 1 2024-02-20T08:06:19.010 INFO:tasks.workunit.client.1.smithi194.stdout:5/854: getdents d4 0 2024-02-20T08:06:19.013 INFO:tasks.workunit.client.1.smithi194.stdout:1/803: mknod d2/d8/d12/dc9/d26/d45/d98/c107 0 2024-02-20T08:06:19.015 INFO:tasks.workunit.client.1.smithi194.stdout:9/893: link d4/deb/f11c d4/deb/f12a 0 2024-02-20T08:06:19.016 INFO:tasks.workunit.client.1.smithi194.stdout:6/911: mkdir df/dab/d1d/d28/d2b/d135 0 2024-02-20T08:06:19.017 INFO:tasks.workunit.client.1.smithi194.stdout:0/778: dwrite d6/d2b/d35/d42/d1e/d45/daa/d77/fa7 [0,4194304] 0 2024-02-20T08:06:19.018 INFO:tasks.workunit.client.1.smithi194.stdout:6/912: read - df/dab/d1d/d28/f10d zero size 2024-02-20T08:06:19.019 INFO:tasks.workunit.client.1.smithi194.stdout:0/779: chown d6/d2b/d35/d42/d1e/d3c/da0/lba 188 1 2024-02-20T08:06:19.019 INFO:tasks.workunit.client.1.smithi194.stdout:8/778: rename d2/d14/d18/d45/d69/daf/ff6 to d2/d14/d18/d45/d69/daf/db3/f113 0 2024-02-20T08:06:19.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/772: fdatasync d0/d10/d1c/d21/f96 0 2024-02-20T08:06:19.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/773: dread - d0/df/fcd zero size 2024-02-20T08:06:19.024 INFO:tasks.workunit.client.1.smithi194.stdout:9/894: symlink d4/d37/d4f/l12b 0 2024-02-20T08:06:19.026 INFO:tasks.workunit.client.1.smithi194.stdout:0/780: mkdir d6/d2b/d35/d39/dfd 0 2024-02-20T08:06:19.029 INFO:tasks.workunit.client.1.smithi194.stdout:8/779: mknod d2/d14/d18/d45/d7b/dc7/d78/c114 0 2024-02-20T08:06:19.031 INFO:tasks.workunit.client.1.smithi194.stdout:3/833: link d5/cd d5/d10/d62/db2/c10d 0 2024-02-20T08:06:19.032 INFO:tasks.workunit.client.1.smithi194.stdout:3/834: fsync d5/d10/d17/fa8 0 2024-02-20T08:06:19.032 INFO:tasks.workunit.client.1.smithi194.stdout:3/835: fdatasync d5/d10/d17/dc2/fc4 0 2024-02-20T08:06:19.033 INFO:tasks.workunit.client.1.smithi194.stdout:4/774: unlink d0/d5c/d60/d4a/dad/fb1 0 2024-02-20T08:06:19.035 INFO:tasks.workunit.client.1.smithi194.stdout:2/855: sync 2024-02-20T08:06:19.036 INFO:tasks.workunit.client.1.smithi194.stdout:5/855: dread d4/d6/dd/ffc [0,4194304] 0 2024-02-20T08:06:19.038 INFO:tasks.workunit.client.1.smithi194.stdout:0/781: mkdir d6/d2b/d35/d42/d1e/dfe 0 2024-02-20T08:06:19.041 INFO:tasks.workunit.client.1.smithi194.stdout:8/780: creat d2/d14/d18/d45/d4e/dbe/f115 x:0 0 0 2024-02-20T08:06:19.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/781: chown d2/d14/d18/d45/d7b/dc7/l10d 214 1 2024-02-20T08:06:19.048 INFO:tasks.workunit.client.1.smithi194.stdout:4/775: rename d0/d2/d3e/cb6 to d0/d2/d51/d9c/ce2 0 2024-02-20T08:06:19.052 INFO:tasks.workunit.client.1.smithi194.stdout:7/846: dwrite d11/d2d/d38/d4a/d27/f39 [0,4194304] 0 2024-02-20T08:06:19.053 INFO:tasks.workunit.client.1.smithi194.stdout:1/804: link d2/d8/d12/dc9/d26/d3d/d71/l8a d2/d8/d12/dc9/d61/d7d/l108 0 2024-02-20T08:06:19.054 INFO:tasks.workunit.client.1.smithi194.stdout:7/847: read d11/d2d/d38/d4a/d53/fb3 [6349521,46440] 0 2024-02-20T08:06:19.057 INFO:tasks.workunit.client.1.smithi194.stdout:6/913: write df/dab/d1d/d28/d2b/d80/fb1 [3977584,108601] 0 2024-02-20T08:06:19.057 INFO:tasks.workunit.client.1.smithi194.stdout:3/836: fdatasync d5/d10/f13 0 2024-02-20T08:06:19.059 INFO:tasks.workunit.client.1.smithi194.stdout:3/837: fdatasync d5/d10/d16/f3a 0 2024-02-20T08:06:19.060 INFO:tasks.workunit.client.1.smithi194.stdout:5/856: rename d4/d6/dd/d25/d7d/de2/fa6 to d4/d6/dd/d25/d78/f106 0 2024-02-20T08:06:19.066 INFO:tasks.workunit.client.1.smithi194.stdout:1/805: dwrite d2/d8/d12/dc9/fc1 [0,4194304] 0 2024-02-20T08:06:19.067 INFO:tasks.workunit.client.1.smithi194.stdout:9/895: write d4/d20/d43/f123 [2376142,118941] 0 2024-02-20T08:06:19.071 INFO:tasks.workunit.client.1.smithi194.stdout:6/914: dwrite df/dbe/f101 [0,4194304] 0 2024-02-20T08:06:19.071 INFO:tasks.workunit.client.1.smithi194.stdout:1/806: chown d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 35696 1 2024-02-20T08:06:19.071 INFO:tasks.workunit.client.1.smithi194.stdout:7/848: mknod d11/d2d/d38/d37/d3c/c104 0 2024-02-20T08:06:19.073 INFO:tasks.workunit.client.1.smithi194.stdout:1/807: write d2/d8/d12/dc9/d26/d3d/fe2 [411781,17334] 0 2024-02-20T08:06:19.075 INFO:tasks.workunit.client.1.smithi194.stdout:7/849: read d11/d2d/d38/d37/fe5 [15064,50045] 0 2024-02-20T08:06:19.075 INFO:tasks.workunit.client.1.smithi194.stdout:1/808: dread - d2/d8/fdd zero size 2024-02-20T08:06:19.075 INFO:tasks.workunit.client.1.smithi194.stdout:0/782: dwrite d6/d2b/d35/f53 [0,4194304] 0 2024-02-20T08:06:19.077 INFO:tasks.workunit.client.1.smithi194.stdout:4/776: dread d0/f32 [0,4194304] 0 2024-02-20T08:06:19.079 INFO:tasks.workunit.client.1.smithi194.stdout:8/782: rename d2/d14/d18/d45/d4e/d9f/f10e to d2/d14/d18/d45/d4e/dbe/dc3/f116 0 2024-02-20T08:06:19.079 INFO:tasks.workunit.client.1.smithi194.stdout:7/850: chown d11/d2d/d38/d37/d43/d8e/d6b/la7 7776052 1 2024-02-20T08:06:19.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/856: creat df/d14/d19/d5c/d97/f101 x:0 0 0 2024-02-20T08:06:19.084 INFO:tasks.workunit.client.1.smithi194.stdout:2/857: stat df/d14/d19/d5c/d78/fe8 0 2024-02-20T08:06:19.085 INFO:tasks.workunit.client.1.smithi194.stdout:5/857: fdatasync d4/d6/dd/d25/d78/d8b/fb4 0 2024-02-20T08:06:19.086 INFO:tasks.workunit.client.1.smithi194.stdout:1/809: dwrite d2/d8/d12/dc9/d26/d3d/d71/f66 [0,4194304] 0 2024-02-20T08:06:19.086 INFO:tasks.workunit.client.1.smithi194.stdout:6/915: truncate df/d42/f72 1019829 0 2024-02-20T08:06:19.090 INFO:tasks.workunit.client.1.smithi194.stdout:1/810: truncate d2/d8/d12/dc9/d26/d3d/d82/fd5 318442 0 2024-02-20T08:06:19.093 INFO:tasks.workunit.client.1.smithi194.stdout:7/851: mkdir d11/d2d/d38/d37/d43/de7/d105 0 2024-02-20T08:06:19.094 INFO:tasks.workunit.client.1.smithi194.stdout:8/783: symlink d2/d14/d18/d45/d90/d92/l117 0 2024-02-20T08:06:19.098 INFO:tasks.workunit.client.1.smithi194.stdout:9/896: mkdir d4/d20/d5c/d12c 0 2024-02-20T08:06:19.098 INFO:tasks.workunit.client.1.smithi194.stdout:0/783: dread d6/d2b/f3a [0,4194304] 0 2024-02-20T08:06:19.103 INFO:tasks.workunit.client.1.smithi194.stdout:5/858: truncate d4/d20/d2b/d79/f8e 941960 0 2024-02-20T08:06:19.104 INFO:tasks.workunit.client.1.smithi194.stdout:5/859: write d4/d6/dd/d25/f29 [818085,56478] 0 2024-02-20T08:06:19.107 INFO:tasks.workunit.client.1.smithi194.stdout:1/811: symlink d2/d8/d12/dc9/d26/d3d/d82/l109 0 2024-02-20T08:06:19.108 INFO:tasks.workunit.client.1.smithi194.stdout:7/852: creat d11/d2d/d38/d4a/d27/d51/d77/d9d/f106 x:0 0 0 2024-02-20T08:06:19.110 INFO:tasks.workunit.client.1.smithi194.stdout:3/838: link d5/df/d30/cc3 d5/d9e/c10e 0 2024-02-20T08:06:19.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/784: dread - d2/d14/d18/d45/d4e/fae zero size 2024-02-20T08:06:19.115 INFO:tasks.workunit.client.1.smithi194.stdout:6/916: mkdir df/dab/d1d/d28/d46/dc6/d136 0 2024-02-20T08:06:19.115 INFO:tasks.workunit.client.1.smithi194.stdout:3/839: read - d5/df/d25/ffb zero size 2024-02-20T08:06:19.116 INFO:tasks.workunit.client.1.smithi194.stdout:4/777: dwrite d0/d10/d1c/f30 [0,4194304] 0 2024-02-20T08:06:19.117 INFO:tasks.workunit.client.1.smithi194.stdout:8/785: read d2/d14/f2c [214778,70340] 0 2024-02-20T08:06:19.118 INFO:tasks.workunit.client.1.smithi194.stdout:5/860: dwrite d4/d20/d2b/ddf/db6/fde [0,4194304] 0 2024-02-20T08:06:19.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/786: stat d2/db5 0 2024-02-20T08:06:19.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/778: write d0/d10/d1c/d4d/d2f/fb2 [2587519,56202] 0 2024-02-20T08:06:19.124 INFO:tasks.workunit.client.1.smithi194.stdout:7/853: read d11/d2d/d38/d4a/d60/f64 [891092,130075] 0 2024-02-20T08:06:19.129 INFO:tasks.workunit.client.1.smithi194.stdout:1/812: dread d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/f50 [0,4194304] 0 2024-02-20T08:06:19.129 INFO:tasks.workunit.client.1.smithi194.stdout:6/917: dwrite df/dbe/f101 [0,4194304] 0 2024-02-20T08:06:19.132 INFO:tasks.workunit.client.1.smithi194.stdout:1/813: write d2/d8/df/f65 [1813765,93339] 0 2024-02-20T08:06:19.133 INFO:tasks.workunit.client.1.smithi194.stdout:6/918: chown df/dab/d1d/d28/d5e/da7/f131 1603913227 1 2024-02-20T08:06:19.134 INFO:tasks.workunit.client.1.smithi194.stdout:5/861: fsync d4/f9f 0 2024-02-20T08:06:19.136 INFO:tasks.workunit.client.1.smithi194.stdout:6/919: write df/dab/d1d/d28/d46/f127 [715091,129293] 0 2024-02-20T08:06:19.136 INFO:tasks.workunit.client.1.smithi194.stdout:2/858: dwrite df/d14/d19/d5c/d60/f7f [0,4194304] 0 2024-02-20T08:06:19.136 INFO:tasks.workunit.client.1.smithi194.stdout:5/862: fsync d4/d6/dd/fd0 0 2024-02-20T08:06:19.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/863: write d4/d6/da5/ff1 [2698877,127597] 0 2024-02-20T08:06:19.142 INFO:tasks.workunit.client.1.smithi194.stdout:9/897: getdents d4/d37/d4f/d91 0 2024-02-20T08:06:19.143 INFO:tasks.workunit.client.1.smithi194.stdout:9/898: dread - d4/de/dc4/f110 zero size 2024-02-20T08:06:19.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/920: chown df/dab/d1d/d28/d2b/caf 53426 1 2024-02-20T08:06:19.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/779: symlink d0/d10/le3 0 2024-02-20T08:06:19.156 INFO:tasks.workunit.client.1.smithi194.stdout:1/814: truncate d2/f7 4358030 0 2024-02-20T08:06:19.157 INFO:tasks.workunit.client.1.smithi194.stdout:2/859: creat df/d3a/db2/f102 x:0 0 0 2024-02-20T08:06:19.158 INFO:tasks.workunit.client.1.smithi194.stdout:3/840: write d5/d10/f4d [4610840,111024] 0 2024-02-20T08:06:19.158 INFO:tasks.workunit.client.1.smithi194.stdout:6/921: creat df/dab/d1d/d28/d46/d5a/d7d/dd4/f137 x:0 0 0 2024-02-20T08:06:19.159 INFO:tasks.workunit.client.1.smithi194.stdout:3/841: readlink d5/d10/d17/d1d/ld8 0 2024-02-20T08:06:19.160 INFO:tasks.workunit.client.1.smithi194.stdout:8/787: creat d2/d14/d18/d45/d7b/f118 x:0 0 0 2024-02-20T08:06:19.160 INFO:tasks.workunit.client.1.smithi194.stdout:4/780: symlink d0/d5c/d60/le4 0 2024-02-20T08:06:19.164 INFO:tasks.workunit.client.1.smithi194.stdout:1/815: creat d2/d8/d12/dc9/d61/f10a x:0 0 0 2024-02-20T08:06:19.166 INFO:tasks.workunit.client.1.smithi194.stdout:2/860: dwrite df/d14/d19/d5c/d60/f7f [0,4194304] 0 2024-02-20T08:06:19.168 INFO:tasks.workunit.client.1.smithi194.stdout:0/784: sync 2024-02-20T08:06:19.168 INFO:tasks.workunit.client.1.smithi194.stdout:2/861: chown df/d14/d19/d5c/fd5 21235845 1 2024-02-20T08:06:19.168 INFO:tasks.workunit.client.1.smithi194.stdout:6/922: fsync df/ded/fdd 0 2024-02-20T08:06:19.168 INFO:tasks.workunit.client.1.smithi194.stdout:7/854: dread d11/d2d/d38/d95/fb5 [0,4194304] 0 2024-02-20T08:06:19.169 INFO:tasks.workunit.client.1.smithi194.stdout:9/899: write d4/de/f96 [361641,70481] 0 2024-02-20T08:06:19.169 INFO:tasks.workunit.client.1.smithi194.stdout:2/862: chown df/d14/d19/d96 1308502 1 2024-02-20T08:06:19.171 INFO:tasks.workunit.client.1.smithi194.stdout:0/785: dread - d6/d2b/d35/d42/d1e/d45/daa/ff6 zero size 2024-02-20T08:06:19.172 INFO:tasks.workunit.client.1.smithi194.stdout:2/863: read - df/d14/d19/d5c/fd5 zero size 2024-02-20T08:06:19.177 INFO:tasks.workunit.client.1.smithi194.stdout:5/864: dread d4/d6/dd/d25/d78/d8b/f24 [0,4194304] 0 2024-02-20T08:06:19.177 INFO:tasks.workunit.client.1.smithi194.stdout:1/816: creat d2/d8/d12/dc9/d61/d7d/dbf/f10b x:0 0 0 2024-02-20T08:06:19.178 INFO:tasks.workunit.client.1.smithi194.stdout:1/817: fdatasync d2/d8/d60/de0/ff1 0 2024-02-20T08:06:19.182 INFO:tasks.workunit.client.1.smithi194.stdout:4/781: rename d0/d2/f6a to d0/fe5 0 2024-02-20T08:06:19.183 INFO:tasks.workunit.client.1.smithi194.stdout:7/855: creat d11/d6e/f107 x:0 0 0 2024-02-20T08:06:19.184 INFO:tasks.workunit.client.1.smithi194.stdout:4/782: write d0/df/d41/d69/f9b [167518,38609] 0 2024-02-20T08:06:19.187 INFO:tasks.workunit.client.1.smithi194.stdout:8/788: creat d2/d14/d18/d45/d69/daf/db3/dce/f119 x:0 0 0 2024-02-20T08:06:19.189 INFO:tasks.workunit.client.1.smithi194.stdout:0/786: symlink d6/d93/dcf/lff 0 2024-02-20T08:06:19.190 INFO:tasks.workunit.client.1.smithi194.stdout:0/787: truncate d6/fee 642731 0 2024-02-20T08:06:19.190 INFO:tasks.workunit.client.1.smithi194.stdout:0/788: chown d6/dbe 336354 1 2024-02-20T08:06:19.190 INFO:tasks.workunit.client.1.smithi194.stdout:2/864: symlink df/d5b/d61/l103 0 2024-02-20T08:06:19.191 INFO:tasks.workunit.client.1.smithi194.stdout:2/865: dread - df/d3a/fd0 zero size 2024-02-20T08:06:19.191 INFO:tasks.workunit.client.1.smithi194.stdout:2/866: chown df/d5b/d61/fbd 229408686 1 2024-02-20T08:06:19.192 INFO:tasks.workunit.client.1.smithi194.stdout:5/865: rmdir d4/d6/dd/d99/dd1 39 2024-02-20T08:06:19.192 INFO:tasks.workunit.client.1.smithi194.stdout:5/866: fsync d4/d20/d2b/ddf/dc4/d28/d85/fc7 0 2024-02-20T08:06:19.200 INFO:tasks.workunit.client.1.smithi194.stdout:8/789: creat d2/d14/d18/d45/d69/d9b/f11a x:0 0 0 2024-02-20T08:06:19.201 INFO:tasks.workunit.client.1.smithi194.stdout:8/790: fdatasync d2/d14/d18/d45/d7b/fa4 0 2024-02-20T08:06:19.202 INFO:tasks.workunit.client.1.smithi194.stdout:4/783: dwrite d0/df/d41/f66 [0,4194304] 0 2024-02-20T08:06:19.202 INFO:tasks.workunit.client.1.smithi194.stdout:5/867: fdatasync d4/d6/dd/d25/d78/d8b/f24 0 2024-02-20T08:06:19.207 INFO:tasks.workunit.client.1.smithi194.stdout:2/867: dwrite df/fa9 [0,4194304] 0 2024-02-20T08:06:19.208 INFO:tasks.workunit.client.1.smithi194.stdout:3/842: getdents d5/d10/d28/d41/d73/d8c/da6/ded/daa 0 2024-02-20T08:06:19.208 INFO:tasks.workunit.client.1.smithi194.stdout:3/843: write d5/d9e/fba [763188,13045] 0 2024-02-20T08:06:19.210 INFO:tasks.workunit.client.1.smithi194.stdout:9/900: rmdir d4/d20/d43/daa/dcb/d119 0 2024-02-20T08:06:19.215 INFO:tasks.workunit.client.1.smithi194.stdout:0/789: symlink d6/d2b/d35/d9c/d62/dd9/l100 0 2024-02-20T08:06:19.217 INFO:tasks.workunit.client.1.smithi194.stdout:8/791: creat d2/d80/dd1/f11b x:0 0 0 2024-02-20T08:06:19.219 INFO:tasks.workunit.client.1.smithi194.stdout:1/818: write d2/d8/d12/dc9/d26/f53 [185825,26304] 0 2024-02-20T08:06:19.225 INFO:tasks.workunit.client.1.smithi194.stdout:1/819: dwrite d2/d8/d12/f21 [4194304,4194304] 0 2024-02-20T08:06:19.225 INFO:tasks.workunit.client.1.smithi194.stdout:6/923: getdents df/dab/d1d/d28/d46/d5a/d6b/d83/db3 0 2024-02-20T08:06:19.226 INFO:tasks.workunit.client.1.smithi194.stdout:1/820: fdatasync d2/d8/f83 0 2024-02-20T08:06:19.227 INFO:tasks.workunit.client.1.smithi194.stdout:1/821: stat d2/d48/fd9 0 2024-02-20T08:06:19.228 INFO:tasks.workunit.client.1.smithi194.stdout:9/901: creat d4/d1b/d79/f12d x:0 0 0 2024-02-20T08:06:19.228 INFO:tasks.workunit.client.1.smithi194.stdout:0/790: readlink d6/d2b/d35/d48/l8c 0 2024-02-20T08:06:19.228 INFO:tasks.workunit.client.1.smithi194.stdout:1/822: dread d2/d8/f3c [0,4194304] 0 2024-02-20T08:06:19.230 INFO:tasks.workunit.client.1.smithi194.stdout:0/791: chown d6/d2b/d35/d9c/d62/dc1 679 1 2024-02-20T08:06:19.231 INFO:tasks.workunit.client.1.smithi194.stdout:8/792: write d2/d80/fda [2249026,54640] 0 2024-02-20T08:06:19.235 INFO:tasks.workunit.client.1.smithi194.stdout:7/856: getdents d11/d2d/d38/d4a/dde 0 2024-02-20T08:06:19.235 INFO:tasks.workunit.client.1.smithi194.stdout:3/844: dread d5/d10/d28/f6c [0,4194304] 0 2024-02-20T08:06:19.235 INFO:tasks.workunit.client.1.smithi194.stdout:2/868: creat df/d14/d19/d5c/d97/df1/f104 x:0 0 0 2024-02-20T08:06:19.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/869: write df/d14/d19/d5c/d97/f101 [414145,124530] 0 2024-02-20T08:06:19.240 INFO:tasks.workunit.client.1.smithi194.stdout:4/784: truncate d0/d4f/fdf 919617 0 2024-02-20T08:06:19.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/793: dwrite d2/d14/d18/d45/d69/d9b/f11a [0,4194304] 0 2024-02-20T08:06:19.242 INFO:tasks.workunit.client.1.smithi194.stdout:9/902: creat d4/d20/d43/daa/dcb/f12e x:0 0 0 2024-02-20T08:06:19.243 INFO:tasks.workunit.client.1.smithi194.stdout:5/868: creat d4/d6/d11/f107 x:0 0 0 2024-02-20T08:06:19.245 INFO:tasks.workunit.client.1.smithi194.stdout:9/903: chown d4/d20/d43/daa/dcb/d104 13 1 2024-02-20T08:06:19.246 INFO:tasks.workunit.client.1.smithi194.stdout:7/857: unlink d11/d2d/f8a 0 2024-02-20T08:06:19.246 INFO:tasks.workunit.client.1.smithi194.stdout:3/845: dwrite d5/d10/d28/dd3/db7/dea/f10a [0,4194304] 0 2024-02-20T08:06:19.247 INFO:tasks.workunit.client.1.smithi194.stdout:6/924: mkdir df/dab/d1d/d28/d46/dc6/d136/d138 0 2024-02-20T08:06:19.247 INFO:tasks.workunit.client.1.smithi194.stdout:3/846: dread - d5/d10/d17/fd4 zero size 2024-02-20T08:06:19.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/794: mknod d2/d80/c11c 0 2024-02-20T08:06:19.256 INFO:tasks.workunit.client.1.smithi194.stdout:1/823: rename d2/d8/d12/dc9/d26/fee to d2/d8/df/f10c 0 2024-02-20T08:06:19.258 INFO:tasks.workunit.client.1.smithi194.stdout:7/858: mknod d11/d2d/d38/d4a/dde/c108 0 2024-02-20T08:06:19.260 INFO:tasks.workunit.client.1.smithi194.stdout:2/870: truncate df/d14/f32 1642389 0 2024-02-20T08:06:19.260 INFO:tasks.workunit.client.1.smithi194.stdout:6/925: dread - df/dab/d1d/d28/d46/dc4/fc5 zero size 2024-02-20T08:06:19.262 INFO:tasks.workunit.client.1.smithi194.stdout:8/795: mkdir d2/d14/d18/d45/d7b/dc7/d11d 0 2024-02-20T08:06:19.263 INFO:tasks.workunit.client.1.smithi194.stdout:8/796: truncate d2/d14/ff1 188113 0 2024-02-20T08:06:19.264 INFO:tasks.workunit.client.1.smithi194.stdout:0/792: rmdir d6/d2b/d35/d39/dfd 0 2024-02-20T08:06:19.265 INFO:tasks.workunit.client.1.smithi194.stdout:0/793: stat d6/d2b/d35/d42/d1e/l98 0 2024-02-20T08:06:19.266 INFO:tasks.workunit.client.1.smithi194.stdout:1/824: rmdir d2/d8/d12/dc9/d61/d9f 39 2024-02-20T08:06:19.268 INFO:tasks.workunit.client.1.smithi194.stdout:5/869: symlink d4/d6/dd/l108 0 2024-02-20T08:06:19.268 INFO:tasks.workunit.client.1.smithi194.stdout:1/825: truncate d2/d8/d12/dc9/d26/d3d/d71/f66 4832389 0 2024-02-20T08:06:19.269 INFO:tasks.workunit.client.1.smithi194.stdout:1/826: readlink d2/d8/d12/la1 0 2024-02-20T08:06:19.272 INFO:tasks.workunit.client.1.smithi194.stdout:9/904: link d4/d37/d38/f116 d4/d20/d41/db6/f12f 0 2024-02-20T08:06:19.276 INFO:tasks.workunit.client.1.smithi194.stdout:9/905: truncate d4/de/dc4/fcc 1107278 0 2024-02-20T08:06:19.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/847: getdents d5/d10/d28/d41/df4 0 2024-02-20T08:06:19.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/848: chown d5/d10/d17 61294 1 2024-02-20T08:06:19.276 INFO:tasks.workunit.client.1.smithi194.stdout:9/906: write d4/de/dc4/fcc [1427933,52455] 0 2024-02-20T08:06:19.276 INFO:tasks.workunit.client.1.smithi194.stdout:8/797: mkdir d2/d14/dc4/d11e 0 2024-02-20T08:06:19.277 INFO:tasks.workunit.client.1.smithi194.stdout:0/794: symlink d6/d2b/d35/d9c/d62/dc1/l101 0 2024-02-20T08:06:19.281 INFO:tasks.workunit.client.1.smithi194.stdout:5/870: creat d4/d20/d2b/ddf/dc4/f109 x:0 0 0 2024-02-20T08:06:19.282 INFO:tasks.workunit.client.1.smithi194.stdout:6/926: dread df/f3c [0,4194304] 0 2024-02-20T08:06:19.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/785: dread d0/fe5 [0,4194304] 0 2024-02-20T08:06:19.283 INFO:tasks.workunit.client.1.smithi194.stdout:1/827: symlink d2/d8/d12/dc9/d61/d68/db7/l10d 0 2024-02-20T08:06:19.283 INFO:tasks.workunit.client.1.smithi194.stdout:5/871: dread d4/d6/dd/fd0 [0,4194304] 0 2024-02-20T08:06:19.284 INFO:tasks.workunit.client.1.smithi194.stdout:6/927: chown df/dab/d1d/d28/d46/d5a/d7d/dd4/d10f 54792022 1 2024-02-20T08:06:19.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/871: mkdir df/d5b/d105 0 2024-02-20T08:06:19.290 INFO:tasks.workunit.client.1.smithi194.stdout:3/849: rmdir d5/df/d9a 39 2024-02-20T08:06:19.291 INFO:tasks.workunit.client.1.smithi194.stdout:3/850: stat d5/df/d60/fa3 0 2024-02-20T08:06:19.292 INFO:tasks.workunit.client.1.smithi194.stdout:3/851: chown d5/d10/d16/f2d 2995 1 2024-02-20T08:06:19.292 INFO:tasks.workunit.client.1.smithi194.stdout:9/907: dread d4/d8b/f8f [0,4194304] 0 2024-02-20T08:06:19.292 INFO:tasks.workunit.client.1.smithi194.stdout:3/852: chown d5/d10/d28/d41 70 1 2024-02-20T08:06:19.293 INFO:tasks.workunit.client.1.smithi194.stdout:0/795: mknod d6/d2b/d35/d9c/d9f/c102 0 2024-02-20T08:06:19.293 INFO:tasks.workunit.client.1.smithi194.stdout:9/908: write d4/d20/d43/f123 [4082310,9491] 0 2024-02-20T08:06:19.293 INFO:tasks.workunit.client.1.smithi194.stdout:4/786: rmdir d0/d2/d51/d9c 39 2024-02-20T08:06:19.299 INFO:tasks.workunit.client.1.smithi194.stdout:5/872: write d4/d6/dd/f2d [1552594,101380] 0 2024-02-20T08:06:19.301 INFO:tasks.workunit.client.1.smithi194.stdout:6/928: mkdir df/dab/d1d/d28/d46/d5a/d6b/dcb/d139 0 2024-02-20T08:06:19.301 INFO:tasks.workunit.client.1.smithi194.stdout:1/828: rmdir d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/db0 39 2024-02-20T08:06:19.305 INFO:tasks.workunit.client.1.smithi194.stdout:3/853: chown d5/d10/d17/d1d/c68 2087083 1 2024-02-20T08:06:19.307 INFO:tasks.workunit.client.1.smithi194.stdout:4/787: creat d0/d2/fe6 x:0 0 0 2024-02-20T08:06:19.308 INFO:tasks.workunit.client.1.smithi194.stdout:0/796: mknod d6/d2b/d35/d42/d1e/d45/c103 0 2024-02-20T08:06:19.313 INFO:tasks.workunit.client.1.smithi194.stdout:7/859: rmdir d11/d2d 39 2024-02-20T08:06:19.314 INFO:tasks.workunit.client.1.smithi194.stdout:2/872: mknod df/d14/d19/d5c/d97/d9a/ddd/df9/c106 0 2024-02-20T08:06:19.315 INFO:tasks.workunit.client.1.smithi194.stdout:2/873: truncate df/d14/d19/d5c/fd5 439984 0 2024-02-20T08:06:19.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/798: creat d2/d14/d18/d45/d4e/f11f x:0 0 0 2024-02-20T08:06:19.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/799: chown d2/d14/f6a 91102062 1 2024-02-20T08:06:19.319 INFO:tasks.workunit.client.1.smithi194.stdout:9/909: creat d4/d20/d5c/d12c/f130 x:0 0 0 2024-02-20T08:06:19.320 INFO:tasks.workunit.client.1.smithi194.stdout:9/910: write d4/d37/ddf/d42/d4e/fda [75380,95510] 0 2024-02-20T08:06:19.321 INFO:tasks.workunit.client.1.smithi194.stdout:4/788: fdatasync d0/d5c/d60/f78 0 2024-02-20T08:06:19.326 INFO:tasks.workunit.client.1.smithi194.stdout:1/829: mkdir d2/d8/d12/dc9/d10e 0 2024-02-20T08:06:19.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/873: dwrite d4/d6/f5e [0,4194304] 0 2024-02-20T08:06:19.327 INFO:tasks.workunit.client.1.smithi194.stdout:5/874: write d4/d6/dd/f2d [5214322,54707] 0 2024-02-20T08:06:19.327 INFO:tasks.workunit.client.1.smithi194.stdout:9/911: rmdir d4/d20/d5c/dd0 39 2024-02-20T08:06:19.330 INFO:tasks.workunit.client.1.smithi194.stdout:0/797: creat d6/d2b/d35/d42/d1e/dfe/f104 x:0 0 0 2024-02-20T08:06:19.330 INFO:tasks.workunit.client.1.smithi194.stdout:4/789: write d0/d2/f1f [3570095,35143] 0 2024-02-20T08:06:19.333 INFO:tasks.workunit.client.1.smithi194.stdout:0/798: write d6/d2b/d35/d42/d1e/d45/daa/ff6 [570023,3948] 0 2024-02-20T08:06:19.335 INFO:tasks.workunit.client.1.smithi194.stdout:2/874: mknod df/d14/d24/d56/d6b/d81/c107 0 2024-02-20T08:06:19.335 INFO:tasks.workunit.client.1.smithi194.stdout:2/875: chown df/l59 244924 1 2024-02-20T08:06:19.336 INFO:tasks.workunit.client.1.smithi194.stdout:1/830: unlink d2/ldc 0 2024-02-20T08:06:19.337 INFO:tasks.workunit.client.1.smithi194.stdout:3/854: write d5/d10/d16/d7b/f107 [1083368,112649] 0 2024-02-20T08:06:19.338 INFO:tasks.workunit.client.1.smithi194.stdout:6/929: link df/d18/f40 df/dab/d1d/d28/d46/f13a 0 2024-02-20T08:06:19.339 INFO:tasks.workunit.client.1.smithi194.stdout:5/875: write d4/d6/dd/d25/d78/f106 [342286,81605] 0 2024-02-20T08:06:19.340 INFO:tasks.workunit.client.1.smithi194.stdout:4/790: creat d0/d10/d1c/d21/d46/fe7 x:0 0 0 2024-02-20T08:06:19.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/876: truncate d4/d6/dd/d25/d7d/f103 442524 0 2024-02-20T08:06:19.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/877: dread - d4/d20/d2b/fe4 zero size 2024-02-20T08:06:19.346 INFO:tasks.workunit.client.1.smithi194.stdout:1/831: symlink d2/d8/d12/dc9/d26/d57/d58/l10f 0 2024-02-20T08:06:19.351 INFO:tasks.workunit.client.1.smithi194.stdout:6/930: rename df/d42/d86 to df/dab/d1d/d99/d13b 0 2024-02-20T08:06:19.352 INFO:tasks.workunit.client.1.smithi194.stdout:2/876: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:19.353 INFO:tasks.workunit.client.1.smithi194.stdout:0/799: dwrite d6/d2b/d35/d42/f30 [0,4194304] 0 2024-02-20T08:06:19.356 INFO:tasks.workunit.client.1.smithi194.stdout:0/800: truncate d6/d2b/d35/d48/ff5 394061 0 2024-02-20T08:06:19.357 INFO:tasks.workunit.client.1.smithi194.stdout:7/860: link d11/d2d/d38/d37/d3c/d8d/fcf d11/d2d/d38/d4a/d27/f109 0 2024-02-20T08:06:19.360 INFO:tasks.workunit.client.1.smithi194.stdout:0/801: fdatasync d6/d2b/d35/d39/d8f/fcd 0 2024-02-20T08:06:19.360 INFO:tasks.workunit.client.1.smithi194.stdout:1/832: mkdir d2/d8/d12/dc9/d26/d3d/de1/d110 0 2024-02-20T08:06:19.361 INFO:tasks.workunit.client.1.smithi194.stdout:3/855: mknod d5/d10/d28/d41/df4/c10f 0 2024-02-20T08:06:19.362 INFO:tasks.workunit.client.1.smithi194.stdout:6/931: dwrite df/dab/d1d/d28/d46/d5a/d7d/dd4/f11e [0,4194304] 0 2024-02-20T08:06:19.363 INFO:tasks.workunit.client.1.smithi194.stdout:7/861: dread d11/d2d/d38/d37/d43/d7b/d91/fe9 [0,4194304] 0 2024-02-20T08:06:19.364 INFO:tasks.workunit.client.1.smithi194.stdout:4/791: rename d0/d5c/d60/c6f to d0/df/d11/dba/ce8 0 2024-02-20T08:06:19.367 INFO:tasks.workunit.client.1.smithi194.stdout:6/932: write df/d18/f107 [335413,107484] 0 2024-02-20T08:06:19.371 INFO:tasks.workunit.client.1.smithi194.stdout:9/912: dwrite d4/d1b/d2e/f45 [0,4194304] 0 2024-02-20T08:06:19.372 INFO:tasks.workunit.client.1.smithi194.stdout:3/856: write d5/d10/d28/f6c [1888859,39390] 0 2024-02-20T08:06:19.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/933: fsync df/dab/dcc/fd3 0 2024-02-20T08:06:19.373 INFO:tasks.workunit.client.1.smithi194.stdout:1/833: rename d2/d8/d60/de0 to d2/d8/d12/dc9/d26/dfc/d111 0 2024-02-20T08:06:19.377 INFO:tasks.workunit.client.1.smithi194.stdout:2/877: dwrite df/d14/d19/d5c/d60/d63/f62 [4194304,4194304] 0 2024-02-20T08:06:19.379 INFO:tasks.workunit.client.1.smithi194.stdout:4/792: dwrite d0/df/d41/f81 [0,4194304] 0 2024-02-20T08:06:19.383 INFO:tasks.workunit.client.1.smithi194.stdout:1/834: readlink d2/l31 0 2024-02-20T08:06:19.387 INFO:tasks.workunit.client.1.smithi194.stdout:3/857: rmdir d5/d9e 39 2024-02-20T08:06:19.392 INFO:tasks.workunit.client.1.smithi194.stdout:5/878: dwrite d4/d20/d2b/d79/f60 [0,4194304] 0 2024-02-20T08:06:19.394 INFO:tasks.workunit.client.1.smithi194.stdout:4/793: creat d0/df/d11/dbb/fe9 x:0 0 0 2024-02-20T08:06:19.394 INFO:tasks.workunit.client.1.smithi194.stdout:0/802: write d6/d2b/d35/d42/d1e/d45/d58/fb6 [738808,90940] 0 2024-02-20T08:06:19.399 INFO:tasks.workunit.client.1.smithi194.stdout:3/858: mkdir d5/d10/d16/d7b/d94/dad/d110 0 2024-02-20T08:06:19.399 INFO:tasks.workunit.client.1.smithi194.stdout:7/862: link d11/d2d/d38/d4a/d53/d81/fd4 d11/d2d/d38/d4a/d27/d51/d84/f10a 0 2024-02-20T08:06:19.401 INFO:tasks.workunit.client.1.smithi194.stdout:6/934: mkdir df/dab/d1d/d28/d46/d5a/d6b/d13c 0 2024-02-20T08:06:19.402 INFO:tasks.workunit.client.1.smithi194.stdout:6/935: readlink df/dab/dcc/lfb 0 2024-02-20T08:06:19.403 INFO:tasks.workunit.client.1.smithi194.stdout:2/878: truncate df/d14/f22 2002325 0 2024-02-20T08:06:19.403 INFO:tasks.workunit.client.1.smithi194.stdout:9/913: creat d4/de/f131 x:0 0 0 2024-02-20T08:06:19.403 INFO:tasks.workunit.client.1.smithi194.stdout:4/794: dwrite d0/d10/d1c/d21/d46/f8c [0,4194304] 0 2024-02-20T08:06:19.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/835: fdatasync d2/d8/d12/dc9/d26/d3d/fda 0 2024-02-20T08:06:19.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/914: read d4/de/f7b [873594,38873] 0 2024-02-20T08:06:19.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/936: readlink df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/lf9 0 2024-02-20T08:06:19.408 INFO:tasks.workunit.client.1.smithi194.stdout:5/879: creat d4/d6/dd/d3a/d101/f10a x:0 0 0 2024-02-20T08:06:19.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/859: rename d5/d10/d17/d1d/d93 to d5/d10/d28/d41/d73/d8c/da6/ded/d109/d111 0 2024-02-20T08:06:19.411 INFO:tasks.workunit.client.1.smithi194.stdout:8/800: sync 2024-02-20T08:06:19.412 INFO:tasks.workunit.client.1.smithi194.stdout:8/801: stat d2/d80/dd1/fe2 0 2024-02-20T08:06:19.413 INFO:tasks.workunit.client.1.smithi194.stdout:8/802: stat d2/d14/d18/d45/d69/daf/db3/dce/f119 0 2024-02-20T08:06:19.415 INFO:tasks.workunit.client.1.smithi194.stdout:4/795: unlink d0/d2/d3e/f71 0 2024-02-20T08:06:19.417 INFO:tasks.workunit.client.1.smithi194.stdout:7/863: symlink d11/d2d/d38/l10b 0 2024-02-20T08:06:19.418 INFO:tasks.workunit.client.1.smithi194.stdout:9/915: chown d4/d37/d38/l6c 23433 1 2024-02-20T08:06:19.420 INFO:tasks.workunit.client.1.smithi194.stdout:5/880: mkdir d4/d6/dd/d3a/d10b 0 2024-02-20T08:06:19.424 INFO:tasks.workunit.client.1.smithi194.stdout:3/860: rmdir d5/d10/d28/dd2 39 2024-02-20T08:06:19.425 INFO:tasks.workunit.client.1.smithi194.stdout:3/861: dread - d5/d10/d16/d7b/d94/dad/db9/fdf zero size 2024-02-20T08:06:19.425 INFO:tasks.workunit.client.1.smithi194.stdout:3/862: chown d5/d10/d62 163636628 1 2024-02-20T08:06:19.433 INFO:tasks.workunit.client.1.smithi194.stdout:8/803: truncate d2/fa3 754759 0 2024-02-20T08:06:19.439 INFO:tasks.workunit.client.1.smithi194.stdout:6/937: mkdir df/dab/d1d/d28/d46/d5a/d7d/dd4/d10f/d13d 0 2024-02-20T08:06:19.440 INFO:tasks.workunit.client.1.smithi194.stdout:5/881: truncate d4/d6/dd/d3a/f9a 413863 0 2024-02-20T08:06:19.441 INFO:tasks.workunit.client.1.smithi194.stdout:5/882: chown d4/d20/d2b/ddf/dc4/f109 614 1 2024-02-20T08:06:19.442 INFO:tasks.workunit.client.1.smithi194.stdout:5/883: dread d4/d6/dd/d25/d7d/f103 [0,4194304] 0 2024-02-20T08:06:19.442 INFO:tasks.workunit.client.1.smithi194.stdout:3/863: chown d5/d10/d28/d41/d73/d8c/ccc 1 1 2024-02-20T08:06:19.443 INFO:tasks.workunit.client.1.smithi194.stdout:3/864: chown d5/d10/d28/dd3/db7/def 255 1 2024-02-20T08:06:19.443 INFO:tasks.workunit.client.1.smithi194.stdout:8/804: symlink d2/db5/l120 0 2024-02-20T08:06:19.443 INFO:tasks.workunit.client.1.smithi194.stdout:3/865: readlink d5/df/d30/lda 0 2024-02-20T08:06:19.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/803: getdents d6/d2b/d35/d42/d1e/dfe 0 2024-02-20T08:06:19.447 INFO:tasks.workunit.client.1.smithi194.stdout:0/804: write d6/d2b/d35/d9c/ffc [690685,129907] 0 2024-02-20T08:06:19.447 INFO:tasks.workunit.client.1.smithi194.stdout:1/836: creat d2/f112 x:0 0 0 2024-02-20T08:06:19.448 INFO:tasks.workunit.client.1.smithi194.stdout:0/805: readlink d6/d2b/d35/d42/d1e/d45/d58/lf1 0 2024-02-20T08:06:19.448 INFO:tasks.workunit.client.1.smithi194.stdout:1/837: stat d2/d8/d12/dc9/d61/c93 0 2024-02-20T08:06:19.449 INFO:tasks.workunit.client.1.smithi194.stdout:7/864: mkdir d11/d10c 0 2024-02-20T08:06:19.450 INFO:tasks.workunit.client.1.smithi194.stdout:0/806: chown d6/d2b/d35/d39/d8f/dbf/feb 513573342 1 2024-02-20T08:06:19.450 INFO:tasks.workunit.client.1.smithi194.stdout:7/865: fdatasync d11/d2d/d38/d37/d3c/d8d/fb6 0 2024-02-20T08:06:19.450 INFO:tasks.workunit.client.1.smithi194.stdout:0/807: chown d6/d2b/d35/d9c/de3 34447 1 2024-02-20T08:06:19.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/916: creat d4/d20/d43/daa/dcb/d104/dd2/d10f/f132 x:0 0 0 2024-02-20T08:06:19.452 INFO:tasks.workunit.client.1.smithi194.stdout:6/938: mknod df/dab/d1d/d28/d2b/d94/d96/c13e 0 2024-02-20T08:06:19.455 INFO:tasks.workunit.client.1.smithi194.stdout:2/879: rename df/d14/d19/d5c/f5e to df/d14/d24/d56/d6b/f108 0 2024-02-20T08:06:19.456 INFO:tasks.workunit.client.1.smithi194.stdout:2/880: write df/d14/d19/d5c/d60/f7f [4114812,69940] 0 2024-02-20T08:06:19.463 INFO:tasks.workunit.client.1.smithi194.stdout:3/866: fdatasync d5/d10/d28/d41/fe1 0 2024-02-20T08:06:19.466 INFO:tasks.workunit.client.1.smithi194.stdout:8/805: write d2/d14/d18/d45/d4e/d9f/ff7 [32655,115452] 0 2024-02-20T08:06:19.467 INFO:tasks.workunit.client.1.smithi194.stdout:4/796: creat d0/df/fea x:0 0 0 2024-02-20T08:06:19.467 INFO:tasks.workunit.client.1.smithi194.stdout:8/806: truncate d2/d14/d18/fde 851769 0 2024-02-20T08:06:19.474 INFO:tasks.workunit.client.1.smithi194.stdout:8/807: dwrite d2/d14/d18/d45/d7b/f118 [0,4194304] 0 2024-02-20T08:06:19.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/884: dwrite d4/d6/da5/fda [0,4194304] 0 2024-02-20T08:06:19.476 INFO:tasks.workunit.client.1.smithi194.stdout:7/866: write d11/d2d/d38/d4a/d53/d81/fd4 [57627,31436] 0 2024-02-20T08:06:19.479 INFO:tasks.workunit.client.1.smithi194.stdout:6/939: write df/dab/d1d/d28/d46/d5a/d6b/f123 [803514,119769] 0 2024-02-20T08:06:19.481 INFO:tasks.workunit.client.1.smithi194.stdout:5/885: dread d4/d6/dd/d25/d78/f106 [0,4194304] 0 2024-02-20T08:06:19.483 INFO:tasks.workunit.client.1.smithi194.stdout:5/886: fsync d4/d20/d2b/ddf/dc4/f109 0 2024-02-20T08:06:19.483 INFO:tasks.workunit.client.1.smithi194.stdout:2/881: symlink df/d14/d19/d5c/d60/d63/d92/l109 0 2024-02-20T08:06:19.486 INFO:tasks.workunit.client.1.smithi194.stdout:3/867: symlink d5/d10/d28/d41/d73/l112 0 2024-02-20T08:06:19.487 INFO:tasks.workunit.client.1.smithi194.stdout:3/868: readlink d5/d10/d16/lf8 0 2024-02-20T08:06:19.488 INFO:tasks.workunit.client.1.smithi194.stdout:1/838: mkdir d2/d8/d113 0 2024-02-20T08:06:19.488 INFO:tasks.workunit.client.1.smithi194.stdout:5/887: dread d4/d6/f75 [0,4194304] 0 2024-02-20T08:06:19.489 INFO:tasks.workunit.client.1.smithi194.stdout:0/808: mkdir d6/d2b/d35/d9c/d105 0 2024-02-20T08:06:19.491 INFO:tasks.workunit.client.1.smithi194.stdout:8/808: symlink d2/d14/d18/d45/d69/daf/dea/l121 0 2024-02-20T08:06:19.491 INFO:tasks.workunit.client.1.smithi194.stdout:2/882: dwrite df/d14/d19/d5c/d78/f90 [0,4194304] 0 2024-02-20T08:06:19.494 INFO:tasks.workunit.client.1.smithi194.stdout:7/867: mknod d11/d2d/d38/d37/c10d 0 2024-02-20T08:06:19.498 INFO:tasks.workunit.client.1.smithi194.stdout:9/917: rename d4/d20/d5c/dd0/def to d4/d1b/d133 0 2024-02-20T08:06:19.498 INFO:tasks.workunit.client.1.smithi194.stdout:2/883: symlink df/d14/l10a 0 2024-02-20T08:06:19.570 INFO:tasks.workunit.client.1.smithi194.stdout:8/809: read d2/d14/d18/d45/d7b/dc7/d78/d98/f9a [5466501,55636] 0 2024-02-20T08:06:19.573 INFO:tasks.workunit.client.1.smithi194.stdout:5/888: dwrite d4/d6/f75 [4194304,4194304] 0 2024-02-20T08:06:19.573 INFO:tasks.workunit.client.1.smithi194.stdout:1/839: dwrite d2/d8/d12/dc9/d61/d68/f89 [0,4194304] 0 2024-02-20T08:06:19.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/918: dwrite d4/d37/ddf/d42/d4e/fda [0,4194304] 0 2024-02-20T08:06:19.581 INFO:tasks.workunit.client.1.smithi194.stdout:9/919: readlink d4/d37/ddf/d59/le3 0 2024-02-20T08:06:19.585 INFO:tasks.workunit.client.1.smithi194.stdout:4/797: sync 2024-02-20T08:06:19.585 INFO:tasks.workunit.client.1.smithi194.stdout:0/809: dread d6/f90 [0,4194304] 0 2024-02-20T08:06:19.617 INFO:tasks.workunit.client.1.smithi194.stdout:4/798: mkdir d0/d5c/d60/d4a/dad/db0/deb 0 2024-02-20T08:06:19.617 INFO:tasks.workunit.client.1.smithi194.stdout:9/920: dread d4/d37/ddf/d42/d4e/d6e/d88/f8e [0,4194304] 0 2024-02-20T08:06:19.618 INFO:tasks.workunit.client.1.smithi194.stdout:6/940: sync 2024-02-20T08:06:19.619 INFO:tasks.workunit.client.1.smithi194.stdout:9/921: chown d4/de/f6d 38586740 1 2024-02-20T08:06:19.620 INFO:tasks.workunit.client.1.smithi194.stdout:1/840: creat d2/d8/d12/dc9/d26/d3d/de1/d110/f114 x:0 0 0 2024-02-20T08:06:19.622 INFO:tasks.workunit.client.1.smithi194.stdout:1/841: read d2/d8/d12/dc9/d26/d3d/d71/f7a [398406,66401] 0 2024-02-20T08:06:19.630 INFO:tasks.workunit.client.1.smithi194.stdout:9/922: mknod d4/d20/d43/daa/dcb/d104/dd2/d10f/c134 0 2024-02-20T08:06:19.632 INFO:tasks.workunit.client.1.smithi194.stdout:2/884: dread df/d14/d24/d56/f7c [0,4194304] 0 2024-02-20T08:06:19.632 INFO:tasks.workunit.client.1.smithi194.stdout:6/941: rename df/dab/d1d/d28/d46/d5a/d7d/dd4/d116 to df/dab/d1d/d28/d2b/d103/d104/d13f 0 2024-02-20T08:06:19.635 INFO:tasks.workunit.client.1.smithi194.stdout:4/799: write d0/d10/d1c/d4d/d2f/fd2 [730730,24562] 0 2024-02-20T08:06:19.636 INFO:tasks.workunit.client.1.smithi194.stdout:7/868: link d11/d2d/d38/d37/d43/de7/fa3 d11/d6e/dc6/f10e 0 2024-02-20T08:06:19.637 INFO:tasks.workunit.client.1.smithi194.stdout:4/800: write d0/d10/d1c/d4d/d2f/f3a [9269874,90021] 0 2024-02-20T08:06:19.639 INFO:tasks.workunit.client.1.smithi194.stdout:4/801: truncate d0/d2/d51/fa8 793854 0 2024-02-20T08:06:19.639 INFO:tasks.workunit.client.1.smithi194.stdout:9/923: creat d4/d37/dab/f135 x:0 0 0 2024-02-20T08:06:19.642 INFO:tasks.workunit.client.1.smithi194.stdout:6/942: mknod df/dab/d1d/d28/d46/d5a/d6b/d83/c140 0 2024-02-20T08:06:19.644 INFO:tasks.workunit.client.1.smithi194.stdout:7/869: mkdir d11/d6e/d10f 0 2024-02-20T08:06:19.647 INFO:tasks.workunit.client.1.smithi194.stdout:4/802: dwrite d0/d2/f35 [4194304,4194304] 0 2024-02-20T08:06:19.647 INFO:tasks.workunit.client.1.smithi194.stdout:9/924: dwrite d4/d1b/d133/f10a [0,4194304] 0 2024-02-20T08:06:19.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/925: read - d4/de/dc4/f110 zero size 2024-02-20T08:06:19.650 INFO:tasks.workunit.client.1.smithi194.stdout:2/885: rename df/d14/d19/d5c/d60/l6d to df/d14/d19/d5c/d97/df1/l10b 0 2024-02-20T08:06:19.653 INFO:tasks.workunit.client.1.smithi194.stdout:6/943: dread - df/dab/d1d/d28/d46/d5a/d6b/d83/fea zero size 2024-02-20T08:06:19.654 INFO:tasks.workunit.client.1.smithi194.stdout:4/803: symlink d0/d5c/d60/d4a/dad/db0/lec 0 2024-02-20T08:06:19.662 INFO:tasks.workunit.client.1.smithi194.stdout:9/926: dwrite d4/deb/f12a [4194304,4194304] 0 2024-02-20T08:06:19.667 INFO:tasks.workunit.client.1.smithi194.stdout:7/870: rename d11/d2d/fb2 to d11/d2d/d38/d4a/d27/d51/d77/de2/f110 0 2024-02-20T08:06:19.669 INFO:tasks.workunit.client.1.smithi194.stdout:8/810: write d2/d14/d18/d45/d90/fb2 [2577924,38796] 0 2024-02-20T08:06:19.670 INFO:tasks.workunit.client.1.smithi194.stdout:5/889: dwrite d4/d6/fc1 [0,4194304] 0 2024-02-20T08:06:19.671 INFO:tasks.workunit.client.1.smithi194.stdout:9/927: mkdir d4/d1b/d133/d11d/d136 0 2024-02-20T08:06:19.672 INFO:tasks.workunit.client.1.smithi194.stdout:9/928: read d4/d1b/fdb [145081,28889] 0 2024-02-20T08:06:19.674 INFO:tasks.workunit.client.1.smithi194.stdout:7/871: symlink d11/d2d/d38/d37/d43/de7/d105/l111 0 2024-02-20T08:06:19.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/872: chown d11/d2d/d38/d4a/d27/d51/d77/d9d/cf4 1107592 1 2024-02-20T08:06:19.676 INFO:tasks.workunit.client.1.smithi194.stdout:5/890: creat d4/d20/d2b/ddf/f10c x:0 0 0 2024-02-20T08:06:19.676 INFO:tasks.workunit.client.1.smithi194.stdout:7/873: chown d11/d2d/d38/d4a/d27/d51/f80 2031625 1 2024-02-20T08:06:19.677 INFO:tasks.workunit.client.1.smithi194.stdout:5/891: chown d4/d6/d11/d2f/f52 0 1 2024-02-20T08:06:19.678 INFO:tasks.workunit.client.1.smithi194.stdout:5/892: chown d4/d20/d2b/ddf/dc4/d28/d85/fc7 13273076 1 2024-02-20T08:06:19.678 INFO:tasks.workunit.client.1.smithi194.stdout:3/869: sync 2024-02-20T08:06:19.678 INFO:tasks.workunit.client.1.smithi194.stdout:9/929: mknod d4/d20/d41/c137 0 2024-02-20T08:06:19.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/870: readlink d5/d10/d16/d7b/le5 0 2024-02-20T08:06:19.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/871: chown d5/l6e 14241532 1 2024-02-20T08:06:19.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/930: write d4/d20/d41/db7/fc7 [907473,1483] 0 2024-02-20T08:06:19.682 INFO:tasks.workunit.client.1.smithi194.stdout:5/893: fdatasync d4/d6/d11/d2f/fb2 0 2024-02-20T08:06:19.685 INFO:tasks.workunit.client.1.smithi194.stdout:0/810: truncate d6/d2b/d35/f53 4192264 0 2024-02-20T08:06:19.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/872: creat d5/d10/d28/d41/d73/d8c/de8/df3/f113 x:0 0 0 2024-02-20T08:06:19.691 INFO:tasks.workunit.client.1.smithi194.stdout:9/931: symlink d4/d20/l138 0 2024-02-20T08:06:19.694 INFO:tasks.workunit.client.1.smithi194.stdout:3/873: creat d5/d10/d28/d41/d73/d8c/de8/df3/f114 x:0 0 0 2024-02-20T08:06:19.696 INFO:tasks.workunit.client.1.smithi194.stdout:9/932: unlink d4/d37/ddf/d42/d4e/d6e/d88/cb2 0 2024-02-20T08:06:19.696 INFO:tasks.workunit.client.1.smithi194.stdout:2/886: dread df/d5b/ffa [0,4194304] 0 2024-02-20T08:06:19.700 INFO:tasks.workunit.client.1.smithi194.stdout:9/933: chown d4/d1b/d90/f11a 26 1 2024-02-20T08:06:19.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/874: dwrite d5/d10/d28/f95 [0,4194304] 0 2024-02-20T08:06:19.704 INFO:tasks.workunit.client.1.smithi194.stdout:1/842: write d2/d8/f3c [567087,71159] 0 2024-02-20T08:06:19.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/875: readlink d5/d10/d16/l39 0 2024-02-20T08:06:19.708 INFO:tasks.workunit.client.1.smithi194.stdout:2/887: symlink df/d14/l10c 0 2024-02-20T08:06:19.709 INFO:tasks.workunit.client.1.smithi194.stdout:3/876: truncate d5/d10/d28/d41/fc0 286230 0 2024-02-20T08:06:19.710 INFO:tasks.workunit.client.1.smithi194.stdout:9/934: rename d4/d1b/l3d to d4/d20/d43/daa/dcb/d104/dd2/l139 0 2024-02-20T08:06:19.711 INFO:tasks.workunit.client.1.smithi194.stdout:1/843: write d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [5080818,55695] 0 2024-02-20T08:06:19.717 INFO:tasks.workunit.client.1.smithi194.stdout:5/894: dread d4/d6/d11/d2f/f4d [0,4194304] 0 2024-02-20T08:06:19.717 INFO:tasks.workunit.client.1.smithi194.stdout:3/877: dread d5/d10/f52 [0,4194304] 0 2024-02-20T08:06:19.718 INFO:tasks.workunit.client.1.smithi194.stdout:5/895: write d4/d20/d2b/ffb [45878,25869] 0 2024-02-20T08:06:19.718 INFO:tasks.workunit.client.1.smithi194.stdout:3/878: write d5/df/d60/fa3 [1965422,127935] 0 2024-02-20T08:06:19.719 INFO:tasks.workunit.client.1.smithi194.stdout:3/879: fdatasync d5/d10/d28/d41/d73/d8c/da6/fd1 0 2024-02-20T08:06:19.719 INFO:tasks.workunit.client.1.smithi194.stdout:3/880: stat d5/d10/d16/lf8 0 2024-02-20T08:06:19.720 INFO:tasks.workunit.client.1.smithi194.stdout:3/881: truncate d5/df/d75/f87 12597635 0 2024-02-20T08:06:19.761 INFO:tasks.workunit.client.1.smithi194.stdout:0/811: sync 2024-02-20T08:06:19.785 INFO:tasks.workunit.client.1.smithi194.stdout:3/882: dread d5/d10/d28/d41/d73/f103 [0,4194304] 0 2024-02-20T08:06:19.787 INFO:tasks.workunit.client.1.smithi194.stdout:9/935: rename d4/d20/d41/f9f to d4/d1b/d2e/de0/f13a 0 2024-02-20T08:06:19.789 INFO:tasks.workunit.client.1.smithi194.stdout:5/896: chown d4/d20/d2b/d79/fac 519681 1 2024-02-20T08:06:19.798 INFO:tasks.workunit.client.1.smithi194.stdout:7/874: dread d11/f1a [0,4194304] 0 2024-02-20T08:06:19.803 INFO:tasks.workunit.client.1.smithi194.stdout:6/944: dwrite df/dab/d1d/d28/d46/f13a [0,4194304] 0 2024-02-20T08:06:19.804 INFO:tasks.workunit.client.1.smithi194.stdout:1/844: rename d2/d8/d12/dc9/d61 to d2/d8/d12/dc9/d26/d3d/d71/d8c/d115 0 2024-02-20T08:06:19.807 INFO:tasks.workunit.client.1.smithi194.stdout:4/804: write d0/df/f3b [1356580,48407] 0 2024-02-20T08:06:19.808 INFO:tasks.workunit.client.1.smithi194.stdout:9/936: fsync d4/d20/d43/d51/f52 0 2024-02-20T08:06:19.811 INFO:tasks.workunit.client.1.smithi194.stdout:1/845: mknod d2/d8/d12/dc9/d26/d3d/d82/c116 0 2024-02-20T08:06:19.812 INFO:tasks.workunit.client.1.smithi194.stdout:1/846: chown d2/d8/d12/dc9/d26/fa5 18 1 2024-02-20T08:06:19.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/897: mkdir d4/d20/d2b/ddf/db6/d10d 0 2024-02-20T08:06:19.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/898: fsync d4/d6/dd/d25/d78/d8b/fff 0 2024-02-20T08:06:19.815 INFO:tasks.workunit.client.1.smithi194.stdout:6/945: mknod df/dab/d1d/d28/d46/d5a/d6b/dcb/c141 0 2024-02-20T08:06:19.817 INFO:tasks.workunit.client.1.smithi194.stdout:4/805: rename d0/d10/lda to d0/df/d72/dc9/led 0 2024-02-20T08:06:19.819 INFO:tasks.workunit.client.1.smithi194.stdout:9/937: unlink d4/d20/fbe 0 2024-02-20T08:06:19.820 INFO:tasks.workunit.client.1.smithi194.stdout:8/811: dwrite d2/d14/d18/d45/d7b/f99 [0,4194304] 0 2024-02-20T08:06:19.820 INFO:tasks.workunit.client.1.smithi194.stdout:9/938: dread - d4/d37/dab/f135 zero size 2024-02-20T08:06:19.832 INFO:tasks.workunit.client.1.smithi194.stdout:7/875: symlink d11/d2d/d38/d37/l112 0 2024-02-20T08:06:19.838 INFO:tasks.workunit.client.1.smithi194.stdout:4/806: mknod d0/d2/d51/cee 0 2024-02-20T08:06:19.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/876: symlink d11/d2d/d38/d37/d43/d8e/d6b/l113 0 2024-02-20T08:06:19.841 INFO:tasks.workunit.client.1.smithi194.stdout:2/888: write df/f41 [2831724,11357] 0 2024-02-20T08:06:19.844 INFO:tasks.workunit.client.1.smithi194.stdout:1/847: creat d2/f117 x:0 0 0 2024-02-20T08:06:19.844 INFO:tasks.workunit.client.1.smithi194.stdout:4/807: mkdir d0/d4f/def 0 2024-02-20T08:06:19.846 INFO:tasks.workunit.client.1.smithi194.stdout:7/877: truncate d11/d2d/d38/d4a/d93/d9a/fd6 733004 0 2024-02-20T08:06:19.851 INFO:tasks.workunit.client.1.smithi194.stdout:4/808: dwrite d0/df/f3b [0,4194304] 0 2024-02-20T08:06:19.852 INFO:tasks.workunit.client.1.smithi194.stdout:3/883: dwrite d5/df/d30/f36 [4194304,4194304] 0 2024-02-20T08:06:19.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/878: mkdir d11/d2d/d38/d4a/d60/dea/d114 0 2024-02-20T08:06:19.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/809: stat d0/df/d41/cbc 0 2024-02-20T08:06:19.854 INFO:tasks.workunit.client.1.smithi194.stdout:3/884: fdatasync d5/df/d25/ffb 0 2024-02-20T08:06:19.856 INFO:tasks.workunit.client.1.smithi194.stdout:4/810: creat d0/d2/ff0 x:0 0 0 2024-02-20T08:06:19.858 INFO:tasks.workunit.client.1.smithi194.stdout:7/879: creat d11/d2d/d38/d4a/d27/d51/d77/d9d/f115 x:0 0 0 2024-02-20T08:06:19.859 INFO:tasks.workunit.client.1.smithi194.stdout:3/885: rmdir d5/d10/d16/d8a 39 2024-02-20T08:06:19.861 INFO:tasks.workunit.client.1.smithi194.stdout:0/812: sync 2024-02-20T08:06:19.862 INFO:tasks.workunit.client.1.smithi194.stdout:4/811: creat d0/d2/d3e/dcc/ff1 x:0 0 0 2024-02-20T08:06:19.863 INFO:tasks.workunit.client.1.smithi194.stdout:0/813: readlink d6/d2b/d35/d42/d1e/d3c/l47 0 2024-02-20T08:06:19.863 INFO:tasks.workunit.client.1.smithi194.stdout:0/814: chown d6/d2b/d35/d39/df0/de5 24 1 2024-02-20T08:06:19.865 INFO:tasks.workunit.client.1.smithi194.stdout:6/946: write df/dab/d1d/d28/d46/d5a/fa2 [343065,70560] 0 2024-02-20T08:06:19.866 INFO:tasks.workunit.client.1.smithi194.stdout:6/947: chown df/dab/d1d/d28/d46/d5a/d6b/d83/d93 27441859 1 2024-02-20T08:06:19.874 INFO:tasks.workunit.client.1.smithi194.stdout:4/812: fdatasync d0/d4f/fdf 0 2024-02-20T08:06:19.874 INFO:tasks.workunit.client.1.smithi194.stdout:0/815: dread d6/d2b/d35/d39/f8e [0,4194304] 0 2024-02-20T08:06:19.875 INFO:tasks.workunit.client.1.smithi194.stdout:7/880: rename d11/d2d/d38/d37/d43/d8e/d6b to d11/d2d/d38/d4a/d60/dea/d114/d116 0 2024-02-20T08:06:19.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/812: dwrite d2/d14/d18/f61 [4194304,4194304] 0 2024-02-20T08:06:19.876 INFO:tasks.workunit.client.1.smithi194.stdout:6/948: mkdir df/d142 0 2024-02-20T08:06:19.878 INFO:tasks.workunit.client.1.smithi194.stdout:9/939: dwrite d4/d20/fb9 [0,4194304] 0 2024-02-20T08:06:19.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/848: write d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/f9c [158337,107909] 0 2024-02-20T08:06:19.887 INFO:tasks.workunit.client.1.smithi194.stdout:7/881: rmdir d11/d2d/d38/d37/d3c/d8d/dc9 39 2024-02-20T08:06:19.888 INFO:tasks.workunit.client.1.smithi194.stdout:2/889: dwrite df/d14/d24/fa8 [0,4194304] 0 2024-02-20T08:06:19.891 INFO:tasks.workunit.client.1.smithi194.stdout:8/813: dwrite d2/d14/d18/fcf [0,4194304] 0 2024-02-20T08:06:19.893 INFO:tasks.workunit.client.1.smithi194.stdout:6/949: creat df/dab/d1d/d28/d46/d5a/d6b/d83/f143 x:0 0 0 2024-02-20T08:06:19.895 INFO:tasks.workunit.client.1.smithi194.stdout:0/816: mkdir d6/d2b/d35/d42/d1e/d3c/d106 0 2024-02-20T08:06:19.896 INFO:tasks.workunit.client.1.smithi194.stdout:0/817: chown d6/f3d 70487 1 2024-02-20T08:06:19.896 INFO:tasks.workunit.client.1.smithi194.stdout:3/886: dread d5/df/d60/fa3 [0,4194304] 0 2024-02-20T08:06:19.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/813: rename d0/f19 to d0/df/d41/ff2 0 2024-02-20T08:06:19.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/940: truncate d4/d20/d5c/fca 747149 0 2024-02-20T08:06:19.910 INFO:tasks.workunit.client.1.smithi194.stdout:0/818: creat d6/d2b/d35/d48/d60/f107 x:0 0 0 2024-02-20T08:06:19.912 INFO:tasks.workunit.client.1.smithi194.stdout:4/814: creat d0/df/d41/d69/ff3 x:0 0 0 2024-02-20T08:06:19.913 INFO:tasks.workunit.client.1.smithi194.stdout:7/882: link d11/d2d/d38/d4a/d93/fda d11/d6e/d10f/f117 0 2024-02-20T08:06:19.915 INFO:tasks.workunit.client.1.smithi194.stdout:6/950: symlink df/dab/d1d/d28/d2b/d80/d128/l144 0 2024-02-20T08:06:19.917 INFO:tasks.workunit.client.1.smithi194.stdout:0/819: dwrite d6/d2b/d35/d42/d1e/f23 [0,4194304] 0 2024-02-20T08:06:19.919 INFO:tasks.workunit.client.1.smithi194.stdout:8/814: rename d2/d14/d18/d45/d7b/dc7/d78/d98/c4f to d2/d14/d18/d45/d4e/c122 0 2024-02-20T08:06:19.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/899: sync 2024-02-20T08:06:19.921 INFO:tasks.workunit.client.1.smithi194.stdout:7/883: mkdir d11/d6e/d10f/d118 0 2024-02-20T08:06:19.922 INFO:tasks.workunit.client.1.smithi194.stdout:6/951: dread df/f3c [0,4194304] 0 2024-02-20T08:06:19.922 INFO:tasks.workunit.client.1.smithi194.stdout:8/815: fsync d2/f1f 0 2024-02-20T08:06:19.922 INFO:tasks.workunit.client.1.smithi194.stdout:1/849: write d2/d8/d12/dc9/d26/d57/f90 [762607,84690] 0 2024-02-20T08:06:19.923 INFO:tasks.workunit.client.1.smithi194.stdout:9/941: rename d4/d20/d5c/la0 to d4/d37/ddf/d59/l13b 0 2024-02-20T08:06:19.925 INFO:tasks.workunit.client.1.smithi194.stdout:2/890: write df/d14/d24/d56/d6b/d81/f87 [5061443,14667] 0 2024-02-20T08:06:19.926 INFO:tasks.workunit.client.1.smithi194.stdout:3/887: dread d5/d10/f13 [0,4194304] 0 2024-02-20T08:06:19.927 INFO:tasks.workunit.client.1.smithi194.stdout:6/952: write df/dab/d1d/d28/fb9 [995361,69856] 0 2024-02-20T08:06:19.927 INFO:tasks.workunit.client.1.smithi194.stdout:7/884: write f5 [14408853,87134] 0 2024-02-20T08:06:19.930 INFO:tasks.workunit.client.1.smithi194.stdout:4/815: rename d0/df/d11/f7b to d0/df/d72/ff4 0 2024-02-20T08:06:19.930 INFO:tasks.workunit.client.1.smithi194.stdout:7/885: readlink d11/d2d/d38/d37/d3c/l3f 0 2024-02-20T08:06:19.930 INFO:tasks.workunit.client.1.smithi194.stdout:6/953: write df/dab/d1d/d28/d46/f13a [7594176,125489] 0 2024-02-20T08:06:19.933 INFO:tasks.workunit.client.1.smithi194.stdout:7/886: write d11/d2d/d38/d37/d43/d7b/dc5/fdd [13581214,78247] 0 2024-02-20T08:06:19.934 INFO:tasks.workunit.client.1.smithi194.stdout:8/816: write d2/d14/d18/d45/d4e/dbe/dc3/f10a [627080,3965] 0 2024-02-20T08:06:19.935 INFO:tasks.workunit.client.1.smithi194.stdout:0/820: rmdir d6/dbe/de2 0 2024-02-20T08:06:19.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/942: dread d4/d20/d41/db6/f12f [0,4194304] 0 2024-02-20T08:06:19.938 INFO:tasks.workunit.client.1.smithi194.stdout:1/850: creat d2/d8/d12/dc9/d26/dfc/f118 x:0 0 0 2024-02-20T08:06:19.939 INFO:tasks.workunit.client.1.smithi194.stdout:2/891: write df/d3a/db2/ffb [47270,92977] 0 2024-02-20T08:06:19.940 INFO:tasks.workunit.client.1.smithi194.stdout:5/900: mknod d4/d6/dd/d99/c10e 0 2024-02-20T08:06:19.941 INFO:tasks.workunit.client.1.smithi194.stdout:6/954: dread df/dab/d1d/d28/d2b/d94/d96/f9c [0,4194304] 0 2024-02-20T08:06:19.941 INFO:tasks.workunit.client.1.smithi194.stdout:5/901: chown d4/d20/d2b/ddf/dc4/d28 177 1 2024-02-20T08:06:19.942 INFO:tasks.workunit.client.1.smithi194.stdout:5/902: chown d4/d6/l40 0 1 2024-02-20T08:06:19.948 INFO:tasks.workunit.client.1.smithi194.stdout:7/887: rename d11/d2d/d38/d37/d43/d7b/d91/fb1 to d11/d2d/d38/d95/f119 0 2024-02-20T08:06:19.950 INFO:tasks.workunit.client.1.smithi194.stdout:3/888: write d5/d10/f13 [4784044,16303] 0 2024-02-20T08:06:19.952 INFO:tasks.workunit.client.1.smithi194.stdout:3/889: read - d5/d10/d16/d7b/d94/fff zero size 2024-02-20T08:06:19.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/821: write d6/d2b/d35/d42/d1e/f3f [797301,74892] 0 2024-02-20T08:06:19.958 INFO:tasks.workunit.client.1.smithi194.stdout:4/816: dread d0/d10/d1c/d4d/f90 [0,4194304] 0 2024-02-20T08:06:19.959 INFO:tasks.workunit.client.1.smithi194.stdout:3/890: dwrite d5/d10/d17/d1d/f6b [0,4194304] 0 2024-02-20T08:06:20.005 INFO:tasks.workunit.client.1.smithi194.stdout:0/822: dread d6/d2b/d35/d48/f4a [0,4194304] 0 2024-02-20T08:06:20.027 INFO:tasks.workunit.client.1.smithi194.stdout:6/955: readlink df/dab/l88 0 2024-02-20T08:06:20.030 INFO:tasks.workunit.client.1.smithi194.stdout:5/903: rename d4/d20/d2b/d79 to d4/d6/d11/d2f/d10f 0 2024-02-20T08:06:20.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/888: mkdir d11/d2d/d38/d4a/d60/dea/d114/d11a 0 2024-02-20T08:06:20.038 INFO:tasks.workunit.client.1.smithi194.stdout:4/817: mkdir d0/d10/d1c/df5 0 2024-02-20T08:06:20.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/817: sync 2024-02-20T08:06:20.039 INFO:tasks.workunit.client.1.smithi194.stdout:4/818: write d0/d10/d1c/d21/f44 [2486718,7583] 0 2024-02-20T08:06:20.044 INFO:tasks.workunit.client.1.smithi194.stdout:1/851: truncate d2/d8/f3c 282182 0 2024-02-20T08:06:20.045 INFO:tasks.workunit.client.1.smithi194.stdout:2/892: creat df/d14/d19/d5c/f10d x:0 0 0 2024-02-20T08:06:20.045 INFO:tasks.workunit.client.1.smithi194.stdout:3/891: mkdir d5/d10/d16/d7b/d94/dad/d110/d115 0 2024-02-20T08:06:20.047 INFO:tasks.workunit.client.1.smithi194.stdout:7/889: write d11/d6e/dc6/ffe [558214,23749] 0 2024-02-20T08:06:20.047 INFO:tasks.workunit.client.1.smithi194.stdout:8/818: mknod d2/d14/dc4/c123 0 2024-02-20T08:06:20.049 INFO:tasks.workunit.client.1.smithi194.stdout:8/819: truncate d2/d14/d18/d45/d7b/f102 425351 0 2024-02-20T08:06:20.050 INFO:tasks.workunit.client.1.smithi194.stdout:4/819: dread d0/d10/d1c/f5a [0,4194304] 0 2024-02-20T08:06:20.050 INFO:tasks.workunit.client.1.smithi194.stdout:0/823: link d6/d2b/d35/d42/fe0 d6/d2b/d35/d48/d60/f108 0 2024-02-20T08:06:20.052 INFO:tasks.workunit.client.1.smithi194.stdout:6/956: rename df/dab/d1d/d28/d2b/l34 to df/dab/d1d/d28/d46/dc6/d136/l145 0 2024-02-20T08:06:20.055 INFO:tasks.workunit.client.1.smithi194.stdout:1/852: creat d2/d8/df/f119 x:0 0 0 2024-02-20T08:06:20.056 INFO:tasks.workunit.client.1.smithi194.stdout:8/820: dwrite d2/d80/fda [0,4194304] 0 2024-02-20T08:06:20.062 INFO:tasks.workunit.client.1.smithi194.stdout:4/820: symlink d0/df/d41/d69/lf6 0 2024-02-20T08:06:20.066 INFO:tasks.workunit.client.1.smithi194.stdout:6/957: chown df/dab/d1d/d28/ca3 7840 1 2024-02-20T08:06:20.068 INFO:tasks.workunit.client.1.smithi194.stdout:9/943: rename d4/d20/d43/daa/dcb/d104 to d4/d1b/d133/d11d/d136/d13c 0 2024-02-20T08:06:20.070 INFO:tasks.workunit.client.1.smithi194.stdout:2/893: mkdir df/d14/d19/d5c/d97/d10e 0 2024-02-20T08:06:20.071 INFO:tasks.workunit.client.1.smithi194.stdout:1/853: mknod d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d68/c11a 0 2024-02-20T08:06:20.072 INFO:tasks.workunit.client.1.smithi194.stdout:1/854: fdatasync d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7d/dbf/fec 0 2024-02-20T08:06:20.073 INFO:tasks.workunit.client.1.smithi194.stdout:7/890: unlink d11/d2d/d38/d37/d3c/d8d/dc9/fd9 0 2024-02-20T08:06:20.074 INFO:tasks.workunit.client.1.smithi194.stdout:2/894: read df/d14/d19/d5c/d60/d63/d92/fcb [3387991,99986] 0 2024-02-20T08:06:20.075 INFO:tasks.workunit.client.1.smithi194.stdout:2/895: chown df/l33 100804825 1 2024-02-20T08:06:20.080 INFO:tasks.workunit.client.1.smithi194.stdout:6/958: creat df/dab/d1d/d28/d46/d5a/d7d/f146 x:0 0 0 2024-02-20T08:06:20.081 INFO:tasks.workunit.client.1.smithi194.stdout:3/892: rename d5/d10/d62/db2 to d5/d10/d28/d41/d73/d8c/da6/d116 0 2024-02-20T08:06:20.083 INFO:tasks.workunit.client.1.smithi194.stdout:1/855: mknod d2/d8/d12/dc9/d26/d3d/d71/d8c/c11b 0 2024-02-20T08:06:20.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/821: mknod d0/d4f/def/cf7 0 2024-02-20T08:06:20.086 INFO:tasks.workunit.client.1.smithi194.stdout:0/824: truncate d6/d2b/d35/d48/df9/ffb 943113 0 2024-02-20T08:06:20.087 INFO:tasks.workunit.client.1.smithi194.stdout:2/896: symlink df/d14/d19/l10f 0 2024-02-20T08:06:20.087 INFO:tasks.workunit.client.1.smithi194.stdout:6/959: rmdir df/dab 39 2024-02-20T08:06:20.091 INFO:tasks.workunit.client.1.smithi194.stdout:2/897: truncate df/d14/d19/d5c/f65 4934271 0 2024-02-20T08:06:20.091 INFO:tasks.workunit.client.1.smithi194.stdout:3/893: symlink d5/d10/d28/dd3/db7/dea/l117 0 2024-02-20T08:06:20.092 INFO:tasks.workunit.client.1.smithi194.stdout:1/856: truncate d2/d8/d12/dc9/d26/d3d/d71/f7a 1565100 0 2024-02-20T08:06:20.092 INFO:tasks.workunit.client.1.smithi194.stdout:7/891: getdents d11/d2d/d38/d4a/d60/dea/d114/d116/dff 0 2024-02-20T08:06:20.096 INFO:tasks.workunit.client.1.smithi194.stdout:8/821: getdents d2 0 2024-02-20T08:06:20.097 INFO:tasks.workunit.client.1.smithi194.stdout:9/944: rename d4/d20/d41/la3 to d4/d37/ddf/d59/l13d 0 2024-02-20T08:06:20.102 INFO:tasks.workunit.client.1.smithi194.stdout:0/825: dread d6/d2b/d35/d42/f15 [0,4194304] 0 2024-02-20T08:06:20.102 INFO:tasks.workunit.client.1.smithi194.stdout:4/822: dread d0/d2/f2e [0,4194304] 0 2024-02-20T08:06:20.104 INFO:tasks.workunit.client.1.smithi194.stdout:6/960: unlink df/dab/d1d/d28/d46/d5a/d6b/d83/c9e 0 2024-02-20T08:06:20.105 INFO:tasks.workunit.client.1.smithi194.stdout:1/857: dwrite d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7d/dbf/fec [0,4194304] 0 2024-02-20T08:06:20.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/894: creat d5/d10/df2/dfc/f118 x:0 0 0 2024-02-20T08:06:20.108 INFO:tasks.workunit.client.1.smithi194.stdout:1/858: read - d2/d8/d12/dc9/d26/dfc/d111/f104 zero size 2024-02-20T08:06:20.110 INFO:tasks.workunit.client.1.smithi194.stdout:6/961: read df/dab/d1d/d28/d46/d5a/f64 [238560,67638] 0 2024-02-20T08:06:20.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/822: dwrite d2/d14/d18/d45/d69/daf/db3/fd0 [0,4194304] 0 2024-02-20T08:06:20.115 INFO:tasks.workunit.client.1.smithi194.stdout:3/895: dwrite d5/d10/d16/f5a [0,4194304] 0 2024-02-20T08:06:20.116 INFO:tasks.workunit.client.1.smithi194.stdout:7/892: symlink d11/d2d/d38/d4a/l11b 0 2024-02-20T08:06:20.117 INFO:tasks.workunit.client.1.smithi194.stdout:1/859: dwrite d2/d8/d12/dc9/d26/fe3 [0,4194304] 0 2024-02-20T08:06:20.120 INFO:tasks.workunit.client.1.smithi194.stdout:3/896: chown d5/d10/d17/d1d/f6b 12 1 2024-02-20T08:06:20.121 INFO:tasks.workunit.client.1.smithi194.stdout:5/904: sync 2024-02-20T08:06:20.121 INFO:tasks.workunit.client.1.smithi194.stdout:1/860: write d2/d8/d12/dc9/d26/d3d/d71/f66 [103925,1825] 0 2024-02-20T08:06:20.122 INFO:tasks.workunit.client.1.smithi194.stdout:3/897: readlink d5/df/d25/l4b 0 2024-02-20T08:06:20.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/823: rename d0/f2d to d0/d4f/ff8 0 2024-02-20T08:06:20.124 INFO:tasks.workunit.client.1.smithi194.stdout:1/861: stat d2/d8/d12/dc9/d26/d3d/fda 0 2024-02-20T08:06:20.125 INFO:tasks.workunit.client.1.smithi194.stdout:0/826: creat d6/d2b/d35/d42/d1e/d45/f109 x:0 0 0 2024-02-20T08:06:20.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/824: chown d0/c7 423838841 1 2024-02-20T08:06:20.125 INFO:tasks.workunit.client.1.smithi194.stdout:7/893: dread d11/d2d/d38/d95/fbe [0,4194304] 0 2024-02-20T08:06:20.126 INFO:tasks.workunit.client.1.smithi194.stdout:0/827: dread d6/fee [0,4194304] 0 2024-02-20T08:06:20.131 INFO:tasks.workunit.client.1.smithi194.stdout:6/962: dread df/dab/d1d/d28/d2b/d80/fb7 [0,4194304] 0 2024-02-20T08:06:20.133 INFO:tasks.workunit.client.1.smithi194.stdout:9/945: dread d4/d20/d43/f47 [0,4194304] 0 2024-02-20T08:06:20.133 INFO:tasks.workunit.client.1.smithi194.stdout:9/946: chown d4/d37/ddf/dc8/d11f 629378 1 2024-02-20T08:06:20.137 INFO:tasks.workunit.client.1.smithi194.stdout:3/898: fdatasync d5/d10/d16/d7b/f107 0 2024-02-20T08:06:20.143 INFO:tasks.workunit.client.1.smithi194.stdout:1/862: creat d2/d8/d12/dc9/d26/d3d/f11c x:0 0 0 2024-02-20T08:06:20.144 INFO:tasks.workunit.client.1.smithi194.stdout:0/828: symlink d6/d2b/d35/d9c/d62/dd9/l10a 0 2024-02-20T08:06:20.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/823: creat d2/dfd/f124 x:0 0 0 2024-02-20T08:06:20.145 INFO:tasks.workunit.client.1.smithi194.stdout:0/829: write d6/d2b/d35/d42/f16 [3112201,35427] 0 2024-02-20T08:06:20.146 INFO:tasks.workunit.client.1.smithi194.stdout:0/830: stat d6/d2b/d35/d42/f15 0 2024-02-20T08:06:20.147 INFO:tasks.workunit.client.1.smithi194.stdout:0/831: readlink l5 0 2024-02-20T08:06:20.148 INFO:tasks.workunit.client.1.smithi194.stdout:2/898: link df/d14/c30 df/d14/d24/d56/d6b/d81/c110 0 2024-02-20T08:06:20.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/905: fsync d4/d6/dd/d3a/f9a 0 2024-02-20T08:06:20.152 INFO:tasks.workunit.client.1.smithi194.stdout:3/899: fsync d5/df/d60/fa3 0 2024-02-20T08:06:20.156 INFO:tasks.workunit.client.1.smithi194.stdout:7/894: dwrite d11/d2d/d38/d95/fbe [0,4194304] 0 2024-02-20T08:06:20.159 INFO:tasks.workunit.client.1.smithi194.stdout:8/824: rmdir d2/d80/dd1/d10c 39 2024-02-20T08:06:20.161 INFO:tasks.workunit.client.1.smithi194.stdout:8/825: write d2/d14/d18/d45/d7b/dc7/f7d [1298562,106520] 0 2024-02-20T08:06:20.162 INFO:tasks.workunit.client.1.smithi194.stdout:0/832: fdatasync d6/d2b/d35/d42/d1e/f2e 0 2024-02-20T08:06:20.164 INFO:tasks.workunit.client.1.smithi194.stdout:9/947: mknod d4/d1b/c13e 0 2024-02-20T08:06:20.166 INFO:tasks.workunit.client.1.smithi194.stdout:6/963: write df/d42/f65 [3928158,110414] 0 2024-02-20T08:06:20.168 INFO:tasks.workunit.client.1.smithi194.stdout:5/906: truncate d4/d6/dd/d25/d78/f106 795533 0 2024-02-20T08:06:20.169 INFO:tasks.workunit.client.1.smithi194.stdout:3/900: symlink d5/df/d25/l119 0 2024-02-20T08:06:20.178 INFO:tasks.workunit.client.1.smithi194.stdout:2/899: creat df/d14/d19/d5c/d97/d10e/f111 x:0 0 0 2024-02-20T08:06:20.182 INFO:tasks.workunit.client.1.smithi194.stdout:3/901: rename d5/d10/d17/feb to d5/d10/d16/d7b/d94/f11a 0 2024-02-20T08:06:20.183 INFO:tasks.workunit.client.1.smithi194.stdout:2/900: dwrite df/d14/d24/d56/d6b/fbc [0,4194304] 0 2024-02-20T08:06:20.184 INFO:tasks.workunit.client.1.smithi194.stdout:7/895: write d11/d2d/d38/d37/d3c/f42 [2319485,76795] 0 2024-02-20T08:06:20.190 INFO:tasks.workunit.client.1.smithi194.stdout:1/863: dwrite d2/f7 [0,4194304] 0 2024-02-20T08:06:20.191 INFO:tasks.workunit.client.1.smithi194.stdout:0/833: dwrite d6/d2b/d35/d39/fc2 [0,4194304] 0 2024-02-20T08:06:20.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/826: creat d2/d14/d18/d45/d69/f125 x:0 0 0 2024-02-20T08:06:20.201 INFO:tasks.workunit.client.1.smithi194.stdout:9/948: link d4/d20/d43/d51/f52 d4/d1b/d107/f13f 0 2024-02-20T08:06:20.203 INFO:tasks.workunit.client.1.smithi194.stdout:1/864: creat d2/d8/d12/dc9/d26/d3d/d82/f11d x:0 0 0 2024-02-20T08:06:20.205 INFO:tasks.workunit.client.1.smithi194.stdout:0/834: creat d6/d2b/d35/d9c/d62/dc1/f10b x:0 0 0 2024-02-20T08:06:20.206 INFO:tasks.workunit.client.1.smithi194.stdout:3/902: creat d5/d10/d17/dc2/d101/f11b x:0 0 0 2024-02-20T08:06:20.209 INFO:tasks.workunit.client.1.smithi194.stdout:1/865: write d2/d8/d12/dc9/fc1 [435315,25450] 0 2024-02-20T08:06:20.209 INFO:tasks.workunit.client.1.smithi194.stdout:6/964: dwrite df/dab/d1d/d28/f48 [0,4194304] 0 2024-02-20T08:06:20.211 INFO:tasks.workunit.client.1.smithi194.stdout:5/907: dwrite d4/d6/fb3 [0,4194304] 0 2024-02-20T08:06:20.214 INFO:tasks.workunit.client.1.smithi194.stdout:6/965: chown df/dab/d1d/d28/c9f 70 1 2024-02-20T08:06:20.215 INFO:tasks.workunit.client.1.smithi194.stdout:2/901: dwrite df/d14/d80/d85/db8/fde [0,4194304] 0 2024-02-20T08:06:20.218 INFO:tasks.workunit.client.1.smithi194.stdout:7/896: link d11/d2d/l48 d11/d2d/d38/d4a/d93/l11c 0 2024-02-20T08:06:20.226 INFO:tasks.workunit.client.1.smithi194.stdout:7/897: write d11/d6e/f78 [1511051,74445] 0 2024-02-20T08:06:20.226 INFO:tasks.workunit.client.1.smithi194.stdout:0/835: dwrite d6/d2b/d35/d39/d55/fde [0,4194304] 0 2024-02-20T08:06:20.228 INFO:tasks.workunit.client.1.smithi194.stdout:8/827: getdents d2/d14/d18/d45/d69/daf/db3/dce 0 2024-02-20T08:06:20.231 INFO:tasks.workunit.client.1.smithi194.stdout:4/825: sync 2024-02-20T08:06:20.231 INFO:tasks.workunit.client.1.smithi194.stdout:5/908: symlink d4/d6/d11/d2f/d77/d90/d100/l110 0 2024-02-20T08:06:20.232 INFO:tasks.workunit.client.1.smithi194.stdout:7/898: rename d11/d2d/d38/d4a/d27/d51/d77/d9d/cdc to d11/d2d/d38/d95/c11d 0 2024-02-20T08:06:20.234 INFO:tasks.workunit.client.1.smithi194.stdout:2/902: dwrite df/f41 [0,4194304] 0 2024-02-20T08:06:20.238 INFO:tasks.workunit.client.1.smithi194.stdout:0/836: creat d6/d2b/d35/d42/d1e/da2/f10c x:0 0 0 2024-02-20T08:06:20.242 INFO:tasks.workunit.client.1.smithi194.stdout:7/899: truncate d11/d2d/d38/d37/d3c/ff0 755744 0 2024-02-20T08:06:20.243 INFO:tasks.workunit.client.1.smithi194.stdout:8/828: symlink d2/d14/d18/d45/d69/daf/dea/l126 0 2024-02-20T08:06:20.245 INFO:tasks.workunit.client.1.smithi194.stdout:5/909: dwrite d4/d6/d11/f7e [0,4194304] 0 2024-02-20T08:06:20.249 INFO:tasks.workunit.client.1.smithi194.stdout:8/829: write d2/d14/d18/d45/d7b/dc0/df3/fff [989892,27594] 0 2024-02-20T08:06:20.249 INFO:tasks.workunit.client.1.smithi194.stdout:5/910: fsync d4/d20/d2b/ddf/dc4/d28/d85/fc7 0 2024-02-20T08:06:20.249 INFO:tasks.workunit.client.1.smithi194.stdout:9/949: dwrite d4/d37/ddf/d42/f7d [0,4194304] 0 2024-02-20T08:06:20.250 INFO:tasks.workunit.client.1.smithi194.stdout:0/837: unlink d6/d2b/d35/d42/l2d 0 2024-02-20T08:06:20.252 INFO:tasks.workunit.client.1.smithi194.stdout:9/950: dread - d4/d37/ddf/d59/ff3 zero size 2024-02-20T08:06:20.252 INFO:tasks.workunit.client.1.smithi194.stdout:4/826: link d0/d10/cdd d0/df/d72/d97/dd1/cf9 0 2024-02-20T08:06:20.252 INFO:tasks.workunit.client.1.smithi194.stdout:8/830: dread - d2/d14/d18/d45/d4e/dbe/f115 zero size 2024-02-20T08:06:20.258 INFO:tasks.workunit.client.1.smithi194.stdout:5/911: mkdir d4/d20/d111 0 2024-02-20T08:06:20.260 INFO:tasks.workunit.client.1.smithi194.stdout:1/866: dread d2/d8/d12/f43 [0,4194304] 0 2024-02-20T08:06:20.261 INFO:tasks.workunit.client.1.smithi194.stdout:3/903: truncate d5/d10/d17/fab 11250467 0 2024-02-20T08:06:20.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/867: chown d2/d8/d12/dc9/d26/d3d/d71/d8c/f19 103862659 1 2024-02-20T08:06:20.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/827: mkdir d0/d5c/d60/d4a/dad/db0/dfa 0 2024-02-20T08:06:20.265 INFO:tasks.workunit.client.1.smithi194.stdout:4/828: chown d0/d2/fc8 3 1 2024-02-20T08:06:20.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/829: chown d0/df/d41/d69 3327388 1 2024-02-20T08:06:20.270 INFO:tasks.workunit.client.1.smithi194.stdout:6/966: dwrite df/dab/f2c [0,4194304] 0 2024-02-20T08:06:20.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/831: truncate d2/d80/fa6 1458654 0 2024-02-20T08:06:20.276 INFO:tasks.workunit.client.1.smithi194.stdout:0/838: creat d6/d2b/d35/da3/f10d x:0 0 0 2024-02-20T08:06:20.278 INFO:tasks.workunit.client.1.smithi194.stdout:6/967: dwrite df/dab/fd0 [0,4194304] 0 2024-02-20T08:06:20.280 INFO:tasks.workunit.client.1.smithi194.stdout:2/903: truncate df/d14/d19/d5c/d60/d63/f62 2680751 0 2024-02-20T08:06:20.280 INFO:tasks.workunit.client.1.smithi194.stdout:4/830: mknod d0/d5c/d60/d4a/d4e/cfb 0 2024-02-20T08:06:20.282 INFO:tasks.workunit.client.1.smithi194.stdout:2/904: write df/d14/d19/d5c/d97/dc8/ff6 [607432,39335] 0 2024-02-20T08:06:20.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/831: chown d0/d5c/d60/d4a/lb5 11968 1 2024-02-20T08:06:20.283 INFO:tasks.workunit.client.1.smithi194.stdout:4/832: stat d0/d5c/d60/d4a/dad/db0/lec 0 2024-02-20T08:06:20.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/905: fdatasync df/d14/d19/d5c/d60/f7f 0 2024-02-20T08:06:20.291 INFO:tasks.workunit.client.1.smithi194.stdout:9/951: dwrite d4/d37/d38/fb1 [0,4194304] 0 2024-02-20T08:06:20.292 INFO:tasks.workunit.client.1.smithi194.stdout:8/832: mknod d2/d14/d18/d45/d90/c127 0 2024-02-20T08:06:20.292 INFO:tasks.workunit.client.1.smithi194.stdout:8/833: stat d2/d80/fbb 0 2024-02-20T08:06:20.301 INFO:tasks.workunit.client.1.smithi194.stdout:2/906: rename df/d14/d24/d56/d6b/d81/l7b to df/d14/d19/d5c/d60/d63/d92/l112 0 2024-02-20T08:06:20.302 INFO:tasks.workunit.client.1.smithi194.stdout:3/904: creat d5/d10/f11c x:0 0 0 2024-02-20T08:06:20.306 INFO:tasks.workunit.client.1.smithi194.stdout:1/868: link d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7e/cba d2/d8/d12/dc9/d26/d45/d98/dc6/c11e 0 2024-02-20T08:06:20.308 INFO:tasks.workunit.client.1.smithi194.stdout:1/869: rename d2 to d2/d8/d12/dc9/d26/d45/d98/dc6/d11f 22 2024-02-20T08:06:20.312 INFO:tasks.workunit.client.1.smithi194.stdout:6/968: creat df/dab/d1d/d28/d46/d5a/d6b/d13c/f147 x:0 0 0 2024-02-20T08:06:20.314 INFO:tasks.workunit.client.1.smithi194.stdout:1/870: dwrite d2/d8/d12/dc9/d26/dfc/f118 [0,4194304] 0 2024-02-20T08:06:20.315 INFO:tasks.workunit.client.1.smithi194.stdout:5/912: getdents d4/d20/d2b/ddf/db6/dbc 0 2024-02-20T08:06:20.316 INFO:tasks.workunit.client.1.smithi194.stdout:4/833: mkdir d0/d5c/d60/d4a/dad/db0/deb/dfc 0 2024-02-20T08:06:20.321 INFO:tasks.workunit.client.1.smithi194.stdout:1/871: dwrite d2/d8/d12/dc9/d26/d3d/d82/fd5 [0,4194304] 0 2024-02-20T08:06:20.323 INFO:tasks.workunit.client.1.smithi194.stdout:1/872: readlink d2/d8/d12/dc9/d26/lbd 0 2024-02-20T08:06:20.324 INFO:tasks.workunit.client.1.smithi194.stdout:1/873: chown d2/d8/d12/dc9/d26/d3d/d82/l109 1774 1 2024-02-20T08:06:20.335 INFO:tasks.workunit.client.1.smithi194.stdout:3/905: link d5/l6e d5/d10/d28/d41/d73/l11d 0 2024-02-20T08:06:20.336 INFO:tasks.workunit.client.1.smithi194.stdout:3/906: fsync d5/d10/d28/d41/d73/d8c/fe3 0 2024-02-20T08:06:20.337 INFO:tasks.workunit.client.1.smithi194.stdout:9/952: getdents d4/d20/d5c/dd0 0 2024-02-20T08:06:20.339 INFO:tasks.workunit.client.1.smithi194.stdout:9/953: write d4/d55/fa6 [507846,124046] 0 2024-02-20T08:06:20.339 INFO:tasks.workunit.client.1.smithi194.stdout:6/969: rename df/dab/d1d/d28/d5e/da7 to df/dab/d1d/d28/d148 0 2024-02-20T08:06:20.341 INFO:tasks.workunit.client.1.smithi194.stdout:0/839: dwrite d6/d2b/d35/f73 [0,4194304] 0 2024-02-20T08:06:20.342 INFO:tasks.workunit.client.1.smithi194.stdout:6/970: chown df/dab/d1d/d28/fb9 149205132 1 2024-02-20T08:06:20.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/907: truncate df/d14/d19/d5c/d97/dc8/ff6 128039 0 2024-02-20T08:06:20.343 INFO:tasks.workunit.client.1.smithi194.stdout:6/971: chown df/dab/d1d/d28/d46/d5a/d6b/d83/d93 10 1 2024-02-20T08:06:20.345 INFO:tasks.workunit.client.1.smithi194.stdout:3/907: rename d5/d10/d28/c35 to d5/df/d30/c11e 0 2024-02-20T08:06:20.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/874: dwrite d2/d8/d60/fa7 [0,4194304] 0 2024-02-20T08:06:20.354 INFO:tasks.workunit.client.1.smithi194.stdout:9/954: rename d4/d20/d5c/d12c to d4/d20/d43/d51/d140 0 2024-02-20T08:06:20.356 INFO:tasks.workunit.client.1.smithi194.stdout:5/913: dread d4/d6/dd/d25/d78/d8b/f54 [0,4194304] 0 2024-02-20T08:06:20.358 INFO:tasks.workunit.client.1.smithi194.stdout:1/875: read d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d68/f89 [3666076,55395] 0 2024-02-20T08:06:20.358 INFO:tasks.workunit.client.1.smithi194.stdout:5/914: stat d4/d6/d11/d2f/d77/c61 0 2024-02-20T08:06:20.364 INFO:tasks.workunit.client.1.smithi194.stdout:9/955: fdatasync d4/d1b/f74 0 2024-02-20T08:06:20.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/908: dwrite df/f4f [4194304,4194304] 0 2024-02-20T08:06:20.366 INFO:tasks.workunit.client.1.smithi194.stdout:5/915: creat d4/d6/dd/d25/d78/d8b/f112 x:0 0 0 2024-02-20T08:06:20.366 INFO:tasks.workunit.client.1.smithi194.stdout:1/876: mknod d2/d8/d12/dc9/d26/d45/d98/dc6/c120 0 2024-02-20T08:06:20.372 INFO:tasks.workunit.client.1.smithi194.stdout:9/956: symlink d4/d37/ddf/dc8/l141 0 2024-02-20T08:06:20.373 INFO:tasks.workunit.client.1.smithi194.stdout:2/909: rmdir df/d14/d19/d5c/d97/d9a/ddd 39 2024-02-20T08:06:20.376 INFO:tasks.workunit.client.1.smithi194.stdout:3/908: dwrite d5/d10/fca [0,4194304] 0 2024-02-20T08:06:20.377 INFO:tasks.workunit.client.1.smithi194.stdout:1/877: creat d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d68/f121 x:0 0 0 2024-02-20T08:06:20.377 INFO:tasks.workunit.client.1.smithi194.stdout:6/972: dread df/dab/d1d/d28/d46/d5a/d6b/dcb/f105 [4194304,4194304] 0 2024-02-20T08:06:20.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/900: sync 2024-02-20T08:06:20.380 INFO:tasks.workunit.client.1.smithi194.stdout:6/973: write df/dab/d1d/d28/d46/d5a/d6b/d13c/f147 [544603,92878] 0 2024-02-20T08:06:20.381 INFO:tasks.workunit.client.1.smithi194.stdout:9/957: mkdir d4/d37/d142 0 2024-02-20T08:06:20.382 INFO:tasks.workunit.client.1.smithi194.stdout:3/909: write d5/fa [650943,118259] 0 2024-02-20T08:06:20.382 INFO:tasks.workunit.client.1.smithi194.stdout:6/974: fsync df/dbe/f12e 0 2024-02-20T08:06:20.383 INFO:tasks.workunit.client.1.smithi194.stdout:9/958: read d4/de/dc4/fcc [1209960,76714] 0 2024-02-20T08:06:20.384 INFO:tasks.workunit.client.1.smithi194.stdout:6/975: chown df/dab/d1d/d28/d46/d5a/c7b 394 1 2024-02-20T08:06:20.388 INFO:tasks.workunit.client.1.smithi194.stdout:7/901: symlink d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb/l11e 0 2024-02-20T08:06:20.390 INFO:tasks.workunit.client.1.smithi194.stdout:2/910: link df/lc4 df/d14/d19/d5c/d97/dc8/l113 0 2024-02-20T08:06:20.395 INFO:tasks.workunit.client.1.smithi194.stdout:9/959: symlink d4/deb/l143 0 2024-02-20T08:06:20.395 INFO:tasks.workunit.client.1.smithi194.stdout:3/910: dread d5/df/d25/f27 [0,4194304] 0 2024-02-20T08:06:20.397 INFO:tasks.workunit.client.1.smithi194.stdout:2/911: dwrite df/d14/d19/d5c/d60/f7f [0,4194304] 0 2024-02-20T08:06:20.399 INFO:tasks.workunit.client.1.smithi194.stdout:7/902: mkdir d11/d2d/d38/d4a/d53/da0/d11f 0 2024-02-20T08:06:20.401 INFO:tasks.workunit.client.1.smithi194.stdout:5/916: dwrite d4/d20/d2b/f4b [0,4194304] 0 2024-02-20T08:06:20.405 INFO:tasks.workunit.client.1.smithi194.stdout:9/960: stat d4/d20/l69 0 2024-02-20T08:06:20.406 INFO:tasks.workunit.client.1.smithi194.stdout:6/976: write df/dab/d1d/d28/d46/f6c [737035,41392] 0 2024-02-20T08:06:20.407 INFO:tasks.workunit.client.1.smithi194.stdout:6/977: read - df/dab/d1d/d28/d46/d5a/d6b/d83/f143 zero size 2024-02-20T08:06:20.408 INFO:tasks.workunit.client.1.smithi194.stdout:3/911: creat d5/df/d75/f11f x:0 0 0 2024-02-20T08:06:20.409 INFO:tasks.workunit.client.1.smithi194.stdout:6/978: fdatasync df/dab/d1d/d28/d2b/f3e 0 2024-02-20T08:06:20.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/912: dread - d5/df/d75/f11f zero size 2024-02-20T08:06:20.411 INFO:tasks.workunit.client.1.smithi194.stdout:6/979: dread - df/dab/d1d/d28/d46/d5a/d6b/d83/d93/f108 zero size 2024-02-20T08:06:20.412 INFO:tasks.workunit.client.1.smithi194.stdout:7/903: mknod d11/d2d/d38/d4a/d93/d9a/c120 0 2024-02-20T08:06:20.412 INFO:tasks.workunit.client.1.smithi194.stdout:1/878: getdents d2/d8/d12/dc9/d26/d3d/d71/d8c/d34 0 2024-02-20T08:06:20.416 INFO:tasks.workunit.client.1.smithi194.stdout:6/980: creat df/dbe/d12c/f149 x:0 0 0 2024-02-20T08:06:20.417 INFO:tasks.workunit.client.1.smithi194.stdout:1/879: creat d2/d48/f122 x:0 0 0 2024-02-20T08:06:20.418 INFO:tasks.workunit.client.1.smithi194.stdout:1/880: chown d2/d8/d60/l88 28430282 1 2024-02-20T08:06:20.419 INFO:tasks.workunit.client.1.smithi194.stdout:7/904: mkdir d11/d2d/d38/d4a/d27/d51/d84/d121 0 2024-02-20T08:06:20.423 INFO:tasks.workunit.client.1.smithi194.stdout:6/981: mknod df/dab/d1d/d28/d2b/d80/d128/c14a 0 2024-02-20T08:06:20.425 INFO:tasks.workunit.client.1.smithi194.stdout:6/982: chown df/dab/d1d/d28/d46/d5a/d6b/dcb/d139 128493978 1 2024-02-20T08:06:20.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/983: chown df/dab/d1d/d28/d46/d5a/d6b/d83/da5/dec/ffe 140985 1 2024-02-20T08:06:20.427 INFO:tasks.workunit.client.1.smithi194.stdout:7/905: unlink d11/d2d/d38/d4a/dde/lf5 0 2024-02-20T08:06:20.427 INFO:tasks.workunit.client.1.smithi194.stdout:6/984: read df/f5d [3336355,53187] 0 2024-02-20T08:06:20.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/912: getdents df/d14/d19/d5c/d97/d9a/ddd/dc1 0 2024-02-20T08:06:20.431 INFO:tasks.workunit.client.1.smithi194.stdout:9/961: dwrite d4/d20/d43/d51/f85 [0,4194304] 0 2024-02-20T08:06:20.433 INFO:tasks.workunit.client.1.smithi194.stdout:9/962: readlink d4/d1b/d2e/lc6 0 2024-02-20T08:06:20.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/963: chown d4/d37/d4f/f11b 73 1 2024-02-20T08:06:20.435 INFO:tasks.workunit.client.1.smithi194.stdout:9/964: dread - d4/d20/d43/daa/dcb/f12e zero size 2024-02-20T08:06:20.438 INFO:tasks.workunit.client.1.smithi194.stdout:2/913: write df/d14/f4c [505799,112488] 0 2024-02-20T08:06:20.442 INFO:tasks.workunit.client.1.smithi194.stdout:3/913: dread d5/df/f67 [0,4194304] 0 2024-02-20T08:06:20.443 INFO:tasks.workunit.client.1.smithi194.stdout:3/914: fsync d5/d10/d16/d7b/fe2 0 2024-02-20T08:06:20.445 INFO:tasks.workunit.client.1.smithi194.stdout:6/985: write df/dab/d1d/ff2 [410036,26047] 0 2024-02-20T08:06:20.447 INFO:tasks.workunit.client.1.smithi194.stdout:9/965: write d4/d20/d43/f75 [1436774,85802] 0 2024-02-20T08:06:20.449 INFO:tasks.workunit.client.1.smithi194.stdout:6/986: fsync df/dab/d1d/d28/d46/f6c 0 2024-02-20T08:06:20.449 INFO:tasks.workunit.client.1.smithi194.stdout:2/914: link df/d3a/ce2 df/d14/d80/d85/c114 0 2024-02-20T08:06:20.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/966: creat d4/deb/f144 x:0 0 0 2024-02-20T08:06:20.451 INFO:tasks.workunit.client.1.smithi194.stdout:3/915: dread d5/d10/fca [0,4194304] 0 2024-02-20T08:06:20.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/881: dread d2/d8/d12/f2c [0,4194304] 0 2024-02-20T08:06:20.452 INFO:tasks.workunit.client.1.smithi194.stdout:6/987: readlink df/dab/d1d/d28/ld9 0 2024-02-20T08:06:20.453 INFO:tasks.workunit.client.1.smithi194.stdout:3/916: fsync d5/fdb 0 2024-02-20T08:06:20.453 INFO:tasks.workunit.client.1.smithi194.stdout:6/988: readlink df/l2a 0 2024-02-20T08:06:20.453 INFO:tasks.workunit.client.1.smithi194.stdout:9/967: write d4/d20/d43/d51/ffa [105606,4404] 0 2024-02-20T08:06:20.456 INFO:tasks.workunit.client.1.smithi194.stdout:2/915: creat df/f115 x:0 0 0 2024-02-20T08:06:20.457 INFO:tasks.workunit.client.1.smithi194.stdout:6/989: creat df/dbe/f14b x:0 0 0 2024-02-20T08:06:20.457 INFO:tasks.workunit.client.1.smithi194.stdout:9/968: dread d4/d20/d43/f47 [0,4194304] 0 2024-02-20T08:06:20.458 INFO:tasks.workunit.client.1.smithi194.stdout:2/916: chown df/f115 65308131 1 2024-02-20T08:06:20.458 INFO:tasks.workunit.client.1.smithi194.stdout:7/906: dread d11/d2d/d38/d37/f90 [0,4194304] 0 2024-02-20T08:06:20.459 INFO:tasks.workunit.client.1.smithi194.stdout:3/917: rename d5/d10/d28/d41/ca9 to d5/d10/d28/dd3/db7/c120 0 2024-02-20T08:06:20.459 INFO:tasks.workunit.client.1.smithi194.stdout:9/969: chown d4/d1b/d2e/lbc 15518517 1 2024-02-20T08:06:20.460 INFO:tasks.workunit.client.1.smithi194.stdout:2/917: write df/d5b/d61/fe4 [815068,97430] 0 2024-02-20T08:06:20.462 INFO:tasks.workunit.client.1.smithi194.stdout:7/907: fdatasync d11/d2d/d38/d4a/d27/d51/f89 0 2024-02-20T08:06:20.467 INFO:tasks.workunit.client.1.smithi194.stdout:3/918: dwrite d5/df/d60/fd0 [0,4194304] 0 2024-02-20T08:06:20.470 INFO:tasks.workunit.client.1.smithi194.stdout:1/882: truncate d2/d8/d12/f2c 804377 0 2024-02-20T08:06:20.471 INFO:tasks.workunit.client.1.smithi194.stdout:7/908: symlink d11/d2d/d38/d4a/d60/l122 0 2024-02-20T08:06:20.475 INFO:tasks.workunit.client.1.smithi194.stdout:9/970: mknod d4/d37/c145 0 2024-02-20T08:06:20.477 INFO:tasks.workunit.client.1.smithi194.stdout:9/971: fdatasync d4/d1b/d2e/f45 0 2024-02-20T08:06:20.477 INFO:tasks.workunit.client.1.smithi194.stdout:7/909: dwrite d11/d2d/d38/d37/d43/d7b/fcb [0,4194304] 0 2024-02-20T08:06:20.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/972: write d4/d37/ddf/d42/f7d [2203034,76425] 0 2024-02-20T08:06:20.480 INFO:tasks.workunit.client.1.smithi194.stdout:3/919: unlink d5/df/d30/lda 0 2024-02-20T08:06:20.481 INFO:tasks.workunit.client.1.smithi194.stdout:8/834: sync 2024-02-20T08:06:20.482 INFO:tasks.workunit.client.1.smithi194.stdout:6/990: link df/d42/c9a df/dab/d1d/d28/d2b/d135/c14c 0 2024-02-20T08:06:20.483 INFO:tasks.workunit.client.1.smithi194.stdout:6/991: chown df/dab/d1d/d28/d46/d5a/d7d/dd4/d10f/d13d 86540 1 2024-02-20T08:06:20.483 INFO:tasks.workunit.client.1.smithi194.stdout:6/992: write df/dab/dcc/fd3 [3633915,53570] 0 2024-02-20T08:06:20.485 INFO:tasks.workunit.client.1.smithi194.stdout:6/993: fsync df/dab/d1d/d28/d46/d5a/d7d/dd4/f11e 0 2024-02-20T08:06:20.495 INFO:tasks.workunit.client.1.smithi194.stdout:6/994: stat df/dab/d1d/d28/d2b/f51 0 2024-02-20T08:06:20.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/995: read df/dbe/f12e [2384818,46296] 0 2024-02-20T08:06:20.496 INFO:tasks.workunit.client.1.smithi194.stdout:9/973: mknod d4/d37/d142/c146 0 2024-02-20T08:06:20.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/996: chown df/dab/d1d/f31 28 1 2024-02-20T08:06:20.498 INFO:tasks.workunit.client.1.smithi194.stdout:2/918: truncate df/d14/d19/faf 1076509 0 2024-02-20T08:06:20.502 INFO:tasks.workunit.client.1.smithi194.stdout:6/997: creat df/dab/d1d/d28/d46/d5a/d6b/d83/db3/f14d x:0 0 0 2024-02-20T08:06:20.504 INFO:tasks.workunit.client.1.smithi194.stdout:8/835: creat d2/d14/f128 x:0 0 0 2024-02-20T08:06:20.505 INFO:tasks.workunit.client.1.smithi194.stdout:1/883: dread d2/d8/f11 [0,4194304] 0 2024-02-20T08:06:20.505 INFO:tasks.workunit.client.1.smithi194.stdout:8/836: write d2/d14/f34 [2865055,123783] 0 2024-02-20T08:06:20.507 INFO:tasks.workunit.client.1.smithi194.stdout:1/884: readlink d2/d8/d12/dc9/l47 0 2024-02-20T08:06:20.507 INFO:tasks.workunit.client.1.smithi194.stdout:6/998: dread df/dab/d1d/d28/d46/d5a/d6b/d13c/f147 [0,4194304] 0 2024-02-20T08:06:20.508 INFO:tasks.workunit.client.1.smithi194.stdout:8/837: write d2/d14/d18/d45/d7b/dc7/d78/f87 [3806012,126225] 0 2024-02-20T08:06:20.508 INFO:tasks.workunit.client.1.smithi194.stdout:7/910: truncate d11/d2d/d38/d37/d3c/fc7 2543504 0 2024-02-20T08:06:20.515 INFO:tasks.workunit.client.1.smithi194.stdout:2/919: rename df/d14/d19/d5c/d60/d63/d92/l9b to df/d14/d19/d5c/d97/d9a/l116 0 2024-02-20T08:06:20.517 INFO:tasks.workunit.client.1.smithi194.stdout:1/885: symlink d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7e/dbe/l123 0 2024-02-20T08:06:20.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/974: dwrite d4/d20/d5c/fca [0,4194304] 0 2024-02-20T08:06:20.518 INFO:tasks.workunit.client.1.smithi194.stdout:1/886: chown d2/d8/df/f65 22918141 1 2024-02-20T08:06:20.520 INFO:tasks.workunit.client.1.smithi194.stdout:7/911: creat d11/d2d/d38/d4a/d27/d51/f123 x:0 0 0 2024-02-20T08:06:20.525 INFO:tasks.workunit.client.1.smithi194.stdout:2/920: mkdir df/d14/d24/d56/da2/d117 0 2024-02-20T08:06:20.527 INFO:tasks.workunit.client.1.smithi194.stdout:7/912: dwrite d11/d2d/d38/d4a/d53/d81/f86 [0,4194304] 0 2024-02-20T08:06:20.528 INFO:tasks.workunit.client.1.smithi194.stdout:9/975: mknod d4/d20/d41/db7/c147 0 2024-02-20T08:06:20.531 INFO:tasks.workunit.client.1.smithi194.stdout:1/887: fsync d2/d8/f11 0 2024-02-20T08:06:20.538 INFO:tasks.workunit.client.1.smithi194.stdout:8/838: dwrite d2/d14/f4c [4194304,4194304] 0 2024-02-20T08:06:20.539 INFO:tasks.workunit.client.1.smithi194.stdout:8/839: stat d2/d80/cef 0 2024-02-20T08:06:20.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/913: unlink d11/d2d/d38/d4a/d53/da0/ff9 0 2024-02-20T08:06:20.543 INFO:tasks.workunit.client.1.smithi194.stdout:8/840: dwrite d2/d14/d18/d45/d7b/f99 [0,4194304] 0 2024-02-20T08:06:20.544 INFO:tasks.workunit.client.1.smithi194.stdout:9/976: creat d4/d55/f148 x:0 0 0 2024-02-20T08:06:20.546 INFO:tasks.workunit.client.1.smithi194.stdout:9/977: chown d4/d1b/d79/f12d 2 1 2024-02-20T08:06:20.549 INFO:tasks.workunit.client.1.smithi194.stdout:1/888: rename d2/d8/d12/dc9/d26/d3d/d71/d8c/f14 to d2/d8/df/f124 0 2024-02-20T08:06:20.549 INFO:tasks.workunit.client.1.smithi194.stdout:6/999: getdents df/dab/d1d/d28/d46/d5a/d6b/dbb 0 2024-02-20T08:06:20.558 INFO:tasks.workunit.client.1.smithi194.stdout:9/978: mknod d4/d1b/d133/d11d/d136/d13c/dd2/d10f/c149 0 2024-02-20T08:06:20.560 INFO:tasks.workunit.client.1.smithi194.stdout:1/889: symlink d2/d8/d12/dc9/d26/d45/l125 0 2024-02-20T08:06:20.562 INFO:tasks.workunit.client.1.smithi194.stdout:4/834: sync 2024-02-20T08:06:20.563 INFO:tasks.workunit.client.1.smithi194.stdout:2/921: link df/d5b/c76 df/d14/d19/d5c/d97/c118 0 2024-02-20T08:06:20.563 INFO:tasks.workunit.client.1.smithi194.stdout:1/890: rmdir d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7e/dbe 39 2024-02-20T08:06:20.563 INFO:tasks.workunit.client.1.smithi194.stdout:4/835: dread - d0/df/d11/dbb/fe9 zero size 2024-02-20T08:06:20.567 INFO:tasks.workunit.client.1.smithi194.stdout:1/891: mknod d2/d48/c126 0 2024-02-20T08:06:20.567 INFO:tasks.workunit.client.1.smithi194.stdout:7/914: link d11/d2d/d38/d4a/d60/dea/d114/d116/l113 d11/d2d/d38/d37/d43/l124 0 2024-02-20T08:06:20.569 INFO:tasks.workunit.client.1.smithi194.stdout:4/836: truncate d0/df/d72/ff4 1439869 0 2024-02-20T08:06:20.574 INFO:tasks.workunit.client.1.smithi194.stdout:7/915: rmdir d11/d6e/dc6 39 2024-02-20T08:06:20.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/979: getdents d4/d37/ddf/d42/d4e/d6e/d88 0 2024-02-20T08:06:20.576 INFO:tasks.workunit.client.1.smithi194.stdout:2/922: creat df/f119 x:0 0 0 2024-02-20T08:06:20.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/837: readlink d0/d2/d3e/dcc/ld8 0 2024-02-20T08:06:20.577 INFO:tasks.workunit.client.1.smithi194.stdout:8/841: dread d2/d14/d18/d45/d4e/dbe/dc3/fc8 [0,4194304] 0 2024-02-20T08:06:20.579 INFO:tasks.workunit.client.1.smithi194.stdout:4/838: read d0/df/f84 [3494646,5255] 0 2024-02-20T08:06:20.579 INFO:tasks.workunit.client.1.smithi194.stdout:1/892: dwrite d2/d8/d12/dc9/d26/d3d/f11c [0,4194304] 0 2024-02-20T08:06:20.596 INFO:tasks.workunit.client.1.smithi194.stdout:5/917: sync 2024-02-20T08:06:20.597 INFO:tasks.workunit.client.1.smithi194.stdout:0/840: sync 2024-02-20T08:06:20.597 INFO:tasks.workunit.client.1.smithi194.stdout:3/920: sync 2024-02-20T08:06:20.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/921: dwrite d5/d10/d28/dd3/faf [0,4194304] 0 2024-02-20T08:06:20.609 INFO:tasks.workunit.client.1.smithi194.stdout:7/916: rmdir d11/d6e 39 2024-02-20T08:06:20.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/980: unlink d4/d1b/d2e/f10e 0 2024-02-20T08:06:20.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/893: symlink d2/d48/l127 0 2024-02-20T08:06:20.619 INFO:tasks.workunit.client.1.smithi194.stdout:0/841: creat d6/d2b/d35/d9c/d9f/f10e x:0 0 0 2024-02-20T08:06:20.620 INFO:tasks.workunit.client.1.smithi194.stdout:5/918: creat d4/d6/dd/d25/d7d/dcd/df0/f113 x:0 0 0 2024-02-20T08:06:20.622 INFO:tasks.workunit.client.1.smithi194.stdout:8/842: dwrite d2/d14/d18/d45/d4e/fae [0,4194304] 0 2024-02-20T08:06:20.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/843: chown d2/d14/d18/d45/d4e/d9f/ca2 126758 1 2024-02-20T08:06:20.628 INFO:tasks.workunit.client.1.smithi194.stdout:3/922: dwrite d5/d10/d28/dd2/ff7 [0,4194304] 0 2024-02-20T08:06:20.636 INFO:tasks.workunit.client.1.smithi194.stdout:7/917: dread d11/d2d/d38/f22 [0,4194304] 0 2024-02-20T08:06:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:20 smithi194 ceph-mon[37804]: pgmap v59: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 88 MiB/s rd, 230 MiB/s wr, 504 op/s 2024-02-20T08:06:20.687 INFO:tasks.workunit.client.1.smithi194.stdout:9/981: creat d4/d20/d5c/dd0/f14a x:0 0 0 2024-02-20T08:06:20.688 INFO:tasks.workunit.client.1.smithi194.stdout:2/923: mkdir df/d14/d19/d5c/d60/df8/d11a 0 2024-02-20T08:06:20.697 INFO:tasks.workunit.client.1.smithi194.stdout:1/894: mknod d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/c128 0 2024-02-20T08:06:20.699 INFO:tasks.workunit.client.1.smithi194.stdout:1/895: write d2/d8/d12/dc9/d26/d3d/d71/d8c/d115/d7e/fe9 [993316,8153] 0 2024-02-20T08:06:20.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/923: fdatasync d5/d10/d16/f2d 0 2024-02-20T08:06:20.703 INFO:tasks.workunit.client.1.smithi194.stdout:2/924: readlink df/d14/l3e 0 2024-02-20T08:06:20.703 INFO:tasks.workunit.client.1.smithi194.stdout:5/919: mknod d4/d6/dd/d3a/d10b/c114 0 2024-02-20T08:06:20.705 INFO:tasks.workunit.client.1.smithi194.stdout:8/844: rename d2/c8 to d2/d80/c129 0 2024-02-20T08:06:20.705 INFO:tasks.workunit.client.1.smithi194.stdout:5/920: read d4/d6/dd/d25/d7d/fbe [805565,65447] 0 2024-02-20T08:06:20.707 INFO:tasks.workunit.client.1.smithi194.stdout:3/924: dwrite d5/d10/d17/dc2/fc4 [0,4194304] 0 2024-02-20T08:06:20.709 INFO:tasks.workunit.client.1.smithi194.stdout:0/842: dread d6/f90 [4194304,4194304] 0 2024-02-20T08:06:20.709 INFO:tasks.workunit.client.1.smithi194.stdout:1/896: mknod d2/d8/c129 0 2024-02-20T08:06:20.709 INFO:tasks.workunit.client.1.smithi194.stdout:8/845: write d2/d14/d18/d45/d69/daf/fd7 [437921,17990] 0 2024-02-20T08:06:20.710 INFO:tasks.workunit.client.1.smithi194.stdout:3/925: fsync d5/d10/d28/fb0 0 2024-02-20T08:06:20.710 INFO:tasks.workunit.client.1.smithi194.stdout:9/982: rename d4/d37/d38/c39 to d4/d20/d43/daa/d129/c14b 0 2024-02-20T08:06:20.715 INFO:tasks.workunit.client.1.smithi194.stdout:5/921: dread d4/d6/fb3 [0,4194304] 0 2024-02-20T08:06:20.718 INFO:tasks.workunit.client.1.smithi194.stdout:7/918: creat d11/d6e/f125 x:0 0 0 2024-02-20T08:06:20.719 INFO:tasks.workunit.client.1.smithi194.stdout:8/846: write d2/d14/f6a [2797983,15] 0 2024-02-20T08:06:20.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/897: creat d2/d8/d60/f12a x:0 0 0 2024-02-20T08:06:20.726 INFO:tasks.workunit.client.1.smithi194.stdout:7/919: rmdir d11/d2d/d38/d4a/d27 39 2024-02-20T08:06:20.727 INFO:tasks.workunit.client.1.smithi194.stdout:9/983: mknod d4/d20/d5c/c14c 0 2024-02-20T08:06:20.728 INFO:tasks.workunit.client.1.smithi194.stdout:9/984: chown d4/d37/ddf/d42/c128 30695110 1 2024-02-20T08:06:20.735 INFO:tasks.workunit.client.1.smithi194.stdout:5/922: creat d4/d6/dd/d99/dd1/f115 x:0 0 0 2024-02-20T08:06:20.735 INFO:tasks.workunit.client.1.smithi194.stdout:7/920: symlink d11/d2d/d38/d4a/d53/da0/l126 0 2024-02-20T08:06:20.736 INFO:tasks.workunit.client.1.smithi194.stdout:5/923: write d4/d6/d11/d2f/d77/f7a [710332,122869] 0 2024-02-20T08:06:20.738 INFO:tasks.workunit.client.1.smithi194.stdout:0/843: link d6/d2b/d35/d9c/d9f/c102 d6/dbe/c10f 0 2024-02-20T08:06:20.739 INFO:tasks.workunit.client.1.smithi194.stdout:7/921: creat d11/d2d/d38/d37/d3c/dd1/f127 x:0 0 0 2024-02-20T08:06:20.740 INFO:tasks.workunit.client.1.smithi194.stdout:9/985: fdatasync d4/d37/dab/fac 0 2024-02-20T08:06:20.745 INFO:tasks.workunit.client.1.smithi194.stdout:5/924: dwrite d4/d6/d11/fec [0,4194304] 0 2024-02-20T08:06:20.746 INFO:tasks.workunit.client.1.smithi194.stdout:7/922: truncate d11/d2d/d38/d4a/d53/d81/ffd 207937 0 2024-02-20T08:06:20.747 INFO:tasks.workunit.client.1.smithi194.stdout:8/847: dread d2/d14/d18/f7f [0,4194304] 0 2024-02-20T08:06:20.750 INFO:tasks.workunit.client.1.smithi194.stdout:5/925: symlink d4/d6/dd/d99/da7/l116 0 2024-02-20T08:06:20.751 INFO:tasks.workunit.client.1.smithi194.stdout:0/844: link d6/d2b/d35/d39/d8f/ca8 d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/c110 0 2024-02-20T08:06:20.756 INFO:tasks.workunit.client.1.smithi194.stdout:7/923: symlink d11/d6e/dc6/l128 0 2024-02-20T08:06:20.757 INFO:tasks.workunit.client.1.smithi194.stdout:4/839: dwrite d0/df/d41/ff2 [0,4194304] 0 2024-02-20T08:06:20.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:20 smithi123 ceph-mon[29383]: pgmap v59: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 88 MiB/s rd, 230 MiB/s wr, 504 op/s 2024-02-20T08:06:20.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/986: dread d4/d1b/d133/f10a [0,4194304] 0 2024-02-20T08:06:20.759 INFO:tasks.workunit.client.1.smithi194.stdout:8/848: symlink d2/d80/dd1/l12a 0 2024-02-20T08:06:20.759 INFO:tasks.workunit.client.1.smithi194.stdout:4/840: chown d0/df/d41/d69/l9f 502758 1 2024-02-20T08:06:20.766 INFO:tasks.workunit.client.1.smithi194.stdout:5/926: mknod d4/d20/d2b/ddf/db6/c117 0 2024-02-20T08:06:20.769 INFO:tasks.workunit.client.1.smithi194.stdout:9/987: dwrite d4/d20/fb9 [0,4194304] 0 2024-02-20T08:06:20.771 INFO:tasks.workunit.client.1.smithi194.stdout:5/927: truncate d4/d20/d2b/f2c 9294005 0 2024-02-20T08:06:20.773 INFO:tasks.workunit.client.1.smithi194.stdout:8/849: creat d2/d14/d18/d45/d69/daf/db3/f12b x:0 0 0 2024-02-20T08:06:20.777 INFO:tasks.workunit.client.1.smithi194.stdout:9/988: read d4/d1b/d2e/f30 [4142388,68646] 0 2024-02-20T08:06:20.777 INFO:tasks.workunit.client.1.smithi194.stdout:4/841: creat d0/df/d41/ffd x:0 0 0 2024-02-20T08:06:20.780 INFO:tasks.workunit.client.1.smithi194.stdout:0/845: symlink d6/d2b/d35/d42/d97/l111 0 2024-02-20T08:06:20.780 INFO:tasks.workunit.client.1.smithi194.stdout:5/928: dread d4/d6/dd/d25/d78/d8b/f54 [0,4194304] 0 2024-02-20T08:06:20.781 INFO:tasks.workunit.client.1.smithi194.stdout:1/898: rename d2/d8/d12/dc9/d26/d3d/d71/d8c/d34/db0/ccd to d2/d48/c12b 0 2024-02-20T08:06:20.786 INFO:tasks.workunit.client.1.smithi194.stdout:8/850: mknod d2/d14/d18/d45/d4e/dbe/c12c 0 2024-02-20T08:06:20.787 INFO:tasks.workunit.client.1.smithi194.stdout:9/989: rmdir d4/d1b/d133 39 2024-02-20T08:06:20.788 INFO:tasks.workunit.client.1.smithi194.stdout:9/990: truncate d4/d55/fc0 1171202 0 2024-02-20T08:06:20.796 INFO:tasks.workunit.client.1.smithi194.stdout:2/925: write df/d14/f32 [1633833,77840] 0 2024-02-20T08:06:20.801 INFO:tasks.workunit.client.1.smithi194.stdout:9/991: symlink d4/d37/d38/l14d 0 2024-02-20T08:06:20.802 INFO:tasks.workunit.client.1.smithi194.stdout:9/992: write d4/d55/fc0 [215319,63743] 0 2024-02-20T08:06:20.803 INFO:tasks.workunit.client.1.smithi194.stdout:9/993: chown d4/d1b/d2e 883907944 1 2024-02-20T08:06:20.809 INFO:tasks.workunit.client.1.smithi194.stdout:2/926: creat df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/f11b x:0 0 0 2024-02-20T08:06:20.810 INFO:tasks.workunit.client.1.smithi194.stdout:2/927: stat df/d14/d19/d5c/d78/fae 0 2024-02-20T08:06:20.811 INFO:tasks.workunit.client.1.smithi194.stdout:4/842: link d0/df/d72/d97/cce d0/d10/d1c/cfe 0 2024-02-20T08:06:20.812 INFO:tasks.workunit.client.1.smithi194.stdout:9/994: chown d4/d1b/d133/d11d/d136/d13c/l95 407 1 2024-02-20T08:06:20.816 INFO:tasks.workunit.client.1.smithi194.stdout:4/843: rmdir d0/d10/d1c/d4d 39 2024-02-20T08:06:20.818 INFO:tasks.workunit.client.1.smithi194.stdout:1/899: getdents d2/d8/d12/dc9/d26/d3d/d71/d8c/dcc 0 2024-02-20T08:06:20.820 INFO:tasks.workunit.client.1.smithi194.stdout:8/851: getdents d2/d14/d18/d45/d69/daf/dea 0 2024-02-20T08:06:20.821 INFO:tasks.workunit.client.1.smithi194.stdout:5/929: dread d4/d20/d2b/ddf/dc4/d28/f66 [0,4194304] 0 2024-02-20T08:06:20.822 INFO:tasks.workunit.client.1.smithi194.stdout:4/844: dwrite d0/d5c/d60/f78 [0,4194304] 0 2024-02-20T08:06:20.823 INFO:tasks.workunit.client.1.smithi194.stdout:8/852: truncate d2/d14/d18/d45/d90/ff2 2480 0 2024-02-20T08:06:20.824 INFO:tasks.workunit.client.1.smithi194.stdout:3/926: truncate d5/d10/d28/d41/fe1 5063896 0 2024-02-20T08:06:20.826 INFO:tasks.workunit.client.1.smithi194.stdout:3/927: stat d5/d10/d17/d1d/c68 0 2024-02-20T08:06:20.828 INFO:tasks.workunit.client.1.smithi194.stdout:2/928: rename df/d14/d19/d5c/d60/fca to df/d14/d24/d56/d6b/f11c 0 2024-02-20T08:06:20.830 INFO:tasks.workunit.client.1.smithi194.stdout:1/900: mknod d2/d8/d113/c12c 0 2024-02-20T08:06:20.832 INFO:tasks.workunit.client.1.smithi194.stdout:4/845: dwrite d0/d10/d1c/d21/d46/f8c [0,4194304] 0 2024-02-20T08:06:20.832 INFO:tasks.workunit.client.1.smithi194.stdout:5/930: dwrite d4/d6/dd/d25/d7d/fba [0,4194304] 0 2024-02-20T08:06:20.836 INFO:tasks.workunit.client.1.smithi194.stdout:9/995: getdents d4 0 2024-02-20T08:06:20.837 INFO:tasks.workunit.client.1.smithi194.stdout:2/929: rmdir df/d14/d80/d85 39 2024-02-20T08:06:20.839 INFO:tasks.workunit.client.1.smithi194.stdout:5/931: creat d4/d6/d11/d2f/d77/d90/d100/f118 x:0 0 0 2024-02-20T08:06:20.839 INFO:tasks.workunit.client.1.smithi194.stdout:4/846: truncate d0/d2/f2e 1695883 0 2024-02-20T08:06:20.841 INFO:tasks.workunit.client.1.smithi194.stdout:3/928: unlink d5/d10/d17/d1d/c69 0 2024-02-20T08:06:20.842 INFO:tasks.workunit.client.1.smithi194.stdout:9/996: creat d4/d37/ddf/dc8/f14e x:0 0 0 2024-02-20T08:06:20.843 INFO:tasks.workunit.client.1.smithi194.stdout:2/930: symlink df/d14/d19/d5c/d97/d10e/l11d 0 2024-02-20T08:06:20.844 INFO:tasks.workunit.client.1.smithi194.stdout:8/853: truncate d2/d14/d18/d45/d69/daf/db3/f113 834101 0 2024-02-20T08:06:20.846 INFO:tasks.workunit.client.1.smithi194.stdout:5/932: mknod d4/d6/dd/d25/c119 0 2024-02-20T08:06:20.850 INFO:tasks.workunit.client.1.smithi194.stdout:8/854: chown d2/d14/d18/cc5 2794 1 2024-02-20T08:06:20.851 INFO:tasks.workunit.client.1.smithi194.stdout:4/847: chown d0/d2/d51/d9c/lc4 29 1 2024-02-20T08:06:20.852 INFO:tasks.workunit.client.1.smithi194.stdout:9/997: creat d4/d1b/d107/f14f x:0 0 0 2024-02-20T08:06:20.855 INFO:tasks.workunit.client.1.smithi194.stdout:4/848: unlink d0/d5c/d60/d4a/dad/db0/lec 0 2024-02-20T08:06:20.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/931: creat df/d14/d19/d5c/f11e x:0 0 0 2024-02-20T08:06:20.856 INFO:tasks.workunit.client.1.smithi194.stdout:4/849: dread - d0/df/d72/dc9/fd4 zero size 2024-02-20T08:06:20.858 INFO:tasks.workunit.client.1.smithi194.stdout:2/932: chown df/d5b/d61/fbd 532 1 2024-02-20T08:06:20.859 INFO:tasks.workunit.client.1.smithi194.stdout:9/998: dwrite d4/d37/ddf/dc8/fe8 [0,4194304] 0 2024-02-20T08:06:20.860 INFO:tasks.workunit.client.1.smithi194.stdout:4/850: write d0/df/f13 [2410591,52598] 0 2024-02-20T08:06:20.860 INFO:tasks.workunit.client.1.smithi194.stdout:9/999: chown d4/d8b/f8f 3 1 2024-02-20T08:06:20.865 INFO:tasks.workunit.client.1.smithi194.stdout:2/933: dwrite df/f72 [4194304,4194304] 0 2024-02-20T08:06:20.874 INFO:tasks.workunit.client.1.smithi194.stdout:8/855: dread d2/d14/f5c [0,4194304] 0 2024-02-20T08:06:20.939 INFO:tasks.workunit.client.1.smithi194.stdout:1/901: rename d2/d8/d12/dc9/d26/d3d to d2/d8/df/d12d 0 2024-02-20T08:06:20.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/902: write d2/d8/d12/dc9/fc1 [3437233,95581] 0 2024-02-20T08:06:20.940 INFO:tasks.workunit.client.1.smithi194.stdout:7/924: write d11/d2d/d38/d4a/d53/fb3 [5970898,117563] 0 2024-02-20T08:06:20.942 INFO:tasks.workunit.client.1.smithi194.stdout:8/856: mknod d2/db5/c12d 0 2024-02-20T08:06:20.942 INFO:tasks.workunit.client.1.smithi194.stdout:1/903: read d2/d8/d60/fb8 [125518,7088] 0 2024-02-20T08:06:20.943 INFO:tasks.workunit.client.1.smithi194.stdout:0/846: write d6/d2b/d35/d9c/f5f [1262826,58523] 0 2024-02-20T08:06:20.947 INFO:tasks.workunit.client.1.smithi194.stdout:7/925: mknod d11/d2d/d38/d4a/d60/dea/d114/d116/c129 0 2024-02-20T08:06:20.949 INFO:tasks.workunit.client.1.smithi194.stdout:7/926: chown d11/d2d/d38/d37/d43/d7b/c85 285783 1 2024-02-20T08:06:20.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/847: dwrite d6/d2b/ff3 [0,4194304] 0 2024-02-20T08:06:20.949 INFO:tasks.workunit.client.1.smithi194.stdout:3/929: rename d5/d10/d17/c50 to d5/d10/d16/d8a/c121 0 2024-02-20T08:06:20.950 INFO:tasks.workunit.client.1.smithi194.stdout:0/848: chown d6/d2b/d35/d48/fea 17 1 2024-02-20T08:06:20.955 INFO:tasks.workunit.client.1.smithi194.stdout:8/857: symlink d2/d14/l12e 0 2024-02-20T08:06:20.959 INFO:tasks.workunit.client.1.smithi194.stdout:3/930: creat d5/d10/d16/d7b/d94/f122 x:0 0 0 2024-02-20T08:06:20.961 INFO:tasks.workunit.client.1.smithi194.stdout:4/851: getdents d0/d10/d1c/d21/d46 0 2024-02-20T08:06:20.964 INFO:tasks.workunit.client.1.smithi194.stdout:0/849: unlink d6/d2b/d35/d42/d1e/d3c/f68 0 2024-02-20T08:06:20.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/934: getdents df/d5b/d61/dce 0 2024-02-20T08:06:20.966 INFO:tasks.workunit.client.1.smithi194.stdout:2/935: read df/d5b/d61/fbd [404101,38395] 0 2024-02-20T08:06:20.966 INFO:tasks.workunit.client.1.smithi194.stdout:8/858: mkdir d2/d14/d18/d45/d69/d106/d12f 0 2024-02-20T08:06:20.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/936: truncate df/d14/d19/d5c/d97/df1/f104 703699 0 2024-02-20T08:06:20.970 INFO:tasks.workunit.client.1.smithi194.stdout:3/931: rmdir d5/d10/d28/dd2 39 2024-02-20T08:06:20.976 INFO:tasks.workunit.client.1.smithi194.stdout:0/850: write d6/d2b/d35/d48/fbd [32295,23436] 0 2024-02-20T08:06:20.980 INFO:tasks.workunit.client.1.smithi194.stdout:3/932: creat d5/df/d25/f123 x:0 0 0 2024-02-20T08:06:20.980 INFO:tasks.workunit.client.1.smithi194.stdout:2/937: dread df/d14/d19/d5c/f94 [0,4194304] 0 2024-02-20T08:06:20.983 INFO:tasks.workunit.client.1.smithi194.stdout:7/927: link d11/d2d/d38/f7a d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb/f12a 0 2024-02-20T08:06:20.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/859: fsync d2/d14/d18/f40 0 2024-02-20T08:06:20.987 INFO:tasks.workunit.client.1.smithi194.stdout:3/933: dwrite d5/d10/d28/fb0 [8388608,4194304] 0 2024-02-20T08:06:20.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/938: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:20.990 INFO:tasks.workunit.client.1.smithi194.stdout:2/939: fsync df/d5b/d61/fe4 0 2024-02-20T08:06:20.995 INFO:tasks.workunit.client.1.smithi194.stdout:5/933: chown d4/d6/dd/d25/d7d/de2/db0/lf7 1682 1 2024-02-20T08:06:20.998 INFO:tasks.workunit.client.1.smithi194.stdout:5/934: dread d4/d6/fb3 [0,4194304] 0 2024-02-20T08:06:21.002 INFO:tasks.workunit.client.1.smithi194.stdout:8/860: creat d2/d14/d18/d45/d4e/dbe/dc3/f130 x:0 0 0 2024-02-20T08:06:21.002 INFO:tasks.workunit.client.1.smithi194.stdout:8/861: dread - d2/db5/ff8 zero size 2024-02-20T08:06:21.007 INFO:tasks.workunit.client.1.smithi194.stdout:4/852: write d0/d10/d1c/d4d/f38 [1860458,43503] 0 2024-02-20T08:06:21.011 INFO:tasks.workunit.client.1.smithi194.stdout:7/928: symlink d11/d2d/d38/d37/d3c/d8d/l12b 0 2024-02-20T08:06:21.013 INFO:tasks.workunit.client.1.smithi194.stdout:5/935: rename d4/d6/d11/d2f/d10f/f81 to d4/d6/dd/d25/d7d/de2/f11a 0 2024-02-20T08:06:21.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/940: mkdir df/d14/d80/d85/d11f 0 2024-02-20T08:06:21.016 INFO:tasks.workunit.client.1.smithi194.stdout:2/941: write df/d14/d19/d5c/f65 [4429928,109046] 0 2024-02-20T08:06:21.017 INFO:tasks.workunit.client.1.smithi194.stdout:2/942: stat df/d14/d24/d56/d6b/d81/c8c 0 2024-02-20T08:06:21.017 INFO:tasks.workunit.client.1.smithi194.stdout:5/936: mknod d4/d6/dd/d99/de6/c11b 0 2024-02-20T08:06:21.018 INFO:tasks.workunit.client.1.smithi194.stdout:3/934: creat d5/f124 x:0 0 0 2024-02-20T08:06:21.019 INFO:tasks.workunit.client.1.smithi194.stdout:8/862: mkdir d2/d14/dc4/d11e/d131 0 2024-02-20T08:06:21.021 INFO:tasks.workunit.client.1.smithi194.stdout:3/935: truncate d5/d10/d28/d41/d73/d8c/de8/df3/f114 498422 0 2024-02-20T08:06:21.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/943: chown df/d14/f22 0 1 2024-02-20T08:06:21.023 INFO:tasks.workunit.client.1.smithi194.stdout:8/863: symlink d2/dfd/l132 0 2024-02-20T08:06:21.023 INFO:tasks.workunit.client.1.smithi194.stdout:2/944: write df/d14/d19/d5c/f11e [356578,54520] 0 2024-02-20T08:06:21.025 INFO:tasks.workunit.client.1.smithi194.stdout:8/864: readlink d2/d14/d18/d45/d7b/dc7/l10d 0 2024-02-20T08:06:21.026 INFO:tasks.workunit.client.1.smithi194.stdout:4/853: rename d0/d5c/f82 to d0/d10/fff 0 2024-02-20T08:06:21.027 INFO:tasks.workunit.client.1.smithi194.stdout:4/854: write d0/f7f [1205466,29459] 0 2024-02-20T08:06:21.028 INFO:tasks.workunit.client.1.smithi194.stdout:7/929: getdents d11/d6e 0 2024-02-20T08:06:21.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/865: dwrite d2/d14/d18/d45/d69/daf/fd7 [0,4194304] 0 2024-02-20T08:06:21.034 INFO:tasks.workunit.client.1.smithi194.stdout:5/937: rename d4/d6/d11/c35 to d4/d6/dd/d25/d7d/c11c 0 2024-02-20T08:06:21.036 INFO:tasks.workunit.client.1.smithi194.stdout:4/855: unlink d0/df/d11/c54 0 2024-02-20T08:06:21.038 INFO:tasks.workunit.client.1.smithi194.stdout:7/930: unlink d11/d2d/d38/d37/d43/d7b/f9b 0 2024-02-20T08:06:21.039 INFO:tasks.workunit.client.1.smithi194.stdout:3/936: link d5/d10/d16/f59 d5/d10/d28/d41/df4/f125 0 2024-02-20T08:06:21.039 INFO:tasks.workunit.client.1.smithi194.stdout:3/937: chown d5/d10/d28/fb3 734 1 2024-02-20T08:06:21.040 INFO:tasks.workunit.client.1.smithi194.stdout:3/938: chown d5/d10/d28/dd3/l61 684 1 2024-02-20T08:06:21.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/866: rmdir d2/d14/d18/d45/d7b/dc0/df3 39 2024-02-20T08:06:21.049 INFO:tasks.workunit.client.1.smithi194.stdout:4/856: creat d0/d5c/d60/d4a/d4e/dbe/ddb/f100 x:0 0 0 2024-02-20T08:06:21.053 INFO:tasks.workunit.client.1.smithi194.stdout:3/939: mkdir d5/d10/d28/d41/d73/d8c/da6/ded/d109/d126 0 2024-02-20T08:06:21.055 INFO:tasks.workunit.client.1.smithi194.stdout:5/938: write d4/d6/d11/d2f/d10f/fac [1620046,40675] 0 2024-02-20T08:06:21.056 INFO:tasks.workunit.client.1.smithi194.stdout:2/945: getdents df/d14/d24/dd2 0 2024-02-20T08:06:21.060 INFO:tasks.workunit.client.1.smithi194.stdout:4/857: symlink d0/df/d72/d97/l101 0 2024-02-20T08:06:21.060 INFO:tasks.workunit.client.1.smithi194.stdout:8/867: write d2/d14/d18/f27 [48481,59241] 0 2024-02-20T08:06:21.061 INFO:tasks.workunit.client.1.smithi194.stdout:3/940: symlink d5/d10/d28/d41/d73/l127 0 2024-02-20T08:06:21.062 INFO:tasks.workunit.client.1.smithi194.stdout:2/946: mknod df/d5b/d61/dce/c120 0 2024-02-20T08:06:21.062 INFO:tasks.workunit.client.1.smithi194.stdout:5/939: dwrite d4/d6/dd/f2d [0,4194304] 0 2024-02-20T08:06:21.063 INFO:tasks.workunit.client.1.smithi194.stdout:8/868: chown d2/fa 3206185 1 2024-02-20T08:06:21.066 INFO:tasks.workunit.client.1.smithi194.stdout:7/931: dwrite d11/d2d/d38/d37/d3c/fee [0,4194304] 0 2024-02-20T08:06:21.079 INFO:tasks.workunit.client.1.smithi194.stdout:5/940: creat d4/d6/dd/d25/d78/f11d x:0 0 0 2024-02-20T08:06:21.080 INFO:tasks.workunit.client.1.smithi194.stdout:4/858: dwrite d0/d10/d1c/d21/d46/f87 [0,4194304] 0 2024-02-20T08:06:21.082 INFO:tasks.workunit.client.1.smithi194.stdout:2/947: creat df/d14/d24/d56/d6b/d9e/f121 x:0 0 0 2024-02-20T08:06:21.084 INFO:tasks.workunit.client.1.smithi194.stdout:8/869: dwrite d2/f3b [0,4194304] 0 2024-02-20T08:06:21.085 INFO:tasks.workunit.client.1.smithi194.stdout:8/870: chown d2/d14/f6a 31111549 1 2024-02-20T08:06:21.086 INFO:tasks.workunit.client.1.smithi194.stdout:5/941: creat d4/d20/d2b/d9b/f11e x:0 0 0 2024-02-20T08:06:21.087 INFO:tasks.workunit.client.1.smithi194.stdout:2/948: read df/d14/d24/fa8 [3066535,45355] 0 2024-02-20T08:06:21.088 INFO:tasks.workunit.client.1.smithi194.stdout:2/949: dread - df/d3a/fd0 zero size 2024-02-20T08:06:21.089 INFO:tasks.workunit.client.1.smithi194.stdout:5/942: fsync d4/d20/d2b/ddf/f10c 0 2024-02-20T08:06:21.090 INFO:tasks.workunit.client.1.smithi194.stdout:3/941: link d5/df/d30/f36 d5/d10/d28/d41/d73/f128 0 2024-02-20T08:06:21.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/950: fsync df/f21 0 2024-02-20T08:06:21.095 INFO:tasks.workunit.client.1.smithi194.stdout:8/871: dwrite d2/d14/d18/d45/d69/f125 [0,4194304] 0 2024-02-20T08:06:21.102 INFO:tasks.workunit.client.1.smithi194.stdout:2/951: creat df/d14/d19/d5c/d97/d9a/ddd/df9/f122 x:0 0 0 2024-02-20T08:06:21.103 INFO:tasks.workunit.client.1.smithi194.stdout:4/859: link d0/d10/f22 d0/d10/d1c/d21/f102 0 2024-02-20T08:06:21.104 INFO:tasks.workunit.client.1.smithi194.stdout:8/872: dwrite d2/d14/d18/d45/d69/daf/f10b [0,4194304] 0 2024-02-20T08:06:21.105 INFO:tasks.workunit.client.1.smithi194.stdout:3/942: mknod d5/df/d9a/c129 0 2024-02-20T08:06:21.106 INFO:tasks.workunit.client.1.smithi194.stdout:3/943: readlink l0 0 2024-02-20T08:06:21.106 INFO:tasks.workunit.client.1.smithi194.stdout:2/952: fsync df/d14/d19/d5c/d97/d9a/ddd/dc1/ff2 0 2024-02-20T08:06:21.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/943: dread d4/f9f [0,4194304] 0 2024-02-20T08:06:21.110 INFO:tasks.workunit.client.1.smithi194.stdout:4/860: fdatasync d0/d10/d1c/d21/d46/fe7 0 2024-02-20T08:06:21.114 INFO:tasks.workunit.client.1.smithi194.stdout:2/953: chown df/d14/d19/cf7 0 1 2024-02-20T08:06:21.115 INFO:tasks.workunit.client.1.smithi194.stdout:4/861: write d0/df/d41/d69/ff3 [816382,28898] 0 2024-02-20T08:06:21.116 INFO:tasks.workunit.client.1.smithi194.stdout:4/862: readlink d0/df/d41/d69/l9f 0 2024-02-20T08:06:21.120 INFO:tasks.workunit.client.1.smithi194.stdout:2/954: write df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/fff [712680,1365] 0 2024-02-20T08:06:21.120 INFO:tasks.workunit.client.1.smithi194.stdout:3/944: dwrite d5/f124 [0,4194304] 0 2024-02-20T08:06:21.120 INFO:tasks.workunit.client.1.smithi194.stdout:5/944: unlink d4/f9f 0 2024-02-20T08:06:21.120 INFO:tasks.workunit.client.1.smithi194.stdout:8/873: mknod d2/d14/d18/d45/d7b/dc7/d11d/c133 0 2024-02-20T08:06:21.120 INFO:tasks.workunit.client.1.smithi194.stdout:4/863: fsync d0/d10/d1c/d4d/d2f/fb2 0 2024-02-20T08:06:21.121 INFO:tasks.workunit.client.1.smithi194.stdout:4/864: readlink d0/df/l40 0 2024-02-20T08:06:21.123 INFO:tasks.workunit.client.1.smithi194.stdout:8/874: truncate d2/d14/d18/d45/d4e/d9f/ff5 833891 0 2024-02-20T08:06:21.123 INFO:tasks.workunit.client.1.smithi194.stdout:2/955: write df/d14/d19/d96/fb0 [7083443,25047] 0 2024-02-20T08:06:21.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/956: chown df/d14/f32 11 1 2024-02-20T08:06:21.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/865: creat d0/d10/d1c/d21/d46/f103 x:0 0 0 2024-02-20T08:06:21.126 INFO:tasks.workunit.client.1.smithi194.stdout:4/866: dread - d0/d5c/fc6 zero size 2024-02-20T08:06:21.128 INFO:tasks.workunit.client.1.smithi194.stdout:8/875: dread d2/d14/f5c [0,4194304] 0 2024-02-20T08:06:21.128 INFO:tasks.workunit.client.1.smithi194.stdout:3/945: link d5/d10/d28/d41/f5c d5/df/d75/f12a 0 2024-02-20T08:06:21.129 INFO:tasks.workunit.client.1.smithi194.stdout:8/876: write d2/d14/d18/d45/d7b/f118 [1883303,106070] 0 2024-02-20T08:06:21.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/867: rename d0/d4f/def to d0/d10/d1c/d21/d46/d104 0 2024-02-20T08:06:21.134 INFO:tasks.workunit.client.1.smithi194.stdout:4/868: creat d0/d5c/f105 x:0 0 0 2024-02-20T08:06:21.136 INFO:tasks.workunit.client.1.smithi194.stdout:2/957: dwrite df/d14/d24/d56/d6b/f108 [4194304,4194304] 0 2024-02-20T08:06:21.137 INFO:tasks.workunit.client.1.smithi194.stdout:2/958: write df/d3a/fd0 [395968,19087] 0 2024-02-20T08:06:21.137 INFO:tasks.workunit.client.1.smithi194.stdout:4/869: mkdir d0/df/d11/d106 0 2024-02-20T08:06:21.144 INFO:tasks.workunit.client.1.smithi194.stdout:3/946: rename d5/d10/d16/d7b/lc6 to d5/l12b 0 2024-02-20T08:06:21.147 INFO:tasks.workunit.client.1.smithi194.stdout:5/945: fdatasync d4/d6/dd/d25/fc8 0 2024-02-20T08:06:21.151 INFO:tasks.workunit.client.1.smithi194.stdout:3/947: getdents d5/d10/d28/db4/d104 0 2024-02-20T08:06:21.153 INFO:tasks.workunit.client.1.smithi194.stdout:4/870: link d0/d10/l8e d0/df/d72/l107 0 2024-02-20T08:06:21.155 INFO:tasks.workunit.client.1.smithi194.stdout:5/946: mknod d4/d6/dd/d25/c11f 0 2024-02-20T08:06:21.159 INFO:tasks.workunit.client.1.smithi194.stdout:2/959: dread df/d5b/d61/dce/fd6 [0,4194304] 0 2024-02-20T08:06:21.160 INFO:tasks.workunit.client.1.smithi194.stdout:8/877: truncate d2/d14/d18/d45/d7b/dc7/d78/f87 1942645 0 2024-02-20T08:06:21.161 INFO:tasks.workunit.client.1.smithi194.stdout:5/947: truncate d4/d6/dd/d25/d78/d8b/fff 1014921 0 2024-02-20T08:06:21.163 INFO:tasks.workunit.client.1.smithi194.stdout:2/960: mknod df/d14/d19/d5c/d78/c123 0 2024-02-20T08:06:21.164 INFO:tasks.workunit.client.1.smithi194.stdout:4/871: link d0/df/d41/d69/daa/lbd d0/d5c/d60/l108 0 2024-02-20T08:06:21.165 INFO:tasks.workunit.client.1.smithi194.stdout:4/872: chown d0/d2/d51/cee 1 1 2024-02-20T08:06:21.166 INFO:tasks.workunit.client.1.smithi194.stdout:5/948: creat d4/d6/dd/d3a/d101/f120 x:0 0 0 2024-02-20T08:06:21.167 INFO:tasks.workunit.client.1.smithi194.stdout:3/948: truncate d5/d10/fca 1671451 0 2024-02-20T08:06:21.167 INFO:tasks.workunit.client.1.smithi194.stdout:2/961: dread df/d14/f4c [0,4194304] 0 2024-02-20T08:06:21.167 INFO:tasks.workunit.client.1.smithi194.stdout:8/878: mknod d2/d14/d18/d45/d69/daf/c134 0 2024-02-20T08:06:21.168 INFO:tasks.workunit.client.1.smithi194.stdout:3/949: write d5/f7c [5036416,125278] 0 2024-02-20T08:06:21.169 INFO:tasks.workunit.client.1.smithi194.stdout:4/873: mkdir d0/df/d11/dbb/d109 0 2024-02-20T08:06:21.170 INFO:tasks.workunit.client.1.smithi194.stdout:5/949: truncate d4/d6/d11/d2f/d10f/f8e 1508861 0 2024-02-20T08:06:21.170 INFO:tasks.workunit.client.1.smithi194.stdout:8/879: read d2/d14/d18/d45/d4e/fae [703901,52662] 0 2024-02-20T08:06:21.172 INFO:tasks.workunit.client.1.smithi194.stdout:3/950: write d5/d10/d16/d7b/d94/f9b [861806,90963] 0 2024-02-20T08:06:21.172 INFO:tasks.workunit.client.1.smithi194.stdout:4/874: write d0/df/d41/fd3 [109972,57078] 0 2024-02-20T08:06:21.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/875: stat d0/df/d41/d69/c7d 0 2024-02-20T08:06:21.183 INFO:tasks.workunit.client.1.smithi194.stdout:3/951: mkdir d5/d10/d28/dd3/db7/def/d12c 0 2024-02-20T08:06:21.184 INFO:tasks.workunit.client.1.smithi194.stdout:4/876: mkdir d0/df/d41/d69/d10a 0 2024-02-20T08:06:21.184 INFO:tasks.workunit.client.1.smithi194.stdout:3/952: chown d5/df/d30/cd6 8846 1 2024-02-20T08:06:21.185 INFO:tasks.workunit.client.1.smithi194.stdout:3/953: chown d5/df/d30/d80 1731976 1 2024-02-20T08:06:21.185 INFO:tasks.workunit.client.1.smithi194.stdout:3/954: dread - d5/d10/df2/dfc/f118 zero size 2024-02-20T08:06:21.188 INFO:tasks.workunit.client.1.smithi194.stdout:4/877: symlink d0/d10/d1c/d21/d46/d104/l10b 0 2024-02-20T08:06:21.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/962: truncate df/d3a/f53 585002 0 2024-02-20T08:06:21.190 INFO:tasks.workunit.client.1.smithi194.stdout:2/963: readlink df/d14/d80/lc3 0 2024-02-20T08:06:21.191 INFO:tasks.workunit.client.1.smithi194.stdout:8/880: creat d2/d14/d18/d45/d69/f135 x:0 0 0 2024-02-20T08:06:21.193 INFO:tasks.workunit.client.1.smithi194.stdout:3/955: unlink d5/d10/d28/d41/d73/d8c/de8/df3/f113 0 2024-02-20T08:06:21.193 INFO:tasks.workunit.client.1.smithi194.stdout:3/956: chown d5/d10/d8d 1791345 1 2024-02-20T08:06:21.195 INFO:tasks.workunit.client.1.smithi194.stdout:5/950: rename d4/d20/d2b/ddf/dc4/d28/f39 to d4/d20/d2b/f121 0 2024-02-20T08:06:21.196 INFO:tasks.workunit.client.1.smithi194.stdout:4/878: creat d0/d5c/d60/d4a/dad/f10c x:0 0 0 2024-02-20T08:06:21.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/881: truncate d2/d14/f5c 206972 0 2024-02-20T08:06:21.199 INFO:tasks.workunit.client.1.smithi194.stdout:1/904: sync 2024-02-20T08:06:21.199 INFO:tasks.workunit.client.1.smithi194.stdout:0/851: sync 2024-02-20T08:06:21.203 INFO:tasks.workunit.client.1.smithi194.stdout:8/882: dwrite d2/d14/d18/d45/d4e/f11f [0,4194304] 0 2024-02-20T08:06:21.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/957: rmdir d5/d10/d8d 39 2024-02-20T08:06:21.215 INFO:tasks.workunit.client.1.smithi194.stdout:1/905: creat d2/d8/df/d12d/d82/f12e x:0 0 0 2024-02-20T08:06:21.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/852: symlink d6/d2b/d35/d9c/d9f/da6/l112 0 2024-02-20T08:06:21.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/853: write d6/d2b/d35/d9c/fe7 [543942,69563] 0 2024-02-20T08:06:21.220 INFO:tasks.workunit.client.1.smithi194.stdout:8/883: chown d2/d14/d18/d45/d4e/c122 334 1 2024-02-20T08:06:21.220 INFO:tasks.workunit.client.1.smithi194.stdout:8/884: write d2/d14/f4c [3745711,68560] 0 2024-02-20T08:06:21.221 INFO:tasks.workunit.client.1.smithi194.stdout:5/951: mkdir d4/d6/dd/d25/d7d/dcd/d122 0 2024-02-20T08:06:21.222 INFO:tasks.workunit.client.1.smithi194.stdout:5/952: truncate d4/d20/d2b/fe4 97966 0 2024-02-20T08:06:21.224 INFO:tasks.workunit.client.1.smithi194.stdout:3/958: mknod d5/d10/d28/d41/d73/d8c/da6/ded/d109/d126/c12d 0 2024-02-20T08:06:21.226 INFO:tasks.workunit.client.1.smithi194.stdout:2/964: rename fc to df/d3a/f124 0 2024-02-20T08:06:21.231 INFO:tasks.workunit.client.1.smithi194.stdout:1/906: dwrite d2/d8/df/d12d/d71/d8c/d34/f6b [0,4194304] 0 2024-02-20T08:06:21.233 INFO:tasks.workunit.client.1.smithi194.stdout:2/965: stat df/d14/d19/d5c/d97/d9a/ddd/lf4 0 2024-02-20T08:06:21.233 INFO:tasks.workunit.client.1.smithi194.stdout:1/907: chown d2/d8/df/d12d 58 1 2024-02-20T08:06:21.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/953: dwrite d4/d6/d11/d2f/f68 [0,4194304] 0 2024-02-20T08:06:21.235 INFO:tasks.workunit.client.1.smithi194.stdout:8/885: creat d2/d14/d18/d45/d69/f136 x:0 0 0 2024-02-20T08:06:21.237 INFO:tasks.workunit.client.1.smithi194.stdout:4/879: rename d0/d10/fff to d0/d5c/f10d 0 2024-02-20T08:06:21.239 INFO:tasks.workunit.client.1.smithi194.stdout:3/959: dwrite d5/d10/d16/d7b/fe2 [0,4194304] 0 2024-02-20T08:06:21.240 INFO:tasks.workunit.client.1.smithi194.stdout:8/886: chown d2/d14/d18/d45/d7b/dc7/l84 6 1 2024-02-20T08:06:21.241 INFO:tasks.workunit.client.1.smithi194.stdout:4/880: truncate d0/d9d/fac 4818017 0 2024-02-20T08:06:21.242 INFO:tasks.workunit.client.1.smithi194.stdout:5/954: unlink d4/d6/dd/d3a/fd6 0 2024-02-20T08:06:21.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/887: write d2/f39 [917463,472] 0 2024-02-20T08:06:21.245 INFO:tasks.workunit.client.1.smithi194.stdout:2/966: creat df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/f125 x:0 0 0 2024-02-20T08:06:21.246 INFO:tasks.workunit.client.1.smithi194.stdout:7/932: sync 2024-02-20T08:06:21.248 INFO:tasks.workunit.client.1.smithi194.stdout:0/854: rename d6/d2b/d35/d42/cd5 to d6/d2b/d35/d39/c113 0 2024-02-20T08:06:21.250 INFO:tasks.workunit.client.1.smithi194.stdout:1/908: symlink d2/d8/df/d12d/d71/d8c/d115/d7d/l12f 0 2024-02-20T08:06:21.250 INFO:tasks.workunit.client.1.smithi194.stdout:1/909: chown d2/d8/c129 974 1 2024-02-20T08:06:21.254 INFO:tasks.workunit.client.1.smithi194.stdout:5/955: mknod d4/d6/dd/d3a/c123 0 2024-02-20T08:06:21.255 INFO:tasks.workunit.client.1.smithi194.stdout:8/888: chown d2/d14/d18/d45/d4e/c74 191054 1 2024-02-20T08:06:21.256 INFO:tasks.workunit.client.1.smithi194.stdout:4/881: symlink d0/df/d72/dc9/l10e 0 2024-02-20T08:06:21.257 INFO:tasks.workunit.client.1.smithi194.stdout:3/960: mkdir d5/d12e 0 2024-02-20T08:06:21.260 INFO:tasks.workunit.client.1.smithi194.stdout:0/855: mknod d6/d93/dcf/c114 0 2024-02-20T08:06:21.262 INFO:tasks.workunit.client.1.smithi194.stdout:0/856: chown d6/d2b/d35/d48/d60/f108 109 1 2024-02-20T08:06:21.263 INFO:tasks.workunit.client.1.smithi194.stdout:5/956: unlink d4/d6/c14 0 2024-02-20T08:06:21.264 INFO:tasks.workunit.client.1.smithi194.stdout:7/933: dwrite d11/d2d/d38/d4a/d27/d51/d77/faf [0,4194304] 0 2024-02-20T08:06:21.265 INFO:tasks.workunit.client.1.smithi194.stdout:8/889: rename d2/d14/d18/cad to d2/d14/d18/d45/d90/c137 0 2024-02-20T08:06:21.266 INFO:tasks.workunit.client.1.smithi194.stdout:8/890: stat d2/d80/dd1/fe2 0 2024-02-20T08:06:21.271 INFO:tasks.workunit.client.1.smithi194.stdout:5/957: dwrite d4/d20/d2b/d9b/f11e [0,4194304] 0 2024-02-20T08:06:21.285 INFO:tasks.workunit.client.1.smithi194.stdout:1/910: write d2/d8/df/f33 [635890,54413] 0 2024-02-20T08:06:21.287 INFO:tasks.workunit.client.1.smithi194.stdout:0/857: mknod d6/d2b/d35/d39/df0/de5/c115 0 2024-02-20T08:06:21.288 INFO:tasks.workunit.client.1.smithi194.stdout:7/934: mknod d11/d2d/d38/d37/d3c/d8d/c12c 0 2024-02-20T08:06:21.289 INFO:tasks.workunit.client.1.smithi194.stdout:7/935: readlink d11/d2d/d38/d4a/d27/l33 0 2024-02-20T08:06:21.293 INFO:tasks.workunit.client.1.smithi194.stdout:0/858: symlink d6/d2b/d35/d39/d8f/dbf/l116 0 2024-02-20T08:06:21.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/967: truncate df/d14/d19/d5c/f11e 156315 0 2024-02-20T08:06:21.294 INFO:tasks.workunit.client.1.smithi194.stdout:7/936: mknod d11/d2d/d38/d37/d3c/d8d/dc9/c12d 0 2024-02-20T08:06:21.296 INFO:tasks.workunit.client.1.smithi194.stdout:0/859: readlink d6/d2b/d35/d42/d1e/d45/daa/la5 0 2024-02-20T08:06:21.296 INFO:tasks.workunit.client.1.smithi194.stdout:4/882: dwrite d0/d10/d1c/f5a [0,4194304] 0 2024-02-20T08:06:21.296 INFO:tasks.workunit.client.1.smithi194.stdout:3/961: getdents d5/d10 0 2024-02-20T08:06:21.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/860: write d6/d2b/d35/d42/d1e/d45/f109 [1010084,88933] 0 2024-02-20T08:06:21.303 INFO:tasks.workunit.client.1.smithi194.stdout:4/883: mkdir d0/d9d/d10f 0 2024-02-20T08:06:21.304 INFO:tasks.workunit.client.1.smithi194.stdout:3/962: mkdir d5/d10/d28/d41/d12f 0 2024-02-20T08:06:21.305 INFO:tasks.workunit.client.1.smithi194.stdout:5/958: write d4/d6/d11/d2f/d10f/f83 [3509170,62850] 0 2024-02-20T08:06:21.305 INFO:tasks.workunit.client.1.smithi194.stdout:7/937: mkdir d11/d2d/d38/d12e 0 2024-02-20T08:06:21.307 INFO:tasks.workunit.client.1.smithi194.stdout:8/891: dwrite d2/d14/d18/f40 [0,4194304] 0 2024-02-20T08:06:21.308 INFO:tasks.workunit.client.1.smithi194.stdout:5/959: dread - d4/d20/d2b/ddf/f10c zero size 2024-02-20T08:06:21.310 INFO:tasks.workunit.client.1.smithi194.stdout:2/968: dwrite df/d3a/f124 [0,4194304] 0 2024-02-20T08:06:21.312 INFO:tasks.workunit.client.1.smithi194.stdout:1/911: getdents d2/d8/df/d12d/d71/d8c/d115 0 2024-02-20T08:06:21.319 INFO:tasks.workunit.client.1.smithi194.stdout:4/884: symlink d0/d9d/l110 0 2024-02-20T08:06:21.319 INFO:tasks.workunit.client.1.smithi194.stdout:7/938: unlink d11/d2d/d38/d37/d43/d7b/fd2 0 2024-02-20T08:06:21.319 INFO:tasks.workunit.client.1.smithi194.stdout:0/861: rmdir d6/d2b 39 2024-02-20T08:06:21.319 INFO:tasks.workunit.client.1.smithi194.stdout:4/885: fsync d0/d10/d1c/d21/d46/f103 0 2024-02-20T08:06:21.322 INFO:tasks.workunit.client.1.smithi194.stdout:5/960: dwrite d4/d20/d2b/ddf/dc4/d28/d85/f104 [0,4194304] 0 2024-02-20T08:06:21.324 INFO:tasks.workunit.client.1.smithi194.stdout:1/912: mkdir d2/d8/d12/dc9/d26/d45/d130 0 2024-02-20T08:06:21.331 INFO:tasks.workunit.client.1.smithi194.stdout:3/963: write d5/d10/d62/fa2 [182715,58598] 0 2024-02-20T08:06:21.332 INFO:tasks.workunit.client.1.smithi194.stdout:0/862: chown d6/d2b/d35/d48/d60/f107 228420659 1 2024-02-20T08:06:21.332 INFO:tasks.workunit.client.1.smithi194.stdout:7/939: chown d11/d2d/d38/d4a/d60/c88 0 1 2024-02-20T08:06:21.334 INFO:tasks.workunit.client.1.smithi194.stdout:7/940: readlink d11/d2d/d38/d37/l112 0 2024-02-20T08:06:21.334 INFO:tasks.workunit.client.1.smithi194.stdout:8/892: dread d2/d14/f34 [0,4194304] 0 2024-02-20T08:06:21.334 INFO:tasks.workunit.client.1.smithi194.stdout:0/863: write d6/d2b/d35/d39/d55/fde [4153304,52755] 0 2024-02-20T08:06:21.336 INFO:tasks.workunit.client.1.smithi194.stdout:0/864: chown d6/d2b/d35/da3 659067 1 2024-02-20T08:06:21.337 INFO:tasks.workunit.client.1.smithi194.stdout:5/961: creat d4/d6/da5/f124 x:0 0 0 2024-02-20T08:06:21.339 INFO:tasks.workunit.client.1.smithi194.stdout:1/913: mknod d2/d8/df/d12d/d71/d8c/d115/d68/db7/c131 0 2024-02-20T08:06:21.340 INFO:tasks.workunit.client.1.smithi194.stdout:2/969: creat df/d14/d19/d5c/d97/d9a/f126 x:0 0 0 2024-02-20T08:06:21.342 INFO:tasks.workunit.client.1.smithi194.stdout:8/893: dwrite d2/d14/d18/d45/d4e/d9f/ffa [0,4194304] 0 2024-02-20T08:06:21.348 INFO:tasks.workunit.client.1.smithi194.stdout:4/886: write d0/df/f84 [4854926,45906] 0 2024-02-20T08:06:21.349 INFO:tasks.workunit.client.1.smithi194.stdout:5/962: mknod d4/d20/d2b/ddf/dc4/c125 0 2024-02-20T08:06:21.353 INFO:tasks.workunit.client.1.smithi194.stdout:8/894: mkdir d2/d14/d18/d45/d69/daf/d138 0 2024-02-20T08:06:21.355 INFO:tasks.workunit.client.1.smithi194.stdout:0/865: truncate d6/d2b/d35/d48/df9/ffb 764370 0 2024-02-20T08:06:21.359 INFO:tasks.workunit.client.1.smithi194.stdout:3/964: creat d5/d10/d17/f130 x:0 0 0 2024-02-20T08:06:21.361 INFO:tasks.workunit.client.1.smithi194.stdout:2/970: rename df/d14/c2c to df/d14/d19/d5c/d97/dc8/c127 0 2024-02-20T08:06:21.362 INFO:tasks.workunit.client.1.smithi194.stdout:1/914: dread d2/d8/d60/fb8 [0,4194304] 0 2024-02-20T08:06:21.365 INFO:tasks.workunit.client.1.smithi194.stdout:5/963: creat d4/d6/dd/d25/d7d/dcd/d122/f126 x:0 0 0 2024-02-20T08:06:21.366 INFO:tasks.workunit.client.1.smithi194.stdout:7/941: dwrite d11/d2d/d38/d4a/d27/d51/d84/f6d [0,4194304] 0 2024-02-20T08:06:21.366 INFO:tasks.workunit.client.1.smithi194.stdout:3/965: mknod d5/d10/d28/d41/d73/d8c/da6/ded/d109/d111/c131 0 2024-02-20T08:06:21.366 INFO:tasks.workunit.client.1.smithi194.stdout:5/964: chown d4/d6/dd/d25/d7d/dcd 10004109 1 2024-02-20T08:06:21.368 INFO:tasks.workunit.client.1.smithi194.stdout:8/895: fdatasync d2/d14/f76 0 2024-02-20T08:06:21.369 INFO:tasks.workunit.client.1.smithi194.stdout:8/896: chown d2/d80/dd1/l12a 933 1 2024-02-20T08:06:21.371 INFO:tasks.workunit.client.1.smithi194.stdout:1/915: creat d2/d8/d12/dc9/d26/d45/f132 x:0 0 0 2024-02-20T08:06:21.372 INFO:tasks.workunit.client.1.smithi194.stdout:8/897: write d2/d80/dd1/fe2 [3353755,93126] 0 2024-02-20T08:06:21.373 INFO:tasks.workunit.client.1.smithi194.stdout:1/916: readlink d2/d8/df/d12d/d71/ld1 0 2024-02-20T08:06:21.374 INFO:tasks.workunit.client.1.smithi194.stdout:5/965: rmdir d4/d6/dd/d99/dd1 39 2024-02-20T08:06:21.382 INFO:tasks.workunit.client.1.smithi194.stdout:0/866: rmdir d6/d2b/d35/d9c/de3 0 2024-02-20T08:06:21.383 INFO:tasks.workunit.client.1.smithi194.stdout:0/867: chown d6/d2b/d35/d42/d1e/d45/f70 1282338644 1 2024-02-20T08:06:21.383 INFO:tasks.workunit.client.1.smithi194.stdout:4/887: getdents d0/df/d72 0 2024-02-20T08:06:21.385 INFO:tasks.workunit.client.1.smithi194.stdout:0/868: dread - d6/d2b/d35/d39/df0/fdd zero size 2024-02-20T08:06:21.387 INFO:tasks.workunit.client.1.smithi194.stdout:3/966: unlink d5/ce4 0 2024-02-20T08:06:21.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/971: dwrite df/d14/f22 [0,4194304] 0 2024-02-20T08:06:21.393 INFO:tasks.workunit.client.1.smithi194.stdout:4/888: dwrite d0/d10/d1c/d21/d46/fc0 [0,4194304] 0 2024-02-20T08:06:21.403 INFO:tasks.workunit.client.1.smithi194.stdout:8/898: mknod d2/d14/d18/d45/d7b/c139 0 2024-02-20T08:06:21.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/917: dread d2/d8/df/d12d/d71/f66 [0,4194304] 0 2024-02-20T08:06:21.407 INFO:tasks.workunit.client.1.smithi194.stdout:3/967: creat d5/d10/d17/dc2/d101/f132 x:0 0 0 2024-02-20T08:06:21.412 INFO:tasks.workunit.client.1.smithi194.stdout:0/869: mknod d6/d2b/d35/c117 0 2024-02-20T08:06:21.413 INFO:tasks.workunit.client.1.smithi194.stdout:7/942: getdents d11/d2d/d38/d37/d3c/d8d/dc9 0 2024-02-20T08:06:21.415 INFO:tasks.workunit.client.1.smithi194.stdout:1/918: rename d2/d8/df/d12d/d71/d8c/d34/db0/ce4 to d2/d8/df/d12d/de1/c133 0 2024-02-20T08:06:21.416 INFO:tasks.workunit.client.1.smithi194.stdout:3/968: symlink d5/d10/d28/dd3/db7/l133 0 2024-02-20T08:06:21.422 INFO:tasks.workunit.client.1.smithi194.stdout:8/899: truncate d2/d80/fa6 748372 0 2024-02-20T08:06:21.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/966: getdents d4/d6/dd/d25/d7d 0 2024-02-20T08:06:21.426 INFO:tasks.workunit.client.1.smithi194.stdout:5/967: fsync d4/d20/d2b/d9b/f11e 0 2024-02-20T08:06:21.426 INFO:tasks.workunit.client.1.smithi194.stdout:2/972: link df/d3a/l51 df/d14/d19/d5c/d60/df8/l128 0 2024-02-20T08:06:21.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/870: write d6/d2b/d35/d48/df9/ffb [1558952,93374] 0 2024-02-20T08:06:21.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/889: getdents d0 0 2024-02-20T08:06:21.436 INFO:tasks.workunit.client.1.smithi194.stdout:3/969: dread d5/df/d30/d80/f89 [0,4194304] 0 2024-02-20T08:06:21.437 INFO:tasks.workunit.client.1.smithi194.stdout:4/890: truncate d0/df/d41/d69/f9b 232222 0 2024-02-20T08:06:21.437 INFO:tasks.workunit.client.1.smithi194.stdout:3/970: chown d5/d10/d16/d7b/d94/fff 255463415 1 2024-02-20T08:06:21.438 INFO:tasks.workunit.client.1.smithi194.stdout:0/871: read d6/d2b/d35/d42/f24 [2110452,92233] 0 2024-02-20T08:06:21.438 INFO:tasks.workunit.client.1.smithi194.stdout:5/968: rename d4/d6/dd/d25/d7d/l91 to d4/d6/dd/d25/d7d/de2/l127 0 2024-02-20T08:06:21.440 INFO:tasks.workunit.client.1.smithi194.stdout:0/872: read d6/d2b/d35/f73 [1563855,112575] 0 2024-02-20T08:06:21.440 INFO:tasks.workunit.client.1.smithi194.stdout:8/900: truncate d2/f1f 4050634 0 2024-02-20T08:06:21.444 INFO:tasks.workunit.client.1.smithi194.stdout:7/943: getdents d11/d2d/d38/d4a/d60/def 0 2024-02-20T08:06:21.445 INFO:tasks.workunit.client.1.smithi194.stdout:1/919: getdents d2/d8/df/d12d/d71 0 2024-02-20T08:06:21.446 INFO:tasks.workunit.client.1.smithi194.stdout:1/920: read d2/d8/df/d12d/d71/d8c/f46 [617935,65467] 0 2024-02-20T08:06:21.446 INFO:tasks.workunit.client.1.smithi194.stdout:4/891: rmdir d0 39 2024-02-20T08:06:21.447 INFO:tasks.workunit.client.1.smithi194.stdout:1/921: readlink d2/d8/df/d12d/d82/laa 0 2024-02-20T08:06:21.447 INFO:tasks.workunit.client.1.smithi194.stdout:3/971: mkdir d5/d10/d28/dd3/d134 0 2024-02-20T08:06:21.448 INFO:tasks.workunit.client.1.smithi194.stdout:3/972: readlink d5/d10/d16/d7b/d94/le7 0 2024-02-20T08:06:21.448 INFO:tasks.workunit.client.1.smithi194.stdout:1/922: write d2/d8/df/d12d/d71/d8c/d34/f6b [924096,7828] 0 2024-02-20T08:06:21.449 INFO:tasks.workunit.client.1.smithi194.stdout:5/969: mknod d4/d20/d2b/ddf/dc4/d28/c128 0 2024-02-20T08:06:21.449 INFO:tasks.workunit.client.1.smithi194.stdout:3/973: stat d5/d10/d28/l65 0 2024-02-20T08:06:21.450 INFO:tasks.workunit.client.1.smithi194.stdout:8/901: rmdir d2/db5 39 2024-02-20T08:06:21.451 INFO:tasks.workunit.client.1.smithi194.stdout:2/973: creat df/d14/d19/d5c/d60/f129 x:0 0 0 2024-02-20T08:06:21.452 INFO:tasks.workunit.client.1.smithi194.stdout:7/944: symlink d11/d2d/d38/d4a/d27/l12f 0 2024-02-20T08:06:21.452 INFO:tasks.workunit.client.1.smithi194.stdout:5/970: write d4/d6/d11/d2f/d10f/f83 [1785147,122921] 0 2024-02-20T08:06:21.457 INFO:tasks.workunit.client.1.smithi194.stdout:0/873: symlink d6/d2b/d35/d9c/l118 0 2024-02-20T08:06:21.458 INFO:tasks.workunit.client.1.smithi194.stdout:2/974: write df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/f11b [578013,17533] 0 2024-02-20T08:06:21.461 INFO:tasks.workunit.client.1.smithi194.stdout:4/892: mknod d0/d5c/d60/c111 0 2024-02-20T08:06:21.463 INFO:tasks.workunit.client.1.smithi194.stdout:5/971: mknod d4/d6/dd/d25/d7d/c129 0 2024-02-20T08:06:21.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/975: truncate df/f119 72444 0 2024-02-20T08:06:21.463 INFO:tasks.workunit.client.1.smithi194.stdout:3/974: dwrite d5/df/d75/f11f [0,4194304] 0 2024-02-20T08:06:21.466 INFO:tasks.workunit.client.1.smithi194.stdout:1/923: dwrite d2/d8/d12/dc9/d26/dfc/d111/ff1 [4194304,4194304] 0 2024-02-20T08:06:21.469 INFO:tasks.workunit.client.1.smithi194.stdout:5/972: fsync d4/d6/d11/d2f/d77/d90/fe9 0 2024-02-20T08:06:21.471 INFO:tasks.workunit.client.1.smithi194.stdout:8/902: dwrite d2/d14/d18/d45/d69/daf/db3/f12b [0,4194304] 0 2024-02-20T08:06:21.473 INFO:tasks.workunit.client.1.smithi194.stdout:1/924: chown d2/d8/cf6 146 1 2024-02-20T08:06:21.474 INFO:tasks.workunit.client.1.smithi194.stdout:2/976: chown df/d14/f66 301 1 2024-02-20T08:06:21.478 INFO:tasks.workunit.client.1.smithi194.stdout:1/925: readlink d2/d8/d12/dc9/d26/d45/l5c 0 2024-02-20T08:06:21.481 INFO:tasks.workunit.client.1.smithi194.stdout:4/893: dwrite d0/df/d41/d69/f91 [4194304,4194304] 0 2024-02-20T08:06:21.515 INFO:tasks.workunit.client.1.smithi194.stdout:0/874: write d6/d2b/d35/d42/f74 [344617,21260] 0 2024-02-20T08:06:21.521 INFO:tasks.workunit.client.1.smithi194.stdout:7/945: rename d11/d2d/d38/d4a/d53/da0/fbc to d11/d2d/d38/d37/d43/d8e/f130 0 2024-02-20T08:06:21.522 INFO:tasks.workunit.client.1.smithi194.stdout:5/973: mkdir d4/d20/d2b/ddf/db6/d10d/d12a 0 2024-02-20T08:06:21.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/974: stat d4/d6/dd/d25/d7d/dcd/df0/f113 0 2024-02-20T08:06:21.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/975: fsync d4/d20/d2b/ddf/dc4/d28/d85/fc7 0 2024-02-20T08:06:21.524 INFO:tasks.workunit.client.1.smithi194.stdout:3/975: rename d5/f7c to d5/df/d75/f135 0 2024-02-20T08:06:21.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/903: rename d2/d14/d18/d45/d4e/dbe/dc3/f130 to d2/d14/d18/d45/d90/d92/f13a 0 2024-02-20T08:06:21.535 INFO:tasks.workunit.client.1.smithi194.stdout:7/946: write d11/d2d/d38/d4a/d27/f29 [46234,8388] 0 2024-02-20T08:06:21.535 INFO:tasks.workunit.client.1.smithi194.stdout:2/977: getdents df/d14/d24/d56/da2 0 2024-02-20T08:06:21.537 INFO:tasks.workunit.client.1.smithi194.stdout:7/947: chown d11/d2d/d38/d4a/d27/d51/f80 338 1 2024-02-20T08:06:21.537 INFO:tasks.workunit.client.1.smithi194.stdout:5/976: mkdir d4/d6/d11/d2f/dee/d12b 0 2024-02-20T08:06:21.540 INFO:tasks.workunit.client.1.smithi194.stdout:5/977: write d4/d20/d2b/ddf/dc4/f109 [816796,888] 0 2024-02-20T08:06:21.540 INFO:tasks.workunit.client.1.smithi194.stdout:0/875: dread d6/d2b/d35/d48/f4a [0,4194304] 0 2024-02-20T08:06:21.541 INFO:tasks.workunit.client.1.smithi194.stdout:2/978: rmdir df/d14/d24/d56/d6b 39 2024-02-20T08:06:21.542 INFO:tasks.workunit.client.1.smithi194.stdout:0/876: read d6/d2b/d35/d42/d1e/d3c/faf [1204645,77604] 0 2024-02-20T08:06:21.542 INFO:tasks.workunit.client.1.smithi194.stdout:0/877: chown d6/d2b/d35/d42/d1e/dfe/f104 0 1 2024-02-20T08:06:21.543 INFO:tasks.workunit.client.1.smithi194.stdout:7/948: symlink d11/d2d/d38/d4a/d60/l131 0 2024-02-20T08:06:21.544 INFO:tasks.workunit.client.1.smithi194.stdout:5/978: dread - d4/d6/dd/d99/dd1/f115 zero size 2024-02-20T08:06:21.549 INFO:tasks.workunit.client.1.smithi194.stdout:1/926: rename d2/d48/fb2 to d2/d8/f134 0 2024-02-20T08:06:21.549 INFO:tasks.workunit.client.1.smithi194.stdout:7/949: dread d11/d2d/d38/d37/d3c/fee [0,4194304] 0 2024-02-20T08:06:21.550 INFO:tasks.workunit.client.1.smithi194.stdout:1/927: chown d2/d8/d12/dc9/ce6 2 1 2024-02-20T08:06:21.550 INFO:tasks.workunit.client.1.smithi194.stdout:3/976: link d5/d10/d28/d41/df4/f125 d5/d10/d8d/f136 0 2024-02-20T08:06:21.551 INFO:tasks.workunit.client.1.smithi194.stdout:3/977: readlink d5/d10/d16/l39 0 2024-02-20T08:06:21.551 INFO:tasks.workunit.client.1.smithi194.stdout:2/979: symlink df/d14/d19/d5c/d97/d9a/l12a 0 2024-02-20T08:06:21.552 INFO:tasks.workunit.client.1.smithi194.stdout:3/978: chown d5/d10/d17/dc2/fc4 662413 1 2024-02-20T08:06:21.552 INFO:tasks.workunit.client.1.smithi194.stdout:2/980: chown c9 89513903 1 2024-02-20T08:06:21.552 INFO:tasks.workunit.client.1.smithi194.stdout:3/979: stat d5/d10/d16/d7b/d94/f11a 0 2024-02-20T08:06:21.558 INFO:tasks.workunit.client.1.smithi194.stdout:1/928: creat d2/d8/df/d12d/d71/d8c/d115/f135 x:0 0 0 2024-02-20T08:06:21.559 INFO:tasks.workunit.client.1.smithi194.stdout:0/878: write d6/d2b/d35/d42/d1e/d45/f70 [982869,123837] 0 2024-02-20T08:06:21.560 INFO:tasks.workunit.client.1.smithi194.stdout:2/981: mkdir df/d14/d19/d5c/d97/d9a/ddd/dc1/dd7/d12b 0 2024-02-20T08:06:21.565 INFO:tasks.workunit.client.1.smithi194.stdout:7/950: write d11/d2d/d38/d4a/d27/d51/d84/f96 [59583,57099] 0 2024-02-20T08:06:21.566 INFO:tasks.workunit.client.1.smithi194.stdout:1/929: mkdir d2/d8/df/d12d/d82/d136 0 2024-02-20T08:06:21.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/980: dread d5/d10/d17/dc2/fc4 [0,4194304] 0 2024-02-20T08:06:21.568 INFO:tasks.workunit.client.1.smithi194.stdout:2/982: fsync df/d14/d19/d5c/d97/d9a/ddd/dc1/fc2 0 2024-02-20T08:06:21.570 INFO:tasks.workunit.client.1.smithi194.stdout:4/894: rename d0/d5c/d60/c111 to d0/d10/c112 0 2024-02-20T08:06:21.572 INFO:tasks.workunit.client.1.smithi194.stdout:5/979: link d4/d6/d11/d2f/d77/c84 d4/d6/dd/d99/c12c 0 2024-02-20T08:06:21.572 INFO:tasks.workunit.client.1.smithi194.stdout:3/981: dwrite d5/d10/d28/dd3/faf [0,4194304] 0 2024-02-20T08:06:21.573 INFO:tasks.workunit.client.1.smithi194.stdout:7/951: creat d11/d2d/d38/d4a/d93/d9a/f132 x:0 0 0 2024-02-20T08:06:21.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/982: fsync d5/d10/d28/d41/d73/d8c/fe3 0 2024-02-20T08:06:21.584 INFO:tasks.workunit.client.1.smithi194.stdout:2/983: fsync df/d14/d24/d56/d6b/f11c 0 2024-02-20T08:06:21.585 INFO:tasks.workunit.client.1.smithi194.stdout:0/879: truncate d6/d2b/d35/d42/f30 918117 0 2024-02-20T08:06:21.586 INFO:tasks.workunit.client.1.smithi194.stdout:0/880: stat d6/d2b/d35/d39/d55/de9 0 2024-02-20T08:06:21.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/895: unlink d0/df/fea 0 2024-02-20T08:06:21.594 INFO:tasks.workunit.client.1.smithi194.stdout:7/952: dread d11/d2d/d38/d37/f4b [0,4194304] 0 2024-02-20T08:06:21.599 INFO:tasks.workunit.client.1.smithi194.stdout:5/980: write d4/d20/d2b/d9b/ddb/fbb [1236224,63511] 0 2024-02-20T08:06:21.617 INFO:tasks.workunit.client.1.smithi194.stdout:3/983: rename d5/d10/d16/f63 to d5/df/d60/f137 0 2024-02-20T08:06:21.618 INFO:tasks.workunit.client.1.smithi194.stdout:2/984: write df/d14/d19/d5c/f94 [1561978,104096] 0 2024-02-20T08:06:21.619 INFO:tasks.workunit.client.1.smithi194.stdout:0/881: symlink d6/d2b/d35/d9c/d62/dd9/l119 0 2024-02-20T08:06:21.620 INFO:tasks.workunit.client.1.smithi194.stdout:2/985: stat df/d14/d19/d5c/d97/d9a/ddd/dc1/ff2 0 2024-02-20T08:06:21.621 INFO:tasks.workunit.client.1.smithi194.stdout:0/882: write d6/f17 [9234002,126161] 0 2024-02-20T08:06:21.622 INFO:tasks.workunit.client.1.smithi194.stdout:7/953: chown d11/d2d/d38/d4a/d93/d9a/leb 387743 1 2024-02-20T08:06:21.622 INFO:tasks.workunit.client.1.smithi194.stdout:0/883: readlink d6/d2b/d35/d9c/d9f/da6/l112 0 2024-02-20T08:06:21.623 INFO:tasks.workunit.client.1.smithi194.stdout:0/884: chown d6/d2b/d35/d39/d8f/fcd 49704 1 2024-02-20T08:06:21.624 INFO:tasks.workunit.client.1.smithi194.stdout:7/954: truncate d11/d2d/d38/d4a/d27/d51/d77/de2/fe8 892089 0 2024-02-20T08:06:21.633 INFO:tasks.workunit.client.1.smithi194.stdout:7/955: unlink d11/d2d/d38/d4a/f21 0 2024-02-20T08:06:21.637 INFO:tasks.workunit.client.1.smithi194.stdout:5/981: creat d4/d6/d11/f12d x:0 0 0 2024-02-20T08:06:21.638 INFO:tasks.workunit.client.1.smithi194.stdout:0/885: fsync d6/d2b/f63 0 2024-02-20T08:06:21.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/886: chown d6/d2b/d35/d9c/d62/dc1/cac 12 1 2024-02-20T08:06:21.643 INFO:tasks.workunit.client.1.smithi194.stdout:0/887: dwrite d6/f90 [0,4194304] 0 2024-02-20T08:06:21.644 INFO:tasks.workunit.client.1.smithi194.stdout:0/888: read - d6/d2b/d35/d42/fe0 zero size 2024-02-20T08:06:21.646 INFO:tasks.workunit.client.1.smithi194.stdout:0/889: chown d6/d2b/d35/d42/d1e/d45/d58/c66 356094312 1 2024-02-20T08:06:21.664 INFO:tasks.workunit.client.1.smithi194.stdout:0/890: dread d6/d2b/d35/d42/d1e/d45/d58/f8d [4194304,4194304] 0 2024-02-20T08:06:21.669 INFO:tasks.workunit.client.1.smithi194.stdout:0/891: dwrite d6/d2b/d35/d48/fbd [0,4194304] 0 2024-02-20T08:06:21.702 INFO:tasks.workunit.client.1.smithi194.stdout:8/904: sync 2024-02-20T08:06:21.715 INFO:tasks.workunit.client.1.smithi194.stdout:2/986: rmdir df/d5b/d105 0 2024-02-20T08:06:21.719 INFO:tasks.workunit.client.1.smithi194.stdout:5/982: rename d4/d6/d11/d2f/l41 to d4/d20/d111/l12e 0 2024-02-20T08:06:21.720 INFO:tasks.workunit.client.1.smithi194.stdout:1/930: link d2/d8/df/d12d/d71/d8c/d115/d68/lfb d2/d8/df/d12d/d71/d8c/d115/d7d/l137 0 2024-02-20T08:06:21.723 INFO:tasks.workunit.client.1.smithi194.stdout:1/931: write d2/d8/d12/dc9/d26/d45/d98/dc6/fc7 [6362538,34090] 0 2024-02-20T08:06:21.728 INFO:tasks.workunit.client.1.smithi194.stdout:5/983: read d4/d6/dd/d3a/f9e [250397,114993] 0 2024-02-20T08:06:21.730 INFO:tasks.workunit.client.1.smithi194.stdout:5/984: readlink d4/d6/dd/d25/d7d/dcd/ld3 0 2024-02-20T08:06:21.732 INFO:tasks.workunit.client.1.smithi194.stdout:5/985: truncate d4/d6/f5e 4649505 0 2024-02-20T08:06:21.738 INFO:tasks.workunit.client.1.smithi194.stdout:0/892: creat d6/d2b/d35/d9c/d62/dc1/df7/f11a x:0 0 0 2024-02-20T08:06:21.739 INFO:tasks.workunit.client.1.smithi194.stdout:8/905: chown d2/d14/d18/d45/d69/daf/dea/l108 127 1 2024-02-20T08:06:21.747 INFO:tasks.workunit.client.1.smithi194.stdout:3/984: getdents d5/d9e 0 2024-02-20T08:06:21.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/956: creat d11/d2d/d38/d37/f133 x:0 0 0 2024-02-20T08:06:21.751 INFO:tasks.workunit.client.1.smithi194.stdout:1/932: rename d2/d8/d12/dc9/l8d to d2/d8/d12/dc9/d26/d45/d98/dc6/l138 0 2024-02-20T08:06:21.754 INFO:tasks.workunit.client.1.smithi194.stdout:0/893: creat d6/d2b/d35/d42/d1e/f11b x:0 0 0 2024-02-20T08:06:21.754 INFO:tasks.workunit.client.1.smithi194.stdout:4/896: write d0/d10/d1c/d4d/d2f/f3d [132593,63799] 0 2024-02-20T08:06:21.755 INFO:tasks.workunit.client.1.smithi194.stdout:8/906: mkdir d2/d14/dc4/d13b 0 2024-02-20T08:06:21.756 INFO:tasks.workunit.client.1.smithi194.stdout:8/907: dread - d2/d14/d18/d45/d4e/f104 zero size 2024-02-20T08:06:21.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/987: truncate df/d14/d24/f4e 3223855 0 2024-02-20T08:06:21.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/908: dread - d2/d14/d18/d45/d69/daf/db3/dce/f119 zero size 2024-02-20T08:06:21.760 INFO:tasks.workunit.client.1.smithi194.stdout:7/957: creat d11/d2d/d38/d37/d43/de7/f134 x:0 0 0 2024-02-20T08:06:21.762 INFO:tasks.workunit.client.1.smithi194.stdout:1/933: read d2/d8/f11 [855986,97577] 0 2024-02-20T08:06:21.762 INFO:tasks.workunit.client.1.smithi194.stdout:0/894: symlink d6/d2b/d35/d9c/d62/dc1/l11c 0 2024-02-20T08:06:21.764 INFO:tasks.workunit.client.1.smithi194.stdout:2/988: symlink df/d14/d80/d85/l12c 0 2024-02-20T08:06:21.765 INFO:tasks.workunit.client.1.smithi194.stdout:8/909: mkdir d2/d14/d18/d45/d4e/dbe/dc3/d13c 0 2024-02-20T08:06:21.765 INFO:tasks.workunit.client.1.smithi194.stdout:0/895: dread d6/d2b/d35/d39/f8e [0,4194304] 0 2024-02-20T08:06:21.766 INFO:tasks.workunit.client.1.smithi194.stdout:5/986: creat d4/d6/dd/d99/f12f x:0 0 0 2024-02-20T08:06:21.766 INFO:tasks.workunit.client.1.smithi194.stdout:0/896: chown d6/d2b/d35/d39/d55/f69 2590756 1 2024-02-20T08:06:21.768 INFO:tasks.workunit.client.1.smithi194.stdout:0/897: write d6/d2b/d35/d9c/d62/dc1/f10b [850130,22132] 0 2024-02-20T08:06:21.769 INFO:tasks.workunit.client.1.smithi194.stdout:8/910: creat d2/dfd/f13d x:0 0 0 2024-02-20T08:06:21.769 INFO:tasks.workunit.client.1.smithi194.stdout:1/934: rmdir d2/d8/df/d12d/d71/d8c/d115/d9f 39 2024-02-20T08:06:21.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/897: rmdir d0/df/d11/dbb/d109 0 2024-02-20T08:06:21.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/898: stat d0/f34 0 2024-02-20T08:06:21.774 INFO:tasks.workunit.client.1.smithi194.stdout:8/911: mkdir d2/d14/d18/d45/d4e/dbe/dc3/d13e 0 2024-02-20T08:06:21.776 INFO:tasks.workunit.client.1.smithi194.stdout:4/899: rmdir d0/d5c/d60/d4a/dad 39 2024-02-20T08:06:21.783 INFO:tasks.workunit.client.1.smithi194.stdout:8/912: mkdir d2/db5/d13f 0 2024-02-20T08:06:21.785 INFO:tasks.workunit.client.1.smithi194.stdout:8/913: symlink d2/d14/dc4/l140 0 2024-02-20T08:06:21.787 INFO:tasks.workunit.client.1.smithi194.stdout:8/914: symlink d2/d14/d18/d45/d4e/dbe/dc3/d13e/l141 0 2024-02-20T08:06:21.788 INFO:tasks.workunit.client.1.smithi194.stdout:8/915: chown d2/d14/d18/d45/d69/daf/dea 2851 1 2024-02-20T08:06:21.791 INFO:tasks.workunit.client.1.smithi194.stdout:8/916: unlink d2/d14/d18/d45/d7b/dc7/d11d/c133 0 2024-02-20T08:06:21.808 INFO:tasks.workunit.client.1.smithi194.stdout:3/985: dwrite d5/d10/d16/f2d [0,4194304] 0 2024-02-20T08:06:21.812 INFO:tasks.workunit.client.1.smithi194.stdout:4/900: rmdir d0/df 39 2024-02-20T08:06:21.815 INFO:tasks.workunit.client.1.smithi194.stdout:7/958: dwrite d11/d2d/d38/d37/d3c/f4c [0,4194304] 0 2024-02-20T08:06:21.815 INFO:tasks.workunit.client.1.smithi194.stdout:3/986: rename d5/fa to d5/d10/d28/db4/f138 0 2024-02-20T08:06:21.815 INFO:tasks.workunit.client.1.smithi194.stdout:1/935: write d2/d8/df/d12d/fda [978101,57680] 0 2024-02-20T08:06:21.819 INFO:tasks.workunit.client.1.smithi194.stdout:2/989: dread df/d14/d24/f4e [0,4194304] 0 2024-02-20T08:06:21.828 INFO:tasks.workunit.client.1.smithi194.stdout:8/917: truncate d2/d14/d18/f40 1645414 0 2024-02-20T08:06:21.839 INFO:tasks.workunit.client.1.smithi194.stdout:2/990: fsync df/d14/d19/d5c/d60/d63/f62 0 2024-02-20T08:06:21.840 INFO:tasks.workunit.client.1.smithi194.stdout:3/987: rename d5/d10/d28/d41/f5c to d5/d10/d16/f139 0 2024-02-20T08:06:21.842 INFO:tasks.workunit.client.1.smithi194.stdout:3/988: readlink d5/d10/d28/d41/d73/d8c/da6/ded/l70 0 2024-02-20T08:06:21.842 INFO:tasks.workunit.client.1.smithi194.stdout:8/918: creat d2/d14/d18/d45/d69/d106/d12f/f142 x:0 0 0 2024-02-20T08:06:21.843 INFO:tasks.workunit.client.1.smithi194.stdout:2/991: dread df/f72 [4194304,4194304] 0 2024-02-20T08:06:21.845 INFO:tasks.workunit.client.1.smithi194.stdout:7/959: rename d11/d2d/d38/d37/d3c/ff0 to d11/d2d/d38/d37/d3c/dd1/f135 0 2024-02-20T08:06:21.846 INFO:tasks.workunit.client.1.smithi194.stdout:4/901: write d0/d4f/f6d [1789430,37605] 0 2024-02-20T08:06:21.846 INFO:tasks.workunit.client.1.smithi194.stdout:3/989: mknod d5/df/d25/c13a 0 2024-02-20T08:06:21.849 INFO:tasks.workunit.client.1.smithi194.stdout:8/919: truncate d2/d80/dd1/d10c/fed 676879 0 2024-02-20T08:06:21.851 INFO:tasks.workunit.client.1.smithi194.stdout:8/920: write d2/d14/d18/d45/d69/d9b/f11a [2146700,17321] 0 2024-02-20T08:06:21.851 INFO:tasks.workunit.client.1.smithi194.stdout:2/992: dread df/d14/f32 [0,4194304] 0 2024-02-20T08:06:21.853 INFO:tasks.workunit.client.1.smithi194.stdout:2/993: fsync df/f41 0 2024-02-20T08:06:21.853 INFO:tasks.workunit.client.1.smithi194.stdout:1/936: dwrite d2/f36 [0,4194304] 0 2024-02-20T08:06:21.855 INFO:tasks.workunit.client.1.smithi194.stdout:3/990: creat d5/d10/f13b x:0 0 0 2024-02-20T08:06:21.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/994: dread - df/d14/d19/d5c/d60/f129 zero size 2024-02-20T08:06:21.857 INFO:tasks.workunit.client.1.smithi194.stdout:8/921: chown d2/d14/d18/d45/d69/daf/db3/dce/f119 3 1 2024-02-20T08:06:21.862 INFO:tasks.workunit.client.1.smithi194.stdout:4/902: mknod d0/df/d11/dbb/c113 0 2024-02-20T08:06:21.863 INFO:tasks.workunit.client.1.smithi194.stdout:4/903: stat d0/df 0 2024-02-20T08:06:21.864 INFO:tasks.workunit.client.1.smithi194.stdout:2/995: creat df/d14/d19/d5c/d60/d63/f12d x:0 0 0 2024-02-20T08:06:21.865 INFO:tasks.workunit.client.1.smithi194.stdout:2/996: chown df/d14/d19/d5c/d97/df1/f104 9817718 1 2024-02-20T08:06:21.865 INFO:tasks.workunit.client.1.smithi194.stdout:8/922: creat d2/d14/d18/d45/d4e/dbe/dc3/f143 x:0 0 0 2024-02-20T08:06:21.866 INFO:tasks.workunit.client.1.smithi194.stdout:5/987: sync 2024-02-20T08:06:21.868 INFO:tasks.workunit.client.1.smithi194.stdout:3/991: chown d5/d10/d28/d41/d73/d8c/de8/df3 31041 1 2024-02-20T08:06:21.873 INFO:tasks.workunit.client.1.smithi194.stdout:5/988: dwrite d4/d6/dd/d25/d78/d8b/f89 [0,4194304] 0 2024-02-20T08:06:21.877 INFO:tasks.workunit.client.1.smithi194.stdout:7/960: dread d11/f35 [4194304,4194304] 0 2024-02-20T08:06:21.877 INFO:tasks.workunit.client.1.smithi194.stdout:4/904: creat d0/d5c/d60/d4a/dad/f114 x:0 0 0 2024-02-20T08:06:21.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/961: chown fd 4 1 2024-02-20T08:06:21.880 INFO:tasks.workunit.client.1.smithi194.stdout:5/989: chown d4/d6/d11/c4f 31952747 1 2024-02-20T08:06:21.881 INFO:tasks.workunit.client.1.smithi194.stdout:3/992: dread d5/d10/d17/dc2/fc4 [0,4194304] 0 2024-02-20T08:06:21.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/962: dread - d11/d2d/d38/d37/d3c/d8d/fc1 zero size 2024-02-20T08:06:21.887 INFO:tasks.workunit.client.1.smithi194.stdout:2/997: link df/d14/d19/d5c/d60/d63/d92/l112 df/d14/d80/d85/l12e 0 2024-02-20T08:06:21.887 INFO:tasks.workunit.client.1.smithi194.stdout:2/998: fsync df/d14/d19/d96/fb0 0 2024-02-20T08:06:21.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/993: creat d5/d10/d28/d41/d73/d8c/da6/ded/d109/d111/f13c x:0 0 0 2024-02-20T08:06:21.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/923: link d2/d14/d18/d45/d7b/dc7/d78/d98/cb1 d2/d14/d18/d45/d7b/c144 0 2024-02-20T08:06:21.894 INFO:tasks.workunit.client.1.smithi194.stdout:7/963: dwrite d11/f1f [4194304,4194304] 0 2024-02-20T08:06:21.895 INFO:tasks.workunit.client.1.smithi194.stdout:1/937: link d2/d8/df/d12d/de1/c133 d2/d8/df/d12d/d71/d8c/d115/d7e/c139 0 2024-02-20T08:06:21.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/905: link d0/d10/l8e d0/d2/l115 0 2024-02-20T08:06:21.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/999: symlink df/d14/d19/d5c/d97/d9a/ddd/d100/l12f 0 2024-02-20T08:06:21.905 INFO:tasks.workunit.client.1.smithi194.stdout:1/938: rename d2/d8/df/d12d/d71/d8c/d115/f135 to d2/d8/df/d12d/ddf/f13a 0 2024-02-20T08:06:21.907 INFO:tasks.workunit.client.1.smithi194.stdout:5/990: link d4/d6/dd/d25/d78/d8b/l7f d4/d6/dd/l130 0 2024-02-20T08:06:21.913 INFO:tasks.workunit.client.1.smithi194.stdout:0/898: sync 2024-02-20T08:06:21.914 INFO:tasks.workunit.client.1.smithi194.stdout:0/899: read - d6/d2b/d35/d42/d1e/f11b zero size 2024-02-20T08:06:21.915 INFO:tasks.workunit.client.1.smithi194.stdout:8/924: write d2/d80/fa6 [908774,77731] 0 2024-02-20T08:06:21.915 INFO:tasks.workunit.client.1.smithi194.stdout:3/994: link d5/d10/d28/dd3/l5f d5/d10/d28/d41/d73/d8c/da6/ded/d109/d126/l13d 0 2024-02-20T08:06:21.916 INFO:tasks.workunit.client.1.smithi194.stdout:5/991: write d4/fe7 [4131756,95256] 0 2024-02-20T08:06:21.916 INFO:tasks.workunit.client.1.smithi194.stdout:0/900: write d6/d2b/d35/d42/f16 [3829024,81938] 0 2024-02-20T08:06:21.916 INFO:tasks.workunit.client.1.smithi194.stdout:4/906: mkdir d0/df/d72/d97/dd1/d116 0 2024-02-20T08:06:21.918 INFO:tasks.workunit.client.1.smithi194.stdout:8/925: chown d2/dfd/f124 86665 1 2024-02-20T08:06:21.918 INFO:tasks.workunit.client.1.smithi194.stdout:1/939: mknod d2/d8/df/d12d/d71/d8c/d115/d7e/dbe/c13b 0 2024-02-20T08:06:21.923 INFO:tasks.workunit.client.1.smithi194.stdout:7/964: getdents d11/d2d/d38/d4a/d53/d81 0 2024-02-20T08:06:21.926 INFO:tasks.workunit.client.1.smithi194.stdout:4/907: creat d0/d2/f117 x:0 0 0 2024-02-20T08:06:21.926 INFO:tasks.workunit.client.1.smithi194.stdout:4/908: chown d0/df/d72/d97/l101 259759617 1 2024-02-20T08:06:21.927 INFO:tasks.workunit.client.1.smithi194.stdout:3/995: mkdir d5/d10/d16/d7b/d94/dad/d110/d13e 0 2024-02-20T08:06:21.928 INFO:tasks.workunit.client.1.smithi194.stdout:0/901: mkdir d6/d2b/d35/d39/d55/d11d 0 2024-02-20T08:06:21.928 INFO:tasks.workunit.client.1.smithi194.stdout:3/996: readlink d5/d10/d28/d41/d73/l86 0 2024-02-20T08:06:21.931 INFO:tasks.workunit.client.1.smithi194.stdout:4/909: creat d0/df/d41/d69/f118 x:0 0 0 2024-02-20T08:06:21.936 INFO:tasks.workunit.client.1.smithi194.stdout:7/965: mkdir d11/d2d/d38/d37/d43/d8e/d136 0 2024-02-20T08:06:21.936 INFO:tasks.workunit.client.1.smithi194.stdout:4/910: dwrite d0/d10/d1c/d4d/d2f/fd2 [0,4194304] 0 2024-02-20T08:06:21.937 INFO:tasks.workunit.client.1.smithi194.stdout:8/926: write d2/f9e [1806405,28616] 0 2024-02-20T08:06:21.939 INFO:tasks.workunit.client.1.smithi194.stdout:0/902: symlink d6/l11e 0 2024-02-20T08:06:21.940 INFO:tasks.workunit.client.1.smithi194.stdout:0/903: dread - d6/d2b/d35/d39/df0/fdd zero size 2024-02-20T08:06:21.942 INFO:tasks.workunit.client.1.smithi194.stdout:0/904: chown d6/d2b/d35/d42/d1e/d3c/da0/fdb 504748798 1 2024-02-20T08:06:21.943 INFO:tasks.workunit.client.1.smithi194.stdout:0/905: write d6/d2b/d35/d39/fc2 [4415795,48100] 0 2024-02-20T08:06:21.944 INFO:tasks.workunit.client.1.smithi194.stdout:0/906: chown d6/d2b/d35/d42/d1e/l98 119 1 2024-02-20T08:06:21.948 INFO:tasks.workunit.client.1.smithi194.stdout:4/911: creat d0/df/d11/d106/f119 x:0 0 0 2024-02-20T08:06:21.950 INFO:tasks.workunit.client.1.smithi194.stdout:8/927: mknod d2/d14/d18/c145 0 2024-02-20T08:06:21.952 INFO:tasks.workunit.client.1.smithi194.stdout:0/907: unlink d6/c40 0 2024-02-20T08:06:21.952 INFO:tasks.workunit.client.1.smithi194.stdout:7/966: truncate d11/d2d/d38/d37/d43/d7b/d91/d9c/dbb/f12a 257502 0 2024-02-20T08:06:21.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/928: write d2/d14/d18/d45/d90/d92/f13a [820596,49125] 0 2024-02-20T08:06:21.956 INFO:tasks.workunit.client.1.smithi194.stdout:0/908: creat d6/d93/f11f x:0 0 0 2024-02-20T08:06:21.956 INFO:tasks.workunit.client.1.smithi194.stdout:7/967: dread - d11/d2d/d38/d4a/d93/d9a/f132 zero size 2024-02-20T08:06:21.956 INFO:tasks.workunit.client.1.smithi194.stdout:4/912: fsync d0/df/d11/d106/f119 0 2024-02-20T08:06:21.958 INFO:tasks.workunit.client.1.smithi194.stdout:3/997: dwrite d5/df/f64 [0,4194304] 0 2024-02-20T08:06:21.959 INFO:tasks.workunit.client.1.smithi194.stdout:7/968: chown d11/d2d/d38/d4a/d53/da0/d11f 129845 1 2024-02-20T08:06:21.960 INFO:tasks.workunit.client.1.smithi194.stdout:3/998: chown d5/d10/d28/f45 12751965 1 2024-02-20T08:06:21.961 INFO:tasks.workunit.client.1.smithi194.stdout:7/969: chown d11/d2d/d38/d37/d3c/c104 185776 1 2024-02-20T08:06:21.962 INFO:tasks.workunit.client.1.smithi194.stdout:0/909: unlink d6/d2b/d35/d42/d1e/d45/daa/d77/cb3 0 2024-02-20T08:06:21.963 INFO:tasks.workunit.client.1.smithi194.stdout:8/929: creat d2/d14/d18/d45/d7b/f146 x:0 0 0 2024-02-20T08:06:21.964 INFO:tasks.workunit.client.1.smithi194.stdout:0/910: read - d6/d2b/d35/d42/d1e/d45/fe6 zero size 2024-02-20T08:06:21.964 INFO:tasks.workunit.client.1.smithi194.stdout:4/913: mknod d0/d10/d1c/c11a 0 2024-02-20T08:06:21.965 INFO:tasks.workunit.client.1.smithi194.stdout:4/914: dread - d0/d2/ff0 zero size 2024-02-20T08:06:21.965 INFO:tasks.workunit.client.1.smithi194.stdout:3/999: symlink d5/df/d25/l13f 0 2024-02-20T08:06:21.968 INFO:tasks.workunit.client.1.smithi194.stdout:7/970: mkdir d11/d2d/d38/d4a/d27/d51/d84/d137 0 2024-02-20T08:06:21.970 INFO:tasks.workunit.client.1.smithi194.stdout:8/930: write d2/d14/d18/d45/d7b/dc7/d78/d98/f9a [3195574,30339] 0 2024-02-20T08:06:21.971 INFO:tasks.workunit.client.1.smithi194.stdout:8/931: read - d2/d80/dd1/f11b zero size 2024-02-20T08:06:21.972 INFO:tasks.workunit.client.1.smithi194.stdout:8/932: write d2/d14/d18/d45/d7b/dc7/d78/d98/f81 [1053568,80363] 0 2024-02-20T08:06:21.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/911: unlink d6/d2b/d35/d42/d1e/d45/daa/fc8 0 2024-02-20T08:06:21.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/912: fdatasync d6/d2b/d35/d9c/d9f/f10e 0 2024-02-20T08:06:21.976 INFO:tasks.workunit.client.1.smithi194.stdout:7/971: creat d11/d2d/d38/d95/f138 x:0 0 0 2024-02-20T08:06:21.976 INFO:tasks.workunit.client.1.smithi194.stdout:0/913: write d6/d2b/d35/d42/d1e/f2e [132075,61794] 0 2024-02-20T08:06:21.976 INFO:tasks.workunit.client.1.smithi194.stdout:4/915: mknod d0/df/c11b 0 2024-02-20T08:06:21.980 INFO:tasks.workunit.client.1.smithi194.stdout:4/916: fsync d0/d2/d3e/f3f 0 2024-02-20T08:06:21.981 INFO:tasks.workunit.client.1.smithi194.stdout:0/914: symlink d6/l120 0 2024-02-20T08:06:21.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/933: creat d2/d14/d18/d45/d7b/dc0/f147 x:0 0 0 2024-02-20T08:06:21.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/934: chown d2/d14/d18/d45/d7b/dc0/fdb 380255 1 2024-02-20T08:06:21.985 INFO:tasks.workunit.client.1.smithi194.stdout:8/935: read d2/d14/d18/d45/d69/daf/db3/ffb [226279,53746] 0 2024-02-20T08:06:21.985 INFO:tasks.workunit.client.1.smithi194.stdout:8/936: stat d2/c47 0 2024-02-20T08:06:21.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/937: chown d2/d14/d18/d45/d7b/dc7/d78/laa 5135 1 2024-02-20T08:06:21.987 INFO:tasks.workunit.client.1.smithi194.stdout:7/972: creat d11/d2d/d38/d37/d3c/d8d/f139 x:0 0 0 2024-02-20T08:06:21.987 INFO:tasks.workunit.client.1.smithi194.stdout:8/938: fsync d2/d14/d18/d45/d4e/dbe/dc3/fe7 0 2024-02-20T08:06:21.991 INFO:tasks.workunit.client.1.smithi194.stdout:7/973: mknod d11/d2d/d38/d4a/d53/da0/c13a 0 2024-02-20T08:06:21.996 INFO:tasks.workunit.client.1.smithi194.stdout:4/917: dread d0/d10/d1c/fb7 [0,4194304] 0 2024-02-20T08:06:21.998 INFO:tasks.workunit.client.1.smithi194.stdout:7/974: symlink d11/d2d/d38/d4a/d60/dea/d114/d11a/l13b 0 2024-02-20T08:06:22.000 INFO:tasks.workunit.client.1.smithi194.stdout:4/918: rename d0/df/d11/dbb/c113 to d0/d5c/d60/d4a/dad/db0/deb/c11c 0 2024-02-20T08:06:22.002 INFO:tasks.workunit.client.1.smithi194.stdout:7/975: rename d11/d6e/f87 to d11/d2d/d38/d4a/d60/dea/d114/f13c 0 2024-02-20T08:06:22.004 INFO:tasks.workunit.client.1.smithi194.stdout:7/976: creat d11/d2d/d38/d37/d43/d7b/dc5/f13d x:0 0 0 2024-02-20T08:06:22.008 INFO:tasks.workunit.client.1.smithi194.stdout:7/977: mkdir d11/d2d/d38/d4a/d93/d9a/d13e 0 2024-02-20T08:06:22.009 INFO:tasks.workunit.client.1.smithi194.stdout:4/919: dwrite d0/d10/d1c/d21/f57 [0,4194304] 0 2024-02-20T08:06:22.009 INFO:tasks.workunit.client.1.smithi194.stdout:0/915: dwrite d6/d2b/d35/d42/d1e/f27 [0,4194304] 0 2024-02-20T08:06:22.029 INFO:tasks.workunit.client.1.smithi194.stdout:0/916: write d6/d2b/f63 [1846803,122081] 0 2024-02-20T08:06:22.030 INFO:tasks.workunit.client.1.smithi194.stdout:7/978: dread d11/d6e/dc6/ffe [0,4194304] 0 2024-02-20T08:06:22.030 INFO:tasks.workunit.client.1.smithi194.stdout:5/992: sync 2024-02-20T08:06:22.033 INFO:tasks.workunit.client.1.smithi194.stdout:4/920: dwrite d0/d2/fe [0,4194304] 0 2024-02-20T08:06:22.034 INFO:tasks.workunit.client.1.smithi194.stdout:5/993: truncate d4/d6/dd/d25/f29 8496947 0 2024-02-20T08:06:22.036 INFO:tasks.workunit.client.1.smithi194.stdout:7/979: creat d11/d2d/d38/d4a/d53/da0/f13f x:0 0 0 2024-02-20T08:06:22.042 INFO:tasks.workunit.client.1.smithi194.stdout:5/994: link d4/d6/da5/f124 d4/d6/dd/d99/de6/f131 0 2024-02-20T08:06:22.044 INFO:tasks.workunit.client.1.smithi194.stdout:0/917: getdents d6/d2b/d35/d42/d1e/d3c 0 2024-02-20T08:06:22.044 INFO:tasks.workunit.client.1.smithi194.stdout:7/980: fdatasync d11/d2d/d38/d4a/d27/f73 0 2024-02-20T08:06:22.045 INFO:tasks.workunit.client.1.smithi194.stdout:4/921: getdents d0/d2/d3e/dcc 0 2024-02-20T08:06:22.048 INFO:tasks.workunit.client.1.smithi194.stdout:0/918: rename d6/d2b/d35/d48/d60/f107 to d6/d2b/d35/d9c/d9f/f121 0 2024-02-20T08:06:22.048 INFO:tasks.workunit.client.1.smithi194.stdout:4/922: symlink d0/d5c/d60/d4a/d4e/l11d 0 2024-02-20T08:06:22.049 INFO:tasks.workunit.client.1.smithi194.stdout:4/923: chown d0/d10/d1c/d21/d46/d104 12266 1 2024-02-20T08:06:22.050 INFO:tasks.workunit.client.1.smithi194.stdout:0/919: mkdir d6/d2b/d35/d9c/d9f/d122 0 2024-02-20T08:06:22.051 INFO:tasks.workunit.client.1.smithi194.stdout:4/924: write d0/d10/d1c/d21/f57 [1449732,123139] 0 2024-02-20T08:06:22.053 INFO:tasks.workunit.client.1.smithi194.stdout:5/995: dread d4/d6/d11/d2f/d10f/f83 [4194304,4194304] 0 2024-02-20T08:06:22.053 INFO:tasks.workunit.client.1.smithi194.stdout:4/925: mknod d0/df/d11/dbb/c11e 0 2024-02-20T08:06:22.054 INFO:tasks.workunit.client.1.smithi194.stdout:4/926: chown d0/d5c/d60/f78 16584 1 2024-02-20T08:06:22.054 INFO:tasks.workunit.client.1.smithi194.stdout:5/996: write d4/d20/d2b/ddf/dc4/f109 [1858698,66327] 0 2024-02-20T08:06:22.056 INFO:tasks.workunit.client.1.smithi194.stdout:5/997: write d4/d6/da5/f102 [410643,55013] 0 2024-02-20T08:06:22.057 INFO:tasks.workunit.client.1.smithi194.stdout:5/998: chown d4/d6/dd/d25/d7d/dcd/ld3 1 1 2024-02-20T08:06:22.058 INFO:tasks.workunit.client.1.smithi194.stdout:0/920: rename d6/d93/fd8 to d6/d2b/d35/d42/d1e/d45/daa/d77/d9d/f123 0 2024-02-20T08:06:22.071 INFO:tasks.workunit.client.1.smithi194.stdout:4/927: dread d0/d10/d1c/d21/f102 [0,4194304] 0 2024-02-20T08:06:22.074 INFO:tasks.workunit.client.1.smithi194.stdout:5/999: dwrite d4/d6/dd/d25/d78/d8b/f24 [0,4194304] 0 2024-02-20T08:06:22.076 INFO:tasks.workunit.client.1.smithi194.stdout:0/921: dread d6/f3d [0,4194304] 0 2024-02-20T08:06:22.076 INFO:tasks.workunit.client.1.smithi194.stdout:4/928: rename d0/d2/d51/d9c/lc4 to d0/d4f/l11f 0 2024-02-20T08:06:22.082 INFO:tasks.workunit.client.1.smithi194.stdout:0/922: dwrite d6/d2b/d35/d42/f24 [0,4194304] 0 2024-02-20T08:06:22.083 INFO:tasks.workunit.client.1.smithi194.stdout:4/929: rename d0/df/d72/dc9/led to d0/d5c/l120 0 2024-02-20T08:06:22.083 INFO:tasks.workunit.client.1.smithi194.stdout:1/940: sync 2024-02-20T08:06:22.086 INFO:tasks.workunit.client.1.smithi194.stdout:4/930: creat d0/d4f/f121 x:0 0 0 2024-02-20T08:06:22.089 INFO:tasks.workunit.client.1.smithi194.stdout:1/941: symlink d2/d8/df/d12d/d71/d8c/d115/d7d/dbf/l13c 0 2024-02-20T08:06:22.091 INFO:tasks.workunit.client.1.smithi194.stdout:4/931: symlink d0/d2/d51/l122 0 2024-02-20T08:06:22.094 INFO:tasks.workunit.client.1.smithi194.stdout:1/942: mknod d2/d8/d12/dc9/d10e/c13d 0 2024-02-20T08:06:22.095 INFO:tasks.workunit.client.1.smithi194.stdout:1/943: fsync d2/d8/d12/dc9/d26/d57/f90 0 2024-02-20T08:06:22.111 INFO:tasks.workunit.client.1.smithi194.stdout:1/944: dwrite d2/d8/df/d12d/d71/f7a [0,4194304] 0 2024-02-20T08:06:22.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/945: rename d2/d8/d12/dc9/d26/d57/f90 to d2/d8/df/d12d/d71/d8c/f13e 0 2024-02-20T08:06:22.123 INFO:tasks.workunit.client.1.smithi194.stdout:1/946: dwrite d2/d8/d12/dc9/d26/f2d [0,4194304] 0 2024-02-20T08:06:22.128 INFO:tasks.workunit.client.1.smithi194.stdout:1/947: symlink d2/d8/d12/dc9/l13f 0 2024-02-20T08:06:22.132 INFO:tasks.workunit.client.1.smithi194.stdout:1/948: write d2/d8/df/d12d/d71/d8c/d115/d68/f89 [4401770,56171] 0 2024-02-20T08:06:22.133 INFO:tasks.workunit.client.1.smithi194.stdout:1/949: chown d2/d8/d12/dc9/d26/dfc/f118 93 1 2024-02-20T08:06:22.134 INFO:tasks.workunit.client.1.smithi194.stdout:8/939: sync 2024-02-20T08:06:22.134 INFO:tasks.workunit.client.1.smithi194.stdout:7/981: sync 2024-02-20T08:06:22.140 INFO:tasks.workunit.client.1.smithi194.stdout:1/950: mkdir d2/d8/df/d12d/d71/d8c/d140 0 2024-02-20T08:06:22.140 INFO:tasks.workunit.client.1.smithi194.stdout:7/982: write d11/d6e/f78 [475779,11109] 0 2024-02-20T08:06:22.141 INFO:tasks.workunit.client.1.smithi194.stdout:1/951: chown d2/d8/df/d12d/d71/d8c/d115/d68/db7/fc8 24 1 2024-02-20T08:06:22.141 INFO:tasks.workunit.client.1.smithi194.stdout:8/940: mkdir d2/d14/d18/d45/d4e/dbe/dc3/d148 0 2024-02-20T08:06:22.142 INFO:tasks.workunit.client.1.smithi194.stdout:7/983: mkdir d11/d2d/d38/d4a/d60/dea/d114/d116/d140 0 2024-02-20T08:06:22.143 INFO:tasks.workunit.client.1.smithi194.stdout:1/952: rename d2/d8/d12/dc9/d26/d45/d98/dc6/c120 to d2/d8/df/d12d/d71/d8c/d140/c141 0 2024-02-20T08:06:22.147 INFO:tasks.workunit.client.1.smithi194.stdout:1/953: symlink d2/d8/d12/l142 0 2024-02-20T08:06:22.148 INFO:tasks.workunit.client.1.smithi194.stdout:1/954: dread - d2/d8/df/d12d/d71/d8c/d115/d68/db7/ff7 zero size 2024-02-20T08:06:22.150 INFO:tasks.workunit.client.1.smithi194.stdout:7/984: creat d11/d2d/d38/d4a/d27/d51/d84/d137/f141 x:0 0 0 2024-02-20T08:06:22.153 INFO:tasks.workunit.client.1.smithi194.stdout:1/955: symlink d2/d8/d12/dc9/d26/d45/d98/l143 0 2024-02-20T08:06:22.156 INFO:tasks.workunit.client.1.smithi194.stdout:1/956: chown d2/d48/c12b 0 1 2024-02-20T08:06:22.158 INFO:tasks.workunit.client.1.smithi194.stdout:0/923: sync 2024-02-20T08:06:22.158 INFO:tasks.workunit.client.1.smithi194.stdout:4/932: sync 2024-02-20T08:06:22.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/957: mkdir d2/d8/df/d12d/de1/d144 0 2024-02-20T08:06:22.161 INFO:tasks.workunit.client.1.smithi194.stdout:1/958: write d2/d8/df/f33 [823265,63037] 0 2024-02-20T08:06:22.162 INFO:tasks.workunit.client.1.smithi194.stdout:4/933: creat d0/df/d72/dc9/f123 x:0 0 0 2024-02-20T08:06:22.164 INFO:tasks.workunit.client.1.smithi194.stdout:0/924: unlink d6/d2b/d35/d42/d1e/d3c/l64 0 2024-02-20T08:06:22.165 INFO:tasks.workunit.client.1.smithi194.stdout:4/934: chown d0/d10/d1c/d21/d46/d104/l10b 8 1 2024-02-20T08:06:22.165 INFO:tasks.workunit.client.1.smithi194.stdout:8/941: dwrite d2/d14/d18/d45/d69/daf/db3/ffb [0,4194304] 0 2024-02-20T08:06:22.167 INFO:tasks.workunit.client.1.smithi194.stdout:1/959: mkdir d2/d8/df/d12d/de1/d110/d145 0 2024-02-20T08:06:22.167 INFO:tasks.workunit.client.1.smithi194.stdout:8/942: chown d2/d80/dd1/l12a 1048546 1 2024-02-20T08:06:22.169 INFO:tasks.workunit.client.1.smithi194.stdout:7/985: write d11/d2d/d38/f7a [883598,73861] 0 2024-02-20T08:06:22.172 INFO:tasks.workunit.client.1.smithi194.stdout:4/935: unlink d0/d10/d1c/d4d/d2f/fd2 0 2024-02-20T08:06:22.178 INFO:tasks.workunit.client.1.smithi194.stdout:0/925: fdatasync d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/f89 0 2024-02-20T08:06:22.179 INFO:tasks.workunit.client.1.smithi194.stdout:4/936: mkdir d0/df/d41/d69/daa/d124 0 2024-02-20T08:06:22.185 INFO:tasks.workunit.client.1.smithi194.stdout:7/986: mknod d11/d10c/c142 0 2024-02-20T08:06:22.187 INFO:tasks.workunit.client.1.smithi194.stdout:4/937: dwrite d0/d5c/d60/d4a/d4e/dbe/ddb/f100 [0,4194304] 0 2024-02-20T08:06:22.189 INFO:tasks.workunit.client.1.smithi194.stdout:4/938: chown d0/d5c/d60/d4a/dad 2709122 1 2024-02-20T08:06:22.189 INFO:tasks.workunit.client.1.smithi194.stdout:1/960: dwrite d2/d8/d12/dc9/d26/f40 [0,4194304] 0 2024-02-20T08:06:22.191 INFO:tasks.workunit.client.1.smithi194.stdout:4/939: chown d0/f34 186279568 1 2024-02-20T08:06:22.195 INFO:tasks.workunit.client.1.smithi194.stdout:8/943: dwrite d2/d14/f2b [0,4194304] 0 2024-02-20T08:06:22.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/944: chown d2/d80/dd1 0 1 2024-02-20T08:06:22.197 INFO:tasks.workunit.client.1.smithi194.stdout:0/926: rename d6/d2b/d35/d9c/lbb to d6/d2b/d35/d42/l124 0 2024-02-20T08:06:22.199 INFO:tasks.workunit.client.1.smithi194.stdout:1/961: creat d2/d8/df/d12d/d71/d8c/f146 x:0 0 0 2024-02-20T08:06:22.203 INFO:tasks.workunit.client.1.smithi194.stdout:4/940: truncate d0/df/d41/f77 405293 0 2024-02-20T08:06:22.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/945: chown d2/d80/dd1/le0 5309 1 2024-02-20T08:06:22.209 INFO:tasks.workunit.client.1.smithi194.stdout:4/941: mkdir d0/d5c/d60/d125 0 2024-02-20T08:06:22.210 INFO:tasks.workunit.client.1.smithi194.stdout:8/946: truncate d2/d14/d18/d45/d4e/d9f/f110 692374 0 2024-02-20T08:06:22.210 INFO:tasks.workunit.client.1.smithi194.stdout:0/927: creat d6/d2b/d35/f125 x:0 0 0 2024-02-20T08:06:22.212 INFO:tasks.workunit.client.1.smithi194.stdout:0/928: stat d6/d2b/d35/d42/d1e/d45/l7d 0 2024-02-20T08:06:22.213 INFO:tasks.workunit.client.1.smithi194.stdout:4/942: creat d0/df/d41/d69/daa/d124/f126 x:0 0 0 2024-02-20T08:06:22.215 INFO:tasks.workunit.client.1.smithi194.stdout:4/943: write d0/df/d41/ff2 [554767,51084] 0 2024-02-20T08:06:22.216 INFO:tasks.workunit.client.1.smithi194.stdout:8/947: fsync d2/d14/d18/d45/d7b/dc7/d78/d98/f86 0 2024-02-20T08:06:22.216 INFO:tasks.workunit.client.1.smithi194.stdout:4/944: stat d0/d10/d1c/f5a 0 2024-02-20T08:06:22.218 INFO:tasks.workunit.client.1.smithi194.stdout:7/987: dread d11/d2d/d38/d37/d3c/fc7 [0,4194304] 0 2024-02-20T08:06:22.226 INFO:tasks.workunit.client.1.smithi194.stdout:4/945: dread d0/d4f/f6d [0,4194304] 0 2024-02-20T08:06:22.231 INFO:tasks.workunit.client.1.smithi194.stdout:4/946: dwrite d0/d10/d1c/d21/f57 [0,4194304] 0 2024-02-20T08:06:22.249 INFO:tasks.workunit.client.1.smithi194.stdout:8/948: unlink d2/d80/dd1/fe2 0 2024-02-20T08:06:22.253 INFO:tasks.workunit.client.1.smithi194.stdout:1/962: write d2/d8/d60/f97 [236591,96541] 0 2024-02-20T08:06:22.254 INFO:tasks.workunit.client.1.smithi194.stdout:1/963: write d2/d48/fd9 [1814436,9538] 0 2024-02-20T08:06:22.256 INFO:tasks.workunit.client.1.smithi194.stdout:7/988: mkdir d11/d2d/d38/d37/d43/d8e/d136/d143 0 2024-02-20T08:06:22.256 INFO:tasks.workunit.client.1.smithi194.stdout:0/929: write d6/f90 [7122811,99041] 0 2024-02-20T08:06:22.259 INFO:tasks.workunit.client.1.smithi194.stdout:8/949: fdatasync d2/d14/d18/d45/d4e/fa8 0 2024-02-20T08:06:22.260 INFO:tasks.workunit.client.1.smithi194.stdout:8/950: stat d2/f9e 0 2024-02-20T08:06:22.261 INFO:tasks.workunit.client.1.smithi194.stdout:1/964: rename d2/d8/d12/f81 to d2/d8/d12/dc9/d10e/f147 0 2024-02-20T08:06:22.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/965: write d2/d8/f85 [2950131,113907] 0 2024-02-20T08:06:22.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/947: creat d0/df/f127 x:0 0 0 2024-02-20T08:06:22.267 INFO:tasks.workunit.client.1.smithi194.stdout:8/951: unlink d2/d14/l12e 0 2024-02-20T08:06:22.268 INFO:tasks.workunit.client.1.smithi194.stdout:8/952: stat d2/d14/d18/d45/d4e/d9f/f110 0 2024-02-20T08:06:22.269 INFO:tasks.workunit.client.1.smithi194.stdout:7/989: symlink d11/d2d/d38/d4a/d53/l144 0 2024-02-20T08:06:22.272 INFO:tasks.workunit.client.1.smithi194.stdout:1/966: creat d2/d8/d12/f148 x:0 0 0 2024-02-20T08:06:22.272 INFO:tasks.workunit.client.1.smithi194.stdout:4/948: symlink d0/df/d72/d97/dd1/l128 0 2024-02-20T08:06:22.273 INFO:tasks.workunit.client.1.smithi194.stdout:0/930: dread d6/d2b/f50 [0,4194304] 0 2024-02-20T08:06:22.273 INFO:tasks.workunit.client.1.smithi194.stdout:4/949: chown d0/df/d72/laf 26896 1 2024-02-20T08:06:22.274 INFO:tasks.workunit.client.1.smithi194.stdout:8/953: mkdir d2/d14/d18/d45/d4e/dbe/d149 0 2024-02-20T08:06:22.274 INFO:tasks.workunit.client.1.smithi194.stdout:0/931: chown d6/d2b/d35/d9c/d62/dd9 2666 1 2024-02-20T08:06:22.276 INFO:tasks.workunit.client.1.smithi194.stdout:4/950: truncate d0/d10/d1c/d21/d46/f103 364765 0 2024-02-20T08:06:22.278 INFO:tasks.workunit.client.1.smithi194.stdout:4/951: chown d0/df/d11/dbb/ddc 0 1 2024-02-20T08:06:22.278 INFO:tasks.workunit.client.1.smithi194.stdout:1/967: dwrite d2/d8/d12/dc9/d26/f40 [4194304,4194304] 0 2024-02-20T08:06:22.281 INFO:tasks.workunit.client.1.smithi194.stdout:8/954: rename d2/d14/d18/d45/d7b/dc7/d78/d98/f6e to d2/d14/d18/d45/d7b/dc7/d78/d98/f14a 0 2024-02-20T08:06:22.282 INFO:tasks.workunit.client.1.smithi194.stdout:0/932: dwrite d6/d2b/d35/d39/d8f/fd4 [0,4194304] 0 2024-02-20T08:06:22.282 INFO:tasks.workunit.client.1.smithi194.stdout:1/968: write d2/d8/f134 [3623033,107105] 0 2024-02-20T08:06:22.283 INFO:tasks.workunit.client.1.smithi194.stdout:1/969: readlink d2/l31 0 2024-02-20T08:06:22.285 INFO:tasks.workunit.client.1.smithi194.stdout:4/952: creat d0/df/d41/d69/d10a/f129 x:0 0 0 2024-02-20T08:06:22.286 INFO:tasks.workunit.client.1.smithi194.stdout:8/955: mkdir d2/d14/d18/d45/d90/d14b 0 2024-02-20T08:06:22.292 INFO:tasks.workunit.client.1.smithi194.stdout:4/953: dwrite d0/d2/fe [4194304,4194304] 0 2024-02-20T08:06:22.294 INFO:tasks.workunit.client.1.smithi194.stdout:4/954: chown d0/d5c/d60/d4a/dad/f114 0 1 2024-02-20T08:06:22.294 INFO:tasks.workunit.client.1.smithi194.stdout:0/933: unlink d6/d2b/d35/d42/c2a 0 2024-02-20T08:06:22.294 INFO:tasks.workunit.client.1.smithi194.stdout:1/970: mknod d2/d8/df/d12d/d71/d8c/d115/c149 0 2024-02-20T08:06:22.296 INFO:tasks.workunit.client.1.smithi194.stdout:8/956: dwrite d2/d14/d18/d45/d4e/dbe/dc3/fe7 [0,4194304] 0 2024-02-20T08:06:22.298 INFO:tasks.workunit.client.1.smithi194.stdout:0/934: write d6/d2b/d35/d42/f24 [5124989,109018] 0 2024-02-20T08:06:22.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/935: write d6/d2b/d35/d39/d8f/fd4 [2496861,76226] 0 2024-02-20T08:06:22.302 INFO:tasks.workunit.client.1.smithi194.stdout:4/955: creat d0/d9d/d10f/f12a x:0 0 0 2024-02-20T08:06:22.303 INFO:tasks.workunit.client.1.smithi194.stdout:0/936: chown d6/d2b/d35/d42/d1e/d45/daa 265 1 2024-02-20T08:06:22.306 INFO:tasks.workunit.client.1.smithi194.stdout:1/971: chown d2/d8/df/d12d/d71/d8c/d115/f9c 1915 1 2024-02-20T08:06:22.306 INFO:tasks.workunit.client.1.smithi194.stdout:4/956: chown d0/df/d41/l8b 3821 1 2024-02-20T08:06:22.308 INFO:tasks.workunit.client.1.smithi194.stdout:8/957: dwrite d2/d14/f2b [0,4194304] 0 2024-02-20T08:06:22.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/957: mknod d0/c12b 0 2024-02-20T08:06:22.315 INFO:tasks.workunit.client.1.smithi194.stdout:8/958: creat d2/d14/d18/d45/d7b/dc7/d78/dbc/f14c x:0 0 0 2024-02-20T08:06:22.321 INFO:tasks.workunit.client.1.smithi194.stdout:0/937: link d6/d2b/d35/d48/df9/ffb d6/dbe/f126 0 2024-02-20T08:06:22.324 INFO:tasks.workunit.client.1.smithi194.stdout:8/959: truncate d2/d14/f5d 1495401 0 2024-02-20T08:06:22.325 INFO:tasks.workunit.client.1.smithi194.stdout:4/958: mknod d0/df/d72/d97/dd1/d116/c12c 0 2024-02-20T08:06:22.326 INFO:tasks.workunit.client.1.smithi194.stdout:4/959: dread - d0/df/d41/fc7 zero size 2024-02-20T08:06:22.327 INFO:tasks.workunit.client.1.smithi194.stdout:4/960: readlink d0/d10/d1c/d21/d46/lb9 0 2024-02-20T08:06:22.330 INFO:tasks.workunit.client.1.smithi194.stdout:4/961: dread d0/d4f/f6d [0,4194304] 0 2024-02-20T08:06:22.331 INFO:tasks.workunit.client.1.smithi194.stdout:8/960: dwrite d2/d14/d18/d45/d4e/d9f/ff7 [0,4194304] 0 2024-02-20T08:06:22.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/962: write d0/d5c/d60/d4a/dad/f114 [135995,107666] 0 2024-02-20T08:06:22.333 INFO:tasks.workunit.client.1.smithi194.stdout:4/963: stat d0/d10/d1c/d21/d46/fc0 0 2024-02-20T08:06:22.334 INFO:tasks.workunit.client.1.smithi194.stdout:8/961: read d2/f9e [127568,127162] 0 2024-02-20T08:06:22.336 INFO:tasks.workunit.client.1.smithi194.stdout:8/962: dread - d2/d80/fbb zero size 2024-02-20T08:06:22.338 INFO:tasks.workunit.client.1.smithi194.stdout:4/964: symlink d0/d2/l12d 0 2024-02-20T08:06:22.338 INFO:tasks.workunit.client.1.smithi194.stdout:8/963: readlink d2/d14/d18/d45/d7b/dc7/l84 0 2024-02-20T08:06:22.341 INFO:tasks.workunit.client.1.smithi194.stdout:4/965: creat d0/d5c/d60/d4a/dad/db0/f12e x:0 0 0 2024-02-20T08:06:22.342 INFO:tasks.workunit.client.1.smithi194.stdout:4/966: fsync d0/d2/d3e/f3f 0 2024-02-20T08:06:22.344 INFO:tasks.workunit.client.1.smithi194.stdout:8/964: symlink d2/d14/d18/d45/l14d 0 2024-02-20T08:06:22.346 INFO:tasks.workunit.client.1.smithi194.stdout:4/967: symlink d0/d4f/l12f 0 2024-02-20T08:06:22.349 INFO:tasks.workunit.client.1.smithi194.stdout:0/938: rmdir d6/d2b/d35 39 2024-02-20T08:06:22.349 INFO:tasks.workunit.client.1.smithi194.stdout:8/965: truncate d2/d14/d18/d45/f95 5083018 0 2024-02-20T08:06:22.350 INFO:tasks.workunit.client.1.smithi194.stdout:8/966: chown d2/dfd 3018938 1 2024-02-20T08:06:22.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/968: dwrite d0/d2/d51/fcf [0,4194304] 0 2024-02-20T08:06:22.354 INFO:tasks.workunit.client.1.smithi194.stdout:0/939: mknod d6/d2b/d35/d42/d1e/d45/df8/c127 0 2024-02-20T08:06:22.356 INFO:tasks.workunit.client.1.smithi194.stdout:4/969: mknod d0/df/d72/dc9/c130 0 2024-02-20T08:06:22.356 INFO:tasks.workunit.client.1.smithi194.stdout:0/940: chown d6/d2b/d35/d42/d1e/f3f 376828859 1 2024-02-20T08:06:22.358 INFO:tasks.workunit.client.1.smithi194.stdout:4/970: write d0/d10/d1c/d21/f57 [4851413,60181] 0 2024-02-20T08:06:22.359 INFO:tasks.workunit.client.1.smithi194.stdout:0/941: rename d6/d2b/d35/d9c to d6/d2b/d35/d9c/d62/d128 22 2024-02-20T08:06:22.359 INFO:tasks.workunit.client.1.smithi194.stdout:8/967: dread d2/d14/d18/d45/d7b/fb6 [0,4194304] 0 2024-02-20T08:06:22.360 INFO:tasks.workunit.client.1.smithi194.stdout:4/971: read - d0/df/d41/fc7 zero size 2024-02-20T08:06:22.365 INFO:tasks.workunit.client.1.smithi194.stdout:8/968: creat d2/d14/d18/d45/d69/daf/d138/f14e x:0 0 0 2024-02-20T08:06:22.366 INFO:tasks.workunit.client.1.smithi194.stdout:8/969: chown d2/d14/d18/d45/d7b/dc7/d11d 10 1 2024-02-20T08:06:22.367 INFO:tasks.workunit.client.1.smithi194.stdout:8/970: readlink d2/d14/d18/d45/d7b/dc7/l96 0 2024-02-20T08:06:22.368 INFO:tasks.workunit.client.1.smithi194.stdout:4/972: truncate d0/d10/d1c/d4d/d2f/fb2 3665622 0 2024-02-20T08:06:22.369 INFO:tasks.workunit.client.1.smithi194.stdout:4/973: chown d0/d5c/d60/d4a/dad 78758331 1 2024-02-20T08:06:22.370 INFO:tasks.workunit.client.1.smithi194.stdout:4/974: truncate d0/d2/f117 285451 0 2024-02-20T08:06:22.370 INFO:tasks.workunit.client.1.smithi194.stdout:8/971: mknod d2/d14/dc4/d13b/c14f 0 2024-02-20T08:06:22.376 INFO:tasks.workunit.client.1.smithi194.stdout:8/972: dwrite d2/d14/d18/d45/d90/fb2 [0,4194304] 0 2024-02-20T08:06:22.379 INFO:tasks.workunit.client.1.smithi194.stdout:8/973: creat d2/d80/f150 x:0 0 0 2024-02-20T08:06:22.386 INFO:tasks.workunit.client.1.smithi194.stdout:4/975: dread d0/df/d72/d97/f89 [0,4194304] 0 2024-02-20T08:06:22.387 INFO:tasks.workunit.client.1.smithi194.stdout:8/974: creat d2/d80/dd1/f151 x:0 0 0 2024-02-20T08:06:22.388 INFO:tasks.workunit.client.1.smithi194.stdout:8/975: fsync d2/d14/d18/d45/d69/daf/db3/ffb 0 2024-02-20T08:06:22.390 INFO:tasks.workunit.client.1.smithi194.stdout:8/976: mkdir d2/d14/d18/d45/d90/d152 0 2024-02-20T08:06:22.391 INFO:tasks.workunit.client.1.smithi194.stdout:7/990: sync 2024-02-20T08:06:22.392 INFO:tasks.workunit.client.1.smithi194.stdout:4/976: creat d0/d10/d1c/d4d/f131 x:0 0 0 2024-02-20T08:06:22.392 INFO:tasks.workunit.client.1.smithi194.stdout:7/991: write d11/d2d/d38/d37/d3c/dd1/f127 [696519,88424] 0 2024-02-20T08:06:22.394 INFO:tasks.workunit.client.1.smithi194.stdout:7/992: write d11/d2d/d38/d4a/d27/d51/fdf [840011,116925] 0 2024-02-20T08:06:22.395 INFO:tasks.workunit.client.1.smithi194.stdout:7/993: fsync d11/d2d/d38/d37/f133 0 2024-02-20T08:06:22.396 INFO:tasks.workunit.client.1.smithi194.stdout:4/977: fdatasync d0/d10/d1c/d4d/f7a 0 2024-02-20T08:06:22.401 INFO:tasks.workunit.client.1.smithi194.stdout:4/978: symlink d0/d10/d1c/d4d/l132 0 2024-02-20T08:06:22.401 INFO:tasks.workunit.client.1.smithi194.stdout:7/994: dwrite d11/d2d/d38/d4a/d27/f76 [0,4194304] 0 2024-02-20T08:06:22.406 INFO:tasks.workunit.client.1.smithi194.stdout:7/995: creat d11/d2d/d38/d4a/d27/d51/f145 x:0 0 0 2024-02-20T08:06:22.410 INFO:tasks.workunit.client.1.smithi194.stdout:4/979: getdents d0/df/d72 0 2024-02-20T08:06:22.413 INFO:tasks.workunit.client.1.smithi194.stdout:8/977: dread d2/f37 [0,4194304] 0 2024-02-20T08:06:22.413 INFO:tasks.workunit.client.1.smithi194.stdout:7/996: dwrite d11/d2d/d38/d4a/d53/d81/f86 [0,4194304] 0 2024-02-20T08:06:22.420 INFO:tasks.workunit.client.1.smithi194.stdout:4/980: getdents d0/d2 0 2024-02-20T08:06:22.421 INFO:tasks.workunit.client.1.smithi194.stdout:8/978: mknod d2/db5/d13f/c153 0 2024-02-20T08:06:22.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/981: creat d0/df/d41/d69/d10a/f133 x:0 0 0 2024-02-20T08:06:22.424 INFO:tasks.workunit.client.1.smithi194.stdout:8/979: creat d2/d14/d18/d45/d90/d92/f154 x:0 0 0 2024-02-20T08:06:22.425 INFO:tasks.workunit.client.1.smithi194.stdout:7/997: creat d11/d2d/d38/d4a/f146 x:0 0 0 2024-02-20T08:06:22.426 INFO:tasks.workunit.client.1.smithi194.stdout:8/980: write d2/d14/d18/d45/d69/daf/db3/f12b [2561938,16855] 0 2024-02-20T08:06:22.426 INFO:tasks.workunit.client.1.smithi194.stdout:7/998: readlink d11/d2d/d38/d4a/d60/l131 0 2024-02-20T08:06:22.426 INFO:tasks.workunit.client.1.smithi194.stdout:4/982: creat d0/d5c/d60/d4a/d4e/dbe/f134 x:0 0 0 2024-02-20T08:06:22.428 INFO:tasks.workunit.client.1.smithi194.stdout:4/983: chown d0/df/l40 1267 1 2024-02-20T08:06:22.433 INFO:tasks.workunit.client.1.smithi194.stdout:4/984: symlink d0/d2/d3e/dcc/l135 0 2024-02-20T08:06:22.434 INFO:tasks.workunit.client.1.smithi194.stdout:4/985: read d0/d2/d51/fcf [536791,57362] 0 2024-02-20T08:06:22.435 INFO:tasks.workunit.client.1.smithi194.stdout:8/981: creat d2/d14/dc4/d11e/d131/f155 x:0 0 0 2024-02-20T08:06:22.438 INFO:tasks.workunit.client.1.smithi194.stdout:4/986: rmdir d0/df 39 2024-02-20T08:06:22.440 INFO:tasks.workunit.client.1.smithi194.stdout:7/999: dwrite d11/d2d/d38/d37/d43/d7b/d91/f98 [0,4194304] 0 2024-02-20T08:06:22.443 INFO:tasks.workunit.client.1.smithi194.stdout:8/982: symlink d2/d14/d18/d45/d90/d152/l156 0 2024-02-20T08:06:22.452 INFO:tasks.workunit.client.1.smithi194.stdout:4/987: dwrite d0/fe5 [0,4194304] 0 2024-02-20T08:06:22.455 INFO:tasks.workunit.client.1.smithi194.stdout:8/983: dwrite d2/d80/fd8 [0,4194304] 0 2024-02-20T08:06:22.459 INFO:tasks.workunit.client.1.smithi194.stdout:4/988: rename d0/df/c50 to d0/df/d72/d97/dd1/d116/c136 0 2024-02-20T08:06:22.460 INFO:tasks.workunit.client.1.smithi194.stdout:4/989: read d0/d10/d1c/d21/f96 [564617,125660] 0 2024-02-20T08:06:22.461 INFO:tasks.workunit.client.1.smithi194.stdout:8/984: creat d2/d14/d18/d45/d4e/dbe/dc3/d148/f157 x:0 0 0 2024-02-20T08:06:22.461 INFO:tasks.workunit.client.1.smithi194.stdout:1/972: sync 2024-02-20T08:06:22.463 INFO:tasks.workunit.client.1.smithi194.stdout:1/973: fsync d2/d8/d12/dc9/d26/d45/fa6 0 2024-02-20T08:06:22.464 INFO:tasks.workunit.client.1.smithi194.stdout:4/990: creat d0/d5c/d60/d4a/dad/db0/deb/f137 x:0 0 0 2024-02-20T08:06:22.465 INFO:tasks.workunit.client.1.smithi194.stdout:8/985: mkdir d2/d14/dc4/d158 0 2024-02-20T08:06:22.465 INFO:tasks.workunit.client.1.smithi194.stdout:1/974: dread - d2/d8/d12/dc9/d26/d45/d98/fff zero size 2024-02-20T08:06:22.466 INFO:tasks.workunit.client.1.smithi194.stdout:8/986: write d2/d14/f3c [1337058,107508] 0 2024-02-20T08:06:22.468 INFO:tasks.workunit.client.1.smithi194.stdout:4/991: read d0/d2/d51/fcf [2653331,50912] 0 2024-02-20T08:06:22.470 INFO:tasks.workunit.client.1.smithi194.stdout:1/975: creat d2/d8/d12/dc9/d26/d57/f14a x:0 0 0 2024-02-20T08:06:22.472 INFO:tasks.workunit.client.1.smithi194.stdout:1/976: readlink d2/d8/d12/dc9/d26/d57/d58/l10f 0 2024-02-20T08:06:22.472 INFO:tasks.workunit.client.1.smithi194.stdout:8/987: rename d2/d14/d18/d45/d69/d9b/c101 to d2/d14/d18/d45/d4e/dbe/dc3/d13e/c159 0 2024-02-20T08:06:22.475 INFO:tasks.workunit.client.1.smithi194.stdout:4/992: dwrite d0/df/f127 [0,4194304] 0 2024-02-20T08:06:22.476 INFO:tasks.workunit.client.1.smithi194.stdout:8/988: write d2/d14/d18/d45/d69/daf/d138/f14e [160485,43710] 0 2024-02-20T08:06:22.478 INFO:tasks.workunit.client.1.smithi194.stdout:4/993: mkdir d0/d5c/d60/d138 0 2024-02-20T08:06:22.480 INFO:tasks.workunit.client.1.smithi194.stdout:8/989: mkdir d2/d14/d18/d45/d4e/dbe/d15a 0 2024-02-20T08:06:22.482 INFO:tasks.workunit.client.1.smithi194.stdout:4/994: symlink d0/d5c/d60/d125/l139 0 2024-02-20T08:06:22.484 INFO:tasks.workunit.client.1.smithi194.stdout:4/995: write d0/d5c/fc6 [904248,74716] 0 2024-02-20T08:06:22.487 INFO:tasks.workunit.client.1.smithi194.stdout:8/990: dwrite d2/d14/d18/d45/d4e/d9f/ff7 [0,4194304] 0 2024-02-20T08:06:22.490 INFO:tasks.workunit.client.1.smithi194.stdout:4/996: truncate d0/d10/d1c/d21/d46/f86 32982 0 2024-02-20T08:06:22.491 INFO:tasks.workunit.client.1.smithi194.stdout:4/997: fsync d0/df/d11/dbb/fe9 0 2024-02-20T08:06:22.492 INFO:tasks.workunit.client.1.smithi194.stdout:4/998: fsync d0/df/d41/d69/f9b 0 2024-02-20T08:06:22.493 INFO:tasks.workunit.client.1.smithi194.stdout:1/977: write d2/d8/d12/dc9/d26/d57/f5f [664169,12031] 0 2024-02-20T08:06:22.494 INFO:tasks.workunit.client.1.smithi194.stdout:1/978: truncate d2/d48/f122 392242 0 2024-02-20T08:06:22.499 INFO:tasks.workunit.client.1.smithi194.stdout:0/942: sync 2024-02-20T08:06:22.503 INFO:tasks.workunit.client.1.smithi194.stdout:4/999: rename d0/f7f to d0/d10/f13a 0 2024-02-20T08:06:22.506 INFO:tasks.workunit.client.1.smithi194.stdout:1/979: link d2/d8/df/d12d/d71/d8c/d115/d7d/l12f d2/d8/d60/d75/l14b 0 2024-02-20T08:06:22.508 INFO:tasks.workunit.client.1.smithi194.stdout:1/980: write d2/d8/df/d12d/d71/d8c/d115/d68/f89 [2065999,39108] 0 2024-02-20T08:06:22.511 INFO:tasks.workunit.client.1.smithi194.stdout:8/991: truncate d2/d14/d18/d45/d4e/dbe/f107 128488 0 2024-02-20T08:06:22.512 INFO:tasks.workunit.client.1.smithi194.stdout:8/992: chown d2/d14/d18/d45/d90/c127 222 1 2024-02-20T08:06:22.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/981: creat d2/d8/d12/dc9/d26/f14c x:0 0 0 2024-02-20T08:06:22.517 INFO:tasks.workunit.client.1.smithi194.stdout:1/982: rename d2/d8/d12/dc9/d26/lbd to d2/d8/d12/l14d 0 2024-02-20T08:06:22.518 INFO:tasks.workunit.client.1.smithi194.stdout:8/993: dwrite d2/d14/d18/d45/d4e/d9f/ffc [4194304,4194304] 0 2024-02-20T08:06:22.518 INFO:tasks.workunit.client.1.smithi194.stdout:0/943: write d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/f89 [437472,57416] 0 2024-02-20T08:06:22.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/983: dwrite d2/d8/d12/dc9/fc1 [0,4194304] 0 2024-02-20T08:06:22.527 INFO:tasks.workunit.client.1.smithi194.stdout:8/994: link d2/d14/d18/d45/d69/leb d2/d80/dd1/d10c/l15b 0 2024-02-20T08:06:22.529 INFO:tasks.workunit.client.1.smithi194.stdout:1/984: fdatasync d2/d8/df/f33 0 2024-02-20T08:06:22.529 INFO:tasks.workunit.client.1.smithi194.stdout:8/995: truncate d2/db5/ff8 106993 0 2024-02-20T08:06:22.535 INFO:tasks.workunit.client.1.smithi194.stdout:8/996: creat d2/d80/dd1/f15c x:0 0 0 2024-02-20T08:06:22.548 INFO:tasks.workunit.client.1.smithi194.stdout:0/944: write d6/d2b/d35/f53 [3062195,112464] 0 2024-02-20T08:06:22.548 INFO:tasks.workunit.client.1.smithi194.stdout:0/945: stat d6/d2b/d35/d42/d1e/d45/c103 0 2024-02-20T08:06:22.551 INFO:tasks.workunit.client.1.smithi194.stdout:8/997: truncate d2/d14/d18/d45/d7b/dc7/d78/dbc/fe3 3054470 0 2024-02-20T08:06:22.553 INFO:tasks.workunit.client.1.smithi194.stdout:8/998: chown d2/d14/c72 26061 1 2024-02-20T08:06:22.556 INFO:tasks.workunit.client.1.smithi194.stdout:0/946: dwrite d6/d2b/f50 [0,4194304] 0 2024-02-20T08:06:22.560 INFO:tasks.workunit.client.1.smithi194.stdout:8/999: creat d2/d14/d18/d45/d7b/dc0/df3/f15d x:0 0 0 2024-02-20T08:06:22.561 INFO:tasks.workunit.client.1.smithi194.stdout:0/947: mkdir d6/d2b/d35/d42/d1e/d45/daa/d129 0 2024-02-20T08:06:22.563 INFO:tasks.workunit.client.1.smithi194.stdout:0/948: mknod d6/d2b/d35/d42/d1e/d45/d58/c12a 0 2024-02-20T08:06:22.635 INFO:tasks.workunit.client.1.smithi194.stdout:1/985: sync 2024-02-20T08:06:22.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:22 smithi194 ceph-mon[37804]: pgmap v60: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 153 MiB/s wr, 351 op/s 2024-02-20T08:06:22.670 INFO:tasks.workunit.client.1.smithi194.stdout:0/949: creat d6/d2b/d35/d42/d1e/d45/daa/d77/f12b x:0 0 0 2024-02-20T08:06:22.671 INFO:tasks.workunit.client.1.smithi194.stdout:1/986: creat d2/d8/df/d12d/de1/d110/f14e x:0 0 0 2024-02-20T08:06:22.673 INFO:tasks.workunit.client.1.smithi194.stdout:0/950: creat d6/d2b/d35/d42/f12c x:0 0 0 2024-02-20T08:06:22.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/987: creat d2/d8/df/d12d/de1/d110/f14f x:0 0 0 2024-02-20T08:06:22.678 INFO:tasks.workunit.client.1.smithi194.stdout:1/988: rename d2/d8/f134 to d2/d8/df/d12d/d71/d8c/d115/d7d/f150 0 2024-02-20T08:06:22.678 INFO:tasks.workunit.client.1.smithi194.stdout:1/989: chown d2/d8/d12/dc9/d26 7971 1 2024-02-20T08:06:22.684 INFO:tasks.workunit.client.1.smithi194.stdout:1/990: dwrite d2/d8/df/d12d/de1/d110/f114 [0,4194304] 0 2024-02-20T08:06:22.684 INFO:tasks.workunit.client.1.smithi194.stdout:0/951: getdents d6/d2b/d35/d42/d1e/d3c 0 2024-02-20T08:06:22.687 INFO:tasks.workunit.client.1.smithi194.stdout:0/952: symlink d6/d2b/d35/d9c/d9f/l12d 0 2024-02-20T08:06:22.693 INFO:tasks.workunit.client.1.smithi194.stdout:1/991: dwrite d2/d48/fd9 [0,4194304] 0 2024-02-20T08:06:22.694 INFO:tasks.workunit.client.1.smithi194.stdout:0/953: mknod d6/d2b/d35/d9c/d62/dc1/c12e 0 2024-02-20T08:06:22.702 INFO:tasks.workunit.client.1.smithi194.stdout:0/954: symlink d6/d2b/d35/d48/d60/l12f 0 2024-02-20T08:06:22.702 INFO:tasks.workunit.client.1.smithi194.stdout:1/992: dwrite d2/d48/f122 [0,4194304] 0 2024-02-20T08:06:22.711 INFO:tasks.workunit.client.1.smithi194.stdout:1/993: chown d2/d8/df/d12d/d71/d8c/d115/d9f/lb1 6428 1 2024-02-20T08:06:22.711 INFO:tasks.workunit.client.1.smithi194.stdout:0/955: getdents d6/d2b/d35/d39/d55/d11d 0 2024-02-20T08:06:22.714 INFO:tasks.workunit.client.1.smithi194.stdout:0/956: rmdir d6/d2b/d35/d39/df0 39 2024-02-20T08:06:22.714 INFO:tasks.workunit.client.1.smithi194.stdout:1/994: readlink d2/d8/d12/dc9/d26/d45/d98/dc6/l138 0 2024-02-20T08:06:22.716 INFO:tasks.workunit.client.1.smithi194.stdout:0/957: mknod d6/d2b/d35/d42/d1e/dfe/c130 0 2024-02-20T08:06:22.718 INFO:tasks.workunit.client.1.smithi194.stdout:1/995: truncate d2/d8/d12/dc9/d26/d45/d98/fff 232563 0 2024-02-20T08:06:22.718 INFO:tasks.workunit.client.1.smithi194.stdout:0/958: read d6/d2b/d35/d39/d8f/fcd [179344,95888] 0 2024-02-20T08:06:22.719 INFO:tasks.workunit.client.1.smithi194.stdout:1/996: chown d2/d8/df/c63 466 1 2024-02-20T08:06:22.720 INFO:tasks.workunit.client.1.smithi194.stdout:1/997: rmdir d2/d8/df/d12d/d71 39 2024-02-20T08:06:22.721 INFO:tasks.workunit.client.1.smithi194.stdout:0/959: symlink d6/d2b/d35/d39/df0/l131 0 2024-02-20T08:06:22.722 INFO:tasks.workunit.client.1.smithi194.stdout:1/998: dread - d2/d8/df/d12d/d71/d8c/d115/d7e/f102 zero size 2024-02-20T08:06:22.730 INFO:tasks.workunit.client.1.smithi194.stdout:1/999: rename d2/d8/d12/dc9/d26 to d2/d8/d12/d151 0 2024-02-20T08:06:22.730 INFO:tasks.workunit.client.1.smithi194.stdout:0/960: link d6/d2b/d35/d39/df0/l131 d6/d2b/d35/d9c/d9f/da6/l132 0 2024-02-20T08:06:22.732 INFO:tasks.workunit.client.1.smithi194.stdout:0/961: mknod d6/d2b/d35/d42/d1e/d3c/da0/c133 0 2024-02-20T08:06:22.734 INFO:tasks.workunit.client.1.smithi194.stdout:0/962: mkdir d6/d2b/d35/d42/d134 0 2024-02-20T08:06:22.735 INFO:tasks.workunit.client.1.smithi194.stdout:0/963: dread - d6/f88 zero size 2024-02-20T08:06:22.736 INFO:tasks.workunit.client.1.smithi194.stdout:0/964: read d6/d2b/d35/d48/ff5 [133944,121902] 0 2024-02-20T08:06:22.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/965: mkdir d6/d2b/d35/d48/d135 0 2024-02-20T08:06:22.745 INFO:tasks.workunit.client.1.smithi194.stdout:0/966: dwrite d6/f1a [0,4194304] 0 2024-02-20T08:06:22.745 INFO:tasks.workunit.client.1.smithi194.stdout:0/967: stat d6/d2b/d35/f38 0 2024-02-20T08:06:22.752 INFO:tasks.workunit.client.1.smithi194.stdout:0/968: getdents d6/d2b/d35/d42/d1e/da2 0 2024-02-20T08:06:22.755 INFO:tasks.workunit.client.1.smithi194.stdout:0/969: rename d6/d2b/d35/f73 to d6/d2b/d35/da3/f136 0 2024-02-20T08:06:22.757 INFO:tasks.workunit.client.1.smithi194.stdout:0/970: fsync d6/d2b/d35/d39/d8f/fcb 0 2024-02-20T08:06:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:22 smithi123 ceph-mon[29383]: pgmap v60: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 153 MiB/s wr, 351 op/s 2024-02-20T08:06:22.759 INFO:tasks.workunit.client.1.smithi194.stdout:0/971: mknod d6/d2b/d35/da3/c137 0 2024-02-20T08:06:22.770 INFO:tasks.workunit.client.1.smithi194.stdout:0/972: dwrite d6/d2b/d35/d42/d1e/d3c/f8a [0,4194304] 0 2024-02-20T08:06:22.779 INFO:tasks.workunit.client.1.smithi194.stdout:0/973: dwrite d6/d2b/d35/d42/d1e/da2/f10c [0,4194304] 0 2024-02-20T08:06:22.788 INFO:tasks.workunit.client.1.smithi194.stdout:0/974: getdents d6/d2b/d35/d39/df0 0 2024-02-20T08:06:22.788 INFO:tasks.workunit.client.1.smithi194.stdout:0/975: stat d6/d2b/d35/d9c/d62/dd9/l119 0 2024-02-20T08:06:22.795 INFO:tasks.workunit.client.1.smithi194.stdout:0/976: dread d6/d2b/d35/d42/d1e/d45/d58/fb6 [0,4194304] 0 2024-02-20T08:06:22.798 INFO:tasks.workunit.client.1.smithi194.stdout:0/977: creat d6/d2b/d35/d42/d1e/d45/daa/d77/f138 x:0 0 0 2024-02-20T08:06:22.802 INFO:tasks.workunit.client.1.smithi194.stdout:0/978: dwrite d6/d2b/d35/d39/fc2 [0,4194304] 0 2024-02-20T08:06:22.803 INFO:tasks.workunit.client.1.smithi194.stdout:0/979: dread - d6/d2b/d35/d48/d60/f108 zero size 2024-02-20T08:06:22.805 INFO:tasks.workunit.client.1.smithi194.stdout:0/980: write d6/d2b/d35/d9c/d9f/f10e [108636,65706] 0 2024-02-20T08:06:22.809 INFO:tasks.workunit.client.1.smithi194.stdout:0/981: getdents d6/d2b/d35/d9c/d62 0 2024-02-20T08:06:22.811 INFO:tasks.workunit.client.1.smithi194.stdout:0/982: truncate d6/d2b/d35/d42/d1e/d45/daa/d77/d9d/f123 492203 0 2024-02-20T08:06:22.813 INFO:tasks.workunit.client.1.smithi194.stdout:0/983: fdatasync d6/d2b/d35/d48/ff5 0 2024-02-20T08:06:22.815 INFO:tasks.workunit.client.1.smithi194.stdout:0/984: creat d6/d2b/d35/d9c/d9f/da6/f139 x:0 0 0 2024-02-20T08:06:22.826 INFO:tasks.workunit.client.1.smithi194.stdout:0/985: write d6/fee [302680,10425] 0 2024-02-20T08:06:22.828 INFO:tasks.workunit.client.1.smithi194.stdout:0/986: truncate d6/f88 326737 0 2024-02-20T08:06:22.834 INFO:tasks.workunit.client.1.smithi194.stdout:0/987: link d6/d2b/d35/d42/d1e/d3c/l5c d6/d2b/d35/d42/d1e/d45/daa/d77/d7f/l13a 0 2024-02-20T08:06:22.835 INFO:tasks.workunit.client.1.smithi194.stdout:0/988: fsync d6/d2b/d35/d42/d1e/d45/d58/f8d 0 2024-02-20T08:06:22.848 INFO:tasks.workunit.client.1.smithi194.stdout:0/989: dread d6/f90 [4194304,4194304] 0 2024-02-20T08:06:22.850 INFO:tasks.workunit.client.1.smithi194.stdout:0/990: unlink d6/d2b/d35/d42/cca 0 2024-02-20T08:06:22.870 INFO:tasks.workunit.client.1.smithi194.stdout:0/991: rename d6/d2b/d35/d42/d1e/d45/daa/d77/f12b to d6/d2b/d35/d39/d55/f13b 0 2024-02-20T08:06:22.875 INFO:tasks.workunit.client.1.smithi194.stdout:0/992: creat d6/d2b/d35/d39/d8f/f13c x:0 0 0 2024-02-20T08:06:22.875 INFO:tasks.workunit.client.1.smithi194.stdout:0/993: stat d6/d2b/d35/d42/d1e/d45/d58/fb6 0 2024-02-20T08:06:22.881 INFO:tasks.workunit.client.1.smithi194.stdout:0/994: dwrite d6/d2b/d35/d42/d1e/d45/f70 [0,4194304] 0 2024-02-20T08:06:22.890 INFO:tasks.workunit.client.1.smithi194.stdout:0/995: truncate d6/d2b/f50 4155826 0 2024-02-20T08:06:22.892 INFO:tasks.workunit.client.1.smithi194.stdout:0/996: creat d6/d2b/d35/d42/d1e/d45/f13d x:0 0 0 2024-02-20T08:06:22.895 INFO:tasks.workunit.client.1.smithi194.stdout:0/997: creat d6/d2b/d35/d42/d1e/d45/df8/f13e x:0 0 0 2024-02-20T08:06:22.908 INFO:tasks.workunit.client.1.smithi194.stdout:0/998: dread d6/d2b/d35/d42/d1e/d45/d58/f87 [0,4194304] 0 2024-02-20T08:06:22.909 INFO:tasks.workunit.client.1.smithi194.stdout:0/999: write d6/d2b/d35/d39/d8f/f13c [222302,2493] 0 2024-02-20T08:06:22.912 INFO:tasks.workunit.client.1.smithi194.stderr:+ rm -rf -- ./tmp.AvWxpkCAlz 2024-02-20T08:06:24.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:24 smithi194 ceph-mon[37804]: pgmap v61: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 96 MiB/s rd, 224 MiB/s wr, 512 op/s 2024-02-20T08:06:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:24 smithi123 ceph-mon[29383]: pgmap v61: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 96 MiB/s rd, 224 MiB/s wr, 512 op/s 2024-02-20T08:06:26.216 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:25 smithi123 ceph-mon[29383]: pgmap v62: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 149 MiB/s wr, 339 op/s 2024-02-20T08:06:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:25 smithi194 ceph-mon[37804]: pgmap v62: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 149 MiB/s wr, 339 op/s 2024-02-20T08:06:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:28 smithi194 ceph-mon[37804]: pgmap v63: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 149 MiB/s wr, 339 op/s 2024-02-20T08:06:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:28 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:28.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:28 smithi123 ceph-mon[29383]: pgmap v63: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 149 MiB/s wr, 339 op/s 2024-02-20T08:06:28.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:28 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:30.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: pgmap v64: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 150 MiB/s wr, 398 op/s 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: osdmap e49: 6 total, 6 up, 6 in 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd='[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]': finished 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: mgrmap e27: smithi123.kwyrtl(active, starting, since 0.00762767s) 2024-02-20T08:06:30.537 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:06:30.538 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:06:30.539 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:06:30.539 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:06:30.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: pgmap v64: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 150 MiB/s wr, 398 op/s 2024-02-20T08:06:30.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 172.21.15.194:0/482779459' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: osdmap e49: 6 total, 6 up, 6 in 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.24375 ' entity='mgr.smithi194.pvhorj' cmd='[{"prefix": "mgr fail", "who": "smithi194.pvhorj"}]': finished 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: mgrmap e27: smithi123.kwyrtl(active, starting, since 0.00762767s) 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:06:30.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:06:30.541 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:06:31.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:31 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T08:06:31.735 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T08:06:31.736 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:31.736 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:06:31.736 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:31.736 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:06:31.736 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:31 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T08:06:32.569 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:32 smithi194 ceph-mon[37804]: mgrmap e28: smithi123.kwyrtl(active, since 1.05446s) 2024-02-20T08:06:32.569 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:32 smithi194 ceph-mon[37804]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:32.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:32 smithi123 ceph-mon[29383]: mgrmap e28: smithi123.kwyrtl(active, since 1.05446s) 2024-02-20T08:06:32.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:32 smithi123 ceph-mon[29383]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:33.572 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:33 smithi194 ceph-mon[37804]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:33.572 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:33 smithi194 ceph-mon[37804]: mgrmap e29: smithi123.kwyrtl(active, since 2s) 2024-02-20T08:06:33.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:33 smithi123 ceph-mon[29383]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:33.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:33 smithi123 ceph-mon[29383]: mgrmap e29: smithi123.kwyrtl(active, since 2s) 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: [20/Feb/2024:08:06:32] ENGINE Bus STARTING 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: [20/Feb/2024:08:06:32] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: [20/Feb/2024:08:06:32] ENGINE Serving on http://172.21.15.123:8765 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: [20/Feb/2024:08:06:32] ENGINE Bus STARTED 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:34.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: [20/Feb/2024:08:06:32] ENGINE Bus STARTING 2024-02-20T08:06:34.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: [20/Feb/2024:08:06:32] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T08:06:34.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: [20/Feb/2024:08:06:32] ENGINE Serving on http://172.21.15.123:8765 2024-02-20T08:06:34.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: [20/Feb/2024:08:06:32] ENGINE Bus STARTED 2024-02-20T08:06:34.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:34.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:35.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:35 smithi194 ceph-mon[37804]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:35.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:35 smithi194 ceph-mon[37804]: mgrmap e30: smithi123.kwyrtl(active, since 4s) 2024-02-20T08:06:35.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:35 smithi123 ceph-mon[29383]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:35.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:35 smithi123 ceph-mon[29383]: mgrmap e30: smithi123.kwyrtl(active, since 4s) 2024-02-20T08:06:36.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:36 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:36.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:36 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:36.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:36 smithi194 ceph-mon[37804]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:36.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:36 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:36.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:36 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:36.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:36 smithi123 ceph-mon[29383]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:06:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:06:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:38 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:06:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:06:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:06:38.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:06:38.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:06:38.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:38 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/82535642' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:06:39.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:39 smithi123 ceph-mon[29383]: pgmap v7: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-02-20T08:06:39.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:39 smithi123 ceph-mon[29383]: mgrmap e31: smithi123.kwyrtl(active, since 8s), standbys: smithi194.pvhorj 2024-02-20T08:06:39.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:39.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:39.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:39 smithi194 ceph-mon[37804]: pgmap v7: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-02-20T08:06:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:39 smithi194 ceph-mon[37804]: mgrmap e31: smithi123.kwyrtl(active, since 8s), standbys: smithi194.pvhorj 2024-02-20T08:06:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:06:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:41.195 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:40 smithi123 ceph-mon[29383]: pgmap v8: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 41 KiB/s rd, 1.0 MiB/s wr, 88 op/s 2024-02-20T08:06:41.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:40 smithi194 ceph-mon[37804]: pgmap v8: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 41 KiB/s rd, 1.0 MiB/s wr, 88 op/s 2024-02-20T08:06:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:43 smithi123 ceph-mon[29383]: pgmap v9: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 KiB/s rd, 1.5 MiB/s wr, 140 op/s 2024-02-20T08:06:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:06:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:43 smithi194 ceph-mon[37804]: pgmap v9: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 KiB/s rd, 1.5 MiB/s wr, 140 op/s 2024-02-20T08:06:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:06:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:06:44.288 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-20T08:06:44.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-20T08:06:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 -- 172.21.15.123:0/4064509797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fcfb0 msgr2=0x7f738c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 --2- 172.21.15.123:0/4064509797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fcfb0 0x7f738c0fd420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f737c004940 tx=0x7f737c009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 -- 172.21.15.123:0/4064509797 shutdown_connections 2024-02-20T08:06:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 --2- 172.21.15.123:0/4064509797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fcfb0 0x7f738c0fd420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 --2- 172.21.15.123:0/4064509797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fbe40 0x7f738c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.527+0000 7f7391dec700 1 -- 172.21.15.123:0/4064509797 >> 172.21.15.123:0/4064509797 conn(0x7f738c0f74e0 msgr2=0x7f738c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.528+0000 7f7391dec700 1 -- 172.21.15.123:0/4064509797 shutdown_connections 2024-02-20T08:06:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.528+0000 7f7391dec700 1 -- 172.21.15.123:0/4064509797 wait complete. 2024-02-20T08:06:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.528+0000 7f7391dec700 1 Processor -- start 2024-02-20T08:06:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f7391dec700 1 -- start start 2024-02-20T08:06:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f7391dec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 0x7f738c10f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f7391dec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 0x7f738c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f7391dec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c110420 con 0x7f738c0fbe40 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f7391dec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c110cc0 con 0x7f738c0fcfb0 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 0x7f738c10f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 0x7f738c10f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57966/0 (socket says 172.21.15.123:57966) 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738b7fe700 1 -- 172.21.15.123:0/3975674653 learned_addr learned my addr 172.21.15.123:0/3975674653 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738affd700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 0x7f738c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738affd700 1 -- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 msgr2=0x7f738c10f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738affd700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 0x7f738c10f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.529+0000 7f738affd700 1 -- 172.21.15.123:0/3975674653 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374005040 con 0x7f738c0fcfb0 2024-02-20T08:06:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f738affd700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 0x7f738c10fe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c004890 tx=0x7f737c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737c00e030 con 0x7f738c0fcfb0 2024-02-20T08:06:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f737c013d00 con 0x7f738c0fcfb0 2024-02-20T08:06:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c005040 con 0x7f738c0fcfb0 2024-02-20T08:06:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c1112f0 con 0x7f738c0fcfb0 2024-02-20T08:06:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.530+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737c00b650 con 0x7f738c0fcfb0 2024-02-20T08:06:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.531+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c1019d0 con 0x7f738c0fcfb0 2024-02-20T08:06:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.532+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f737c01c400 con 0x7f738c0fcfb0 2024-02-20T08:06:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.532+0000 7f7383fff700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 0x7f737806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.533+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f737c08e330 con 0x7f738c0fcfb0 2024-02-20T08:06:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.533+0000 7f738b7fe700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 0x7f737806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.533+0000 7f738b7fe700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 0x7f737806f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73740044e0 tx=0x7f737400b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.537+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f737c05bd60 con 0x7f738c0fcfb0 2024-02-20T08:06:44.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:44 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:06:44.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:44 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:06:44.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:44 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:06:44.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:44 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:06:44.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.876+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f738c1115d0 con 0x7f737806d200 2024-02-20T08:06:44.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.877+0000 7f7383fff700 1 -- 172.21.15.123:0/3975674653 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f738c1115d0 con 0x7f737806d200 2024-02-20T08:06:44.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 msgr2=0x7f737806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 0x7f737806f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73740044e0 tx=0x7f737400b040 comp rx=0 tx=0).stop 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 msgr2=0x7f738c10fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 0x7f738c10fe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c004890 tx=0x7f737c009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 shutdown_connections 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f737806d200 0x7f737806f6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f738c0fbe40 0x7f738c10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 --2- 172.21.15.123:0/3975674653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f738c0fcfb0 0x7f738c10fe20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 >> 172.21.15.123:0/3975674653 conn(0x7f738c0f74e0 msgr2=0x7f738c0f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 shutdown_connections 2024-02-20T08:06:44.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:44.880+0000 7f7391dec700 1 -- 172.21.15.123:0/3975674653 wait complete. 2024-02-20T08:06:44.895 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:06:45.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 -- 172.21.15.123:0/3177393756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 msgr2=0x7fd6d00fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/3177393756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d00fe700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc004940 tx=0x7fd6bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:45.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 -- 172.21.15.123:0/3177393756 shutdown_connections 2024-02-20T08:06:45.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/3177393756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d00fe700 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/3177393756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 0x7fd6d00fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.017+0000 7fd6d71ba700 1 -- 172.21.15.123:0/3177393756 >> 172.21.15.123:0/3177393756 conn(0x7fd6d00f6ca0 msgr2=0x7fd6d00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.018+0000 7fd6d71ba700 1 -- 172.21.15.123:0/3177393756 shutdown_connections 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.018+0000 7fd6d71ba700 1 -- 172.21.15.123:0/3177393756 wait complete. 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.018+0000 7fd6d71ba700 1 Processor -- start 2024-02-20T08:06:45.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.018+0000 7fd6d71ba700 1 -- start start 2024-02-20T08:06:45.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6d71ba700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 0x7fd6d010b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6d71ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6d71ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d010c270 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6d71ba700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d010cb10 con 0x7fd6d00fb220 2024-02-20T08:06:45.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57978/0 (socket says 172.21.15.123:57978) 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 -- 172.21.15.123:0/1022311366 learned_addr learned my addr 172.21.15.123:0/1022311366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6d4f56700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 0x7fd6d010b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 -- 172.21.15.123:0/1022311366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 msgr2=0x7fd6d010b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 0x7fd6d010b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.019+0000 7fd6cffff700 1 -- 172.21.15.123:0/1022311366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc005040 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.020+0000 7fd6cffff700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009b30 tx=0x7fd6bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.020+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc021070 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.020+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6bc01c400 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.020+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d010cd90 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.021+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc00e070 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.021+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d010d2d0 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.022+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fd6bc00b760 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.022+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d004bed0 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.022+0000 7fd6cd7fa700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 0x7fd6c006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.023+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd6bc08d7d0 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.023+0000 7fd6d4f56700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 0x7fd6c006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.023+0000 7fd6d4f56700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 0x7fd6c006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6d010b470 tx=0x7fd6c400b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.030+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd6bc057980 con 0x7fd6d00fe2b0 2024-02-20T08:06:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.458+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d010d6e0 con 0x7fd6c006d200 2024-02-20T08:06:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.459+0000 7fd6cd7fa700 1 -- 172.21.15.123:0/1022311366 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fd6d010d6e0 con 0x7fd6c006d200 2024-02-20T08:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 msgr2=0x7fd6c006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 0x7fd6c006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6d010b470 tx=0x7fd6c400b040 comp rx=0 tx=0).stop 2024-02-20T08:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 msgr2=0x7fd6d010bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009b30 tx=0x7fd6bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 shutdown_connections 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd6c006d200 0x7fd6c006f6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00fb220 0x7fd6d010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 --2- 172.21.15.123:0/1022311366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00fe2b0 0x7fd6d010bc20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 >> 172.21.15.123:0/1022311366 conn(0x7fd6d00f6ca0 msgr2=0x7fd6d00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 shutdown_connections 2024-02-20T08:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.462+0000 7fd6d71ba700 1 -- 172.21.15.123:0/1022311366 wait complete. 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: pgmap v10: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.597 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.597 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.597 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 -- 172.21.15.123:0/824810261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 msgr2=0x7f48900ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 --2- 172.21.15.123:0/824810261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f48900ffad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4880004940 tx=0x7f4880009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 -- 172.21.15.123:0/824810261 shutdown_connections 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 --2- 172.21.15.123:0/824810261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 0x7f4890102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 --2- 172.21.15.123:0/824810261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f48900ffad0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 -- 172.21.15.123:0/824810261 >> 172.21.15.123:0/824810261 conn(0x7f48900f74e0 msgr2=0x7f48900f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 -- 172.21.15.123:0/824810261 shutdown_connections 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.604+0000 7f4894e6d700 1 -- 172.21.15.123:0/824810261 wait complete. 2024-02-20T08:06:45.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 Processor -- start 2024-02-20T08:06:45.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 -- start start 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 0x7f489010de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489010e420 con 0x7f4890066400 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f4894e6d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489010ecc0 con 0x7f48901000a0 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f488e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f488e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57988/0 (socket says 172.21.15.123:57988) 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f488e59c700 1 -- 172.21.15.123:0/1457270851 learned_addr learned my addr 172.21.15.123:0/1457270851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.605+0000 7f488dd9b700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 0x7f489010de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f488e59c700 1 -- 172.21.15.123:0/1457270851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 msgr2=0x7f489010de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f488e59c700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 0x7f489010de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f488e59c700 1 -- 172.21.15.123:0/1457270851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880005040 con 0x7f4890066400 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f488e59c700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4880000c00 tx=0x7f4880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4880021070 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f488001c400 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489010ef40 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488000e070 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.606+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489010f420 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.607+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4890107a50 con 0x7f4890066400 2024-02-20T08:06:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.608+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f488001ca50 con 0x7f4890066400 2024-02-20T08:06:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.609+0000 7f487effd700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 0x7f4878073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.609+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f488008d960 con 0x7f4890066400 2024-02-20T08:06:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.609+0000 7f488dd9b700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 0x7f4878073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.609+0000 7f488dd9b700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 0x7f4878073ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4884009b80 tx=0x7f488400b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:45.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.616+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f488005b390 con 0x7f4890066400 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: pgmap v10: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:06:45.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.917+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f489002b3b0 con 0x7f4878071610 2024-02-20T08:06:45.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.929+0000 7f487effd700 1 -- 172.21.15.123:0/1457270851 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f489002b3b0 con 0x7f4878071610 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (107s) 8s ago 10m 25.7M - 0.25.0 c8568f914cd2 a5c1c8e46fd5 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (10m) 8s ago 10m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (9m) 11s ago 9m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (63s) 8s ago 9m 74.5M - 9.4.7 954c08fa6188 4b8d379a3806 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (4m) 8s ago 4m 12.3M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (4m) 8s ago 4m 239M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (4m) 11s ago 4m 15.4M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (4m) 11s ago 4m 13.0M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (40s) 8s ago 11m 473M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283 running (2m) 11s ago 9m 80.2M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 915e6082ff57 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (11m) 8s ago 11m 54.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (8m) 11s ago 8m 44.8M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:06:45.930 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (114s) 8s ago 10m 15.8M - 1.5.0 0da6a335fe13 1dba37793143 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (47s) 11s ago 9m 14.3M - 1.5.0 0da6a335fe13 cabdaa08f7d8 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (8m) 8s ago 8m 164M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (7m) 8s ago 7m 170M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (7m) 8s ago 7m 148M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (6m) 11s ago 6m 208M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (6m) 11s ago 6m 184M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (5m) 11s ago 5m 195M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:06:45.931 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (50s) 8s ago 9m 42.5M - 2.43.0 a07b618ecd1d 4686fac5a0d4 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.932+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 msgr2=0x7f4878073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.932+0000 7f4894e6d700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 0x7f4878073ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4884009b80 tx=0x7f488400b040 comp rx=0 tx=0).stop 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.932+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 msgr2=0x7f489010d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.932+0000 7f4894e6d700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4880000c00 tx=0x7f4880009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.932+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 shutdown_connections 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4878071610 0x7f4878073ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4890066400 0x7f489010d8e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 --2- 172.21.15.123:0/1457270851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48901000a0 0x7f489010de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:45.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 >> 172.21.15.123:0/1457270851 conn(0x7f48900f74e0 msgr2=0x7f48900f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:45.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 shutdown_connections 2024-02-20T08:06:45.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:45.933+0000 7f4894e6d700 1 -- 172.21.15.123:0/1457270851 wait complete. 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/4001078783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f41000c0 msgr2=0x7fa2f4102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/4001078783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f41000c0 0x7fa2f4102520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8004940 tx=0x7fa2e8009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/4001078783 shutdown_connections 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/4001078783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f41000c0 0x7fa2f4102520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/4001078783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f40663e0 0x7fa2f40ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/4001078783 >> 172.21.15.123:0/4001078783 conn(0x7fa2f40f74e0 msgr2=0x7fa2f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/4001078783 shutdown_connections 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.055+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/4001078783 wait complete. 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 Processor -- start 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 -- start start 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41000c0 0x7fa2f40fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40fbff0 con 0x7fa2f40663e0 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f8bbc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40fc160 con 0x7fa2f41000c0 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57994/0 (socket says 172.21.15.123:57994) 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 -- 172.21.15.123:0/1861312730 learned_addr learned my addr 172.21.15.123:0/1861312730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f1d9b700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41000c0 0x7fa2f40fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 -- 172.21.15.123:0/1861312730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41000c0 msgr2=0x7fa2f40fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41000c0 0x7fa2f40fb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.056+0000 7fa2f259c700 1 -- 172.21.15.123:0/1861312730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8005040 con 0x7fa2f40663e0 2024-02-20T08:06:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2f259c700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4002a80 tx=0x7fa2e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e4007cc0 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f40fc440 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2e400f040 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e400dac0 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.057+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f4115890 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.058+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f404bed0 con 0x7fa2f40663e0 2024-02-20T08:06:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.059+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fa2e400dc20 con 0x7fa2f40663e0 2024-02-20T08:06:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.059+0000 7fa2e2ffd700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 0x7fa2dc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.059+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa2e408c420 con 0x7fa2f40663e0 2024-02-20T08:06:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.059+0000 7fa2f1d9b700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 0x7fa2dc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.060+0000 7fa2f1d9b700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 0x7fa2dc06f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8004890 tx=0x7fa2e8009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.064+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa2e4059dd0 con 0x7fa2f40663e0 2024-02-20T08:06:46.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:46 smithi123 ceph-mon[29383]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T08:06:46.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:46 smithi123 ceph-mon[29383]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T08:06:46.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:46 smithi123 ceph-mon[29383]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:46.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:46 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.512+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2f4115c60 con 0x7fa2f40663e0 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.513+0000 7fa2e2ffd700 1 -- 172.21.15.123:0/1861312730 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa2e4059960 con 0x7fa2f40663e0 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 12, 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:06:46.514 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 msgr2=0x7fa2dc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 0x7fa2dc06f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8004890 tx=0x7fa2e8009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 msgr2=0x7fa2f40fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4002a80 tx=0x7fa2e40046b0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 shutdown_connections 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa2dc06d200 0x7fa2dc06f6b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f40663e0 0x7fa2f40fd570 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 --2- 172.21.15.123:0/1861312730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41000c0 0x7fa2f40fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 >> 172.21.15.123:0/1861312730 conn(0x7fa2f40f74e0 msgr2=0x7fa2f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 shutdown_connections 2024-02-20T08:06:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.515+0000 7fa2f8bbc700 1 -- 172.21.15.123:0/1861312730 wait complete. 2024-02-20T08:06:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 -- 172.21.15.123:0/1333202127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 msgr2=0x7f56100fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 --2- 172.21.15.123:0/1333202127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f56100fc250 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5604004940 tx=0x7f5604009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 -- 172.21.15.123:0/1333202127 shutdown_connections 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 --2- 172.21.15.123:0/1333202127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 0x7f56100fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 --2- 172.21.15.123:0/1333202127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f56100fc250 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 -- 172.21.15.123:0/1333202127 >> 172.21.15.123:0/1333202127 conn(0x7f56100f7520 msgr2=0x7f56100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 -- 172.21.15.123:0/1333202127 shutdown_connections 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 -- 172.21.15.123:0/1333202127 wait complete. 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.643+0000 7f5617b9e700 1 Processor -- start 2024-02-20T08:06:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5617b9e700 1 -- start start 2024-02-20T08:06:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:46 smithi194 ceph-mon[37804]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-02-20T08:06:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:46 smithi194 ceph-mon[37804]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-02-20T08:06:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:46 smithi194 ceph-mon[37804]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:46 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:06:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5617b9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5617b9e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 0x7f561010cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5617b9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561010d2e0 con 0x7f56100fbe40 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5617b9e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561010db80 con 0x7f56100fcfb0 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58010/0 (socket says 172.21.15.123:58010) 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 -- 172.21.15.123:0/310234294 learned_addr learned my addr 172.21.15.123:0/310234294 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f5615139700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 0x7f561010cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 -- 172.21.15.123:0/310234294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 msgr2=0x7f561010cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 0x7f561010cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 -- 172.21.15.123:0/310234294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604005040 con 0x7f56100fbe40 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.644+0000 7f561593a700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c00 tx=0x7f5604009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.645+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5604021070 con 0x7f56100fbe40 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.645+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561010de00 con 0x7f56100fbe40 2024-02-20T08:06:46.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.645+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f560401c400 con 0x7f56100fbe40 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.645+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560400e070 con 0x7f56100fbe40 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.645+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561010e2e0 con 0x7f56100fbe40 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.646+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561004bed0 con 0x7f56100fbe40 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.646+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f560401ca50 con 0x7f56100fbe40 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.647+0000 7f56027fc700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 0x7f55fc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.647+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f560408d960 con 0x7f56100fbe40 2024-02-20T08:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.647+0000 7f5615139700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 0x7f55fc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.647+0000 7f5615139700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 0x7f55fc0718c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b80 tx=0x7f560c00b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:06:46.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.654+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f560405b390 con 0x7f56100fbe40 2024-02-20T08:06:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.995+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f561010e700 con 0x7f55fc06f410 2024-02-20T08:06:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.997+0000 7f56027fc700 1 -- 172.21.15.123:0/310234294 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f561010e700 con 0x7f55fc06f410 2024-02-20T08:06:46.997 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:06:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:06:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/2 daemons upgraded", 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:06:46.998 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.999+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 msgr2=0x7f55fc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.999+0000 7f5617b9e700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 0x7f55fc0718c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b80 tx=0x7f560c00b040 comp rx=0 tx=0).stop 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.999+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 msgr2=0x7f561010c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:46.999+0000 7f5617b9e700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c00 tx=0x7f5604009e30 comp rx=0 tx=0).stop 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 shutdown_connections 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f55fc06f410 0x7f55fc0718c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56100fbe40 0x7f561010c7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:47.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 --2- 172.21.15.123:0/310234294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56100fcfb0 0x7f561010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:06:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 >> 172.21.15.123:0/310234294 conn(0x7f56100f7520 msgr2=0x7f5610100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:06:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 shutdown_connections 2024-02-20T08:06:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:06:47.000+0000 7f5617b9e700 1 -- 172.21.15.123:0/310234294 wait complete. 2024-02-20T08:06:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:47 smithi194 ceph-mon[37804]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:47 smithi194 ceph-mon[37804]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:47 smithi194 ceph-mon[37804]: pgmap v11: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-02-20T08:06:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:47 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1861312730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:06:47.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:47 smithi123 ceph-mon[29383]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:47.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:47 smithi123 ceph-mon[29383]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:47.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:47 smithi123 ceph-mon[29383]: pgmap v11: 65 pgs: 65 active+clean; 664 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-02-20T08:06:47.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:47 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1861312730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:06:48.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:48 smithi194 ceph-mon[37804]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:48.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:48 smithi123 ceph-mon[29383]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:06:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:49 smithi194 ceph-mon[37804]: pgmap v12: 65 pgs: 65 active+clean; 289 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 185 op/s 2024-02-20T08:06:49.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:49 smithi123 ceph-mon[29383]: pgmap v12: 65 pgs: 65 active+clean; 289 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 185 op/s 2024-02-20T08:06:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:50 smithi123 ceph-mon[29383]: pgmap v13: 65 pgs: 65 active+clean; 289 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-02-20T08:06:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:50 smithi194 ceph-mon[37804]: pgmap v13: 65 pgs: 65 active+clean; 289 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-02-20T08:06:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:53 smithi123 ceph-mon[29383]: pgmap v14: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 170 op/s 2024-02-20T08:06:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:53 smithi194 ceph-mon[37804]: pgmap v14: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 170 op/s 2024-02-20T08:06:55.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:55 smithi123 ceph-mon[29383]: pgmap v15: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-02-20T08:06:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:55 smithi194 ceph-mon[37804]: pgmap v15: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-02-20T08:06:57.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:57 smithi194 ceph-mon[37804]: pgmap v16: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-02-20T08:06:57.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:57 smithi123 ceph-mon[29383]: pgmap v16: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-02-20T08:06:59.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:06:59 smithi194 ceph-mon[37804]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 158 op/s 2024-02-20T08:06:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:06:59 smithi123 ceph-mon[29383]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 158 op/s 2024-02-20T08:07:01.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:00 smithi123 ceph-mon[29383]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-02-20T08:07:01.237 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:00 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:00 smithi194 ceph-mon[37804]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-02-20T08:07:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:00 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:03 smithi123 ceph-mon[29383]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 143 op/s 2024-02-20T08:07:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:07:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:03 smithi194 ceph-mon[37804]: pgmap v19: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 143 op/s 2024-02-20T08:07:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:07:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:04.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:04 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:07:04.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:04 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:07:05.609 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:05 smithi194 ceph-mon[37804]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-02-20T08:07:05.609 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:05 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:07:05.609 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:05 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:07:05.609 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:05 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:05 smithi123 ceph-mon[29383]: pgmap v20: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-02-20T08:07:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:05 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:07:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:05 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:07:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:05 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:06 smithi194 ceph-mon[37804]: Upgrade: Updating mgr.smithi194.pvhorj 2024-02-20T08:07:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:06 smithi194 ceph-mon[37804]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:07:06.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:06 smithi123 ceph-mon[29383]: Upgrade: Updating mgr.smithi194.pvhorj 2024-02-20T08:07:06.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:06 smithi123 ceph-mon[29383]: Deploying daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:07:07.633 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:07 smithi194 ceph-mon[37804]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-02-20T08:07:07.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:07 smithi123 ceph-mon[29383]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-02-20T08:07:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:09 smithi194 ceph-mon[37804]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-02-20T08:07:09.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:09 smithi123 ceph-mon[29383]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-02-20T08:07:10.595 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:10 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:10.596 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:10 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:10.596 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:10 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:10.653 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:10 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:10.653 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:10 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:10.653 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:10 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:11 smithi194 ceph-mon[37804]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 102 op/s 2024-02-20T08:07:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:11 smithi123 ceph-mon[29383]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 102 op/s 2024-02-20T08:07:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:13 smithi194 ceph-mon[37804]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 151 op/s 2024-02-20T08:07:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:13.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:13 smithi123 ceph-mon[29383]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 151 op/s 2024-02-20T08:07:13.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:13.799 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:15.300 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:15 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:15.300 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:15 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:15.300 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:15 smithi194 ceph-mon[37804]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-20T08:07:15.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:15 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:15.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:15 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:15.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:15 smithi123 ceph-mon[29383]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-20T08:07:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:16 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:16.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:16 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 -- 172.21.15.123:0/2792407843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec80fe5a0 msgr2=0x7feec80fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 --2- 172.21.15.123:0/2792407843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec80fe5a0 0x7feec80fe9b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feeb8004940 tx=0x7feeb8009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 -- 172.21.15.123:0/2792407843 shutdown_connections 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 --2- 172.21.15.123:0/2792407843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fef80 0x7feec80fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 --2- 172.21.15.123:0/2792407843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec80fe5a0 0x7feec80fe9b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 -- 172.21.15.123:0/2792407843 >> 172.21.15.123:0/2792407843 conn(0x7feec80f6ca0 msgr2=0x7feec80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.136+0000 7feecdc1d700 1 -- 172.21.15.123:0/2792407843 shutdown_connections 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.137+0000 7feecdc1d700 1 -- 172.21.15.123:0/2792407843 wait complete. 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.137+0000 7feecdc1d700 1 Processor -- start 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.137+0000 7feecdc1d700 1 -- start start 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feecdc1d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feecdc1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec806f530 0x7feec8117540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feecdc1d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec806f9f0 con 0x7feec806f530 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feecdc1d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec806fb60 con 0x7feec80fe5a0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:37570/0 (socket says 172.21.15.123:37570) 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 -- 172.21.15.123:0/3384161342 learned_addr learned my addr 172.21.15.123:0/3384161342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec6ffd700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec806f530 0x7feec8117540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 -- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec806f530 msgr2=0x7feec8117540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec806f530 0x7feec8117540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 -- 172.21.15.123:0/3384161342 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8005040 con 0x7feec80fe5a0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.138+0000 7feec77fe700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feeb8000c00 tx=0x7feeb8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.139+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb8021070 con 0x7feec80fe5a0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.139+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec8117b40 con 0x7feec80fe5a0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.139+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feeb8013de0 con 0x7feec80fe5a0 2024-02-20T08:07:17.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.139+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb800e070 con 0x7feec80fe5a0 2024-02-20T08:07:17.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.139+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec8118020 con 0x7feec80fe5a0 2024-02-20T08:07:17.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.140+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec804bed0 con 0x7feec80fe5a0 2024-02-20T08:07:17.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.141+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7feeb801c400 con 0x7feec80fe5a0 2024-02-20T08:07:17.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.141+0000 7feeaffff700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 0x7feeb006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.141+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feeb808d8f0 con 0x7feec80fe5a0 2024-02-20T08:07:17.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.142+0000 7feec6ffd700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 0x7feeb006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.143+0000 7feec6ffd700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 0x7feeb006f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feebc009b80 tx=0x7feebc00b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:17.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.146+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7feeb805b320 con 0x7feec80fe5a0 2024-02-20T08:07:17.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:17 smithi194 ceph-mon[37804]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-20T08:07:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.429+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feec80fef80 con 0x7feeb006d200 2024-02-20T08:07:17.429 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:17 smithi123 ceph-mon[29383]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-20T08:07:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.430+0000 7feeaffff700 1 -- 172.21.15.123:0/3384161342 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7feec80fef80 con 0x7feeb006d200 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.432+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 msgr2=0x7feeb006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.432+0000 7feecdc1d700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 0x7feeb006f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feebc009b80 tx=0x7feebc00b040 comp rx=0 tx=0).stop 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.432+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 msgr2=0x7feec806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.432+0000 7feecdc1d700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feeb8000c00 tx=0x7feeb8009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 shutdown_connections 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7feeb006d200 0x7feeb006f6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feec80fe5a0 0x7feec806eff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 --2- 172.21.15.123:0/3384161342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feec806f530 0x7feec8117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 >> 172.21.15.123:0/3384161342 conn(0x7feec80f6ca0 msgr2=0x7feec8101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 shutdown_connections 2024-02-20T08:07:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.433+0000 7feecdc1d700 1 -- 172.21.15.123:0/3384161342 wait complete. 2024-02-20T08:07:17.444 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:07:17.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.595+0000 7f2d1e7fc700 1 -- 172.21.15.123:0/2835418028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d1400bc70 con 0x7f2d2006e560 2024-02-20T08:07:17.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.595+0000 7f2d25b86700 1 -- 172.21.15.123:0/2835418028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 msgr2=0x7f2d2006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.595+0000 7f2d25b86700 1 --2- 172.21.15.123:0/2835418028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d2006e970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2d14004940 tx=0x7f2d14009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:17.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 -- 172.21.15.123:0/2835418028 shutdown_connections 2024-02-20T08:07:17.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 --2- 172.21.15.123:0/2835418028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 0x7f2d20108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 --2- 172.21.15.123:0/2835418028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d2006e970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 -- 172.21.15.123:0/2835418028 >> 172.21.15.123:0/2835418028 conn(0x7f2d20069e70 msgr2=0x7f2d2006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:17.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 -- 172.21.15.123:0/2835418028 shutdown_connections 2024-02-20T08:07:17.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.596+0000 7f2d25b86700 1 -- 172.21.15.123:0/2835418028 wait complete. 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.597+0000 7f2d25b86700 1 Processor -- start 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.597+0000 7f2d25b86700 1 -- start start 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.598+0000 7f2d25b86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.598+0000 7f2d25b86700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 0x7f2d20113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.598+0000 7f2d25b86700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20113710 con 0x7f2d2006e560 2024-02-20T08:07:17.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.598+0000 7f2d25b86700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d201263f0 con 0x7f2d2006eeb0 2024-02-20T08:07:17.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.598+0000 7f2d1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50038/0 (socket says 172.21.15.123:50038) 2024-02-20T08:07:17.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 -- 172.21.15.123:0/725269177 learned_addr learned my addr 172.21.15.123:0/725269177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:17.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1effd700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 0x7f2d20113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 -- 172.21.15.123:0/725269177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 msgr2=0x7f2d20113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 0x7f2d20113080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 -- 172.21.15.123:0/725269177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14005040 con 0x7f2d2006e560 2024-02-20T08:07:17.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.599+0000 7f2d1f7fe700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2d14007cc0 tx=0x7f2d14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:17.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.600+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d1400e070 con 0x7f2d2006e560 2024-02-20T08:07:17.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.600+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d14013420 con 0x7f2d2006e560 2024-02-20T08:07:17.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.601+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d1400bee0 con 0x7f2d2006e560 2024-02-20T08:07:17.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.601+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d20126670 con 0x7f2d2006e560 2024-02-20T08:07:17.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.601+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d20126ad0 con 0x7f2d2006e560 2024-02-20T08:07:17.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.603+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2010cd10 con 0x7f2d2006e560 2024-02-20T08:07:17.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.604+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 31) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f2d1400b9a0 con 0x7f2d2006e560 2024-02-20T08:07:17.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.604+0000 7f2d07fff700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 0x7f2d0806f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:17.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.604+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2d1408d330 con 0x7f2d2006e560 2024-02-20T08:07:17.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.607+0000 7f2d1effd700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 0x7f2d0806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:17.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.607+0000 7f2d1effd700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 0x7f2d0806f550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d2006f9e0 tx=0x7f2d100091a0 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.614+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2d1405ad40 con 0x7f2d2006e560 2024-02-20T08:07:17.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.923+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d20126db0 con 0x7f2d0806d0a0 2024-02-20T08:07:17.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.925+0000 7f2d07fff700 1 -- 172.21.15.123:0/725269177 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f2d20126db0 con 0x7f2d0806d0a0 2024-02-20T08:07:17.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 msgr2=0x7f2d0806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 0x7f2d0806f550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d2006f9e0 tx=0x7f2d100091a0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 msgr2=0x7f2d20112b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2d14007cc0 tx=0x7f2d14009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 shutdown_connections 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f2d0806d0a0 0x7f2d0806f550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2006e560 0x7f2d20112b40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 --2- 172.21.15.123:0/725269177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d2006eeb0 0x7f2d20113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 >> 172.21.15.123:0/725269177 conn(0x7f2d20069e70 msgr2=0x7f2d20107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 shutdown_connections 2024-02-20T08:07:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:17.927+0000 7f2d25b86700 1 -- 172.21.15.123:0/725269177 wait complete. 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 -- 172.21.15.123:0/1268595988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 msgr2=0x7f346c0fd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 --2- 172.21.15.123:0/1268595988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c0fd840 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f345c004940 tx=0x7f345c009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 -- 172.21.15.123:0/1268595988 shutdown_connections 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 --2- 172.21.15.123:0/1268595988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346c0fc0a0 0x7f346c0fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 --2- 172.21.15.123:0/1268595988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c0fd840 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 -- 172.21.15.123:0/1268595988 >> 172.21.15.123:0/1268595988 conn(0x7f346c0f6ca0 msgr2=0x7f346c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 -- 172.21.15.123:0/1268595988 shutdown_connections 2024-02-20T08:07:18.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.065+0000 7f3471312700 1 -- 172.21.15.123:0/1268595988 wait complete. 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 Processor -- start 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 -- start start 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346c0fc0a0 0x7f346c110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0fbd50 con 0x7f346c0fd430 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.066+0000 7f3471312700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0fbe90 con 0x7f346c0fc0a0 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50056/0 (socket says 172.21.15.123:50056) 2024-02-20T08:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 -- 172.21.15.123:0/1962771440 learned_addr learned my addr 172.21.15.123:0/1962771440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 -- 172.21.15.123:0/1962771440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346c0fc0a0 msgr2=0x7f346c110690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346c0fc0a0 0x7f346c110690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 -- 172.21.15.123:0/1962771440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c005040 con 0x7f346c0fd430 2024-02-20T08:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.067+0000 7f346a7fc700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f346000eb70 tx=0x7f346000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.072+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3460007cc0 con 0x7f346c0fd430 2024-02-20T08:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.072+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f346000f040 con 0x7f346c0fd430 2024-02-20T08:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.072+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346000cbd0 con 0x7f346c0fd430 2024-02-20T08:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.072+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c1131e0 con 0x7f346c0fd430 2024-02-20T08:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.073+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c1136d0 con 0x7f346c0fd430 2024-02-20T08:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.074+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c04bed0 con 0x7f346c0fd430 2024-02-20T08:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.074+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f346000cd30 con 0x7f346c0fd430 2024-02-20T08:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.075+0000 7f34537fe700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 0x7f345406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.075+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f346008c1e0 con 0x7f346c0fd430 2024-02-20T08:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.075+0000 7f346affd700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 0x7f345406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:18.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.075+0000 7f346affd700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 0x7f345406f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:18.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.079+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3460056190 con 0x7f346c0fd430 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:07:18.247 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:18 smithi123 ceph-mon[29383]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:07:18.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.373+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f346c113940 con 0x7f345406d200 2024-02-20T08:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.385+0000 7f34537fe700 1 -- 172.21.15.123:0/1962771440 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f346c113940 con 0x7f345406d200 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (2m) 41s ago 10m 25.7M - 0.25.0 c8568f914cd2 a5c1c8e46fd5 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (11m) 41s ago 11m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (9m) 5s ago 9m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (96s) 41s ago 10m 74.5M - 9.4.7 954c08fa6188 4b8d379a3806 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (5m) 41s ago 5m 12.3M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (5m) 41s ago 4m 239M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (5m) 5s ago 5m 15.7M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (4m) 5s ago 4m 13.2M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (73s) 41s ago 12m 473M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (9s) 5s ago 9m 66.5M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (12m) 41s ago 12m 54.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (9m) 5s ago 9m 44.1M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:07:18.386 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (2m) 41s ago 11m 15.8M - 1.5.0 0da6a335fe13 1dba37793143 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (80s) 5s ago 9m 15.5M - 1.5.0 0da6a335fe13 cabdaa08f7d8 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (8m) 41s ago 8m 164M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (8m) 41s ago 8m 170M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (7m) 41s ago 7m 148M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (7m) 5s ago 7m 217M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (6m) 5s ago 6m 189M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (6m) 5s ago 6m 184M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:07:18.387 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 starting - - - - 2024-02-20T08:07:18.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 msgr2=0x7f345406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 0x7f345406f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:18.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 msgr2=0x7f346c112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f346000eb70 tx=0x7f346000b040 comp rx=0 tx=0).stop 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 shutdown_connections 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f345406d200 0x7f345406f6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346c0fc0a0 0x7f346c110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 --2- 172.21.15.123:0/1962771440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f346c0fd430 0x7f346c112be0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 >> 172.21.15.123:0/1962771440 conn(0x7f346c0f6ca0 msgr2=0x7f346c1002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 shutdown_connections 2024-02-20T08:07:18.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.388+0000 7f3471312700 1 -- 172.21.15.123:0/1962771440 wait complete. 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:07:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:18 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/1797043985' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:07:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 -- 172.21.15.123:0/2877161884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fe0e0 msgr2=0x7fd8500fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 --2- 172.21.15.123:0/2877161884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fe0e0 0x7fd8500fe550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd844004940 tx=0x7fd844009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 -- 172.21.15.123:0/2877161884 shutdown_connections 2024-02-20T08:07:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 --2- 172.21.15.123:0/2877161884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fe0e0 0x7fd8500fe550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 --2- 172.21.15.123:0/2877161884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fcef0 0x7fd8500fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.507+0000 7fd855239700 1 -- 172.21.15.123:0/2877161884 >> 172.21.15.123:0/2877161884 conn(0x7fd8500f8620 msgr2=0x7fd8500faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 -- 172.21.15.123:0/2877161884 shutdown_connections 2024-02-20T08:07:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 -- 172.21.15.123:0/2877161884 wait complete. 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 Processor -- start 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 -- start start 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 0x7fd8500702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500708e0 con 0x7fd8500fcef0 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.508+0000 7fd855239700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850070a50 con 0x7fd8500fe0e0 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56752/0 (socket says 172.21.15.123:56752) 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 -- 172.21.15.123:0/119035611 learned_addr learned my addr 172.21.15.123:0/119035611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84e59c700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 0x7fd8500702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 -- 172.21.15.123:0/119035611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 msgr2=0x7fd8500702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 0x7fd8500702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 -- 172.21.15.123:0/119035611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844005040 con 0x7fd8500fcef0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84e59c700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 0x7fd8500702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd84ed9d700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd84000eb70 tx=0x7fd84000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.509+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd840007cc0 con 0x7fd8500fcef0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.510+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850070cd0 con 0x7fd8500fcef0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.510+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850115920 con 0x7fd8500fcef0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.510+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd84000f040 con 0x7fd8500fcef0 2024-02-20T08:07:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.510+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84000cbd0 con 0x7fd8500fcef0 2024-02-20T08:07:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.511+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0052e0 con 0x7fd8500fcef0 2024-02-20T08:07:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.511+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fd84000cd30 con 0x7fd8500fcef0 2024-02-20T08:07:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.512+0000 7fd8377fe700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 0x7fd83806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.512+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd84008c1e0 con 0x7fd8500fcef0 2024-02-20T08:07:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.512+0000 7fd84e59c700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 0x7fd83806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.512+0000 7fd84e59c700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 0x7fd83806f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b0d0 tx=0x7fd844009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.516+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd840059cc0 con 0x7fd8500fcef0 2024-02-20T08:07:18.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.961+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd83c005860 con 0x7fd8500fcef0 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.962+0000 7fd8377fe700 1 -- 172.21.15.123:0/119035611 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fd840059850 con 0x7fd8500fcef0 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:07:18.962 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 12, 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:07:18.963 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 msgr2=0x7fd83806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 0x7fd83806f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b0d0 tx=0x7fd844009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 msgr2=0x7fd850071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd84000eb70 tx=0x7fd84000b040 comp rx=0 tx=0).stop 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 shutdown_connections 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fd83806d200 0x7fd83806f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8500fcef0 0x7fd850071e60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 --2- 172.21.15.123:0/119035611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8500fe0e0 0x7fd8500702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 >> 172.21.15.123:0/119035611 conn(0x7fd8500f8620 msgr2=0x7fd8501013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 shutdown_connections 2024-02-20T08:07:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:18.964+0000 7fd855239700 1 -- 172.21.15.123:0/119035611 wait complete. 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/1390886819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fbe40 msgr2=0x7f4f340fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/1390886819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fbe40 0x7f4f340fc250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4f28004940 tx=0x7f4f28009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/1390886819 shutdown_connections 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/1390886819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fcfb0 0x7f4f340fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/1390886819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fbe40 0x7f4f340fc250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/1390886819 >> 172.21.15.123:0/1390886819 conn(0x7f4f340f74e0 msgr2=0x7f4f340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/1390886819 shutdown_connections 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.106+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/1390886819 wait complete. 2024-02-20T08:07:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 Processor -- start 2024-02-20T08:07:19.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 -- start start 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fbe40 0x7f4f3410c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3410d380 con 0x7f4f340fcfb0 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f3ae2e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3410dc20 con 0x7f4f340fbe40 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56782/0 (socket says 172.21.15.123:56782) 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.107+0000 7f4f33fff700 1 -- 172.21.15.123:0/2639887159 learned_addr learned my addr 172.21.15.123:0/2639887159 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f38bca700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fbe40 0x7f4f3410c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f33fff700 1 -- 172.21.15.123:0/2639887159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fbe40 msgr2=0x7f4f3410c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f33fff700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fbe40 0x7f4f3410c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f33fff700 1 -- 172.21.15.123:0/2639887159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28005040 con 0x7f4f340fcfb0 2024-02-20T08:07:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f33fff700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c830 tx=0x7f4f20004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:19.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f200106f0 con 0x7f4f340fcfb0 2024-02-20T08:07:19.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3410df00 con 0x7f4f340fcfb0 2024-02-20T08:07:19.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f20010d20 con 0x7f4f340fcfb0 2024-02-20T08:07:19.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f200113a0 con 0x7f4f340fcfb0 2024-02-20T08:07:19.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.108+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3410e3c0 con 0x7f4f340fcfb0 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.110+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3404bed0 con 0x7f4f340fcfb0 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.110+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f4f20010850 con 0x7f4f340fcfb0 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.110+0000 7f4f317fa700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 0x7f4f24073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.111+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4f2008c670 con 0x7f4f340fcfb0 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.111+0000 7f4f38bca700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 0x7f4f24073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.111+0000 7f4f38bca700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 0x7f4f24073ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b3b0 tx=0x7f4f28009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:19.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.118+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4f2005a1b0 con 0x7f4f340fcfb0 2024-02-20T08:07:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: mgrmap e32: smithi123.kwyrtl(active, since 47s), standbys: smithi194.pvhorj 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 178 op/s 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/119035611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:07:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:19 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: mgrmap e32: smithi123.kwyrtl(active, since 47s), standbys: smithi194.pvhorj 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 178 op/s 2024-02-20T08:07:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/119035611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:19 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:19.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.438+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f3410eaa0 con 0x7f4f24071610 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.440+0000 7f4f317fa700 1 -- 172.21.15.123:0/2639887159 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f4f3410eaa0 con 0x7f4f24071610 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:07:19.440 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/2 daemons upgraded", 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:07:19.441 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 msgr2=0x7f4f24073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 0x7f4f24073ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b3b0 tx=0x7f4f28009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 msgr2=0x7f4f3410cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c830 tx=0x7f4f20004470 comp rx=0 tx=0).stop 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 shutdown_connections 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f4f24071610 0x7f4f24073ac0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.443+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f340fbe40 0x7f4f3410c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.444+0000 7f4f3ae2e700 1 --2- 172.21.15.123:0/2639887159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f340fcfb0 0x7f4f3410cd80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:19.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.444+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 >> 172.21.15.123:0/2639887159 conn(0x7f4f340f74e0 msgr2=0x7f4f34100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:19.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.444+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 shutdown_connections 2024-02-20T08:07:19.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:19.444+0000 7f4f3ae2e700 1 -- 172.21.15.123:0/2639887159 wait complete. 2024-02-20T08:07:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all mgr 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi123.kwyrtl"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi123.kwyrtl"}]': finished 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.pvhorj"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.pvhorj"}]': finished 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all rgw 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all rbd-mirror 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-20T08:07:20.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all ceph-exporter 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all iscsi 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all nfs 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all nvmeof 2024-02-20T08:07:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:20 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:20.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all mgr 2024-02-20T08:07:20.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi123.kwyrtl"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi123.kwyrtl"}]': finished 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.pvhorj"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.pvhorj"}]': finished 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all rgw 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all rbd-mirror 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all ceph-exporter 2024-02-20T08:07:20.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all iscsi 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all nfs 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all nvmeof 2024-02-20T08:07:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:20 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:21 smithi194 ceph-mon[37804]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:21 smithi194 ceph-mon[37804]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-02-20T08:07:21.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:21 smithi123 ceph-mon[29383]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:21.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:21 smithi123 ceph-mon[29383]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-02-20T08:07:23.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:23 smithi194 ceph-mon[37804]: pgmap v29: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 195 op/s 2024-02-20T08:07:23.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:23 smithi123 ceph-mon[29383]: pgmap v29: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 195 op/s 2024-02-20T08:07:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:25 smithi194 ceph-mon[37804]: pgmap v30: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-02-20T08:07:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:25 smithi123 ceph-mon[29383]: pgmap v30: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-02-20T08:07:27.411 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:27 smithi123 ceph-mon[29383]: Upgrade: Updating node-exporter.smithi123 (1/2) 2024-02-20T08:07:27.412 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:27 smithi123 ceph-mon[29383]: Deploying daemon node-exporter.smithi123 on smithi123 2024-02-20T08:07:27.412 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:27 smithi123 ceph-mon[29383]: pgmap v31: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-02-20T08:07:27.508 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-20T08:07:27.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-20T08:07:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:27 smithi194 ceph-mon[37804]: Upgrade: Updating node-exporter.smithi123 (1/2) 2024-02-20T08:07:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:27 smithi194 ceph-mon[37804]: Deploying daemon node-exporter.smithi123 on smithi123 2024-02-20T08:07:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:27 smithi194 ceph-mon[37804]: pgmap v31: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-02-20T08:07:27.933 DEBUG:teuthology.parallel:result is None 2024-02-20T08:07:29.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:29 smithi194 ceph-mon[37804]: pgmap v32: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 217 op/s 2024-02-20T08:07:29.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:29.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:29 smithi123 ceph-mon[29383]: pgmap v32: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 217 op/s 2024-02-20T08:07:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:31.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:30 smithi123 ceph-mon[29383]: pgmap v33: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2024-02-20T08:07:31.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:30 smithi194 ceph-mon[37804]: pgmap v33: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2024-02-20T08:07:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:32.204 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:31 smithi194 ceph-mon[37804]: Upgrade: Updating node-exporter.smithi194 (2/2) 2024-02-20T08:07:32.204 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:31 smithi194 ceph-mon[37804]: Deploying daemon node-exporter.smithi194 on smithi194 2024-02-20T08:07:32.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:31 smithi123 ceph-mon[29383]: Upgrade: Updating node-exporter.smithi194 (2/2) 2024-02-20T08:07:32.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:31 smithi123 ceph-mon[29383]: Deploying daemon node-exporter.smithi194 on smithi194 2024-02-20T08:07:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:32 smithi194 ceph-mon[37804]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 229 op/s 2024-02-20T08:07:33.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:32 smithi123 ceph-mon[29383]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 229 op/s 2024-02-20T08:07:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-02-20T08:07:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:37 smithi194 ceph-mon[37804]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-02-20T08:07:37.717 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:37 smithi123 ceph-mon[29383]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-02-20T08:07:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:38 smithi123 ceph-mon[29383]: pgmap v37: 65 pgs: 65 active+clean; 271 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-02-20T08:07:38.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:38.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:38.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:38 smithi194 ceph-mon[37804]: pgmap v37: 65 pgs: 65 active+clean; 271 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-02-20T08:07:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:39 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:39 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:40 smithi194 ceph-mon[37804]: pgmap v38: 65 pgs: 65 active+clean; 271 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2024-02-20T08:07:40.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:40 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:40.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:40 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:40 smithi123 ceph-mon[29383]: pgmap v38: 65 pgs: 65 active+clean; 271 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2024-02-20T08:07:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:40 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:40 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:41.499 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-20T08:07:41.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-20T08:07:41.831 DEBUG:teuthology.parallel:result is None 2024-02-20T08:07:41.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-20T08:07:41.875 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-20T08:07:41.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-20T08:07:41.913 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-20T08:07:41.913 DEBUG:teuthology.parallel:result is None 2024-02-20T08:07:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:43 smithi123 ceph-mon[29383]: pgmap v39: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 236 op/s 2024-02-20T08:07:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:43.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:43 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:43 smithi194 ceph-mon[37804]: pgmap v39: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 236 op/s 2024-02-20T08:07:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:43 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: pgmap v40: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:45 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: pgmap v40: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:45.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:45 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:46.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:46 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:46.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:46 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:07:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:47 smithi194 ceph-mon[37804]: pgmap v41: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-20T08:07:47.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:47 smithi123 ceph-mon[29383]: pgmap v41: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-20T08:07:48.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:48 smithi194 ceph-mon[37804]: Upgrade: Updating prometheus.smithi123 2024-02-20T08:07:48.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:48 smithi194 ceph-mon[37804]: Deploying daemon prometheus.smithi123 on smithi123 2024-02-20T08:07:48.659 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:48 smithi123 ceph-mon[29383]: Upgrade: Updating prometheus.smithi123 2024-02-20T08:07:48.659 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:48 smithi123 ceph-mon[29383]: Deploying daemon prometheus.smithi123 on smithi123 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- 172.21.15.123:0/2213554275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4100070 msgr2=0x7fafb4102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 --2- 172.21.15.123:0/2213554275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4100070 0x7fafb4102490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fafa0004940 tx=0x7fafa0009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- 172.21.15.123:0/2213554275 shutdown_connections 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 --2- 172.21.15.123:0/2213554275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4100070 0x7fafb4102490 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 --2- 172.21.15.123:0/2213554275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4066cb0 0x7fafb40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- 172.21.15.123:0/2213554275 >> 172.21.15.123:0/2213554275 conn(0x7fafb40f75c0 msgr2=0x7fafb40f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- 172.21.15.123:0/2213554275 shutdown_connections 2024-02-20T08:07:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- 172.21.15.123:0/2213554275 wait complete. 2024-02-20T08:07:49.567 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:49 smithi123 ceph-mon[29383]: pgmap v42: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-02-20T08:07:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 Processor -- start 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.564+0000 7fafbab03700 1 -- start start 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafbab03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafbab03700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4100070 0x7fafb410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafbab03700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb410e4a0 con 0x7fafb4066cb0 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafbab03700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb410ed40 con 0x7fafb4100070 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44610/0 (socket says 172.21.15.123:44610) 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 -- 172.21.15.123:0/1816577124 learned_addr learned my addr 172.21.15.123:0/1816577124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb3fff700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4100070 0x7fafb410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 -- 172.21.15.123:0/1816577124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4100070 msgr2=0x7fafb410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4100070 0x7fafb410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.565+0000 7fafb889f700 1 -- 172.21.15.123:0/1816577124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0005040 con 0x7fafb4066cb0 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafb889f700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c800 tx=0x7fafa8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa80106f0 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafa8010d20 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb410f020 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa80113a0 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.566+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb410f560 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.567+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb404bed0 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.567+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fafa8012400 con 0x7fafb4066cb0 2024-02-20T08:07:49.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.568+0000 7fafb17fa700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 0x7fafa406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.568+0000 7fafb3fff700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 0x7fafa406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.568+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fafa808c5f0 con 0x7fafb4066cb0 2024-02-20T08:07:49.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.568+0000 7fafb3fff700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 0x7fafa406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b3b0 tx=0x7fafa0009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.573+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fafa805a130 con 0x7fafb4066cb0 2024-02-20T08:07:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:49 smithi194 ceph-mon[37804]: pgmap v42: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-02-20T08:07:49.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.790+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafb410f9e0 con 0x7fafa406d200 2024-02-20T08:07:49.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.791+0000 7fafb17fa700 1 -- 172.21.15.123:0/1816577124 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fafb410f9e0 con 0x7fafa406d200 2024-02-20T08:07:49.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 msgr2=0x7fafa406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 0x7fafa406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b3b0 tx=0x7fafa0009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 msgr2=0x7fafb410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c800 tx=0x7fafa8004470 comp rx=0 tx=0).stop 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 shutdown_connections 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fafa406d200 0x7fafa406f6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb4066cb0 0x7fafb410d960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 --2- 172.21.15.123:0/1816577124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafb4100070 0x7fafb410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 >> 172.21.15.123:0/1816577124 conn(0x7fafb40f75c0 msgr2=0x7fafb40f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 shutdown_connections 2024-02-20T08:07:49.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.793+0000 7fafbab03700 1 -- 172.21.15.123:0/1816577124 wait complete. 2024-02-20T08:07:49.805 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:07:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 -- 172.21.15.123:0/2157444417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 msgr2=0x7fb18c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 --2- 172.21.15.123:0/2157444417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c0fe550 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb180004940 tx=0x7fb180009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 -- 172.21.15.123:0/2157444417 shutdown_connections 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 --2- 172.21.15.123:0/2157444417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c0fe550 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 --2- 172.21.15.123:0/2157444417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 0x7fb18c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 -- 172.21.15.123:0/2157444417 >> 172.21.15.123:0/2157444417 conn(0x7fb18c0f8620 msgr2=0x7fb18c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 -- 172.21.15.123:0/2157444417 shutdown_connections 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.902+0000 7fb1919e6700 1 -- 172.21.15.123:0/2157444417 wait complete. 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 Processor -- start 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 -- start start 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 0x7fb18c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c10e4a0 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb1919e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c10ed40 con 0x7fb18c0fcef0 2024-02-20T08:07:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb18a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb18a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44630/0 (socket says 172.21.15.123:44630) 2024-02-20T08:07:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.903+0000 7fb18a7fc700 1 -- 172.21.15.123:0/1090409605 learned_addr learned my addr 172.21.15.123:0/1090409605 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb18affd700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 0x7fb18c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb18a7fc700 1 -- 172.21.15.123:0/1090409605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 msgr2=0x7fb18c10d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb18a7fc700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 0x7fb18c10d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb18a7fc700 1 -- 172.21.15.123:0/1090409605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180005040 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb18a7fc700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb1800093b0 tx=0x7fb180009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18000e040 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb18000bcc0 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18001c630 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c10efc0 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.904+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c10f500 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.905+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c04bed0 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.905+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7fb1800139f0 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.906+0000 7fb1737fe700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 0x7fb17406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.906+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb18008db90 con 0x7fb18c0fe0e0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.906+0000 7fb18affd700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 0x7fb17406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.906+0000 7fb18affd700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 0x7fb17406f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:49.910+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb18005b660 con 0x7fb18c0fe0e0 2024-02-20T08:07:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.126+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb18c10f9a0 con 0x7fb17406d200 2024-02-20T08:07:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.127+0000 7fb1737fe700 1 -- 172.21.15.123:0/1090409605 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fb18c10f9a0 con 0x7fb17406d200 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 msgr2=0x7fb17406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 0x7fb17406f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 msgr2=0x7fb18c10dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb1800093b0 tx=0x7fb180009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 shutdown_connections 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fb17406d200 0x7fb17406f6b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb18c0fcef0 0x7fb18c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 --2- 172.21.15.123:0/1090409605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18c0fe0e0 0x7fb18c10dea0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 >> 172.21.15.123:0/1090409605 conn(0x7fb18c0f8620 msgr2=0x7fb18c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 shutdown_connections 2024-02-20T08:07:50.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.130+0000 7fb1919e6700 1 -- 172.21.15.123:0/1090409605 wait complete. 2024-02-20T08:07:50.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 -- 172.21.15.123:0/2361935317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c0708c0 msgr2=0x7f442c070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 --2- 172.21.15.123:0/2361935317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c0708c0 0x7f442c070d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4418004940 tx=0x7f4418009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 -- 172.21.15.123:0/2361935317 shutdown_connections 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 --2- 172.21.15.123:0/2361935317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c0708c0 0x7f442c070d10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 --2- 172.21.15.123:0/2361935317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c071f10 0x7f442c070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 -- 172.21.15.123:0/2361935317 >> 172.21.15.123:0/2361935317 conn(0x7f442c0f8620 msgr2=0x7f442c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 -- 172.21.15.123:0/2361935317 shutdown_connections 2024-02-20T08:07:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.231+0000 7f44330f2700 1 -- 172.21.15.123:0/2361935317 wait complete. 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 Processor -- start 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 -- start start 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c0708c0 0x7f442c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1149e0 con 0x7f442c071f10 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f44330f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c115280 con 0x7f442c0708c0 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f442bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f442bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44652/0 (socket says 172.21.15.123:44652) 2024-02-20T08:07:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.232+0000 7f442bfff700 1 -- 172.21.15.123:0/4019086751 learned_addr learned my addr 172.21.15.123:0/4019086751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f4430e8e700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c0708c0 0x7f442c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f442bfff700 1 -- 172.21.15.123:0/4019086751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c0708c0 msgr2=0x7f442c113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f442bfff700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c0708c0 0x7f442c113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f442bfff700 1 -- 172.21.15.123:0/4019086751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418005040 con 0x7f442c071f10 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f442bfff700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4418007d70 tx=0x7f4418009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4418021070 con 0x7f442c071f10 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c115500 con 0x7f442c071f10 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f441801c400 con 0x7f442c071f10 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f441800e070 con 0x7f442c071f10 2024-02-20T08:07:50.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.233+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c1159e0 con 0x7f442c071f10 2024-02-20T08:07:50.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.235+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c04bed0 con 0x7f442c071f10 2024-02-20T08:07:50.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.235+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f441801ca50 con 0x7f442c071f10 2024-02-20T08:07:50.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.235+0000 7f44297fa700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 0x7f441c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.235+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f441808dab0 con 0x7f442c071f10 2024-02-20T08:07:50.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.236+0000 7f4430e8e700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 0x7f441c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.236+0000 7f4430e8e700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 0x7f441c06f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4420004600 tx=0x7f442000b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:50.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.240+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f441805b4e0 con 0x7f442c071f10 2024-02-20T08:07:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.454+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f442c115d90 con 0x7f441c06d200 2024-02-20T08:07:50.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.464+0000 7f44297fa700 1 -- 172.21.15.123:0/4019086751 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f442c115d90 con 0x7f441c06d200 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (2m) 10s ago 11m 25.7M - 0.25.0 c8568f914cd2 a5c1c8e46fd5 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (11m) 10s ago 11m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (10m) 13s ago 10m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (2m) 10s ago 10m 78.6M - 9.4.7 954c08fa6188 4b8d379a3806 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (5m) 10s ago 5m 12.7M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (5m) 10s ago 5m 175M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (5m) 13s ago 5m 15.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (5m) 13s ago 5m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (105s) 10s ago 12m 494M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (41s) 13s ago 10m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:07:50.466 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (12m) 10s ago 12m 54.8M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (10m) 13s ago 10m 45.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (22s) 10s ago 11m 8002k - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (17s) 13s ago 10m 5435k - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (9m) 10s ago 9m 183M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (8m) 10s ago 8m 186M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (8m) 10s ago 8m 168M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (7m) 13s ago 7m 224M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (7m) 13s ago 7m 198M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (7m) 13s ago 7m 190M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:07:50.467 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (51s) 10s ago 10m 46.6M - 2.43.0 a07b618ecd1d 39bd3d1ecf19 2024-02-20T08:07:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 msgr2=0x7f441c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 0x7f441c06f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4420004600 tx=0x7f442000b040 comp rx=0 tx=0).stop 2024-02-20T08:07:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 msgr2=0x7f442c1143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4418007d70 tx=0x7f4418009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 shutdown_connections 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f441c06d200 0x7f441c06f6b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c0708c0 0x7f442c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 --2- 172.21.15.123:0/4019086751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f442c071f10 0x7f442c1143e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 >> 172.21.15.123:0/4019086751 conn(0x7f442c0f8620 msgr2=0x7f442c0fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 shutdown_connections 2024-02-20T08:07:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.467+0000 7f44330f2700 1 -- 172.21.15.123:0/4019086751 wait complete. 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 -- 172.21.15.123:0/3604169138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 msgr2=0x7f8c0c104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 --2- 172.21.15.123:0/3604169138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c104830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8c00004940 tx=0x7f8c00009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 -- 172.21.15.123:0/3604169138 shutdown_connections 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 --2- 172.21.15.123:0/3604169138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c104830 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 --2- 172.21.15.123:0/3604169138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 0x7f8c0c101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 -- 172.21.15.123:0/3604169138 >> 172.21.15.123:0/3604169138 conn(0x7f8c0c0f7500 msgr2=0x7f8c0c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 -- 172.21.15.123:0/3604169138 shutdown_connections 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.573+0000 7f8c118f8700 1 -- 172.21.15.123:0/3604169138 wait complete. 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 Processor -- start 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 -- start start 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 0x7f8c0c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1106e0 con 0x7f8c0c102450 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c118f8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c110f80 con 0x7f8c0c066c50 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44680/0 (socket says 172.21.15.123:44680) 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/922999952 learned_addr learned my addr 172.21.15.123:0/922999952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0affd700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 0x7f8c0c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/922999952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 msgr2=0x7f8c0c10fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 0x7f8c0c10fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.574+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/922999952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00005040 con 0x7f8c0c102450 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8c0a7fc700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c00 tx=0x7f8c00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0000e040 con 0x7f8c0c102450 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c111200 con 0x7f8c0c102450 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c0000bbf0 con 0x7f8c0c102450 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0001c630 con 0x7f8c0c102450 2024-02-20T08:07:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.575+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c111740 con 0x7f8c0c102450 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.576+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c04bed0 con 0x7f8c0c102450 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.576+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f8c0000bd60 con 0x7f8c0c102450 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.577+0000 7f8bf37fe700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 0x7f8bf406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.577+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8c0008dbe0 con 0x7f8c0c102450 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.577+0000 7f8c0affd700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 0x7f8bf406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.578+0000 7f8c0affd700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 0x7f8bf406f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc004f40 tx=0x7f8bfc00b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.585+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8c0005b610 con 0x7f8c0c102450 2024-02-20T08:07:50.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.887+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c0c107c20 con 0x7f8c0c102450 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.887+0000 7f8bf37fe700 1 -- 172.21.15.123:0/922999952 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8c0005b1a0 con 0x7f8c0c102450 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:07:50.889 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 12, 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:07:50.890 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 msgr2=0x7f8bf406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 0x7f8bf406f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc004f40 tx=0x7f8bfc00b040 comp rx=0 tx=0).stop 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 msgr2=0x7f8c0c1100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c00 tx=0x7f8c00009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 shutdown_connections 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f8bf406d200 0x7f8bf406f6b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0c066c50 0x7f8c0c10fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 --2- 172.21.15.123:0/922999952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c0c102450 0x7f8c0c1100e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.889+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 >> 172.21.15.123:0/922999952 conn(0x7f8c0c0f7500 msgr2=0x7f8c0c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.890+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 shutdown_connections 2024-02-20T08:07:50.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.890+0000 7f8c118f8700 1 -- 172.21.15.123:0/922999952 wait complete. 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- 172.21.15.123:0/524433235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 msgr2=0x7f18140fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 --2- 172.21.15.123:0/524433235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f18140fc250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1808004940 tx=0x7f1808009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- 172.21.15.123:0/524433235 shutdown_connections 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 --2- 172.21.15.123:0/524433235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f18140fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 --2- 172.21.15.123:0/524433235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f18140fc250 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- 172.21.15.123:0/524433235 >> 172.21.15.123:0/524433235 conn(0x7f18140f74e0 msgr2=0x7f18140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- 172.21.15.123:0/524433235 shutdown_connections 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- 172.21.15.123:0/524433235 wait complete. 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 Processor -- start 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.994+0000 7f181914a700 1 -- start start 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f1814112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140664f0 con 0x7f18140fbe40 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814066630 con 0x7f18140fcfb0 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44692/0 (socket says 172.21.15.123:44692) 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 -- 172.21.15.123:0/771667353 learned_addr learned my addr 172.21.15.123:0/771667353 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181259c700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f1814112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 -- 172.21.15.123:0/771667353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 msgr2=0x7f1814112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f1814112bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 -- 172.21.15.123:0/771667353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808005040 con 0x7f18140fbe40 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181259c700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f1814112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f1812d9d700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18080093b0 tx=0x7f1808009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180800e040 con 0x7f18140fbe40 2024-02-20T08:07:50.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18141131f0 con 0x7f18140fbe40 2024-02-20T08:07:50.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18141136d0 con 0x7f18140fbe40 2024-02-20T08:07:50.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f180800bcc0 con 0x7f18140fbe40 2024-02-20T08:07:50.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.995+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1808025640 con 0x7f18140fbe40 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.996+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181404bed0 con 0x7f18140fbe40 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.997+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 32) v1 ==== 91311+0+0 (secure 0 0 0) 0x7f18080139f0 con 0x7f18140fbe40 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.997+0000 7f17fb7fe700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 0x7f17fc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.997+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f180808dca0 con 0x7f18140fbe40 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.997+0000 7f181259c700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 0x7f17fc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:07:51.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:50.998+0000 7f181259c700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 0x7f17fc06f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1804006fd0 tx=0x7f1804008040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:07:51.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.003+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1808092070 con 0x7f18140fbe40 2024-02-20T08:07:51.111 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:50 smithi123 ceph-mon[29383]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:51.111 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:50 smithi123 ceph-mon[29383]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:51.111 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:50 smithi123 ceph-mon[29383]: pgmap v43: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 567 KiB/s wr, 118 op/s 2024-02-20T08:07:51.112 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:50 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/922999952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:51.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.217+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1814101990 con 0x7f17fc06d200 2024-02-20T08:07:51.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.218+0000 7f17fb7fe700 1 -- 172.21.15.123:0/771667353 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f1814101990 con 0x7f17fc06d200 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/2 daemons upgraded", 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:07:51.220 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 msgr2=0x7f17fc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 0x7f17fc06f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1804006fd0 tx=0x7f1804008040 comp rx=0 tx=0).stop 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 msgr2=0x7f1814110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18080093b0 tx=0x7f1808009e30 comp rx=0 tx=0).stop 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 shutdown_connections 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f17fc06d200 0x7f17fc06f6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18140fbe40 0x7f1814110670 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 --2- 172.21.15.123:0/771667353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18140fcfb0 0x7f1814112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 >> 172.21.15.123:0/771667353 conn(0x7f18140f74e0 msgr2=0x7f1814100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 shutdown_connections 2024-02-20T08:07:51.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:07:51.220+0000 7f181914a700 1 -- 172.21.15.123:0/771667353 wait complete. 2024-02-20T08:07:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:50 smithi194 ceph-mon[37804]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:50 smithi194 ceph-mon[37804]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:50 smithi194 ceph-mon[37804]: pgmap v43: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 567 KiB/s wr, 118 op/s 2024-02-20T08:07:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:50 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/922999952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:07:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:51 smithi123 ceph-mon[29383]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:51 smithi123 ceph-mon[29383]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:51 smithi194 ceph-mon[37804]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:51 smithi194 ceph-mon[37804]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:07:53.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:52 smithi123 ceph-mon[29383]: pgmap v44: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 578 KiB/s wr, 119 op/s 2024-02-20T08:07:53.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:52 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:53.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:52 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:53.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:52 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:52 smithi194 ceph-mon[37804]: pgmap v44: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 578 KiB/s wr, 119 op/s 2024-02-20T08:07:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:52 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:52 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:53.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:52 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:07:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:55 smithi194 ceph-mon[37804]: pgmap v45: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:07:55.692 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:55 smithi123 ceph-mon[29383]: pgmap v45: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:07:57.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:57 smithi123 ceph-mon[29383]: pgmap v46: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:07:57.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:57 smithi194 ceph-mon[37804]: pgmap v46: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:07:59.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:58 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:59.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:58 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:59.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:58 smithi123 ceph-mon[29383]: pgmap v47: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:07:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:58 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:58 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:07:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:58 smithi194 ceph-mon[37804]: pgmap v47: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-02-20T08:08:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:59 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:07:59 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:59 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:07:59 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:00.982 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:00 smithi123 ceph-mon[29383]: pgmap v48: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s wr, 0 op/s 2024-02-20T08:08:00.982 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:00 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:00 smithi194 ceph-mon[37804]: pgmap v48: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s wr, 0 op/s 2024-02-20T08:08:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:00 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:01 smithi123 ceph-mon[29383]: mgrmap e33: smithi123.kwyrtl(active, since 90s), standbys: smithi194.pvhorj 2024-02-20T08:08:02.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:01 smithi194 ceph-mon[37804]: mgrmap e33: smithi123.kwyrtl(active, since 90s), standbys: smithi194.pvhorj 2024-02-20T08:08:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: pgmap v49: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s wr, 0 op/s 2024-02-20T08:08:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:03 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: pgmap v49: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s wr, 0 op/s 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:03 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:04.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:04 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:08:04.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:04 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-20T08:08:05.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:05 smithi123 ceph-mon[29383]: pgmap v50: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:05 smithi194 ceph-mon[37804]: pgmap v50: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:06.533 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:06 smithi123 ceph-mon[29383]: Upgrade: Updating alertmanager.smithi123 2024-02-20T08:08:06.533 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:06 smithi123 ceph-mon[29383]: Deploying daemon alertmanager.smithi123 on smithi123 2024-02-20T08:08:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:06 smithi194 ceph-mon[37804]: Upgrade: Updating alertmanager.smithi123 2024-02-20T08:08:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:06 smithi194 ceph-mon[37804]: Deploying daemon alertmanager.smithi123 on smithi123 2024-02-20T08:08:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:07 smithi194 ceph-mon[37804]: pgmap v51: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:07.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:07 smithi123 ceph-mon[29383]: pgmap v51: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:09 smithi194 ceph-mon[37804]: pgmap v52: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:09.649 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:09 smithi123 ceph-mon[29383]: pgmap v52: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:10 smithi123 ceph-mon[29383]: pgmap v53: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:11.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:10 smithi194 ceph-mon[37804]: pgmap v53: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:12 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:12 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:12 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:12 smithi123 ceph-mon[29383]: pgmap v54: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:12.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:12 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:12.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:12 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:12.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:12 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:12.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:12 smithi194 ceph-mon[37804]: pgmap v54: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-20T08:08:15.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:15 smithi123 ceph-mon[29383]: pgmap v55: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:15 smithi194 ceph-mon[37804]: pgmap v55: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:16.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:16 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:16.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:16 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:17 smithi194 ceph-mon[37804]: pgmap v56: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:17 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:17 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:17.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:17 smithi123 ceph-mon[29383]: pgmap v56: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:17.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:17 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:17.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:17 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:18 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:18 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:18 smithi123 ceph-mon[29383]: pgmap v57: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:18 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:18 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:18 smithi194 ceph-mon[37804]: pgmap v57: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:20 smithi123 ceph-mon[29383]: pgmap v58: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 -- 172.21.15.123:0/1759940887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 msgr2=0x7f7908102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 --2- 172.21.15.123:0/1759940887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f7908102480 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f78fc004940 tx=0x7f78fc009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 -- 172.21.15.123:0/1759940887 shutdown_connections 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 --2- 172.21.15.123:0/1759940887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f7908102480 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 --2- 172.21.15.123:0/1759940887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 0x7f79080ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 -- 172.21.15.123:0/1759940887 >> 172.21.15.123:0/1759940887 conn(0x7f79080f7590 msgr2=0x7f79080f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 -- 172.21.15.123:0/1759940887 shutdown_connections 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.329+0000 7f790d393700 1 -- 172.21.15.123:0/1759940887 wait complete. 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 Processor -- start 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 -- start start 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 0x7f790810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790810e4d0 con 0x7f7908100060 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f790d393700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790810ed70 con 0x7f7908066c50 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f79067fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f79067fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38952/0 (socket says 172.21.15.123:38952) 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f79067fc700 1 -- 172.21.15.123:0/3123809014 learned_addr learned my addr 172.21.15.123:0/3123809014 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.330+0000 7f7906ffd700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 0x7f790810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f79067fc700 1 -- 172.21.15.123:0/3123809014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 msgr2=0x7f790810d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f79067fc700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 0x7f790810d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f79067fc700 1 -- 172.21.15.123:0/3123809014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc005040 con 0x7f7908100060 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f79067fc700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0093b0 tx=0x7f78fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78fc00e040 con 0x7f7908100060 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790810eff0 con 0x7f7908100060 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790810f530 con 0x7f7908100060 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78fc00bcc0 con 0x7f7908100060 2024-02-20T08:08:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.331+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78fc01c630 con 0x7f7908100060 2024-02-20T08:08:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.332+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790804bed0 con 0x7f7908100060 2024-02-20T08:08:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.333+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f78fc013420 con 0x7f7908100060 2024-02-20T08:08:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.333+0000 7f78ef7fe700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 0x7f78f006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.333+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f78fc08d7d0 con 0x7f7908100060 2024-02-20T08:08:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.333+0000 7f7906ffd700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 0x7f78f006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.334+0000 7f7906ffd700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 0x7f78f006f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7908066990 tx=0x7f78f800b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.338+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f78fc05b4c0 con 0x7f7908100060 2024-02-20T08:08:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:20 smithi194 ceph-mon[37804]: pgmap v58: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:21.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.555+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7908100cc0 con 0x7f78f006d0e0 2024-02-20T08:08:21.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.557+0000 7f78ef7fe700 1 -- 172.21.15.123:0/3123809014 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f7908100cc0 con 0x7f78f006d0e0 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 msgr2=0x7f78f006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 0x7f78f006f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7908066990 tx=0x7f78f800b040 comp rx=0 tx=0).stop 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 msgr2=0x7f790810ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0093b0 tx=0x7f78fc009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 shutdown_connections 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f78f006d0e0 0x7f78f006f590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7908066c50 0x7f790810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 --2- 172.21.15.123:0/3123809014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908100060 0x7f790810ded0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 >> 172.21.15.123:0/3123809014 conn(0x7f79080f7590 msgr2=0x7f79080f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 shutdown_connections 2024-02-20T08:08:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.559+0000 7f790d393700 1 -- 172.21.15.123:0/3123809014 wait complete. 2024-02-20T08:08:21.571 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:08:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 -- 172.21.15.123:0/2466421275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c1000c0 msgr2=0x7f3f8c102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 --2- 172.21.15.123:0/2466421275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c102520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c004940 tx=0x7f3f7c009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 -- 172.21.15.123:0/2466421275 shutdown_connections 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 --2- 172.21.15.123:0/2466421275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c102520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 --2- 172.21.15.123:0/2466421275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 -- 172.21.15.123:0/2466421275 >> 172.21.15.123:0/2466421275 conn(0x7f3f8c0f74e0 msgr2=0x7f3f8c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 -- 172.21.15.123:0/2466421275 shutdown_connections 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.673+0000 7f3f90c02700 1 -- 172.21.15.123:0/2466421275 wait complete. 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 Processor -- start 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 -- start start 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c0fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0fbff0 con 0x7f3f8c0663e0 2024-02-20T08:08:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f90c02700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0fc160 con 0x7f3f8c1000c0 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f8a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f8a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38968/0 (socket says 172.21.15.123:38968) 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f8a59c700 1 -- 172.21.15.123:0/4076447277 learned_addr learned my addr 172.21.15.123:0/4076447277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.674+0000 7f3f89d9b700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c0fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f8a59c700 1 -- 172.21.15.123:0/4076447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c1000c0 msgr2=0x7f3f8c0fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f8a59c700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c0fb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f8a59c700 1 -- 172.21.15.123:0/4076447277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c005040 con 0x7f3f8c0663e0 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f8a59c700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000eb40 tx=0x7f3f8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f80007cc0 con 0x7f3f8c0663e0 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f8000f040 con 0x7f3f8c0663e0 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c0fc3e0 con 0x7f3f8c0663e0 2024-02-20T08:08:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8000ca10 con 0x7f3f8c0663e0 2024-02-20T08:08:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.675+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c115900 con 0x7f3f8c0663e0 2024-02-20T08:08:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.676+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c04bed0 con 0x7f3f8c0663e0 2024-02-20T08:08:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.676+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f3f8000cb70 con 0x7f3f8c0663e0 2024-02-20T08:08:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.677+0000 7f3f7affd700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 0x7f3f7406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.677+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3f8008c050 con 0x7f3f8c0663e0 2024-02-20T08:08:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.677+0000 7f3f89d9b700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 0x7f3f7406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.677+0000 7f3f89d9b700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 0x7f3f7406f590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000c00 tx=0x7f3f7c009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.681+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3f80059d50 con 0x7f3f8c0663e0 2024-02-20T08:08:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.903+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f8c100d60 con 0x7f3f7406d0e0 2024-02-20T08:08:21.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.904+0000 7f3f7affd700 1 -- 172.21.15.123:0/4076447277 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f3f8c100d60 con 0x7f3f7406d0e0 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 msgr2=0x7f3f7406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 0x7f3f7406f590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000c00 tx=0x7f3f7c009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 msgr2=0x7f3f8c0fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000eb40 tx=0x7f3f8000b040 comp rx=0 tx=0).stop 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 shutdown_connections 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f3f7406d0e0 0x7f3f7406f590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c0663e0 0x7f3f8c0fd570 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 --2- 172.21.15.123:0/4076447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8c1000c0 0x7f3f8c0fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 >> 172.21.15.123:0/4076447277 conn(0x7f3f8c0f74e0 msgr2=0x7f3f8c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 shutdown_connections 2024-02-20T08:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:21.906+0000 7f3f90c02700 1 -- 172.21.15.123:0/4076447277 wait complete. 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:21.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:08:21.980 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:08:21.980 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- 172.21.15.123:0/1672863263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fcef0 msgr2=0x7fdf140fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 --2- 172.21.15.123:0/1672863263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fcef0 0x7fdf140fd320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdf10004940 tx=0x7fdf10009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- 172.21.15.123:0/1672863263 shutdown_connections 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 --2- 172.21.15.123:0/1672863263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fe0e0 0x7fdf140fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 --2- 172.21.15.123:0/1672863263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fcef0 0x7fdf140fd320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- 172.21.15.123:0/1672863263 >> 172.21.15.123:0/1672863263 conn(0x7fdf140f8620 msgr2=0x7fdf140faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- 172.21.15.123:0/1672863263 shutdown_connections 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- 172.21.15.123:0/1672863263 wait complete. 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 Processor -- start 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- start start 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fcef0 0x7fdf1410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1410e4b0 con 0x7fdf140fe0e0 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.012+0000 7fdf1b489700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1410ed50 con 0x7fdf140fcef0 2024-02-20T08:08:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38984/0 (socket says 172.21.15.123:38984) 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 -- 172.21.15.123:0/3351220476 learned_addr learned my addr 172.21.15.123:0/3351220476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf19225700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fcef0 0x7fdf1410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 -- 172.21.15.123:0/3351220476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fcef0 msgr2=0x7fdf1410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fcef0 0x7fdf1410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 -- 172.21.15.123:0/3351220476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10005040 con 0x7fdf140fe0e0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf18a24700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdf04002a50 tx=0x7fdf040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04007cc0 con 0x7fdf140fe0e0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf0400f040 con 0x7fdf140fe0e0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1410f030 con 0x7fdf140fe0e0 2024-02-20T08:08:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04009640 con 0x7fdf140fe0e0 2024-02-20T08:08:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.013+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1410f570 con 0x7fdf140fe0e0 2024-02-20T08:08:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.014+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1404bed0 con 0x7fdf140fe0e0 2024-02-20T08:08:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.015+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7fdf040097a0 con 0x7fdf140fe0e0 2024-02-20T08:08:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.015+0000 7fdf09ffb700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 0x7fdf0006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.015+0000 7fdf19225700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 0x7fdf0006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.015+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdf0408c260 con 0x7fdf140fe0e0 2024-02-20T08:08:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.016+0000 7fdf19225700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 0x7fdf0006f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3b0 tx=0x7fdf10009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.020+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fdf04059eb0 con 0x7fdf140fe0e0 2024-02-20T08:08:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.232+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1410fa10 con 0x7fdf0006d0e0 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.233 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.234 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:21 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.242+0000 7fdf09ffb700 1 -- 172.21.15.123:0/3351220476 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdf1410fa10 con 0x7fdf0006d0e0 2024-02-20T08:08:22.242 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:08:22.242 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (11s) 5s ago 11m 16.2M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:08:22.242 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (12m) 5s ago 12m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:08:22.242 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (10m) 44s ago 10m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (2m) 5s ago 11m 83.8M - 9.4.7 954c08fa6188 4b8d379a3806 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (6m) 5s ago 6m 12.8M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (6m) 5s ago 6m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (6m) 44s ago 6m 15.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (6m) 44s ago 6m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (2m) 5s ago 13m 498M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (73s) 44s ago 10m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (13m) 5s ago 13m 55.3M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (10m) 44s ago 10m 45.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (53s) 5s ago 12m 8535k - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (49s) 44s ago 10m 5435k - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (9m) 5s ago 9m 187M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:08:22.243 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (9m) 5s ago 9m 192M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:08:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (8m) 5s ago 8m 171M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:08:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (8m) 44s ago 8m 224M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:08:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (8m) 44s ago 8m 198M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:08:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (7m) 44s ago 7m 190M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:08:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (30s) 5s ago 11m 46.8M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 msgr2=0x7fdf0006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 0x7fdf0006f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3b0 tx=0x7fdf10009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 msgr2=0x7fdf1410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdf04002a50 tx=0x7fdf040046b0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 shutdown_connections 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fdf0006d0e0 0x7fdf0006f590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fcef0 0x7fdf1410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 --2- 172.21.15.123:0/3351220476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe0e0 0x7fdf1410deb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 >> 172.21.15.123:0/3351220476 conn(0x7fdf140f8620 msgr2=0x7fdf141013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 shutdown_connections 2024-02-20T08:08:22.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.244+0000 7fdf1b489700 1 -- 172.21.15.123:0/3351220476 wait complete. 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- 172.21.15.123:0/2314051854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fcef0 msgr2=0x7f0cfc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 --2- 172.21.15.123:0/2314051854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc0fd320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009ce0 tx=0x7f0cf4004d10 comp rx=0 tx=0).stop 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- 172.21.15.123:0/2314051854 shutdown_connections 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 --2- 172.21.15.123:0/2314051854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 --2- 172.21.15.123:0/2314051854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc0fd320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- 172.21.15.123:0/2314051854 >> 172.21.15.123:0/2314051854 conn(0x7f0cfc0f8620 msgr2=0x7f0cfc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- 172.21.15.123:0/2314051854 shutdown_connections 2024-02-20T08:08:22.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- 172.21.15.123:0/2314051854 wait complete. 2024-02-20T08:08:22.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 Processor -- start 2024-02-20T08:08:22.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.345+0000 7f0d01086700 1 -- start start 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0d01086700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0d01086700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0d01086700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0708e0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0d01086700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc070a50 con 0x7f0cfc0fcef0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39008/0 (socket says 172.21.15.123:39008) 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 -- 172.21.15.123:0/443398133 learned_addr learned my addr 172.21.15.123:0/443398133 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfad9d700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 -- 172.21.15.123:0/443398133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fcef0 msgr2=0x7f0cfc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 -- 172.21.15.123:0/443398133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009940 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0cfa59c700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000eb70 tx=0x7f0cf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf0007cc0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cf000f040 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc070cd0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.346+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf000ca90 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.347+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc1159e0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.347+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc04bed0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.348+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f0cf000cbf0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.348+0000 7f0ce37fe700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 0x7f0ce406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.348+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0cf008c0a0 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.349+0000 7f0cfad9d700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 0x7f0ce406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.349+0000 7f0cfad9d700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 0x7f0ce406f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009cb0 tx=0x7f0cf4004d10 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.353+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0cf0059c70 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:21 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.629+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cfc105a50 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.630+0000 7f0ce37fe700 1 -- 172.21.15.123:0/443398133 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0cf0059800 con 0x7f0cfc0fe0e0 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:08:22.630 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 12, 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:08:22.631 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.632+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 msgr2=0x7f0ce406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.632+0000 7f0d01086700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 0x7f0ce406f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009cb0 tx=0x7f0cf4004d10 comp rx=0 tx=0).stop 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.632+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 msgr2=0x7f0cfc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.632+0000 7f0d01086700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000eb70 tx=0x7f0cf000b040 comp rx=0 tx=0).stop 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 shutdown_connections 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0ce406d0e0 0x7f0ce406f590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0fcef0 0x7f0cfc071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 --2- 172.21.15.123:0/443398133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cfc0fe0e0 0x7f0cfc0702e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 >> 172.21.15.123:0/443398133 conn(0x7f0cfc0f8620 msgr2=0x7f0cfc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 shutdown_connections 2024-02-20T08:08:22.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.633+0000 7f0d01086700 1 -- 172.21.15.123:0/443398133 wait complete. 2024-02-20T08:08:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 -- 172.21.15.123:0/1401022294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 msgr2=0x7f49bc0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 --2- 172.21.15.123:0/1401022294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc0fb630 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009ce0 tx=0x7f49b8004d10 comp rx=0 tx=0).stop 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 -- 172.21.15.123:0/1401022294 shutdown_connections 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 --2- 172.21.15.123:0/1401022294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc0fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 --2- 172.21.15.123:0/1401022294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc0fb630 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 -- 172.21.15.123:0/1401022294 >> 172.21.15.123:0/1401022294 conn(0x7f49bc0f6ca0 msgr2=0x7f49bc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 -- 172.21.15.123:0/1401022294 shutdown_connections 2024-02-20T08:08:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.735+0000 7f49c4251700 1 -- 172.21.15.123:0/1401022294 wait complete. 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 Processor -- start 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 -- start start 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc10e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc10e6c0 con 0x7f49bc0fb220 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c4251700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc10ef60 con 0x7f49bc0fe2b0 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39026/0 (socket says 172.21.15.123:39026) 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 -- 172.21.15.123:0/432215153 learned_addr learned my addr 172.21.15.123:0/432215153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c17ec700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc10e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 -- 172.21.15.123:0/432215153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 msgr2=0x7f49bc10e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc10e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 -- 172.21.15.123:0/432215153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8009940 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c17ec700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc10e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49c1fed700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f49b800bea0 tx=0x7f49b8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.736+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b800e040 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.737+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49b8008ea0 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.737+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc10f1e0 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.737+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b801c920 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.737+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc10f720 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.738+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc04bed0 con 0x7f49bc0fb220 2024-02-20T08:08:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.738+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f49b8012c70 con 0x7f49bc0fb220 2024-02-20T08:08:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.738+0000 7f49b27fc700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 0x7f49a806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.738+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f49b808e130 con 0x7f49bc0fb220 2024-02-20T08:08:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.738+0000 7f49c17ec700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 0x7f49a806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.739+0000 7f49c17ec700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 0x7f49a806f590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009fd0 tx=0x7f49ac00b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:22.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.744+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f49b805bd80 con 0x7f49bc0fb220 2024-02-20T08:08:22.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.974+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49bc10fb90 con 0x7f49a806d0e0 2024-02-20T08:08:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.975+0000 7f49b27fc700 1 -- 172.21.15.123:0/432215153 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f49bc10fb90 con 0x7f49a806d0e0 2024-02-20T08:08:22.975 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/2 daemons upgraded", 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading grafana daemons", 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:08:22.976 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.977+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 msgr2=0x7f49a806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.977+0000 7f49c4251700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 0x7f49a806f590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009fd0 tx=0x7f49ac00b040 comp rx=0 tx=0).stop 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.977+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 msgr2=0x7f49bc10db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.977+0000 7f49c4251700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f49b800bea0 tx=0x7f49b8004d10 comp rx=0 tx=0).stop 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 shutdown_connections 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f49a806d0e0 0x7f49a806f590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc0fb220 0x7f49bc10db80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 --2- 172.21.15.123:0/432215153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0fe2b0 0x7f49bc10e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 >> 172.21.15.123:0/432215153 conn(0x7f49bc0f6ca0 msgr2=0x7f49bc1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 shutdown_connections 2024-02-20T08:08:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:22.978+0000 7f49c4251700 1 -- 172.21.15.123:0/432215153 wait complete. 2024-02-20T08:08:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:22 smithi123 ceph-mon[29383]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:22 smithi123 ceph-mon[29383]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:22 smithi123 ceph-mon[29383]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:22 smithi123 ceph-mon[29383]: pgmap v59: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:23.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:22 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/443398133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:22 smithi194 ceph-mon[37804]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:22 smithi194 ceph-mon[37804]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:22 smithi194 ceph-mon[37804]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:22 smithi194 ceph-mon[37804]: pgmap v59: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:22 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/443398133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:23 smithi123 ceph-mon[29383]: Upgrade: Updating grafana.smithi123 2024-02-20T08:08:24.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:23 smithi123 ceph-mon[29383]: Deploying daemon grafana.smithi123 on smithi123 2024-02-20T08:08:24.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:23 smithi123 ceph-mon[29383]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:23 smithi194 ceph-mon[37804]: Upgrade: Updating grafana.smithi123 2024-02-20T08:08:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:23 smithi194 ceph-mon[37804]: Deploying daemon grafana.smithi123 on smithi123 2024-02-20T08:08:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:23 smithi194 ceph-mon[37804]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:24 smithi123 ceph-mon[29383]: pgmap v60: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:24 smithi194 ceph-mon[37804]: pgmap v60: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:27.585 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:27 smithi123 ceph-mon[29383]: pgmap v61: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:27 smithi194 ceph-mon[37804]: pgmap v61: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:28.659 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:28 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:28.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:28 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:28.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:28 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:28.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:28 smithi123 ceph-mon[29383]: pgmap v62: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:28 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:28 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:28 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:28 smithi194 ceph-mon[37804]: pgmap v62: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:31.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:30 smithi123 ceph-mon[29383]: pgmap v63: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:31.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:30 smithi194 ceph-mon[37804]: pgmap v63: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:33.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:33 smithi194 ceph-mon[37804]: pgmap v64: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:33.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:33 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:33.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:33 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:33.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:33 smithi123 ceph-mon[29383]: pgmap v64: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:33.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:33 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:33.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:33 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:34 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:34 smithi123 ceph-mon[29383]: pgmap v65: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:34 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:34 smithi194 ceph-mon[37804]: pgmap v65: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:37.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: pgmap v66: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:37.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:37.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:37.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:37.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:37.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:37 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: pgmap v66: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:37.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:37 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:08:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-20T08:08:38.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:38.649 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:38 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:08:38.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.660 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.661 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-20T08:08:38.662 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:38.663 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:38.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:08:38.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:08:38.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:08:38.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:38 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:39 smithi194 ceph-mon[37804]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:08:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:39 smithi194 ceph-mon[37804]: Upgrade: Finalizing container_image settings 2024-02-20T08:08:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:39 smithi194 ceph-mon[37804]: Upgrade: Complete! 2024-02-20T08:08:39.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:39 smithi194 ceph-mon[37804]: pgmap v67: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:39.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:39 smithi123 ceph-mon[29383]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-20T08:08:39.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:39 smithi123 ceph-mon[29383]: Upgrade: Finalizing container_image settings 2024-02-20T08:08:39.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:39 smithi123 ceph-mon[29383]: Upgrade: Complete! 2024-02-20T08:08:39.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:39 smithi123 ceph-mon[29383]: pgmap v67: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:40 smithi123 ceph-mon[29383]: pgmap v68: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:40 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:41.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:40 smithi194 ceph-mon[37804]: pgmap v68: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:41.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:40 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:08:43.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:43 smithi194 ceph-mon[37804]: pgmap v69: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:43.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:43 smithi123 ceph-mon[29383]: pgmap v69: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:45.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:45 smithi194 ceph-mon[37804]: pgmap v70: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:45.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:45 smithi123 ceph-mon[29383]: pgmap v70: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:46.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:46 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:46.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:46 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:08:47.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:47 smithi194 ceph-mon[37804]: pgmap v71: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:47.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:47 smithi123 ceph-mon[29383]: pgmap v71: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:49.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:49 smithi194 ceph-mon[37804]: pgmap v72: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:49.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:49 smithi123 ceph-mon[29383]: pgmap v72: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:50 smithi123 ceph-mon[29383]: pgmap v73: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:50 smithi194 ceph-mon[37804]: pgmap v73: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 -- 172.21.15.123:0/2812455215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fbe40 msgr2=0x7f9cf80fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2812455215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fbe40 0x7f9cf80fc250 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004940 tx=0x7f9cf0009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 -- 172.21.15.123:0/2812455215 shutdown_connections 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2812455215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2812455215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fbe40 0x7f9cf80fc250 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.099+0000 7f9d005dc700 1 -- 172.21.15.123:0/2812455215 >> 172.21.15.123:0/2812455215 conn(0x7f9cf80f7520 msgr2=0x7f9cf80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 -- 172.21.15.123:0/2812455215 shutdown_connections 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 -- 172.21.15.123:0/2812455215 wait complete. 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 Processor -- start 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 -- start start 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fbe40 0x7f9cf810c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf810d420 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9d005dc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf810dc60 con 0x7f9cf80fbe40 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.100+0000 7f9cfdb77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46480/0 (socket says 172.21.15.123:46480) 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 -- 172.21.15.123:0/2814710977 learned_addr learned my addr 172.21.15.123:0/2814710977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfe378700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fbe40 0x7f9cf810c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 -- 172.21.15.123:0/2814710977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fbe40 msgr2=0x7f9cf810c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fbe40 0x7f9cf810c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 -- 172.21.15.123:0/2814710977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0005040 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9cfdb77700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800b790 tx=0x7f9ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce800f770 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ce800fda0 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf810df40 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce800d310 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.101+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf810e480 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.102+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf804bed0 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.103+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f9ce8010420 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.103+0000 7f9ceeffd700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 0x7f9ce406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.103+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9ce808c4d0 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.103+0000 7f9cfe378700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 0x7f9ce406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.104+0000 7f9cfe378700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 0x7f9ce406f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004f90 tx=0x7f9cf0009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:53.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.108+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9ce805a1c0 con 0x7f9cf80fcfb0 2024-02-20T08:08:53.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.317+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cf810ea30 con 0x7f9ce406d0e0 2024-02-20T08:08:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.318+0000 7f9ceeffd700 1 -- 172.21.15.123:0/2814710977 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f9cf810ea30 con 0x7f9ce406d0e0 2024-02-20T08:08:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 msgr2=0x7f9ce406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 0x7f9ce406f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004f90 tx=0x7f9cf0009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 msgr2=0x7f9cf810cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800b790 tx=0x7f9ce8009250 comp rx=0 tx=0).stop 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 shutdown_connections 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9ce406d0e0 0x7f9ce406f590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf80fbe40 0x7f9cf810c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 --2- 172.21.15.123:0/2814710977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cf80fcfb0 0x7f9cf810cd90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 >> 172.21.15.123:0/2814710977 conn(0x7f9cf80f7520 msgr2=0x7f9cf8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 shutdown_connections 2024-02-20T08:08:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:53.320+0000 7f9d005dc700 1 -- 172.21.15.123:0/2814710977 wait complete. 2024-02-20T08:08:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:53 smithi123 ceph-mon[29383]: pgmap v74: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:53 smithi194 ceph-mon[37804]: pgmap v74: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:53.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-20T08:08:54.187 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:08:54.567 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:54 smithi123 ceph-mon[29383]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:54.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:54 smithi194 ceph-mon[37804]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:08:55.637 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:55 smithi123 ceph-mon[29383]: pgmap v75: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:55 smithi194 ceph-mon[37804]: pgmap v75: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 -- 172.21.15.123:0/196969396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 msgr2=0x7f71f40fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 --2- 172.21.15.123:0/196969396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f40fbea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f71dc004940 tx=0x7f71dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 -- 172.21.15.123:0/196969396 shutdown_connections 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 --2- 172.21.15.123:0/196969396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f40fbea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 --2- 172.21.15.123:0/196969396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 0x7f71f4102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 -- 172.21.15.123:0/196969396 >> 172.21.15.123:0/196969396 conn(0x7f71f4071d90 msgr2=0x7f71f4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 -- 172.21.15.123:0/196969396 shutdown_connections 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.871+0000 7f71fa104700 1 -- 172.21.15.123:0/196969396 wait complete. 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 Processor -- start 2024-02-20T08:08:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 -- start start 2024-02-20T08:08:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 0x7f71f410eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f410f620 con 0x7f71f41027e0 2024-02-20T08:08:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71fa104700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f410f790 con 0x7f71f4101e40 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46500/0 (socket says 172.21.15.123:46500) 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 -- 172.21.15.123:0/845054483 learned_addr learned my addr 172.21.15.123:0/845054483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71f37fe700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 0x7f71f410eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 -- 172.21.15.123:0/845054483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 msgr2=0x7f71f410eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 0x7f71f410eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.872+0000 7f71eaffd700 1 -- 172.21.15.123:0/845054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc005040 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71eaffd700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0090d0 tx=0x7f71dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71dc00e040 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71dc00bbf0 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f4117aa0 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71dc01c630 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.873+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f4117fb0 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.874+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4104310 con 0x7f71f41027e0 2024-02-20T08:08:55.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.874+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f71dc00bd60 con 0x7f71f41027e0 2024-02-20T08:08:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.875+0000 7f71f0ff9700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 0x7f71e006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.875+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f71dc08d8a0 con 0x7f71f41027e0 2024-02-20T08:08:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.875+0000 7f71f37fe700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 0x7f71e006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.875+0000 7f71f37fe700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 0x7f71e006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009fd0 tx=0x7f71e4009e90 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:55.879+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f71dc0579c0 con 0x7f71f41027e0 2024-02-20T08:08:56.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.154+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71f404bed0 con 0x7f71f41027e0 2024-02-20T08:08:56.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.155+0000 7f71f0ff9700 1 -- 172.21.15.123:0/845054483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f71dc013e60 con 0x7f71f41027e0 2024-02-20T08:08:56.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 msgr2=0x7f71e006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:56.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 0x7f71e006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009fd0 tx=0x7f71e4009e90 comp rx=0 tx=0).stop 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 msgr2=0x7f71f410f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0090d0 tx=0x7f71dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 shutdown_connections 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f71e006d0e0 0x7f71e006f590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101e40 0x7f71f410eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 --2- 172.21.15.123:0/845054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71f41027e0 0x7f71f410f070 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 >> 172.21.15.123:0/845054483 conn(0x7f71f4071d90 msgr2=0x7f71f40fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 shutdown_connections 2024-02-20T08:08:56.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:56.157+0000 7f71fa104700 1 -- 172.21.15.123:0/845054483 wait complete. 2024-02-20T08:08:56.168 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:08:56.641 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:56 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/845054483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:56.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:56 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/845054483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:56.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-20T08:08:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:08:57.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:57 smithi123 ceph-mon[29383]: pgmap v76: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:57.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:57 smithi194 ceph-mon[37804]: pgmap v76: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 -- 172.21.15.123:0/2926572991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12600fb570 msgr2=0x7f12600fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 --2- 172.21.15.123:0/2926572991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12600fb570 0x7f12600fb9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1254004940 tx=0x7f1254009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 -- 172.21.15.123:0/2926572991 shutdown_connections 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 --2- 172.21.15.123:0/2926572991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12600fb570 0x7f12600fb9c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 --2- 172.21.15.123:0/2926572991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1260103140 0x7f1260103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 -- 172.21.15.123:0/2926572991 >> 172.21.15.123:0/2926572991 conn(0x7f1260071560 msgr2=0x7f1260071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 -- 172.21.15.123:0/2926572991 shutdown_connections 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.736+0000 7f1266115700 1 -- 172.21.15.123:0/2926572991 wait complete. 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 Processor -- start 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 -- start start 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600fb570 0x7f1260113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260114710 con 0x7f1260103140 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f1266115700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126010da40 con 0x7f12600fb570 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f125effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.737+0000 7f125effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39342/0 (socket says 172.21.15.123:39342) 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125effd700 1 -- 172.21.15.123:0/1507859784 learned_addr learned my addr 172.21.15.123:0/1507859784 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125f7fe700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600fb570 0x7f1260113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125effd700 1 -- 172.21.15.123:0/1507859784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600fb570 msgr2=0x7f1260113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125effd700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600fb570 0x7f1260113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125effd700 1 -- 172.21.15.123:0/1507859784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254005040 con 0x7f1260103140 2024-02-20T08:08:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f125effd700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1254009100 tx=0x7f1254009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125400e040 con 0x7f1260103140 2024-02-20T08:08:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1254004290 con 0x7f1260103140 2024-02-20T08:08:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126010dcc0 con 0x7f1260103140 2024-02-20T08:08:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125401c630 con 0x7f1260103140 2024-02-20T08:08:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.738+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126010e200 con 0x7f1260103140 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.739+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12601054d0 con 0x7f1260103140 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.740+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f125400bbf0 con 0x7f1260103140 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.740+0000 7f1247fff700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 0x7f124806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.740+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f125408d8c0 con 0x7f1260103140 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.740+0000 7f125f7fe700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 0x7f124806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:08:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.741+0000 7f125f7fe700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 0x7f124806f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1250004bc0 tx=0x7f1250009040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:08:58.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:58.745+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f125405b510 con 0x7f1260103140 2024-02-20T08:08:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.017+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f126010f160 con 0x7f1260103140 2024-02-20T08:08:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.018+0000 7f1247fff700 1 -- 172.21.15.123:0/1507859784 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f125405b0a0 con 0x7f1260103140 2024-02-20T08:08:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 msgr2=0x7f124806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 0x7f124806f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1250004bc0 tx=0x7f1250009040 comp rx=0 tx=0).stop 2024-02-20T08:08:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 msgr2=0x7f12601140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1254009100 tx=0x7f1254009e30 comp rx=0 tx=0).stop 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 shutdown_connections 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f124806d0e0 0x7f124806f590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600fb570 0x7f1260113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 --2- 172.21.15.123:0/1507859784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260103140 0x7f12601140c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 >> 172.21.15.123:0/1507859784 conn(0x7f1260071560 msgr2=0x7f12600f97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 shutdown_connections 2024-02-20T08:08:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:08:59.020+0000 7f1266115700 1 -- 172.21.15.123:0/1507859784 wait complete. 2024-02-20T08:08:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)" 2024-02-20T08:08:59.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:59 smithi194 ceph-mon[37804]: pgmap v77: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:59.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:08:59 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1507859784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:59.693 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:59 smithi123 ceph-mon[29383]: pgmap v77: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:08:59.693 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:08:59 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1507859784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:08:59.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-20T08:08:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:01.092 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:00 smithi123 ceph-mon[29383]: pgmap v78: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:01.092 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:00 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:00 smithi194 ceph-mon[37804]: pgmap v78: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:01.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:00 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 -- 172.21.15.123:0/3124464439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 msgr2=0x7f10dc103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 --2- 172.21.15.123:0/3124464439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc103510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f10cc004940 tx=0x7f10cc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 -- 172.21.15.123:0/3124464439 shutdown_connections 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 --2- 172.21.15.123:0/3124464439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 0x7f10dc0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 --2- 172.21.15.123:0/3124464439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc103510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 -- 172.21.15.123:0/3124464439 >> 172.21.15.123:0/3124464439 conn(0x7f10dc071560 msgr2=0x7f10dc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 -- 172.21.15.123:0/3124464439 shutdown_connections 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.657+0000 7f10e1b94700 1 -- 172.21.15.123:0/3124464439 wait complete. 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 Processor -- start 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 -- start start 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 0x7f10dc0fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0fd320 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10e1b94700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0fd490 con 0x7f10dc0fb570 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39358/0 (socket says 172.21.15.123:39358) 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.658+0000 7f10daffd700 1 -- 172.21.15.123:0/1205738021 learned_addr learned my addr 172.21.15.123:0/1205738021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10db7fe700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 0x7f10dc0fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10daffd700 1 -- 172.21.15.123:0/1205738021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 msgr2=0x7f10dc0fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10daffd700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 0x7f10dc0fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10daffd700 1 -- 172.21.15.123:0/1205738021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc005040 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10daffd700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f10d000b790 tx=0x7f10d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d000f770 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc119e90 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10d000fda0 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d000d310 con 0x7f10dc103140 2024-02-20T08:09:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.659+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc11a350 con 0x7f10dc103140 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.660+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc073080 con 0x7f10dc103140 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.660+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f10d0010420 con 0x7f10dc103140 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.661+0000 7f10c3fff700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 0x7f10c406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.661+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f10d008c580 con 0x7f10dc103140 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.661+0000 7f10db7fe700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 0x7f10c406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.661+0000 7f10db7fe700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 0x7f10c406f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10cc004f90 tx=0x7f10cc009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:01.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.665+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f10d00566a0 con 0x7f10dc103140 2024-02-20T08:09:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.938+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10dc105550 con 0x7f10dc103140 2024-02-20T08:09:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.938+0000 7f10c3fff700 1 -- 172.21.15.123:0/1205738021 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f10d0059d60 con 0x7f10dc103140 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 msgr2=0x7f10c406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 0x7f10c406f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10cc004f90 tx=0x7f10cc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 msgr2=0x7f10dc0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f10d000b790 tx=0x7f10d0009250 comp rx=0 tx=0).stop 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 shutdown_connections 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f10c406d0e0 0x7f10c406f590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10dc0fb570 0x7f10dc0fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 --2- 172.21.15.123:0/1205738021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10dc103140 0x7f10dc0fcc90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 >> 172.21.15.123:0/1205738021 conn(0x7f10dc071560 msgr2=0x7f10dc0f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 shutdown_connections 2024-02-20T08:09:01.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:01.940+0000 7f10e1b94700 1 -- 172.21.15.123:0/1205738021 wait complete. 2024-02-20T08:09:01.951 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:09:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:01 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/1205738021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:02.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:01 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/1205738021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:02.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-20T08:09:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:03.244 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:02 smithi123 ceph-mon[29383]: pgmap v79: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:03.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:02 smithi194 ceph-mon[37804]: pgmap v79: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 -- 172.21.15.123:0/512499795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 msgr2=0x7f6b08106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 --2- 172.21.15.123:0/512499795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08106f40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6afc004940 tx=0x7f6afc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 -- 172.21.15.123:0/512499795 shutdown_connections 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 --2- 172.21.15.123:0/512499795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08106f40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 --2- 172.21.15.123:0/512499795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b080fdf60 0x7f6b080fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.493+0000 7f6b0e297700 1 -- 172.21.15.123:0/512499795 >> 172.21.15.123:0/512499795 conn(0x7f6b080f7a10 msgr2=0x7f6b080f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.494+0000 7f6b0e297700 1 -- 172.21.15.123:0/512499795 shutdown_connections 2024-02-20T08:09:04.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.494+0000 7f6b0e297700 1 -- 172.21.15.123:0/512499795 wait complete. 2024-02-20T08:09:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.494+0000 7f6b0e297700 1 Processor -- start 2024-02-20T08:09:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.494+0000 7f6b0e297700 1 -- start start 2024-02-20T08:09:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b080fdf60 0x7f6b08113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08114640 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0810d970 con 0x7f6b080fdf60 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39378/0 (socket says 172.21.15.123:39378) 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 -- 172.21.15.123:0/2988832630 learned_addr learned my addr 172.21.15.123:0/2988832630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 -- 172.21.15.123:0/2988832630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b080fdf60 msgr2=0x7f6b08113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b080fdf60 0x7f6b08113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 -- 172.21.15.123:0/2988832630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc005040 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b077fe700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009180 tx=0x7f6afc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6afc00e040 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6afc004290 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6afc01c630 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0810dbf0 con 0x7f6b080fe900 2024-02-20T08:09:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.495+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0810e130 con 0x7f6b080fe900 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.496+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b08104550 con 0x7f6b080fe900 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.497+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f6afc0139f0 con 0x7f6b080fe900 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.497+0000 7f6b04ff9700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 0x7f6af006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.497+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6afc08da80 con 0x7f6b080fe900 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.497+0000 7f6b07fff700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 0x7f6af006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.498+0000 7f6b07fff700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 0x7f6af006f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009b80 tx=0x7f6af8009d60 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:04.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.502+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6afc05b6d0 con 0x7f6b080fe900 2024-02-20T08:09:04.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:04.713+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b08109ff0 con 0x7f6af006d0f0 2024-02-20T08:09:05.630 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:05 smithi123 ceph-mon[29383]: pgmap v80: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:05 smithi194 ceph-mon[37804]: pgmap v80: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:06 smithi194 ceph-mon[37804]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:06.744 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:06 smithi123 ceph-mon[29383]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:06.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.784+0000 7f6b04ff9700 1 -- 172.21.15.123:0/2988832630 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f6b08109ff0 con 0x7f6af006d0f0 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 msgr2=0x7f6af006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 0x7f6af006f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009b80 tx=0x7f6af8009d60 comp rx=0 tx=0).stop 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 msgr2=0x7f6b08113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009180 tx=0x7f6afc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 shutdown_connections 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.786+0000 7f6b0e297700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6af006d0f0 0x7f6af006f5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.787+0000 7f6b0e297700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b080fdf60 0x7f6b08113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.787+0000 7f6b0e297700 1 --2- 172.21.15.123:0/2988832630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b080fe900 0x7f6b08113ff0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.787+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 >> 172.21.15.123:0/2988832630 conn(0x7f6b080f7a10 msgr2=0x7f6b081016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.787+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 shutdown_connections 2024-02-20T08:09:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:06.787+0000 7f6b0e297700 1 -- 172.21.15.123:0/2988832630 wait complete. 2024-02-20T08:09:06.798 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:09:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:07 smithi194 ceph-mon[37804]: pgmap v81: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:07.664 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:07 smithi123 ceph-mon[29383]: pgmap v81: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:07.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch ps' 2024-02-20T08:09:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 -- 172.21.15.123:0/1148418133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 msgr2=0x7f70e8102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 --2- 172.21.15.123:0/1148418133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8102230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70d8004940 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 -- 172.21.15.123:0/1148418133 shutdown_connections 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 --2- 172.21.15.123:0/1148418133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 0x7f70e80fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 --2- 172.21.15.123:0/1148418133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8102230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 -- 172.21.15.123:0/1148418133 >> 172.21.15.123:0/1148418133 conn(0x7f70e80f7a10 msgr2=0x7f70e80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 -- 172.21.15.123:0/1148418133 shutdown_connections 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.581+0000 7f70efeaa700 1 -- 172.21.15.123:0/1148418133 wait complete. 2024-02-20T08:09:09.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 Processor -- start 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 -- start start 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 0x7f70e8112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81135a0 con 0x7f70e8101e60 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70efeaa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e810c8d0 con 0x7f70e8102800 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60000/0 (socket says 172.21.15.123:60000) 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 -- 172.21.15.123:0/3911875568 learned_addr learned my addr 172.21.15.123:0/3911875568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70ed445700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 0x7f70e8112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 -- 172.21.15.123:0/3911875568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 msgr2=0x7f70e8112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 0x7f70e8112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 -- 172.21.15.123:0/3911875568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8005040 con 0x7f70e8101e60 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.582+0000 7f70edc46700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009fd0 tx=0x7f70d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:09.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d800e040 con 0x7f70e8101e60 2024-02-20T08:09:09.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70d800bbf0 con 0x7f70e8101e60 2024-02-20T08:09:09.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e810cb50 con 0x7f70e8101e60 2024-02-20T08:09:09.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e810d090 con 0x7f70e8101e60 2024-02-20T08:09:09.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d801c3f0 con 0x7f70e8101e60 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.583+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80ff170 con 0x7f70e8101e60 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.584+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f70d800bd60 con 0x7f70e8101e60 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.584+0000 7f70de7fc700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 0x7f70d406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.585+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f70d808d8b0 con 0x7f70e8101e60 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.585+0000 7f70ed445700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 0x7f70d406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:09.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.585+0000 7f70ed445700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 0x7f70d406f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f70e810e240 tx=0x7f70e4009ee0 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:09.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.589+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f70d805b500 con 0x7f70e8101e60 2024-02-20T08:09:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:09 smithi194 ceph-mon[37804]: pgmap v82: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:09.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:09 smithi123 ceph-mon[29383]: pgmap v82: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.791+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f70e804bed0 con 0x7f70d406d0f0 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.801+0000 7f70de7fc700 1 -- 172.21.15.123:0/3911875568 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f70e804bed0 con 0x7f70d406d0f0 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (58s) 37s ago 12m 16.2M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (13m) 37s ago 13m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (11m) 92s ago 11m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (42s) 37s ago 12m 55.2M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (6m) 37s ago 6m 12.9M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:09:09.801 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (6m) 37s ago 6m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (6m) 92s ago 6m 15.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (6m) 92s ago 6m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (3m) 37s ago 14m 499M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (2m) 92s ago 11m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (14m) 37s ago 14m 55.3M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (11m) 92s ago 11m 45.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (101s) 37s ago 12m 8698k - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (96s) 92s ago 11m 5435k - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (10m) 37s ago 10m 188M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (10m) 37s ago 10m 192M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (9m) 37s ago 9m 171M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (9m) 92s ago 9m 224M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (8m) 92s ago 8m 198M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:09:09.802 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (8m) 92s ago 8m 190M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:09:09.803 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (77s) 37s ago 11m 46.9M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:09:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.802+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 msgr2=0x7f70d406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 0x7f70d406f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f70e810e240 tx=0x7f70e4009ee0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 msgr2=0x7f70e8112a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009fd0 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 shutdown_connections 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f70d406d0f0 0x7f70d406f5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70e8101e60 0x7f70e8112a10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 --2- 172.21.15.123:0/3911875568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8102800 0x7f70e8112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 >> 172.21.15.123:0/3911875568 conn(0x7f70e80f7a10 msgr2=0x7f70e80f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 shutdown_connections 2024-02-20T08:09:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:09.803+0000 7f70efeaa700 1 -- 172.21.15.123:0/3911875568 wait complete. 2024-02-20T08:09:10.428 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-20T08:09:10.429 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:09:10.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-20T08:09:10.686 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:11.149 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:10 smithi123 ceph-mon[29383]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:11.150 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:10 smithi123 ceph-mon[29383]: pgmap v83: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:11.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:10 smithi194 ceph-mon[37804]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:10 smithi194 ceph-mon[37804]: pgmap v83: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.324+0000 7f12a8f20700 1 -- 172.21.15.123:0/2007844863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a4102f50 msgr2=0x7f12a4103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.324+0000 7f12a8f20700 1 --2- 172.21.15.123:0/2007844863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a4102f50 0x7f12a4103320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1294004940 tx=0x7f1294009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- 172.21.15.123:0/2007844863 shutdown_connections 2024-02-20T08:09:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 --2- 172.21.15.123:0/2007844863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a41038f0 0x7f12a40fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 --2- 172.21.15.123:0/2007844863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a4102f50 0x7f12a4103320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- 172.21.15.123:0/2007844863 >> 172.21.15.123:0/2007844863 conn(0x7f12a40f8ae0 msgr2=0x7f12a40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- 172.21.15.123:0/2007844863 shutdown_connections 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- 172.21.15.123:0/2007844863 wait complete. 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 Processor -- start 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- start start 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4102f50 0x7f12a4113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4114700 con 0x7f12a41038f0 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.325+0000 7f12a8f20700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a410d9a0 con 0x7f12a4102f50 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60026/0 (socket says 172.21.15.123:60026) 2024-02-20T08:09:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 -- 172.21.15.123:0/768673279 learned_addr learned my addr 172.21.15.123:0/768673279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a259c700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4102f50 0x7f12a4113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 -- 172.21.15.123:0/768673279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4102f50 msgr2=0x7f12a4113ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4102f50 0x7f12a4113ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 -- 172.21.15.123:0/768673279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294005040 con 0x7f12a41038f0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a1d9b700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f129800b790 tx=0x7f1298009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129800f6f0 con 0x7f12a41038f0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f129800fd20 con 0x7f12a41038f0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a410dc80 con 0x7f12a41038f0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12980103a0 con 0x7f12a41038f0 2024-02-20T08:09:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.326+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a410e1c0 con 0x7f12a41038f0 2024-02-20T08:09:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.327+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40fc6e0 con 0x7f12a41038f0 2024-02-20T08:09:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.328+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f1298011400 con 0x7f12a41038f0 2024-02-20T08:09:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.328+0000 7f1292ffd700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 0x7f128c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.328+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f129808c3e0 con 0x7f12a41038f0 2024-02-20T08:09:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.328+0000 7f12a259c700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 0x7f128c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.329+0000 7f12a259c700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 0x7f128c06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1294004f90 tx=0x7f1294009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:12.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.333+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1298059fb0 con 0x7f12a41038f0 2024-02-20T08:09:12.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.525+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f12a404bed0 con 0x7f12a41038f0 2024-02-20T08:09:12.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.529+0000 7f1292ffd700 1 -- 172.21.15.123:0/768673279 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1298059b40 con 0x7f12a41038f0 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 msgr2=0x7f128c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 0x7f128c06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1294004f90 tx=0x7f1294009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 msgr2=0x7f12a4114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f129800b790 tx=0x7f1298009220 comp rx=0 tx=0).stop 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 shutdown_connections 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f128c06d0e0 0x7f128c06f590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4102f50 0x7f12a4113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 --2- 172.21.15.123:0/768673279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12a41038f0 0x7f12a4114020 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 >> 172.21.15.123:0/768673279 conn(0x7f12a40f8ae0 msgr2=0x7f12a40fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 shutdown_connections 2024-02-20T08:09:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:12.531+0000 7f12a8f20700 1 -- 172.21.15.123:0/768673279 wait complete. 2024-02-20T08:09:13.194 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-20T08:09:13.195 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:09:13.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-20T08:09:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:13.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: pgmap v84: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:13.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/768673279' entity='client.admin' 2024-02-20T08:09:13.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:13 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: pgmap v84: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/768673279' entity='client.admin' 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:13.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:13 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 -- 172.21.15.123:0/65805606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 msgr2=0x7f0ec8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 --2- 172.21.15.123:0/65805606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec8103510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004940 tx=0x7f0ec4009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 -- 172.21.15.123:0/65805606 shutdown_connections 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 --2- 172.21.15.123:0/65805606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 0x7f0ec80fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 --2- 172.21.15.123:0/65805606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec8103510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 -- 172.21.15.123:0/65805606 >> 172.21.15.123:0/65805606 conn(0x7f0ec8071560 msgr2=0x7f0ec8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 -- 172.21.15.123:0/65805606 shutdown_connections 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.187+0000 7f0ecf558700 1 -- 172.21.15.123:0/65805606 wait complete. 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 Processor -- start 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 -- start start 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 0x7f0ec8113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec81147b0 con 0x7f0ec8103140 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecf558700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec810da50 con 0x7f0ec80fb570 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60034/0 (socket says 172.21.15.123:60034) 2024-02-20T08:09:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 -- 172.21.15.123:0/1315674687 learned_addr learned my addr 172.21.15.123:0/1315674687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0ecd2f4700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 0x7f0ec8113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 -- 172.21.15.123:0/1315674687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 msgr2=0x7f0ec8113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 0x7f0ec8113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 -- 172.21.15.123:0/1315674687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4005040 con 0x7f0ec8103140 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.188+0000 7f0eccaf3700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b790 tx=0x7f0eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.189+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb800f770 con 0x7f0ec8103140 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.189+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eb800fda0 con 0x7f0ec8103140 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.189+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec810dd30 con 0x7f0ec8103140 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.189+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb800d310 con 0x7f0ec8103140 2024-02-20T08:09:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.189+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec810e270 con 0x7f0ec8103140 2024-02-20T08:09:15.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.190+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec8073080 con 0x7f0ec8103140 2024-02-20T08:09:15.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.190+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f0eb8010420 con 0x7f0ec8103140 2024-02-20T08:09:15.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.191+0000 7f0ebdffb700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 0x7f0eb406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:15.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.191+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0eb808c5b0 con 0x7f0ec8103140 2024-02-20T08:09:15.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.191+0000 7f0ecd2f4700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 0x7f0eb406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:15.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.191+0000 7f0ecd2f4700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 0x7f0eb406f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004f90 tx=0x7f0ec4009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:15.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.195+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0eb805a200 con 0x7f0ec8103140 2024-02-20T08:09:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.392+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0ec8105580 con 0x7f0ec8103140 2024-02-20T08:09:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.392+0000 7f0ebdffb700 1 -- 172.21.15.123:0/1315674687 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0eb8059d90 con 0x7f0ec8103140 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 msgr2=0x7f0eb406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 0x7f0eb406f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004f90 tx=0x7f0ec4009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 msgr2=0x7f0ec81140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b790 tx=0x7f0eb8009250 comp rx=0 tx=0).stop 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 shutdown_connections 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f0eb406d0e0 0x7f0eb406f590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec80fb570 0x7f0ec8113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 --2- 172.21.15.123:0/1315674687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ec8103140 0x7f0ec81140d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 >> 172.21.15.123:0/1315674687 conn(0x7f0ec8071560 msgr2=0x7f0ec80f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 shutdown_connections 2024-02-20T08:09:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:15.394+0000 7f0ecf558700 1 -- 172.21.15.123:0/1315674687 wait complete. 2024-02-20T08:09:15.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:15 smithi123 ceph-mon[29383]: pgmap v85: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:15 smithi194 ceph-mon[37804]: pgmap v85: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:16.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-20T08:09:16.304 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:16.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:16 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:16.671 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:16 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:17.391 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:17 smithi123 ceph-mon[29383]: pgmap v86: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:17 smithi194 ceph-mon[37804]: pgmap v86: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 -- 172.21.15.123:0/446160617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 msgr2=0x7f9b840fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 --2- 172.21.15.123:0/446160617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b840fb9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b78004940 tx=0x7f9b78009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 -- 172.21.15.123:0/446160617 shutdown_connections 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 --2- 172.21.15.123:0/446160617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b840fb9c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 --2- 172.21.15.123:0/446160617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 0x7f9b84103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 -- 172.21.15.123:0/446160617 >> 172.21.15.123:0/446160617 conn(0x7f9b84071560 msgr2=0x7f9b84071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 -- 172.21.15.123:0/446160617 shutdown_connections 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 -- 172.21.15.123:0/446160617 wait complete. 2024-02-20T08:09:17.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.903+0000 7f9b891db700 1 Processor -- start 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b891db700 1 -- start start 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b891db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b891db700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 0x7f9b841140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b891db700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84114720 con 0x7f9b840fb570 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b891db700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8410da50 con 0x7f9b84103140 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60060/0 (socket says 172.21.15.123:60060) 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 -- 172.21.15.123:0/2679649800 learned_addr learned my addr 172.21.15.123:0/2679649800 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 -- 172.21.15.123:0/2679649800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 msgr2=0x7f9b841140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b8259c700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 0x7f9b841140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 0x7f9b841140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 -- 172.21.15.123:0/2679649800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78005040 con 0x7f9b840fb570 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b82d9d700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c8c0 tx=0x7f9b740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:17.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.904+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b7400a980 con 0x7f9b840fb570 2024-02-20T08:09:17.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.905+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8410dd30 con 0x7f9b840fb570 2024-02-20T08:09:17.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.905+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b7400ce60 con 0x7f9b840fb570 2024-02-20T08:09:17.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.905+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b740115e0 con 0x7f9b840fb570 2024-02-20T08:09:17.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.905+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8410e270 con 0x7f9b840fb570 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.905+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b841054d0 con 0x7f9b840fb570 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.906+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f9b74012400 con 0x7f9b840fb570 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.906+0000 7f9b6b7fe700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 0x7f9b6c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.907+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9b7408c550 con 0x7f9b840fb570 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.907+0000 7f9b8259c700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 0x7f9b6c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:17.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.907+0000 7f9b8259c700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 0x7f9b6c06f590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009fd0 tx=0x7f9b78009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:17.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:17.911+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9b7405a240 con 0x7f9b840fb570 2024-02-20T08:09:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.105+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f9b8404bed0 con 0x7f9b840fb570 2024-02-20T08:09:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.105+0000 7f9b6b7fe700 1 -- 172.21.15.123:0/2679649800 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9b740126b0 con 0x7f9b840fb570 2024-02-20T08:09:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 msgr2=0x7f9b6c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 0x7f9b6c06f590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009fd0 tx=0x7f9b78009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 msgr2=0x7f9b84113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c8c0 tx=0x7f9b740044c0 comp rx=0 tx=0).stop 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 shutdown_connections 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9b6c06d0e0 0x7f9b6c06f590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b840fb570 0x7f9b84113b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 --2- 172.21.15.123:0/2679649800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103140 0x7f9b841140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 >> 172.21.15.123:0/2679649800 conn(0x7f9b84071560 msgr2=0x7f9b840f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 shutdown_connections 2024-02-20T08:09:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:18.107+0000 7f9b891db700 1 -- 172.21.15.123:0/2679649800 wait complete. 2024-02-20T08:09:18.724 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-20T08:09:18.979 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:19.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:19 smithi194 ceph-mon[37804]: pgmap v87: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:19.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:19 smithi123 ceph-mon[29383]: pgmap v87: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:20.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 -- 172.21.15.123:0/1943869864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 msgr2=0x7f14981022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:20.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 --2- 172.21.15.123:0/1943869864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f14981022c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f148c004940 tx=0x7f148c009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 -- 172.21.15.123:0/1943869864 shutdown_connections 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 --2- 172.21.15.123:0/1943869864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 0x7f14980fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 --2- 172.21.15.123:0/1943869864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f14981022c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 -- 172.21.15.123:0/1943869864 >> 172.21.15.123:0/1943869864 conn(0x7f1498071560 msgr2=0x7f1498071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 -- 172.21.15.123:0/1943869864 shutdown_connections 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.518+0000 7f149e520700 1 -- 172.21.15.123:0/1943869864 wait complete. 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 Processor -- start 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 -- start start 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 0x7f1498103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1498103870 con 0x7f1498101ef0 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f149e520700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14981039e0 con 0x7f1498102890 2024-02-20T08:09:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f1497fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f1497fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56008/0 (socket says 172.21.15.123:56008) 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f1497fff700 1 -- 172.21.15.123:0/675299664 learned_addr learned my addr 172.21.15.123:0/675299664 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.519+0000 7f14977fe700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 0x7f1498103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1497fff700 1 -- 172.21.15.123:0/675299664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 msgr2=0x7f1498103270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1497fff700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 0x7f1498103270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1497fff700 1 -- 172.21.15.123:0/675299664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c005040 con 0x7f1498101ef0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1497fff700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b3b0 tx=0x7f148c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f148c00e040 con 0x7f1498101ef0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f148c00bbf0 con 0x7f1498101ef0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1498119c80 con 0x7f1498101ef0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f148c01c3f0 con 0x7f1498101ef0 2024-02-20T08:09:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.520+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149811a0e0 con 0x7f1498101ef0 2024-02-20T08:09:20.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.521+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498100260 con 0x7f1498101ef0 2024-02-20T08:09:20.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.522+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f148c00bd60 con 0x7f1498101ef0 2024-02-20T08:09:20.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.522+0000 7f1494ff9700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 0x7f148006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:20.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.522+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f148c08d7c0 con 0x7f1498101ef0 2024-02-20T08:09:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.522+0000 7f14977fe700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 0x7f148006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.523+0000 7f14977fe700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 0x7f148006f590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1498104730 tx=0x7f148800b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.527+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f148c057980 con 0x7f1498101ef0 2024-02-20T08:09:20.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.717+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f1498073080 con 0x7f1498101ef0 2024-02-20T08:09:20.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.717+0000 7f1494ff9700 1 -- 172.21.15.123:0/675299664 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f148c05b040 con 0x7f1498101ef0 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.719+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 msgr2=0x7f148006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.719+0000 7f149e520700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 0x7f148006f590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1498104730 tx=0x7f148800b040 comp rx=0 tx=0).stop 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.719+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 msgr2=0x7f1498102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b3b0 tx=0x7f148c009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 shutdown_connections 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f148006d0e0 0x7f148006f590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1498101ef0 0x7f1498102d30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 --2- 172.21.15.123:0/675299664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1498102890 0x7f1498103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 >> 172.21.15.123:0/675299664 conn(0x7f1498071560 msgr2=0x7f1498106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 shutdown_connections 2024-02-20T08:09:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:20.720+0000 7f149e520700 1 -- 172.21.15.123:0/675299664 wait complete. 2024-02-20T08:09:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:20 smithi123 ceph-mon[29383]: pgmap v88: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:21.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-20T08:09:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:20 smithi194 ceph-mon[37804]: pgmap v88: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:23.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- 172.21.15.123:0/4235430281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c103140 msgr2=0x7f820c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 --2- 172.21.15.123:0/4235430281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c103140 0x7f820c103510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8208004940 tx=0x7f8208009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- 172.21.15.123:0/4235430281 shutdown_connections 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 --2- 172.21.15.123:0/4235430281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c0fb570 0x7f820c0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 --2- 172.21.15.123:0/4235430281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c103140 0x7f820c103510 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- 172.21.15.123:0/4235430281 >> 172.21.15.123:0/4235430281 conn(0x7f820c071560 msgr2=0x7f820c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- 172.21.15.123:0/4235430281 shutdown_connections 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- 172.21.15.123:0/4235430281 wait complete. 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 Processor -- start 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.282+0000 7f821404e700 1 -- start start 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c103140 0x7f820c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c1146a0 con 0x7f820c0fb570 2024-02-20T08:09:23.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c10d9d0 con 0x7f820c103140 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56034/0 (socket says 172.21.15.123:56034) 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 -- 172.21.15.123:0/2286560155 learned_addr learned my addr 172.21.15.123:0/2286560155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f82115e9700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c103140 0x7f820c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 -- 172.21.15.123:0/2286560155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c103140 msgr2=0x7f820c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c103140 0x7f820c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 -- 172.21.15.123:0/2286560155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208005040 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f8211dea700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8208009100 tx=0x7f8208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820800e040 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c10dc50 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8208013420 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820800bee0 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.283+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c10e190 con 0x7f820c0fb570 2024-02-20T08:09:23.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.284+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c100310 con 0x7f820c0fb570 2024-02-20T08:09:23.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.285+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f820800ba10 con 0x7f820c0fb570 2024-02-20T08:09:23.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.285+0000 7f82027fc700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 0x7f81f806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:23.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.285+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f820808d850 con 0x7f820c0fb570 2024-02-20T08:09:23.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.285+0000 7f82115e9700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 0x7f81f806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:23.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.286+0000 7f82115e9700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 0x7f81f806f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f820c10f340 tx=0x7f81fc009040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:23.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.290+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f820805b4a0 con 0x7f820c0fb570 2024-02-20T08:09:23.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.504+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}) v1 -- 0x7f820c04bed0 con 0x7f81f806d0e0 2024-02-20T08:09:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.510+0000 7f82027fc700 1 -- 172.21.15.123:0/2286560155 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f820c04bed0 con 0x7f81f806d0e0 2024-02-20T08:09:23.510 INFO:teuthology.orchestra.run.smithi123.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:09:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 msgr2=0x7f81f806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 0x7f81f806f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f820c10f340 tx=0x7f81fc009040 comp rx=0 tx=0).stop 2024-02-20T08:09:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 msgr2=0x7f820c113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8208009100 tx=0x7f8208009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 shutdown_connections 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f81f806d0e0 0x7f81f806f590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820c0fb570 0x7f820c113b10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 --2- 172.21.15.123:0/2286560155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c103140 0x7f820c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 >> 172.21.15.123:0/2286560155 conn(0x7f820c071560 msgr2=0x7f820c0fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 shutdown_connections 2024-02-20T08:09:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:23.512+0000 7f821404e700 1 -- 172.21.15.123:0/2286560155 wait complete. 2024-02-20T08:09:23.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:23 smithi194 ceph-mon[37804]: pgmap v89: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:23.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:23 smithi123 ceph-mon[29383]: pgmap v89: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:24.121 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-20T08:09:24.122 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:09:24.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-20T08:09:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:09:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:09:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:09:24.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:24 smithi123 ceph-mon[29383]: pgmap v90: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:09:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:91ff50e903dcc99ee3ecf9523050878eb452da5c 2024-02-20T08:09:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:24 smithi194 ceph-mon[37804]: pgmap v90: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.112+0000 7f6ae6748700 1 -- 172.21.15.123:0/736365630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae0102f50 msgr2=0x7f6ae0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.112+0000 7f6ae6748700 1 --2- 172.21.15.123:0/736365630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae0102f50 0x7f6ae0103320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0004940 tx=0x7f6ad0009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 -- 172.21.15.123:0/736365630 shutdown_connections 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 --2- 172.21.15.123:0/736365630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae01038f0 0x7f6ae00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 --2- 172.21.15.123:0/736365630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae0102f50 0x7f6ae0103320 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 -- 172.21.15.123:0/736365630 >> 172.21.15.123:0/736365630 conn(0x7f6ae00f8ae0 msgr2=0x7f6ae00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 -- 172.21.15.123:0/736365630 shutdown_connections 2024-02-20T08:09:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 -- 172.21.15.123:0/736365630 wait complete. 2024-02-20T08:09:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 Processor -- start 2024-02-20T08:09:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.113+0000 7f6ae6748700 1 -- start start 2024-02-20T08:09:27.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6ae6748700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae0102f50 0x7f6ae0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6ae6748700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6ae6748700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae01145f0 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6ae6748700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae010d920 con 0x7f6ae0102f50 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56044/0 (socket says 172.21.15.123:56044) 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 -- 172.21.15.123:0/3861741823 learned_addr learned my addr 172.21.15.123:0/3861741823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adffff700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae0102f50 0x7f6ae0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 -- 172.21.15.123:0/3861741823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae0102f50 msgr2=0x7f6ae0113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae0102f50 0x7f6ae0113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.114+0000 7f6adf7fe700 1 -- 172.21.15.123:0/3861741823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0005040 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6adf7fe700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4002a50 tx=0x7f6ad4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad4007cc0 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ad400f040 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad400d9c0 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae010dc00 con 0x7f6ae01038f0 2024-02-20T08:09:27.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.115+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae010e140 con 0x7f6ae01038f0 2024-02-20T08:09:27.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.116+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0100260 con 0x7f6ae01038f0 2024-02-20T08:09:27.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.117+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f6ad4009730 con 0x7f6ae01038f0 2024-02-20T08:09:27.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.117+0000 7f6adcff9700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 0x7f6ac806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.117+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6ad408c2d0 con 0x7f6ae01038f0 2024-02-20T08:09:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.117+0000 7f6adffff700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 0x7f6ac806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.118+0000 7f6adffff700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 0x7f6ac806f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0004f90 tx=0x7f6ad0009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.122+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6ad4059ea0 con 0x7f6ae01038f0 2024-02-20T08:09:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.341+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ae010a0f0 con 0x7f6ac806d0e0 2024-02-20T08:09:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.343+0000 7f6adcff9700 1 -- 172.21.15.123:0/3861741823 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6ad0009710 con 0x7f6ac806d0e0 2024-02-20T08:09:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 msgr2=0x7f6ac806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 0x7f6ac806f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0004f90 tx=0x7f6ad0009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 msgr2=0x7f6ae0113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4002a50 tx=0x7f6ad4004600 comp rx=0 tx=0).stop 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 shutdown_connections 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f6ac806d0e0 0x7f6ac806f590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ae0102f50 0x7f6ae0113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 --2- 172.21.15.123:0/3861741823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ae01038f0 0x7f6ae0113fa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 >> 172.21.15.123:0/3861741823 conn(0x7f6ae00f8ae0 msgr2=0x7f6ae00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 shutdown_connections 2024-02-20T08:09:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.345+0000 7f6ae6748700 1 -- 172.21.15.123:0/3861741823 wait complete. 2024-02-20T08:09:27.355 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3019925784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fdf60 msgr2=0x7f68a40fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3019925784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fdf60 0x7f68a40fe330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f68a0004940 tx=0x7f68a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3019925784 shutdown_connections 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3019925784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fe900 0x7f68a4106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3019925784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fdf60 0x7f68a40fe330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3019925784 >> 172.21.15.123:0/3019925784 conn(0x7f68a40f7a10 msgr2=0x7f68a40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3019925784 shutdown_connections 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.449+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3019925784 wait complete. 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 Processor -- start 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 -- start start 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fdf60 0x7f68a40fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40fc8d0 con 0x7f68a40fe900 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68ac7dd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40fca40 con 0x7f68a40fdf60 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68a9d78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68a9d78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56070/0 (socket says 172.21.15.123:56070) 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.450+0000 7f68a9d78700 1 -- 172.21.15.123:0/3862983543 learned_addr learned my addr 172.21.15.123:0/3862983543 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68aa579700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fdf60 0x7f68a40fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68a9d78700 1 -- 172.21.15.123:0/3862983543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fdf60 msgr2=0x7f68a40fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68a9d78700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fdf60 0x7f68a40fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68a9d78700 1 -- 172.21.15.123:0/3862983543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0005040 con 0x7f68a40fe900 2024-02-20T08:09:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68a9d78700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f689400c8c0 tx=0x7f68940044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f689400a980 con 0x7f68a40fe900 2024-02-20T08:09:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4119ce0 con 0x7f68a40fe900 2024-02-20T08:09:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f689400ce60 con 0x7f68a40fe900 2024-02-20T08:09:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68940115e0 con 0x7f68a40fe900 2024-02-20T08:09:27.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.451+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a411a1c0 con 0x7f68a40fe900 2024-02-20T08:09:27.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.452+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4104550 con 0x7f68a40fe900 2024-02-20T08:09:27.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.453+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f6894012400 con 0x7f68a40fe900 2024-02-20T08:09:27.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.454+0000 7f689affd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 0x7f689006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.454+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f689408c640 con 0x7f68a40fe900 2024-02-20T08:09:27.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.454+0000 7f68aa579700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 0x7f689006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.454+0000 7f68aa579700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 0x7f689006f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68a0004f90 tx=0x7f68a0009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.458+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6894056760 con 0x7f68a40fe900 2024-02-20T08:09:27.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:27.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: Upgrade: Target is version 19.0.0-1587-g91ff50e9 (squid) 2024-02-20T08:09:27.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024'] 2024-02-20T08:09:27.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:27.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: Upgrade: Setting container_image for all mgr 2024-02-20T08:09:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-20T08:09:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:27 smithi123 ceph-mon[29383]: pgmap v91: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: Upgrade: Target is version 19.0.0-1587-g91ff50e9 (squid) 2024-02-20T08:09:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024'] 2024-02-20T08:09:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: Upgrade: Setting container_image for all mgr 2024-02-20T08:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-20T08:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:27 smithi194 ceph-mon[37804]: pgmap v91: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.680+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68a40fb5e0 con 0x7f689006d0e0 2024-02-20T08:09:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.681+0000 7f689affd700 1 -- 172.21.15.123:0/3862983543 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f68a40fb5e0 con 0x7f689006d0e0 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.683+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 msgr2=0x7f689006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.683+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 0x7f689006f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68a0004f90 tx=0x7f68a0009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.683+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 msgr2=0x7f68a40fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.683+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f689400c8c0 tx=0x7f68940044c0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 shutdown_connections 2024-02-20T08:09:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f689006d0e0 0x7f689006f590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a40fdf60 0x7f68a40fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 --2- 172.21.15.123:0/3862983543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68a40fe900 0x7f68a40fc2d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 >> 172.21.15.123:0/3862983543 conn(0x7f68a40f7a10 msgr2=0x7f68a41016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 shutdown_connections 2024-02-20T08:09:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.684+0000 7f68ac7dd700 1 -- 172.21.15.123:0/3862983543 wait complete. 2024-02-20T08:09:27.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.788+0000 7f9fecd25700 1 -- 172.21.15.123:0/707745311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 msgr2=0x7f9fe80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.788+0000 7f9fecd25700 1 --2- 172.21.15.123:0/707745311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe80fbea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8004940 tx=0x7f9fd8009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:27.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 -- 172.21.15.123:0/707745311 shutdown_connections 2024-02-20T08:09:27.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 --2- 172.21.15.123:0/707745311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe80fbea0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 --2- 172.21.15.123:0/707745311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 0x7f9fe8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 -- 172.21.15.123:0/707745311 >> 172.21.15.123:0/707745311 conn(0x7f9fe8071d90 msgr2=0x7f9fe8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:27.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 -- 172.21.15.123:0/707745311 shutdown_connections 2024-02-20T08:09:27.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 -- 172.21.15.123:0/707745311 wait complete. 2024-02-20T08:09:27.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 Processor -- start 2024-02-20T08:09:27.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.789+0000 7f9fecd25700 1 -- start start 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fecd25700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 0x7f9fe810c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fecd25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fecd25700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe810d1e0 con 0x7f9fe81027e0 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fecd25700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe810d320 con 0x7f9fe8101e40 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56086/0 (socket says 172.21.15.123:56086) 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 -- 172.21.15.123:0/465031283 learned_addr learned my addr 172.21.15.123:0/465031283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe659c700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 0x7f9fe810c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 -- 172.21.15.123:0/465031283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 msgr2=0x7f9fe810c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 0x7f9fe810c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 -- 172.21.15.123:0/465031283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8005040 con 0x7f9fe81027e0 2024-02-20T08:09:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.790+0000 7f9fe5d9b700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80090d0 tx=0x7f9fd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.791+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd800e040 con 0x7f9fe81027e0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.791+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe810d5a0 con 0x7f9fe81027e0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.791+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fd800bbf0 con 0x7f9fe81027e0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.791+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd801c630 con 0x7f9fe81027e0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.791+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe811a150 con 0x7f9fe81027e0 2024-02-20T08:09:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.792+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8104310 con 0x7f9fe81027e0 2024-02-20T08:09:27.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.793+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f9fd800bd60 con 0x7f9fe81027e0 2024-02-20T08:09:27.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.793+0000 7f9fd6ffd700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 0x7f9fd006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:27.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.793+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9fd808d760 con 0x7f9fe81027e0 2024-02-20T08:09:27.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.793+0000 7f9fe659c700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 0x7f9fd006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:27.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.794+0000 7f9fe659c700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 0x7f9fd006f590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc004cc0 tx=0x7f9fdc00b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:27.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:27.798+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9fd8057920 con 0x7f9fe81027e0 2024-02-20T08:09:28.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.010+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fe8065ec0 con 0x7f9fd006d0e0 2024-02-20T08:09:28.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.021+0000 7f9fd6ffd700 1 -- 172.21.15.123:0/465031283 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9fe8065ec0 con 0x7f9fd006d0e0 2024-02-20T08:09:28.021 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:09:28.021 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (77s) 55s ago 13m 16.2M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:09:28.021 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (13m) 55s ago 13m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (11m) 110s ago 11m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (60s) 55s ago 12m 55.2M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (7m) 55s ago 7m 12.9M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (7m) 55s ago 7m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (7m) 110s ago 7m 15.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (7m) 110s ago 7m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (3m) 55s ago 14m 499M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (2m) 110s ago 11m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (14m) 55s ago 14m 55.3M 2048M 17.2.7-521-gc80e7168 10b0c032c913 d6733f26ecfb 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (11m) 110s ago 11m 45.4M 2048M 17.2.7-521-gc80e7168 10b0c032c913 c309c365b5d4 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (119s) 55s ago 13m 8698k - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (114s) 110s ago 11m 5435k - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (10m) 55s ago 10m 188M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (10m) 55s ago 10m 192M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (9m) 55s ago 9m 171M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (9m) 110s ago 9m 224M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:09:28.022 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (9m) 110s ago 9m 198M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:09:28.023 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (8m) 110s ago 8m 190M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:09:28.023 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (95s) 55s ago 12m 46.9M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:09:28.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 msgr2=0x7f9fd006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 0x7f9fd006f590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc004cc0 tx=0x7f9fdc00b040 comp rx=0 tx=0).stop 2024-02-20T08:09:28.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 msgr2=0x7f9fe810cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80090d0 tx=0x7f9fd8009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 shutdown_connections 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f9fd006d0e0 0x7f9fd006f590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe8101e40 0x7f9fe810c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 --2- 172.21.15.123:0/465031283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fe81027e0 0x7f9fe810cca0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 >> 172.21.15.123:0/465031283 conn(0x7f9fe8071d90 msgr2=0x7f9fe80fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 shutdown_connections 2024-02-20T08:09:28.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.023+0000 7f9fecd25700 1 -- 172.21.15.123:0/465031283 wait complete. 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- 172.21.15.123:0/2870244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c1027e0 msgr2=0x7f895c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 --2- 172.21.15.123:0/2870244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c1027e0 0x7f895c0fbea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f894c004940 tx=0x7f894c009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- 172.21.15.123:0/2870244466 shutdown_connections 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 --2- 172.21.15.123:0/2870244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c1027e0 0x7f895c0fbea0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 --2- 172.21.15.123:0/2870244466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c101e40 0x7f895c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- 172.21.15.123:0/2870244466 >> 172.21.15.123:0/2870244466 conn(0x7f895c071d90 msgr2=0x7f895c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- 172.21.15.123:0/2870244466 shutdown_connections 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- 172.21.15.123:0/2870244466 wait complete. 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 Processor -- start 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.139+0000 7f8960da6700 1 -- start start 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 0x7f895c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c114650 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c10d980 con 0x7f895c1027e0 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56104/0 (socket says 172.21.15.123:56104) 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 -- 172.21.15.123:0/3195498198 learned_addr learned my addr 172.21.15.123:0/3195498198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8959d9b700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 0x7f895c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 -- 172.21.15.123:0/3195498198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 msgr2=0x7f895c114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 0x7f895c114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 -- 172.21.15.123:0/3195498198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c005040 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8959d9b700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 0x7f895c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f895a59c700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8950002a50 tx=0x7f89500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8950007cc0 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f895000f040 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c10dc60 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.140+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c10e170 con 0x7f895c101e40 2024-02-20T08:09:28.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.141+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f895000db70 con 0x7f895c101e40 2024-02-20T08:09:28.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.141+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c0052b0 con 0x7f895c101e40 2024-02-20T08:09:28.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.142+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f895001c400 con 0x7f895c101e40 2024-02-20T08:09:28.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.142+0000 7f894affd700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 0x7f894406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.142+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f895008bc10 con 0x7f895c101e40 2024-02-20T08:09:28.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.142+0000 7f8959d9b700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 0x7f894406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.143+0000 7f8959d9b700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 0x7f894406f590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f895c10ecb0 tx=0x7f894c009e30 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.147+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f89500597e0 con 0x7f895c101e40 2024-02-20T08:09:28.311 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:28 smithi123 ceph-mon[29383]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:28.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.435+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f893c005d70 con 0x7f895c101e40 2024-02-20T08:09:28.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.436+0000 7f894affd700 1 -- 172.21.15.123:0/3195498198 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8950059370 con 0x7f895c101e40 2024-02-20T08:09:28.436 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:09:28.437 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 12, 2024-02-20T08:09:28.438 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:09:28.438 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:09:28.438 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 msgr2=0x7f894406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 0x7f894406f590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f895c10ecb0 tx=0x7f894c009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 msgr2=0x7f895c113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8950002a50 tx=0x7f89500046b0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 shutdown_connections 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f894406d0e0 0x7f894406f590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101e40 0x7f895c113ac0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 --2- 172.21.15.123:0/3195498198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f895c1027e0 0x7f895c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 >> 172.21.15.123:0/3195498198 conn(0x7f895c071d90 msgr2=0x7f895c065720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 shutdown_connections 2024-02-20T08:09:28.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.438+0000 7f8960da6700 1 -- 172.21.15.123:0/3195498198 wait complete. 2024-02-20T08:09:28.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 -- 172.21.15.123:0/4161650563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 msgr2=0x7fc9b0109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 --2- 172.21.15.123:0/4161650563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0109250 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4004970 tx=0x7fc9a4009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 -- 172.21.15.123:0/4161650563 shutdown_connections 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 --2- 172.21.15.123:0/4161650563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0109250 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 --2- 172.21.15.123:0/4161650563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 0x7fc9b0070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 -- 172.21.15.123:0/4161650563 >> 172.21.15.123:0/4161650563 conn(0x7fc9b00f8af0 msgr2=0x7fc9b00faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 -- 172.21.15.123:0/4161650563 shutdown_connections 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.543+0000 7fc9b5417700 1 -- 172.21.15.123:0/4161650563 wait complete. 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 Processor -- start 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 -- start start 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 0x7fc9b0115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0116780 con 0x7fc9b0070c40 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9b5417700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b010fad0 con 0x7fc9b0070330 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60588/0 (socket says 172.21.15.123:60588) 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9aeffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 0x7fc9b0115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.544+0000 7fc9ae7fc700 1 -- 172.21.15.123:0/2544073625 learned_addr learned my addr 172.21.15.123:0/2544073625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9ae7fc700 1 -- 172.21.15.123:0/2544073625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 msgr2=0x7fc9b0115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9ae7fc700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 0x7fc9b0115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9ae7fc700 1 -- 172.21.15.123:0/2544073625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4005040 con 0x7fc9b0070c40 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9ae7fc700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4004f50 tx=0x7fc9a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a400e040 con 0x7fc9b0070c40 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b010fd50 con 0x7fc9b0070c40 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9a4004290 con 0x7fc9b0070c40 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a401c3f0 con 0x7fc9b0070c40 2024-02-20T08:09:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.545+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b0110240 con 0x7fc9b0070c40 2024-02-20T08:09:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.546+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b0106910 con 0x7fc9b0070c40 2024-02-20T08:09:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.548+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7fc9a400bc10 con 0x7fc9b0070c40 2024-02-20T08:09:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.548+0000 7fc9977fe700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 0x7fc99806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.548+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc9a408e240 con 0x7fc9b0070c40 2024-02-20T08:09:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.549+0000 7fc9aeffd700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 0x7fc99806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.549+0000 7fc9aeffd700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 0x7fc99806f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a000b040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.552+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc9a4058400 con 0x7fc9b0070c40 2024-02-20T08:09:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:28 smithi194 ceph-mon[37804]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.798+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9b004bed0 con 0x7fc9b0070c40 2024-02-20T08:09:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.799+0000 7fc9977fe700 1 -- 172.21.15.123:0/2544073625 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1813 (secure 0 0 0) 0x7fc9a405bac0 con 0x7fc9b0070c40 2024-02-20T08:09:28.799 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:09:28.799 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:09:28.800 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:09:28.801 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:28.802 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 msgr2=0x7fc99806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 0x7fc99806f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a000b040 comp rx=0 tx=0).stop 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 msgr2=0x7fc9b0116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4004f50 tx=0x7fc9a4009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 shutdown_connections 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fc99806d0f0 0x7fc99806f5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9b0070330 0x7fc9b0115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 --2- 172.21.15.123:0/2544073625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b0070c40 0x7fc9b0116130 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 >> 172.21.15.123:0/2544073625 conn(0x7fc9b00f8af0 msgr2=0x7fc9b0103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 shutdown_connections 2024-02-20T08:09:28.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.801+0000 7fc9b5417700 1 -- 172.21.15.123:0/2544073625 wait complete. 2024-02-20T08:09:28.804 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:09:28.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 -- 172.21.15.123:0/2704621161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 msgr2=0x7f76cc0fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/2704621161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fc680 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f76bc004940 tx=0x7f76bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:28.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 -- 172.21.15.123:0/2704621161 shutdown_connections 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/2704621161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fc680 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/2704621161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc1022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 -- 172.21.15.123:0/2704621161 >> 172.21.15.123:0/2704621161 conn(0x7f76cc071560 msgr2=0x7f76cc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 -- 172.21.15.123:0/2704621161 shutdown_connections 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.909+0000 7f76d0a9f700 1 -- 172.21.15.123:0/2704621161 wait complete. 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 Processor -- start 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 -- start start 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc0fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0fe6a0 con 0x7f76cc102880 2024-02-20T08:09:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76d0a9f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0fe810 con 0x7f76cc101ee0 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60620/0 (socket says 172.21.15.123:60620) 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 -- 172.21.15.123:0/3138013254 learned_addr learned my addr 172.21.15.123:0/3138013254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 -- 172.21.15.123:0/3138013254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 msgr2=0x7f76cc0fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76ca59c700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc0fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc0fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 -- 172.21.15.123:0/3138013254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc005040 con 0x7f76cc102880 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76ca59c700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc0fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c9d9b700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009150 tx=0x7f76bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.910+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76bc00e040 con 0x7f76cc102880 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.911+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc119cf0 con 0x7f76cc102880 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.911+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76bc00bbf0 con 0x7f76cc102880 2024-02-20T08:09:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.911+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76bc01c630 con 0x7f76cc102880 2024-02-20T08:09:28.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.911+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc11a150 con 0x7f76cc102880 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.912+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc1053c0 con 0x7f76cc102880 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.912+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7f76bc00bd60 con 0x7f76cc102880 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.913+0000 7f76c2ffd700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 0x7f76b806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.913+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f76bc08d910 con 0x7f76cc102880 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.913+0000 7f76ca59c700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 0x7f76b806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.913+0000 7f76ca59c700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 0x7f76b806f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76b4007fd0 tx=0x7f76b4009040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:28.917+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f76bc057a30 con 0x7f76cc102880 2024-02-20T08:09:29.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.137+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 --> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76cc04bf40 con 0x7f76b806d0e0 2024-02-20T08:09:29.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.138+0000 7f76c2ffd700 1 -- 172.21.15.123:0/3138013254 <== mgr.14692 v2:172.21.15.123:6800/2877296499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f76cc04bf40 con 0x7f76b806d0e0 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "2/21 daemons upgraded", 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading mon daemons", 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:09:29.139 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.140+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 msgr2=0x7f76b806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.140+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 0x7f76b806f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76b4007fd0 tx=0x7f76b4009040 comp rx=0 tx=0).stop 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.140+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 msgr2=0x7f76cc0fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.140+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009150 tx=0x7f76bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 shutdown_connections 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7f76b806d0e0 0x7f76b806f590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76cc101ee0 0x7f76cc0fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 --2- 172.21.15.123:0/3138013254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76cc102880 0x7f76cc0fe0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 >> 172.21.15.123:0/3138013254 conn(0x7f76cc071560 msgr2=0x7f76cc1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 shutdown_connections 2024-02-20T08:09:29.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.141+0000 7f76d0a9f700 1 -- 172.21.15.123:0/3138013254 wait complete. 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 -- 172.21.15.123:0/1998974419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 msgr2=0x7fa1940fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 --2- 172.21.15.123:0/1998974419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa1940fbe70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa188004940 tx=0x7fa188009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 -- 172.21.15.123:0/1998974419 shutdown_connections 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 --2- 172.21.15.123:0/1998974419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa1940fbe70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 --2- 172.21.15.123:0/1998974419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 -- 172.21.15.123:0/1998974419 >> 172.21.15.123:0/1998974419 conn(0x7fa1940f7a10 msgr2=0x7fa1940f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 -- 172.21.15.123:0/1998974419 shutdown_connections 2024-02-20T08:09:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.245+0000 7fa1996f7700 1 -- 172.21.15.123:0/1998974419 wait complete. 2024-02-20T08:09:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 Processor -- start 2024-02-20T08:09:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 -- start start 2024-02-20T08:09:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194114670 con 0x7fa194102800 2024-02-20T08:09:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1996f7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19410d9a0 con 0x7fa194101e60 2024-02-20T08:09:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60640/0 (socket says 172.21.15.123:60640) 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.246+0000 7fa1927fc700 1 -- 172.21.15.123:0/2994649673 learned_addr learned my addr 172.21.15.123:0/2994649673 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa192ffd700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1927fc700 1 -- 172.21.15.123:0/2994649673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 msgr2=0x7fa194113ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1927fc700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194113ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1927fc700 1 -- 172.21.15.123:0/2994649673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188005040 con 0x7fa194102800 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa192ffd700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1927fc700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1880090d0 tx=0x7fa188009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18800e040 con 0x7fa194102800 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19410dc20 con 0x7fa194102800 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa18800bbf0 con 0x7fa194102800 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18800e040 con 0x7fa194102800 2024-02-20T08:09:29.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.247+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19410e160 con 0x7fa194102800 2024-02-20T08:09:29.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.249+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 33) v1 ==== 91209+0+0 (secure 0 0 0) 0x7fa188025400 con 0x7fa194102800 2024-02-20T08:09:29.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.249+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1800052e0 con 0x7fa194102800 2024-02-20T08:09:29.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.250+0000 7fa17b7fe700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 0x7fa17c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:29.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.250+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa18808d7e0 con 0x7fa194102800 2024-02-20T08:09:29.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.250+0000 7fa192ffd700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 0x7fa17c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:29.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.250+0000 7fa192ffd700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 0x7fa17c06f600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa18c004550 tx=0x7fa18c009040 comp rx=0 tx=0).ready entity=mgr.14692 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:29.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.254+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa18805c1e0 con 0x7fa194102800 2024-02-20T08:09:29.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:29.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:29.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: pgmap v92: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: Upgrade: Updating mon.smithi123 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: Deploying daemon mon.smithi123 on smithi123 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/3195498198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:29 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2544073625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:09:29.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.532+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa180005590 con 0x7fa194102800 2024-02-20T08:09:29.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.533+0000 7fa17b7fe700 1 -- 172.21.15.123:0/2994649673 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa18805bd70 con 0x7fa194102800 2024-02-20T08:09:29.533 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:29.533 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:29.533 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 msgr2=0x7fa17c06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 0x7fa17c06f600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa18c004550 tx=0x7fa18c009040 comp rx=0 tx=0).stop 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 msgr2=0x7fa194114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1880090d0 tx=0x7fa188009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 shutdown_connections 2024-02-20T08:09:29.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:6800/2877296499,v1:172.21.15.123:6801/2877296499] conn(0x7fa17c06d150 0x7fa17c06f600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194101e60 0x7fa194113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 --2- 172.21.15.123:0/2994649673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194102800 0x7fa194114020 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:29.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 >> 172.21.15.123:0/2994649673 conn(0x7fa1940f7a10 msgr2=0x7fa194065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:29.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 shutdown_connections 2024-02-20T08:09:29.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:29.535+0000 7fa1996f7700 1 -- 172.21.15.123:0/2994649673 wait complete. 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: pgmap v92: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: Upgrade: Updating mon.smithi123 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:09:29.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:09:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: Deploying daemon mon.smithi123 on smithi123 2024-02-20T08:09:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/3195498198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:29 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2544073625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:09:30.556 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 systemd[1]: Stopping Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:09:30.556 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 ceph-mon[29383]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:30.557 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 ceph-mon[29383]: from='client.? 172.21.15.123:0/2994649673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:09:30.557 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 ceph-mon[29383]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:30.557 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[29379]: 2024-02-20T08:09:30.545+0000 7f10a26db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi123 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:09:30.557 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[29379]: 2024-02-20T08:09:30.545+0000 7f10a26db700 -1 mon.smithi123@0(leader) e2 *** Got Signal Terminated *** 2024-02-20T08:09:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:30 smithi194 ceph-mon[37804]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:09:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:30 smithi194 ceph-mon[37804]: from='client.? 172.21.15.123:0/2994649673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:09:30.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:30 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:30 smithi123 podman[112234]: 2024-02-20 08:09:30.790685454 +0000 UTC m=+0.345444218 container died d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-c80e716, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-20T08:09:31.421 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 podman[112234]: 2024-02-20 08:09:31.162343422 +0000 UTC m=+0.717102189 container cleanup d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-c80e716, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-20T08:09:31.422 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 bash[112234]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123 2024-02-20T08:09:31.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 podman[112259]: 2024-02-20 08:09:31.422044222 +0000 UTC m=+0.633192604 container remove d6733f26ecfbbf3b01d9c66579c4afd4fd3d83de62794c7a801861542a50e501 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=quincy-c80e716, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-20T08:09:31.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service: Deactivated successfully. 2024-02-20T08:09:31.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 systemd[1]: Stopped Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:09:31.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service: Consumed 13.504s CPU time. 2024-02-20T08:09:32.031 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 systemd[1]: Starting Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:09:32.031 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:31 smithi123 podman[112389]: 2024-02-20 08:09:31.895455846 +0000 UTC m=+0.017788616 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:09:32.032 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 podman[112389]: 2024-02-20 08:09:32.031881547 +0000 UTC m=+0.154214381 container create f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 podman[112389]: 2024-02-20 08:09:32.234440776 +0000 UTC m=+0.356773537 container init f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 podman[112389]: 2024-02-20 08:09:32.237425199 +0000 UTC m=+0.359757969 container start f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5) 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: set uid:gid to 167:167 (ceph:ceph) 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev), process ceph-mon, pid 2 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: pidfile_write: ignore empty --pid-file 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: load: jerasure load: lrc 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: RocksDB version: 7.9.2 2024-02-20T08:09:32.285 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Git sha 0 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Compile date 2024-02-20 02:38:26 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: DB SUMMARY 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: DB Session ID: 0RWI1YH94ZXFBFLUNWM0 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: CURRENT file: CURRENT 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: IDENTITY file: IDENTITY 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1170 Bytes 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi123/store.db dir, Total Num: 1, files: 000033.sst 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi123/store.db: 000031.log size: 4742253 ; 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.error_if_exists: 0 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.create_if_missing: 0 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.paranoid_checks: 1 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-20T08:09:32.286 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.env: 0x55ba5c2e2ae0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.fs: PosixFileSystem 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.info_log: 0x55ba5d4bf780 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_file_opening_threads: 16 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.statistics: (nil) 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.use_fsync: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_log_file_size: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.keep_log_file_num: 1000 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.recycle_log_file_num: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_fallocate: 1 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_mmap_reads: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_mmap_writes: 0 2024-02-20T08:09:32.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.use_direct_reads: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.create_missing_column_families: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.db_log_dir: 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.wal_dir: 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.advise_random_on_open: 1 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.db_write_buffer_size: 0 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.write_buffer_manager: 0x55ba5d493400 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-20T08:09:32.288 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.rate_limiter: (nil) 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.wal_recovery_mode: 2 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enable_thread_tracking: 0 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enable_pipelined_write: 0 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.unordered_write: 0 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-20T08:09:32.289 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.row_cache: None 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.wal_filter: None 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_ingest_behind: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.two_write_queues: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.manual_wal_flush: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.wal_compression: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.atomic_flush: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.log_readahead_size: 0 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-20T08:09:32.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.best_efforts_recovery: 0 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.allow_data_in_errors: 0 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.db_host_id: __hostname__ 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_background_jobs: 2 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_background_compactions: -1 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_subcompactions: 1 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_total_wal_size: 0 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-20T08:09:32.292 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_open_files: -1 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bytes_per_sync: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_readahead_size: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_background_flushes: -1 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Compression algorithms supported: 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kZSTD supported: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kXpressCompression supported: 0 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kLZ4HCCompression supported: 1 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kZlibCompression supported: 1 2024-02-20T08:09:32.293 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kSnappyCompression supported: 1 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kLZ4Compression supported: 1 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: kBZip2Compression supported: 0 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000015 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.merge_operator: 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_filter: None 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_filter_factory: None 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.sst_partitioner_factory: None 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-20T08:09:32.294 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ba5d4bf8a0) 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks: 1 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_top_level_index_and_filter: 1 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_type: 0 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_index_type: 0 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_shortening: 1 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: checksum: 4 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: no_block_cache: 0 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache: 0x55ba5d4c3090 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_name: BinnedLRUCache 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_options: 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: capacity : 536870912 2024-02-20T08:09:32.295 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: num_shard_bits : 4 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: strict_capacity_limit : 0 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: high_pri_pool_ratio: 0.000 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_compressed: (nil) 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: persistent_cache: (nil) 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size: 4096 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size_deviation: 10 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_restart_interval: 16 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_block_restart_interval: 1 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: metadata_block_size: 4096 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: partition_filters: 0 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: use_delta_encoding: 1 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: filter_policy: bloomfilter 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: whole_key_filtering: 1 2024-02-20T08:09:32.296 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: verify_compression: 0 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: read_amp_bytes_per_bit: 0 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: format_version: 5 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_index_compression: 1 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_align: 0 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: max_auto_readahead_size: 262144 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: prepopulate_block_cache: 0 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: initial_auto_readahead_size: 8192 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: num_file_reads_for_auto_readahead: 2 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.write_buffer_size: 33554432 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_write_buffer_number: 2 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression: NoCompression 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression: Disabled 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.prefix_extractor: nullptr 2024-02-20T08:09:32.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.num_levels: 7 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-20T08:09:32.298 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.level: 32767 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.strategy: 0 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.enabled: false 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.target_file_size_base: 67108864 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-20T08:09:32.299 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.arena_block_size: 1048576 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-20T08:09:32.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.disable_auto_compactions: 0 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.table_properties_collectors: 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.inplace_update_support: 0 2024-02-20T08:09:32.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.bloom_locality: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.max_successive_merges: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.paranoid_file_checks: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.force_consistency_checks: 1 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.report_bg_io_stats: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.ttl: 2592000 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-20T08:09:32.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enable_blob_files: false 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.min_blob_size: 0 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_file_size: 268435456 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.blob_file_starting_level: 0 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12119, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-20T08:09:32.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f8059b2c-b301-4742-89e0-94baf77ddae8 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416572266640, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416572284823, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 4248881, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12120, "largest_seqno": 15593, "table_properties": {"data_size": 4235512, "index_size": 8444, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3909, "raw_key_size": 34455, "raw_average_key_size": 22, "raw_value_size": 4204899, "raw_average_value_size": 2700, "num_data_blocks": 382, "num_entries": 1557, "num_filter_entries": 1557, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708416572, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f8059b2c-b301-4742-89e0-94baf77ddae8", "db_session_id": "0RWI1YH94ZXFBFLUNWM0", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416572284930, "job": 1, "event": "recovery_finished"} 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi123/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ba5d5b2000 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: DB pointer 0x55ba5d59e000 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** DB Stats ** 2024-02-20T08:09:32.304 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: L0 1/0 4.05 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: L6 1/0 4.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Sum 2/0 8.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-20T08:09:32.305 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 509.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T08:09:32.306 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative compaction: 0.00 GB write, 192.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval compaction: 0.00 GB write, 192.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Block cache BinnedLRUCache@0x55ba5d4c3090#2 capacity: 512.00 MB usage: 13.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T08:09:32.307 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: starting mon.smithi123 rank 0 at public addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] at bind addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi123 fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T08:09:32.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???) e2 preinit fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T08:09:32.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).mds e15 new map 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).mds e15 print_map 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: e15 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: legacy client fscid: 1 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Filesystem 'cephfs' (1) 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: fs_name cephfs 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: epoch 15 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:09:32.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: tableserver 0 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: root 0 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: session_timeout 60 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: session_autoclose 300 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: max_file_size 1099511627776 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: max_xattr_size 65536 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: required_client_features {} 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: last_failure 0 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: last_failure_osd_epoch 47 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: max_mds 1 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: in 0 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: up {0=14482} 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: failed 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: damaged 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: stopped 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_pools [3] 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: metadata_pool 2 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: inline_data enabled 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: balancer 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: bal_rank_mask -1 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: standby_count_wanted 1 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: [mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:32.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Standby daemons: 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: [mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: [mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: [mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:32.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 ceph-mon[112409]: mon.smithi123@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-20T08:09:32.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 bash[112389]: f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 2024-02-20T08:09:32.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:32 smithi123 systemd[1]: Started Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:09:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: pgmap v94: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: mon.smithi123 calling monitor election 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: osdmap e49: 6 total, 6 up, 6 in 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: mgrmap e33: smithi123.kwyrtl(active, since 3m), standbys: smithi194.pvhorj 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: from='mgr.14692 ' entity='' 2024-02-20T08:09:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:33 smithi194 ceph-mon[37804]: mgrmap e34: smithi123.kwyrtl(active, since 3m), standbys: smithi194.pvhorj 2024-02-20T08:09:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: from='mgr.14692 172.21.15.123:0/2113269376' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: pgmap v94: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: mon.smithi123 calling monitor election 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: osdmap e49: 6 total, 6 up, 6 in 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: mgrmap e33: smithi123.kwyrtl(active, since 3m), standbys: smithi194.pvhorj 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: from='mgr.14692 ' entity='' 2024-02-20T08:09:34.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:33 smithi123 ceph-mon[112409]: mgrmap e34: smithi123.kwyrtl(active, since 3m), standbys: smithi194.pvhorj 2024-02-20T08:09:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194[37787]: 2024-02-20T08:09:40.598+0000 7fe97c985700 -1 mon.smithi194@1(peon).osd e50 update_from_paxos full map CRC mismatch, resetting to canonical 2024-02-20T08:09:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: Active manager daemon smithi123.kwyrtl restarted 2024-02-20T08:09:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: Activating manager daemon smithi123.kwyrtl 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: osdmap e50: 6 total, 6 up, 6 in 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: mgrmap e35: smithi123.kwyrtl(active, starting, since 0.0070119s), standbys: smithi194.pvhorj 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:09:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:09:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:09:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:09:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:09:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:09:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:40 smithi194 ceph-mon[37804]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T08:09:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: Active manager daemon smithi123.kwyrtl restarted 2024-02-20T08:09:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: Activating manager daemon smithi123.kwyrtl 2024-02-20T08:09:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: osdmap e50: 6 total, 6 up, 6 in 2024-02-20T08:09:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: mgrmap e35: smithi123.kwyrtl(active, starting, since 0.0070119s), standbys: smithi194.pvhorj 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi123.kwyrtl", "id": "smithi123.kwyrtl"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr metadata", "who": "smithi194.pvhorj", "id": "smithi194.pvhorj"}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:09:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:09:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-20T08:09:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-20T08:09:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-20T08:09:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:40 smithi123 ceph-mon[112409]: Manager daemon smithi123.kwyrtl is now available 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: failed to encode map e50 with expected crc 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:09:41.898 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: failed to encode map e50 with expected crc 2024-02-20T08:09:41.899 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:41 smithi123 ceph-mon[112409]: mgrmap e36: smithi123.kwyrtl(active, since 1.00997s), standbys: smithi194.pvhorj 2024-02-20T08:09:41.976 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: failed to encode map e50 with expected crc 2024-02-20T08:09:41.976 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:41.976 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:41.976 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj restarted 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: Standby manager daemon smithi194.pvhorj started 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/crt"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.pvhorj/key"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.? 172.21.15.194:0/2932719873' entity='mgr.smithi194.pvhorj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/mirror_snapshot_schedule"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.kwyrtl/trash_purge_schedule"}]: dispatch 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: failed to encode map e50 with expected crc 2024-02-20T08:09:41.977 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:41 smithi194 ceph-mon[37804]: mgrmap e36: smithi123.kwyrtl(active, since 1.00997s), standbys: smithi194.pvhorj 2024-02-20T08:09:42.712 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:42 smithi194 ceph-mon[37804]: pgmap v3: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:42 smithi123 ceph-mon[112409]: pgmap v3: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:43.912 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: [20/Feb/2024:08:09:41] ENGINE Bus STARTING 2024-02-20T08:09:43.912 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: [20/Feb/2024:08:09:42] ENGINE Serving on http://172.21.15.123:8765 2024-02-20T08:09:43.913 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: [20/Feb/2024:08:09:42] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T08:09:43.913 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: [20/Feb/2024:08:09:42] ENGINE Bus STARTED 2024-02-20T08:09:43.913 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: pgmap v4: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:43.913 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:43 smithi123 ceph-mon[112409]: mgrmap e37: smithi123.kwyrtl(active, since 3s), standbys: smithi194.pvhorj 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: [20/Feb/2024:08:09:41] ENGINE Bus STARTING 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: [20/Feb/2024:08:09:42] ENGINE Serving on http://172.21.15.123:8765 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: [20/Feb/2024:08:09:42] ENGINE Serving on https://172.21.15.123:7150 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: [20/Feb/2024:08:09:42] ENGINE Bus STARTED 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: pgmap v4: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:43 smithi194 ceph-mon[37804]: mgrmap e37: smithi123.kwyrtl(active, since 3s), standbys: smithi194.pvhorj 2024-02-20T08:09:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:44 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:44 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:44 smithi123 ceph-mon[112409]: pgmap v5: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:45.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:44 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:45.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:44 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:45.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:44 smithi194 ceph-mon[37804]: pgmap v5: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:46.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:45 smithi194 ceph-mon[37804]: mgrmap e38: smithi123.kwyrtl(active, since 4s), standbys: smithi194.pvhorj 2024-02-20T08:09:46.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:45 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:46.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:45 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:45 smithi123 ceph-mon[112409]: mgrmap e38: smithi123.kwyrtl(active, since 4s), standbys: smithi194.pvhorj 2024-02-20T08:09:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:47.092 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:46 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:47.092 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:46 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:47.093 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:46 smithi194 ceph-mon[37804]: pgmap v6: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:46 smithi123 ceph-mon[112409]: pgmap v6: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:09:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:48 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:48 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:48.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:49.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:49 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi194 2024-02-20T08:09:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:49 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:49 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:49 smithi194 ceph-mon[37804]: pgmap v7: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-20T08:09:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:49 smithi123 ceph-mon[112409]: Detected new or changed devices on smithi194 2024-02-20T08:09:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:49 smithi123 ceph-mon[112409]: pgmap v7: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: Detected new or changed devices on smithi123 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:09:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: pgmap v8: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:51 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: Detected new or changed devices on smithi123 2024-02-20T08:09:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: Updating smithi123:/etc/ceph/ceph.conf 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: Updating smithi194:/etc/ceph/ceph.conf 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: pgmap v8: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:09:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:09:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:09:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:09:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:09:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:52 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-20T08:09:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-20T08:09:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:09:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-02-20T08:09:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: Updating smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:09:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: Updating smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-20T08:09:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:09:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-20T08:09:53.851 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:53 smithi194 ceph-mon[37804]: pgmap v9: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-20T08:09:53.851 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:53 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:53.851 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:53 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:09:53.851 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:53 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:09:53.851 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:53 smithi194 ceph-mon[37804]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:54.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:53 smithi123 ceph-mon[112409]: pgmap v9: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-20T08:09:54.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:54.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:09:54.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:09:54.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:09:54.666 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:54 smithi194 ceph-mon[37804]: Upgrade: Updating mon.smithi194 2024-02-20T08:09:54.666 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:54 smithi194 ceph-mon[37804]: Deploying daemon mon.smithi194 on smithi194 2024-02-20T08:09:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:54 smithi123 ceph-mon[112409]: Upgrade: Updating mon.smithi194 2024-02-20T08:09:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:54 smithi123 ceph-mon[112409]: Deploying daemon mon.smithi194 on smithi194 2024-02-20T08:09:55.196 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:54 smithi194 systemd[1]: Stopping Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:09:55.451 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194[37787]: 2024-02-20T08:09:55.195+0000 7fe982190700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi194 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:09:55.451 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194[37787]: 2024-02-20T08:09:55.195+0000 7fe982190700 -1 mon.smithi194@1(peon) e2 *** Got Signal Terminated *** 2024-02-20T08:09:55.704 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 podman[88772]: 2024-02-20 08:09:55.451190165 +0000 UTC m=+0.371607911 container died c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, io.buildah.version=1.33.5, RELEASE=quincy-c80e716, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-20T08:09:55.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 podman[88772]: 2024-02-20 08:09:55.794862003 +0000 UTC m=+0.715279749 container cleanup c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, RELEASE=quincy-c80e716, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:09:55.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 bash[88772]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194 2024-02-20T08:09:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:55 smithi194 podman[88786]: 2024-02-20 08:09:55.995904066 +0000 UTC m=+0.542017930 container remove c309c365b5d4bdd393aadabc2aef580e0cff1325e1ea2ca39af83a6ee2813a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=quincy-c80e716, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-20T08:09:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi194.service: Deactivated successfully. 2024-02-20T08:09:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 systemd[1]: Stopped Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:09:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi194.service: Consumed 7.318s CPU time. 2024-02-20T08:09:56.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 systemd[1]: Starting Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:09:56.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 podman[88918]: 2024-02-20 08:09:56.5244961 +0000 UTC m=+0.017626656 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:09:56.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 podman[88918]: 2024-02-20 08:09:56.627475679 +0000 UTC m=+0.120606280 container create 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-20T08:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 podman[88918]: 2024-02-20 08:09:56.85775019 +0000 UTC m=+0.350880746 container init 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD) 2024-02-20T08:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 podman[88918]: 2024-02-20 08:09:56.860976675 +0000 UTC m=+0.354107234 container start 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-20T08:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: set uid:gid to 167:167 (ceph:ceph) 2024-02-20T08:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev), process ceph-mon, pid 2 2024-02-20T08:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: pidfile_write: ignore empty --pid-file 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: load: jerasure load: lrc 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: RocksDB version: 7.9.2 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Git sha 0 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Compile date 2024-02-20 02:38:26 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: DB SUMMARY 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: DB Session ID: 9AUHKBW7U8V42C5165IR 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: CURRENT file: CURRENT 2024-02-20T08:09:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: IDENTITY file: IDENTITY 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1095 Bytes 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi194/store.db dir, Total Num: 1, files: 000027.sst 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi194/store.db: 000025.log size: 9737172 ; 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.error_if_exists: 0 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.create_if_missing: 0 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.paranoid_checks: 1 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-20T08:09:57.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-20T08:09:57.148 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-20T08:09:57.148 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.env: 0x55732f9f3ae0 2024-02-20T08:09:57.148 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.fs: PosixFileSystem 2024-02-20T08:09:57.148 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.info_log: 0x5573306ad780 2024-02-20T08:09:57.148 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_file_opening_threads: 16 2024-02-20T08:09:57.151 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.statistics: (nil) 2024-02-20T08:09:57.151 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.use_fsync: 0 2024-02-20T08:09:57.151 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_log_file_size: 0 2024-02-20T08:09:57.151 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-20T08:09:57.151 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.keep_log_file_num: 1000 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.recycle_log_file_num: 0 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_fallocate: 1 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_mmap_reads: 0 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_mmap_writes: 0 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.use_direct_reads: 0 2024-02-20T08:09:57.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.create_missing_column_families: 0 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.db_log_dir: 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.wal_dir: 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-20T08:09:57.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.advise_random_on_open: 1 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.db_write_buffer_size: 0 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.write_buffer_manager: 0x557330681400 2024-02-20T08:09:57.154 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.rate_limiter: (nil) 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.wal_recovery_mode: 2 2024-02-20T08:09:57.155 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enable_thread_tracking: 0 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enable_pipelined_write: 0 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.unordered_write: 0 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.row_cache: None 2024-02-20T08:09:57.156 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.wal_filter: None 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_ingest_behind: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.two_write_queues: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.manual_wal_flush: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.wal_compression: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.atomic_flush: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.log_readahead_size: 0 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-20T08:09:57.157 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.best_efforts_recovery: 0 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.allow_data_in_errors: 0 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.db_host_id: __hostname__ 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_background_jobs: 2 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_background_compactions: -1 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_subcompactions: 1 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_total_wal_size: 0 2024-02-20T08:09:57.158 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_open_files: -1 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bytes_per_sync: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_readahead_size: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_background_flushes: -1 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Compression algorithms supported: 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kZSTD supported: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kXpressCompression supported: 0 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kLZ4HCCompression supported: 1 2024-02-20T08:09:57.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kZlibCompression supported: 1 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kSnappyCompression supported: 1 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kLZ4Compression supported: 1 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: kBZip2Compression supported: 0 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000009 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.merge_operator: 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_filter: None 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_filter_factory: None 2024-02-20T08:09:57.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.sst_partitioner_factory: None 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5573306ad8a0) 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_type: 0 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_index_type: 0 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_shortening: 1 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: checksum: 4 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: no_block_cache: 0 2024-02-20T08:09:57.161 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache: 0x5573306b1090 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_options: 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: capacity : 536870912 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_shard_bits : 4 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: strict_capacity_limit : 0 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_compressed: (nil) 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: persistent_cache: (nil) 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size: 4096 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size_deviation: 10 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_restart_interval: 16 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_block_restart_interval: 1 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_block_size: 4096 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: partition_filters: 0 2024-02-20T08:09:57.162 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: use_delta_encoding: 1 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: filter_policy: bloomfilter 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: whole_key_filtering: 1 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: verify_compression: 0 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: format_version: 5 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_index_compression: 1 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_align: 0 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_auto_readahead_size: 262144 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: prepopulate_block_cache: 0 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: initial_auto_readahead_size: 8192 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.write_buffer_size: 33554432 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_write_buffer_number: 2 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression: NoCompression 2024-02-20T08:09:57.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression: Disabled 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.prefix_extractor: nullptr 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.num_levels: 7 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-20T08:09:57.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.level: 32767 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.strategy: 0 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.enabled: false 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-20T08:09:57.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.target_file_size_base: 67108864 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-20T08:09:57.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.arena_block_size: 1048576 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.disable_auto_compactions: 0 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-20T08:09:57.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.table_properties_collectors: 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.inplace_update_support: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.bloom_locality: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.max_successive_merges: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.paranoid_file_checks: 0 2024-02-20T08:09:57.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.force_consistency_checks: 1 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.report_bg_io_stats: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.ttl: 2592000 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enable_blob_files: false 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.min_blob_size: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_file_size: 268435456 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-20T08:09:57.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.blob_file_starting_level: 0 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12151, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 09e5f765-0027-48b4-a772-d8acc4e5cd39 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416596890558, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416596914014, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 5787210, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12156, "largest_seqno": 16495, "table_properties": {"data_size": 5771743, "index_size": 10030, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4421, "raw_key_size": 39173, "raw_average_key_size": 22, "raw_value_size": 5736853, "raw_average_value_size": 3257, "num_data_blocks": 450, "num_entries": 1761, "num_filter_entries": 1761, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708416596, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "09e5f765-0027-48b4-a772-d8acc4e5cd39", "db_session_id": "9AUHKBW7U8V42C5165IR", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708416596914154, "job": 1, "event": "recovery_finished"} 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi194/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-20T08:09:57.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5573307a0000 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: DB pointer 0x55733078c000 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** DB Stats ** 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-20T08:09:57.171 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 5.52 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.6 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L6 1/0 4.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 2/0 10.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.6 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.6 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 591.6 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.172 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.01 GB write, 195.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.01 GB write, 195.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Block cache BinnedLRUCache@0x5573306b1090#2 capacity: 512.00 MB usage: 14.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-02-20T08:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: starting mon.smithi194 rank 1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi194 fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???) e2 preinit fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).mds e15 new map 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).mds e15 print_map 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: e15 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: legacy client fscid: 1 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Filesystem 'cephfs' (1) 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: fs_name cephfs 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: epoch 15 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:09:57.174 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: tableserver 0 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: root 0 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_timeout 60 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_autoclose 300 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_file_size 1099511627776 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_xattr_size 65536 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: required_client_features {} 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure 0 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure_osd_epoch 47 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_mds 1 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: in 0 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: up {0=14482} 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: failed 2024-02-20T08:09:57.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: damaged 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: stopped 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_pools [3] 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_pool 2 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: inline_data enabled 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: balancer 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: bal_rank_mask -1 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: standby_count_wanted 1 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Standby daemons: 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:57.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 ceph-mon[88937]: mon.smithi194@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 bash[88918]: 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 2024-02-20T08:09:57.177 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:56 smithi194 systemd[1]: Started Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:09:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: mon.smithi194 calling monitor election 2024-02-20T08:09:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: mon.smithi123 calling monitor election 2024-02-20T08:09:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: monmap e3: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: osdmap e50: 6 total, 6 up, 6 in 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: mgrmap e38: smithi123.kwyrtl(active, since 16s), standbys: smithi194.pvhorj 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:58.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:58.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: mon.smithi194 calling monitor election 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: mon.smithi123 calling monitor election 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: mon.smithi123 is new leader, mons smithi123,smithi194 in quorum (ranks 0,1) 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: monmap e3: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: osdmap e50: 6 total, 6 up, 6 in 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: mgrmap e38: smithi123.kwyrtl(active, since 16s), standbys: smithi194.pvhorj 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:09:58.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:09:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:09:59 smithi123 ceph-mon[112409]: pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-20T08:09:59.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:09:59 smithi194 ceph-mon[88937]: pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-20T08:09:59.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 -- 172.21.15.123:0/3289655699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4834102f50 msgr2=0x7f4834103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 --2- 172.21.15.123:0/3289655699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4834102f50 0x7f4834103320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4830004940 tx=0x7f4830009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 -- 172.21.15.123:0/3289655699 shutdown_connections 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 --2- 172.21.15.123:0/3289655699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48341038f0 0x7f48340fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 --2- 172.21.15.123:0/3289655699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4834102f50 0x7f4834103320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.649+0000 7f483b68f700 1 -- 172.21.15.123:0/3289655699 >> 172.21.15.123:0/3289655699 conn(0x7f48340f8ae0 msgr2=0x7f48340faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 -- 172.21.15.123:0/3289655699 shutdown_connections 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 -- 172.21.15.123:0/3289655699 wait complete. 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 Processor -- start 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 -- start start 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834116890 con 0x7f48341038f0 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483b68f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483410fb30 con 0x7f4834102f50 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f4838c2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f4838c2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46462/0 (socket says 172.21.15.123:46462) 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f483942b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.650+0000 7f4838c2a700 1 -- 172.21.15.123:0/1712766437 learned_addr learned my addr 172.21.15.123:0/1712766437 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483942b700 1 -- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 msgr2=0x7f4834115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483942b700 1 -- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 msgr2=0x7f4834115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483942b700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483942b700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4838c2a700 1 -- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 msgr2=0x7f4834115c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4838c2a700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4838c2a700 1 -- 172.21.15.123:0/1712766437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830005040 con 0x7f48341038f0 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4838c2a700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f482400b790 tx=0x7f4824009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:59.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f482400f6f0 con 0x7f48341038f0 2024-02-20T08:09:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f482400fd20 con 0x7f48341038f0 2024-02-20T08:09:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483410fe10 con 0x7f48341038f0 2024-02-20T08:09:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48240103a0 con 0x7f48341038f0 2024-02-20T08:09:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.651+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4834110350 con 0x7f48341038f0 2024-02-20T08:09:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.652+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48340fc6e0 con 0x7f48341038f0 2024-02-20T08:09:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.653+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f4824011400 con 0x7f48341038f0 2024-02-20T08:09:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.653+0000 7f4829ffb700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 0x7f482006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.653+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f482408ce70 con 0x7f48341038f0 2024-02-20T08:09:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.653+0000 7f483942b700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 0x7f482006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.654+0000 7f483942b700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 0x7f482006fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4830004560 tx=0x7f4830009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:59.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.658+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f482405a130 con 0x7f48341038f0 2024-02-20T08:09:59.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.874+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4834111250 con 0x7f482006d900 2024-02-20T08:09:59.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.875+0000 7f4829ffb700 1 -- 172.21.15.123:0/1712766437 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4834111250 con 0x7f482006d900 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 msgr2=0x7f482006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 0x7f482006fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4830004560 tx=0x7f4830009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 msgr2=0x7f48341161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f482400b790 tx=0x7f4824009220 comp rx=0 tx=0).stop 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 shutdown_connections 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f482006d900 0x7f482006fdb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4834102f50 0x7f4834115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 --2- 172.21.15.123:0/1712766437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48341038f0 0x7f48341161b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 >> 172.21.15.123:0/1712766437 conn(0x7f48340f8ae0 msgr2=0x7f48340fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 shutdown_connections 2024-02-20T08:09:59.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.877+0000 7f483b68f700 1 -- 172.21.15.123:0/1712766437 wait complete. 2024-02-20T08:09:59.889 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:09:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 -- 172.21.15.123:0/3053171422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04102800 msgr2=0x7fdf040fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:09:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3053171422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04102800 0x7fdf040fbe70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdef4004940 tx=0x7fdef4009e30 comp rx=0 tx=0).stop 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 -- 172.21.15.123:0/3053171422 shutdown_connections 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3053171422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04102800 0x7fdf040fbe70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3053171422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04101e60 0x7fdf04102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.979+0000 7fdf0b815700 1 -- 172.21.15.123:0/3053171422 >> 172.21.15.123:0/3053171422 conn(0x7fdf040f7a10 msgr2=0x7fdf040f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 -- 172.21.15.123:0/3053171422 shutdown_connections 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 -- 172.21.15.123:0/3053171422 wait complete. 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 Processor -- start 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 -- start start 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf041146f0 con 0x7fdf04101e60 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf0b815700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0410da20 con 0x7fdf04102800 2024-02-20T08:09:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.980+0000 7fdf095b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46474/0 (socket says 172.21.15.123:46474) 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 -- 172.21.15.123:0/3218897179 learned_addr learned my addr 172.21.15.123:0/3218897179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf08db0700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf08db0700 1 -- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 msgr2=0x7fdf041140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf08db0700 1 -- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 msgr2=0x7fdf041140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf08db0700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf08db0700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 -- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 msgr2=0x7fdf041140a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 -- 172.21.15.123:0/3218897179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4005040 con 0x7fdf04101e60 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf095b1700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf00002a50 tx=0x7fdf000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf00007cc0 con 0x7fdf04101e60 2024-02-20T08:09:59.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf0000f040 con 0x7fdf04101e60 2024-02-20T08:09:59.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0410dd00 con 0x7fdf04101e60 2024-02-20T08:09:59.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.981+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf00009640 con 0x7fdf04101e60 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.982+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0410e240 con 0x7fdf04101e60 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.982+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf040fb610 con 0x7fdf04101e60 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.983+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fdf000097a0 con 0x7fdf04101e60 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.983+0000 7fdef9ffb700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 0x7fdef006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.983+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdf0008cf40 con 0x7fdf04101e60 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.983+0000 7fdf08db0700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 0x7fdef006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:09:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.984+0000 7fdf08db0700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 0x7fdef006fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf0410f390 tx=0x7fdef4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:09:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:09:59.988+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdf0005a100 con 0x7fdf04101e60 2024-02-20T08:10:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.198+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf0410f140 con 0x7fdef006d900 2024-02-20T08:10:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.199+0000 7fdef9ffb700 1 -- 172.21.15.123:0/3218897179 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fdf0410f140 con 0x7fdef006d900 2024-02-20T08:10:00.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 msgr2=0x7fdef006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 0x7fdef006fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf0410f390 tx=0x7fdef4009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:00.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 msgr2=0x7fdf04113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf00002a50 tx=0x7fdf000046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 shutdown_connections 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdef006d900 0x7fdef006fdb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf04101e60 0x7fdf04113b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 --2- 172.21.15.123:0/3218897179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04102800 0x7fdf041140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 >> 172.21.15.123:0/3218897179 conn(0x7fdf040f7a10 msgr2=0x7fdf04066070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 shutdown_connections 2024-02-20T08:10:00.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.202+0000 7fdf0b815700 1 -- 172.21.15.123:0/3218897179 wait complete. 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 -- 172.21.15.123:0/2677077125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 msgr2=0x7fe4dc0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2677077125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc0fbe70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0004940 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 -- 172.21.15.123:0/2677077125 shutdown_connections 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2677077125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc0fbe70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2677077125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 -- 172.21.15.123:0/2677077125 >> 172.21.15.123:0/2677077125 conn(0x7fe4dc0f7a10 msgr2=0x7fe4dc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 -- 172.21.15.123:0/2677077125 shutdown_connections 2024-02-20T08:10:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.304+0000 7fe4e22da700 1 -- 172.21.15.123:0/2677077125 wait complete. 2024-02-20T08:10:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 Processor -- start 2024-02-20T08:10:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 -- start start 2024-02-20T08:10:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc10f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10f630 con 0x7fe4dc102800 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.305+0000 7fe4e22da700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10f770 con 0x7fe4dc101e60 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4db7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc10f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:35992/0 (socket says 172.21.15.123:35992) 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 -- 172.21.15.123:0/2350406837 learned_addr learned my addr 172.21.15.123:0/2350406837 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 -- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 msgr2=0x7fe4dc10eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 -- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 msgr2=0x7fe4dc10eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4dbfff700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4db7fe700 1 -- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 msgr2=0x7fe4dc10eb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4db7fe700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4db7fe700 1 -- 172.21.15.123:0/2350406837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005040 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4db7fe700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc10f0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc067410 tx=0x7fe4d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d000e040 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc117a70 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d0004290 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d001c3f0 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.306+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc117f80 con 0x7fe4dc102800 2024-02-20T08:10:00.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.307+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc104330 con 0x7fe4dc102800 2024-02-20T08:10:00.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.308+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fe4d000bbf0 con 0x7fe4dc102800 2024-02-20T08:10:00.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.308+0000 7fe4d8ff9700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 0x7fe4c406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.308+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe4d008e2d0 con 0x7fe4dc102800 2024-02-20T08:10:00.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.308+0000 7fe4dbfff700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 0x7fe4c406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.309+0000 7fe4dbfff700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 0x7fe4c406fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0041d0 tx=0x7fe4cc007ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:00.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.313+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe4d00579d0 con 0x7fe4dc102800 2024-02-20T08:10:00.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.517+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4dc066750 con 0x7fe4c406d900 2024-02-20T08:10:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.527+0000 7fe4d8ff9700 1 -- 172.21.15.123:0/2350406837 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe4dc066750 con 0x7fe4c406d900 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (109s) 14s ago 13m 18.5M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (13m) 14s ago 13m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (12m) 0s ago 12m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (93s) 14s ago 13m 78.7M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (7m) 14s ago 7m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (7m) 14s ago 7m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (7m) 0s ago 7m 16.6M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (7m) 0s ago 7m 14.5M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (3m) 14s ago 14m 470M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (2m) 0s ago 12m 447M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:10:00.529 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (28s) 14s ago 15m 30.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (3s) 0s ago 12m 26.4M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (2m) 14s ago 13m 16.8M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (2m) 0s ago 12m 15.7M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (11m) 14s ago 11m 189M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (11m) 14s ago 11m 193M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (10m) 14s ago 10m 173M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (10m) 0s ago 10m 228M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (9m) 0s ago 9m 200M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (9m) 0s ago 9m 196M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:10:00.530 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (2m) 14s ago 12m 54.9M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 msgr2=0x7fe4c406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 0x7fe4c406fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0041d0 tx=0x7fe4cc007ab0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 msgr2=0x7fe4dc10f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc10f0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc067410 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 shutdown_connections 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe4c406d900 0x7fe4c406fdb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4dc101e60 0x7fe4dc10eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 --2- 172.21.15.123:0/2350406837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4dc102800 0x7fe4dc10f0a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 >> 172.21.15.123:0/2350406837 conn(0x7fe4dc0f7a10 msgr2=0x7fe4dc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 shutdown_connections 2024-02-20T08:10:00.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.529+0000 7fe4e22da700 1 -- 172.21.15.123:0/2350406837 wait complete. 2024-02-20T08:10:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- 172.21.15.123:0/635983370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 msgr2=0x7f11d8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/635983370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8107050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f11c0004970 tx=0x7f11c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- 172.21.15.123:0/635983370 shutdown_connections 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/635983370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8107050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/635983370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d80fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- 172.21.15.123:0/635983370 >> 172.21.15.123:0/635983370 conn(0x7f11d8071d90 msgr2=0x7f11d8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- 172.21.15.123:0/635983370 shutdown_connections 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- 172.21.15.123:0/635983370 wait complete. 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 Processor -- start 2024-02-20T08:10:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.628+0000 7f11dd4f2700 1 -- start start 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11dd4f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11dd4f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11dd4f2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8114580 con 0x7f11d80fe8f0 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11dd4f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d810d8b0 con 0x7f11d80fdfe0 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46516/0 (socket says 172.21.15.123:46516) 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 -- 172.21.15.123:0/1333713018 learned_addr learned my addr 172.21.15.123:0/1333713018 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11d6ffd700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11d6ffd700 1 -- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 msgr2=0x7f11d81139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11d6ffd700 1 -- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 msgr2=0x7f11d81139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11d6ffd700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11d6ffd700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 -- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 msgr2=0x7f11d81139f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 -- 172.21.15.123:0/1333713018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0005040 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11ce7fc700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000c00 tx=0x7f11c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c000e040 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d810db30 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.629+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11c0004290 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.630+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c001c630 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.630+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d810e070 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.631+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d81046c0 con 0x7f11d80fe8f0 2024-02-20T08:10:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.631+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f11c0013980 con 0x7f11d80fe8f0 2024-02-20T08:10:00.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.631+0000 7f11cffff700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 0x7f11c406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:00.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.632+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f11c008e440 con 0x7f11d80fe8f0 2024-02-20T08:10:00.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.632+0000 7f11d6ffd700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 0x7f11c406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:00.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.632+0000 7f11d6ffd700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 0x7f11c406fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009e50 tx=0x7f11c8009f10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:00.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.636+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f11c005b670 con 0x7f11d80fe8f0 2024-02-20T08:10:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.916+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f11d810a030 con 0x7f11d80fe8f0 2024-02-20T08:10:00.918 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:00.918 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:00.918 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.917+0000 7f11cffff700 1 -- 172.21.15.123:0/1333713018 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f11c005b200 con 0x7f11d80fe8f0 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:10:00.919 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 10, 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:10:00.920 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 msgr2=0x7f11c406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 0x7f11c406fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009e50 tx=0x7f11c8009f10 comp rx=0 tx=0).stop 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 msgr2=0x7f11d8113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000c00 tx=0x7f11c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 shutdown_connections 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f11c406d900 0x7f11c406fdb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d80fdfe0 0x7f11d81139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 --2- 172.21.15.123:0/1333713018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11d80fe8f0 0x7f11d8113f30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 >> 172.21.15.123:0/1333713018 conn(0x7f11d8071d90 msgr2=0x7f11d8101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 shutdown_connections 2024-02-20T08:10:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:00.919+0000 7f11dd4f2700 1 -- 172.21.15.123:0/1333713018 wait complete. 2024-02-20T08:10:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 -- 172.21.15.123:0/2442137665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 msgr2=0x7fce5c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 --2- 172.21.15.123:0/2442137665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c103510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce4c004940 tx=0x7fce4c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 -- 172.21.15.123:0/2442137665 shutdown_connections 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 --2- 172.21.15.123:0/2442137665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c0fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 --2- 172.21.15.123:0/2442137665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c103510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.019+0000 7fce64253700 1 -- 172.21.15.123:0/2442137665 >> 172.21.15.123:0/2442137665 conn(0x7fce5c071560 msgr2=0x7fce5c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 -- 172.21.15.123:0/2442137665 shutdown_connections 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 -- 172.21.15.123:0/2442137665 wait complete. 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 Processor -- start 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 -- start start 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c1146a0 con 0x7fce5c103140 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce64253700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c10d9d0 con 0x7fce5c0fb570 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce617ee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce61fef700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce617ee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46540/0 (socket says 172.21.15.123:46540) 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce617ee700 1 -- 172.21.15.123:0/1874476826 learned_addr learned my addr 172.21.15.123:0/1874476826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce61fef700 1 -- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 msgr2=0x7fce5c113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce61fef700 1 -- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 msgr2=0x7fce5c113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce61fef700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.020+0000 7fce61fef700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:10:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce617ee700 1 -- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 msgr2=0x7fce5c113b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce617ee700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce617ee700 1 -- 172.21.15.123:0/1874476826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c005040 con 0x7fce5c103140 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce617ee700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce58002a50 tx=0x7fce580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce58007cc0 con 0x7fce5c103140 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce5800f040 con 0x7fce5c103140 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c10dcb0 con 0x7fce5c103140 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce58009640 con 0x7fce5c103140 2024-02-20T08:10:01.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.021+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c10e1f0 con 0x7fce5c103140 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.022+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c100310 con 0x7fce5c103140 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.022+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fce580097c0 con 0x7fce5c103140 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.023+0000 7fce527fc700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 0x7fce4806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.023+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fce5808ce80 con 0x7fce5c103140 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.023+0000 7fce61fef700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 0x7fce4806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.023+0000 7fce61fef700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 0x7fce4806fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce4c004560 tx=0x7fce4c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.027+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce5805a030 con 0x7fce5c103140 2024-02-20T08:10:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.266+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce5c10f0f0 con 0x7fce5c103140 2024-02-20T08:10:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.266+0000 7fce527fc700 1 -- 172.21.15.123:0/1874476826 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fce58059bc0 con 0x7fce5c103140 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:10:01.268 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:10:01.269 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 msgr2=0x7fce4806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 0x7fce4806fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce4c004560 tx=0x7fce4c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 msgr2=0x7fce5c114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce58002a50 tx=0x7fce580046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 shutdown_connections 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fce4806d900 0x7fce4806fdb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce5c0fb570 0x7fce5c113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 --2- 172.21.15.123:0/1874476826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c103140 0x7fce5c114050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.268+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 >> 172.21.15.123:0/1874476826 conn(0x7fce5c071560 msgr2=0x7fce5c0fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.269+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 shutdown_connections 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.269+0000 7fce64253700 1 -- 172.21.15.123:0/1874476826 wait complete. 2024-02-20T08:10:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:10:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 -- 172.21.15.123:0/2447768240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 msgr2=0x7f769c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 --2- 172.21.15.123:0/2447768240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0fcf60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f768c004940 tx=0x7f768c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 -- 172.21.15.123:0/2447768240 shutdown_connections 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 --2- 172.21.15.123:0/2447768240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0fcf60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 --2- 172.21.15.123:0/2447768240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 -- 172.21.15.123:0/2447768240 >> 172.21.15.123:0/2447768240 conn(0x7f769c0f8ae0 msgr2=0x7f769c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 -- 172.21.15.123:0/2447768240 shutdown_connections 2024-02-20T08:10:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.370+0000 7f76a153f700 1 -- 172.21.15.123:0/2447768240 wait complete. 2024-02-20T08:10:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 Processor -- start 2024-02-20T08:10:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 -- start start 2024-02-20T08:10:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c070dd0 con 0x7f769c1038f0 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f76a153f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c070f40 con 0x7f769c102f50 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46554/0 (socket says 172.21.15.123:46554) 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 -- 172.21.15.123:0/665482820 learned_addr learned my addr 172.21.15.123:0/665482820 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769affd700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769affd700 1 -- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 msgr2=0x7f769c070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769affd700 1 -- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 msgr2=0x7f769c070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769affd700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769affd700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 -- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 msgr2=0x7f769c070290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:10:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 -- 172.21.15.123:0/665482820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c005040 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.371+0000 7f769a7fc700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f768c0090d0 tx=0x7f768c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.372+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768c00e040 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.372+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c119cd0 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.372+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f768c00bbf0 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.372+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768c01c630 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.372+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c11a130 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.373+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c105420 con 0x7f769c1038f0 2024-02-20T08:10:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.373+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f768c00bd60 con 0x7f769c1038f0 2024-02-20T08:10:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.374+0000 7f76837fe700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 0x7f768406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.374+0000 7f769affd700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 0x7f768406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.374+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f768c08e400 con 0x7f769c1038f0 2024-02-20T08:10:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.374+0000 7f769affd700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 0x7f768406fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7690009e50 tx=0x7f7690009e80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.378+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f768c057b00 con 0x7f769c1038f0 2024-02-20T08:10:01.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.591+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f769c0719d0 con 0x7f768406d900 2024-02-20T08:10:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.592+0000 7f76837fe700 1 -- 172.21.15.123:0/665482820 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f769c0719d0 con 0x7f768406d900 2024-02-20T08:10:01.593 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:10:01.593 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "4/21 daemons upgraded", 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading mon daemons", 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:10:01.594 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 msgr2=0x7f768406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 0x7f768406fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7690009e50 tx=0x7f7690009e80 comp rx=0 tx=0).stop 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 msgr2=0x7f769c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f768c0090d0 tx=0x7f768c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 shutdown_connections 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f768406d900 0x7f768406fdb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c102f50 0x7f769c070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 --2- 172.21.15.123:0/665482820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c1038f0 0x7f769c0707d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 >> 172.21.15.123:0/665482820 conn(0x7f769c0f8ae0 msgr2=0x7f769c0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 shutdown_connections 2024-02-20T08:10:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.594+0000 7f76a153f700 1 -- 172.21.15.123:0/665482820 wait complete. 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.695+0000 7f7134051700 1 -- 172.21.15.123:0/4196354740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c102800 msgr2=0x7f712c0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.695+0000 7f7134051700 1 --2- 172.21.15.123:0/4196354740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c102800 0x7f712c0fbe70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7128004940 tx=0x7f7128009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- 172.21.15.123:0/4196354740 shutdown_connections 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 --2- 172.21.15.123:0/4196354740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c102800 0x7f712c0fbe70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 --2- 172.21.15.123:0/4196354740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c101e60 0x7f712c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- 172.21.15.123:0/4196354740 >> 172.21.15.123:0/4196354740 conn(0x7f712c0f7a10 msgr2=0x7f712c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- 172.21.15.123:0/4196354740 shutdown_connections 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- 172.21.15.123:0/4196354740 wait complete. 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 Processor -- start 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- start start 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0fe620 con 0x7f712c101e60 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7134051700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0fe790 con 0x7f712c102800 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.696+0000 7f7131ded700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46566/0 (socket says 172.21.15.123:46566) 2024-02-20T08:10:01.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 -- 172.21.15.123:0/648305954 learned_addr learned my addr 172.21.15.123:0/648305954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71315ec700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71315ec700 1 -- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 msgr2=0x7f712c0fe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-20T08:10:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71315ec700 1 -- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 msgr2=0x7f712c0fe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-20T08:10:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71315ec700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71315ec700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 -- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 msgr2=0x7f712c0fe020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 -- 172.21.15.123:0/648305954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128005040 con 0x7f712c101e60 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7131ded700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f711c0041d0 tx=0x7f711c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c007cc0 con 0x7f712c101e60 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f711c00f040 con 0x7f712c101e60 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c00dbe0 con 0x7f712c101e60 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c119d00 con 0x7f712c101e60 2024-02-20T08:10:01.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.697+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c11a1e0 con 0x7f712c101e60 2024-02-20T08:10:01.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.698+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0fb610 con 0x7f712c101e60 2024-02-20T08:10:01.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.699+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f711c00dd40 con 0x7f712c101e60 2024-02-20T08:10:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.699+0000 7f71227fc700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 0x7f711806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.699+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f711c08c7a0 con 0x7f712c101e60 2024-02-20T08:10:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.699+0000 7f71315ec700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 0x7f711806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.700+0000 7f71315ec700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 0x7f711806fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ff4e0 tx=0x7f7128009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:01.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.705+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f711c055ea0 con 0x7f712c101e60 2024-02-20T08:10:01.925 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1333713018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:01.926 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:01 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1874476826' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:10:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.984+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f712c11a420 con 0x7f712c101e60 2024-02-20T08:10:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.984+0000 7f71227fc700 1 -- 172.21.15.123:0/648305954 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f711c059560 con 0x7f712c101e60 2024-02-20T08:10:01.985 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:01.985 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:01.985 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:10:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 msgr2=0x7f711806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 0x7f711806fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ff4e0 tx=0x7f7128009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 msgr2=0x7f712c0fdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f711c0041d0 tx=0x7f711c0046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 shutdown_connections 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f711806d900 0x7f711806fdb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f712c101e60 0x7f712c0fdae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 --2- 172.21.15.123:0/648305954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c102800 0x7f712c0fe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 >> 172.21.15.123:0/648305954 conn(0x7f712c0f7a10 msgr2=0x7f712c066030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 shutdown_connections 2024-02-20T08:10:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:01.987+0000 7f7134051700 1 -- 172.21.15.123:0/648305954 wait complete. 2024-02-20T08:10:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1333713018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:02.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:01 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1874476826' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:10:03.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:02 smithi123 ceph-mon[112409]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:03.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:02 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/648305954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:10:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:02 smithi194 ceph-mon[88937]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:02 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/648305954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:10:03.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:03 smithi194 ceph-mon[88937]: pgmap v14: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:04.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:03 smithi123 ceph-mon[112409]: pgmap v14: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: Reconfiguring mon.smithi123 (monmap changed)... 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:10:05.462 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:05.463 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: Reconfiguring daemon mon.smithi123 on smithi123 2024-02-20T08:10:05.463 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:05 smithi123 ceph-mon[112409]: pgmap v15: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: Reconfiguring mon.smithi123 (monmap changed)... 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: Reconfiguring daemon mon.smithi123 on smithi123 2024-02-20T08:10:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:05 smithi194 ceph-mon[88937]: pgmap v15: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:07.402 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:07.402 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:07.402 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: Reconfiguring mgr.smithi123.kwyrtl (monmap changed)... 2024-02-20T08:10:07.402 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:10:07.403 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:10:07.403 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:07.403 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: Reconfiguring daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T08:10:07.403 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:07 smithi123 ceph-mon[112409]: pgmap v16: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: Reconfiguring mgr.smithi123.kwyrtl (monmap changed)... 2024-02-20T08:10:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.kwyrtl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:10:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:10:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: Reconfiguring daemon mgr.smithi123.kwyrtl on smithi123 2024-02-20T08:10:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:07 smithi194 ceph-mon[88937]: pgmap v16: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:09.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:09.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:09.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: Reconfiguring crash.smithi123 (monmap changed)... 2024-02-20T08:10:09.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:09.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:09.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:08 smithi123 ceph-mon[112409]: Reconfiguring daemon crash.smithi123 on smithi123 2024-02-20T08:10:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: Reconfiguring crash.smithi123 (monmap changed)... 2024-02-20T08:10:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:08 smithi194 ceph-mon[88937]: Reconfiguring daemon crash.smithi123 on smithi123 2024-02-20T08:10:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:09 smithi123 ceph-mon[112409]: pgmap v17: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:10.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T08:10:10.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:09 smithi194 ceph-mon[88937]: pgmap v17: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T08:10:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:10.859 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:10 smithi123 ceph-mon[112409]: Reconfiguring osd.0 (monmap changed)... 2024-02-20T08:10:10.859 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:10 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.0 on smithi123 2024-02-20T08:10:10.859 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:10 smithi194 ceph-mon[88937]: Reconfiguring osd.0 (monmap changed)... 2024-02-20T08:10:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:10 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.0 on smithi123 2024-02-20T08:10:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:11.829 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:11 smithi123 ceph-mon[112409]: pgmap v18: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:11.829 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:11.829 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:11.829 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T08:10:11.830 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:11 smithi194 ceph-mon[88937]: pgmap v18: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T08:10:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: Reconfiguring osd.1 (monmap changed)... 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.1 on smithi123 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T08:10:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: Reconfiguring osd.1 (monmap changed)... 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.1 on smithi123 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T08:10:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:13.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:13 smithi123 ceph-mon[112409]: pgmap v19: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:13.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:13 smithi123 ceph-mon[112409]: Reconfiguring osd.2 (monmap changed)... 2024-02-20T08:10:13.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:13 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.2 on smithi123 2024-02-20T08:10:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:13 smithi194 ceph-mon[88937]: pgmap v19: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:13 smithi194 ceph-mon[88937]: Reconfiguring osd.2 (monmap changed)... 2024-02-20T08:10:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:13 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.2 on smithi123 2024-02-20T08:10:15.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:15.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:15.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: Reconfiguring mds.cephfs.smithi123.gglmsl (monmap changed)... 2024-02-20T08:10:15.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: Reconfiguring daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:10:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:15 smithi123 ceph-mon[112409]: pgmap v20: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: Reconfiguring mds.cephfs.smithi123.gglmsl (monmap changed)... 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: Reconfiguring daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:10:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:15 smithi194 ceph-mon[88937]: pgmap v20: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: Reconfiguring mds.cephfs.smithi123.uffypv (monmap changed)... 2024-02-20T08:10:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: Reconfiguring daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:10:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:17 smithi123 ceph-mon[112409]: pgmap v21: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: Reconfiguring mds.cephfs.smithi123.uffypv (monmap changed)... 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: Reconfiguring daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:10:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:17 smithi194 ceph-mon[88937]: pgmap v21: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: Reconfiguring crash.smithi194 (monmap changed)... 2024-02-20T08:10:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: Reconfiguring daemon crash.smithi194 on smithi194 2024-02-20T08:10:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:18 smithi123 ceph-mon[112409]: pgmap v22: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: Reconfiguring crash.smithi194 (monmap changed)... 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: Reconfiguring daemon crash.smithi194 on smithi194 2024-02-20T08:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:18 smithi194 ceph-mon[88937]: pgmap v22: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: Reconfiguring mgr.smithi194.pvhorj (monmap changed)... 2024-02-20T08:10:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:10:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:10:20.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:20.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:20 smithi194 ceph-mon[88937]: Reconfiguring daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: Reconfiguring mgr.smithi194.pvhorj (monmap changed)... 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.pvhorj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:20 smithi123 ceph-mon[112409]: Reconfiguring daemon mgr.smithi194.pvhorj on smithi194 2024-02-20T08:10:21.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: pgmap v23: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:10:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:10:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:21.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: pgmap v23: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:21.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:21.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-20T08:10:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-20T08:10:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:22.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:22 smithi194 ceph-mon[88937]: Reconfiguring mon.smithi194 (monmap changed)... 2024-02-20T08:10:22.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:22 smithi194 ceph-mon[88937]: Reconfiguring daemon mon.smithi194 on smithi194 2024-02-20T08:10:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:22 smithi123 ceph-mon[112409]: Reconfiguring mon.smithi194 (monmap changed)... 2024-02-20T08:10:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:22 smithi123 ceph-mon[112409]: Reconfiguring daemon mon.smithi194 on smithi194 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: pgmap v24: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: Reconfiguring osd.3 (monmap changed)... 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T08:10:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:23.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:23 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.3 on smithi194 2024-02-20T08:10:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: pgmap v24: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: Reconfiguring osd.3 (monmap changed)... 2024-02-20T08:10:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T08:10:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:24.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:23 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.3 on smithi194 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: Reconfiguring osd.4 (monmap changed)... 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:25.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.4 on smithi194 2024-02-20T08:10:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:25 smithi194 ceph-mon[88937]: pgmap v25: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: Reconfiguring osd.4 (monmap changed)... 2024-02-20T08:10:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:10:25.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:25.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.4 on smithi194 2024-02-20T08:10:25.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:25 smithi123 ceph-mon[112409]: pgmap v25: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:26.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:26.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:26.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:26.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:10:26.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:10:26.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:27.616 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:27 smithi194 ceph-mon[88937]: Reconfiguring osd.5 (monmap changed)... 2024-02-20T08:10:27.616 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:27 smithi194 ceph-mon[88937]: Reconfiguring daemon osd.5 on smithi194 2024-02-20T08:10:27.616 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:27 smithi194 ceph-mon[88937]: pgmap v26: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:27 smithi123 ceph-mon[112409]: Reconfiguring osd.5 (monmap changed)... 2024-02-20T08:10:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:27 smithi123 ceph-mon[112409]: Reconfiguring daemon osd.5 on smithi194 2024-02-20T08:10:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:27 smithi123 ceph-mon[112409]: pgmap v26: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:28.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: Reconfiguring mds.cephfs.smithi194.icyfny (monmap changed)... 2024-02-20T08:10:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:28 smithi194 ceph-mon[88937]: Reconfiguring daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:10:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: Reconfiguring mds.cephfs.smithi194.icyfny (monmap changed)... 2024-02-20T08:10:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:28 smithi123 ceph-mon[112409]: Reconfiguring daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:10:29.984 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:29 smithi194 ceph-mon[88937]: pgmap v27: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:29.984 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:29.984 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:29.984 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:29.984 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:29 smithi123 ceph-mon[112409]: pgmap v27: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:10:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:30.839 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:30 smithi194 ceph-mon[88937]: Reconfiguring mds.cephfs.smithi194.lquaku (monmap changed)... 2024-02-20T08:10:30.839 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:30 smithi194 ceph-mon[88937]: Reconfiguring daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:10:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:30 smithi123 ceph-mon[112409]: Reconfiguring mds.cephfs.smithi194.lquaku (monmap changed)... 2024-02-20T08:10:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:30 smithi123 ceph-mon[112409]: Reconfiguring daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:10:31.823 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: pgmap v28: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:31.823 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi123"}]: dispatch 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi123"}]': finished 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2024-02-20T08:10:31.824 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2024-02-20T08:10:32.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 -- 172.21.15.123:0/2239644185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fdfe0 msgr2=0x7f53fc0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 --2- 172.21.15.123:0/2239644185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc0fe3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f53ec004970 tx=0x7f53ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:32.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 -- 172.21.15.123:0/2239644185 shutdown_connections 2024-02-20T08:10:32.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 --2- 172.21.15.123:0/2239644185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 --2- 172.21.15.123:0/2239644185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc0fe3b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 -- 172.21.15.123:0/2239644185 >> 172.21.15.123:0/2239644185 conn(0x7f53fc071d90 msgr2=0x7f53fc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 -- 172.21.15.123:0/2239644185 shutdown_connections 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.091+0000 7f5402933700 1 -- 172.21.15.123:0/2239644185 wait complete. 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 Processor -- start 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 -- start start 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1146f0 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f5402933700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc10d990 con 0x7f53fc0fdfe0 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37524/0 (socket says 172.21.15.123:37524) 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 -- 172.21.15.123:0/3072368561 learned_addr learned my addr 172.21.15.123:0/3072368561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fbfff700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 -- 172.21.15.123:0/3072368561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 msgr2=0x7f53fc113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fb7fe700 1 -- 172.21.15.123:0/3072368561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec005040 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.092+0000 7f53fbfff700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f53fb7fe700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53f000b790 tx=0x7f53f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f000f770 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc10dc70 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53f000fda0 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f000d310 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.093+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc10e1b0 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.094+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f53f000f8d0 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.094+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc1046c0 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.095+0000 7f53f8ff9700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 0x7f53e406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.095+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f53f008cf30 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.095+0000 7f53fbfff700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 0x7f53e406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.095+0000 7f53fbfff700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 0x7f53e406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.100+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f53f00c0d20 con 0x7f53fc0fe8f0 2024-02-20T08:10:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: pgmap v28: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi123"}]: dispatch 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi123"}]': finished 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2024-02-20T08:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2024-02-20T08:10:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.321+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53fc1137a0 con 0x7f53e406d900 2024-02-20T08:10:32.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.322+0000 7f53f8ff9700 1 -- 172.21.15.123:0/3072368561 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f53fc1137a0 con 0x7f53e406d900 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.324+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 msgr2=0x7f53e406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.324+0000 7f5402933700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 0x7f53e406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.324+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 msgr2=0x7f53fc114010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.324+0000 7f5402933700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53f000b790 tx=0x7f53f0009250 comp rx=0 tx=0).stop 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 shutdown_connections 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f53e406d900 0x7f53e406fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53fc0fdfe0 0x7f53fc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 --2- 172.21.15.123:0/3072368561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0fe8f0 0x7f53fc114010 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 >> 172.21.15.123:0/3072368561 conn(0x7f53fc071d90 msgr2=0x7f53fc101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 shutdown_connections 2024-02-20T08:10:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.325+0000 7f5402933700 1 -- 172.21.15.123:0/3072368561 wait complete. 2024-02-20T08:10:32.335 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 -- 172.21.15.123:0/3179165767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fe8f0 msgr2=0x7fb8c8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/3179165767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8107050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc004970 tx=0x7fb8bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 -- 172.21.15.123:0/3179165767 shutdown_connections 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/3179165767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8107050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/3179165767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c80fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 -- 172.21.15.123:0/3179165767 >> 172.21.15.123:0/3179165767 conn(0x7fb8c8071d90 msgr2=0x7fb8c8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 -- 172.21.15.123:0/3179165767 shutdown_connections 2024-02-20T08:10:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 -- 172.21.15.123:0/3179165767 wait complete. 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.427+0000 7fb8cdc14700 1 Processor -- start 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8cdc14700 1 -- start start 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8cdc14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8cdc14700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8cdc14700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81145a0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8cdc14700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c810d8d0 con 0x7fb8c80fe8f0 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37544/0 (socket says 172.21.15.123:37544) 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 -- 172.21.15.123:0/802721646 learned_addr learned my addr 172.21.15.123:0/802721646 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c6ffd700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 -- 172.21.15.123:0/802721646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fe8f0 msgr2=0x7fb8c8113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 -- 172.21.15.123:0/802721646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc005040 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8c77fe700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000cb10 tx=0x7fb8c0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.428+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c0004200 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.429+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8c000acc0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.429+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c810dbb0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.429+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c0003d90 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.429+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c810e0c0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.430+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c81046c0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.430+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fb8c0003430 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.431+0000 7fb8affff700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 0x7fb8b006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.431+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb8c008d5c0 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.431+0000 7fb8c6ffd700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 0x7fb8b006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.431+0000 7fb8c6ffd700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 0x7fb8b006fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8c810ec00 tx=0x7fb8bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.435+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb8c005a880 con 0x7fb8c80fdfe0 2024-02-20T08:10:32.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.656+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c804bed0 con 0x7fb8b006d900 2024-02-20T08:10:32.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.657+0000 7fb8affff700 1 -- 172.21.15.123:0/802721646 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb8c804bed0 con 0x7fb8b006d900 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 msgr2=0x7fb8b006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 0x7fb8b006fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8c810ec00 tx=0x7fb8bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 msgr2=0x7fb8c8113a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000cb10 tx=0x7fb8c0007f70 comp rx=0 tx=0).stop 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 shutdown_connections 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb8b006d900 0x7fb8b006fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c80fdfe0 0x7fb8c8113a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 --2- 172.21.15.123:0/802721646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8c80fe8f0 0x7fb8c8113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 >> 172.21.15.123:0/802721646 conn(0x7fb8c8071d90 msgr2=0x7fb8c8101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:32.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 shutdown_connections 2024-02-20T08:10:32.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.659+0000 7fb8cdc14700 1 -- 172.21.15.123:0/802721646 wait complete. 2024-02-20T08:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 -- 172.21.15.123:0/1029817744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8781027e0 msgr2=0x7fb8780fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 --2- 172.21.15.123:0/1029817744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8781027e0 0x7fb8780fbea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb868004940 tx=0x7fb868009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 -- 172.21.15.123:0/1029817744 shutdown_connections 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 --2- 172.21.15.123:0/1029817744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8781027e0 0x7fb8780fbea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 --2- 172.21.15.123:0/1029817744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb878101e40 0x7fb878102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 -- 172.21.15.123:0/1029817744 >> 172.21.15.123:0/1029817744 conn(0x7fb878071d90 msgr2=0x7fb878072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 -- 172.21.15.123:0/1029817744 shutdown_connections 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.769+0000 7fb87fade700 1 -- 172.21.15.123:0/1029817744 wait complete. 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 Processor -- start 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 -- start start 2024-02-20T08:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8781027e0 0x7fb8780fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780fe600 con 0x7fb878101e40 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87fade700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780fe770 con 0x7fb8781027e0 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87d87a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87d87a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37560/0 (socket says 172.21.15.123:37560) 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87d87a700 1 -- 172.21.15.123:0/1602176566 learned_addr learned my addr 172.21.15.123:0/1602176566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.770+0000 7fb87d079700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8781027e0 0x7fb8780fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87d87a700 1 -- 172.21.15.123:0/1602176566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8781027e0 msgr2=0x7fb8780fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87d87a700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8781027e0 0x7fb8780fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87d87a700 1 -- 172.21.15.123:0/1602176566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868005040 con 0x7fb878101e40 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87d87a700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb874002a50 tx=0x7fb8740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb874007cc0 con 0x7fb878101e40 2024-02-20T08:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb87400f040 con 0x7fb878101e40 2024-02-20T08:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb87400da30 con 0x7fb878101e40 2024-02-20T08:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb878119ce0 con 0x7fb878101e40 2024-02-20T08:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.771+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87811a140 con 0x7fb878101e40 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.772+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8780738b0 con 0x7fb878101e40 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.772+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fb87400db90 con 0x7fb878101e40 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.773+0000 7fb86e7fc700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 0x7fb86406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.773+0000 7fb87d079700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 0x7fb86406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.773+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb87408cea0 con 0x7fb878101e40 2024-02-20T08:10:32.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.774+0000 7fb87d079700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 0x7fb86406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb86800b3b0 tx=0x7fb868009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.778+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb874056520 con 0x7fb878101e40 2024-02-20T08:10:32.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.987+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8780ff370 con 0x7fb86406d900 2024-02-20T08:10:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.997+0000 7fb86e7fc700 1 -- 172.21.15.123:0/1602176566 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb86800b6e0 con 0x7fb86406d900 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (2m) 47s ago 14m 18.5M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (14m) 47s ago 14m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 53a7916576d1 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (12m) 33s ago 12m 6660k - 17.2.7-521-gc80e7168 10b0c032c913 ea43940c640b 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (2m) 47s ago 13m 78.7M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (8m) 47s ago 8m 13.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (8m) 47s ago 8m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (8m) 33s ago 8m 16.6M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (8m) 33s ago 8m 14.5M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (4m) 47s ago 15m 470M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (3m) 33s ago 12m 447M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:10:32.998 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (61s) 47s ago 15m 30.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (36s) 33s ago 12m 26.4M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (3m) 47s ago 14m 16.8M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (2m) 33s ago 12m 15.7M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (12m) 47s ago 12m 189M 1557M 17.2.7-521-gc80e7168 10b0c032c913 70571a838f6a 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (11m) 47s ago 11m 193M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (11m) 47s ago 11m 173M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (10m) 33s ago 10m 228M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (10m) 33s ago 10m 200M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (9m) 33s ago 9m 196M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:10:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (2m) 47s ago 13m 54.9M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:10:32.999 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:32 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all mon 2024-02-20T08:10:33.000 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:33.000 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:33.000 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:33.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 msgr2=0x7fb86406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 0x7fb86406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb86800b3b0 tx=0x7fb868009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 msgr2=0x7fb8780fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb874002a50 tx=0x7fb8740046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 shutdown_connections 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb86406d900 0x7fb86406fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb878101e40 0x7fb8780fdac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:32.999+0000 7fb87fade700 1 --2- 172.21.15.123:0/1602176566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8781027e0 0x7fb8780fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.000+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 >> 172.21.15.123:0/1602176566 conn(0x7fb878071d90 msgr2=0x7fb878065720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.000+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 shutdown_connections 2024-02-20T08:10:33.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.000+0000 7fb87fade700 1 -- 172.21.15.123:0/1602176566 wait complete. 2024-02-20T08:10:33.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 -- 172.21.15.123:0/2625901670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc1038e0 msgr2=0x7f16cc0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 --2- 172.21.15.123:0/2625901670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc1038e0 0x7f16cc0fcf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f16c0004940 tx=0x7f16c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 -- 172.21.15.123:0/2625901670 shutdown_connections 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 --2- 172.21.15.123:0/2625901670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc1038e0 0x7f16cc0fcf50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 --2- 172.21.15.123:0/2625901670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc102f40 0x7f16cc103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 -- 172.21.15.123:0/2625901670 >> 172.21.15.123:0/2625901670 conn(0x7f16cc0f8af0 msgr2=0x7f16cc0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 -- 172.21.15.123:0/2625901670 shutdown_connections 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.111+0000 7f16d16f8700 1 -- 172.21.15.123:0/2625901670 wait complete. 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 Processor -- start 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 -- start start 2024-02-20T08:10:33.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc1038e0 0x7f16cc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc1145f0 con 0x7f16cc102f40 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16d16f8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc10d920 con 0x7f16cc1038e0 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37566/0 (socket says 172.21.15.123:37566) 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 -- 172.21.15.123:0/4083687492 learned_addr learned my addr 172.21.15.123:0/4083687492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16ca7fc700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc1038e0 0x7f16cc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 -- 172.21.15.123:0/4083687492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc1038e0 msgr2=0x7f16cc113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc1038e0 0x7f16cc113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.112+0000 7f16caffd700 1 -- 172.21.15.123:0/4083687492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0005040 con 0x7f16cc102f40 2024-02-20T08:10:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16caffd700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16bc002a50 tx=0x7f16bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16bc007cc0 con 0x7f16cc102f40 2024-02-20T08:10:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16bc00f040 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc10dc00 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16bc009640 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.113+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc10e140 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.114+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc105410 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.114+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f16bc0097a0 con 0x7f16cc102f40 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.115+0000 7f16b37fe700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 0x7f16b406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.115+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f16bc08cec0 con 0x7f16cc102f40 2024-02-20T08:10:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.115+0000 7f16ca7fc700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 0x7f16b406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.115+0000 7f16ca7fc700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 0x7f16b406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f16cc10f290 tx=0x7f16c0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.120+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f16bc05a070 con 0x7f16cc102f40 2024-02-20T08:10:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:32 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all mon 2024-02-20T08:10:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:33.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.405+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16cc0fc6f0 con 0x7f16cc102f40 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.405+0000 7f16b37fe700 1 -- 172.21.15.123:0/4083687492 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f16bc059c00 con 0x7f16cc102f40 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6 2024-02-20T08:10:33.406 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 10, 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:10:33.407 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.407+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 msgr2=0x7f16b406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.407+0000 7f16d16f8700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 0x7f16b406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f16cc10f290 tx=0x7f16c0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.407+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 msgr2=0x7f16cc113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.407+0000 7f16d16f8700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16bc002a50 tx=0x7f16bc0046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 shutdown_connections 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f16b406d900 0x7f16b406fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16cc102f40 0x7f16cc113a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 --2- 172.21.15.123:0/4083687492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16cc1038e0 0x7f16cc113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 >> 172.21.15.123:0/4083687492 conn(0x7f16cc0f8af0 msgr2=0x7f16cc0fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 shutdown_connections 2024-02-20T08:10:33.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.408+0000 7f16d16f8700 1 -- 172.21.15.123:0/4083687492 wait complete. 2024-02-20T08:10:33.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 -- 172.21.15.123:0/4272099729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fe8f0 msgr2=0x7f0e9c107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 --2- 172.21.15.123:0/4272099729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c107050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e90004970 tx=0x7f0e90009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 -- 172.21.15.123:0/4272099729 shutdown_connections 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 --2- 172.21.15.123:0/4272099729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c107050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 --2- 172.21.15.123:0/4272099729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 -- 172.21.15.123:0/4272099729 >> 172.21.15.123:0/4272099729 conn(0x7f0e9c071d90 msgr2=0x7f0e9c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 -- 172.21.15.123:0/4272099729 shutdown_connections 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.511+0000 7f0ea0882700 1 -- 172.21.15.123:0/4272099729 wait complete. 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 Processor -- start 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 -- start start 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c0fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0fc9e0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0ea0882700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0fcb50 con 0x7f0e9c0fe8f0 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37580/0 (socket says 172.21.15.123:37580) 2024-02-20T08:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 -- 172.21.15.123:0/2438503245 learned_addr learned my addr 172.21.15.123:0/2438503245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e99d9b700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c0fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 -- 172.21.15.123:0/2438503245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 msgr2=0x7f0e9c0fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c0fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 -- 172.21.15.123:0/2438503245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90005040 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e99d9b700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c0fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.512+0000 7f0e9a59c700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c002a50 tx=0x7f0e8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.513+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e8c007cc0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.513+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c119c30 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.513+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e8c00f040 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.513+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e8c009640 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.513+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c11a110 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.514+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c1046c0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.514+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f0e8c0097c0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.515+0000 7f0e8affd700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 0x7f0e8406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.515+0000 7f0e99d9b700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 0x7f0e8406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.515+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0e8c08ce80 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.515+0000 7f0e99d9b700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 0x7f0e8406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009fd0 tx=0x7f0e90009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.519+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0e8c056500 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.759+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e9c04bed0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.759+0000 7f0e8affd700 1 -- 172.21.15.123:0/2438503245 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f0e8c059bc0 con 0x7f0e9c0fdfe0 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:10:33.760 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:10:33.761 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:10:33.762 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:33.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:10:33.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 msgr2=0x7f0e8406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 0x7f0e8406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009fd0 tx=0x7f0e90009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 msgr2=0x7f0e9c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c002a50 tx=0x7f0e8c0046b0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 shutdown_connections 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e8406d900 0x7f0e8406fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e9c0fdfe0 0x7f0e9c0fbea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 --2- 172.21.15.123:0/2438503245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e9c0fe8f0 0x7f0e9c0fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.761+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 >> 172.21.15.123:0/2438503245 conn(0x7f0e9c071d90 msgr2=0x7f0e9c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.762+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 shutdown_connections 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.762+0000 7f0ea0882700 1 -- 172.21.15.123:0/2438503245 wait complete. 2024-02-20T08:10:33.765 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:10:33.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 -- 172.21.15.123:0/2035417140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 msgr2=0x7f79180fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 --2- 172.21.15.123:0/2035417140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fb9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f790c004940 tx=0x7f790c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:33.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 -- 172.21.15.123:0/2035417140 shutdown_connections 2024-02-20T08:10:33.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 --2- 172.21.15.123:0/2035417140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fb9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 --2- 172.21.15.123:0/2035417140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 0x7f7918103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 -- 172.21.15.123:0/2035417140 >> 172.21.15.123:0/2035417140 conn(0x7f7918071560 msgr2=0x7f7918071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 -- 172.21.15.123:0/2035417140 shutdown_connections 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.864+0000 7f791e7fe700 1 -- 172.21.15.123:0/2035417140 wait complete. 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 Processor -- start 2024-02-20T08:10:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 -- start start 2024-02-20T08:10:33.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 0x7f79180fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180fd320 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f791e7fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180fd490 con 0x7f7918103140 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.865+0000 7f7917fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37606/0 (socket says 172.21.15.123:37606) 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 -- 172.21.15.123:0/676328152 learned_addr learned my addr 172.21.15.123:0/676328152 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f79177fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 0x7f79180fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 -- 172.21.15.123:0/676328152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 msgr2=0x7f79180fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 0x7f79180fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 -- 172.21.15.123:0/676328152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c005040 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7917fff700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f790800b790 tx=0x7f7908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790800f770 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918119ec0 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791811a380 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f790800fda0 con 0x7f79180fb570 2024-02-20T08:10:33.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.866+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790800d310 con 0x7f79180fb570 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.867+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918105570 con 0x7f79180fb570 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.868+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f790800f8d0 con 0x7f79180fb570 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.868+0000 7f7914ff9700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 0x7f790006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.868+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f790808cf40 con 0x7f79180fb570 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.868+0000 7f79177fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 0x7f790006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:33.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.868+0000 7f79177fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 0x7f790006fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79180fe150 tx=0x7f790c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:33.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:33.872+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f79080c0d20 con 0x7f79180fb570 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: pgmap v29: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: Upgrade: Updating crash.smithi123 (1/2) 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: Deploying daemon crash.smithi123 on smithi123 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:33 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/4083687492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:34.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.097+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f791804bed0 con 0x7f790006d900 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.099+0000 7f7914ff9700 1 -- 172.21.15.123:0/676328152 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f791804bed0 con 0x7f790006d900 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:10:34.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr" 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "4/21 daemons upgraded", 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading crash daemons", 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:10:34.100 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:10:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 msgr2=0x7f790006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 0x7f790006fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79180fe150 tx=0x7f790c009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 msgr2=0x7f79180fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f790800b790 tx=0x7f7908009250 comp rx=0 tx=0).stop 2024-02-20T08:10:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 shutdown_connections 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f790006d900 0x7f790006fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79180fb570 0x7f79180fc750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 --2- 172.21.15.123:0/676328152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7918103140 0x7f79180fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 >> 172.21.15.123:0/676328152 conn(0x7f7918071560 msgr2=0x7f79180f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 shutdown_connections 2024-02-20T08:10:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.101+0000 7f791e7fe700 1 -- 172.21.15.123:0/676328152 wait complete. 2024-02-20T08:10:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: pgmap v29: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: Upgrade: Updating crash.smithi123 (1/2) 2024-02-20T08:10:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: Deploying daemon crash.smithi123 on smithi123 2024-02-20T08:10:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:34.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:33 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/4083687492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:34.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- 172.21.15.123:0/3451536665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c01038f0 msgr2=0x7ff1c00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 --2- 172.21.15.123:0/3451536665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c01038f0 0x7ff1c00fcf60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0004940 tx=0x7ff1b0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- 172.21.15.123:0/3451536665 shutdown_connections 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 --2- 172.21.15.123:0/3451536665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c01038f0 0x7ff1c00fcf60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 --2- 172.21.15.123:0/3451536665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1c0102f50 0x7ff1c0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- 172.21.15.123:0/3451536665 >> 172.21.15.123:0/3451536665 conn(0x7ff1c00f8ae0 msgr2=0x7ff1c00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- 172.21.15.123:0/3451536665 shutdown_connections 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- 172.21.15.123:0/3451536665 wait complete. 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 Processor -- start 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.203+0000 7ff1c877d700 1 -- start start 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1c01038f0 0x7ff1c0114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c01146e0 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c010d980 con 0x7ff1c01038f0 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37618/0 (socket says 172.21.15.123:37618) 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 -- 172.21.15.123:0/2725676968 learned_addr learned my addr 172.21.15.123:0/2725676968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 -- 172.21.15.123:0/2725676968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1c01038f0 msgr2=0x7ff1c0114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1c01038f0 0x7ff1c0114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 -- 172.21.15.123:0/2725676968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b0005040 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c6519700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b790 tx=0x7ff1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1bc00f770 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1bc00fda0 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c010dc60 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1bc00d310 con 0x7ff1c0102f50 2024-02-20T08:10:34.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.204+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c010e1a0 con 0x7ff1c0102f50 2024-02-20T08:10:34.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.205+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00fc6e0 con 0x7ff1c0102f50 2024-02-20T08:10:34.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.206+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7ff1bc010420 con 0x7ff1c0102f50 2024-02-20T08:10:34.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.206+0000 7ff1b6ffd700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 0x7ff1ac06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:10:34.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.206+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff1bc08d040 con 0x7ff1c0102f50 2024-02-20T08:10:34.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.206+0000 7ff1c5d18700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 0x7ff1ac06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:10:34.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.207+0000 7ff1c5d18700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 0x7ff1ac06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000b3b0 tx=0x7ff1b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:10:34.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.211+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff1bc05a380 con 0x7ff1c0102f50 2024-02-20T08:10:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.529+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff1c010f0a0 con 0x7ff1c0102f50 2024-02-20T08:10:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.529+0000 7ff1b6ffd700 1 -- 172.21.15.123:0/2725676968 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff1bc059f10 con 0x7ff1c0102f50 2024-02-20T08:10:34.530 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:34.530 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:10:34.530 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:10:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 msgr2=0x7ff1ac06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 0x7ff1ac06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000b3b0 tx=0x7ff1b0009e30 comp rx=0 tx=0).stop 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 msgr2=0x7ff1c0113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b790 tx=0x7ff1bc009250 comp rx=0 tx=0).stop 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 shutdown_connections 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff1ac06d900 0x7ff1ac06fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1c0102f50 0x7ff1c0113ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 --2- 172.21.15.123:0/2725676968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1c01038f0 0x7ff1c0114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.531+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 >> 172.21.15.123:0/2725676968 conn(0x7ff1c00f8ae0 msgr2=0x7ff1c00fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.532+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 shutdown_connections 2024-02-20T08:10:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:10:34.532+0000 7ff1c877d700 1 -- 172.21.15.123:0/2725676968 wait complete. 2024-02-20T08:10:34.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:34 smithi123 ceph-mon[112409]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:34.799 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:34 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2438503245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:10:34.799 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:34 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2725676968' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:10:35.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:34 smithi194 ceph-mon[88937]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:35.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:34 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2438503245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:10:35.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:34 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2725676968' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:10:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:35 smithi123 ceph-mon[112409]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:35 smithi123 ceph-mon[112409]: pgmap v30: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:36.065 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:35 smithi194 ceph-mon[88937]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:10:36.065 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:35 smithi194 ceph-mon[88937]: pgmap v30: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:37.783 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:37.784 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:37.784 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:37 smithi123 ceph-mon[112409]: pgmap v31: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:37.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:37.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:37.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:37 smithi194 ceph-mon[88937]: pgmap v31: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:39.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: Upgrade: Updating crash.smithi194 (2/2) 2024-02-20T08:10:39.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:39.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:39.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:39.319 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: Deploying daemon crash.smithi194 on smithi194 2024-02-20T08:10:39.320 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:39 smithi194 ceph-mon[88937]: pgmap v32: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: Upgrade: Updating crash.smithi194 (2/2) 2024-02-20T08:10:39.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-20T08:10:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: Deploying daemon crash.smithi194 on smithi194 2024-02-20T08:10:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:39 smithi123 ceph-mon[112409]: pgmap v32: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:41 smithi194 ceph-mon[88937]: pgmap v33: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:41 smithi123 ceph-mon[112409]: pgmap v33: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:42.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:42.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:43.950 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:43 smithi194 ceph-mon[88937]: pgmap v34: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:44.003 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:43 smithi123 ceph-mon[112409]: pgmap v34: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:45.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:45.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:45.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:45 smithi194 ceph-mon[88937]: pgmap v35: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:45 smithi123 ceph-mon[112409]: pgmap v35: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:46 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:46 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:47.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:47 smithi194 ceph-mon[88937]: pgmap v36: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:47.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:47.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:47 smithi123 ceph-mon[112409]: pgmap v36: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:48.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:48.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:48.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:48 smithi194 ceph-mon[88937]: pgmap v37: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:49.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:48 smithi123 ceph-mon[112409]: pgmap v37: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:50.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:50.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:51 smithi123 ceph-mon[112409]: pgmap v38: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:51.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:51 smithi194 ceph-mon[88937]: pgmap v38: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all crash 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi123"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi123"}]': finished 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-20T08:10:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:52 smithi123 ceph-mon[112409]: Upgrade: osd.0 is safe to restart 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all crash 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi123"}]: dispatch 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi123"}]': finished 2024-02-20T08:10:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2024-02-20T08:10:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2024-02-20T08:10:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-20T08:10:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-20T08:10:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:52 smithi194 ceph-mon[88937]: Upgrade: osd.0 is safe to restart 2024-02-20T08:10:53.746 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:53 smithi123 ceph-mon[112409]: pgmap v39: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:53.746 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:53.746 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T08:10:53.746 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:53.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:53 smithi194 ceph-mon[88937]: pgmap v39: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:53.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:10:53.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-20T08:10:53.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:10:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:54 smithi123 ceph-mon[112409]: Upgrade: Updating osd.0 2024-02-20T08:10:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:54 smithi123 ceph-mon[112409]: Deploying daemon osd.0 on smithi123 2024-02-20T08:10:54.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:54 smithi194 ceph-mon[88937]: Upgrade: Updating osd.0 2024-02-20T08:10:54.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:54 smithi194 ceph-mon[88937]: Deploying daemon osd.0 on smithi123 2024-02-20T08:10:55.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:55 smithi123 ceph-mon[112409]: pgmap v40: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:55.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:55 smithi194 ceph-mon[88937]: pgmap v40: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:56.599 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:56.600 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:56 smithi123 systemd[1]: Stopping Ceph osd.0 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:10:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:10:57.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:56 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[47654]: 2024-02-20T08:10:56.598+0000 7f89a6d8a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:10:57.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:56 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[47654]: 2024-02-20T08:10:56.598+0000 7f89a6d8a700 -1 osd.0 50 *** Got signal Terminated *** 2024-02-20T08:10:57.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:56 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[47654]: 2024-02-20T08:10:56.598+0000 7f89a6d8a700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:10:57.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:57 smithi123 ceph-mon[112409]: osd.0 marked itself down and dead 2024-02-20T08:10:57.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:57 smithi123 ceph-mon[112409]: pgmap v41: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:57 smithi194 ceph-mon[88937]: osd.0 marked itself down and dead 2024-02-20T08:10:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:57 smithi194 ceph-mon[88937]: pgmap v41: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:58.083 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:57 smithi123 podman[122860]: 2024-02-20 08:10:57.824258789 +0000 UTC m=+1.375337560 container died 70571a838f6ad4c55ce75153b423bf4a926260292b0a14ec8897c4dc2ecbb135 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-c80e716, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-20T08:10:58.423 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:58 smithi123 podman[122860]: 2024-02-20 08:10:58.207068457 +0000 UTC m=+1.758147242 container cleanup 70571a838f6ad4c55ce75153b423bf4a926260292b0a14ec8897c4dc2ecbb135 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-c80e716, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-20T08:10:58.423 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:58 smithi123 bash[122860]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0 2024-02-20T08:10:58.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:58 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:10:58.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:58 smithi123 ceph-mon[112409]: failed to encode map e51 with expected crc 2024-02-20T08:10:58.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:58 smithi123 ceph-mon[112409]: osdmap e51: 6 total, 5 up, 6 in 2024-02-20T08:10:58.759 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:58 smithi123 podman[122881]: 2024-02-20 08:10:58.478940904 +0000 UTC m=+0.654908477 container remove 70571a838f6ad4c55ce75153b423bf4a926260292b0a14ec8897c4dc2ecbb135 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, ceph=True) 2024-02-20T08:10:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:58 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:10:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:58 smithi194 ceph-mon[88937]: failed to encode map e51 with expected crc 2024-02-20T08:10:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:58 smithi194 ceph-mon[88937]: osdmap e51: 6 total, 5 up, 6 in 2024-02-20T08:10:59.145 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:58 smithi123 podman[122972]: 2024-02-20 08:10:58.731006202 +0000 UTC m=+0.018459667 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:10:59.145 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:58 smithi123 podman[122972]: 2024-02-20 08:10:58.834492767 +0000 UTC m=+0.121946229 container create 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:10:59.145 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:59 smithi123 podman[122972]: 2024-02-20 08:10:59.045592574 +0000 UTC m=+0.333046035 container init 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-20T08:10:59.145 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:59 smithi123 podman[122972]: 2024-02-20 08:10:59.048931456 +0000 UTC m=+0.336384927 container start 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-20T08:10:59.146 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:59 smithi123 podman[122972]: 2024-02-20 08:10:59.14555737 +0000 UTC m=+0.433010837 container attach 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-20T08:10:59.431 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:10:59 smithi123 podman[122972]: 2024-02-20 08:10:59.345132089 +0000 UTC m=+0.632585555 container died 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: osdmap e52: 6 total, 5 up, 6 in 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:10:59 smithi123 ceph-mon[112409]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: osdmap e52: 6 total, 5 up, 6 in 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: failed to encode map e52 with expected crc 2024-02-20T08:10:59.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:10:59 smithi194 ceph-mon[88937]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:00.258 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[122998]: 2024-02-20 08:11:00.008236359 +0000 UTC m=+0.657805151 container remove 0cc59058926e2253adb666f6b904c5909fb1b73afc95a77279b28062f751cf98 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2) 2024-02-20T08:11:00.258 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-20T08:11:00.258 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 systemd[1]: Stopped Ceph osd.0 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:11:00.259 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.0.service: Consumed 48.669s CPU time. 2024-02-20T08:11:00.259 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 systemd[1]: Starting Ceph osd.0 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:11:00.704 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[123106]: 2024-02-20 08:11:00.450919729 +0000 UTC m=+0.113463152 container create f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-20T08:11:00.704 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[123106]: 2024-02-20 08:11:00.355386397 +0000 UTC m=+0.017929820 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:00.704 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[123106]: 2024-02-20 08:11:00.704062961 +0000 UTC m=+0.366606389 container init f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214) 2024-02-20T08:11:01.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[123106]: 2024-02-20 08:11:00.707771513 +0000 UTC m=+0.370314947 container start f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214) 2024-02-20T08:11:01.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:00 smithi123 podman[123106]: 2024-02-20 08:11:00.812022616 +0000 UTC m=+0.474566057 container attach f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-20T08:11:01.465 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 bash[123106]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate[123121]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-20T08:11:01.466 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 podman[123106]: 2024-02-20 08:11:01.175216351 +0000 UTC m=+0.837759772 container died f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:11:01.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:01 smithi123 ceph-mon[112409]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:02.033 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 podman[123254]: 2024-02-20 08:11:01.782581235 +0000 UTC m=+0.597663381 container remove f2bd05bc13ff3f0eac1bdb56ddb7b0335f9f1d72c86ac3afa0e0270e9148cbc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-20T08:11:02.033 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:01 smithi123 podman[123320]: 2024-02-20 08:11:01.896326615 +0000 UTC m=+0.018381220 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:02.033 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 podman[123320]: 2024-02-20 08:11:02.033707657 +0000 UTC m=+0.155762255 container create 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-20T08:11:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:01 smithi194 ceph-mon[88937]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:02.311 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 podman[123320]: 2024-02-20 08:11:02.210787591 +0000 UTC m=+0.332842183 container init 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-02-20T08:11:02.311 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 podman[123320]: 2024-02-20 08:11:02.21370547 +0000 UTC m=+0.335760065 container start 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-20T08:11:02.311 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 ceph-osd[123339]: -- 172.21.15.123:0/2814753964 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560fb551f1e0 con 0x560fb54f1000 2024-02-20T08:11:02.756 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 bash[123320]: 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c 2024-02-20T08:11:02.756 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 systemd[1]: Started Ceph osd.0 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:11:03.008 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:02 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T08:11:02.755+0000 7fc760a157c0 -1 Falling back to public interface 2024-02-20T08:11:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:03.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:03.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:03 smithi123 ceph-mon[112409]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:03 smithi194 ceph-mon[88937]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 -- 172.21.15.123:0/1081858999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fc6f0 msgr2=0x7f3de0100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 --2- 172.21.15.123:0/1081858999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fc6f0 0x7f3de0100d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0004940 tx=0x7f3dd0009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 -- 172.21.15.123:0/1081858999 shutdown_connections 2024-02-20T08:11:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 --2- 172.21.15.123:0/1081858999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fc6f0 0x7f3de0100d10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 --2- 172.21.15.123:0/1081858999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fbd50 0x7f3de00fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 -- 172.21.15.123:0/1081858999 >> 172.21.15.123:0/1081858999 conn(0x7f3de00f7a10 msgr2=0x7f3de00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:04.638 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:04 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 -- 172.21.15.123:0/1081858999 shutdown_connections 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.637+0000 7f3de7f13700 1 -- 172.21.15.123:0/1081858999 wait complete. 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 Processor -- start 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 -- start start 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fc6f0 0x7f3de011a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de011ad10 con 0x7f3de00fbd50 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de7f13700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0113f90 con 0x7f3de00fc6f0 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59700/0 (socket says 172.21.15.123:59700) 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 -- 172.21.15.123:0/4145752880 learned_addr learned my addr 172.21.15.123:0/4145752880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de54ae700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fc6f0 0x7f3de011a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 -- 172.21.15.123:0/4145752880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fc6f0 msgr2=0x7f3de011a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fc6f0 0x7f3de011a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 -- 172.21.15.123:0/4145752880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0005040 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.638+0000 7f3de5caf700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800bbb0 tx=0x7f3dd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.639+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd80092e0 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.639+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0114210 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.639+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dd800cb20 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.639+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd8015d70 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.639+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0114750 con 0x7f3de00fbd50 2024-02-20T08:11:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.640+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de00fe430 con 0x7f3de00fbd50 2024-02-20T08:11:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.640+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f3dd8012070 con 0x7f3de00fbd50 2024-02-20T08:11:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.641+0000 7f3dd67fc700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 0x7f3dcc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.641+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3dd808cd20 con 0x7f3de00fbd50 2024-02-20T08:11:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.641+0000 7f3de54ae700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 0x7f3dcc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.641+0000 7f3de54ae700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 0x7f3dcc06fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3de0115990 tx=0x7f3dd0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:04.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:04 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.646+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3dd8059fe0 con 0x7f3de00fbd50 2024-02-20T08:11:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.873+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3de01156d0 con 0x7f3dcc06d900 2024-02-20T08:11:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.874+0000 7f3dd67fc700 1 -- 172.21.15.123:0/4145752880 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3de01156d0 con 0x7f3dcc06d900 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 msgr2=0x7f3dcc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 0x7f3dcc06fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3de0115990 tx=0x7f3dd0009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 msgr2=0x7f3de011a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800bbb0 tx=0x7f3dd8009840 comp rx=0 tx=0).stop 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 shutdown_connections 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3dcc06d900 0x7f3dcc06fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00fbd50 0x7f3de011a0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 --2- 172.21.15.123:0/4145752880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de00fc6f0 0x7f3de011a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 >> 172.21.15.123:0/4145752880 conn(0x7f3de00f7a10 msgr2=0x7f3de010d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 shutdown_connections 2024-02-20T08:11:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.877+0000 7f3de7f13700 1 -- 172.21.15.123:0/4145752880 wait complete. 2024-02-20T08:11:04.888 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:11:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 -- 172.21.15.123:0/1469278420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750101e60 msgr2=0x7ff750102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 --2- 172.21.15.123:0/1469278420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750101e60 0x7ff750102230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff740004940 tx=0x7ff740009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 -- 172.21.15.123:0/1469278420 shutdown_connections 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 --2- 172.21.15.123:0/1469278420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750102800 0x7ff7500fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 --2- 172.21.15.123:0/1469278420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750101e60 0x7ff750102230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 -- 172.21.15.123:0/1469278420 >> 172.21.15.123:0/1469278420 conn(0x7ff7500f7a10 msgr2=0x7ff7500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 -- 172.21.15.123:0/1469278420 shutdown_connections 2024-02-20T08:11:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.983+0000 7ff755992700 1 -- 172.21.15.123:0/1469278420 wait complete. 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 Processor -- start 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 -- start start 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750101e60 0x7ff75010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75010f6a0 con 0x7ff750102800 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff755992700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75010f810 con 0x7ff750101e60 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff74e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff74e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59714/0 (socket says 172.21.15.123:59714) 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff74e7fc700 1 -- 172.21.15.123:0/344204578 learned_addr learned my addr 172.21.15.123:0/344204578 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.984+0000 7ff74effd700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750101e60 0x7ff75010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff74e7fc700 1 -- 172.21.15.123:0/344204578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750101e60 msgr2=0x7ff75010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff74e7fc700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750101e60 0x7ff75010ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff74e7fc700 1 -- 172.21.15.123:0/344204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740005040 con 0x7ff750102800 2024-02-20T08:11:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff74e7fc700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff74400c800 tx=0x7ff744004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7440106f0 con 0x7ff750102800 2024-02-20T08:11:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff750117b80 con 0x7ff750102800 2024-02-20T08:11:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff744010d20 con 0x7ff750102800 2024-02-20T08:11:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7440113a0 con 0x7ff750102800 2024-02-20T08:11:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.985+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff750118090 con 0x7ff750102800 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.986+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7500ff170 con 0x7ff750102800 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.987+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7ff744012400 con 0x7ff750102800 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.987+0000 7ff7377fe700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 0x7ff73806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.987+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff74408cf10 con 0x7ff750102800 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.987+0000 7ff74effd700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 0x7ff73806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.987+0000 7ff74effd700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 0x7ff73806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b3b0 tx=0x7ff740009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:04.991+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff744056720 con 0x7ff750102800 2024-02-20T08:11:05.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.227+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff75004bf40 con 0x7ff73806d900 2024-02-20T08:11:05.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.229+0000 7ff7377fe700 1 -- 172.21.15.123:0/344204578 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff75004bf40 con 0x7ff73806d900 2024-02-20T08:11:05.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 msgr2=0x7ff73806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 0x7ff73806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b3b0 tx=0x7ff740009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:05.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 msgr2=0x7ff75010f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff74400c800 tx=0x7ff744004470 comp rx=0 tx=0).stop 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 shutdown_connections 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff73806d900 0x7ff73806fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff750101e60 0x7ff75010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 --2- 172.21.15.123:0/344204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff750102800 0x7ff75010f0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 >> 172.21.15.123:0/344204578 conn(0x7ff7500f7a10 msgr2=0x7ff7500f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 shutdown_connections 2024-02-20T08:11:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.231+0000 7ff755992700 1 -- 172.21.15.123:0/344204578 wait complete. 2024-02-20T08:11:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 -- 172.21.15.123:0/143020244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fe8f0 msgr2=0x7fbaa8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/143020244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa8107050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba9c004970 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 -- 172.21.15.123:0/143020244 shutdown_connections 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/143020244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa8107050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/143020244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 -- 172.21.15.123:0/143020244 >> 172.21.15.123:0/143020244 conn(0x7fbaa8071d90 msgr2=0x7fbaa8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 -- 172.21.15.123:0/143020244 shutdown_connections 2024-02-20T08:11:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.350+0000 7fbaad0d2700 1 -- 172.21.15.123:0/143020244 wait complete. 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 Processor -- start 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 -- start start 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa80fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80fc9e0 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaad0d2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80fcb50 con 0x7fbaa80fe8f0 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaa6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaa6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59732/0 (socket says 172.21.15.123:59732) 2024-02-20T08:11:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaa6d9d700 1 -- 172.21.15.123:0/1701723910 learned_addr learned my addr 172.21.15.123:0/1701723910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.351+0000 7fbaa659c700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa80fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaa6d9d700 1 -- 172.21.15.123:0/1701723910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fe8f0 msgr2=0x7fbaa80fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaa6d9d700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa80fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaa6d9d700 1 -- 172.21.15.123:0/1701723910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c005040 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaa6d9d700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba98002a50 tx=0x7fba980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba98007cc0 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa8119c30 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba9800f040 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9800da30 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.352+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa811a0e0 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.353+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa81046c0 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.354+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fba9800dbb0 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.354+0000 7fba8f7fe700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 0x7fba9006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.354+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fba9808d540 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.354+0000 7fbaa659c700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 0x7fba9006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.355+0000 7fbaa659c700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 0x7fba9006fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.362+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fba98056c40 con 0x7fbaa80fdfe0 2024-02-20T08:11:05.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:05 smithi123 ceph-mon[112409]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:05.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.584+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaa804bf70 con 0x7fba9006d900 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.595+0000 7fba8f7fe700 1 -- 172.21.15.123:0/1701723910 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fba9c00b630 con 0x7fba9006d900 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (2m) 18s ago 14m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (29s) 18s ago 14m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (24s) 21s ago 13m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (2m) 18s ago 14m 75.2M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:11:05.595 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (8m) 18s ago 8m 14.0M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (8m) 18s ago 8m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (8m) 21s ago 8m 16.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (8m) 21s ago 8m 14.7M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (5m) 18s ago 16m 494M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (3m) 21s ago 13m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (93s) 18s ago 16m 43.4M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (69s) 21s ago 13m 36.5M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (3m) 18s ago 14m 16.8M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (3m) 21s ago 13m 16.2M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 starting - - - 1557M 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (12m) 18s ago 12m 193M 1557M 17.2.7-521-gc80e7168 10b0c032c913 afe0f09c8ba4 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (11m) 18s ago 11m 173M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (11m) 21s ago 11m 228M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (10m) 21s ago 10m 201M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:11:05.596 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (10m) 21s ago 10m 196M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:11:05.597 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (3m) 18s ago 13m 57.0M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:11:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 msgr2=0x7fba9006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 0x7fba9006fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 msgr2=0x7fbaa80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba98002a50 tx=0x7fba980046b0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 shutdown_connections 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fba9006d900 0x7fba9006fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaa80fdfe0 0x7fbaa80fbea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 --2- 172.21.15.123:0/1701723910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa80fe8f0 0x7fbaa80fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 >> 172.21.15.123:0/1701723910 conn(0x7fbaa8071d90 msgr2=0x7fbaa8101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 shutdown_connections 2024-02-20T08:11:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.597+0000 7fbaad0d2700 1 -- 172.21.15.123:0/1701723910 wait complete. 2024-02-20T08:11:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:05 smithi194 ceph-mon[88937]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:05.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.700+0000 7f133d273700 1 -- 172.21.15.123:0/299498187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13381027e0 msgr2=0x7f13380fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.700+0000 7f133d273700 1 --2- 172.21.15.123:0/299498187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13381027e0 0x7f13380fbea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132c004940 tx=0x7f132c009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:05.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- 172.21.15.123:0/299498187 shutdown_connections 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 --2- 172.21.15.123:0/299498187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13381027e0 0x7f13380fbea0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 --2- 172.21.15.123:0/299498187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1338101e40 0x7f1338102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- 172.21.15.123:0/299498187 >> 172.21.15.123:0/299498187 conn(0x7f1338071d90 msgr2=0x7f1338072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- 172.21.15.123:0/299498187 shutdown_connections 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- 172.21.15.123:0/299498187 wait complete. 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 Processor -- start 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- start start 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13381027e0 0x7f1338113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338114630 con 0x7f1338101e40 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.701+0000 7f133d273700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133810d960 con 0x7f13381027e0 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59744/0 (socket says 172.21.15.123:59744) 2024-02-20T08:11:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 -- 172.21.15.123:0/3235160073 learned_addr learned my addr 172.21.15.123:0/3235160073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f13367fc700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13381027e0 0x7f1338113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 -- 172.21.15.123:0/3235160073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13381027e0 msgr2=0x7f1338113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13381027e0 0x7f1338113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 -- 172.21.15.123:0/3235160073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c005040 con 0x7f1338101e40 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f1336ffd700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1328002a50 tx=0x7f13280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1328007cc0 con 0x7f1338101e40 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f132800f040 con 0x7f1338101e40 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133810dc40 con 0x7f1338101e40 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132800da30 con 0x7f1338101e40 2024-02-20T08:11:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.702+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133810e150 con 0x7f1338101e40 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.703+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13380738b0 con 0x7f1338101e40 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.704+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f132800db90 con 0x7f1338101e40 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.704+0000 7f131f7fe700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 0x7f132006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.704+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f132808cea0 con 0x7f1338101e40 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.704+0000 7f13367fc700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 0x7f132006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:05.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.705+0000 7f13367fc700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 0x7f132006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b3b0 tx=0x7f132c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:05.709+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f132805a050 con 0x7f1338101e40 2024-02-20T08:11:06.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.021+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f133810f080 con 0x7f1338101e40 2024-02-20T08:11:06.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.022+0000 7f131f7fe700 1 -- 172.21.15.123:0/3235160073 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f1328059be0 con 0x7f1338101e40 2024-02-20T08:11:06.022 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:11:06.022 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:11:06.022 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:11:06.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 5 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 9, 2024-02-20T08:11:06.023 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:11:06.024 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:11:06.024 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 msgr2=0x7f132006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 0x7f132006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b3b0 tx=0x7f132c009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 msgr2=0x7f1338113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1328002a50 tx=0x7f13280046b0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 shutdown_connections 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f132006d900 0x7f132006fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1338101e40 0x7f1338113aa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 --2- 172.21.15.123:0/3235160073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13381027e0 0x7f1338113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 >> 172.21.15.123:0/3235160073 conn(0x7f1338071d90 msgr2=0x7f1338065720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 shutdown_connections 2024-02-20T08:11:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.025+0000 7f133d273700 1 -- 172.21.15.123:0/3235160073 wait complete. 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- 172.21.15.123:0/1062853701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4101e60 msgr2=0x7f2fd4102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/1062853701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4101e60 0x7f2fd4102230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc004940 tx=0x7f2fcc009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- 172.21.15.123:0/1062853701 shutdown_connections 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/1062853701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4102800 0x7f2fd40fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/1062853701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4101e60 0x7f2fd4102230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- 172.21.15.123:0/1062853701 >> 172.21.15.123:0/1062853701 conn(0x7f2fd40f7a10 msgr2=0x7f2fd40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- 172.21.15.123:0/1062853701 shutdown_connections 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- 172.21.15.123:0/1062853701 wait complete. 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 Processor -- start 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.131+0000 7f2fd8aca700 1 -- start start 2024-02-20T08:11:06.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4101e60 0x7f2fd41139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4114580 con 0x7f2fd4102800 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd410d8b0 con 0x7f2fd4101e60 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59754/0 (socket says 172.21.15.123:59754) 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 -- 172.21.15.123:0/3428089135 learned_addr learned my addr 172.21.15.123:0/3428089135 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd259c700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4101e60 0x7f2fd41139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 -- 172.21.15.123:0/3428089135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4101e60 msgr2=0x7f2fd41139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4101e60 0x7f2fd41139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 -- 172.21.15.123:0/3428089135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc005040 con 0x7f2fd4102800 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd1d9b700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800ec30 tx=0x7f2fc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc8007b30 con 0x7f2fd4102800 2024-02-20T08:11:06.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd410db90 con 0x7f2fd4102800 2024-02-20T08:11:06.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fc800f040 con 0x7f2fd4102800 2024-02-20T08:11:06.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc800cc80 con 0x7f2fd4102800 2024-02-20T08:11:06.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.132+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd410e0d0 con 0x7f2fd4102800 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.134+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40fb610 con 0x7f2fd4102800 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.134+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f2fc8007c90 con 0x7f2fd4102800 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.134+0000 7f2fc2ffd700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 0x7f2fbc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.134+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2fc808d580 con 0x7f2fd4102800 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.134+0000 7f2fd259c700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 0x7f2fbc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.135+0000 7f2fd259c700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 0x7f2fbc06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b0d0 tx=0x7f2fcc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.139+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2fc805a730 con 0x7f2fd4102800 2024-02-20T08:11:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.396+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2fd404bed0 con 0x7f2fd4102800 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.396+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/3428089135 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f2fc805a2c0 con 0x7f2fd4102800 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:11:06.397 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:11:06.398 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:11:06.399 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:06.400 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:06.400 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:06.400 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:06.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.398+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 msgr2=0x7f2fbc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.398+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 0x7f2fbc06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b0d0 tx=0x7f2fcc009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.398+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 msgr2=0x7f2fd4113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.398+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800ec30 tx=0x7f2fc800b040 comp rx=0 tx=0).stop 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 shutdown_connections 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2fbc06d900 0x7f2fbc06fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4101e60 0x7f2fd41139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 --2- 172.21.15.123:0/3428089135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fd4102800 0x7f2fd4113f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 >> 172.21.15.123:0/3428089135 conn(0x7f2fd40f7a10 msgr2=0x7f2fd4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 shutdown_connections 2024-02-20T08:11:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.399+0000 7f2fd8aca700 1 -- 172.21.15.123:0/3428089135 wait complete. 2024-02-20T08:11:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.514+0000 7fb827eec700 1 -- 172.21.15.123:0/4238414413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fe950 msgr2=0x7fb820106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.514+0000 7fb827eec700 1 --2- 172.21.15.123:0/4238414413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fe950 0x7fb820106f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb810004940 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 -- 172.21.15.123:0/4238414413 shutdown_connections 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 --2- 172.21.15.123:0/4238414413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fe950 0x7fb820106f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 --2- 172.21.15.123:0/4238414413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 -- 172.21.15.123:0/4238414413 >> 172.21.15.123:0/4238414413 conn(0x7fb8200f79e0 msgr2=0x7fb8200f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 -- 172.21.15.123:0/4238414413 shutdown_connections 2024-02-20T08:11:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 -- 172.21.15.123:0/4238414413 wait complete. 2024-02-20T08:11:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 Processor -- start 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.515+0000 7fb827eec700 1 -- start start 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb827eec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb827eec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 0x7fb8200fc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb827eec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200fc920 con 0x7fb8200fdfb0 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb827eec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200fca90 con 0x7fb8200fe950 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59772/0 (socket says 172.21.15.123:59772) 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 -- 172.21.15.123:0/136738365 learned_addr learned my addr 172.21.15.123:0/136738365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825487700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 0x7fb8200fc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 -- 172.21.15.123:0/136738365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 msgr2=0x7fb8200fc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 0x7fb8200fc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825c88700 1 -- 172.21.15.123:0/136738365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810005040 con 0x7fb8200fdfb0 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.516+0000 7fb825487700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 0x7fb8200fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb825c88700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00eb40 tx=0x7fb81c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c007cc0 con 0x7fb8200fdfb0 2024-02-20T08:11:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb820119cb0 con 0x7fb8200fdfb0 2024-02-20T08:11:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82011a110 con 0x7fb8200fdfb0 2024-02-20T08:11:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb81c00f040 con 0x7fb8200fdfb0 2024-02-20T08:11:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.517+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c00ca10 con 0x7fb8200fdfb0 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.518+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8040052e0 con 0x7fb8200fdfb0 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.518+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fb81c00cb70 con 0x7fb8200fdfb0 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.519+0000 7fb8167fc700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 0x7fb80c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.519+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb81c08cba0 con 0x7fb8200fdfb0 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.519+0000 7fb825487700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 0x7fb80c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.520+0000 7fb825487700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 0x7fb80c06fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8200fd7e0 tx=0x7fb810009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.524+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb81c056350 con 0x7fb8200fdfb0 2024-02-20T08:11:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:06 smithi194 ceph-mon[88937]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:06 smithi194 ceph-mon[88937]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:06 smithi194 ceph-mon[88937]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:06 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3235160073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:06.704 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:06 smithi123 ceph-mon[112409]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.704 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:06 smithi123 ceph-mon[112409]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.704 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:06 smithi123 ceph-mon[112409]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:06.704 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:06 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3235160073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:06.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.753+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb804000bf0 con 0x7fb80c06d900 2024-02-20T08:11:06.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.754+0000 7fb8167fc700 1 -- 172.21.15.123:0/136738365 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb804000bf0 con 0x7fb80c06d900 2024-02-20T08:11:06.754 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "6/21 daemons upgraded", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:11:06.755 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:11:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.757+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 msgr2=0x7fb80c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.757+0000 7fb827eec700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 0x7fb80c06fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8200fd7e0 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.757+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 msgr2=0x7fb8200fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.757+0000 7fb827eec700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00eb40 tx=0x7fb81c00b040 comp rx=0 tx=0).stop 2024-02-20T08:11:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 shutdown_connections 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fb80c06d900 0x7fb80c06fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8200fdfb0 0x7fb8200fbde0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 --2- 172.21.15.123:0/136738365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8200fe950 0x7fb8200fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 >> 172.21.15.123:0/136738365 conn(0x7fb8200f79e0 msgr2=0x7fb820101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 shutdown_connections 2024-02-20T08:11:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.758+0000 7fb827eec700 1 -- 172.21.15.123:0/136738365 wait complete. 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 -- 172.21.15.123:0/3634016682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 msgr2=0x7f17b8103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 --2- 172.21.15.123:0/3634016682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8103310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17b4004940 tx=0x7f17b4009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 -- 172.21.15.123:0/3634016682 shutdown_connections 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 --2- 172.21.15.123:0/3634016682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 0x7f17b80fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 --2- 172.21.15.123:0/3634016682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8103310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 -- 172.21.15.123:0/3634016682 >> 172.21.15.123:0/3634016682 conn(0x7f17b80f8af0 msgr2=0x7f17b80faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.898+0000 7f17c0479700 1 -- 172.21.15.123:0/3634016682 shutdown_connections 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 -- 172.21.15.123:0/3634016682 wait complete. 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 Processor -- start 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 -- start start 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 0x7f17b80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8070dd0 con 0x7f17b8102f40 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.899+0000 7f17c0479700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8070f40 con 0x7f17b81038e0 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59788/0 (socket says 172.21.15.123:59788) 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 -- 172.21.15.123:0/2257445741 learned_addr learned my addr 172.21.15.123:0/2257445741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17bda14700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 0x7f17b80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 -- 172.21.15.123:0/2257445741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 msgr2=0x7f17b80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 0x7f17b80707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 -- 172.21.15.123:0/2257445741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4005040 con 0x7f17b8102f40 2024-02-20T08:11:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.900+0000 7f17be215700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009100 tx=0x7f17b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.901+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b400e040 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.901+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17b4013420 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.901+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8119c80 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.901+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b400bee0 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.901+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b811a090 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.902+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80fc6f0 con 0x7f17b8102f40 2024-02-20T08:11:06.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.902+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f17b401c750 con 0x7f17b8102f40 2024-02-20T08:11:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.903+0000 7f17aeffd700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 0x7f17a406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.903+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f17b408e400 con 0x7f17b8102f40 2024-02-20T08:11:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.903+0000 7f17bda14700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 0x7f17a406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.903+0000 7f17bda14700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 0x7f17a406fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17b8071c90 tx=0x7f17a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:06.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:06.908+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f17b4057b70 con 0x7f17b8102f40 2024-02-20T08:11:07.293 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T08:11:07.008+0000 7fc760a157c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-20T08:11:07.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.305+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f17b810a040 con 0x7f17b8102f40 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.305+0000 7f17aeffd700 1 -- 172.21.15.123:0/2257445741 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1517 (secure 0 0 0) 0x7f17b405b230 con 0x7f17b8102f40 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: osd.0 (root=default,host=smithi123) is down 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-02-20T08:11:07.306 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-02-20T08:11:07.307 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 msgr2=0x7f17a406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 0x7f17a406fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17b8071c90 tx=0x7f17a800b040 comp rx=0 tx=0).stop 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 msgr2=0x7f17b8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009100 tx=0x7f17b4009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 shutdown_connections 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f17a406d900 0x7f17a406fdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b8102f40 0x7f17b8070290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 --2- 172.21.15.123:0/2257445741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17b81038e0 0x7f17b80707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 >> 172.21.15.123:0/2257445741 conn(0x7f17b80f8af0 msgr2=0x7f17b80fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 shutdown_connections 2024-02-20T08:11:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:07.308+0000 7f17c0479700 1 -- 172.21.15.123:0/2257445741 wait complete. 2024-02-20T08:11:07.562 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T08:11:07.299+0000 7fc760a157c0 -1 osd.0 50 log_to_monitors true 2024-02-20T08:11:07.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3428089135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:11:07.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-mon[112409]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:07.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-mon[112409]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:07.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-mon[112409]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-20T08:11:07.563 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:07 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2257445741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:11:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:07 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3428089135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:11:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:07 smithi194 ceph-mon[88937]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:07 smithi194 ceph-mon[88937]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:07 smithi194 ceph-mon[88937]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-20T08:11:07.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:07 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2257445741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:11:08.375 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T08:11:08.268+0000 7fc74de65700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: failed to encode map e53 with expected crc 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: osdmap e53: 6 total, 5 up, 6 in 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:08.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:08 smithi194 ceph-mon[88937]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: failed to encode map e53 with expected crc 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: osdmap e53: 6 total, 5 up, 6 in 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:08 smithi123 ceph-mon[112409]: from='osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229]' entity='osd.0' 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229] boot 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: osdmap e54: 6 total, 6 up, 6 in 2024-02-20T08:11:09.636 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: osd.0 [v2:172.21.15.123:6802/3390296229,v1:172.21.15.123:6803/3390296229] boot 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: osdmap e54: 6 total, 6 up, 6 in 2024-02-20T08:11:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-20T08:11:10.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:10 smithi194 ceph-mon[88937]: failed to encode map e54 with expected crc 2024-02-20T08:11:10.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:10 smithi194 ceph-mon[88937]: osdmap e55: 6 total, 6 up, 6 in 2024-02-20T08:11:10.692 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:10 smithi123 ceph-mon[112409]: failed to encode map e54 with expected crc 2024-02-20T08:11:10.692 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:10 smithi123 ceph-mon[112409]: osdmap e55: 6 total, 6 up, 6 in 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: failed to encode map e55 with expected crc 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: mgrmap e39: smithi123.kwyrtl(active, since 91s), standbys: smithi194.pvhorj 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-20T08:11:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: mgrmap e39: smithi123.kwyrtl(active, since 91s), standbys: smithi194.pvhorj 2024-02-20T08:11:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-20T08:11:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:13 smithi123 ceph-mon[112409]: pgmap v54: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:11:14.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:13 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-20T08:11:14.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:13 smithi123 ceph-mon[112409]: Upgrade: osd.1 is safe to restart 2024-02-20T08:11:14.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:13 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-02-20T08:11:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:13 smithi194 ceph-mon[88937]: pgmap v54: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-20T08:11:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:13 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-20T08:11:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:13 smithi194 ceph-mon[88937]: Upgrade: osd.1 is safe to restart 2024-02-20T08:11:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:13 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-02-20T08:11:15.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: Upgrade: Updating osd.1 2024-02-20T08:11:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T08:11:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: Deploying daemon osd.1 on smithi123 2024-02-20T08:11:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:15 smithi123 ceph-mon[112409]: pgmap v55: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 423 B/s wr, 0 op/s 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: Upgrade: Updating osd.1 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: Deploying daemon osd.1 on smithi123 2024-02-20T08:11:15.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:15 smithi194 ceph-mon[88937]: pgmap v55: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 423 B/s wr, 0 op/s 2024-02-20T08:11:17.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:17 smithi123 ceph-mon[112409]: pgmap v56: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-02-20T08:11:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:17 smithi194 ceph-mon[88937]: pgmap v56: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-02-20T08:11:18.258 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:17 smithi123 systemd[1]: Stopping Ceph osd.1 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:11:18.258 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:18 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[55722]: 2024-02-20T08:11:18.091+0000 7f1bb515a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:11:18.259 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:18 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[55722]: 2024-02-20T08:11:18.091+0000 7f1bb515a700 -1 osd.1 55 *** Got signal Terminated *** 2024-02-20T08:11:18.259 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:18 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[55722]: 2024-02-20T08:11:18.091+0000 7f1bb515a700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:11:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:18 smithi123 ceph-mon[112409]: osd.1 marked itself down and dead 2024-02-20T08:11:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:18 smithi194 ceph-mon[88937]: osd.1 marked itself down and dead 2024-02-20T08:11:19.344 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:19 smithi123 podman[128250]: 2024-02-20 08:11:19.064113369 +0000 UTC m=+1.067632129 container died afe0f09c8ba43759f4245b45fc117d6419490bce33e781641da7ca34b74bc4da (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=quincy-c80e716, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-20T08:11:19.684 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:19 smithi123 podman[128250]: 2024-02-20 08:11:19.534770612 +0000 UTC m=+1.538289383 container cleanup afe0f09c8ba43759f4245b45fc117d6419490bce33e781641da7ca34b74bc4da (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-20T08:11:19.685 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:19 smithi123 bash[128250]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1 2024-02-20T08:11:20.008 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:19 smithi123 podman[128269]: 2024-02-20 08:11:19.819875563 +0000 UTC m=+0.750356106 container remove afe0f09c8ba43759f4245b45fc117d6419490bce33e781641da7ca34b74bc4da (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=quincy-c80e716, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-20T08:11:20.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: pgmap v57: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 328 B/s wr, 0 op/s 2024-02-20T08:11:20.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:11:20.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: osdmap e56: 6 total, 5 up, 6 in 2024-02-20T08:11:20.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:19 smithi123 ceph-mon[112409]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: pgmap v57: 65 pgs: 65 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 328 B/s wr, 0 op/s 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: osdmap e56: 6 total, 5 up, 6 in 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:19 smithi194 ceph-mon[88937]: failed to encode map e56 with expected crc 2024-02-20T08:11:20.474 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.14585421 +0000 UTC m=+0.106511543 container create a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD) 2024-02-20T08:11:20.474 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.057276963 +0000 UTC m=+0.017934304 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:20.474 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.373643018 +0000 UTC m=+0.334300351 container init a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-20T08:11:20.474 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.376730949 +0000 UTC m=+0.337388295 container start a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-20T08:11:20.474 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.47359374 +0000 UTC m=+0.434251092 container attach a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-20T08:11:20.758 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:20 smithi123 podman[128359]: 2024-02-20 08:11:20.660775222 +0000 UTC m=+0.621432557 container died a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-20T08:11:20.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: failed to encode map e57 with expected crc 2024-02-20T08:11:20.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: osdmap e57: 6 total, 5 up, 6 in 2024-02-20T08:11:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: failed to encode map e57 with expected crc 2024-02-20T08:11:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: failed to encode map e57 with expected crc 2024-02-20T08:11:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: failed to encode map e57 with expected crc 2024-02-20T08:11:20.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:20 smithi123 ceph-mon[112409]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: osdmap e57: 6 total, 5 up, 6 in 2024-02-20T08:11:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:20 smithi194 ceph-mon[88937]: failed to encode map e57 with expected crc 2024-02-20T08:11:21.695 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 podman[128385]: 2024-02-20 08:11:21.361370793 +0000 UTC m=+0.695292665 container remove a6f9a77c443c63835a9cb1838062556bd84914c5b09a0f6af73478769e88f9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-20T08:11:21.695 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-20T08:11:21.695 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 systemd[1]: Stopped Ceph osd.1 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:11:21.695 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.1.service: Consumed 52.005s CPU time. 2024-02-20T08:11:21.696 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 systemd[1]: Starting Ceph osd.1 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:11:21.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:21 smithi123 ceph-mon[112409]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:21.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:21.956 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 podman[128493]: 2024-02-20 08:11:21.714093783 +0000 UTC m=+0.018221501 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:21.956 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:21 smithi123 podman[128493]: 2024-02-20 08:11:21.828979807 +0000 UTC m=+0.133107525 container create f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:11:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:21 smithi194 ceph-mon[88937]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:22.497 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 podman[128493]: 2024-02-20 08:11:22.049160795 +0000 UTC m=+0.353288504 container init f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-20T08:11:22.497 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 podman[128493]: 2024-02-20 08:11:22.052373349 +0000 UTC m=+0.356501060 container start f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:11:22.497 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 podman[128493]: 2024-02-20 08:11:22.148134318 +0000 UTC m=+0.452262035 container attach f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:11:22.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-20T08:11:22.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 bash[128493]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate[128507]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-20T08:11:22.760 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:22 smithi123 podman[128493]: 2024-02-20 08:11:22.522027041 +0000 UTC m=+0.826154756 container died f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-20T08:11:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:22 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:23.452 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 podman[128630]: 2024-02-20 08:11:23.118927422 +0000 UTC m=+0.591348387 container remove f14c2ab7dbb823fe490897df2f00e5f9d3b9ce24b268ca178f5fd795624c1ac4 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-activate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-20T08:11:23.452 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 podman[128695]: 2024-02-20 08:11:23.236243525 +0000 UTC m=+0.017804873 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:23.452 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 podman[128695]: 2024-02-20 08:11:23.344851739 +0000 UTC m=+0.126413118 container create 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:11:23.747 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 podman[128695]: 2024-02-20 08:11:23.564079225 +0000 UTC m=+0.345640564 container init 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-20T08:11:23.747 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 podman[128695]: 2024-02-20 08:11:23.567383378 +0000 UTC m=+0.348944714 container start 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-20T08:11:23.748 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 ceph-osd[128713]: -- 172.21.15.123:0/1904314174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bd7da5f1e0 con 0x55bd7da31000 2024-02-20T08:11:23.748 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 bash[128695]: 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 2024-02-20T08:11:23.748 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:23 smithi123 systemd[1]: Started Ceph osd.1 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:11:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:23 smithi123 ceph-mon[112409]: pgmap v61: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:23 smithi194 ceph-mon[88937]: pgmap v61: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:24.508 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:24 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T08:11:24.103+0000 7fc1d83ba7c0 -1 Falling back to public interface 2024-02-20T08:11:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:25 smithi123 ceph-mon[112409]: pgmap v62: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:25 smithi194 ceph-mon[88937]: pgmap v62: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:28.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:27 smithi123 ceph-mon[112409]: pgmap v63: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:27 smithi194 ceph-mon[88937]: pgmap v63: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:28.603 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:28 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T08:11:28.314+0000 7fc1d83ba7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-20T08:11:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:28 smithi123 ceph-mon[112409]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-20T08:11:29.008 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:28 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T08:11:28.635+0000 7fc1d83ba7c0 -1 osd.1 55 log_to_monitors true 2024-02-20T08:11:29.008 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 08:11:28 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T08:11:28.774+0000 7fc1c9812700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:11:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:28 smithi194 ceph-mon[88937]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-20T08:11:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: pgmap v64: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-20T08:11:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: osdmap e58: 6 total, 5 up, 6 in 2024-02-20T08:11:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:11:30.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:30.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: pgmap v64: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: osdmap e58: 6 total, 5 up, 6 in 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: from='osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: failed to encode map e58 with expected crc 2024-02-20T08:11:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:30.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: failed to encode map e58 with expected crc 2024-02-20T08:11:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: failed to encode map e59 with expected crc 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896] boot 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: osdmap e59: 6 total, 6 up, 6 in 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:31.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: failed to encode map e58 with expected crc 2024-02-20T08:11:31.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: failed to encode map e59 with expected crc 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: osd.1 [v2:172.21.15.123:6810/3638223896,v1:172.21.15.123:6811/3638223896] boot 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: osdmap e59: 6 total, 6 up, 6 in 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: osdmap e60: 6 total, 6 up, 6 in 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:31 smithi123 ceph-mon[112409]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: osdmap e60: 6 total, 6 up, 6 in 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:32.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:31 smithi194 ceph-mon[88937]: failed to encode map e60 with expected crc 2024-02-20T08:11:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:32 smithi194 ceph-mon[88937]: pgmap v69: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18/264 objects degraded (6.818%) 2024-02-20T08:11:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:32 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:33.191 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:32 smithi123 ceph-mon[112409]: pgmap v69: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18/264 objects degraded (6.818%) 2024-02-20T08:11:33.191 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:32 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:11:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:34 smithi194 ceph-mon[88937]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-20T08:11:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:11:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:34 smithi123 ceph-mon[112409]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-20T08:11:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:35 smithi194 ceph-mon[88937]: pgmap v70: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:35.909 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:35 smithi123 ceph-mon[112409]: pgmap v70: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:36.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:36 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded) 2024-02-20T08:11:36.929 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:36 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded) 2024-02-20T08:11:37.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 -- 172.21.15.123:0/2661029426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 msgr2=0x7f07500fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 --2- 172.21.15.123:0/2661029426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f07500fbe70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0738004940 tx=0x7f0738009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 -- 172.21.15.123:0/2661029426 shutdown_connections 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 --2- 172.21.15.123:0/2661029426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f07500fbe70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 --2- 172.21.15.123:0/2661029426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 0x7f0750102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 -- 172.21.15.123:0/2661029426 >> 172.21.15.123:0/2661029426 conn(0x7f07500f7a10 msgr2=0x7f07500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 -- 172.21.15.123:0/2661029426 shutdown_connections 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.418+0000 7f0755364700 1 -- 172.21.15.123:0/2661029426 wait complete. 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 Processor -- start 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 -- start start 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 0x7f075010eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075010f670 con 0x7f0750102800 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0755364700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075010f7b0 con 0x7f0750101e60 2024-02-20T08:11:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35588/0 (socket says 172.21.15.123:35588) 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 -- 172.21.15.123:0/2678215138 learned_addr learned my addr 172.21.15.123:0/2678215138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f074effd700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 0x7f075010eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 -- 172.21.15.123:0/2678215138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 msgr2=0x7f075010eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 0x7f075010eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.419+0000 7f0747fff700 1 -- 172.21.15.123:0/2678215138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738005040 con 0x7f0750102800 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f0747fff700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07380090d0 tx=0x7f0738009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073800e040 con 0x7f0750102800 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f073800bbf0 con 0x7f0750102800 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0750117ab0 con 0x7f0750102800 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073801c630 con 0x7f0750102800 2024-02-20T08:11:37.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.420+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750117fc0 con 0x7f0750102800 2024-02-20T08:11:37.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.421+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0750104330 con 0x7f0750102800 2024-02-20T08:11:37.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.421+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f073800bd60 con 0x7f0750102800 2024-02-20T08:11:37.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.422+0000 7f07477fe700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 0x7f073c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.422+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f073808e180 con 0x7f0750102800 2024-02-20T08:11:37.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.422+0000 7f074effd700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 0x7f073c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.422+0000 7f074effd700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 0x7f073c06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07400041d0 tx=0x7f0740009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:37.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.427+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0738057aa0 con 0x7f0750102800 2024-02-20T08:11:37.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.691+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0750117c40 con 0x7f073c06d7e0 2024-02-20T08:11:37.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.693+0000 7f07477fe700 1 -- 172.21.15.123:0/2678215138 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0750117c40 con 0x7f073c06d7e0 2024-02-20T08:11:37.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 msgr2=0x7f073c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 0x7f073c06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07400041d0 tx=0x7f0740009040 comp rx=0 tx=0).stop 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 msgr2=0x7f075010f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07380090d0 tx=0x7f0738009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 shutdown_connections 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f073c06d7e0 0x7f073c06fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750101e60 0x7f075010eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 --2- 172.21.15.123:0/2678215138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0750102800 0x7f075010f0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 >> 172.21.15.123:0/2678215138 conn(0x7f07500f7a10 msgr2=0x7f07500f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:37.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 shutdown_connections 2024-02-20T08:11:37.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.695+0000 7f0755364700 1 -- 172.21.15.123:0/2678215138 wait complete. 2024-02-20T08:11:37.706 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 -- 172.21.15.123:0/266782379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc102dc0 msgr2=0x7f02cc103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 --2- 172.21.15.123:0/266782379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc102dc0 0x7f02cc103190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02bc004940 tx=0x7f02bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 -- 172.21.15.123:0/266782379 shutdown_connections 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 --2- 172.21.15.123:0/266782379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc0fb390 0x7f02cc0fb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 --2- 172.21.15.123:0/266782379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc102dc0 0x7f02cc103190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 -- 172.21.15.123:0/266782379 >> 172.21.15.123:0/266782379 conn(0x7f02cc072270 msgr2=0x7f02cc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 -- 172.21.15.123:0/266782379 shutdown_connections 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 -- 172.21.15.123:0/266782379 wait complete. 2024-02-20T08:11:37.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.800+0000 7f02d09ff700 1 Processor -- start 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02d09ff700 1 -- start start 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02d09ff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02d09ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 0x7f02cc113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02d09ff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc114460 con 0x7f02cc0fb390 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02d09ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc10d700 con 0x7f02cc102dc0 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35606/0 (socket says 172.21.15.123:35606) 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 -- 172.21.15.123:0/4094436424 learned_addr learned my addr 172.21.15.123:0/4094436424 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02ca59c700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 0x7f02cc113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 -- 172.21.15.123:0/4094436424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 msgr2=0x7f02cc113d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 0x7f02cc113d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 -- 172.21.15.123:0/4094436424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc005040 con 0x7f02cc0fb390 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02ca59c700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 0x7f02cc113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.801+0000 7f02cad9d700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009fd0 tx=0x7f02bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:37.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02bc00e040 con 0x7f02cc0fb390 2024-02-20T08:11:37.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc10d980 con 0x7f02cc0fb390 2024-02-20T08:11:37.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02bc00bbf0 con 0x7f02cc0fb390 2024-02-20T08:11:37.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc10df40 con 0x7f02cc0fb390 2024-02-20T08:11:37.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02bc01c3f0 con 0x7f02cc0fb390 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.802+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc05f5c0 con 0x7f02cc0fb390 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.804+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f02bc00bd60 con 0x7f02cc0fb390 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.804+0000 7f02b37fe700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 0x7f02b406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.804+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f02bc08e1c0 con 0x7f02cc0fb390 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.804+0000 7f02ca59c700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 0x7f02b406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:37.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.804+0000 7f02ca59c700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 0x7f02b406fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f02cc10f070 tx=0x7f02c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:37.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:37.809+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f02bc05b610 con 0x7f02cc0fb390 2024-02-20T08:11:37.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:37 smithi194 ceph-mon[88937]: pgmap v71: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:37 smithi123 ceph-mon[112409]: pgmap v71: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:38.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.031+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02cc10ee90 con 0x7f02b406d7f0 2024-02-20T08:11:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.033+0000 7f02b37fe700 1 -- 172.21.15.123:0/4094436424 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f02cc10ee90 con 0x7f02b406d7f0 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 msgr2=0x7f02b406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 0x7f02b406fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f02cc10f070 tx=0x7f02c0008040 comp rx=0 tx=0).stop 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 msgr2=0x7f02cc113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009fd0 tx=0x7f02bc009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 shutdown_connections 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f02b406d7f0 0x7f02b406fca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02cc0fb390 0x7f02cc113840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 --2- 172.21.15.123:0/4094436424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02cc102dc0 0x7f02cc113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 >> 172.21.15.123:0/4094436424 conn(0x7f02cc072270 msgr2=0x7f02cc0fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 shutdown_connections 2024-02-20T08:11:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.035+0000 7f02d09ff700 1 -- 172.21.15.123:0/4094436424 wait complete. 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 -- 172.21.15.123:0/382229713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 msgr2=0x7f7ef40fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/382229713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fb9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8004940 tx=0x7f7ee8009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 -- 172.21.15.123:0/382229713 shutdown_connections 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/382229713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fb9c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/382229713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 0x7f7ef4103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 -- 172.21.15.123:0/382229713 >> 172.21.15.123:0/382229713 conn(0x7f7ef4071560 msgr2=0x7f7ef4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 -- 172.21.15.123:0/382229713 shutdown_connections 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.139+0000 7f7ef8b78700 1 -- 172.21.15.123:0/382229713 wait complete. 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 Processor -- start 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 -- start start 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 0x7f7ef40fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40fd290 con 0x7f7ef40fb570 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef8b78700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40fd400 con 0x7f7ef4103140 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35624/0 (socket says 172.21.15.123:35624) 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 -- 172.21.15.123:0/1954743021 learned_addr learned my addr 172.21.15.123:0/1954743021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef1d9b700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 0x7f7ef40fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 -- 172.21.15.123:0/1954743021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 msgr2=0x7f7ef40fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 0x7f7ef40fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 -- 172.21.15.123:0/1954743021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8005040 con 0x7f7ef40fb570 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.140+0000 7f7ef259c700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4002a50 tx=0x7f7ee40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.141+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee4007cc0 con 0x7f7ef40fb570 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.141+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee400f040 con 0x7f7ef40fb570 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.141+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4119dd0 con 0x7f7ef40fb570 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.141+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee4009640 con 0x7f7ef40fb570 2024-02-20T08:11:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.141+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef411a2b0 con 0x7f7ef40fb570 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.142+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef41054d0 con 0x7f7ef40fb570 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.142+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7ee40097a0 con 0x7f7ef40fb570 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.143+0000 7f7ee2ffd700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 0x7f7edc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.143+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7ee408cc20 con 0x7f7ef40fb570 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.143+0000 7f7ef1d9b700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 0x7f7edc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.143+0000 7f7ef1d9b700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 0x7f7edc06fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009fd0 tx=0x7f7ee8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.147+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ee40564c0 con 0x7f7ef40fb570 2024-02-20T08:11:38.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.372+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ef404bf40 con 0x7f7edc06d7e0 2024-02-20T08:11:38.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.383+0000 7f7ee2ffd700 1 -- 172.21.15.123:0/1954743021 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7ef404bf40 con 0x7f7edc06d7e0 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (3m) 9s ago 15m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (62s) 9s ago 15m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (57s) 53s ago 14m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (3m) 9s ago 14m 80.2M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:11:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (9m) 9s ago 9m 14.2M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (9m) 9s ago 9m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (9m) 53s ago 9m 16.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (9m) 53s ago 9m 14.7M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (5m) 9s ago 16m 498M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (4m) 53s ago 13m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (2m) 9s ago 16m 45.6M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (101s) 53s ago 13m 36.5M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (4m) 9s ago 15m 16.7M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 53s ago 13m 16.2M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (36s) 9s ago 13m 84.8M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (15s) 9s ago 12m 12.4M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (12m) 9s ago 12m 171M 1557M 17.2.7-521-gc80e7168 10b0c032c913 1fcbd66fcb67 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (11m) 53s ago 11m 228M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:11:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (11m) 53s ago 11m 201M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (10m) 53s ago 10m 196M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (3m) 9s ago 14m 57.1M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 msgr2=0x7f7edc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 0x7f7edc06fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009fd0 tx=0x7f7ee8009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 msgr2=0x7f7ef40fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4002a50 tx=0x7f7ee40046b0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 shutdown_connections 2024-02-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7edc06d7e0 0x7f7edc06fc90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ef40fb570 0x7f7ef40fc750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 --2- 172.21.15.123:0/1954743021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef4103140 0x7f7ef40fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 >> 172.21.15.123:0/1954743021 conn(0x7f7ef4071560 msgr2=0x7f7ef40f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 shutdown_connections 2024-02-20T08:11:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.385+0000 7f7ef8b78700 1 -- 172.21.15.123:0/1954743021 wait complete. 2024-02-20T08:11:38.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.484+0000 7f4668e78700 1 -- 172.21.15.123:0/2895491869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 msgr2=0x7f46640fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.484+0000 7f4668e78700 1 --2- 172.21.15.123:0/2895491869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f46640fcf60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4658004940 tx=0x7f4658009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- 172.21.15.123:0/2895491869 shutdown_connections 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 --2- 172.21.15.123:0/2895491869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f46640fcf60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 --2- 172.21.15.123:0/2895491869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 0x7f4664103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- 172.21.15.123:0/2895491869 >> 172.21.15.123:0/2895491869 conn(0x7f46640f8ae0 msgr2=0x7f46640faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- 172.21.15.123:0/2895491869 shutdown_connections 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- 172.21.15.123:0/2895491869 wait complete. 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 Processor -- start 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- start start 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 0x7f4664113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4664114620 con 0x7f46641038f0 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.485+0000 7f4668e78700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466410d950 con 0x7f4664102f50 2024-02-20T08:11:38.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44466/0 (socket says 172.21.15.123:44466) 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 -- 172.21.15.123:0/691549820 learned_addr learned my addr 172.21.15.123:0/691549820 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f466259c700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 0x7f4664113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 -- 172.21.15.123:0/691549820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 msgr2=0x7f4664113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 0x7f4664113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 -- 172.21.15.123:0/691549820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658005040 con 0x7f46641038f0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4661d9b700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4658009100 tx=0x7f4658009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465800e040 con 0x7f46641038f0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4658004290 con 0x7f46641038f0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466410dbd0 con 0x7f46641038f0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465801c3f0 con 0x7f46641038f0 2024-02-20T08:11:38.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.486+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466410e110 con 0x7f46641038f0 2024-02-20T08:11:38.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.487+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4664105420 con 0x7f46641038f0 2024-02-20T08:11:38.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.488+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f465800bbf0 con 0x7f46641038f0 2024-02-20T08:11:38.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.488+0000 7f4652ffd700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 0x7f464c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.488+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f465808e080 con 0x7f46641038f0 2024-02-20T08:11:38.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.488+0000 7f466259c700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 0x7f464c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.489+0000 7f466259c700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 0x7f464c06fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46540041d0 tx=0x7f46540043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.493+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f465805b4d0 con 0x7f46641038f0 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.777+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46640fc6e0 con 0x7f46641038f0 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.778+0000 7f4652ffd700 1 -- 172.21.15.123:0/691549820 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f465805b060 con 0x7f46641038f0 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:38.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4, 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 8, 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 6 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:11:38.779 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:11:38.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 msgr2=0x7f464c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 0x7f464c06fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46540041d0 tx=0x7f46540043c0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 msgr2=0x7f4664113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4658009100 tx=0x7f4658009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 shutdown_connections 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f464c06d7f0 0x7f464c06fca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4664102f50 0x7f4664113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 --2- 172.21.15.123:0/691549820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46641038f0 0x7f4664113fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 >> 172.21.15.123:0/691549820 conn(0x7f46640f8ae0 msgr2=0x7f46640fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 shutdown_connections 2024-02-20T08:11:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.780+0000 7f4668e78700 1 -- 172.21.15.123:0/691549820 wait complete. 2024-02-20T08:11:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.882+0000 7f46cc867700 1 -- 172.21.15.123:0/2594115806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fdf50 msgr2=0x7f46c80fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.882+0000 7f46cc867700 1 --2- 172.21.15.123:0/2594115806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fdf50 0x7f46c80fe320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46b8004940 tx=0x7f46b8009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:38.884 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:38 smithi123 ceph-mon[112409]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- 172.21.15.123:0/2594115806 shutdown_connections 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 --2- 172.21.15.123:0/2594115806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fe8f0 0x7f46c8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 --2- 172.21.15.123:0/2594115806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fdf50 0x7f46c80fe320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- 172.21.15.123:0/2594115806 >> 172.21.15.123:0/2594115806 conn(0x7f46c80f7a10 msgr2=0x7f46c80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- 172.21.15.123:0/2594115806 shutdown_connections 2024-02-20T08:11:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- 172.21.15.123:0/2594115806 wait complete. 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 Processor -- start 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- start start 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fdf50 0x7f46c8115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8116810 con 0x7f46c80fe8f0 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.883+0000 7f46cc867700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c810fb40 con 0x7f46c80fdf50 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44484/0 (socket says 172.21.15.123:44484) 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 -- 172.21.15.123:0/1070207395 learned_addr learned my addr 172.21.15.123:0/1070207395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c659c700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fdf50 0x7f46c8115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 -- 172.21.15.123:0/1070207395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fdf50 msgr2=0x7f46c8115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fdf50 0x7f46c8115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 -- 172.21.15.123:0/1070207395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8005040 con 0x7f46c80fe8f0 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46c5d9b700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c8c0 tx=0x7f46bc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc00a980 con 0x7f46c80fe8f0 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46bc00ce60 con 0x7f46c80fe8f0 2024-02-20T08:11:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc0115e0 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.884+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c810fe20 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.885+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c8110300 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.885+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8106a80 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.886+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f46bc012400 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.886+0000 7f46b6ffd700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 0x7f46b006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.887+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f46bc08ce70 con 0x7f46c80fe8f0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.887+0000 7f46c659c700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 0x7f46b006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.887+0000 7f46c659c700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 0x7f46b006fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46b8004f90 tx=0x7f46b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:38.891+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f46bc05a360 con 0x7f46c80fe8f0 2024-02-20T08:11:38.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:38 smithi194 ceph-mon[88937]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.127+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f46c804bed0 con 0x7f46c80fe8f0 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.128+0000 7f46b6ffd700 1 -- 172.21.15.123:0/1070207395 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f46bc0126b0 con 0x7f46c80fe8f0 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:11:39.128 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:11:39.129 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:11:39.130 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:39.131 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 msgr2=0x7f46b006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 0x7f46b006fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46b8004f90 tx=0x7f46b8009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 msgr2=0x7f46c81161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c8c0 tx=0x7f46bc0044c0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 shutdown_connections 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f46b006d7e0 0x7f46b006fc90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c80fdf50 0x7f46c8115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 --2- 172.21.15.123:0/1070207395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46c80fe8f0 0x7f46c81161c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 >> 172.21.15.123:0/1070207395 conn(0x7f46c80f7a10 msgr2=0x7f46c80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 shutdown_connections 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.130+0000 7f46cc867700 1 -- 172.21.15.123:0/1070207395 wait complete. 2024-02-20T08:11:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:11:39.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- 172.21.15.123:0/2540141628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc1038e0 msgr2=0x7fd9dc0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/2540141628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc1038e0 0x7fd9dc0fcf50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4004940 tx=0x7fd9c4009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:39.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- 172.21.15.123:0/2540141628 shutdown_connections 2024-02-20T08:11:39.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/2540141628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc1038e0 0x7fd9dc0fcf50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/2540141628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc102f40 0x7fd9dc103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- 172.21.15.123:0/2540141628 >> 172.21.15.123:0/2540141628 conn(0x7fd9dc0f8af0 msgr2=0x7fd9dc0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- 172.21.15.123:0/2540141628 shutdown_connections 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- 172.21.15.123:0/2540141628 wait complete. 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 Processor -- start 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.231+0000 7fd9e18e8700 1 -- start start 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9e18e8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9e18e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc1038e0 0x7fd9dc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9e18e8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc070dd0 con 0x7fd9dc102f40 2024-02-20T08:11:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9e18e8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc070f40 con 0x7fd9dc1038e0 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44516/0 (socket says 172.21.15.123:44516) 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 -- 172.21.15.123:0/1577854155 learned_addr learned my addr 172.21.15.123:0/1577854155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 -- 172.21.15.123:0/1577854155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc1038e0 msgr2=0x7fd9dc0707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc1038e0 0x7fd9dc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 -- 172.21.15.123:0/1577854155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4005040 con 0x7fd9dc102f40 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9daffd700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c830 tx=0x7fd9cc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc00a760 con 0x7fd9dc102f40 2024-02-20T08:11:39.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9cc00ad90 con 0x7fd9dc102f40 2024-02-20T08:11:39.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc119ca0 con 0x7fd9dc102f40 2024-02-20T08:11:39.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.232+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc0113a0 con 0x7fd9dc102f40 2024-02-20T08:11:39.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.233+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc11a180 con 0x7fd9dc102f40 2024-02-20T08:11:39.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.233+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc105410 con 0x7fd9dc102f40 2024-02-20T08:11:39.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.234+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd9cc012400 con 0x7fd9dc102f40 2024-02-20T08:11:39.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.234+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 0x7fd9c806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.235+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd9cc08cec0 con 0x7fd9dc102f40 2024-02-20T08:11:39.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.235+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 0x7fd9c806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:39.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.235+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 0x7fd9c806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400b3b0 tx=0x7fd9c4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:39.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.239+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9cc0567e0 con 0x7fd9dc102f40 2024-02-20T08:11:39.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.452+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9dc071a40 con 0x7fd9c806d7e0 2024-02-20T08:11:39.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.453+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1577854155 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd9dc071a40 con 0x7fd9c806d7e0 2024-02-20T08:11:39.453 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "8/21 daemons upgraded", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:11:39.454 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 msgr2=0x7fd9c806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 0x7fd9c806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400b3b0 tx=0x7fd9c4009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 msgr2=0x7fd9dc070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c830 tx=0x7fd9cc004470 comp rx=0 tx=0).stop 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 shutdown_connections 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd9c806d7e0 0x7fd9c806fc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9dc102f40 0x7fd9dc070290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 --2- 172.21.15.123:0/1577854155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc1038e0 0x7fd9dc0707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 >> 172.21.15.123:0/1577854155 conn(0x7fd9dc0f8af0 msgr2=0x7fd9dc0fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 shutdown_connections 2024-02-20T08:11:39.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.455+0000 7fd9e18e8700 1 -- 172.21.15.123:0/1577854155 wait complete. 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 -- 172.21.15.123:0/2943030852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fdfe0 msgr2=0x7f44640fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 --2- 172.21.15.123:0/2943030852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fdfe0 0x7f44640fe3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4458004970 tx=0x7f4458009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 -- 172.21.15.123:0/2943030852 shutdown_connections 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 --2- 172.21.15.123:0/2943030852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fe8f0 0x7f4464107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 --2- 172.21.15.123:0/2943030852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fdfe0 0x7f44640fe3b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 -- 172.21.15.123:0/2943030852 >> 172.21.15.123:0/2943030852 conn(0x7f4464071d90 msgr2=0x7f4464072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 -- 172.21.15.123:0/2943030852 shutdown_connections 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.557+0000 7f4468f87700 1 -- 172.21.15.123:0/2943030852 wait complete. 2024-02-20T08:11:39.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 Processor -- start 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 -- start start 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fdfe0 0x7f44640fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640fc9e0 con 0x7f44640fe8f0 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4468f87700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44640fcb50 con 0x7f44640fdfe0 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:39.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44542/0 (socket says 172.21.15.123:44542) 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 -- 172.21.15.123:0/3378610648 learned_addr learned my addr 172.21.15.123:0/3378610648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f446259c700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fdfe0 0x7f44640fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 -- 172.21.15.123:0/3378610648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fdfe0 msgr2=0x7f44640fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fdfe0 0x7f44640fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 -- 172.21.15.123:0/3378610648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458005040 con 0x7f44640fe8f0 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4461d9b700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f445400c8c0 tx=0x7f44540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:39.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.558+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f445400a980 con 0x7f44640fe8f0 2024-02-20T08:11:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.559+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f445400ce60 con 0x7f44640fe8f0 2024-02-20T08:11:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.559+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4464119c90 con 0x7f44640fe8f0 2024-02-20T08:11:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.559+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44540115e0 con 0x7f44640fe8f0 2024-02-20T08:11:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.559+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446411a170 con 0x7f44640fe8f0 2024-02-20T08:11:39.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.560+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44641046c0 con 0x7f44640fe8f0 2024-02-20T08:11:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.560+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4454012400 con 0x7f44640fe8f0 2024-02-20T08:11:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.561+0000 7f4452ffd700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 0x7f444c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:11:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.561+0000 7f446259c700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 0x7f444c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:11:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.561+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f445408ce40 con 0x7f44640fe8f0 2024-02-20T08:11:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.561+0000 7f446259c700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 0x7f444c06fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f4458009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:11:39.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.565+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4454056800 con 0x7f44640fe8f0 2024-02-20T08:11:39.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.840+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f44640738b0 con 0x7f44640fe8f0 2024-02-20T08:11:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:39 smithi123 ceph-mon[112409]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:39 smithi123 ceph-mon[112409]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:39 smithi123 ceph-mon[112409]: pgmap v72: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:39 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/691549820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:39 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1070207395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:11:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.841+0000 7f4452ffd700 1 -- 172.21.15.123:0/3378610648 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f44540126b0 con 0x7f44640fe8f0 2024-02-20T08:11:39.843 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:11:39.844 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:11:39.844 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:11:39.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 msgr2=0x7f444c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 0x7f444c06fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f4458009e30 comp rx=0 tx=0).stop 2024-02-20T08:11:39.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 msgr2=0x7f44640fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:11:39.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f445400c8c0 tx=0x7f44540044c0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 shutdown_connections 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f444c06d7e0 0x7f444c06fc90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44640fdfe0 0x7f44640fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 --2- 172.21.15.123:0/3378610648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44640fe8f0 0x7f44640fc3e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.843+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 >> 172.21.15.123:0/3378610648 conn(0x7f4464071d90 msgr2=0x7f4464101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:11:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.844+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 shutdown_connections 2024-02-20T08:11:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:11:39.844+0000 7f4468f87700 1 -- 172.21.15.123:0/3378610648 wait complete. 2024-02-20T08:11:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:39 smithi194 ceph-mon[88937]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:39 smithi194 ceph-mon[88937]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:39.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:39 smithi194 ceph-mon[88937]: pgmap v72: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:39.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:39 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/691549820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:11:39.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:39 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1070207395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:11:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:40 smithi194 ceph-mon[88937]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:40 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3378610648' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:11:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:40 smithi123 ceph-mon[112409]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:11:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:40 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3378610648' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:11:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:41 smithi123 ceph-mon[112409]: pgmap v73: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:41 smithi194 ceph-mon[88937]: pgmap v73: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:43 smithi123 ceph-mon[112409]: pgmap v74: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:43 smithi194 ceph-mon[88937]: pgmap v74: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:45 smithi123 ceph-mon[112409]: pgmap v75: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:45 smithi194 ceph-mon[88937]: pgmap v75: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:47 smithi123 ceph-mon[112409]: pgmap v76: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:47 smithi194 ceph-mon[88937]: pgmap v76: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:49 smithi123 ceph-mon[112409]: pgmap v77: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:50.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:49 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:50.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:49 smithi123 ceph-mon[112409]: Upgrade: osd.2 is safe to restart 2024-02-20T08:11:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:49 smithi194 ceph-mon[88937]: pgmap v77: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:49 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-20T08:11:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:49 smithi194 ceph-mon[88937]: Upgrade: osd.2 is safe to restart 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: Upgrade: Updating osd.2 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: Deploying daemon osd.2 on smithi123 2024-02-20T08:11:51.705 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:51 smithi123 ceph-mon[112409]: pgmap v78: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: Upgrade: Updating osd.2 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: Deploying daemon osd.2 on smithi123 2024-02-20T08:11:51.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:51 smithi194 ceph-mon[88937]: pgmap v78: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:53.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:53 smithi123 ceph-mon[112409]: pgmap v79: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:53.990 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:53 smithi123 systemd[1]: Stopping Ceph osd.2 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:11:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:53 smithi194 ceph-mon[88937]: pgmap v79: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:54.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:53 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[63185]: 2024-02-20T08:11:53.991+0000 7ff9cc2f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:11:54.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:53 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[63185]: 2024-02-20T08:11:53.991+0000 7ff9cc2f3700 -1 osd.2 60 *** Got signal Terminated *** 2024-02-20T08:11:54.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:53 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[63185]: 2024-02-20T08:11:53.991+0000 7ff9cc2f3700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:11:54.950 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:54 smithi123 ceph-mon[112409]: osd.2 marked itself down and dead 2024-02-20T08:11:55.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:54 smithi194 ceph-mon[88937]: osd.2 marked itself down and dead 2024-02-20T08:11:55.492 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:55 smithi123 podman[133764]: 2024-02-20 08:11:55.223304489 +0000 UTC m=+1.344270647 container died 1fcbd66fcb67542330c4da3d0ae13604d72ef87e4070a8bcf0f1c848d3ab5c3f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-20T08:11:55.758 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:55 smithi123 podman[133764]: 2024-02-20 08:11:55.583711804 +0000 UTC m=+1.704677972 container cleanup 1fcbd66fcb67542330c4da3d0ae13604d72ef87e4070a8bcf0f1c848d3ab5c3f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, RELEASE=quincy-c80e716, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214) 2024-02-20T08:11:55.758 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:55 smithi123 bash[133764]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: pgmap v80: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: osdmap e61: 6 total, 5 up, 6 in 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: failed to encode map e61 with expected crc 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: failed to encode map e61 with expected crc 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: failed to encode map e61 with expected crc 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: pgmap v80: 65 pgs: 65 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: osdmap e61: 6 total, 5 up, 6 in 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: failed to encode map e61 with expected crc 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: failed to encode map e61 with expected crc 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: failed to encode map e61 with expected crc 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:11:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:11:56.247 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:55 smithi123 podman[133792]: 2024-02-20 08:11:55.91872001 +0000 UTC m=+0.696091153 container remove 1fcbd66fcb67542330c4da3d0ae13604d72ef87e4070a8bcf0f1c848d3ab5c3f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=quincy-c80e716, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-20T08:11:56.508 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.150253918 +0000 UTC m=+0.018327297 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:56.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.252858523 +0000 UTC m=+0.120931927 container create 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T08:11:56.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.489359773 +0000 UTC m=+0.357433145 container init 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-20T08:11:56.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.492876274 +0000 UTC m=+0.360949637 container start 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS) 2024-02-20T08:11:57.008 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.597102213 +0000 UTC m=+0.465175590 container attach 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:11:57.008 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:56 smithi123 podman[133884]: 2024-02-20 08:11:56.781687118 +0000 UTC m=+0.649760474 container died 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214) 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: osdmap e62: 6 total, 5 up, 6 in 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:56 smithi123 ceph-mon[112409]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: osdmap e62: 6 total, 5 up, 6 in 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:56 smithi194 ceph-mon[88937]: failed to encode map e62 with expected crc 2024-02-20T08:11:57.361 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 podman[133910]: 2024-02-20 08:11:57.347932568 +0000 UTC m=+0.560491244 container remove 4e09e4dfec1d2966c3427e814309fb7f4cbbd0696a49addc6a933dbbc2616de2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-20T08:11:57.710 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-20T08:11:57.710 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 systemd[1]: Stopped Ceph osd.2 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:11:57.710 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.2.service: Consumed 44.028s CPU time. 2024-02-20T08:11:57.710 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 systemd[1]: Starting Ceph osd.2 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:11:57.985 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:57 smithi123 ceph-mon[112409]: pgmap v83: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10/264 objects degraded (3.788%) 2024-02-20T08:11:57.985 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:57 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 5 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:57.986 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 podman[134016]: 2024-02-20 08:11:57.69774292 +0000 UTC m=+0.018252705 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:57.986 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:57 smithi123 podman[134016]: 2024-02-20 08:11:57.81918416 +0000 UTC m=+0.139693942 container create 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-02-20T08:11:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:57 smithi194 ceph-mon[88937]: pgmap v83: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10/264 objects degraded (3.788%) 2024-02-20T08:11:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:57 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 5 pgs degraded (PG_DEGRADED) 2024-02-20T08:11:58.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 podman[134016]: 2024-02-20 08:11:58.113930284 +0000 UTC m=+0.434440081 container init 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-02-20T08:11:58.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 podman[134016]: 2024-02-20 08:11:58.117260687 +0000 UTC m=+0.437770470 container start 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-20T08:11:58.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 podman[134016]: 2024-02-20 08:11:58.188331167 +0000 UTC m=+0.508840954 container attach 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-20T08:11:58.925 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 bash[134016]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate[134030]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-20T08:11:58.926 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:58 smithi123 podman[134016]: 2024-02-20 08:11:58.585595049 +0000 UTC m=+0.906104835 container died 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-20T08:11:59.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 podman[134154]: 2024-02-20 08:11:59.200938202 +0000 UTC m=+0.610542526 container remove 418bf2d00f07c4bfcb1fb54edc3e758720fadead8b55ded6a7aba877c0b263e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:11:59.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 podman[134221]: 2024-02-20 08:11:59.401724569 +0000 UTC m=+0.103437275 container create 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-02-20T08:11:59.509 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 podman[134221]: 2024-02-20 08:11:59.315721373 +0000 UTC m=+0.017434079 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:11:59.770 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:11:59 smithi123 ceph-mon[112409]: pgmap v84: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-02-20T08:11:59.770 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 podman[134221]: 2024-02-20 08:11:59.646086338 +0000 UTC m=+0.347799056 container init 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:11:59.770 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 podman[134221]: 2024-02-20 08:11:59.649240043 +0000 UTC m=+0.350952752 container start 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214) 2024-02-20T08:11:59.770 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 ceph-osd[134240]: -- 172.21.15.123:0/2866733489 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec8817b1e0 con 0x55ec8814cc00 2024-02-20T08:12:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:11:59 smithi194 ceph-mon[88937]: pgmap v84: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-02-20T08:12:00.190 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 bash[134221]: 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 2024-02-20T08:12:00.190 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:11:59 smithi123 systemd[1]: Started Ceph osd.2 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:12:00.508 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:12:00 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T08:12:00.189+0000 7f7816cea7c0 -1 Falling back to public interface 2024-02-20T08:12:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:00 smithi123 ceph-mon[112409]: pgmap v85: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:00 smithi194 ceph-mon[88937]: pgmap v85: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:02.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:02 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:02.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:02 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:03.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:03 smithi194 ceph-mon[88937]: pgmap v86: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:03.710 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:03 smithi123 ceph-mon[112409]: pgmap v86: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:04.364 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:12:04 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T08:12:04.073+0000 7f7816cea7c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-20T08:12:04.365 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:12:04 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T08:12:04.363+0000 7f7816cea7c0 -1 osd.2 60 log_to_monitors true 2024-02-20T08:12:04.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:04 smithi194 ceph-mon[88937]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-20T08:12:04.682 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:04 smithi123 ceph-mon[112409]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-20T08:12:04.682 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 08:12:04 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T08:12:04.401+0000 7f7808142700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: osdmap e63: 6 total, 5 up, 6 in 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:05.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-20T08:12:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: osdmap e63: 6 total, 5 up, 6 in 2024-02-20T08:12:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: from='osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-02-20T08:12:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-20T08:12:05.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:05.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:12:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014] boot 2024-02-20T08:12:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: osdmap e64: 6 total, 6 up, 6 in 2024-02-20T08:12:06.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:12:06.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:06.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:06.756 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: osd.2 [v2:172.21.15.123:6818/2869727014,v1:172.21.15.123:6819/2869727014] boot 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: osdmap e64: 6 total, 6 up, 6 in 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: failed to encode map e63 with expected crc 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:06.757 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:07.724 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.724 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: osdmap e65: 6 total, 6 up, 6 in 2024-02-20T08:12:07.724 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.724 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.724 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.725 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.725 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.725 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:07 smithi123 ceph-mon[112409]: pgmap v91: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 25/264 objects degraded (9.470%) 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: osdmap e65: 6 total, 6 up, 6 in 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: failed to encode map e65 with expected crc 2024-02-20T08:12:07.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:07 smithi194 ceph-mon[88937]: pgmap v91: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 25/264 objects degraded (9.470%) 2024-02-20T08:12:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:08 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:08.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:08 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:09.750 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:09 smithi123 ceph-mon[112409]: pgmap v92: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-02-20T08:12:09.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:09 smithi194 ceph-mon[88937]: pgmap v92: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-02-20T08:12:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 -- 172.21.15.123:0/2909023144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 msgr2=0x7f86b4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 --2- 172.21.15.123:0/2909023144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4102210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009ce0 tx=0x7f86ac004d10 comp rx=0 tx=0).stop 2024-02-20T08:12:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 -- 172.21.15.123:0/2909023144 shutdown_connections 2024-02-20T08:12:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 --2- 172.21.15.123:0/2909023144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b40fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 --2- 172.21.15.123:0/2909023144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4102210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 -- 172.21.15.123:0/2909023144 >> 172.21.15.123:0/2909023144 conn(0x7f86b4071d90 msgr2=0x7f86b4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 -- 172.21.15.123:0/2909023144 shutdown_connections 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.946+0000 7f86b9b24700 1 -- 172.21.15.123:0/2909023144 wait complete. 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 Processor -- start 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 -- start start 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b4114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b4114780 con 0x7f86b4101e40 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b9b24700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b410dab0 con 0x7f86b41027e0 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36042/0 (socket says 172.21.15.123:36042) 2024-02-20T08:12:09.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 -- 172.21.15.123:0/990626926 learned_addr learned my addr 172.21.15.123:0/990626926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b2ffd700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b4114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 -- 172.21.15.123:0/990626926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 msgr2=0x7f86b4114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b4114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 -- 172.21.15.123:0/990626926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac009940 con 0x7f86b4101e40 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b2ffd700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b4114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.947+0000 7f86b37fe700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00bf60 tx=0x7f86ac004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.948+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac00e040 con 0x7f86b4101e40 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.948+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b410dd30 con 0x7f86b4101e40 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.948+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86ac0128e0 con 0x7f86b4101e40 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.948+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac01c870 con 0x7f86b4101e40 2024-02-20T08:12:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.948+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b410e270 con 0x7f86b4101e40 2024-02-20T08:12:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.949+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b40738b0 con 0x7f86b4101e40 2024-02-20T08:12:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.949+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f86ac012a50 con 0x7f86b4101e40 2024-02-20T08:12:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.950+0000 7f869bfff700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 0x7f869c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.950+0000 7f86b2ffd700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 0x7f869c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.950+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f86ac08ebb0 con 0x7f86b4101e40 2024-02-20T08:12:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.950+0000 7f86b2ffd700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 0x7f869c06fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86a8007fd0 tx=0x7f86a8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:09.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:09.955+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f86ac095080 con 0x7f86b4101e40 2024-02-20T08:12:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.168+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b410f1d0 con 0x7f869c06d7e0 2024-02-20T08:12:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.170+0000 7f869bfff700 1 -- 172.21.15.123:0/990626926 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f86b410f1d0 con 0x7f869c06d7e0 2024-02-20T08:12:10.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 msgr2=0x7f869c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 0x7f869c06fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86a8007fd0 tx=0x7f86a8009040 comp rx=0 tx=0).stop 2024-02-20T08:12:10.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 msgr2=0x7f86b4113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00bf60 tx=0x7f86ac004d10 comp rx=0 tx=0).stop 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 shutdown_connections 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f869c06d7e0 0x7f869c06fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86b4101e40 0x7f86b4113bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 --2- 172.21.15.123:0/990626926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b41027e0 0x7f86b4114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 >> 172.21.15.123:0/990626926 conn(0x7f86b4071d90 msgr2=0x7f86b40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 shutdown_connections 2024-02-20T08:12:10.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.172+0000 7f86b9b24700 1 -- 172.21.15.123:0/990626926 wait complete. 2024-02-20T08:12:10.183 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:12:10.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 -- 172.21.15.123:0/285468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fdfe0 msgr2=0x7f6e100fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 --2- 172.21.15.123:0/285468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fdfe0 0x7f6e100fe3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004970 tx=0x7f6e00009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 -- 172.21.15.123:0/285468331 shutdown_connections 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 --2- 172.21.15.123:0/285468331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fe8f0 0x7f6e10107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 --2- 172.21.15.123:0/285468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fdfe0 0x7f6e100fe3b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 -- 172.21.15.123:0/285468331 >> 172.21.15.123:0/285468331 conn(0x7f6e10071d90 msgr2=0x7f6e10072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 -- 172.21.15.123:0/285468331 shutdown_connections 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 -- 172.21.15.123:0/285468331 wait complete. 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.273+0000 7f6e164c2700 1 Processor -- start 2024-02-20T08:12:10.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e164c2700 1 -- start start 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e164c2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fdfe0 0x7f6e10113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e164c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e164c2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e101145e0 con 0x7f6e100fe8f0 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e164c2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1010d910 con 0x7f6e100fdfe0 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36048/0 (socket says 172.21.15.123:36048) 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 -- 172.21.15.123:0/1324549422 learned_addr learned my addr 172.21.15.123:0/1324549422 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0ffff700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fdfe0 0x7f6e10113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 -- 172.21.15.123:0/1324549422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fdfe0 msgr2=0x7f6e10113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fdfe0 0x7f6e10113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 -- 172.21.15.123:0/1324549422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00005040 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.274+0000 7f6e0f7fe700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c8c0 tx=0x7f6e040044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0400a760 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1010dbf0 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e0400ad90 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e040113a0 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1010e130 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.275+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e101046c0 con 0x7f6e100fe8f0 2024-02-20T08:12:10.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.276+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6e04012400 con 0x7f6e100fe8f0 2024-02-20T08:12:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.276+0000 7f6e0cff9700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 0x7f6df806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.277+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6e0408cf20 con 0x7f6e100fe8f0 2024-02-20T08:12:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.277+0000 7f6e0ffff700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 0x7f6df806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.277+0000 7f6e0ffff700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 0x7f6df806fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004940 tx=0x7f6e00009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.281+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e0405a2d0 con 0x7f6e100fe8f0 2024-02-20T08:12:10.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.492+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e10113720 con 0x7f6df806d7e0 2024-02-20T08:12:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.493+0000 7f6e0cff9700 1 -- 172.21.15.123:0/1324549422 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6e10113720 con 0x7f6df806d7e0 2024-02-20T08:12:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 msgr2=0x7f6df806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 0x7f6df806fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004940 tx=0x7f6e00009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 msgr2=0x7f6e10113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c8c0 tx=0x7f6e040044c0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 shutdown_connections 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f6df806d7e0 0x7f6df806fc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e100fdfe0 0x7f6e10113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 --2- 172.21.15.123:0/1324549422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100fe8f0 0x7f6e10113f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 >> 172.21.15.123:0/1324549422 conn(0x7f6e10071d90 msgr2=0x7f6e10101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 shutdown_connections 2024-02-20T08:12:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.495+0000 7f6e164c2700 1 -- 172.21.15.123:0/1324549422 wait complete. 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- 172.21.15.123:0/3608271864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 msgr2=0x7f91ec0fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 --2- 172.21.15.123:0/3608271864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec0fba20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91e0004940 tx=0x7f91e0009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- 172.21.15.123:0/3608271864 shutdown_connections 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 --2- 172.21.15.123:0/3608271864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec0fba20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 --2- 172.21.15.123:0/3608271864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 0x7f91ec103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- 172.21.15.123:0/3608271864 >> 172.21.15.123:0/3608271864 conn(0x7f91ec071560 msgr2=0x7f91ec071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- 172.21.15.123:0/3608271864 shutdown_connections 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- 172.21.15.123:0/3608271864 wait complete. 2024-02-20T08:12:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 Processor -- start 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.599+0000 7f91f25fd700 1 -- start start 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 0x7f91ec113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec114640 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec10d970 con 0x7f91ec103050 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36058/0 (socket says 172.21.15.123:36058) 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 -- 172.21.15.123:0/2050629478 learned_addr learned my addr 172.21.15.123:0/2050629478 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91eb7fe700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 0x7f91ec113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 -- 172.21.15.123:0/2050629478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 msgr2=0x7f91ec113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 0x7f91ec113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 -- 172.21.15.123:0/2050629478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0005040 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91ebfff700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00eb40 tx=0x7f91dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc007cc0 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91dc00f040 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec10dbf0 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc00ca10 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.600+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec10e130 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.601+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec100350 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.602+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f91dc00cc80 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.602+0000 7f91e8ff9700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 0x7f91d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.602+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f91dc08ca20 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.602+0000 7f91eb7fe700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 0x7f91d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.603+0000 7f91eb7fe700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 0x7f91d406fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91ec10f2e0 tx=0x7f91e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.607+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f91dc059ea0 con 0x7f91ec0fb5b0 2024-02-20T08:12:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:12:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:10 smithi123 ceph-mon[112409]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-20T08:12:10.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.814+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91ec04bed0 con 0x7f91d406d7f0 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.824+0000 7f91e8ff9700 1 -- 172.21.15.123:0/2050629478 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f91ec04bed0 con 0x7f91d406d7f0 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (3m) 5s ago 15m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (94s) 5s ago 16m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (89s) 86s ago 14m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (3m) 5s ago 15m 80.3M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (9m) 5s ago 9m 14.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (9m) 5s ago 9m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:12:10.825 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (9m) 86s ago 9m 16.8M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (9m) 86s ago 9m 14.7M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (6m) 5s ago 17m 503M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (5m) 86s ago 14m 448M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (2m) 5s ago 17m 47.7M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (2m) 86s ago 14m 36.5M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (4m) 5s ago 15m 17.2M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 86s ago 14m 16.2M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (68s) 5s ago 13m 85.2M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (47s) 5s ago 13m 81.7M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (11s) 5s ago 12m 12.6M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (12m) 86s ago 12m 228M 2581M 17.2.7-521-gc80e7168 10b0c032c913 05d42dcd2440 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (11m) 86s ago 11m 201M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (11m) 86s ago 11m 196M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:12:10.826 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (4m) 5s ago 14m 57.1M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:12:10.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 msgr2=0x7f91d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 0x7f91d406fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91ec10f2e0 tx=0x7f91e0009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:10.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 msgr2=0x7f91ec113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00eb40 tx=0x7f91dc00b040 comp rx=0 tx=0).stop 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 shutdown_connections 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f91d406d7f0 0x7f91d406fca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91ec0fb5b0 0x7f91ec113ab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 --2- 172.21.15.123:0/2050629478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91ec103050 0x7f91ec113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 >> 172.21.15.123:0/2050629478 conn(0x7f91ec071560 msgr2=0x7f91ec0fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 shutdown_connections 2024-02-20T08:12:10.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.827+0000 7f91f25fd700 1 -- 172.21.15.123:0/2050629478 wait complete. 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:10 smithi194 ceph-mon[88937]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 -- 172.21.15.123:0/2317578312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fe8f0 msgr2=0x7f07e4107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 --2- 172.21.15.123:0/2317578312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fe8f0 0x7f07e4107050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07d8004970 tx=0x7f07d8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 -- 172.21.15.123:0/2317578312 shutdown_connections 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 --2- 172.21.15.123:0/2317578312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fe8f0 0x7f07e4107050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 --2- 172.21.15.123:0/2317578312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fdfe0 0x7f07e40fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 -- 172.21.15.123:0/2317578312 >> 172.21.15.123:0/2317578312 conn(0x7f07e4071d90 msgr2=0x7f07e4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 -- 172.21.15.123:0/2317578312 shutdown_connections 2024-02-20T08:12:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.926+0000 7f07ea324700 1 -- 172.21.15.123:0/2317578312 wait complete. 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 Processor -- start 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 -- start start 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fe8f0 0x7f07e4113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4114580 con 0x7f07e40fdfe0 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.927+0000 7f07ea324700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e410d8b0 con 0x7f07e40fe8f0 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36074/0 (socket says 172.21.15.123:36074) 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 -- 172.21.15.123:0/1325747559 learned_addr learned my addr 172.21.15.123:0/1325747559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e37fe700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fe8f0 0x7f07e4113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 -- 172.21.15.123:0/1325747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fe8f0 msgr2=0x7f07e4113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fe8f0 0x7f07e4113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 -- 172.21.15.123:0/1325747559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8005040 con 0x7f07e40fdfe0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e3fff700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07d4002a50 tx=0x7f07d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d4007cc0 con 0x7f07e40fdfe0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e410db90 con 0x7f07e40fdfe0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07d400f040 con 0x7f07e40fdfe0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d400da30 con 0x7f07e40fdfe0 2024-02-20T08:12:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.928+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e410e0a0 con 0x7f07e40fdfe0 2024-02-20T08:12:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.929+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e41046c0 con 0x7f07e40fdfe0 2024-02-20T08:12:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.930+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f07d400db90 con 0x7f07e40fdfe0 2024-02-20T08:12:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.930+0000 7f07e0ff9700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 0x7f07cc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.930+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f07d408cc20 con 0x7f07e40fdfe0 2024-02-20T08:12:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.930+0000 7f07e37fe700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 0x7f07cc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.931+0000 7f07e37fe700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 0x7f07cc06fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:10.935+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f07d4059ff0 con 0x7f07e40fdfe0 2024-02-20T08:12:11.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.208+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07e404bed0 con 0x7f07e40fdfe0 2024-02-20T08:12:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.208+0000 7f07e0ff9700 1 -- 172.21.15.123:0/1325747559 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f07d4059b80 con 0x7f07e40fdfe0 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:12:11.211 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 3, 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 3 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 7, 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 7 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:12:11.212 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 msgr2=0x7f07cc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 0x7f07cc06fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 msgr2=0x7f07e41139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07d4002a50 tx=0x7f07d40046b0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 shutdown_connections 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f07cc06d7e0 0x7f07cc06fc90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07e40fdfe0 0x7f07e41139f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 --2- 172.21.15.123:0/1325747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07e40fe8f0 0x7f07e4113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.210+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 >> 172.21.15.123:0/1325747559 conn(0x7f07e4071d90 msgr2=0x7f07e4101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.211+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 shutdown_connections 2024-02-20T08:12:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.211+0000 7f07ea324700 1 -- 172.21.15.123:0/1325747559 wait complete. 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 -- 172.21.15.123:0/3946767397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 msgr2=0x7fa478103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 --2- 172.21.15.123:0/3946767397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478103320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa468009ce0 tx=0x7fa468004d10 comp rx=0 tx=0).stop 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 -- 172.21.15.123:0/3946767397 shutdown_connections 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 --2- 172.21.15.123:0/3946767397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 0x7fa4780fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 --2- 172.21.15.123:0/3946767397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478103320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 -- 172.21.15.123:0/3946767397 >> 172.21.15.123:0/3946767397 conn(0x7fa4780f8ae0 msgr2=0x7fa4780faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:11.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 -- 172.21.15.123:0/3946767397 shutdown_connections 2024-02-20T08:12:11.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.312+0000 7fa47de09700 1 -- 172.21.15.123:0/3946767397 wait complete. 2024-02-20T08:12:11.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 Processor -- start 2024-02-20T08:12:11.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 -- start start 2024-02-20T08:12:11.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 0x7fa478114140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478114820 con 0x7fa478102f50 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa47de09700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47810dae0 con 0x7fa4781038f0 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa4777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa4777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36100/0 (socket says 172.21.15.123:36100) 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.313+0000 7fa4777fe700 1 -- 172.21.15.123:0/703041213 learned_addr learned my addr 172.21.15.123:0/703041213 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa476ffd700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 0x7fa478114140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa4777fe700 1 -- 172.21.15.123:0/703041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 msgr2=0x7fa478114140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa4777fe700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 0x7fa478114140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa4777fe700 1 -- 172.21.15.123:0/703041213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009940 con 0x7fa478102f50 2024-02-20T08:12:11.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa4777fe700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa468004b70 tx=0x7fa468004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46800e040 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa468004610 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46801c810 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47810dd60 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.314+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47810e2a0 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.315+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4780fc6e0 con 0x7fa478102f50 2024-02-20T08:12:11.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.316+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa468012c00 con 0x7fa478102f50 2024-02-20T08:12:11.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.316+0000 7fa46ffff700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 0x7fa46406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.316+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa46808e9f0 con 0x7fa478102f50 2024-02-20T08:12:11.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.316+0000 7fa476ffd700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 0x7fa46406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.316+0000 7fa476ffd700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 0x7fa46406fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa460006fd0 tx=0x7fa460008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:11.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.321+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa468090e60 con 0x7fa478102f50 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.559+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa47810f1e0 con 0x7fa478102f50 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.560+0000 7fa46ffff700 1 -- 172.21.15.123:0/703041213 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fa46802a750 con 0x7fa478102f50 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:12:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:12:11.561 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:12:11.562 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:11.563 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 msgr2=0x7fa46406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 0x7fa46406fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa460006fd0 tx=0x7fa460008040 comp rx=0 tx=0).stop 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 msgr2=0x7fa478113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa468004b70 tx=0x7fa468004d10 comp rx=0 tx=0).stop 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 shutdown_connections 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa46406d7f0 0x7fa46406fca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa478102f50 0x7fa478113c00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 --2- 172.21.15.123:0/703041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4781038f0 0x7fa478114140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 >> 172.21.15.123:0/703041213 conn(0x7fa4780f8ae0 msgr2=0x7fa4780fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 shutdown_connections 2024-02-20T08:12:11.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.562+0000 7fa47de09700 1 -- 172.21.15.123:0/703041213 wait complete. 2024-02-20T08:12:11.565 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 -- 172.21.15.123:0/1901673569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c401027e0 msgr2=0x7f2c400fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 --2- 172.21.15.123:0/1901673569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c401027e0 0x7f2c400fbea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c28004940 tx=0x7f2c28009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 -- 172.21.15.123:0/1901673569 shutdown_connections 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 --2- 172.21.15.123:0/1901673569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c401027e0 0x7f2c400fbea0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 --2- 172.21.15.123:0/1901673569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c40101e40 0x7f2c40102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 -- 172.21.15.123:0/1901673569 >> 172.21.15.123:0/1901673569 conn(0x7f2c40071d90 msgr2=0x7f2c40072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 -- 172.21.15.123:0/1901673569 shutdown_connections 2024-02-20T08:12:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.668+0000 7f2c45eed700 1 -- 172.21.15.123:0/1901673569 wait complete. 2024-02-20T08:12:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 Processor -- start 2024-02-20T08:12:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 -- start start 2024-02-20T08:12:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 0x7f2c4010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4010f6a0 con 0x7f2c40101e40 2024-02-20T08:12:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c45eed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4010f810 con 0x7f2c401027e0 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36116/0 (socket says 172.21.15.123:36116) 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.669+0000 7f2c3f7fe700 1 -- 172.21.15.123:0/553987498 learned_addr learned my addr 172.21.15.123:0/553987498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c36ffd700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 0x7f2c4010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3f7fe700 1 -- 172.21.15.123:0/553987498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 msgr2=0x7f2c4010f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3f7fe700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 0x7f2c4010f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3f7fe700 1 -- 172.21.15.123:0/553987498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28005040 con 0x7f2c40101e40 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c36ffd700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 0x7f2c4010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3f7fe700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c840 tx=0x7f2c30004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c30012810 con 0x7f2c40101e40 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c30012e40 con 0x7f2c40101e40 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c40117ae0 con 0x7f2c40101e40 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3000a370 con 0x7f2c40101e40 2024-02-20T08:12:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.670+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c40118020 con 0x7f2c40101e40 2024-02-20T08:12:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.671+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c40104310 con 0x7f2c40101e40 2024-02-20T08:12:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.671+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2c30011380 con 0x7f2c40101e40 2024-02-20T08:12:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.672+0000 7f2c3cff9700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 0x7f2c2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.672+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2c3008d290 con 0x7f2c40101e40 2024-02-20T08:12:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.672+0000 7f2c36ffd700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 0x7f2c2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.672+0000 7f2c36ffd700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 0x7f2c2c06fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009fd0 tx=0x7f2c28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.676+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2c30056b30 con 0x7f2c40101e40 2024-02-20T08:12:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.892+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c40065ee0 con 0x7f2c2c06d7e0 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: pgmap v93: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1325747559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/703041213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:12:11.893 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:11 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded) 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.893+0000 7f2c3cff9700 1 -- 172.21.15.123:0/553987498 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2c40065ee0 con 0x7f2c2c06d7e0 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:12:11.894 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:12:11.895 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:12:11.895 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "9/21 daemons upgraded", 2024-02-20T08:12:11.895 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:12:11.895 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:12:11.895 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 msgr2=0x7f2c2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 0x7f2c2c06fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009fd0 tx=0x7f2c28009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 msgr2=0x7f2c4010eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c840 tx=0x7f2c30004470 comp rx=0 tx=0).stop 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 shutdown_connections 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2c2c06d7e0 0x7f2c2c06fc90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c40101e40 0x7f2c4010eb10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 --2- 172.21.15.123:0/553987498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c401027e0 0x7f2c4010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.895+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 >> 172.21.15.123:0/553987498 conn(0x7f2c40071d90 msgr2=0x7f2c400fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.896+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 shutdown_connections 2024-02-20T08:12:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.896+0000 7f2c45eed700 1 -- 172.21.15.123:0/553987498 wait complete. 2024-02-20T08:12:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 -- 172.21.15.123:0/2354262107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fdfc0 msgr2=0x7f19f80fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 --2- 172.21.15.123:0/2354262107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fdfc0 0x7f19f80fe390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19e8004940 tx=0x7f19e8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 -- 172.21.15.123:0/2354262107 shutdown_connections 2024-02-20T08:12:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 --2- 172.21.15.123:0/2354262107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fe960 0x7f19f8106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:11.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 --2- 172.21.15.123:0/2354262107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fdfc0 0x7f19f80fe390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 -- 172.21.15.123:0/2354262107 >> 172.21.15.123:0/2354262107 conn(0x7f19f80f7a10 msgr2=0x7f19f80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 -- 172.21.15.123:0/2354262107 shutdown_connections 2024-02-20T08:12:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.998+0000 7f19fe553700 1 -- 172.21.15.123:0/2354262107 wait complete. 2024-02-20T08:12:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 Processor -- start 2024-02-20T08:12:12.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 -- start start 2024-02-20T08:12:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fdfc0 0x7f19f8113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8114510 con 0x7f19f80fe960 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19fe553700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f810d840 con 0x7f19f80fdfc0 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36124/0 (socket says 172.21.15.123:36124) 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:11.999+0000 7f19f77fe700 1 -- 172.21.15.123:0/346114396 learned_addr learned my addr 172.21.15.123:0/346114396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f7fff700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fdfc0 0x7f19f8113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f77fe700 1 -- 172.21.15.123:0/346114396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fdfc0 msgr2=0x7f19f8113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f77fe700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fdfc0 0x7f19f8113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f77fe700 1 -- 172.21.15.123:0/346114396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8005040 con 0x7f19f80fe960 2024-02-20T08:12:12.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f77fe700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00eb40 tx=0x7f19ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec007cc0 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f810dac0 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19ec00f040 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec009620 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.000+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f810e000 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.001+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f81045b0 con 0x7f19f80fe960 2024-02-20T08:12:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.002+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f19ec009780 con 0x7f19f80fe960 2024-02-20T08:12:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.002+0000 7f19f4ff9700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 0x7f19e006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.002+0000 7f19f7fff700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 0x7f19e006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.002+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f19ec08cb40 con 0x7f19f80fe960 2024-02-20T08:12:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.003+0000 7f19f7fff700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 0x7f19e006fc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19e800b0d0 tx=0x7f19e8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:12.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.007+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f19ec059fc0 con 0x7f19f80fe960 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: pgmap v93: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1325747559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/703041213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:12:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:11 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded) 2024-02-20T08:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.279+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f19f8109f80 con 0x7f19f80fe960 2024-02-20T08:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.280+0000 7f19f4ff9700 1 -- 172.21.15.123:0/346114396 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f19ec059b50 con 0x7f19f80fe960 2024-02-20T08:12:12.280 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:12:12.280 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:12:12.280 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:12:12.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 msgr2=0x7f19e006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:12.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 0x7f19e006fc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19e800b0d0 tx=0x7f19e8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:12.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 msgr2=0x7f19f8113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00eb40 tx=0x7f19ec00b040 comp rx=0 tx=0).stop 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 shutdown_connections 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f19e006d7e0 0x7f19e006fc90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fdfc0 0x7f19f8113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 --2- 172.21.15.123:0/346114396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f80fe960 0x7f19f8113ec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 >> 172.21.15.123:0/346114396 conn(0x7f19f80f7a10 msgr2=0x7f19f8101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 shutdown_connections 2024-02-20T08:12:12.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:12.282+0000 7f19fe553700 1 -- 172.21.15.123:0/346114396 wait complete. 2024-02-20T08:12:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:12 smithi123 ceph-mon[112409]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:12 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/346114396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:12:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:12 smithi194 ceph-mon[88937]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:12 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/346114396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:12:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:13 smithi123 ceph-mon[112409]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:13 smithi123 ceph-mon[112409]: pgmap v94: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:13 smithi194 ceph-mon[88937]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:13 smithi194 ceph-mon[88937]: pgmap v94: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:15 smithi123 ceph-mon[112409]: pgmap v95: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:15 smithi194 ceph-mon[88937]: pgmap v95: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:17.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:18.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:17 smithi123 ceph-mon[112409]: pgmap v96: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:17 smithi194 ceph-mon[88937]: pgmap v96: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:20.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:19 smithi123 ceph-mon[112409]: pgmap v97: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:19 smithi194 ceph-mon[88937]: pgmap v97: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:21 smithi123 ceph-mon[112409]: pgmap v98: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:21 smithi194 ceph-mon[88937]: pgmap v98: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:23 smithi123 ceph-mon[112409]: pgmap v99: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:23 smithi194 ceph-mon[88937]: pgmap v99: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: pgmap v100: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: Upgrade: osd.3 is safe to restart 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: pgmap v100: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: Upgrade: osd.3 is safe to restart 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: Upgrade: Updating osd.3 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: Deploying daemon osd.3 on smithi194 2024-02-20T08:12:27.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:27 smithi194 ceph-mon[88937]: pgmap v101: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: Upgrade: Updating osd.3 2024-02-20T08:12:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-20T08:12:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:27.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: Deploying daemon osd.3 on smithi194 2024-02-20T08:12:27.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:27 smithi123 ceph-mon[112409]: pgmap v101: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:29.913 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:29 smithi194 ceph-mon[88937]: pgmap v102: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:29.914 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:29 smithi194 systemd[1]: Stopping Ceph osd.3 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:12:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:29 smithi123 ceph-mon[112409]: pgmap v102: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:30.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:29 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[43395]: 2024-02-20T08:12:29.942+0000 7fac7cb84700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:12:30.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:29 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[43395]: 2024-02-20T08:12:29.942+0000 7fac7cb84700 -1 osd.3 65 *** Got signal Terminated *** 2024-02-20T08:12:30.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:29 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[43395]: 2024-02-20T08:12:29.942+0000 7fac7cb84700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:12:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:30 smithi123 ceph-mon[112409]: osd.3 marked itself down and dead 2024-02-20T08:12:31.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:30 smithi194 ceph-mon[88937]: osd.3 marked itself down and dead 2024-02-20T08:12:31.527 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:31 smithi194 podman[97582]: 2024-02-20 08:12:31.237026502 +0000 UTC m=+1.428024570 container died 05d42dcd2440c8951d30f1f63ca306a77df6b35ff9e6fdfde50312b88472139a (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=quincy-c80e716, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:12:31.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:31 smithi194 ceph-mon[88937]: pgmap v103: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:31.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:31 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:12:31.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:31 smithi194 ceph-mon[88937]: failed to encode map e66 with expected crc 2024-02-20T08:12:31.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:31 smithi194 ceph-mon[88937]: osdmap e66: 6 total, 5 up, 6 in 2024-02-20T08:12:31.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:31 smithi194 podman[97582]: 2024-02-20 08:12:31.726421303 +0000 UTC m=+1.917419384 container cleanup 05d42dcd2440c8951d30f1f63ca306a77df6b35ff9e6fdfde50312b88472139a (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c80e716, GIT_CLEAN=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux ) 2024-02-20T08:12:31.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:31 smithi194 bash[97582]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3 2024-02-20T08:12:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:31 smithi123 ceph-mon[112409]: pgmap v103: 65 pgs: 65 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:31 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:12:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:31 smithi123 ceph-mon[112409]: failed to encode map e66 with expected crc 2024-02-20T08:12:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:31 smithi123 ceph-mon[112409]: osdmap e66: 6 total, 5 up, 6 in 2024-02-20T08:12:32.286 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:31 smithi194 podman[97613]: 2024-02-20 08:12:31.986262919 +0000 UTC m=+0.743308544 container remove 05d42dcd2440c8951d30f1f63ca306a77df6b35ff9e6fdfde50312b88472139a (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:12:32.598 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.189151218 +0000 UTC m=+0.018507044 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:12:32.598 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.303523598 +0000 UTC m=+0.132879415 container create 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:12:32.598 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.514630963 +0000 UTC m=+0.343986781 container init 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-20T08:12:32.598 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.517729702 +0000 UTC m=+0.347085534 container start 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T08:12:32.598 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.597728314 +0000 UTC m=+0.427084135 container attach 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T08:12:32.894 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:32 smithi194 podman[97705]: 2024-02-20 08:12:32.81247358 +0000 UTC m=+0.641829407 container died 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-20T08:12:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:32 smithi194 ceph-mon[88937]: failed to encode map e67 with expected crc 2024-02-20T08:12:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:32 smithi194 ceph-mon[88937]: failed to encode map e67 with expected crc 2024-02-20T08:12:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:32 smithi194 ceph-mon[88937]: osdmap e67: 6 total, 5 up, 6 in 2024-02-20T08:12:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:32 smithi194 ceph-mon[88937]: failed to encode map e67 with expected crc 2024-02-20T08:12:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:32 smithi194 ceph-mon[88937]: failed to encode map e67 with expected crc 2024-02-20T08:12:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:32 smithi123 ceph-mon[112409]: failed to encode map e67 with expected crc 2024-02-20T08:12:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:32 smithi123 ceph-mon[112409]: failed to encode map e67 with expected crc 2024-02-20T08:12:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:32 smithi123 ceph-mon[112409]: osdmap e67: 6 total, 5 up, 6 in 2024-02-20T08:12:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:32 smithi123 ceph-mon[112409]: failed to encode map e67 with expected crc 2024-02-20T08:12:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:32 smithi123 ceph-mon[112409]: failed to encode map e67 with expected crc 2024-02-20T08:12:33.373 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 podman[97731]: 2024-02-20 08:12:33.359501933 +0000 UTC m=+0.541995557 container remove 02309b098b9c8f42d32c4be674644cd9a740d7bdf32f7a3a9312c8530c7e6226 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:12:33.644 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-20T08:12:33.644 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 systemd[1]: Stopped Ceph osd.3 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:12:33.644 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.3.service: Consumed 1min 266ms CPU time. 2024-02-20T08:12:33.644 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 systemd[1]: Starting Ceph osd.3 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:12:33.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:33 smithi194 ceph-mon[88937]: pgmap v106: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9/264 objects degraded (3.409%) 2024-02-20T08:12:33.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:33 smithi194 ceph-mon[88937]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-02-20T08:12:33.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:33 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 9/264 objects degraded (3.409%), 3 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:33.996 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 podman[97836]: 2024-02-20 08:12:33.694243399 +0000 UTC m=+0.018079760 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:12:33.997 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 podman[97836]: 2024-02-20 08:12:33.7941349 +0000 UTC m=+0.117971253 container create a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-20T08:12:33.997 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 podman[97836]: 2024-02-20 08:12:33.996331214 +0000 UTC m=+0.320167569 container init a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:12:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:33 smithi123 ceph-mon[112409]: pgmap v106: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9/264 objects degraded (3.409%) 2024-02-20T08:12:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:33 smithi123 ceph-mon[112409]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-02-20T08:12:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:33 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 9/264 objects degraded (3.409%), 3 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:34.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:33 smithi194 podman[97836]: 2024-02-20 08:12:33.99959142 +0000 UTC m=+0.323427782 container start a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:12:34.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 podman[97836]: 2024-02-20 08:12:34.113267067 +0000 UTC m=+0.437103443 container attach a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0) 2024-02-20T08:12:34.796 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-20T08:12:34.796 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 bash[97836]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate[97851]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-20T08:12:34.797 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:34 smithi194 podman[97836]: 2024-02-20 08:12:34.464672568 +0000 UTC m=+0.788508914 container died a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD) 2024-02-20T08:12:35.144 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 podman[97971]: 2024-02-20 08:12:35.033288267 +0000 UTC m=+0.563553712 container remove a1dd2cee792ee5f13b230b2f6103fca9c87b175fd41620dfab853eaa667a7585 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-20T08:12:35.511 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 podman[98035]: 2024-02-20 08:12:35.147420988 +0000 UTC m=+0.018143739 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:12:35.511 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 podman[98035]: 2024-02-20 08:12:35.259158126 +0000 UTC m=+0.129880877 container create 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:12:35.511 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 podman[98035]: 2024-02-20 08:12:35.511353028 +0000 UTC m=+0.382075779 container init 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-20T08:12:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:35 smithi194 ceph-mon[88937]: pgmap v107: 65 pgs: 10 active+undersized+degraded, 18 peering, 10 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 28/264 objects degraded (10.606%) 2024-02-20T08:12:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:35.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:35.894 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 podman[98035]: 2024-02-20 08:12:35.514497153 +0000 UTC m=+0.385219904 container start 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-20T08:12:35.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 ceph-osd[98054]: -- 172.21.15.194:0/289032876 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fb913391e0 con 0x55fb9130ac00 2024-02-20T08:12:35.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 bash[98035]: 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d 2024-02-20T08:12:35.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:35 smithi194 systemd[1]: Started Ceph osd.3 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:12:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:35 smithi123 ceph-mon[112409]: pgmap v107: 65 pgs: 10 active+undersized+degraded, 18 peering, 10 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 28/264 objects degraded (10.606%) 2024-02-20T08:12:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:36.394 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:36 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T08:12:36.058+0000 7fe561b977c0 -1 Falling back to public interface 2024-02-20T08:12:36.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:36 smithi194 ceph-mon[88937]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-02-20T08:12:37.077 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:36 smithi123 ceph-mon[112409]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-02-20T08:12:38.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:37 smithi123 ceph-mon[112409]: pgmap v108: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:38.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:37 smithi194 ceph-mon[88937]: pgmap v108: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:39 smithi123 ceph-mon[112409]: pgmap v109: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:39 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:40.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:39 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:39 smithi194 ceph-mon[88937]: pgmap v109: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:39 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:39 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:40.733 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T08:12:40.573+0000 7fe561b977c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-20T08:12:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:41.144 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:40 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T08:12:40.946+0000 7fe561b977c0 -1 osd.3 65 log_to_monitors true 2024-02-20T08:12:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:41 smithi194 ceph-mon[88937]: pgmap v110: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:41 smithi194 ceph-mon[88937]: from='osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T08:12:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:41 smithi194 ceph-mon[88937]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T08:12:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:41 smithi123 ceph-mon[112409]: pgmap v110: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:41 smithi123 ceph-mon[112409]: from='osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T08:12:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:41 smithi123 ceph-mon[112409]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- 172.21.15.123:0/607408815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994102800 msgr2=0x7f29940fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 --2- 172.21.15.123:0/607408815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994102800 0x7f29940fbe70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2980004940 tx=0x7f2980009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- 172.21.15.123:0/607408815 shutdown_connections 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 --2- 172.21.15.123:0/607408815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994102800 0x7f29940fbe70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 --2- 172.21.15.123:0/607408815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994101e60 0x7f2994102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- 172.21.15.123:0/607408815 >> 172.21.15.123:0/607408815 conn(0x7f29940f7a10 msgr2=0x7f29940f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- 172.21.15.123:0/607408815 shutdown_connections 2024-02-20T08:12:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- 172.21.15.123:0/607408815 wait complete. 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 Processor -- start 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.395+0000 7f299ae7f700 1 -- start start 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994102800 0x7f2994103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994103890 con 0x7f2994101e60 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994103a00 con 0x7f2994102800 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47038/0 (socket says 172.21.15.123:47038) 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 -- 172.21.15.123:0/605192891 learned_addr learned my addr 172.21.15.123:0/605192891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2993fff700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994102800 0x7f2994103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 -- 172.21.15.123:0/605192891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994102800 msgr2=0x7f2994103200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994102800 0x7f2994103200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 -- 172.21.15.123:0/605192891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980005040 con 0x7f2994101e60 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f2998c1b700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f298800b790 tx=0x7f2988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298800f6f0 con 0x7f2994101e60 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2994119d50 con 0x7f2994101e60 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f298800fd20 con 0x7f2994101e60 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29880103a0 con 0x7f2994101e60 2024-02-20T08:12:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.396+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299411a210 con 0x7f2994101e60 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.397+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940fb610 con 0x7f2994101e60 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.398+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2988011400 con 0x7f2994101e60 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.398+0000 7f29917fa700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 0x7f298406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.398+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f298808cc70 con 0x7f2994101e60 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.399+0000 7f2993fff700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 0x7f298406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.399+0000 7f2993fff700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 0x7f298406fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2994104dd0 tx=0x7f2980009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:42.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.403+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2988056590 con 0x7f2994101e60 2024-02-20T08:12:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.614+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2994066760 con 0x7f298406d7f0 2024-02-20T08:12:42.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.615+0000 7f29917fa700 1 -- 172.21.15.123:0/605192891 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2994066760 con 0x7f298406d7f0 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.617+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 msgr2=0x7f298406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.617+0000 7f299ae7f700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 0x7f298406fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2994104dd0 tx=0x7f2980009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.617+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 msgr2=0x7f2994102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.617+0000 7f299ae7f700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f298800b790 tx=0x7f2988009250 comp rx=0 tx=0).stop 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 shutdown_connections 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f298406d7f0 0x7f298406fca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2994101e60 0x7f2994102cc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 --2- 172.21.15.123:0/605192891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2994102800 0x7f2994103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 >> 172.21.15.123:0/605192891 conn(0x7f29940f7a10 msgr2=0x7f2994066050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 shutdown_connections 2024-02-20T08:12:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.618+0000 7f299ae7f700 1 -- 172.21.15.123:0/605192891 wait complete. 2024-02-20T08:12:42.629 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 -- 172.21.15.123:0/1196191376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 msgr2=0x7fe334103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 --2- 172.21.15.123:0/1196191376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334103320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe324004940 tx=0x7fe324009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 -- 172.21.15.123:0/1196191376 shutdown_connections 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 --2- 172.21.15.123:0/1196191376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 0x7fe3340fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 --2- 172.21.15.123:0/1196191376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334103320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 -- 172.21.15.123:0/1196191376 >> 172.21.15.123:0/1196191376 conn(0x7fe3340f8ae0 msgr2=0x7fe3340faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 -- 172.21.15.123:0/1196191376 shutdown_connections 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.721+0000 7fe339291700 1 -- 172.21.15.123:0/1196191376 wait complete. 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 Processor -- start 2024-02-20T08:12:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 -- start start 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 0x7fe334113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341145f0 con 0x7fe334102f50 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe339291700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33410d920 con 0x7fe3341038f0 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47056/0 (socket says 172.21.15.123:47056) 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 -- 172.21.15.123:0/1593963099 learned_addr learned my addr 172.21.15.123:0/1593963099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe3327fc700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 0x7fe334113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 -- 172.21.15.123:0/1593963099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 msgr2=0x7fe334113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 0x7fe334113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.722+0000 7fe332ffd700 1 -- 172.21.15.123:0/1593963099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324005040 con 0x7fe334102f50 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe332ffd700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe324000c00 tx=0x7fe324009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32400e040 con 0x7fe334102f50 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe32400bbf0 con 0x7fe334102f50 2024-02-20T08:12:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33410dba0 con 0x7fe334102f50 2024-02-20T08:12:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32401c3f0 con 0x7fe334102f50 2024-02-20T08:12:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.723+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33410e0e0 con 0x7fe334102f50 2024-02-20T08:12:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.724+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334100260 con 0x7fe334102f50 2024-02-20T08:12:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.724+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe324013420 con 0x7fe334102f50 2024-02-20T08:12:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.725+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 0x7fe31c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.725+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe32408e200 con 0x7fe334102f50 2024-02-20T08:12:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.725+0000 7fe3327fc700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 0x7fe31c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.725+0000 7fe3327fc700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 0x7fe31c06fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe33410f290 tx=0x7fe32800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:42.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.729+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe32405b650 con 0x7fe334102f50 2024-02-20T08:12:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.944+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe33404bed0 con 0x7fe31c06d7e0 2024-02-20T08:12:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.945+0000 7fe31b7fe700 1 -- 172.21.15.123:0/1593963099 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe33404bed0 con 0x7fe31c06d7e0 2024-02-20T08:12:42.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 msgr2=0x7fe31c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 0x7fe31c06fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe33410f290 tx=0x7fe32800b040 comp rx=0 tx=0).stop 2024-02-20T08:12:42.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 msgr2=0x7fe334113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:42.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe324000c00 tx=0x7fe324009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:42.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 shutdown_connections 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe31c06d7e0 0x7fe31c06fc90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe334102f50 0x7fe334113a60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 --2- 172.21.15.123:0/1593963099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3341038f0 0x7fe334113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 >> 172.21.15.123:0/1593963099 conn(0x7fe3340f8ae0 msgr2=0x7fe3340fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 shutdown_connections 2024-02-20T08:12:42.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:42.947+0000 7fe339291700 1 -- 172.21.15.123:0/1593963099 wait complete. 2024-02-20T08:12:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-20T08:12:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: from='osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:12:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: osdmap e68: 6 total, 5 up, 6 in 2024-02-20T08:12:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:12:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:42 smithi123 ceph-mon[112409]: from='osd.3 ' entity='osd.3' 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 -- 172.21.15.123:0/2020305969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 msgr2=0x7fbba8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/2020305969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8102210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbba4004940 tx=0x7fbba4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 -- 172.21.15.123:0/2020305969 shutdown_connections 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/2020305969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 0x7fbba80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/2020305969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8102210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 -- 172.21.15.123:0/2020305969 >> 172.21.15.123:0/2020305969 conn(0x7fbba8071d90 msgr2=0x7fbba8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 -- 172.21.15.123:0/2020305969 shutdown_connections 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.050+0000 7fbbb00fc700 1 -- 172.21.15.123:0/2020305969 wait complete. 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 Processor -- start 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 -- start start 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 0x7fbba8113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8114610 con 0x7fbba8101e40 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbb00fc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba810d940 con 0x7fbba81027e0 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbade98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbade98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47068/0 (socket says 172.21.15.123:47068) 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbade98700 1 -- 172.21.15.123:0/3980041553 learned_addr learned my addr 172.21.15.123:0/3980041553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.051+0000 7fbbad697700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 0x7fbba8113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbade98700 1 -- 172.21.15.123:0/3980041553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 msgr2=0x7fbba8113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbade98700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 0x7fbba8113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbade98700 1 -- 172.21.15.123:0/3980041553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4005040 con 0x7fbba8101e40 2024-02-20T08:12:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbade98700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009100 tx=0x7fbba4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba400e040 con 0x7fbba8101e40 2024-02-20T08:12:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbba4013420 con 0x7fbba8101e40 2024-02-20T08:12:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba810dbc0 con 0x7fbba8101e40 2024-02-20T08:12:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba400bee0 con 0x7fbba8101e40 2024-02-20T08:12:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.052+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba810e100 con 0x7fbba8101e40 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.053+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba80738b0 con 0x7fbba8101e40 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.053+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fbba400ba10 con 0x7fbba8101e40 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.054+0000 7fbb9e7fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 0x7fbb9406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.054+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbba408e1d0 con 0x7fbba8101e40 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.054+0000 7fbbad697700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 0x7fbb9406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.054+0000 7fbbad697700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 0x7fbb9406fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbba810f2b0 tx=0x7fbb98009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.058+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbba405b5c0 con 0x7fbba8101e40 2024-02-20T08:12:43.082 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T08:12:42.664+0000 7fe54efe7700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:12:43.082 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-20T08:12:43.082 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: from='osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:12:43.082 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: osdmap e68: 6 total, 5 up, 6 in 2024-02-20T08:12:43.083 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:12:43.083 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:43.083 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:42 smithi194 ceph-mon[88937]: from='osd.3 ' entity='osd.3' 2024-02-20T08:12:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.263+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbba810f060 con 0x7fbb9406d7e0 2024-02-20T08:12:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.273+0000 7fbb9e7fc700 1 -- 172.21.15.123:0/3980041553 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbba810f060 con 0x7fbb9406d7e0 2024-02-20T08:12:43.274 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (4m) 38s ago 16m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (2m) 38s ago 16m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (2m) 4s ago 15m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (4m) 38s ago 15m 80.3M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (10m) 38s ago 10m 14.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (10m) 38s ago 10m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (10m) 4s ago 10m 17.3M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (10m) 4s ago 10m 15.2M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (6m) 38s ago 17m 503M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (5m) 4s ago 15m 449M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (3m) 38s ago 17m 47.7M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:12:43.275 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (2m) 4s ago 14m 38.0M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (5m) 38s ago 16m 17.2M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 4s ago 15m 15.8M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (101s) 38s ago 14m 85.2M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (80s) 38s ago 13m 81.7M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (43s) 38s ago 13m 12.6M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (8s) 4s ago 12m 12.7M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (12m) 4s ago 12m 204M 2581M 17.2.7-521-gc80e7168 10b0c032c913 2084fe56b83b 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (11m) 4s ago 11m 199M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:12:43.276 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (4m) 38s ago 15m 57.1M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 msgr2=0x7fbb9406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 0x7fbb9406fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbba810f2b0 tx=0x7fbb98009040 comp rx=0 tx=0).stop 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 msgr2=0x7fbba8113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009100 tx=0x7fbba4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 shutdown_connections 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbb9406d7e0 0x7fbb9406fc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8101e40 0x7fbba8113a80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 --2- 172.21.15.123:0/3980041553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81027e0 0x7fbba8113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 >> 172.21.15.123:0/3980041553 conn(0x7fbba8071d90 msgr2=0x7fbba80656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.275+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 shutdown_connections 2024-02-20T08:12:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.276+0000 7fbbb00fc700 1 -- 172.21.15.123:0/3980041553 wait complete. 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 -- 172.21.15.123:0/853991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 msgr2=0x7ffab01033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 --2- 172.21.15.123:0/853991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab01033b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4004940 tx=0x7ffaa4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 -- 172.21.15.123:0/853991902 shutdown_connections 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 --2- 172.21.15.123:0/853991902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 0x7ffab00fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 --2- 172.21.15.123:0/853991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab01033b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 -- 172.21.15.123:0/853991902 >> 172.21.15.123:0/853991902 conn(0x7ffab0071500 msgr2=0x7ffab0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 -- 172.21.15.123:0/853991902 shutdown_connections 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.375+0000 7ffab6714700 1 -- 172.21.15.123:0/853991902 wait complete. 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 Processor -- start 2024-02-20T08:12:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 -- start start 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 0x7ffab0113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0114720 con 0x7ffab0102fe0 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffab6714700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab010d9c0 con 0x7ffab00fb560 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47078/0 (socket says 172.21.15.123:47078) 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffaaf7fe700 1 -- 172.21.15.123:0/992591306 learned_addr learned my addr 172.21.15.123:0/992591306 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.376+0000 7ffaaffff700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 0x7ffab0113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaaf7fe700 1 -- 172.21.15.123:0/992591306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 msgr2=0x7ffab0113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaaf7fe700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 0x7ffab0113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaaf7fe700 1 -- 172.21.15.123:0/992591306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4005040 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaaf7fe700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b790 tx=0x7ffaa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa000f6f0 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaa000fd20 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab010dca0 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa00103a0 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.377+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab010e1e0 con 0x7ffab0102fe0 2024-02-20T08:12:43.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.378+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab0100290 con 0x7ffab0102fe0 2024-02-20T08:12:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.379+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ffaa0011400 con 0x7ffab0102fe0 2024-02-20T08:12:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.379+0000 7ffaacff9700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 0x7ffa9806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.379+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffaa008cc80 con 0x7ffab0102fe0 2024-02-20T08:12:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.379+0000 7ffaaffff700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 0x7ffa9806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.379+0000 7ffaaffff700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 0x7ffa9806fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b3b0 tx=0x7ffaa4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.384+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffaa005a0d0 con 0x7ffab0102fe0 2024-02-20T08:12:43.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.675+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffab010a1b0 con 0x7ffab0102fe0 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.676+0000 7ffaacff9700 1 -- 172.21.15.123:0/992591306 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7ffaa0059c60 con 0x7ffab0102fe0 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2, 2024-02-20T08:12:43.677 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:12:43.678 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:43.678 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:12:43.678 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 6, 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 8 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:12:43.680 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 msgr2=0x7ffa9806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 0x7ffa9806fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b3b0 tx=0x7ffaa4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 msgr2=0x7ffab0114040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b790 tx=0x7ffaa0009250 comp rx=0 tx=0).stop 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 shutdown_connections 2024-02-20T08:12:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffa9806d7e0 0x7ffa9806fc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab00fb560 0x7ffab0113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 --2- 172.21.15.123:0/992591306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffab0102fe0 0x7ffab0114040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 >> 172.21.15.123:0/992591306 conn(0x7ffab0071500 msgr2=0x7ffab00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 shutdown_connections 2024-02-20T08:12:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.679+0000 7ffab6714700 1 -- 172.21.15.123:0/992591306 wait complete. 2024-02-20T08:12:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 -- 172.21.15.123:0/1899604976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc00fb570 msgr2=0x7febc00fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 --2- 172.21.15.123:0/1899604976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc00fb570 0x7febc00fb9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7febb4004940 tx=0x7febb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 -- 172.21.15.123:0/1899604976 shutdown_connections 2024-02-20T08:12:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 --2- 172.21.15.123:0/1899604976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc00fb570 0x7febc00fb9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 --2- 172.21.15.123:0/1899604976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc0103140 0x7febc0103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 -- 172.21.15.123:0/1899604976 >> 172.21.15.123:0/1899604976 conn(0x7febc0071560 msgr2=0x7febc0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 -- 172.21.15.123:0/1899604976 shutdown_connections 2024-02-20T08:12:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.781+0000 7febc5e0b700 1 -- 172.21.15.123:0/1899604976 wait complete. 2024-02-20T08:12:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 Processor -- start 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 -- start start 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00fb570 0x7febc0113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01147c0 con 0x7febc0103140 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febc5e0b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc010da60 con 0x7febc00fb570 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47094/0 (socket says 172.21.15.123:47094) 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 -- 172.21.15.123:0/859286441 learned_addr learned my addr 172.21.15.123:0/859286441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbf7fe700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00fb570 0x7febc0113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 -- 172.21.15.123:0/859286441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00fb570 msgr2=0x7febc0113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00fb570 0x7febc0113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.782+0000 7febbeffd700 1 -- 172.21.15.123:0/859286441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4005040 con 0x7febc0103140 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7febbeffd700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7febb400b3b0 tx=0x7febb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb400e040 con 0x7febc0103140 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febb400bbf0 con 0x7febc0103140 2024-02-20T08:12:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc010dce0 con 0x7febc0103140 2024-02-20T08:12:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb401c3f0 con 0x7febc0103140 2024-02-20T08:12:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.783+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc010e220 con 0x7febc0103140 2024-02-20T08:12:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.784+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc0105570 con 0x7febc0103140 2024-02-20T08:12:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.784+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7febb400bd60 con 0x7febc0103140 2024-02-20T08:12:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.785+0000 7feba7fff700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 0x7feba806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.785+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7febb408e100 con 0x7febc0103140 2024-02-20T08:12:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.785+0000 7febbf7fe700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 0x7feba806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.785+0000 7febbf7fe700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 0x7feba806fc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febb0009bf0 tx=0x7febb00091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:43.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:43.789+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7febb405b5f0 con 0x7febc0103140 2024-02-20T08:12:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: pgmap v112: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:12:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: failed to encode map e69 with expected crc 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390] boot 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: osdmap e69: 6 total, 6 up, 6 in 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:12:44.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:43 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/992591306' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.030+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febc0073080 con 0x7febc0103140 2024-02-20T08:12:44.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.030+0000 7feba7fff700 1 -- 172.21.15.123:0/859286441 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7febb405b180 con 0x7febc0103140 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:12:44.032 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:12:44.033 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:44.034 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:44.035 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:12:44.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 msgr2=0x7feba806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 0x7feba806fc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febb0009bf0 tx=0x7febb00091a0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 msgr2=0x7febc01140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7febb400b3b0 tx=0x7febb4009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 shutdown_connections 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feba806d7e0 0x7feba806fc90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00fb570 0x7febc0113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 --2- 172.21.15.123:0/859286441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc0103140 0x7febc01140e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.032+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 >> 172.21.15.123:0/859286441 conn(0x7febc0071560 msgr2=0x7febc00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.033+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 shutdown_connections 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.033+0000 7febc5e0b700 1 -- 172.21.15.123:0/859286441 wait complete. 2024-02-20T08:12:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 -- 172.21.15.123:0/1609688339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 msgr2=0x7f772c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 --2- 172.21.15.123:0/1609688339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c0fcf60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f771c004940 tx=0x7f771c009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 -- 172.21.15.123:0/1609688339 shutdown_connections 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 --2- 172.21.15.123:0/1609688339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c0fcf60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 --2- 172.21.15.123:0/1609688339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 0x7f772c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 -- 172.21.15.123:0/1609688339 >> 172.21.15.123:0/1609688339 conn(0x7f772c0f8ae0 msgr2=0x7f772c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 -- 172.21.15.123:0/1609688339 shutdown_connections 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.134+0000 7f773293f700 1 -- 172.21.15.123:0/1609688339 wait complete. 2024-02-20T08:12:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 Processor -- start 2024-02-20T08:12:44.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 -- start start 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 0x7f772c113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c114600 con 0x7f772c1038f0 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f773293f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c10d930 con 0x7f772c102f50 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f772b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f772b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47110/0 (socket says 172.21.15.123:47110) 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f772b7fe700 1 -- 172.21.15.123:0/854867840 learned_addr learned my addr 172.21.15.123:0/854867840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.135+0000 7f772bfff700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 0x7f772c113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f772b7fe700 1 -- 172.21.15.123:0/854867840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 msgr2=0x7f772c113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f772b7fe700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 0x7f772c113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f772b7fe700 1 -- 172.21.15.123:0/854867840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c005040 con 0x7f772c1038f0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f772b7fe700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f771c0090d0 tx=0x7f771c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c00e040 con 0x7f772c1038f0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f771c009430 con 0x7f772c1038f0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c10dbb0 con 0x7f772c1038f0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c01c3f0 con 0x7f772c1038f0 2024-02-20T08:12:44.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.136+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c10e0f0 con 0x7f772c1038f0 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.137+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c105420 con 0x7f772c1038f0 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.138+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f771c00bbf0 con 0x7f772c1038f0 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.138+0000 7f7728ff9700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 0x7f771406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.138+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f771c08e120 con 0x7f772c1038f0 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.138+0000 7f772bfff700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 0x7f771406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.138+0000 7f772bfff700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 0x7f771406fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77200041d0 tx=0x7f77200043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:44.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.142+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f771c05b570 con 0x7f772c1038f0 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: pgmap v112: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:12:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: failed to encode map e68 with expected crc 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: failed to encode map e69 with expected crc 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: osd.3 [v2:172.21.15.194:6800/3997122390,v1:172.21.15.194:6801/3997122390] boot 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: osdmap e69: 6 total, 6 up, 6 in 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-20T08:12:44.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:43 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/992591306' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:12:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.354+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f772c113740 con 0x7f771406d7e0 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.355+0000 7f7728ff9700 1 -- 172.21.15.123:0/854867840 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f772c113740 con 0x7f771406d7e0 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:12:44.356 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "10/21 daemons upgraded", 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:12:44.357 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 msgr2=0x7f771406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 0x7f771406fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77200041d0 tx=0x7f77200043c0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 msgr2=0x7f772c113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f771c0090d0 tx=0x7f771c009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 shutdown_connections 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f771406d7e0 0x7f771406fc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c102f50 0x7f772c113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 --2- 172.21.15.123:0/854867840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f772c1038f0 0x7f772c113fb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.357+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 >> 172.21.15.123:0/854867840 conn(0x7f772c0f8ae0 msgr2=0x7f772c0fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.358+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 shutdown_connections 2024-02-20T08:12:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.358+0000 7f773293f700 1 -- 172.21.15.123:0/854867840 wait complete. 2024-02-20T08:12:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 -- 172.21.15.123:0/3591674434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 msgr2=0x7f52080fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 --2- 172.21.15.123:0/3591674434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f52080fcf60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51f8004940 tx=0x7f51f8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 -- 172.21.15.123:0/3591674434 shutdown_connections 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 --2- 172.21.15.123:0/3591674434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f52080fcf60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 --2- 172.21.15.123:0/3591674434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 -- 172.21.15.123:0/3591674434 >> 172.21.15.123:0/3591674434 conn(0x7f52080f8ae0 msgr2=0x7f52080faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 -- 172.21.15.123:0/3591674434 shutdown_connections 2024-02-20T08:12:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.458+0000 7f52101b4700 1 -- 172.21.15.123:0/3591674434 wait complete. 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 Processor -- start 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 -- start start 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208114640 con 0x7f52081038f0 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f52101b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520810d970 con 0x7f5208102f50 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47128/0 (socket says 172.21.15.123:47128) 2024-02-20T08:12:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 -- 172.21.15.123:0/3554982308 learned_addr learned my addr 172.21.15.123:0/3554982308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520df50700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 -- 172.21.15.123:0/3554982308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 msgr2=0x7f5208113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520d74f700 1 -- 172.21.15.123:0/3554982308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8005040 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.459+0000 7f520df50700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f520d74f700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51f80090d0 tx=0x7f51f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f800e040 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520810dbf0 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51f800bbf0 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f801c630 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.460+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520810e130 con 0x7f52081038f0 2024-02-20T08:12:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.461+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208105420 con 0x7f52081038f0 2024-02-20T08:12:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.461+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f51f800bd60 con 0x7f52081038f0 2024-02-20T08:12:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.462+0000 7f51fe7fc700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 0x7f51f406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:12:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.462+0000 7f520df50700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 0x7f51f406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:12:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.462+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f51f808e1b0 con 0x7f52081038f0 2024-02-20T08:12:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.462+0000 7f520df50700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 0x7f51f406fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5204009fd0 tx=0x7f5204009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:12:44.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.466+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f51f805b600 con 0x7f52081038f0 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.752+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f520810a050 con 0x7f52081038f0 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.753+0000 7f51fe7fc700 1 -- 172.21.15.123:0/3554982308 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1372 (secure 0 0 0) 0x7f51f8013e60 con 0x7f52081038f0 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-02-20T08:12:44.754 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-02-20T08:12:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-02-20T08:12:44.756 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-02-20T08:12:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 msgr2=0x7f51f406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 0x7f51f406fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5204009fd0 tx=0x7f5204009e90 comp rx=0 tx=0).stop 2024-02-20T08:12:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 msgr2=0x7f5208113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:12:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51f80090d0 tx=0x7f51f8009e30 comp rx=0 tx=0).stop 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 shutdown_connections 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f51f406d7e0 0x7f51f406fc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5208102f50 0x7f5208113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 --2- 172.21.15.123:0/3554982308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52081038f0 0x7f5208113ff0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 >> 172.21.15.123:0/3554982308 conn(0x7f52080f8ae0 msgr2=0x7f52080fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 shutdown_connections 2024-02-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:12:44.755+0000 7f52101b4700 1 -- 172.21.15.123:0/3554982308 wait complete. 2024-02-20T08:12:45.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/859286441' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:12:45.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:45.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: pgmap v114: 65 pgs: 10 peering, 12 active+undersized+degraded, 16 active+undersized, 27 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: osdmap e70: 6 total, 6 up, 6 in 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:44 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3554982308' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/859286441' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: pgmap v114: 65 pgs: 10 peering, 12 active+undersized+degraded, 16 active+undersized, 27 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: osdmap e70: 6 total, 6 up, 6 in 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: failed to encode map e70 with expected crc 2024-02-20T08:12:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:44 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3554982308' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:12:47.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:47 smithi123 ceph-mon[112409]: pgmap v116: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/264 objects degraded (11.742%) 2024-02-20T08:12:47.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:47 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:47 smithi194 ceph-mon[88937]: pgmap v116: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/264 objects degraded (11.742%) 2024-02-20T08:12:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:47 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded (PG_DEGRADED) 2024-02-20T08:12:49.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:48 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded) 2024-02-20T08:12:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:48 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded) 2024-02-20T08:12:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:49 smithi194 ceph-mon[88937]: pgmap v117: 65 pgs: 10 peering, 55 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:49 smithi123 ceph-mon[112409]: pgmap v117: 65 pgs: 10 peering, 55 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:51 smithi194 ceph-mon[88937]: pgmap v118: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:51 smithi123 ceph-mon[112409]: pgmap v118: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:53 smithi194 ceph-mon[88937]: pgmap v119: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:54.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:53 smithi123 ceph-mon[112409]: pgmap v119: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:55 smithi194 ceph-mon[88937]: pgmap v120: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:55 smithi123 ceph-mon[112409]: pgmap v120: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:12:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:12:58.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:57 smithi123 ceph-mon[112409]: pgmap v121: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:57 smithi194 ceph-mon[88937]: pgmap v121: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:12:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:12:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:13:00.100 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:59 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:13:00.100 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:59 smithi194 ceph-mon[88937]: Upgrade: osd.4 is safe to restart 2024-02-20T08:13:00.101 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:12:59 smithi194 ceph-mon[88937]: pgmap v122: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:59 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-20T08:13:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:59 smithi123 ceph-mon[112409]: Upgrade: osd.4 is safe to restart 2024-02-20T08:13:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:12:59 smithi123 ceph-mon[112409]: pgmap v122: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:01.314 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: Upgrade: Updating osd.4 2024-02-20T08:13:01.314 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:01.314 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:13:01.314 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:01.314 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: Deploying daemon osd.4 on smithi194 2024-02-20T08:13:01.315 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:01 smithi194 ceph-mon[88937]: pgmap v123: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:01.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: Upgrade: Updating osd.4 2024-02-20T08:13:01.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:01.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-20T08:13:01.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:01.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: Deploying daemon osd.4 on smithi194 2024-02-20T08:13:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:01 smithi123 ceph-mon[112409]: pgmap v123: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:03.644 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:03 smithi194 systemd[1]: Stopping Ceph osd.4 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:13:04.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:03 smithi123 ceph-mon[112409]: pgmap v124: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:04.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:03 smithi123 ceph-mon[112409]: osd.4 marked itself down and dead 2024-02-20T08:13:04.080 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:03 smithi194 ceph-mon[88937]: pgmap v124: 65 pgs: 65 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:04.080 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:03 smithi194 ceph-mon[88937]: osd.4 marked itself down and dead 2024-02-20T08:13:04.080 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:03 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[50255]: 2024-02-20T08:13:03.651+0000 7f5420a12700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:13:04.080 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:03 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[50255]: 2024-02-20T08:13:03.651+0000 7f5420a12700 -1 osd.4 70 *** Got signal Terminated *** 2024-02-20T08:13:04.080 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:03 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[50255]: 2024-02-20T08:13:03.651+0000 7f5420a12700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:13:04.393 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:04 smithi194 podman[102601]: 2024-02-20 08:13:04.080302467 +0000 UTC m=+0.566117721 container died 2084fe56b83ba9ff4199d04b83900cec46ef970144b2b6d017e1b072091a2b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=quincy-c80e716, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:13:04.644 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:04 smithi194 podman[102601]: 2024-02-20 08:13:04.47653614 +0000 UTC m=+0.962351384 container cleanup 2084fe56b83ba9ff4199d04b83900cec46ef970144b2b6d017e1b072091a2b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=quincy-c80e716) 2024-02-20T08:13:04.644 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:04 smithi194 bash[102601]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4 2024-02-20T08:13:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:04 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:13:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:04 smithi123 ceph-mon[112409]: failed to encode map e71 with expected crc 2024-02-20T08:13:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:04 smithi123 ceph-mon[112409]: osdmap e71: 6 total, 5 up, 6 in 2024-02-20T08:13:05.040 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:04 smithi194 podman[102620]: 2024-02-20 08:13:04.702910276 +0000 UTC m=+0.624954890 container remove 2084fe56b83ba9ff4199d04b83900cec46ef970144b2b6d017e1b072091a2b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, RELEASE=quincy-c80e716, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:05.040 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:04 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:13:05.041 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:04 smithi194 ceph-mon[88937]: failed to encode map e71 with expected crc 2024-02-20T08:13:05.041 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:04 smithi194 ceph-mon[88937]: osdmap e71: 6 total, 5 up, 6 in 2024-02-20T08:13:05.306 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:05.041137863 +0000 UTC m=+0.114362220 container create 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:05.306 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:04.944289668 +0000 UTC m=+0.017514026 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:05.306 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:05.231201217 +0000 UTC m=+0.304425577 container init 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:13:05.306 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:05.234184997 +0000 UTC m=+0.307409362 container start 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:13:05.306 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:05.305988565 +0000 UTC m=+0.379212932 container attach 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214) 2024-02-20T08:13:05.644 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:05 smithi194 podman[102712]: 2024-02-20 08:13:05.530210151 +0000 UTC m=+0.603434509 container died 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-20T08:13:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:05 smithi123 ceph-mon[112409]: pgmap v126: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:05 smithi123 ceph-mon[112409]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-20T08:13:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:05 smithi123 ceph-mon[112409]: osdmap e72: 6 total, 5 up, 6 in 2024-02-20T08:13:06.043 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:05 smithi194 ceph-mon[88937]: pgmap v126: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:06.043 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:05 smithi194 ceph-mon[88937]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-20T08:13:06.044 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:05 smithi194 ceph-mon[88937]: osdmap e72: 6 total, 5 up, 6 in 2024-02-20T08:13:06.305 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102738]: 2024-02-20 08:13:06.091278848 +0000 UTC m=+0.555486678 container remove 0c2cc4cece5147ba07bc14ae0362056360490e1d73095e85d1e22c88b74ef377 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:13:06.305 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-20T08:13:06.305 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 systemd[1]: Stopped Ceph osd.4 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:13:06.305 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.4.service: Consumed 50.585s CPU time. 2024-02-20T08:13:06.638 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 systemd[1]: Starting Ceph osd.4 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:13:06.638 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102842]: 2024-02-20 08:13:06.519288781 +0000 UTC m=+0.114146935 container create 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-02-20T08:13:06.638 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102842]: 2024-02-20 08:13:06.422691246 +0000 UTC m=+0.017549410 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:06 smithi194 ceph-mon[88937]: failed to encode map e72 with expected crc 2024-02-20T08:13:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:06 smithi194 ceph-mon[88937]: failed to encode map e72 with expected crc 2024-02-20T08:13:06.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102842]: 2024-02-20 08:13:06.780207796 +0000 UTC m=+0.375065952 container init 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:13:06.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102842]: 2024-02-20 08:13:06.783456647 +0000 UTC m=+0.378314803 container start 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:13:06.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:06 smithi194 podman[102842]: 2024-02-20 08:13:06.855063385 +0000 UTC m=+0.449921551 container attach 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T08:13:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:06 smithi123 ceph-mon[112409]: failed to encode map e72 with expected crc 2024-02-20T08:13:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:06 smithi123 ceph-mon[112409]: failed to encode map e72 with expected crc 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-20T08:13:07.525 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 bash[102842]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate[102857]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-20T08:13:07.526 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 podman[102842]: 2024-02-20 08:13:07.254361865 +0000 UTC m=+0.849220020 container died 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-20T08:13:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-mon[88937]: pgmap v128: 65 pgs: 2 active+undersized+degraded, 10 peering, 3 stale+active+clean, 3 active+undersized, 47 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8/264 objects degraded (3.030%) 2024-02-20T08:13:07.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:07 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 8/264 objects degraded (3.030%), 2 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:08.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:07 smithi123 ceph-mon[112409]: pgmap v128: 65 pgs: 2 active+undersized+degraded, 10 peering, 3 stale+active+clean, 3 active+undersized, 47 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8/264 objects degraded (3.030%) 2024-02-20T08:13:08.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:07 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 8/264 objects degraded (3.030%), 2 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:08.294 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:07 smithi194 podman[102982]: 2024-02-20 08:13:07.941996645 +0000 UTC m=+0.682482715 container remove 92b7b75c56678dd43283bb6b70aff10adf1d1b5f968b5f4b2817b2f5a3af2174 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-20T08:13:08.294 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 podman[103044]: 2024-02-20 08:13:08.06695344 +0000 UTC m=+0.017932010 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:08.294 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 podman[103044]: 2024-02-20 08:13:08.18466745 +0000 UTC m=+0.135646016 container create 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:08.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 podman[103044]: 2024-02-20 08:13:08.454122539 +0000 UTC m=+0.405101121 container init 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-20T08:13:08.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 podman[103044]: 2024-02-20 08:13:08.457498161 +0000 UTC m=+0.408476728 container start 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T08:13:08.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 ceph-osd[103065]: -- 172.21.15.194:0/3729328574 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556eaac211e0 con 0x556eaabf3000 2024-02-20T08:13:08.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 bash[103044]: 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d 2024-02-20T08:13:08.894 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:08 smithi194 systemd[1]: Started Ceph osd.4 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:13:09.391 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:09 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T08:13:09.004+0000 7f7293a9d7c0 -1 Falling back to public interface 2024-02-20T08:13:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:09.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:09 smithi194 ceph-mon[88937]: pgmap v129: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39/264 objects degraded (14.773%) 2024-02-20T08:13:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:09 smithi123 ceph-mon[112409]: pgmap v129: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39/264 objects degraded (14.773%) 2024-02-20T08:13:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:11 smithi123 ceph-mon[112409]: pgmap v130: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:11 smithi123 ceph-mon[112409]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-20T08:13:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:11 smithi194 ceph-mon[88937]: pgmap v130: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:12.301 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:12.301 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:12.301 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:11 smithi194 ceph-mon[88937]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-20T08:13:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:12 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:12 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:13.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:13 smithi194 ceph-mon[88937]: pgmap v131: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:13.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:13 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:13 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:13.799 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:13 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T08:13:13.535+0000 7f7293a9d7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-20T08:13:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:13 smithi123 ceph-mon[112409]: pgmap v131: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:13 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:13 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:14.144 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:13 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T08:13:13.866+0000 7f7293a9d7c0 -1 osd.4 70 log_to_monitors true 2024-02-20T08:13:14.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:14 smithi194 ceph-mon[88937]: from='osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:13:14.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:14 smithi194 ceph-mon[88937]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- 172.21.15.123:0/2094522958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04101e60 msgr2=0x7f4c04102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 --2- 172.21.15.123:0/2094522958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04101e60 0x7f4c04102230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8004940 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- 172.21.15.123:0/2094522958 shutdown_connections 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 --2- 172.21.15.123:0/2094522958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04102800 0x7f4c040fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 --2- 172.21.15.123:0/2094522958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04101e60 0x7f4c04102230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- 172.21.15.123:0/2094522958 >> 172.21.15.123:0/2094522958 conn(0x7f4c040f7a10 msgr2=0x7f4c040f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- 172.21.15.123:0/2094522958 shutdown_connections 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- 172.21.15.123:0/2094522958 wait complete. 2024-02-20T08:13:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 Processor -- start 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.871+0000 7f4c0af16700 1 -- start start 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c0af16700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04101e60 0x7f4c0410c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c0af16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c0af16700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0410d220 con 0x7f4c04102800 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c0af16700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0410d390 con 0x7f4c04101e60 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49612/0 (socket says 172.21.15.123:49612) 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 -- 172.21.15.123:0/408889944 learned_addr learned my addr 172.21.15.123:0/408889944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c08cb2700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04101e60 0x7f4c0410c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 -- 172.21.15.123:0/408889944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04101e60 msgr2=0x7f4c0410c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04101e60 0x7f4c0410c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.872+0000 7f4c03fff700 1 -- 172.21.15.123:0/408889944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8005040 con 0x7f4c04102800 2024-02-20T08:13:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c03fff700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0002a80 tx=0x7f4bf0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf0004e80 con 0x7f4c04102800 2024-02-20T08:13:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bf000f040 con 0x7f4c04102800 2024-02-20T08:13:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c04119e10 con 0x7f4c04102800 2024-02-20T08:13:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf000daa0 con 0x7f4c04102800 2024-02-20T08:13:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.873+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0411a210 con 0x7f4c04102800 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.874+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c040ff170 con 0x7f4c04102800 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.874+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4bf0007cc0 con 0x7f4c04102800 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.875+0000 7f4c017fa700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 0x7f4bf406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.875+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4bf008c4d0 con 0x7f4c04102800 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.875+0000 7f4c08cb2700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 0x7f4bf406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.875+0000 7f4c08cb2700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 0x7f4bf406fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8004f90 tx=0x7f4bf8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:14.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:14.879+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4bf00598a0 con 0x7f4c04102800 2024-02-20T08:13:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:14 smithi123 ceph-mon[112409]: from='osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:13:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:14 smithi123 ceph-mon[112409]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-20T08:13:15.072 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 08:13:14 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T08:13:14.771+0000 7f7284ef5700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:13:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.092+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c040667c0 con 0x7f4bf406d7e0 2024-02-20T08:13:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.093+0000 7f4c017fa700 1 -- 172.21.15.123:0/408889944 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4c040667c0 con 0x7f4bf406d7e0 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 msgr2=0x7f4bf406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 0x7f4bf406fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8004f90 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 msgr2=0x7f4c0410cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0002a80 tx=0x7f4bf0004630 comp rx=0 tx=0).stop 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 shutdown_connections 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4bf406d7e0 0x7f4bf406fc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c04101e60 0x7f4c0410c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 --2- 172.21.15.123:0/408889944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c04102800 0x7f4c0410cce0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 >> 172.21.15.123:0/408889944 conn(0x7f4c040f7a10 msgr2=0x7f4c040f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 shutdown_connections 2024-02-20T08:13:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.095+0000 7f4c0af16700 1 -- 172.21.15.123:0/408889944 wait complete. 2024-02-20T08:13:15.106 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:13:15.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- 172.21.15.123:0/355917069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 msgr2=0x7fd49c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/355917069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c0fcf60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd484004940 tx=0x7fd484009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- 172.21.15.123:0/355917069 shutdown_connections 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/355917069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c0fcf60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/355917069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 0x7fd49c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- 172.21.15.123:0/355917069 >> 172.21.15.123:0/355917069 conn(0x7fd49c0f8ae0 msgr2=0x7fd49c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- 172.21.15.123:0/355917069 shutdown_connections 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- 172.21.15.123:0/355917069 wait complete. 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 Processor -- start 2024-02-20T08:13:15.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.198+0000 7fd4a16c5700 1 -- start start 2024-02-20T08:13:15.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 0x7fd49c113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c114620 con 0x7fd49c1038f0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c10d950 con 0x7fd49c102f50 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49630/0 (socket says 172.21.15.123:49630) 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 -- 172.21.15.123:0/2186100485 learned_addr learned my addr 172.21.15.123:0/2186100485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd49affd700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 0x7fd49c113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 -- 172.21.15.123:0/2186100485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 msgr2=0x7fd49c113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 0x7fd49c113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 -- 172.21.15.123:0/2186100485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484005040 con 0x7fd49c1038f0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4927fc700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd484000c00 tx=0x7fd484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd484021070 con 0x7fd49c1038f0 2024-02-20T08:13:15.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c10dbd0 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd484013dd0 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd48400e070 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.199+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c10e0b0 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.200+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c105420 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.201+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd48401cbf0 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.201+0000 7fd493fff700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 0x7fd48806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.201+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd48408e320 con 0x7fd49c1038f0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.201+0000 7fd49affd700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 0x7fd48806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.202+0000 7fd49affd700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 0x7fd48806fc90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd48c001490 tx=0x7fd48c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.206+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd48405b830 con 0x7fd49c1038f0 2024-02-20T08:13:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.417+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd49c10f0e0 con 0x7fd48806d7e0 2024-02-20T08:13:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.418+0000 7fd493fff700 1 -- 172.21.15.123:0/2186100485 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd49c10f0e0 con 0x7fd48806d7e0 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 msgr2=0x7fd48806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 0x7fd48806fc90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd48c001490 tx=0x7fd48c00b040 comp rx=0 tx=0).stop 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 msgr2=0x7fd49c113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd484000c00 tx=0x7fd484009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 shutdown_connections 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd48806d7e0 0x7fd48806fc90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd49c102f50 0x7fd49c113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 --2- 172.21.15.123:0/2186100485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd49c1038f0 0x7fd49c113fd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.420+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 >> 172.21.15.123:0/2186100485 conn(0x7fd49c0f8ae0 msgr2=0x7fd49c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.421+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 shutdown_connections 2024-02-20T08:13:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.421+0000 7fd4a16c5700 1 -- 172.21.15.123:0/2186100485 wait complete. 2024-02-20T08:13:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- 172.21.15.123:0/1334543849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 msgr2=0x7f2bec102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 --2- 172.21.15.123:0/1334543849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec102230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009ce0 tx=0x7f2be8004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- 172.21.15.123:0/1334543849 shutdown_connections 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 --2- 172.21.15.123:0/1334543849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 0x7f2bec0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 --2- 172.21.15.123:0/1334543849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec102230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- 172.21.15.123:0/1334543849 >> 172.21.15.123:0/1334543849 conn(0x7f2bec0f7a10 msgr2=0x7f2bec0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- 172.21.15.123:0/1334543849 shutdown_connections 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- 172.21.15.123:0/1334543849 wait complete. 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 Processor -- start 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.522+0000 7f2bf326b700 1 -- start start 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf326b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf326b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 0x7f2bec103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf326b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec103c80 con 0x7f2bec101e60 2024-02-20T08:13:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf326b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec103df0 con 0x7f2bec102800 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49638/0 (socket says 172.21.15.123:49638) 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 -- 172.21.15.123:0/664561885 learned_addr learned my addr 172.21.15.123:0/664561885 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf0806700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 0x7f2bec103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 -- 172.21.15.123:0/664561885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 msgr2=0x7f2bec103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 0x7f2bec103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 -- 172.21.15.123:0/664561885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8009940 con 0x7f2bec101e60 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf1007700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2be800ba50 tx=0x7f2be8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be800e040 con 0x7f2bec101e60 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2be8004610 con 0x7f2bec101e60 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec119d30 con 0x7f2bec101e60 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.523+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be8012b10 con 0x7f2bec101e60 2024-02-20T08:13:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.524+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec11a210 con 0x7f2bec101e60 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.524+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec0fb610 con 0x7f2bec101e60 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.525+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2be801c830 con 0x7f2bec101e60 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.525+0000 7f2be1ffb700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 0x7f2bd806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.525+0000 7f2bf0806700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 0x7f2bd806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.525+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2be808f1e0 con 0x7f2bec101e60 2024-02-20T08:13:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.526+0000 7f2bf0806700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 0x7f2bd806fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bec104ad0 tx=0x7f2bdc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.530+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2be8058a80 con 0x7f2bec101e60 2024-02-20T08:13:15.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.731+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bec065f50 con 0x7f2bd806d7e0 2024-02-20T08:13:15.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.742+0000 7f2be1ffb700 1 -- 172.21.15.123:0/664561885 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2bec065f50 con 0x7f2bd806d7e0 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (5m) 70s ago 16m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (2m) 70s ago 17m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (2m) 4s ago 15m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (4m) 70s ago 16m 80.3M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (11m) 70s ago 11m 14.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (10m) 70s ago 10m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (11m) 4s ago 11m 17.4M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (10m) 4s ago 10m 15.3M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (7m) 70s ago 18m 503M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (6m) 4s ago 15m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:13:15.743 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (3m) 70s ago 18m 47.7M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (3m) 4s ago 15m 41.7M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (5m) 70s ago 17m 17.2M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 4s ago 15m 15.5M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (2m) 70s ago 14m 85.2M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (112s) 70s ago 14m 81.7M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (76s) 70s ago 13m 12.6M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (40s) 4s ago 13m 100M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (7s) 4s ago 12m 15.1M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (12m) 4s ago 12m 199M 2581M 17.2.7-521-gc80e7168 10b0c032c913 9979fc6ea190 2024-02-20T08:13:15.744 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (5m) 70s ago 16m 57.1M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 msgr2=0x7f2bd806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 0x7f2bd806fc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bec104ad0 tx=0x7f2bdc00b040 comp rx=0 tx=0).stop 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 msgr2=0x7f2bec1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2be800ba50 tx=0x7f2be8004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 shutdown_connections 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2bd806d7e0 0x7f2bd806fc90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bec101e60 0x7f2bec1030d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 --2- 172.21.15.123:0/664561885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bec102800 0x7f2bec103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.744+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 >> 172.21.15.123:0/664561885 conn(0x7f2bec0f7a10 msgr2=0x7f2bec105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.745+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 shutdown_connections 2024-02-20T08:13:15.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.745+0000 7f2bf326b700 1 -- 172.21.15.123:0/664561885 wait complete. 2024-02-20T08:13:15.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/3241970318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 msgr2=0x7f1dcc0fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/3241970318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc0fcee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc004940 tx=0x7f1dbc009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/3241970318 shutdown_connections 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/3241970318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc0fcee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/3241970318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 0x7f1dcc1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/3241970318 >> 172.21.15.123:0/3241970318 conn(0x7f1dcc0f8a40 msgr2=0x7f1dcc0fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/3241970318 shutdown_connections 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/3241970318 wait complete. 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.853+0000 7f1dd2fd7700 1 Processor -- start 2024-02-20T08:13:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd2fd7700 1 -- start start 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd2fd7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 0x7f1dcc113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd2fd7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd2fd7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1144e0 con 0x7f1dcc103870 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd2fd7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc10d810 con 0x7f1dcc102ed0 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49654/0 (socket says 172.21.15.123:49654) 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 -- 172.21.15.123:0/4072720621 learned_addr learned my addr 172.21.15.123:0/4072720621 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dd0d73700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 0x7f1dcc113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 -- 172.21.15.123:0/4072720621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 msgr2=0x7f1dcc113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 0x7f1dcc113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 -- 172.21.15.123:0/4072720621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc005040 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.854+0000 7f1dcbfff700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc000c00 tx=0x7f1dbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.855+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dbc021070 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.855+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc10da90 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.855+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1dbc013dd0 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.855+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dbc00e070 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.855+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc10df70 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.856+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc0fc660 con 0x7f1dcc103870 2024-02-20T08:13:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.856+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1dbc01cbf0 con 0x7f1dcc103870 2024-02-20T08:13:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.857+0000 7f1dc97fa700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 0x7f1db806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.857+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1dbc08e470 con 0x7f1dcc103870 2024-02-20T08:13:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.857+0000 7f1dd0d73700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 0x7f1db806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.857+0000 7f1dd0d73700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 0x7f1db806fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4004b50 tx=0x7f1dc400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:15.861+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1dbc05b8c0 con 0x7f1dcc103870 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: pgmap v132: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: failed to encode map e73 with expected crc 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: from='osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: osdmap e73: 6 total, 5 up, 6 in 2024-02-20T08:13:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:15 smithi123 ceph-mon[112409]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: pgmap v132: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 255 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: failed to encode map e73 with expected crc 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: from='osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: osdmap e73: 6 total, 5 up, 6 in 2024-02-20T08:13:16.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:15 smithi194 ceph-mon[88937]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:16.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.135+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1dcc04bed0 con 0x7f1dcc103870 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.136+0000 7f1dc97fa700 1 -- 172.21.15.123:0/4072720621 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f1dbc05b450 con 0x7f1dcc103870 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:16.136 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 5 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 5, 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 9 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:13:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 msgr2=0x7f1db806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 0x7f1db806fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4004b50 tx=0x7f1dc400b040 comp rx=0 tx=0).stop 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 msgr2=0x7f1dcc113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc000c00 tx=0x7f1dbc009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 shutdown_connections 2024-02-20T08:13:16.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1db806d7e0 0x7f1db806fc90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dcc102ed0 0x7f1dcc113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 --2- 172.21.15.123:0/4072720621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dcc103870 0x7f1dcc113e90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 >> 172.21.15.123:0/4072720621 conn(0x7f1dcc0f8a40 msgr2=0x7f1dcc0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 shutdown_connections 2024-02-20T08:13:16.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.138+0000 7f1dd2fd7700 1 -- 172.21.15.123:0/4072720621 wait complete. 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 -- 172.21.15.123:0/3369344445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 msgr2=0x7f1258103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 --2- 172.21.15.123:0/3369344445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258103320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1248004940 tx=0x7f1248009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 -- 172.21.15.123:0/3369344445 shutdown_connections 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 --2- 172.21.15.123:0/3369344445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 0x7f12580fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 --2- 172.21.15.123:0/3369344445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258103320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 -- 172.21.15.123:0/3369344445 >> 172.21.15.123:0/3369344445 conn(0x7f12580f8ae0 msgr2=0x7f12580faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 -- 172.21.15.123:0/3369344445 shutdown_connections 2024-02-20T08:13:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.239+0000 7f125e719700 1 -- 172.21.15.123:0/3369344445 wait complete. 2024-02-20T08:13:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 Processor -- start 2024-02-20T08:13:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 -- start start 2024-02-20T08:13:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 0x7f1258113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12581145f0 con 0x7f1258102f50 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.240+0000 7f125e719700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125810d920 con 0x7f12581038f0 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49664/0 (socket says 172.21.15.123:49664) 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 -- 172.21.15.123:0/1419557892 learned_addr learned my addr 172.21.15.123:0/1419557892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f12577fe700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 0x7f1258113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 -- 172.21.15.123:0/1419557892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 msgr2=0x7f1258113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 0x7f1258113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 -- 172.21.15.123:0/1419557892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248005040 con 0x7f1258102f50 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1257fff700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f124800b3b0 tx=0x7f1248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124800e040 con 0x7f1258102f50 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f124800bbf0 con 0x7f1258102f50 2024-02-20T08:13:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124801c3f0 con 0x7f1258102f50 2024-02-20T08:13:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125810dba0 con 0x7f1258102f50 2024-02-20T08:13:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.241+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125810e0e0 con 0x7f1258102f50 2024-02-20T08:13:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.242+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1258100260 con 0x7f1258102f50 2024-02-20T08:13:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.243+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f124800bd60 con 0x7f1258102f50 2024-02-20T08:13:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.243+0000 7f1254ff9700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 0x7f124006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.243+0000 7f12577fe700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 0x7f124006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.243+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f124808e1d0 con 0x7f1258102f50 2024-02-20T08:13:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.244+0000 7f12577fe700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 0x7f124006fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f125810f290 tx=0x7f124c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.248+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f124805b620 con 0x7f1258102f50 2024-02-20T08:13:16.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.486+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f125804bed0 con 0x7f1258102f50 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.486+0000 7f1254ff9700 1 -- 172.21.15.123:0/1419557892 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f124805b1b0 con 0x7f1258102f50 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:13:16.487 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:13:16.488 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:13:16.489 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:16.490 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:16.490 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:16.490 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:16.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.489+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 msgr2=0x7f124006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.489+0000 7f125e719700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 0x7f124006fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f125810f290 tx=0x7f124c00b040 comp rx=0 tx=0).stop 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.489+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 msgr2=0x7f1258113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.489+0000 7f125e719700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f124800b3b0 tx=0x7f1248009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 shutdown_connections 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f124006d7e0 0x7f124006fc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258102f50 0x7f1258113a60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 --2- 172.21.15.123:0/1419557892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12581038f0 0x7f1258113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 >> 172.21.15.123:0/1419557892 conn(0x7f12580f8ae0 msgr2=0x7f12580fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 shutdown_connections 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.490+0000 7f125e719700 1 -- 172.21.15.123:0/1419557892 wait complete. 2024-02-20T08:13:16.491 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 -- 172.21.15.123:0/1314645117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 msgr2=0x7f179c1033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/1314645117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c1033b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f178c004940 tx=0x7f178c009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 -- 172.21.15.123:0/1314645117 shutdown_connections 2024-02-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/1314645117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 0x7f179c0fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/1314645117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c1033b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.599+0000 7f17a0d9e700 1 -- 172.21.15.123:0/1314645117 >> 172.21.15.123:0/1314645117 conn(0x7f179c071500 msgr2=0x7f179c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 -- 172.21.15.123:0/1314645117 shutdown_connections 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 -- 172.21.15.123:0/1314645117 wait complete. 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 Processor -- start 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 -- start start 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 0x7f179c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c114610 con 0x7f179c102fe0 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f17a0d9e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c10d940 con 0x7f179c0fb560 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f1799d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f1799d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49686/0 (socket says 172.21.15.123:49686) 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.600+0000 7f1799d9b700 1 -- 172.21.15.123:0/3584751979 learned_addr learned my addr 172.21.15.123:0/3584751979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f179a59c700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 0x7f179c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f1799d9b700 1 -- 172.21.15.123:0/3584751979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 msgr2=0x7f179c113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f1799d9b700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 0x7f179c113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f1799d9b700 1 -- 172.21.15.123:0/3584751979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c005040 con 0x7f179c102fe0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f1799d9b700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f179000eb40 tx=0x7f179000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1790007cc0 con 0x7f179c102fe0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f179000f040 con 0x7f179c102fe0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c10dbc0 con 0x7f179c102fe0 2024-02-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f179000ca10 con 0x7f179c102fe0 2024-02-20T08:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.601+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c10e100 con 0x7f179c102fe0 2024-02-20T08:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.602+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c100290 con 0x7f179c102fe0 2024-02-20T08:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.603+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f179000cc80 con 0x7f179c102fe0 2024-02-20T08:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.603+0000 7f178affd700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 0x7f178406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.603+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f179008ca30 con 0x7f179c102fe0 2024-02-20T08:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.603+0000 7f179a59c700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 0x7f178406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.603+0000 7f179a59c700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 0x7f178406fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f178c009b30 tx=0x7f178c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.607+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1790059eb0 con 0x7f179c102fe0 2024-02-20T08:13:16.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.839+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f179c10a130 con 0x7f178406d7e0 2024-02-20T08:13:16.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.841+0000 7f178affd700 1 -- 172.21.15.123:0/3584751979 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f179c10a130 con 0x7f178406d7e0 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "11/21 daemons upgraded", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:13:16.841 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:13:16.842 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:13:16.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 msgr2=0x7f178406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 0x7f178406fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f178c009b30 tx=0x7f178c009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:16.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 msgr2=0x7f179c113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f179000eb40 tx=0x7f179000b040 comp rx=0 tx=0).stop 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 shutdown_connections 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f178406d7e0 0x7f178406fc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f179c0fb560 0x7f179c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 --2- 172.21.15.123:0/3584751979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f179c102fe0 0x7f179c113fc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 >> 172.21.15.123:0/3584751979 conn(0x7f179c071500 msgr2=0x7f179c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 shutdown_connections 2024-02-20T08:13:16.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.843+0000 7f17a0d9e700 1 -- 172.21.15.123:0/3584751979 wait complete. 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- 172.21.15.123:0/3787643564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 msgr2=0x7f5634102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 --2- 172.21.15.123:0/3787643564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f5634102230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5630009ce0 tx=0x7f5630004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- 172.21.15.123:0/3787643564 shutdown_connections 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 --2- 172.21.15.123:0/3787643564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f56340fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 --2- 172.21.15.123:0/3787643564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f5634102230 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- 172.21.15.123:0/3787643564 >> 172.21.15.123:0/3787643564 conn(0x7f5634071500 msgr2=0x7f5634071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- 172.21.15.123:0/3787643564 shutdown_connections 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- 172.21.15.123:0/3787643564 wait complete. 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 Processor -- start 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.943+0000 7f563b0f0700 1 -- start start 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f563410f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563410f7c0 con 0x7f5634101e60 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563410f930 con 0x7f5634102800 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49718/0 (socket says 172.21.15.123:49718) 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 -- 172.21.15.123:0/958805925 learned_addr learned my addr 172.21.15.123:0/958805925 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f562bfff700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f563410f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 -- 172.21.15.123:0/958805925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 msgr2=0x7f563410f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f563410f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 -- 172.21.15.123:0/958805925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009940 con 0x7f5634101e60 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f562bfff700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f563410f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f5638e8c700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f563000bf90 tx=0x7f5630004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563000e040 con 0x7f5634101e60 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56300128e0 con 0x7f5634101e60 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634117c20 con 0x7f5634101e60 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563001c8d0 con 0x7f5634101e60 2024-02-20T08:13:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.944+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5634118130 con 0x7f5634101e60 2024-02-20T08:13:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.945+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340754c0 con 0x7f5634101e60 2024-02-20T08:13:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.946+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5630012410 con 0x7f5634101e60 2024-02-20T08:13:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.946+0000 7f56297fa700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 0x7f561c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.946+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f563008e9b0 con 0x7f5634101e60 2024-02-20T08:13:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.946+0000 7f562bfff700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 0x7f561c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:16.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.947+0000 7f562bfff700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 0x7f561c06fc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5624006fd0 tx=0x7f5624008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:16.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:16.951+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f56300582d0 con 0x7f5634101e60 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: failed to encode map e74 with expected crc 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365] boot 2024-02-20T08:13:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: osdmap e74: 6 total, 6 up, 6 in 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: failed to encode map e74 with expected crc 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/4072720621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1419557892' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.222+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5634118370 con 0x7f5634101e60 2024-02-20T08:13:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.223+0000 7f56297fa700 1 -- 172.21.15.123:0/958805925 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1207 (secure 0 0 0) 0x7f56300204d0 con 0x7f5634101e60 2024-02-20T08:13:17.223 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.223 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.223 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: failed to encode map e74 with expected crc 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: osd.4 [v2:172.21.15.194:6808/1371659365,v1:172.21.15.194:6809/1371659365] boot 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: osdmap e74: 6 total, 6 up, 6 in 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: failed to encode map e74 with expected crc 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/4072720621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1419557892' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:17.224 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:17.225 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:17.225 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-02-20T08:13:17.225 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:13:17.225 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:13:17.225 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-20T08:13:17.226 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 msgr2=0x7f561c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 0x7f561c06fc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5624006fd0 tx=0x7f5624008040 comp rx=0 tx=0).stop 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 msgr2=0x7f563410ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f563000bf90 tx=0x7f5630004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 shutdown_connections 2024-02-20T08:13:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f561c06d7e0 0x7f561c06fc90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5634101e60 0x7f563410ec60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 --2- 172.21.15.123:0/958805925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5634102800 0x7f563410f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 >> 172.21.15.123:0/958805925 conn(0x7f5634071500 msgr2=0x7f56340fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 shutdown_connections 2024-02-20T08:13:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:17.225+0000 7f563b0f0700 1 -- 172.21.15.123:0/958805925 wait complete. 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: pgmap v135: 65 pgs: 4 peering, 14 active+undersized+degraded, 16 active+undersized, 31 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: osdmap e75: 6 total, 6 up, 6 in 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/958805925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:13:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:17 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: pgmap v135: 65 pgs: 4 peering, 14 active+undersized+degraded, 16 active+undersized, 31 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: osdmap e75: 6 total, 6 up, 6 in 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: failed to encode map e75 with expected crc 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/958805925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:13:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:17 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:18 smithi194 ceph-mon[88937]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:18 smithi123 ceph-mon[112409]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:19 smithi194 ceph-mon[88937]: pgmap v137: 65 pgs: 4 peering, 6 active+undersized+degraded, 8 active+undersized, 47 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 12/264 objects degraded (4.545%) 2024-02-20T08:13:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:19 smithi123 ceph-mon[112409]: pgmap v137: 65 pgs: 4 peering, 6 active+undersized+degraded, 8 active+undersized, 47 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 12/264 objects degraded (4.545%) 2024-02-20T08:13:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:20 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/264 objects degraded (4.545%), 6 pgs degraded) 2024-02-20T08:13:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:20 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/264 objects degraded (4.545%), 6 pgs degraded) 2024-02-20T08:13:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:21 smithi194 ceph-mon[88937]: pgmap v138: 65 pgs: 4 peering, 61 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:21 smithi123 ceph-mon[112409]: pgmap v138: 65 pgs: 4 peering, 61 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:22 smithi194 ceph-mon[88937]: pgmap v139: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:22 smithi123 ceph-mon[112409]: pgmap v139: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:25 smithi123 ceph-mon[112409]: pgmap v140: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:26.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:25 smithi194 ceph-mon[88937]: pgmap v140: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:28.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:27 smithi123 ceph-mon[112409]: pgmap v141: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:27 smithi194 ceph-mon[88937]: pgmap v141: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:30.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:29 smithi123 ceph-mon[112409]: pgmap v142: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:29 smithi194 ceph-mon[88937]: pgmap v142: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:31 smithi123 ceph-mon[112409]: pgmap v143: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:31 smithi194 ceph-mon[88937]: pgmap v143: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:32 smithi194 ceph-mon[88937]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:32 smithi194 ceph-mon[88937]: Upgrade: osd.5 is safe to restart 2024-02-20T08:13:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:32 smithi123 ceph-mon[112409]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-20T08:13:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:32 smithi123 ceph-mon[112409]: Upgrade: osd.5 is safe to restart 2024-02-20T08:13:33.993 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:33 smithi194 ceph-mon[88937]: pgmap v144: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:33.993 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:33.993 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:13:33.993 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:33 smithi123 ceph-mon[112409]: pgmap v144: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-20T08:13:34.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:34 smithi194 ceph-mon[88937]: Upgrade: Updating osd.5 2024-02-20T08:13:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:34 smithi194 ceph-mon[88937]: Deploying daemon osd.5 on smithi194 2024-02-20T08:13:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:34 smithi123 ceph-mon[112409]: Upgrade: Updating osd.5 2024-02-20T08:13:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:34 smithi123 ceph-mon[112409]: Deploying daemon osd.5 on smithi194 2024-02-20T08:13:36.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:35 smithi123 ceph-mon[112409]: pgmap v145: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:36.137 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:35 smithi194 ceph-mon[88937]: pgmap v145: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:36.772 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:36 smithi194 systemd[1]: Stopping Ceph osd.5 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:13:37.144 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:36 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[57175]: 2024-02-20T08:13:36.771+0000 7fc3e6f9c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T08:13:37.144 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:36 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[57175]: 2024-02-20T08:13:36.771+0000 7fc3e6f9c700 -1 osd.5 75 *** Got signal Terminated *** 2024-02-20T08:13:37.144 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:36 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[57175]: 2024-02-20T08:13:36.771+0000 7fc3e6f9c700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T08:13:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:37 smithi123 ceph-mon[112409]: pgmap v146: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:37 smithi123 ceph-mon[112409]: osd.5 marked itself down and dead 2024-02-20T08:13:38.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:37 smithi194 ceph-mon[88937]: pgmap v146: 65 pgs: 65 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:38.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:37 smithi194 ceph-mon[88937]: osd.5 marked itself down and dead 2024-02-20T08:13:38.384 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:38 smithi194 podman[107885]: 2024-02-20 08:13:38.104696566 +0000 UTC m=+1.443030828 container died 9979fc6ea1908962850025c5f3c0406cb7073d80c2543d3791560bb1a311ad8f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-c80e716, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:38.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:38 smithi194 podman[107885]: 2024-02-20 08:13:38.482681093 +0000 UTC m=+1.821015368 container cleanup 9979fc6ea1908962850025c5f3c0406cb7073d80c2543d3791560bb1a311ad8f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c80e716, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-20T08:13:38.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:38 smithi194 bash[107885]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5 2024-02-20T08:13:39.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:38 smithi123 ceph-mon[112409]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:13:39.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:38 smithi123 ceph-mon[112409]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-20T08:13:39.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:38 smithi123 ceph-mon[112409]: osdmap e76: 6 total, 5 up, 6 in 2024-02-20T08:13:39.092 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:38 smithi194 ceph-mon[88937]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-20T08:13:39.092 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:38 smithi194 ceph-mon[88937]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-20T08:13:39.092 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:38 smithi194 ceph-mon[88937]: osdmap e76: 6 total, 5 up, 6 in 2024-02-20T08:13:39.093 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:38 smithi194 podman[107914]: 2024-02-20 08:13:38.742281521 +0000 UTC m=+0.632332273 container remove 9979fc6ea1908962850025c5f3c0406cb7073d80c2543d3791560bb1a311ad8f (image=quay.ceph.io/ceph-ci/ceph@sha256:479114d4af9dd6c9b2771de62c79e08a4e4ba3cecb535f7d44dca6fc106bb04b, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-c80e716, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-20T08:13:39.378 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:39.093197063 +0000 UTC m=+0.112433575 container create e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-20T08:13:39.378 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:38.999323996 +0000 UTC m=+0.018560516 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:39.378 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:39.304297774 +0000 UTC m=+0.323534300 container init e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-20T08:13:39.378 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:39.307770485 +0000 UTC m=+0.327007015 container start e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T08:13:39.378 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:39.378543758 +0000 UTC m=+0.397780297 container attach e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-20T08:13:39.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:39 smithi194 podman[108008]: 2024-02-20 08:13:39.598251201 +0000 UTC m=+0.617487717 container died e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-20T08:13:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:39 smithi194 ceph-mon[88937]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:39 smithi194 ceph-mon[88937]: osdmap e77: 6 total, 5 up, 6 in 2024-02-20T08:13:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:39 smithi123 ceph-mon[112409]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-20T08:13:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:39 smithi123 ceph-mon[112409]: osdmap e77: 6 total, 5 up, 6 in 2024-02-20T08:13:40.601 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108034]: 2024-02-20 08:13:40.165424548 +0000 UTC m=+0.562296617 container remove e59adf296122c8c15e6c44cff01632d043108aca926fe3b54ddee150cea2ea9c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:40.601 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-20T08:13:40.601 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 systemd[1]: Stopped Ceph osd.5 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:13:40.601 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 systemd[1]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.5.service: Consumed 53.008s CPU time. 2024-02-20T08:13:40.601 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 systemd[1]: Starting Ceph osd.5 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T08:13:40.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108140]: 2024-02-20 08:13:40.504098649 +0000 UTC m=+0.019401729 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:40.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108140]: 2024-02-20 08:13:40.649997933 +0000 UTC m=+0.165301001 container create 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 5]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.f", "id": [3, 2]}]: dispatch 2024-02-20T08:13:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0, 1, 2]}]: dispatch 2024-02-20T08:13:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-02-20T08:13:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 5]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.f", "id": [3, 2]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0, 1, 2]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:41.346 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108140]: 2024-02-20 08:13:40.907539489 +0000 UTC m=+0.422842558 container init 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:13:41.346 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108140]: 2024-02-20 08:13:40.910619462 +0000 UTC m=+0.425922534 container start 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-20T08:13:41.346 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:40 smithi194 podman[108140]: 2024-02-20 08:13:40.985846774 +0000 UTC m=+0.501149851 container attach 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:13:41.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-20T08:13:41.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-20T08:13:41.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-20T08:13:41.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-20T08:13:41.644 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 bash[108140]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate[108155]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-20T08:13:41.645 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:41 smithi194 podman[108140]: 2024-02-20 08:13:41.370813676 +0000 UTC m=+0.886116751 container died 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: pgmap v150: 65 pgs: 7 active+undersized+degraded, 5 stale+active+clean, 8 active+undersized, 45 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 18/264 objects degraded (6.818%) 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: Health check failed: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 5]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]': finished 2024-02-20T08:13:42.073 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.f", "id": [3, 2]}]': finished 2024-02-20T08:13:42.074 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0, 1, 2]}]': finished 2024-02-20T08:13:42.074 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-02-20T08:13:42.074 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:41 smithi194 ceph-mon[88937]: osdmap e78: 6 total, 5 up, 6 in 2024-02-20T08:13:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: pgmap v150: 65 pgs: 7 active+undersized+degraded, 5 stale+active+clean, 8 active+undersized, 45 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 18/264 objects degraded (6.818%) 2024-02-20T08:13:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: Health check failed: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 5]}]': finished 2024-02-20T08:13:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 5]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.f", "id": [3, 2]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0, 1, 2]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-02-20T08:13:42.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:41 smithi123 ceph-mon[112409]: osdmap e78: 6 total, 5 up, 6 in 2024-02-20T08:13:42.394 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 podman[108284]: 2024-02-20 08:13:42.073217008 +0000 UTC m=+0.697567459 container remove 3ba8ad77f2d97e332b75dba9cae80d4057f193b8903a175d7c2bbd6ffeef34f1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-activate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS) 2024-02-20T08:13:42.394 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 podman[108346]: 2024-02-20 08:13:42.193376759 +0000 UTC m=+0.018115140 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T08:13:42.394 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 podman[108346]: 2024-02-20 08:13:42.321627124 +0000 UTC m=+0.146365496 container create 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-20T08:13:42.785 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 podman[108346]: 2024-02-20 08:13:42.551240757 +0000 UTC m=+0.375979132 container init 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T08:13:42.785 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 podman[108346]: 2024-02-20 08:13:42.554360882 +0000 UTC m=+0.379099262 container start 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-20T08:13:42.785 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 ceph-osd[108365]: -- 172.21.15.194:0/4086409552 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5610dcc9b1e0 con 0x5610dcc6cc00 2024-02-20T08:13:42.785 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 bash[108346]: 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 2024-02-20T08:13:42.785 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:42 smithi194 systemd[1]: Started Ceph osd.5 for 1f99de10-cfc5-11ee-95bb-87774f69a715. 2024-02-20T08:13:43.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:42 smithi194 ceph-mon[88937]: osdmap e79: 6 total, 5 up, 6 in 2024-02-20T08:13:43.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:43.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:43.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:42 smithi123 ceph-mon[112409]: osdmap e79: 6 total, 5 up, 6 in 2024-02-20T08:13:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:43.393 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:43 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T08:13:43.096+0000 7fa6357bb7c0 -1 Falling back to public interface 2024-02-20T08:13:43.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:43 smithi194 ceph-mon[88937]: pgmap v153: 65 pgs: 3 remapped+peering, 13 active+undersized+degraded, 1 stale+active+clean, 13 active+undersized, 35 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-20T08:13:43.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:43 smithi194 ceph-mon[88937]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-20T08:13:43.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:43 smithi194 ceph-mon[88937]: osdmap e80: 6 total, 5 up, 6 in 2024-02-20T08:13:44.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:43 smithi123 ceph-mon[112409]: pgmap v153: 65 pgs: 3 remapped+peering, 13 active+undersized+degraded, 1 stale+active+clean, 13 active+undersized, 35 active+clean; 255 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-20T08:13:44.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:43 smithi123 ceph-mon[112409]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-20T08:13:44.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:43 smithi123 ceph-mon[112409]: osdmap e80: 6 total, 5 up, 6 in 2024-02-20T08:13:45.109 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:44 smithi194 ceph-mon[88937]: osdmap e81: 6 total, 5 up, 6 in 2024-02-20T08:13:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:44 smithi123 ceph-mon[112409]: osdmap e81: 6 total, 5 up, 6 in 2024-02-20T08:13:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:45 smithi194 ceph-mon[88937]: pgmap v156: 65 pgs: 1 active+undersized+remapped, 3 active+clean+remapped, 3 remapped+peering, 13 active+undersized+degraded, 13 active+undersized, 32 active+clean; 255 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%); 7/264 objects misplaced (2.652%); 0 B/s, 109 objects/s recovering 2024-02-20T08:13:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:45 smithi194 ceph-mon[88937]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-20T08:13:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:45 smithi194 ceph-mon[88937]: osdmap e82: 6 total, 5 up, 6 in 2024-02-20T08:13:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:45 smithi123 ceph-mon[112409]: pgmap v156: 65 pgs: 1 active+undersized+remapped, 3 active+clean+remapped, 3 remapped+peering, 13 active+undersized+degraded, 13 active+undersized, 32 active+clean; 255 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%); 7/264 objects misplaced (2.652%); 0 B/s, 109 objects/s recovering 2024-02-20T08:13:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:45 smithi123 ceph-mon[112409]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-20T08:13:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:45 smithi123 ceph-mon[112409]: osdmap e82: 6 total, 5 up, 6 in 2024-02-20T08:13:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:47.327 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T08:13:47.021+0000 7fa6357bb7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-20T08:13:47.327 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T08:13:47.326+0000 7fa6357bb7c0 -1 osd.5 75 log_to_monitors true 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- 172.21.15.123:0/3901429336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 msgr2=0x7f4cec0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/3901429336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0fcf50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0004940 tx=0x7f4ce0009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- 172.21.15.123:0/3901429336 shutdown_connections 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/3901429336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0fcf50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/3901429336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 0x7f4cec103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- 172.21.15.123:0/3901429336 >> 172.21.15.123:0/3901429336 conn(0x7f4cec0f8af0 msgr2=0x7f4cec0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- 172.21.15.123:0/3901429336 shutdown_connections 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- 172.21.15.123:0/3901429336 wait complete. 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 Processor -- start 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.340+0000 7f4cf0e96700 1 -- start start 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 0x7f4cec070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec070dd0 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec070f40 con 0x7f4cec102f40 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51626/0 (socket says 172.21.15.123:51626) 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 -- 172.21.15.123:0/1966671149 learned_addr learned my addr 172.21.15.123:0/1966671149 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cea59c700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 0x7f4cec070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 -- 172.21.15.123:0/1966671149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 msgr2=0x7f4cec070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 0x7f4cec070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 -- 172.21.15.123:0/1966671149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0005040 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4ce9d9b700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009030 tx=0x7f4ce0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce000e040 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ce0009400 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec119cc0 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce001c3f0 con 0x7f4cec1038e0 2024-02-20T08:13:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.341+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec11a120 con 0x7f4cec1038e0 2024-02-20T08:13:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.342+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0fc6f0 con 0x7f4cec1038e0 2024-02-20T08:13:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.343+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4ce000bbf0 con 0x7f4cec1038e0 2024-02-20T08:13:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.343+0000 7f4cdaffd700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 0x7f4cd406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.343+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f4ce008e3d0 con 0x7f4cec1038e0 2024-02-20T08:13:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.343+0000 7f4cea59c700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 0x7f4cd406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.344+0000 7f4cea59c700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 0x7f4cd406fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009fd0 tx=0x7f4cdc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.348+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4ce0057ae0 con 0x7f4cec1038e0 2024-02-20T08:13:47.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.563+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cec071a70 con 0x7f4cd406d7f0 2024-02-20T08:13:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.565+0000 7f4cdaffd700 1 -- 172.21.15.123:0/1966671149 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4cec071a70 con 0x7f4cd406d7f0 2024-02-20T08:13:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 msgr2=0x7f4cd406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 0x7f4cd406fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009fd0 tx=0x7f4cdc00b040 comp rx=0 tx=0).stop 2024-02-20T08:13:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 msgr2=0x7f4cec0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009030 tx=0x7f4ce0009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 shutdown_connections 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4cd406d7f0 0x7f4cd406fca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec102f40 0x7f4cec070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 --2- 172.21.15.123:0/1966671149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cec1038e0 0x7f4cec0707d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 >> 172.21.15.123:0/1966671149 conn(0x7f4cec0f8af0 msgr2=0x7f4cec0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 shutdown_connections 2024-02-20T08:13:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.567+0000 7f4cf0e96700 1 -- 172.21.15.123:0/1966671149 wait complete. 2024-02-20T08:13:47.578 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 -- 172.21.15.123:0/2538353371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5400fb570 msgr2=0x7fd5400fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 --2- 172.21.15.123:0/2538353371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5400fb570 0x7fd5400fb9c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd530004940 tx=0x7fd530009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 -- 172.21.15.123:0/2538353371 shutdown_connections 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 --2- 172.21.15.123:0/2538353371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5400fb570 0x7fd5400fb9c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 --2- 172.21.15.123:0/2538353371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd540103140 0x7fd540103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 -- 172.21.15.123:0/2538353371 >> 172.21.15.123:0/2538353371 conn(0x7fd540071560 msgr2=0x7fd540071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:47.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 -- 172.21.15.123:0/2538353371 shutdown_connections 2024-02-20T08:13:47.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.670+0000 7fd54791b700 1 -- 172.21.15.123:0/2538353371 wait complete. 2024-02-20T08:13:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 Processor -- start 2024-02-20T08:13:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 -- start start 2024-02-20T08:13:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5400fb570 0x7fd5400fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400fd290 con 0x7fd540103140 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd54791b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400fd400 con 0x7fd5400fb570 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51646/0 (socket says 172.21.15.123:51646) 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 -- 172.21.15.123:0/3162143359 learned_addr learned my addr 172.21.15.123:0/3162143359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd5456b7700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5400fb570 0x7fd5400fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 -- 172.21.15.123:0/3162143359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5400fb570 msgr2=0x7fd5400fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5400fb570 0x7fd5400fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.671+0000 7fd544eb6700 1 -- 172.21.15.123:0/3162143359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530005040 con 0x7fd540103140 2024-02-20T08:13:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.672+0000 7fd544eb6700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd530009b30 tx=0x7fd530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.673+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd530021070 con 0x7fd540103140 2024-02-20T08:13:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.673+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd530013e50 con 0x7fd540103140 2024-02-20T08:13:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.673+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd540119dd0 con 0x7fd540103140 2024-02-20T08:13:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.673+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53000e070 con 0x7fd540103140 2024-02-20T08:13:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.673+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54011a230 con 0x7fd540103140 2024-02-20T08:13:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.675+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5401054d0 con 0x7fd540103140 2024-02-20T08:13:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.675+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd53001c400 con 0x7fd540103140 2024-02-20T08:13:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.675+0000 7fd535ffb700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 0x7fd52c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.675+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6861+0+0 (secure 0 0 0) 0x7fd53008e460 con 0x7fd540103140 2024-02-20T08:13:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.675+0000 7fd5456b7700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 0x7fd52c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:47.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.676+0000 7fd5456b7700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 0x7fd52c06fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd53c004600 tx=0x7fd53c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.683+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd530057c10 con 0x7fd540103140 2024-02-20T08:13:47.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.895+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd54010a250 con 0x7fd52c06d7e0 2024-02-20T08:13:47.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.896+0000 7fd535ffb700 1 -- 172.21.15.123:0/3162143359 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd53c009420 con 0x7fd52c06d7e0 2024-02-20T08:13:47.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 msgr2=0x7fd52c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 0x7fd52c06fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd53c004600 tx=0x7fd53c00b040 comp rx=0 tx=0).stop 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 msgr2=0x7fd5400fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd530009b30 tx=0x7fd530009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 shutdown_connections 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd52c06d7e0 0x7fd52c06fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5400fb570 0x7fd5400fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 --2- 172.21.15.123:0/3162143359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd540103140 0x7fd5400fcc90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 >> 172.21.15.123:0/3162143359 conn(0x7fd540071560 msgr2=0x7fd5400f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 shutdown_connections 2024-02-20T08:13:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.898+0000 7fd54791b700 1 -- 172.21.15.123:0/3162143359 wait complete. 2024-02-20T08:13:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 -- 172.21.15.123:0/3744935931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe390102f50 msgr2=0x7fe390103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 --2- 172.21.15.123:0/3744935931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe390102f50 0x7fe390103320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe388009ce0 tx=0x7fe388004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 -- 172.21.15.123:0/3744935931 shutdown_connections 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 --2- 172.21.15.123:0/3744935931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3901038f0 0x7fe3900fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 --2- 172.21.15.123:0/3744935931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe390102f50 0x7fe390103320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 -- 172.21.15.123:0/3744935931 >> 172.21.15.123:0/3744935931 conn(0x7fe3900f8ae0 msgr2=0x7fe3900faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 -- 172.21.15.123:0/3744935931 shutdown_connections 2024-02-20T08:13:48.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:47.999+0000 7fe395a5d700 1 -- 172.21.15.123:0/3744935931 wait complete. 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: pgmap v158: 65 pgs: 1 active+undersized+remapped, 3 active+clean+remapped, 4 remapped+peering, 12 active+undersized+degraded, 13 active+undersized, 32 active+clean; 255 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%); 7/264 objects misplaced (2.652%); 4.1 MiB/s, 0 keys/s, 91 objects/s recovering 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: from='osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:13:48.040 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:47 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:48.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 Processor -- start 2024-02-20T08:13:48.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 -- start start 2024-02-20T08:13:48.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390102f50 0x7fe390070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390070dd0 con 0x7fe3901038f0 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe395a5d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390070f40 con 0x7fe390102f50 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51668/0 (socket says 172.21.15.123:51668) 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 -- 172.21.15.123:0/1022622609 learned_addr learned my addr 172.21.15.123:0/1022622609 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38effd700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390102f50 0x7fe390070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 -- 172.21.15.123:0/1022622609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390102f50 msgr2=0x7fe390070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390102f50 0x7fe390070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.000+0000 7fe38e7fc700 1 -- 172.21.15.123:0/1022622609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009940 con 0x7fe3901038f0 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe38e7fc700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe378002a50 tx=0x7fe3780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe378007cc0 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe390119db0 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe37800f040 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39011a290 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.001+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37800db30 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.002+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900fc6e0 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.003+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe37800dc90 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.003+0000 7fe3877fe700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 0x7fe37c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.003+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6861+0+0 (secure 0 0 0) 0x7fe37808ce20 con 0x7fe3901038f0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.003+0000 7fe38effd700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 0x7fe37c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.004+0000 7fe38effd700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 0x7fe37c06fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe388003400 tx=0x7fe388004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.008+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe3780564b0 con 0x7fe3901038f0 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: pgmap v158: 65 pgs: 1 active+undersized+remapped, 3 active+clean+remapped, 4 remapped+peering, 12 active+undersized+degraded, 13 active+undersized, 32 active+clean; 255 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%); 7/264 objects misplaced (2.652%); 4.1 MiB/s, 0 keys/s, 91 objects/s recovering 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: from='osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-20T08:13:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:47 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:48.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.212+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe390071a70 con 0x7fe37c06d7e0 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.222+0000 7fe3877fe700 1 -- 172.21.15.123:0/1022622609 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe390071a70 con 0x7fe37c06d7e0 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (5m) 103s ago 17m 28.7M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (3m) 103s ago 17m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (3m) 2s ago 16m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (5m) 103s ago 16m 80.3M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (11m) 103s ago 11m 14.4M - 17.2.7-521-gc80e7168 10b0c032c913 b2acf55647c3 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (11m) 103s ago 11m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:13:48.222 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (11m) 2s ago 11m 17.5M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (11m) 2s ago 11m 15.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (7m) 103s ago 18m 503M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (6m) 2s ago 16m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (4m) 103s ago 18m 47.7M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (3m) 2s ago 16m 39.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (6m) 103s ago 17m 17.2M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 2s ago 16m 15.6M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (2m) 103s ago 15m 85.2M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (2m) 103s ago 14m 81.7M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (108s) 103s ago 14m 12.6M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (73s) 2s ago 13m 102M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (40s) 2s ago 13m 92.5M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (6s) 2s ago 13m 12.1M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4adb558e933b 2024-02-20T08:13:48.223 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (5m) 103s ago 16m 57.1M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:13:48.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 msgr2=0x7fe37c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 0x7fe37c06fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe388003400 tx=0x7fe388004d10 comp rx=0 tx=0).stop 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 msgr2=0x7fe3900707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe378002a50 tx=0x7fe3780046b0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 shutdown_connections 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe37c06d7e0 0x7fe37c06fc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390102f50 0x7fe390070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 --2- 172.21.15.123:0/1022622609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3901038f0 0x7fe3900707d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 >> 172.21.15.123:0/1022622609 conn(0x7fe3900f8ae0 msgr2=0x7fe3900fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 shutdown_connections 2024-02-20T08:13:48.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.224+0000 7fe395a5d700 1 -- 172.21.15.123:0/1022622609 wait complete. 2024-02-20T08:13:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- 172.21.15.123:0/2661908306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46781027e0 msgr2=0x7f46780fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 --2- 172.21.15.123:0/2661908306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46781027e0 0x7f46780fbea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4668004940 tx=0x7f4668009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- 172.21.15.123:0/2661908306 shutdown_connections 2024-02-20T08:13:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 --2- 172.21.15.123:0/2661908306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46781027e0 0x7f46780fbea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 --2- 172.21.15.123:0/2661908306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4678101e40 0x7f4678102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- 172.21.15.123:0/2661908306 >> 172.21.15.123:0/2661908306 conn(0x7f4678071d90 msgr2=0x7f4678072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- 172.21.15.123:0/2661908306 shutdown_connections 2024-02-20T08:13:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- 172.21.15.123:0/2661908306 wait complete. 2024-02-20T08:13:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 Processor -- start 2024-02-20T08:13:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.324+0000 7f467f24b700 1 -- start start 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46781027e0 0x7f4678112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4678113500 con 0x7f4678101e40 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467810c830 con 0x7f46781027e0 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51680/0 (socket says 172.21.15.123:51680) 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 -- 172.21.15.123:0/1926521659 learned_addr learned my addr 172.21.15.123:0/1926521659 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f4677fff700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46781027e0 0x7f4678112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 -- 172.21.15.123:0/1926521659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46781027e0 msgr2=0x7f4678112eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46781027e0 0x7f4678112eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 -- 172.21.15.123:0/1926521659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668005040 con 0x7f4678101e40 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467cfe7700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4670001db0 tx=0x7f4670009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f467000ed50 con 0x7f4678101e40 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467810cb10 con 0x7f4678101e40 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4670007df0 con 0x7f4678101e40 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4670014640 con 0x7f4678101e40 2024-02-20T08:13:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.325+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467810d020 con 0x7f4678101e40 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.326+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780738b0 con 0x7f4678101e40 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.327+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f46700147a0 con 0x7f4678101e40 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.327+0000 7f46757fa700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 0x7f466406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.327+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f467008ce30 con 0x7f4678101e40 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.327+0000 7f4677fff700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 0x7f466406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.328+0000 7f4677fff700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 0x7f466406fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f467810db60 tx=0x7f4668009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.332+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f467005a0a0 con 0x7f4678101e40 2024-02-20T08:13:48.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.610+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f467810df50 con 0x7f4678101e40 2024-02-20T08:13:48.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.610+0000 7f46757fa700 1 -- 172.21.15.123:0/1926521659 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f4670059c30 con 0x7f4678101e40 2024-02-20T08:13:48.610 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 5 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 4, 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 9 2024-02-20T08:13:48.611 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:13:48.612 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:13:48.612 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T08:13:48.523+0000 7fa622c0b700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-20T08:13:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 msgr2=0x7f466406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 0x7f466406fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f467810db60 tx=0x7f4668009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 msgr2=0x7f4678112970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4670001db0 tx=0x7f4670009ee0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 shutdown_connections 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f466406d7e0 0x7f466406fc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4678101e40 0x7f4678112970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 --2- 172.21.15.123:0/1926521659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46781027e0 0x7f4678112eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 >> 172.21.15.123:0/1926521659 conn(0x7f4678071d90 msgr2=0x7f46780fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 shutdown_connections 2024-02-20T08:13:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.613+0000 7f467f24b700 1 -- 172.21.15.123:0/1926521659 wait complete. 2024-02-20T08:13:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- 172.21.15.123:0/427243941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904102880 msgr2=0x7fd9040fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 --2- 172.21.15.123:0/427243941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904102880 0x7fd9040fc680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4004940 tx=0x7fd8f4009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- 172.21.15.123:0/427243941 shutdown_connections 2024-02-20T08:13:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 --2- 172.21.15.123:0/427243941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904102880 0x7fd9040fc680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 --2- 172.21.15.123:0/427243941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904101ee0 0x7fd9041022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- 172.21.15.123:0/427243941 >> 172.21.15.123:0/427243941 conn(0x7fd904071560 msgr2=0x7fd904071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- 172.21.15.123:0/427243941 shutdown_connections 2024-02-20T08:13:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- 172.21.15.123:0/427243941 wait complete. 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 Processor -- start 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.716+0000 7fd90b773700 1 -- start start 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90b773700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90b773700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904102880 0x7fd90410cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90b773700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90410d240 con 0x7fd904101ee0 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90b773700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90410d3b0 con 0x7fd904102880 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd908d0e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904102880 0x7fd90410cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37016/0 (socket says 172.21.15.123:37016) 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 -- 172.21.15.123:0/395072832 learned_addr learned my addr 172.21.15.123:0/395072832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 -- 172.21.15.123:0/395072832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904102880 msgr2=0x7fd90410cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904102880 0x7fd90410cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 -- 172.21.15.123:0/395072832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4005040 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90950f700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cb10 tx=0x7fd900007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd900004200 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd904119e30 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.717+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd90000ac70 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.718+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd900003d30 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.718+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90411a230 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.719+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9041043b0 con 0x7fd904101ee0 2024-02-20T08:13:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.719+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd90000a7a0 con 0x7fd904101ee0 2024-02-20T08:13:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.719+0000 7fd8f9ffb700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 0x7fd8f006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.720+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6861+0+0 (secure 0 0 0) 0x7fd90008d520 con 0x7fd904101ee0 2024-02-20T08:13:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.720+0000 7fd908d0e700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 0x7fd8f006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.720+0000 7fd908d0e700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 0x7fd8f006fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9040fc0e0 tx=0x7fd8f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.724+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd90005a6e0 con 0x7fd904101ee0 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: osdmap e83: 6 total, 5 up, 6 in 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='osd.5 ' entity='osd.5' 2024-02-20T08:13:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:48 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1926521659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.962+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd904073080 con 0x7fd904101ee0 2024-02-20T08:13:48.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:48.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-20T08:13:48.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: osdmap e83: 6 total, 5 up, 6 in 2024-02-20T08:13:48.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:48.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-02-20T08:13:48.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='osd.5 ' entity='osd.5' 2024-02-20T08:13:48.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:48 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1926521659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.962+0000 7fd8f9ffb700 1 -- 172.21.15.123:0/395072832 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fd900004360 con 0x7fd904101ee0 2024-02-20T08:13:48.963 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-02-20T08:13:48.963 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:13:48.963 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:13:48.963 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:02:26.035784+0000 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:13:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 47 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14482} 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:13:48.965 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{0:14482} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.123:6828/3850080893,v1:172.21.15.123:6829/3850080893] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3033221132,v1:172.21.15.123:6827/3033221132] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:24275} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 msgr2=0x7fd8f006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 0x7fd8f006fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9040fc0e0 tx=0x7fd8f4009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 msgr2=0x7fd90410c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cb10 tx=0x7fd900007f90 comp rx=0 tx=0).stop 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 shutdown_connections 2024-02-20T08:13:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fd8f006d7e0 0x7fd8f006fc90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd904101ee0 0x7fd90410c7c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 --2- 172.21.15.123:0/395072832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904102880 0x7fd90410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.964+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 >> 172.21.15.123:0/395072832 conn(0x7fd904071560 msgr2=0x7fd9040fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.965+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 shutdown_connections 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:48.965+0000 7fd90b773700 1 -- 172.21.15.123:0/395072832 wait complete. 2024-02-20T08:13:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 -- 172.21.15.123:0/3979119602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fdf80 msgr2=0x7f599c0fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 --2- 172.21.15.123:0/3979119602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fdf80 0x7f599c0fe350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f598c004940 tx=0x7f598c009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 -- 172.21.15.123:0/3979119602 shutdown_connections 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 --2- 172.21.15.123:0/3979119602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fe920 0x7f599c106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 --2- 172.21.15.123:0/3979119602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fdf80 0x7f599c0fe350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 -- 172.21.15.123:0/3979119602 >> 172.21.15.123:0/3979119602 conn(0x7f599c0f79c0 msgr2=0x7f599c0f9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 -- 172.21.15.123:0/3979119602 shutdown_connections 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.066+0000 7f59a354a700 1 -- 172.21.15.123:0/3979119602 wait complete. 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 Processor -- start 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 -- start start 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fdf80 0x7f599c113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c114640 con 0x7f599c0fe920 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a354a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c10d970 con 0x7f599c0fdf80 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37032/0 (socket says 172.21.15.123:37032) 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a12e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fdf80 0x7f599c113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 -- 172.21.15.123:0/785397392 learned_addr learned my addr 172.21.15.123:0/785397392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 -- 172.21.15.123:0/785397392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fdf80 msgr2=0x7f599c113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fdf80 0x7f599c113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.067+0000 7f59a0ae5700 1 -- 172.21.15.123:0/785397392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c005040 con 0x7f599c0fe920 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f59a0ae5700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f599800eb40 tx=0x7f599800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5998007cc0 con 0x7f599c0fe920 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f599800f040 con 0x7f599c0fe920 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c10dbf0 con 0x7f599c0fe920 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f599800ca10 con 0x7f599c0fe920 2024-02-20T08:13:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.068+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c10e130 con 0x7f599c0fe920 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.069+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c1046b0 con 0x7f599c0fe920 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.069+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f599800cc80 con 0x7f599c0fe920 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.070+0000 7f5991ffb700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 0x7f598806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.070+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f599808cc30 con 0x7f599c0fe920 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.070+0000 7f59a12e6700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 0x7f598806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.070+0000 7f59a12e6700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 0x7f598806fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b0d0 tx=0x7f598c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:49.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.074+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5998059ea0 con 0x7f599c0fe920 2024-02-20T08:13:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.286+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f599c109ff0 con 0x7f598806d7e0 2024-02-20T08:13:49.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.287+0000 7f5991ffb700 1 -- 172.21.15.123:0/785397392 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f599c109ff0 con 0x7f598806d7e0 2024-02-20T08:13:49.287 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:13:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:13:49.287 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "osd", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "12/21 daemons upgraded", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading osd daemons", 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:13:49.288 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 msgr2=0x7f598806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 0x7f598806fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b0d0 tx=0x7f598c009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 msgr2=0x7f599c113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f599800eb40 tx=0x7f599800b040 comp rx=0 tx=0).stop 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 shutdown_connections 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f598806d7e0 0x7f598806fc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c0fdf80 0x7f599c113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 --2- 172.21.15.123:0/785397392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0fe920 0x7f599c113ff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.289+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 >> 172.21.15.123:0/785397392 conn(0x7f599c0f79c0 msgr2=0x7f599c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.290+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 shutdown_connections 2024-02-20T08:13:49.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.290+0000 7f59a354a700 1 -- 172.21.15.123:0/785397392 wait complete. 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 -- 172.21.15.123:0/3868700520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fdfc0 msgr2=0x7f2eb80fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 --2- 172.21.15.123:0/3868700520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb80fe390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8004940 tx=0x7f2ea8009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 -- 172.21.15.123:0/3868700520 shutdown_connections 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 --2- 172.21.15.123:0/3868700520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fe960 0x7f2eb8106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 --2- 172.21.15.123:0/3868700520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb80fe390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 -- 172.21.15.123:0/3868700520 >> 172.21.15.123:0/3868700520 conn(0x7f2eb80f7a10 msgr2=0x7f2eb80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:49.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 -- 172.21.15.123:0/3868700520 shutdown_connections 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.390+0000 7f2ec0210700 1 -- 172.21.15.123:0/3868700520 wait complete. 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 Processor -- start 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 -- start start 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb8113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81146c0 con 0x7f2eb80fe960 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ec0210700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb810d960 con 0x7f2eb80fdfc0 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebd7ab700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebdfac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb8113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebd7ab700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37046/0 (socket says 172.21.15.123:37046) 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebdfac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb8113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:51146/0 (socket says 172.21.15.123:51146) 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebd7ab700 1 -- 172.21.15.123:0/2817966877 learned_addr learned my addr 172.21.15.123:0/2817966877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:13:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebd7ab700 1 -- 172.21.15.123:0/2817966877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 msgr2=0x7f2eb8113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.391+0000 7f2ebd7ab700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb8113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2ebd7ab700 1 -- 172.21.15.123:0/2817966877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8005040 con 0x7f2eb80fe960 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2ebd7ab700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b790 tx=0x7f2eb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb400f6f0 con 0x7f2eb80fe960 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb810dc40 con 0x7f2eb80fe960 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb400fd20 con 0x7f2eb80fe960 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb40103a0 con 0x7f2eb80fe960 2024-02-20T08:13:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.392+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb810e180 con 0x7f2eb80fe960 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.393+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb81045b0 con 0x7f2eb80fe960 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.393+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2eb4011400 con 0x7f2eb80fe960 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.394+0000 7f2eae7fc700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 0x7f2ea406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.394+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f2eb408ce90 con 0x7f2eb80fe960 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.394+0000 7f2ebdfac700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 0x7f2ea406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:13:49.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.394+0000 7f2ebdfac700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 0x7f2ea406fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8004560 tx=0x7f2ea8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:13:49.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.398+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2eb405a0d0 con 0x7f2eb80fe960 2024-02-20T08:13:49.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.692+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2eb80fb610 con 0x7f2eb80fe960 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.692+0000 7f2eae7fc700 1 -- 172.21.15.123:0/2817966877 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1279 (secure 0 0 0) 0x7f2eb4059c60 con 0x7f2eb80fe960 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-20T08:13:49.693 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-20T08:13:49.694 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-20T08:13:49.694 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-20T08:13:49.694 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-20T08:13:49.694 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-20T08:13:49.694 INFO:teuthology.orchestra.run.smithi123.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-20T08:13:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 msgr2=0x7f2ea406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 0x7f2ea406fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8004560 tx=0x7f2ea8009e30 comp rx=0 tx=0).stop 2024-02-20T08:13:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 msgr2=0x7f2eb8113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:13:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b790 tx=0x7f2eb4009250 comp rx=0 tx=0).stop 2024-02-20T08:13:49.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 shutdown_connections 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2ea406d7e0 0x7f2ea406fc90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb80fdfc0 0x7f2eb8113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 --2- 172.21.15.123:0/2817966877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb80fe960 0x7f2eb8113fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 >> 172.21.15.123:0/2817966877 conn(0x7f2eb80f7a10 msgr2=0x7f2eb8101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 shutdown_connections 2024-02-20T08:13:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:13:49.695+0000 7f2ec0210700 1 -- 172.21.15.123:0/2817966877 wait complete. 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: pgmap v160: 65 pgs: 6 active+clean+remapped, 2 remapped+peering, 12 active+undersized+degraded, 12 active+undersized, 33 active+clean; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%); 7/264 objects misplaced (2.652%); 3.4 MiB/s, 0 keys/s, 73 objects/s recovering 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/395072832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420] boot 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: osdmap e84: 6 total, 6 up, 6 in 2024-02-20T08:13:50.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:13:50.034 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:50.034 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:50.034 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: pgmap v160: 65 pgs: 6 active+clean+remapped, 2 remapped+peering, 12 active+undersized+degraded, 12 active+undersized, 33 active+clean; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%); 7/264 objects misplaced (2.652%); 3.4 MiB/s, 0 keys/s, 73 objects/s recovering 2024-02-20T08:13:50.035 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/395072832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:13:50.035 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-20T08:13:50.035 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: osd.5 [v2:172.21.15.194:6816/3914156420,v1:172.21.15.194:6817/3914156420] boot 2024-02-20T08:13:50.035 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: osdmap e84: 6 total, 6 up, 6 in 2024-02-20T08:13:50.035 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-20T08:13:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2817966877' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:13:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-20T08:13:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-20T08:13:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:50 smithi123 ceph-mon[112409]: osdmap e85: 6 total, 6 up, 6 in 2024-02-20T08:13:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:13:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2817966877' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:13:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-20T08:13:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-20T08:13:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:50 smithi194 ceph-mon[88937]: osdmap e85: 6 total, 6 up, 6 in 2024-02-20T08:13:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:51 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all osd 2024-02-20T08:13:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:51 smithi123 ceph-mon[112409]: Upgrade: Setting require_osd_release to 19 squid 2024-02-20T08:13:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:51 smithi123 ceph-mon[112409]: pgmap v163: 65 pgs: 1 remapped+peering, 7 active+clean+remapped, 2 peering, 10 active+undersized+degraded, 12 active+undersized, 33 active+clean; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/264 objects degraded (11.364%); 7/264 objects misplaced (2.652%) 2024-02-20T08:13:52.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:51 smithi123 ceph-mon[112409]: osdmap e86: 6 total, 6 up, 6 in 2024-02-20T08:13:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:51 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all osd 2024-02-20T08:13:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:51 smithi194 ceph-mon[88937]: Upgrade: Setting require_osd_release to 19 squid 2024-02-20T08:13:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:51 smithi194 ceph-mon[88937]: pgmap v163: 65 pgs: 1 remapped+peering, 7 active+clean+remapped, 2 peering, 10 active+undersized+degraded, 12 active+undersized, 33 active+clean; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/264 objects degraded (11.364%); 7/264 objects misplaced (2.652%) 2024-02-20T08:13:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:51 smithi194 ceph-mon[88937]: osdmap e86: 6 total, 6 up, 6 in 2024-02-20T08:13:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: Upgrade: Updating mds.cephfs.smithi123.gglmsl 2024-02-20T08:13:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:13:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: Deploying daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:13:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: Health check update: Degraded data redundancy: 30/264 objects degraded (11.364%), 10 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: osdmap e87: 6 total, 6 up, 6 in 2024-02-20T08:13:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:53 smithi123 ceph-mon[112409]: pgmap v166: 65 pgs: 42 active+clean, 1 active+recovering+undersized+remapped, 9 active+undersized, 5 active+undersized+degraded, 2 peering, 5 active+clean+remapped, 1 remapped+peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11/264 objects degraded (4.167%); 7/264 objects misplaced (2.652%); 0 B/s, 37 objects/s recovering 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: Upgrade: Updating mds.cephfs.smithi123.gglmsl 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.gglmsl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: Deploying daemon mds.cephfs.smithi123.gglmsl on smithi123 2024-02-20T08:13:53.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: Health check update: Degraded data redundancy: 30/264 objects degraded (11.364%), 10 pgs degraded (PG_DEGRADED) 2024-02-20T08:13:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: osdmap e87: 6 total, 6 up, 6 in 2024-02-20T08:13:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:53 smithi194 ceph-mon[88937]: pgmap v166: 65 pgs: 42 active+clean, 1 active+recovering+undersized+remapped, 9 active+undersized, 5 active+undersized+degraded, 2 peering, 5 active+clean+remapped, 1 remapped+peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11/264 objects degraded (4.167%); 7/264 objects misplaced (2.652%); 0 B/s, 37 objects/s recovering 2024-02-20T08:13:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:54 smithi123 ceph-mon[112409]: osdmap e88: 6 total, 6 up, 6 in 2024-02-20T08:13:54.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:54 smithi194 ceph-mon[88937]: osdmap e88: 6 total, 6 up, 6 in 2024-02-20T08:13:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:55 smithi194 ceph-mon[88937]: osdmap e89: 6 total, 6 up, 6 in 2024-02-20T08:13:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:55 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 2 up:standby 2024-02-20T08:13:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:55 smithi194 ceph-mon[88937]: pgmap v169: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 3 peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 B/s, 91 objects/s recovering 2024-02-20T08:13:55.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:55 smithi123 ceph-mon[112409]: osdmap e89: 6 total, 6 up, 6 in 2024-02-20T08:13:55.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:55 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 2 up:standby 2024-02-20T08:13:55.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:55 smithi123 ceph-mon[112409]: pgmap v169: 65 pgs: 61 active+clean, 1 active+recovering+undersized+remapped, 3 peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 B/s, 91 objects/s recovering 2024-02-20T08:13:56.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:56 smithi194 ceph-mon[88937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/264 objects degraded (4.167%), 5 pgs degraded) 2024-02-20T08:13:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:56.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:56 smithi123 ceph-mon[112409]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/264 objects degraded (4.167%), 5 pgs degraded) 2024-02-20T08:13:56.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:13:56.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:13:57.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:57 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:13:57.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:57 smithi194 ceph-mon[88937]: pgmap v170: 65 pgs: 63 active+clean, 1 active+recovering+undersized+remapped, 1 peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 B/s, 70 objects/s recovering 2024-02-20T08:13:57.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:57 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:13:57.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:57 smithi123 ceph-mon[112409]: pgmap v170: 65 pgs: 63 active+clean, 1 active+recovering+undersized+remapped, 1 peering; 255 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 B/s, 70 objects/s recovering 2024-02-20T08:14:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:13:59 smithi123 ceph-mon[112409]: pgmap v171: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 14 B/s, 47 objects/s recovering 2024-02-20T08:14:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:13:59 smithi194 ceph-mon[88937]: pgmap v171: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 14 B/s, 47 objects/s recovering 2024-02-20T08:14:00.886 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: pgmap v172: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 11 B/s, 37 objects/s recovering 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:boot 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:14:00.887 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: pgmap v172: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 11 B/s, 37 objects/s recovering 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:boot 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi123.uffypv=up:active} 3 up:standby 2024-02-20T08:14:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:14:03.925 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:03 smithi123 ceph-mon[112409]: pgmap v173: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s, 10 objects/s recovering 2024-02-20T08:14:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:03 smithi194 ceph-mon[88937]: pgmap v173: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s, 10 objects/s recovering 2024-02-20T08:14:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:05 smithi123 ceph-mon[112409]: pgmap v174: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 8 objects/s recovering 2024-02-20T08:14:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:06.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:05 smithi194 ceph-mon[88937]: pgmap v174: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 8 objects/s recovering 2024-02-20T08:14:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:08.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:07 smithi123 ceph-mon[112409]: pgmap v175: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-20T08:14:08.138 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:07 smithi194 ceph-mon[88937]: pgmap v175: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: pgmap v176: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:10.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: pgmap v176: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:11 smithi123 ceph-mon[112409]: pgmap v177: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:14:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:11 smithi194 ceph-mon[88937]: pgmap v177: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:14:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.uffypv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:12 smithi123 ceph-mon[112409]: Upgrade: Updating mds.cephfs.smithi123.uffypv 2024-02-20T08:14:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:12 smithi123 ceph-mon[112409]: Deploying daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:14:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:12 smithi194 ceph-mon[88937]: Upgrade: Updating mds.cephfs.smithi123.uffypv 2024-02-20T08:14:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:12 smithi194 ceph-mon[88937]: Deploying daemon mds.cephfs.smithi123.uffypv on smithi123 2024-02-20T08:14:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:13 smithi123 ceph-mon[112409]: pgmap v178: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:14:14.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:13 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[112405]: 2024-02-20T08:14:13.780+0000 7fb1bbc8d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:13 smithi194 ceph-mon[88937]: pgmap v178: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:14:15.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: osdmap e90: 6 total, 6 up, 6 in 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: Standby daemon mds.cephfs.smithi194.icyfny assigned to filesystem cephfs as rank 0 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:14:15.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:14 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:replay} 2 up:standby 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: osdmap e90: 6 total, 6 up, 6 in 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: Standby daemon mds.cephfs.smithi194.icyfny assigned to filesystem cephfs as rank 0 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:14:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:14 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:replay} 2 up:standby 2024-02-20T08:14:16.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:15 smithi194 ceph-mon[88937]: pgmap v180: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-02-20T08:14:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:15 smithi123 ceph-mon[112409]: pgmap v180: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-02-20T08:14:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:14:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:14:17.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:17 smithi194 ceph-mon[88937]: pgmap v181: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-20T08:14:18.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:17 smithi123 ceph-mon[112409]: pgmap v181: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-20T08:14:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 -- 172.21.15.123:0/973322468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 msgr2=0x7f55ac1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 --2- 172.21.15.123:0/973322468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac1092e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5598004940 tx=0x7f5598009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 -- 172.21.15.123:0/973322468 shutdown_connections 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 --2- 172.21.15.123:0/973322468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac1092e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 --2- 172.21.15.123:0/973322468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 0x7f55ac070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 -- 172.21.15.123:0/973322468 >> 172.21.15.123:0/973322468 conn(0x7f55ac0f8ae0 msgr2=0x7f55ac0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 -- 172.21.15.123:0/973322468 shutdown_connections 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.812+0000 7f55b302c700 1 -- 172.21.15.123:0/973322468 wait complete. 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 Processor -- start 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 -- start start 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 0x7f55ac115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac116780 con 0x7f55ac070bc0 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b302c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac10fad0 con 0x7f55ac0702b0 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58066/0 (socket says 172.21.15.123:58066) 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55abfff700 1 -- 172.21.15.123:0/2742765252 learned_addr learned my addr 172.21.15.123:0/2742765252 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.813+0000 7f55b0dc8700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 0x7f55ac115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55abfff700 1 -- 172.21.15.123:0/2742765252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 msgr2=0x7f55ac115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55abfff700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 0x7f55ac115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55abfff700 1 -- 172.21.15.123:0/2742765252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598005040 con 0x7f55ac070bc0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55abfff700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55980090d0 tx=0x7f5598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5598021070 con 0x7f55ac070bc0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5598013d00 con 0x7f55ac070bc0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac10fd50 con 0x7f55ac070bc0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f559800e070 con 0x7f55ac070bc0 2024-02-20T08:14:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.814+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac110230 con 0x7f55ac070bc0 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.815+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac1069a0 con 0x7f55ac070bc0 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.816+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f559801ca60 con 0x7f55ac070bc0 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.816+0000 7f55a97fa700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 0x7f559c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.816+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f559808e4a0 con 0x7f55ac070bc0 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.816+0000 7f55b0dc8700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 0x7f559c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:19.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.817+0000 7f55b0dc8700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 0x7f559c06fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009b80 tx=0x7f55a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:19.821+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5598057c60 con 0x7f55ac070bc0 2024-02-20T08:14:20.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.034+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55ac04bf40 con 0x7f559c06d7f0 2024-02-20T08:14:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.035+0000 7f55a97fa700 1 -- 172.21.15.123:0/2742765252 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f55ac04bf40 con 0x7f559c06d7f0 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.037+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 msgr2=0x7f559c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.037+0000 7f55b302c700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 0x7f559c06fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009b80 tx=0x7f55a000b040 comp rx=0 tx=0).stop 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 msgr2=0x7f55ac116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55980090d0 tx=0x7f5598009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 shutdown_connections 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f559c06d7f0 0x7f559c06fca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ac0702b0 0x7f55ac115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 --2- 172.21.15.123:0/2742765252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55ac070bc0 0x7f55ac116130 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 >> 172.21.15.123:0/2742765252 conn(0x7f55ac0f8ae0 msgr2=0x7f55ac103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 shutdown_connections 2024-02-20T08:14:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.038+0000 7f55b302c700 1 -- 172.21.15.123:0/2742765252 wait complete. 2024-02-20T08:14:20.048 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:14:20.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 -- 172.21.15.123:0/2658774472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 msgr2=0x7fee44107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 --2- 172.21.15.123:0/2658774472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44107050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee38004970 tx=0x7fee38009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 -- 172.21.15.123:0/2658774472 shutdown_connections 2024-02-20T08:14:20.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 --2- 172.21.15.123:0/2658774472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44107050 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 --2- 172.21.15.123:0/2658774472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee440fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 -- 172.21.15.123:0/2658774472 >> 172.21.15.123:0/2658774472 conn(0x7fee44071d90 msgr2=0x7fee44072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.142 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:19 smithi123 ceph-mon[112409]: pgmap v182: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-02-20T08:14:20.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 -- 172.21.15.123:0/2658774472 shutdown_connections 2024-02-20T08:14:20.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 -- 172.21.15.123:0/2658774472 wait complete. 2024-02-20T08:14:20.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.140+0000 7fee49d24700 1 Processor -- start 2024-02-20T08:14:20.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee49d24700 1 -- start start 2024-02-20T08:14:20.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee49d24700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee44113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee49d24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee49d24700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee441145a0 con 0x7fee440fe8f0 2024-02-20T08:14:20.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee49d24700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4410d8d0 con 0x7fee440fdfe0 2024-02-20T08:14:20.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58084/0 (socket says 172.21.15.123:58084) 2024-02-20T08:14:20.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee437fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee44113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 -- 172.21.15.123:0/580361960 learned_addr learned my addr 172.21.15.123:0/580361960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 -- 172.21.15.123:0/580361960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 msgr2=0x7fee44113a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee44113a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 -- 172.21.15.123:0/580361960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38005040 con 0x7fee440fe8f0 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee437fe700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee44113a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.141+0000 7fee42ffd700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee38005010 tx=0x7fee38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.142+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3800e040 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.142+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4410db50 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.142+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee38013420 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.142+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3801c610 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.142+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4410e090 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.143+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee441046c0 con 0x7fee440fe8f0 2024-02-20T08:14:20.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.143+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fee38013590 con 0x7fee440fe8f0 2024-02-20T08:14:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.144+0000 7fee2bfff700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 0x7fee2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.144+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fee3808e300 con 0x7fee440fe8f0 2024-02-20T08:14:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.144+0000 7fee437fe700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 0x7fee2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.144+0000 7fee437fe700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 0x7fee2c06fc90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee34009b80 tx=0x7fee3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.152 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:19 smithi194 ceph-mon[88937]: pgmap v182: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-02-20T08:14:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.150+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee3805b600 con 0x7fee440fe8f0 2024-02-20T08:14:20.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.362+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee4410f060 con 0x7fee2c06d7e0 2024-02-20T08:14:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.363+0000 7fee2bfff700 1 -- 172.21.15.123:0/580361960 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fee4410f060 con 0x7fee2c06d7e0 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 msgr2=0x7fee2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 0x7fee2c06fc90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee34009b80 tx=0x7fee3400b040 comp rx=0 tx=0).stop 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 msgr2=0x7fee44113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee38005010 tx=0x7fee38009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 shutdown_connections 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fee2c06d7e0 0x7fee2c06fc90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440fdfe0 0x7fee44113a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 --2- 172.21.15.123:0/580361960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee440fe8f0 0x7fee44113f50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 >> 172.21.15.123:0/580361960 conn(0x7fee44071d90 msgr2=0x7fee44101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 shutdown_connections 2024-02-20T08:14:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.365+0000 7fee49d24700 1 -- 172.21.15.123:0/580361960 wait complete. 2024-02-20T08:14:20.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 -- 172.21.15.123:0/588400338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c101e40 msgr2=0x7fdd1c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 --2- 172.21.15.123:0/588400338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c101e40 0x7fdd1c102210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c004940 tx=0x7fdd0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 -- 172.21.15.123:0/588400338 shutdown_connections 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 --2- 172.21.15.123:0/588400338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c0fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 --2- 172.21.15.123:0/588400338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c101e40 0x7fdd1c102210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 -- 172.21.15.123:0/588400338 >> 172.21.15.123:0/588400338 conn(0x7fdd1c071d90 msgr2=0x7fdd1c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 -- 172.21.15.123:0/588400338 shutdown_connections 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 -- 172.21.15.123:0/588400338 wait complete. 2024-02-20T08:14:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.468+0000 7fdd220ec700 1 Processor -- start 2024-02-20T08:14:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd220ec700 1 -- start start 2024-02-20T08:14:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd220ec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 0x7fdd1c10ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd220ec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd220ec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c10f550 con 0x7fdd1c1027e0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd220ec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c10f6c0 con 0x7fdd1c101e40 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58092/0 (socket says 172.21.15.123:58092) 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 0x7fdd1c10ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 -- 172.21.15.123:0/324886935 learned_addr learned my addr 172.21.15.123:0/324886935 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 -- 172.21.15.123:0/324886935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 msgr2=0x7fdd1c10ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 0x7fdd1c10ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1affd700 1 -- 172.21.15.123:0/324886935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c005040 con 0x7fdd1c1027e0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.469+0000 7fdd1b7fe700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 0x7fdd1c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd1affd700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400c890 tx=0x7fdd040044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0400a700 con 0x7fdd1c1027e0 2024-02-20T08:14:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c117a50 con 0x7fdd1c1027e0 2024-02-20T08:14:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd0400ad30 con 0x7fdd1c1027e0 2024-02-20T08:14:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c117f40 con 0x7fdd1c1027e0 2024-02-20T08:14:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.470+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd040113a0 con 0x7fdd1c1027e0 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.471+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc0052e0 con 0x7fdd1c1027e0 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.471+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fdd0400a860 con 0x7fdd1c1027e0 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.472+0000 7fdd13fff700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 0x7fdd0806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.472+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fdd0408cef0 con 0x7fdd1c1027e0 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.472+0000 7fdd1b7fe700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 0x7fdd0806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.472+0000 7fdd1b7fe700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 0x7fdd0806fc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c004f90 tx=0x7fdd0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.476+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd04056750 con 0x7fdd1c1027e0 2024-02-20T08:14:20.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.683+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcfc000bf0 con 0x7fdd0806d7e0 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.693+0000 7fdd13fff700 1 -- 172.21.15.123:0/324886935 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdcfc000bf0 con 0x7fdd0806d7e0 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (6m) 15s ago 17m 27.2M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (3m) 15s ago 18m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (3m) 35s ago 16m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (5m) 15s ago 17m 86.3M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (21s) 15s ago 12m 10.4M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e48e69346378 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (12m) 15s ago 12m 152M - 17.2.7-521-gc80e7168 10b0c032c913 3578bb189413 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (12m) 35s ago 12m 17.5M - 17.2.7-521-gc80e7168 10b0c032c913 18aa8ae56dc8 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (12m) 35s ago 11m 15.4M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:14:20.693 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (8m) 15s ago 19m 506M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (7m) 35s ago 16m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (4m) 15s ago 19m 52.2M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (4m) 35s ago 16m 39.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (6m) 15s ago 18m 18.4M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 35s ago 16m 15.6M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (3m) 15s ago 15m 103M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (2m) 15s ago 15m 103M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (2m) 15s ago 14m 116M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (105s) 35s ago 14m 102M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (72s) 35s ago 14m 92.5M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (38s) 35s ago 13m 12.1M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4adb558e933b 2024-02-20T08:14:20.694 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (6m) 15s ago 17m 58.2M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:14:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 msgr2=0x7fdd0806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 0x7fdd0806fc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c004f90 tx=0x7fdd0c009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 msgr2=0x7fdd1c10efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400c890 tx=0x7fdd040044c0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 shutdown_connections 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdd0806d7e0 0x7fdd0806fc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c101e40 0x7fdd1c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 --2- 172.21.15.123:0/324886935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd1c1027e0 0x7fdd1c10efc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 >> 172.21.15.123:0/324886935 conn(0x7fdd1c071d90 msgr2=0x7fdd1c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 shutdown_connections 2024-02-20T08:14:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.695+0000 7fdd220ec700 1 -- 172.21.15.123:0/324886935 wait complete. 2024-02-20T08:14:20.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 -- 172.21.15.123:0/3190806286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6681027e0 msgr2=0x7fe6680fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 --2- 172.21.15.123:0/3190806286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6681027e0 0x7fe6680fbea0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe658004940 tx=0x7fe658009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:20.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 -- 172.21.15.123:0/3190806286 shutdown_connections 2024-02-20T08:14:20.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 --2- 172.21.15.123:0/3190806286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6681027e0 0x7fe6680fbea0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 --2- 172.21.15.123:0/3190806286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe668101e40 0x7fe668102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 -- 172.21.15.123:0/3190806286 >> 172.21.15.123:0/3190806286 conn(0x7fe668071d90 msgr2=0x7fe668072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:20.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 -- 172.21.15.123:0/3190806286 shutdown_connections 2024-02-20T08:14:20.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.800+0000 7fe66ff82700 1 -- 172.21.15.123:0/3190806286 wait complete. 2024-02-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 Processor -- start 2024-02-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 -- start start 2024-02-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6681027e0 0x7fe66810f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66810f720 con 0x7fe668101e40 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66ff82700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66810f860 con 0x7fe6681027e0 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58114/0 (socket says 172.21.15.123:58114) 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 -- 172.21.15.123:0/561213520 learned_addr learned my addr 172.21.15.123:0/561213520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66d51d700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6681027e0 0x7fe66810f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 -- 172.21.15.123:0/561213520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6681027e0 msgr2=0x7fe66810f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6681027e0 0x7fe66810f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.801+0000 7fe66dd1e700 1 -- 172.21.15.123:0/561213520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658005040 con 0x7fe668101e40 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe66dd1e700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbe0 tx=0x7fe660009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6600092e0 con 0x7fe668101e40 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe66000cb20 con 0x7fe668101e40 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe668117b90 con 0x7fe668101e40 2024-02-20T08:14:20.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe660015db0 con 0x7fe668101e40 2024-02-20T08:14:20.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.802+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6681180a0 con 0x7fe668101e40 2024-02-20T08:14:20.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.803+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6680ff150 con 0x7fe668101e40 2024-02-20T08:14:20.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.803+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe660012070 con 0x7fe668101e40 2024-02-20T08:14:20.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.803+0000 7fe65e7fc700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 0x7fe65406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:20.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.804+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fe66008cab0 con 0x7fe668101e40 2024-02-20T08:14:20.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.804+0000 7fe66d51d700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 0x7fe65406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:20.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.804+0000 7fe66d51d700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 0x7fe65406fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe65800b3b0 tx=0x7fe658009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:20.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:20.808+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe660056270 con 0x7fe668101e40 2024-02-20T08:14:21.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.086+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe668065ec0 con 0x7fe668101e40 2024-02-20T08:14:21.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.087+0000 7fe65e7fc700 1 -- 172.21.15.123:0/561213520 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fe660059930 con 0x7fe668101e40 2024-02-20T08:14:21.088 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:14:21.088 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:14:21.088 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:14:21.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:21.088 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 6 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2, 2024-02-20T08:14:21.089 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 1 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 2, 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 11 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:14:21.090 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 msgr2=0x7fe65406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 0x7fe65406fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe65800b3b0 tx=0x7fe658009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 msgr2=0x7fe66810ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbe0 tx=0x7fe660009840 comp rx=0 tx=0).stop 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 shutdown_connections 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe65406d7e0 0x7fe65406fc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe668101e40 0x7fe66810ebc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 --2- 172.21.15.123:0/561213520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6681027e0 0x7fe66810f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 >> 172.21.15.123:0/561213520 conn(0x7fe668071d90 msgr2=0x7fe6680fadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 shutdown_connections 2024-02-20T08:14:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.089+0000 7fe66ff82700 1 -- 172.21.15.123:0/561213520 wait complete. 2024-02-20T08:14:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.190+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/2818852562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e84102f50 msgr2=0x7f7e84103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.190+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/2818852562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e84102f50 0x7f7e84103320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e80004940 tx=0x7f7e80009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/2818852562 shutdown_connections 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/2818852562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e841038f0 0x7f7e840fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/2818852562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e84102f50 0x7f7e84103320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/2818852562 >> 172.21.15.123:0/2818852562 conn(0x7f7e840f8ae0 msgr2=0x7f7e840faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/2818852562 shutdown_connections 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/2818852562 wait complete. 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 Processor -- start 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- start start 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 0x7f7e84113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84114600 con 0x7f7e841038f0 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.191+0000 7f7e8b6c5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8410d930 con 0x7f7e84102f50 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58128/0 (socket says 172.21.15.123:58128) 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 -- 172.21.15.123:0/1758991479 learned_addr learned my addr 172.21.15.123:0/1758991479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e89461700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 0x7f7e84113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 -- 172.21.15.123:0/1758991479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 msgr2=0x7f7e84113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 0x7f7e84113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 -- 172.21.15.123:0/1758991479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80005040 con 0x7f7e841038f0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e89461700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 0x7f7e84113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e88c60700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e74002a80 tx=0x7f7e74004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e74007cc0 con 0x7f7e841038f0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e7400f040 con 0x7f7e841038f0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8410dc10 con 0x7f7e841038f0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7400daf0 con 0x7f7e841038f0 2024-02-20T08:14:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.192+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8410e150 con 0x7f7e841038f0 2024-02-20T08:14:21.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.193+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e840fc6e0 con 0x7f7e841038f0 2024-02-20T08:14:21.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.194+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7e7400dd30 con 0x7f7e841038f0 2024-02-20T08:14:21.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.194+0000 7f7e79ffb700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 0x7f7e7006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.194+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f7e7408c6e0 con 0x7f7e841038f0 2024-02-20T08:14:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.194+0000 7f7e89461700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 0x7f7e7006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.195+0000 7f7e89461700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 0x7f7e7006fc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e80004f90 tx=0x7f7e80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.199+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e74059950 con 0x7f7e841038f0 2024-02-20T08:14:21.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.444+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e8404bed0 con 0x7f7e841038f0 2024-02-20T08:14:21.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.445+0000 7f7e79ffb700 1 -- 172.21.15.123:0/1758991479 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1673 (secure 0 0 0) 0x7f7e740594e0 con 0x7f7e841038f0 2024-02-20T08:14:21.445 INFO:teuthology.orchestra.run.smithi123.stdout:e19 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 19 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:14:13.791110+0000 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:14:21.446 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 90 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=24275} 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:14:21.447 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{0:24275} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:14:21.448 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 msgr2=0x7f7e7006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 0x7f7e7006fc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e80004f90 tx=0x7f7e80009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 msgr2=0x7f7e84113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e74002a80 tx=0x7f7e74004630 comp rx=0 tx=0).stop 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 shutdown_connections 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7e7006d7e0 0x7f7e7006fc90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e84102f50 0x7f7e84113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 --2- 172.21.15.123:0/1758991479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e841038f0 0x7f7e84113fb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 >> 172.21.15.123:0/1758991479 conn(0x7f7e840f8ae0 msgr2=0x7f7e840fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 shutdown_connections 2024-02-20T08:14:21.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.447+0000 7f7e8b6c5700 1 -- 172.21.15.123:0/1758991479 wait complete. 2024-02-20T08:14:21.450 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 19 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 -- 172.21.15.123:0/1237431556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102f50 msgr2=0x7f7b8c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 --2- 172.21.15.123:0/1237431556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102f50 0x7f7b8c103320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7b88004940 tx=0x7f7b88009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 -- 172.21.15.123:0/1237431556 shutdown_connections 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 --2- 172.21.15.123:0/1237431556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 --2- 172.21.15.123:0/1237431556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102f50 0x7f7b8c103320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 -- 172.21.15.123:0/1237431556 >> 172.21.15.123:0/1237431556 conn(0x7f7b8c0f8ae0 msgr2=0x7f7b8c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 -- 172.21.15.123:0/1237431556 shutdown_connections 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.550+0000 7f7b94194700 1 -- 172.21.15.123:0/1237431556 wait complete. 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 Processor -- start 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 -- start start 2024-02-20T08:14:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c102f50 0x7f7b8c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c114680 con 0x7f7b8c1038f0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b94194700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c10d9b0 con 0x7f7b8c102f50 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58146/0 (socket says 172.21.15.123:58146) 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 -- 172.21.15.123:0/1691475570 learned_addr learned my addr 172.21.15.123:0/1691475570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b91f30700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c102f50 0x7f7b8c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 -- 172.21.15.123:0/1691475570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c102f50 msgr2=0x7f7b8c113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c102f50 0x7f7b8c113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.551+0000 7f7b9172f700 1 -- 172.21.15.123:0/1691475570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88005040 con 0x7f7b8c1038f0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b9172f700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c002a80 tx=0x7f7b7c004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b7c004e80 con 0x7f7b8c1038f0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c10dc90 con 0x7f7b8c1038f0 2024-02-20T08:14:21.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b7c00f040 con 0x7f7b8c1038f0 2024-02-20T08:14:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b7c00daa0 con 0x7f7b8c1038f0 2024-02-20T08:14:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.552+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c10e1d0 con 0x7f7b8c1038f0 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.553+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c0fc6e0 con 0x7f7b8c1038f0 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.553+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7b7c007cc0 con 0x7f7b8c1038f0 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.553+0000 7f7b827fc700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 0x7f7b7806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.554+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f7b7c08c640 con 0x7f7b8c1038f0 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.554+0000 7f7b91f30700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 0x7f7b7806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.554+0000 7f7b91f30700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 0x7f7b7806fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b88004f90 tx=0x7f7b88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.558+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7b7c0598b0 con 0x7f7b8c1038f0 2024-02-20T08:14:21.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.777+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b8c1137c0 con 0x7f7b7806d7e0 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.779+0000 7f7b827fc700 1 -- 172.21.15.123:0/1691475570 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7b8c1137c0 con 0x7f7b7806d7e0 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "osd", 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:14:21.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "13/21 daemons upgraded", 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading mds daemons", 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:14:21.780 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:14:21.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 msgr2=0x7f7b7806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 0x7f7b7806fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b88004f90 tx=0x7f7b88009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 msgr2=0x7f7b8c114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c002a80 tx=0x7f7b7c004630 comp rx=0 tx=0).stop 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 shutdown_connections 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f7b7806d7e0 0x7f7b7806fc90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b8c102f50 0x7f7b8c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 --2- 172.21.15.123:0/1691475570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c1038f0 0x7f7b8c114030 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 >> 172.21.15.123:0/1691475570 conn(0x7f7b8c0f8ae0 msgr2=0x7f7b8c0fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 shutdown_connections 2024-02-20T08:14:21.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.781+0000 7f7b94194700 1 -- 172.21.15.123:0/1691475570 wait complete. 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 -- 172.21.15.123:0/1563516229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 msgr2=0x7f5d04107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 --2- 172.21.15.123:0/1563516229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04107050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8004970 tx=0x7f5cf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 -- 172.21.15.123:0/1563516229 shutdown_connections 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 --2- 172.21.15.123:0/1563516229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04107050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 --2- 172.21.15.123:0/1563516229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d040fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.898+0000 7f5d0938f700 1 -- 172.21.15.123:0/1563516229 >> 172.21.15.123:0/1563516229 conn(0x7f5d04071d90 msgr2=0x7f5d04072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 -- 172.21.15.123:0/1563516229 shutdown_connections 2024-02-20T08:14:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 -- 172.21.15.123:0/1563516229 wait complete. 2024-02-20T08:14:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 Processor -- start 2024-02-20T08:14:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 -- start start 2024-02-20T08:14:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d04114580 con 0x7f5d040fe8f0 2024-02-20T08:14:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.899+0000 7f5d0938f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0410d8b0 con 0x7f5d040fdfe0 2024-02-20T08:14:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d02ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58154/0 (socket says 172.21.15.123:58154) 2024-02-20T08:14:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 -- 172.21.15.123:0/3037948777 learned_addr learned my addr 172.21.15.123:0/3037948777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d02ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:45106/0 (socket says 172.21.15.123:45106) 2024-02-20T08:14:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 -- 172.21.15.123:0/3037948777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 msgr2=0x7f5d041139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 -- 172.21.15.123:0/3037948777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8005040 con 0x7f5d040fe8f0 2024-02-20T08:14:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d02ffd700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d027fc700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005010 tx=0x7f5cf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf800e040 con 0x7f5d040fe8f0 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cf8013420 con 0x7f5d040fe8f0 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0410db30 con 0x7f5d040fe8f0 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf801c610 con 0x7f5d040fe8f0 2024-02-20T08:14:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.900+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0410e070 con 0x7f5d040fe8f0 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.901+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d041046c0 con 0x7f5d040fe8f0 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.902+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5cf8013590 con 0x7f5d040fe8f0 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.902+0000 7f5ceb7fe700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 0x7f5cec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.902+0000 7f5d02ffd700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 0x7f5cec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.903+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f5cf808e1a0 con 0x7f5d040fe8f0 2024-02-20T08:14:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.903+0000 7f5d02ffd700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 0x7f5cec06fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009b80 tx=0x7f5cf400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:21.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:21.907+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5cf805b530 con 0x7f5d040fe8f0 2024-02-20T08:14:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: pgmap v183: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-20T08:14:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/561213520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:22.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:21 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1758991479' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: pgmap v183: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/561213520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:21 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1758991479' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:14:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.204+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5d040738b0 con 0x7f5d040fe8f0 2024-02-20T08:14:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.204+0000 7f5ceb7fe700 1 -- 172.21.15.123:0/3037948777 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f5cf8013840 con 0x7f5d040fe8f0 2024-02-20T08:14:22.204 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-02-20T08:14:22.205 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-20T08:14:22.205 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs is degraded 2024-02-20T08:14:22.205 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:14:22.205 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:14:22.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 msgr2=0x7f5cec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:22.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 0x7f5cec06fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009b80 tx=0x7f5cf400b040 comp rx=0 tx=0).stop 2024-02-20T08:14:22.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 msgr2=0x7f5d04113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005010 tx=0x7f5cf8009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 shutdown_connections 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5cec06d7e0 0x7f5cec06fc90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d040fdfe0 0x7f5d041139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 --2- 172.21.15.123:0/3037948777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d040fe8f0 0x7f5d04113f30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 >> 172.21.15.123:0/3037948777 conn(0x7f5d04071d90 msgr2=0x7f5d04101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 shutdown_connections 2024-02-20T08:14:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:22.207+0000 7f5d0938f700 1 -- 172.21.15.123:0/3037948777 wait complete. 2024-02-20T08:14:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:22 smithi194 ceph-mon[88937]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:22 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3037948777' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:14:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:22 smithi123 ceph-mon[112409]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:22 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3037948777' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:14:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:23 smithi194 ceph-mon[88937]: pgmap v184: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-20T08:14:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:23 smithi123 ceph-mon[112409]: pgmap v184: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-20T08:14:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.000999979 2024-02-20T08:14:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999979 2024-02-20T08:14:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.123:6828/266272272,v1:172.21.15.123:6829/266272272] up:boot 2024-02-20T08:14:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:reconnect 2024-02-20T08:14:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:reconnect} 3 up:standby 2024-02-20T08:14:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.000999979 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999979 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.123:6828/266272272,v1:172.21.15.123:6829/266272272] up:boot 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:reconnect 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:reconnect} 3 up:standby 2024-02-20T08:14:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: pgmap v185: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:rejoin 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:rejoin} 3 up:standby 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: daemon mds.cephfs.smithi194.icyfny is now active in filesystem cephfs as rank 0 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:26.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: pgmap v185: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:rejoin 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.icyfny=up:rejoin} 3 up:standby 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: daemon mds.cephfs.smithi194.icyfny is now active in filesystem cephfs as rank 0 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:26 smithi194 ceph-mon[88937]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:14:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:26 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:active 2024-02-20T08:14:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:26 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi194.icyfny=up:active} 3 up:standby 2024-02-20T08:14:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:26 smithi194 ceph-mon[88937]: pgmap v186: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-20T08:14:26.910 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:26 smithi123 ceph-mon[112409]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:14:26.910 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:26 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6824/235540453,v1:172.21.15.194:6825/235540453] up:active 2024-02-20T08:14:26.910 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:26 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi194.icyfny=up:active} 3 up:standby 2024-02-20T08:14:26.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:26 smithi123 ceph-mon[112409]: pgmap v186: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-20T08:14:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:28.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:28.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:28.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:29.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:29 smithi123 ceph-mon[112409]: pgmap v187: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 7 op/s 2024-02-20T08:14:29.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:29.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:29.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:29 smithi194 ceph-mon[88937]: pgmap v187: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 7 op/s 2024-02-20T08:14:32.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:31 smithi123 ceph-mon[112409]: pgmap v188: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 6 op/s 2024-02-20T08:14:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:31 smithi194 ceph-mon[88937]: pgmap v188: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 6 op/s 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:33 smithi194 ceph-mon[88937]: pgmap v189: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 426 B/s wr, 5 op/s 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:33.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:33 smithi123 ceph-mon[112409]: pgmap v189: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 426 B/s wr, 5 op/s 2024-02-20T08:14:35.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:34 smithi194 ceph-mon[88937]: Upgrade: Updating mds.cephfs.smithi194.icyfny 2024-02-20T08:14:35.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:35.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:35.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:35.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:34 smithi194 ceph-mon[88937]: Deploying daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:14:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:34 smithi123 ceph-mon[112409]: Upgrade: Updating mds.cephfs.smithi194.icyfny 2024-02-20T08:14:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.icyfny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:34 smithi123 ceph-mon[112409]: Deploying daemon mds.cephfs.smithi194.icyfny on smithi194 2024-02-20T08:14:35.933 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:35 smithi194 ceph-mon[88937]: pgmap v190: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-20T08:14:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:35 smithi123 ceph-mon[112409]: pgmap v190: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-20T08:14:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:35 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[112405]: 2024-02-20T08:14:35.934+0000 7fb1bbc8d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: osdmap e91: 6 total, 6 up, 6 in 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: Standby daemon mds.cephfs.smithi194.lquaku assigned to filesystem cephfs as rank 0 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:replay} 2 up:standby 2024-02-20T08:14:36.941 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:14:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:14:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:14:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: osdmap e91: 6 total, 6 up, 6 in 2024-02-20T08:14:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: Standby daemon mds.cephfs.smithi194.lquaku assigned to filesystem cephfs as rank 0 2024-02-20T08:14:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:14:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:14:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:replay} 2 up:standby 2024-02-20T08:14:37.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:14:38.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:37 smithi194 ceph-mon[88937]: pgmap v192: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.0 KiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-02-20T08:14:38.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:37 smithi123 ceph-mon[112409]: pgmap v192: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.0 KiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-02-20T08:14:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:39 smithi194 ceph-mon[88937]: pgmap v193: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-02-20T08:14:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:39 smithi123 ceph-mon[112409]: pgmap v193: 65 pgs: 65 active+clean; 255 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-02-20T08:14:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:42.058 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:41 smithi194 ceph-mon[88937]: pgmap v194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-02-20T08:14:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:41 smithi123 ceph-mon[112409]: pgmap v194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-02-20T08:14:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: pgmap v195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5.2 KiB/s wr, 7 op/s 2024-02-20T08:14:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:44.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6824/1865473040,v1:172.21.15.194:6825/1865473040] up:boot 2024-02-20T08:14:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:replay} 3 up:standby 2024-02-20T08:14:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: pgmap v195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5.2 KiB/s wr, 7 op/s 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6824/1865473040,v1:172.21.15.194:6825/1865473040] up:boot 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:replay} 3 up:standby 2024-02-20T08:14:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:14:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:45 smithi123 ceph-mon[112409]: pgmap v196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-20T08:14:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:45 smithi194 ceph-mon[88937]: pgmap v196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-20T08:14:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:46 smithi123 ceph-mon[112409]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.000999979 2024-02-20T08:14:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:46 smithi123 ceph-mon[112409]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999979 2024-02-20T08:14:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:46 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:reconnect 2024-02-20T08:14:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:46 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:reconnect} 3 up:standby 2024-02-20T08:14:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:46 smithi194 ceph-mon[88937]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.000999979 2024-02-20T08:14:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:46 smithi194 ceph-mon[88937]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999979 2024-02-20T08:14:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:46 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:reconnect 2024-02-20T08:14:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:46 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:reconnect} 3 up:standby 2024-02-20T08:14:48.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:47 smithi123 ceph-mon[112409]: pgmap v197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-20T08:14:48.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:47 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:rejoin 2024-02-20T08:14:48.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:47 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:rejoin} 3 up:standby 2024-02-20T08:14:48.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:47 smithi123 ceph-mon[112409]: daemon mds.cephfs.smithi194.lquaku is now active in filesystem cephfs as rank 0 2024-02-20T08:14:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:47 smithi194 ceph-mon[88937]: pgmap v197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-20T08:14:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:47 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:rejoin 2024-02-20T08:14:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:47 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi194.lquaku=up:rejoin} 3 up:standby 2024-02-20T08:14:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:47 smithi194 ceph-mon[88937]: daemon mds.cephfs.smithi194.lquaku is now active in filesystem cephfs as rank 0 2024-02-20T08:14:49.130 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:48 smithi194 ceph-mon[88937]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:14:49.131 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:48 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:active 2024-02-20T08:14:49.131 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:48 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi194.lquaku=up:active} 3 up:standby 2024-02-20T08:14:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:48 smithi123 ceph-mon[112409]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:14:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:48 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] up:active 2024-02-20T08:14:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:48 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi194.lquaku=up:active} 3 up:standby 2024-02-20T08:14:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:49 smithi194 ceph-mon[88937]: pgmap v198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-20T08:14:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:49 smithi123 ceph-mon[112409]: pgmap v198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-20T08:14:51.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:51.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:51.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:51 smithi123 ceph-mon[112409]: pgmap v199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-20T08:14:51.620 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:51.620 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:51.620 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:51 smithi194 ceph-mon[88937]: pgmap v199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 -- 172.21.15.123:0/2362839346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c1038f0 msgr2=0x7feb3c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 --2- 172.21.15.123:0/2362839346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c1038f0 0x7feb3c0fcf60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb2c004940 tx=0x7feb2c009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 -- 172.21.15.123:0/2362839346 shutdown_connections 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 --2- 172.21.15.123:0/2362839346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c1038f0 0x7feb3c0fcf60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 --2- 172.21.15.123:0/2362839346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c102f50 0x7feb3c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 -- 172.21.15.123:0/2362839346 >> 172.21.15.123:0/2362839346 conn(0x7feb3c0f8ae0 msgr2=0x7feb3c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 -- 172.21.15.123:0/2362839346 shutdown_connections 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.322+0000 7feb4325d700 1 -- 172.21.15.123:0/2362839346 wait complete. 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.323+0000 7feb4325d700 1 Processor -- start 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.323+0000 7feb4325d700 1 -- start start 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.323+0000 7feb4325d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb4325d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c1038f0 0x7feb3c113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb4325d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c114590 con 0x7feb3c102f50 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb4325d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c10d8c0 con 0x7feb3c1038f0 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42870/0 (socket says 172.21.15.123:42870) 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 -- 172.21.15.123:0/38167341 learned_addr learned my addr 172.21.15.123:0/38167341 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb33fff700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c1038f0 0x7feb3c113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 -- 172.21.15.123:0/38167341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c1038f0 msgr2=0x7feb3c113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c1038f0 0x7feb3c113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 -- 172.21.15.123:0/38167341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c005040 con 0x7feb3c102f50 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb40ff9700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb38002a80 tx=0x7feb380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb38007cc0 con 0x7feb3c102f50 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb3800f040 con 0x7feb3c102f50 2024-02-20T08:14:52.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c10dba0 con 0x7feb3c102f50 2024-02-20T08:14:52.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3800dac0 con 0x7feb3c102f50 2024-02-20T08:14:52.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.324+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c10e0b0 con 0x7feb3c102f50 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.325+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c105420 con 0x7feb3c102f50 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.326+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7feb3800dc20 con 0x7feb3c102f50 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.326+0000 7feb317fa700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 0x7feb2406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.326+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7feb3808ce40 con 0x7feb3c102f50 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.326+0000 7feb33fff700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 0x7feb2406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.327+0000 7feb33fff700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 0x7feb2406fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb3c10ebf0 tx=0x7feb2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.331+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feb3805a050 con 0x7feb3c102f50 2024-02-20T08:14:52.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:52.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:52.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.545+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3c04bed0 con 0x7feb2406d7f0 2024-02-20T08:14:52.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.547+0000 7feb317fa700 1 -- 172.21.15.123:0/38167341 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7feb3c04bed0 con 0x7feb2406d7f0 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 msgr2=0x7feb2406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 0x7feb2406fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb3c10ebf0 tx=0x7feb2c009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 msgr2=0x7feb3c113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb38002a80 tx=0x7feb380046b0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 shutdown_connections 2024-02-20T08:14:52.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7feb2406d7f0 0x7feb2406fca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb3c102f50 0x7feb3c113a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 --2- 172.21.15.123:0/38167341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3c1038f0 0x7feb3c113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 >> 172.21.15.123:0/38167341 conn(0x7feb3c0f8ae0 msgr2=0x7feb3c0fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:52.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 shutdown_connections 2024-02-20T08:14:52.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.549+0000 7feb4325d700 1 -- 172.21.15.123:0/38167341 wait complete. 2024-02-20T08:14:52.561 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:14:52.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:52.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 -- 172.21.15.123:0/996142097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e4101e40 msgr2=0x7f04e4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 --2- 172.21.15.123:0/996142097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e4101e40 0x7f04e4102210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004940 tx=0x7f04dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 -- 172.21.15.123:0/996142097 shutdown_connections 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 --2- 172.21.15.123:0/996142097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e41027e0 0x7f04e40fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 --2- 172.21.15.123:0/996142097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e4101e40 0x7f04e4102210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 -- 172.21.15.123:0/996142097 >> 172.21.15.123:0/996142097 conn(0x7f04e4071d90 msgr2=0x7f04e4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 -- 172.21.15.123:0/996142097 shutdown_connections 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.652+0000 7f04e8f34700 1 -- 172.21.15.123:0/996142097 wait complete. 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 Processor -- start 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 -- start start 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e4101e40 0x7f04e410eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e410f5b0 con 0x7f04e41027e0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e8f34700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e410f6f0 con 0x7f04e4101e40 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42898/0 (socket says 172.21.15.123:42898) 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e4101e40 0x7f04e410eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 -- 172.21.15.123:0/3435260486 learned_addr learned my addr 172.21.15.123:0/3435260486 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 -- 172.21.15.123:0/3435260486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e4101e40 msgr2=0x7f04e410eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e4101e40 0x7f04e410eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 -- 172.21.15.123:0/3435260486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc005040 con 0x7f04e41027e0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.653+0000 7f04e1d9b700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f04cc002a50 tx=0x7f04cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.654+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04cc007cc0 con 0x7f04e41027e0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.654+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04cc00f040 con 0x7f04e41027e0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.654+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04cc00d9c0 con 0x7f04e41027e0 2024-02-20T08:14:52.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.654+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e4117a50 con 0x7f04e41027e0 2024-02-20T08:14:52.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.654+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e4117f60 con 0x7f04e41027e0 2024-02-20T08:14:52.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.655+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40ff150 con 0x7f04e41027e0 2024-02-20T08:14:52.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.655+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f04cc009730 con 0x7f04e41027e0 2024-02-20T08:14:52.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.656+0000 7f04daffd700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 0x7f04d006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.656+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f04cc08ccb0 con 0x7f04e41027e0 2024-02-20T08:14:52.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.656+0000 7f04e259c700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 0x7f04d006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.656+0000 7f04e259c700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 0x7f04d006fc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004f90 tx=0x7f04dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.660+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f04cc056410 con 0x7f04e41027e0 2024-02-20T08:14:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.875+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04e4065ec0 con 0x7f04d006d7e0 2024-02-20T08:14:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.876+0000 7f04daffd700 1 -- 172.21.15.123:0/3435260486 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f04e4065ec0 con 0x7f04d006d7e0 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 msgr2=0x7f04d006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 0x7f04d006fc90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004f90 tx=0x7f04dc009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 msgr2=0x7f04e410f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f04cc002a50 tx=0x7f04cc004600 comp rx=0 tx=0).stop 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 shutdown_connections 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f04d006d7e0 0x7f04d006fc90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04e4101e40 0x7f04e410eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 --2- 172.21.15.123:0/3435260486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04e41027e0 0x7f04e410f020 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.878+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 >> 172.21.15.123:0/3435260486 conn(0x7f04e4071d90 msgr2=0x7f04e40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.879+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 shutdown_connections 2024-02-20T08:14:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.879+0000 7f04e8f34700 1 -- 172.21.15.123:0/3435260486 wait complete. 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 -- 172.21.15.123:0/730205777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec102800 msgr2=0x7f9eec0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/730205777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec102800 0x7f9eec0fbe70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8004940 tx=0x7f9ed8009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 -- 172.21.15.123:0/730205777 shutdown_connections 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/730205777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec102800 0x7f9eec0fbe70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/730205777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec101e60 0x7f9eec102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 -- 172.21.15.123:0/730205777 >> 172.21.15.123:0/730205777 conn(0x7f9eec0f7a10 msgr2=0x7f9eec0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:52.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 -- 172.21.15.123:0/730205777 shutdown_connections 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.980+0000 7f9ef2a87700 1 -- 172.21.15.123:0/730205777 wait complete. 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 Processor -- start 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 -- start start 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec102800 0x7f9eec10f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec10f610 con 0x7f9eec101e60 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef2a87700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec10f780 con 0x7f9eec102800 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42906/0 (socket says 172.21.15.123:42906) 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 -- 172.21.15.123:0/3909032441 learned_addr learned my addr 172.21.15.123:0/3909032441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9eebfff700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec102800 0x7f9eec10f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 -- 172.21.15.123:0/3909032441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec102800 msgr2=0x7f9eec10f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec102800 0x7f9eec10f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.981+0000 7f9ef0823700 1 -- 172.21.15.123:0/3909032441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8005040 con 0x7f9eec101e60 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ef0823700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c830 tx=0x7f9ee0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee00106f0 con 0x7f9eec101e60 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec117b10 con 0x7f9eec101e60 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ee0010d20 con 0x7f9eec101e60 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee00113a0 con 0x7f9eec101e60 2024-02-20T08:14:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.982+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec117fd0 con 0x7f9eec101e60 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.983+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec104330 con 0x7f9eec101e60 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.983+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9ee0012400 con 0x7f9eec101e60 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.984+0000 7f9ee97fa700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 0x7f9edc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.984+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f9ee008cf10 con 0x7f9eec101e60 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.984+0000 7f9eebfff700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 0x7f9edc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.984+0000 7f9eebfff700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 0x7f9edc06fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8004890 tx=0x7f9ed8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:52.988+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ee0056710 con 0x7f9eec101e60 2024-02-20T08:14:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.196+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eec0667b0 con 0x7f9edc06d7e0 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.206+0000 7f9ee97fa700 1 -- 172.21.15.123:0/3909032441 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9eec0667b0 con 0x7f9edc06d7e0 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (6m) 25s ago 18m 27.0M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (4m) 25s ago 18m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (4m) 3s ago 17m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:14:53.207 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (6m) 25s ago 17m 86.6M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (53s) 25s ago 12m 11.7M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e48e69346378 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (30s) 25s ago 12m 11.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 24e5439a92bf 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (11s) 3s ago 12m 15.0M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1a856c298641 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (12m) 3s ago 12m 275M - 17.2.7-521-gc80e7168 10b0c032c913 ad549af3ede3 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (8m) 25s ago 19m 506M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (7m) 3s ago 17m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (5m) 25s ago 19m 52.8M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (4m) 3s ago 17m 43.5M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (7m) 25s ago 18m 18.4M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 3s ago 17m 15.6M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (3m) 25s ago 16m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (3m) 25s ago 15m 110M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:14:53.208 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (2m) 25s ago 15m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:14:53.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (2m) 3s ago 14m 116M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:14:53.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (105s) 3s ago 14m 97.9M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:14:53.209 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (71s) 3s ago 14m 105M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4adb558e933b 2024-02-20T08:14:53.209 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (7m) 25s ago 17m 58.4M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 msgr2=0x7f9edc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 0x7f9edc06fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8004890 tx=0x7f9ed8009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 msgr2=0x7f9eec10eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c830 tx=0x7f9ee0004470 comp rx=0 tx=0).stop 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 shutdown_connections 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f9edc06d7e0 0x7f9edc06fc90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec101e60 0x7f9eec10eb40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 --2- 172.21.15.123:0/3909032441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec102800 0x7f9eec10f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 >> 172.21.15.123:0/3909032441 conn(0x7f9eec0f7a10 msgr2=0x7f9eec0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 shutdown_connections 2024-02-20T08:14:53.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.208+0000 7f9ef2a87700 1 -- 172.21.15.123:0/3909032441 wait complete. 2024-02-20T08:14:53.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 -- 172.21.15.123:0/3671796767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc0fb570 msgr2=0x7fa9fc0fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 --2- 172.21.15.123:0/3671796767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc0fb9c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec004940 tx=0x7fa9ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 -- 172.21.15.123:0/3671796767 shutdown_connections 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 --2- 172.21.15.123:0/3671796767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc0fb9c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 --2- 172.21.15.123:0/3671796767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc103140 0x7fa9fc103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 -- 172.21.15.123:0/3671796767 >> 172.21.15.123:0/3671796767 conn(0x7fa9fc071560 msgr2=0x7fa9fc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 -- 172.21.15.123:0/3671796767 shutdown_connections 2024-02-20T08:14:53.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.307+0000 7faa03e37700 1 -- 172.21.15.123:0/3671796767 wait complete. 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 Processor -- start 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 -- start start 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc114710 con 0x7fa9fc103140 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa03e37700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc10da40 con 0x7fa9fc0fb570 2024-02-20T08:14:53.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa013d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa013d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42916/0 (socket says 172.21.15.123:42916) 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa013d2700 1 -- 172.21.15.123:0/3548728988 learned_addr learned my addr 172.21.15.123:0/3548728988 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.308+0000 7faa01bd3700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa013d2700 1 -- 172.21.15.123:0/3548728988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc0fb570 msgr2=0x7fa9fc113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa013d2700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa013d2700 1 -- 172.21.15.123:0/3548728988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec005040 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa013d2700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009150 tx=0x7fa9ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec00e040 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc10dcc0 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9ec00bbf0 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec01c3f0 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.309+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc10e200 con 0x7fa9fc103140 2024-02-20T08:14:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.310+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc1054d0 con 0x7fa9fc103140 2024-02-20T08:14:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.310+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa9ec00bd60 con 0x7fa9fc103140 2024-02-20T08:14:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.311+0000 7fa9f27fc700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 0x7fa9e806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.311+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fa9ec08e300 con 0x7fa9fc103140 2024-02-20T08:14:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.311+0000 7faa01bd3700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 0x7fa9e806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.311+0000 7faa01bd3700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 0x7fa9e806fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009fd0 tx=0x7fa9f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.315+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9ec05b590 con 0x7fa9fc103140 2024-02-20T08:14:53.386 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:53 smithi194 ceph-mon[88937]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:53.386 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:53 smithi194 ceph-mon[88937]: pgmap v200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-20T08:14:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:53 smithi123 ceph-mon[112409]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:53.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:53 smithi123 ceph-mon[112409]: pgmap v200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-20T08:14:53.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.593+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9fc10f160 con 0x7fa9fc103140 2024-02-20T08:14:53.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.593+0000 7fa9f27fc700 1 -- 172.21.15.123:0/3548728988 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fa9ec05b120 con 0x7fa9fc103140 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 6 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:53.595 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 3 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 17.2.7-521-gc80e7168 (c80e7168938c48b49e5ce2e002f48bf150b5f4a4) quincy (stable)": 1, 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 13 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:14:53.596 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 msgr2=0x7fa9e806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 0x7fa9e806fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009fd0 tx=0x7fa9f800b040 comp rx=0 tx=0).stop 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 msgr2=0x7fa9fc1140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009150 tx=0x7fa9ec009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 shutdown_connections 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa9e806d7f0 0x7fa9e806fca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9fc0fb570 0x7fa9fc113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.595+0000 7faa03e37700 1 --2- 172.21.15.123:0/3548728988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9fc103140 0x7fa9fc1140c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.596+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 >> 172.21.15.123:0/3548728988 conn(0x7fa9fc071560 msgr2=0x7fa9fc0f97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:53.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.596+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 shutdown_connections 2024-02-20T08:14:53.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.596+0000 7faa03e37700 1 -- 172.21.15.123:0/3548728988 wait complete. 2024-02-20T08:14:53.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- 172.21.15.123:0/3619632215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa084103140 msgr2=0x7fa084103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 --2- 172.21.15.123:0/3619632215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa084103140 0x7fa084103510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa074004940 tx=0x7fa074009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- 172.21.15.123:0/3619632215 shutdown_connections 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 --2- 172.21.15.123:0/3619632215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0840fb570 0x7fa0840fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 --2- 172.21.15.123:0/3619632215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa084103140 0x7fa084103510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- 172.21.15.123:0/3619632215 >> 172.21.15.123:0/3619632215 conn(0x7fa084071560 msgr2=0x7fa084071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- 172.21.15.123:0/3619632215 shutdown_connections 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- 172.21.15.123:0/3619632215 wait complete. 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 Processor -- start 2024-02-20T08:14:53.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 -- start start 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.697+0000 7fa089574700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 0x7fa0841140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa089574700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084114720 con 0x7fa0840fb570 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa089574700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08410da50 con 0x7fa084103140 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42930/0 (socket says 172.21.15.123:42930) 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 -- 172.21.15.123:0/3765310922 learned_addr learned my addr 172.21.15.123:0/3765310922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa0827fc700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 0x7fa0841140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 -- 172.21.15.123:0/3765310922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 msgr2=0x7fa0841140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 0x7fa0841140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 -- 172.21.15.123:0/3765310922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074005040 con 0x7fa0840fb570 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa0827fc700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 0x7fa0841140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:14:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa082ffd700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b3b0 tx=0x7fa074009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07400e040 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08410dcd0 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa07400bbf0 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07401c630 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.698+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08410e210 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.699+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa084105570 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.700+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa07400bd60 con 0x7fa0840fb570 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.700+0000 7fa06b7fe700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 0x7fa06c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.700+0000 7fa0827fc700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 0x7fa06c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.700+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fa07408e460 con 0x7fa0840fb570 2024-02-20T08:14:53.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.700+0000 7fa0827fc700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 0x7fa06c06fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa078009fd0 tx=0x7fa078009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:53.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.705+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa07405b6f0 con 0x7fa0840fb570 2024-02-20T08:14:53.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.940+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa08410a1d0 con 0x7fa0840fb570 2024-02-20T08:14:53.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.940+0000 7fa06b7fe700 1 -- 172.21.15.123:0/3765310922 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fa07405b280 con 0x7fa0840fb570 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:e28 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 28 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:14:46.839776+0000 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:14:53.942 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 91 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:14:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=24289} 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:14:53.944 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{0:24289} state up:active seq 190 join_fscid=1 addr [v2:172.21.15.194:6826/2264298744,v1:172.21.15.194:6827/2264298744] compat {c=[1],r=[1],i=[7ff]}] 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6828/266272272,v1:172.21.15.123:6829/266272272] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:14:53.945 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6824/1865473040,v1:172.21.15.194:6825/1865473040] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 msgr2=0x7fa06c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 0x7fa06c06fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa078009fd0 tx=0x7fa078009f20 comp rx=0 tx=0).stop 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 msgr2=0x7fa084113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b3b0 tx=0x7fa074009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 shutdown_connections 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa06c06d7e0 0x7fa06c06fc90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0840fb570 0x7fa084113b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 --2- 172.21.15.123:0/3765310922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084103140 0x7fa0841140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 >> 172.21.15.123:0/3765310922 conn(0x7fa084071560 msgr2=0x7fa0840f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 shutdown_connections 2024-02-20T08:14:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:53.943+0000 7fa089574700 1 -- 172.21.15.123:0/3765310922 wait complete. 2024-02-20T08:14:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-02-20T08:14:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 -- 172.21.15.123:0/3038378771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75681027e0 msgr2=0x7f75680fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 --2- 172.21.15.123:0/3038378771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75681027e0 0x7f75680fbea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7554004940 tx=0x7f7554009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 -- 172.21.15.123:0/3038378771 shutdown_connections 2024-02-20T08:14:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 --2- 172.21.15.123:0/3038378771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75681027e0 0x7f75680fbea0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 --2- 172.21.15.123:0/3038378771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568101e40 0x7f7568102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 -- 172.21.15.123:0/3038378771 >> 172.21.15.123:0/3038378771 conn(0x7f7568071d90 msgr2=0x7f7568072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 -- 172.21.15.123:0/3038378771 shutdown_connections 2024-02-20T08:14:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.046+0000 7f756edaa700 1 -- 172.21.15.123:0/3038378771 wait complete. 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 Processor -- start 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 -- start start 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75681027e0 0x7f756810f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756810f600 con 0x7f7568101e40 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756edaa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756810f770 con 0x7f75681027e0 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42960/0 (socket says 172.21.15.123:42960) 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 -- 172.21.15.123:0/4234660506 learned_addr learned my addr 172.21.15.123:0/4234660506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f7567fff700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75681027e0 0x7f756810f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 -- 172.21.15.123:0/4234660506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75681027e0 msgr2=0x7f756810f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75681027e0 0x7f756810f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 -- 172.21.15.123:0/4234660506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554005040 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.047+0000 7f756cb46700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f755c002a50 tx=0x7f755c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.048+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c007cc0 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.048+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7568117ae0 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.048+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f755c00f040 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.048+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c009640 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.048+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7568117ff0 con 0x7f7568101e40 2024-02-20T08:14:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.049+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7568104310 con 0x7f7568101e40 2024-02-20T08:14:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.049+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f755c0097a0 con 0x7f7568101e40 2024-02-20T08:14:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.049+0000 7f75657fa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 0x7f755806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.050+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f755c08ce00 con 0x7f7568101e40 2024-02-20T08:14:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.050+0000 7f7567fff700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 0x7f755806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.050+0000 7f7567fff700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 0x7f755806fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fd0 tx=0x7f7554009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.054+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f755c0564e0 con 0x7f7568101e40 2024-02-20T08:14:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.267+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7568065ec0 con 0x7f755806d7e0 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.268+0000 7f75657fa700 1 -- 172.21.15.123:0/4234660506 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7568065ec0 con 0x7f755806d7e0 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024", 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": true, 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [ 2024-02-20T08:14:54.269 INFO:teuthology.orchestra.run.smithi123.stdout: "osd", 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "mon", 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr", 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "crash" 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": "15/21 daemons upgraded", 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "Currently upgrading mds daemons", 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:14:54.270 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:14:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 msgr2=0x7f755806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 0x7f755806fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fd0 tx=0x7f7554009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 msgr2=0x7f756810eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f755c002a50 tx=0x7f755c0046b0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 shutdown_connections 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f755806d7e0 0x7f755806fc90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7568101e40 0x7f756810eb10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 --2- 172.21.15.123:0/4234660506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75681027e0 0x7f756810f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 >> 172.21.15.123:0/4234660506 conn(0x7f7568071d90 msgr2=0x7f75680fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 shutdown_connections 2024-02-20T08:14:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.270+0000 7f756edaa700 1 -- 172.21.15.123:0/4234660506 wait complete. 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- 172.21.15.123:0/569011866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 msgr2=0x7f5c10106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 --2- 172.21.15.123:0/569011866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10106f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c04004940 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- 172.21.15.123:0/569011866 shutdown_connections 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 --2- 172.21.15.123:0/569011866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10106f40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 --2- 172.21.15.123:0/569011866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 0x7f5c100fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- 172.21.15.123:0/569011866 >> 172.21.15.123:0/569011866 conn(0x7f5c100f7a10 msgr2=0x7f5c100f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- 172.21.15.123:0/569011866 shutdown_connections 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- 172.21.15.123:0/569011866 wait complete. 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 Processor -- start 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.371+0000 7f5c1601c700 1 -- start start 2024-02-20T08:14:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c1601c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 0x7f5c10113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c1601c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c1601c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10114640 con 0x7f5c100fe900 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c1601c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1010d970 con 0x7f5c100fdf60 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42966/0 (socket says 172.21.15.123:42966) 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 -- 172.21.15.123:0/3406170531 learned_addr learned my addr 172.21.15.123:0/3406170531 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0f7fe700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 0x7f5c10113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 -- 172.21.15.123:0/3406170531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 msgr2=0x7f5c10113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 0x7f5c10113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 -- 172.21.15.123:0/3406170531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04005040 con 0x7f5c100fe900 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c0effd700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c04007f50 tx=0x7f5c04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c04021070 con 0x7f5c100fe900 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1010dbf0 con 0x7f5c100fe900 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c04013dd0 con 0x7f5c100fe900 2024-02-20T08:14:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.372+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0400e070 con 0x7f5c100fe900 2024-02-20T08:14:54.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.373+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1010e130 con 0x7f5c100fe900 2024-02-20T08:14:54.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.374+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c10104550 con 0x7f5c100fe900 2024-02-20T08:14:54.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.374+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5c0401c400 con 0x7f5c100fe900 2024-02-20T08:14:54.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.374+0000 7f5bf7fff700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 0x7f5bf806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:14:54.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.374+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f5c0408e610 con 0x7f5c100fe900 2024-02-20T08:14:54.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.375+0000 7f5c0f7fe700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 0x7f5bf806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:14:54.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.375+0000 7f5c0f7fe700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 0x7f5bf806fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c00004b50 tx=0x7f5c0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:14:54.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.379+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5c0405b8a0 con 0x7f5c100fe900 2024-02-20T08:14:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:54 smithi194 ceph-mon[88937]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:54 smithi194 ceph-mon[88937]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:54 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3548728988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:54 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3765310922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:14:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:54 smithi123 ceph-mon[112409]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:54 smithi123 ceph-mon[112409]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:54 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3548728988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:54 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3765310922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:14:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.658+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5c10109ff0 con 0x7f5c100fe900 2024-02-20T08:14:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.658+0000 7f5bf7fff700 1 -- 172.21.15.123:0/3406170531 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5c0405b430 con 0x7f5c100fe900 2024-02-20T08:14:54.659 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:14:54.659 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:14:54.659 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:14:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 msgr2=0x7f5bf806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 0x7f5bf806fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c00004b50 tx=0x7f5c0000b040 comp rx=0 tx=0).stop 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 msgr2=0x7f5c10113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c04007f50 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 shutdown_connections 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f5bf806d7e0 0x7f5bf806fc90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c100fdf60 0x7f5c10113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 --2- 172.21.15.123:0/3406170531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c100fe900 0x7f5c10113ff0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 >> 172.21.15.123:0/3406170531 conn(0x7f5c100f7a10 msgr2=0x7f5c101016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 shutdown_connections 2024-02-20T08:14:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:14:54.660+0000 7f5c1601c700 1 -- 172.21.15.123:0/3406170531 wait complete. 2024-02-20T08:14:55.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:55.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3406170531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:14:55.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: pgmap v201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:14:55.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3406170531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:14:55.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: pgmap v201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-02-20T08:14:55.643 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:55.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:14:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:57.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: pgmap v202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: Upgrade: Updating mds.cephfs.smithi194.lquaku 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:57.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:57 smithi194 ceph-mon[88937]: Deploying daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: pgmap v202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: Upgrade: Updating mds.cephfs.smithi194.lquaku 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.lquaku", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:14:58.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:57 smithi123 ceph-mon[112409]: Deploying daemon mds.cephfs.smithi194.lquaku on smithi194 2024-02-20T08:14:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:58 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[112405]: 2024-02-20T08:14:58.834+0000 7fb1bbc8d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: pgmap v203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: osdmap e92: 6 total, 6 up, 6 in 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: Standby daemon mds.cephfs.smithi123.gglmsl assigned to filesystem cephfs as rank 0 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:15:00.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:15:00.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:14:59 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:replay} 2 up:standby 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: pgmap v203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: osdmap e92: 6 total, 6 up, 6 in 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: Standby daemon mds.cephfs.smithi123.gglmsl assigned to filesystem cephfs as rank 0 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-20T08:15:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-20T08:15:00.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:14:59 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:replay} 2 up:standby 2024-02-20T08:15:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:01 smithi194 ceph-mon[88937]: pgmap v205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-02-20T08:15:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:01 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:01 smithi123 ceph-mon[112409]: pgmap v205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-02-20T08:15:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:01 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:03 smithi194 ceph-mon[88937]: pgmap v206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-02-20T08:15:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:03 smithi123 ceph-mon[112409]: pgmap v206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-02-20T08:15:06.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:05 smithi123 ceph-mon[112409]: pgmap v207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 0 B/s wr, 5 op/s 2024-02-20T08:15:06.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:05 smithi194 ceph-mon[88937]: pgmap v207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 0 B/s wr, 5 op/s 2024-02-20T08:15:08.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:07 smithi123 ceph-mon[112409]: pgmap v208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 5 op/s 2024-02-20T08:15:08.093 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:07 smithi194 ceph-mon[88937]: pgmap v208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 5 op/s 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: pgmap v209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 0 B/s wr, 6 op/s 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999977 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.00199995 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:reconnect 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:reconnect} 2 up:standby 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: pgmap v209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 0 B/s wr, 6 op/s 2024-02-20T08:15:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: reconnect by client.14538 192.168.0.1:0/3934461339 after 0.000999977 2024-02-20T08:15:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: reconnect by client.24327 192.168.0.1:0/2934764264 after 0.00199995 2024-02-20T08:15:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:reconnect 2024-02-20T08:15:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:reconnect} 2 up:standby 2024-02-20T08:15:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:10.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:11.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:rejoin 2024-02-20T08:15:11.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.194:6826/1906868462,v1:172.21.15.194:6827/1906868462] up:boot 2024-02-20T08:15:11.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:rejoin} 3 up:standby 2024-02-20T08:15:11.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:11.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: daemon mds.cephfs.smithi123.gglmsl is now active in filesystem cephfs as rank 0 2024-02-20T08:15:11.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:11.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:rejoin 2024-02-20T08:15:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.194:6826/1906868462,v1:172.21.15.194:6827/1906868462] up:boot 2024-02-20T08:15:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: fsmap cephfs:1/1 {0=cephfs.smithi123.gglmsl=up:rejoin} 3 up:standby 2024-02-20T08:15:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: daemon mds.cephfs.smithi123.gglmsl is now active in filesystem cephfs as rank 0 2024-02-20T08:15:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: pgmap v210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:active 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: pgmap v210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: mds.? [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] up:active 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:13 smithi194 ceph-mon[88937]: pgmap v211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-02-20T08:15:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:13 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:13 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:13 smithi123 ceph-mon[112409]: pgmap v211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-02-20T08:15:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:13 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:13 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:15.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:15 smithi194 ceph-mon[88937]: pgmap v212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 255 B/s wr, 7 op/s 2024-02-20T08:15:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:15 smithi123 ceph-mon[112409]: pgmap v212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 255 B/s wr, 7 op/s 2024-02-20T08:15:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:17.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all mds 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.gglmsl"}]': finished 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.uffypv"}]': finished 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.icyfny"}]': finished 2024-02-20T08:15:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.lquaku"}]': finished 2024-02-20T08:15:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: Upgrade: Setting filesystem cephfs Joinable 2024-02-20T08:15:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-20T08:15:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:17 smithi123 ceph-mon[112409]: pgmap v213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-20T08:15:17.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all mds 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.gglmsl"}]: dispatch 2024-02-20T08:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.gglmsl"}]': finished 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.uffypv"}]: dispatch 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi123.uffypv"}]': finished 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.icyfny"}]: dispatch 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.icyfny"}]': finished 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.lquaku"}]: dispatch 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.lquaku"}]': finished 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: Upgrade: Setting filesystem cephfs Joinable 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-20T08:15:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:17 smithi194 ceph-mon[88937]: pgmap v213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all rgw 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all rbd-mirror 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all ceph-exporter 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all iscsi 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all nfs 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Setting container_image for all nvmeof 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Finalizing container_image settings 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-20T08:15:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-20T08:15:18.762 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: Upgrade: Complete! 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-20T08:15:18.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:18.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: fsmap cephfs:1 {0=cephfs.smithi123.gglmsl=up:active} 3 up:standby 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all rgw 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all rbd-mirror 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all ceph-exporter 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all iscsi 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all nfs 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Setting container_image for all nvmeof 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Finalizing container_image settings 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: Upgrade: Complete! 2024-02-20T08:15:18.898 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:15:18.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:19.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:19 smithi123 ceph-mon[112409]: pgmap v214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-20T08:15:19.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:19 smithi194 ceph-mon[88937]: pgmap v214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-20T08:15:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:21 smithi123 ceph-mon[112409]: pgmap v215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-02-20T08:15:22.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:21 smithi194 ceph-mon[88937]: pgmap v215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-02-20T08:15:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:23 smithi123 ceph-mon[112409]: pgmap v216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:15:24.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:23 smithi194 ceph-mon[88937]: pgmap v216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-02-20T08:15:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 -- 172.21.15.123:0/2352978815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fdfe0 msgr2=0x7f734c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 --2- 172.21.15.123:0/2352978815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fdfe0 0x7f734c0fe3b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7348004970 tx=0x7f7348009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 -- 172.21.15.123:0/2352978815 shutdown_connections 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 --2- 172.21.15.123:0/2352978815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fe8f0 0x7f734c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 --2- 172.21.15.123:0/2352978815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fdfe0 0x7f734c0fe3b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 -- 172.21.15.123:0/2352978815 >> 172.21.15.123:0/2352978815 conn(0x7f734c071d90 msgr2=0x7f734c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 -- 172.21.15.123:0/2352978815 shutdown_connections 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 -- 172.21.15.123:0/2352978815 wait complete. 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.779+0000 7f735348a700 1 Processor -- start 2024-02-20T08:15:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f735348a700 1 -- start start 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f735348a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 0x7f734c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f735348a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f735348a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1145e0 con 0x7f734c0fe8f0 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f735348a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c10d910 con 0x7f734c0fdfe0 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47330/0 (socket says 172.21.15.123:47330) 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 -- 172.21.15.123:0/2394340854 learned_addr learned my addr 172.21.15.123:0/2394340854 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7351226700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 0x7f734c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 -- 172.21.15.123:0/2394340854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 msgr2=0x7f734c113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 0x7f734c113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 -- 172.21.15.123:0/2394340854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348005040 con 0x7f734c0fe8f0 2024-02-20T08:15:24.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7351226700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 0x7f734c113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.780+0000 7f7350a25700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f733c00eb40 tx=0x7f733c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.781+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c007cc0 con 0x7f734c0fe8f0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.781+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f733c00f040 con 0x7f734c0fe8f0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.781+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c10db90 con 0x7f734c0fe8f0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.781+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c009620 con 0x7f734c0fe8f0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.781+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c10e0d0 con 0x7f734c0fe8f0 2024-02-20T08:15:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.782+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c1046c0 con 0x7f734c0fe8f0 2024-02-20T08:15:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.782+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f733c009780 con 0x7f734c0fe8f0 2024-02-20T08:15:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.783+0000 7f7341ffb700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 0x7f733806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.783+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f733c08cd30 con 0x7f734c0fe8f0 2024-02-20T08:15:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.783+0000 7f7351226700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 0x7f733806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.783+0000 7f7351226700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 0x7f733806fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:24.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:24.788+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f733c059fa0 con 0x7f734c0fe8f0 2024-02-20T08:15:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.003+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f734c10a030 con 0x7f733806d7e0 2024-02-20T08:15:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.004+0000 7f7341ffb700 1 -- 172.21.15.123:0/2394340854 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f734c10a030 con 0x7f733806d7e0 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 msgr2=0x7f733806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 0x7f733806fc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 msgr2=0x7f734c113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f733c00eb40 tx=0x7f733c00b040 comp rx=0 tx=0).stop 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 shutdown_connections 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f733806d7e0 0x7f733806fc90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734c0fdfe0 0x7f734c113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 --2- 172.21.15.123:0/2394340854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c0fe8f0 0x7f734c113f90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 >> 172.21.15.123:0/2394340854 conn(0x7f734c071d90 msgr2=0x7f734c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 shutdown_connections 2024-02-20T08:15:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:25.006+0000 7f735348a700 1 -- 172.21.15.123:0/2394340854 wait complete. 2024-02-20T08:15:25.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch ps' 2024-02-20T08:15:25.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:25 smithi194 ceph-mon[88937]: pgmap v217: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-20T08:15:25.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:25.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:25.939 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:25 smithi123 ceph-mon[112409]: pgmap v217: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-20T08:15:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:15:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:27.035 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:26 smithi123 ceph-mon[112409]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:27.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:26 smithi194 ceph-mon[88937]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 -- 172.21.15.123:0/2160388162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fdf80 msgr2=0x7fdf140fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/2160388162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fdf80 0x7fdf140fe350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdf10004940 tx=0x7fdf10009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 -- 172.21.15.123:0/2160388162 shutdown_connections 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/2160388162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fe920 0x7fdf14106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/2160388162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fdf80 0x7fdf140fe350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 -- 172.21.15.123:0/2160388162 >> 172.21.15.123:0/2160388162 conn(0x7fdf140f79e0 msgr2=0x7fdf140f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 -- 172.21.15.123:0/2160388162 shutdown_connections 2024-02-20T08:15:27.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.595+0000 7fdf1ba36700 1 -- 172.21.15.123:0/2160388162 wait complete. 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 Processor -- start 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 -- start start 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fdf80 0x7fdf14113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14114750 con 0x7fdf140fe920 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf1ba36700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1410d9f0 con 0x7fdf140fdf80 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf18fd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf18fd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47342/0 (socket says 172.21.15.123:47342) 2024-02-20T08:15:27.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf18fd1700 1 -- 172.21.15.123:0/4037840087 learned_addr learned my addr 172.21.15.123:0/4037840087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf197d2700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fdf80 0x7fdf14113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.596+0000 7fdf18fd1700 1 -- 172.21.15.123:0/4037840087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fdf80 msgr2=0x7fdf14113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf18fd1700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fdf80 0x7fdf14113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf18fd1700 1 -- 172.21.15.123:0/4037840087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10005040 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf18fd1700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400b790 tx=0x7fdf04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0400f6f0 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf0400fd20 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1410dcd0 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf040103a0 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.597+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1410e210 con 0x7fdf140fe920 2024-02-20T08:15:27.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.598+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf141046b0 con 0x7fdf140fe920 2024-02-20T08:15:27.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.598+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fdf04011400 con 0x7fdf140fe920 2024-02-20T08:15:27.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.599+0000 7fdf09ffb700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 0x7fdf0006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:27.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.599+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fdf0408ce80 con 0x7fdf140fe920 2024-02-20T08:15:27.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.599+0000 7fdf197d2700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 0x7fdf0006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:27.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.599+0000 7fdf197d2700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 0x7fdf0006fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3b0 tx=0x7fdf10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:27.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.604+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdf0405a0c0 con 0x7fdf140fe920 2024-02-20T08:15:27.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.806+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1410a070 con 0x7fdf0006d7e0 2024-02-20T08:15:27.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.816+0000 7fdf09ffb700 1 -- 172.21.15.123:0/4037840087 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdf1410a070 con 0x7fdf0006d7e0 2024-02-20T08:15:27.816 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:15:27.816 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (7m) 60s ago 19m 27.0M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:15:27.816 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (4m) 60s ago 19m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:15:27.816 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (4m) 16s ago 17m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (7m) 60s ago 18m 86.6M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (88s) 60s ago 13m 11.7M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e48e69346378 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (65s) 60s ago 13m 11.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 24e5439a92bf 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (45s) 16s ago 13m 15.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1a856c298641 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (18s) 16s ago 13m 12.3M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e33159a2b85d 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (9m) 60s ago 20m 506M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (8m) 16s ago 17m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (5m) 60s ago 20m 52.8M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (5m) 16s ago 17m 43.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (7m) 60s ago 19m 18.4M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 16s ago 17m 16.2M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (4m) 60s ago 16m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (4m) 60s ago 16m 110M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:15:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (3m) 60s ago 15m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:15:27.818 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (2m) 16s ago 15m 115M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:15:27.818 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (2m) 16s ago 15m 99.0M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:15:27.818 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (105s) 16s ago 14m 106M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4adb558e933b 2024-02-20T08:15:27.818 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (7m) 60s ago 18m 58.4M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 msgr2=0x7fdf0006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 0x7fdf0006fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3b0 tx=0x7fdf10009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 msgr2=0x7fdf14114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400b790 tx=0x7fdf04009250 comp rx=0 tx=0).stop 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 shutdown_connections 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fdf0006d7e0 0x7fdf0006fc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf140fdf80 0x7fdf14113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 --2- 172.21.15.123:0/4037840087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf140fe920 0x7fdf14114070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 >> 172.21.15.123:0/4037840087 conn(0x7fdf140f79e0 msgr2=0x7fdf14101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 shutdown_connections 2024-02-20T08:15:27.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:27.818+0000 7fdf1ba36700 1 -- 172.21.15.123:0/4037840087 wait complete. 2024-02-20T08:15:28.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:27 smithi123 ceph-mon[112409]: pgmap v218: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-02-20T08:15:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:27 smithi194 ceph-mon[88937]: pgmap v218: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-02-20T08:15:28.459 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch upgrade status' 2024-02-20T08:15:28.724 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:28 smithi123 ceph-mon[112409]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:29.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:28 smithi194 ceph-mon[88937]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:29.984 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:29 smithi123 ceph-mon[112409]: pgmap v219: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-20T08:15:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:29 smithi194 ceph-mon[88937]: pgmap v219: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-20T08:15:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 -- 172.21.15.123:0/1634088177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 msgr2=0x7f460c1022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1634088177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c1022b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45f4004940 tx=0x7f45f4009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 -- 172.21.15.123:0/1634088177 shutdown_connections 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1634088177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c0fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1634088177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c1022b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 -- 172.21.15.123:0/1634088177 >> 172.21.15.123:0/1634088177 conn(0x7f460c071560 msgr2=0x7f460c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 -- 172.21.15.123:0/1634088177 shutdown_connections 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.510+0000 7f4610c2d700 1 -- 172.21.15.123:0/1634088177 wait complete. 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.511+0000 7f4610c2d700 1 Processor -- start 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.511+0000 7f4610c2d700 1 -- start start 2024-02-20T08:15:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c10cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c10d220 con 0x7f460c101ee0 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c10d360 con 0x7f460c102880 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41840/0 (socket says 172.21.15.123:41840) 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 -- 172.21.15.123:0/1978103601 learned_addr learned my addr 172.21.15.123:0/1978103601 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4609d9b700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c10cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:30.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 -- 172.21.15.123:0/1978103601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 msgr2=0x7f460c10cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c10cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 -- 172.21.15.123:0/1978103601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4005040 con 0x7f460c101ee0 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4609d9b700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f460a59c700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b3b0 tx=0x7f45f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f400e040 con 0x7f460c101ee0 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c10d5e0 con 0x7f460c101ee0 2024-02-20T08:15:30.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45f400bbf0 con 0x7f460c101ee0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f401c630 con 0x7f460c101ee0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.512+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c11a190 con 0x7f460c101ee0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.513+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c0ff1f0 con 0x7f460c101ee0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.514+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f45f400bd60 con 0x7f460c101ee0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.514+0000 7f4602ffd700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 0x7f45f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.515+0000 7f4609d9b700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 0x7f45f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.515+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f45f408e450 con 0x7f460c101ee0 2024-02-20T08:15:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.515+0000 7f4609d9b700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 0x7f45f806fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009fd0 tx=0x7f45fc009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.519+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f45f4057b60 con 0x7f460c101ee0 2024-02-20T08:15:30.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.735+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f460c04bf40 con 0x7f45f806d7e0 2024-02-20T08:15:30.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.736+0000 7f4602ffd700 1 -- 172.21.15.123:0/1978103601 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f460c04bf40 con 0x7f45f806d7e0 2024-02-20T08:15:30.737 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:15:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "target_image": null, 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "in_progress": false, 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "which": "", 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "services_complete": [], 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "progress": null, 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "is_paused": false 2024-02-20T08:15:30.738 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 msgr2=0x7f45f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 0x7f45f806fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009fd0 tx=0x7f45fc009ee0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 msgr2=0x7f460c10c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b3b0 tx=0x7f45f4009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 shutdown_connections 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f45f806d7e0 0x7f45f806fc90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c101ee0 0x7f460c10c7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 --2- 172.21.15.123:0/1978103601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c102880 0x7f460c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:30.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 >> 172.21.15.123:0/1978103601 conn(0x7f460c071560 msgr2=0x7f460c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:30.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 shutdown_connections 2024-02-20T08:15:30.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:30.738+0000 7f4610c2d700 1 -- 172.21.15.123:0/1978103601 wait complete. 2024-02-20T08:15:31.577 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph health detail' 2024-02-20T08:15:31.839 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:32.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:31 smithi123 ceph-mon[112409]: pgmap v220: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-20T08:15:32.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:31 smithi123 ceph-mon[112409]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:31 smithi194 ceph-mon[88937]: pgmap v220: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-20T08:15:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:31 smithi194 ceph-mon[88937]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 -- 172.21.15.123:0/550382443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c101e60 msgr2=0x7f0e6c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 --2- 172.21.15.123:0/550382443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c101e60 0x7f0e6c102230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e68004940 tx=0x7f0e68009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 -- 172.21.15.123:0/550382443 shutdown_connections 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 --2- 172.21.15.123:0/550382443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c102800 0x7f0e6c0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 --2- 172.21.15.123:0/550382443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c101e60 0x7f0e6c102230 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.558+0000 7f0e73c84700 1 -- 172.21.15.123:0/550382443 >> 172.21.15.123:0/550382443 conn(0x7f0e6c0f7a10 msgr2=0x7f0e6c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 -- 172.21.15.123:0/550382443 shutdown_connections 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 -- 172.21.15.123:0/550382443 wait complete. 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 Processor -- start 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 -- start start 2024-02-20T08:15:33.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 0x7f0e6c112990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1135b0 con 0x7f0e6c102800 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e73c84700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c10c850 con 0x7f0e6c101e60 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e7121f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e7121f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41868/0 (socket says 172.21.15.123:41868) 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.559+0000 7f0e7121f700 1 -- 172.21.15.123:0/750756681 learned_addr learned my addr 172.21.15.123:0/750756681 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e71a20700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 0x7f0e6c112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e7121f700 1 -- 172.21.15.123:0/750756681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 msgr2=0x7f0e6c112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e7121f700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 0x7f0e6c112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e7121f700 1 -- 172.21.15.123:0/750756681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68005040 con 0x7f0e6c102800 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e71a20700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 0x7f0e6c112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e7121f700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00b790 tx=0x7f0e5c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c00f6f0 con 0x7f0e6c102800 2024-02-20T08:15:33.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e5c00fd20 con 0x7f0e6c102800 2024-02-20T08:15:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c0103a0 con 0x7f0e6c102800 2024-02-20T08:15:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c10cb30 con 0x7f0e6c102800 2024-02-20T08:15:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.560+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c10d070 con 0x7f0e6c102800 2024-02-20T08:15:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.561+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c0fb610 con 0x7f0e6c102800 2024-02-20T08:15:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.562+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0e5c011400 con 0x7f0e6c102800 2024-02-20T08:15:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.562+0000 7f0e627fc700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 0x7f0e5806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.562+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f0e5c08ce60 con 0x7f0e6c102800 2024-02-20T08:15:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.562+0000 7f0e71a20700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 0x7f0e5806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:33.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.562+0000 7f0e71a20700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 0x7f0e5806fc90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e68004f90 tx=0x7f0e68009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:33.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.567+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0e5c05a0a0 con 0x7f0e6c102800 2024-02-20T08:15:33.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.842+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0e6c10df70 con 0x7f0e6c102800 2024-02-20T08:15:33.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.842+0000 7f0e627fc700 1 -- 172.21.15.123:0/750756681 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0e5c059c30 con 0x7f0e6c102800 2024-02-20T08:15:33.844 INFO:teuthology.orchestra.run.smithi123.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:15:33.844 INFO:teuthology.orchestra.run.smithi123.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-20T08:15:33.844 INFO:teuthology.orchestra.run.smithi123.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-20T08:15:33.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 msgr2=0x7f0e5806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:33.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 0x7f0e5806fc90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e68004f90 tx=0x7f0e68009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:33.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 msgr2=0x7f0e6c112ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:33.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00b790 tx=0x7f0e5c009220 comp rx=0 tx=0).stop 2024-02-20T08:15:33.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 shutdown_connections 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0e5806d7e0 0x7f0e5806fc90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c101e60 0x7f0e6c112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 --2- 172.21.15.123:0/750756681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e6c102800 0x7f0e6c112ed0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 >> 172.21.15.123:0/750756681 conn(0x7f0e6c0f7a10 msgr2=0x7f0e6c0f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 shutdown_connections 2024-02-20T08:15:33.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:33.844+0000 7f0e73c84700 1 -- 172.21.15.123:0/750756681 wait complete. 2024-02-20T08:15:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:33 smithi194 ceph-mon[88937]: pgmap v221: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:34.197 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:33 smithi123 ceph-mon[112409]: pgmap v221: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:34.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions' 2024-02-20T08:15:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:34.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:34 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/750756681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:15:35.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:34 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/750756681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-20T08:15:36.047 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:35 smithi123 ceph-mon[112409]: pgmap v222: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:35 smithi194 ceph-mon[88937]: pgmap v222: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:36.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.412+0000 7f354d9c0700 1 -- 172.21.15.123:0/2814026054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 msgr2=0x7f3548102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.412+0000 7f354d9c0700 1 --2- 172.21.15.123:0/2814026054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548102210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3538004940 tx=0x7f3538009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 -- 172.21.15.123:0/2814026054 shutdown_connections 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 --2- 172.21.15.123:0/2814026054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 0x7f35480fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 --2- 172.21.15.123:0/2814026054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548102210 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 -- 172.21.15.123:0/2814026054 >> 172.21.15.123:0/2814026054 conn(0x7f3548071d90 msgr2=0x7f3548072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 -- 172.21.15.123:0/2814026054 shutdown_connections 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 -- 172.21.15.123:0/2814026054 wait complete. 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 Processor -- start 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 -- start start 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.413+0000 7f354d9c0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:36.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f354d9c0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 0x7f3548113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f354d9c0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481146a0 con 0x7f3548101e40 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f354d9c0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354810d940 con 0x7f35481027e0 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41886/0 (socket says 172.21.15.123:41886) 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 -- 172.21.15.123:0/1903163212 learned_addr learned my addr 172.21.15.123:0/1903163212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 -- 172.21.15.123:0/1903163212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 msgr2=0x7f3548113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f35467fc700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 0x7f3548113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 0x7f3548113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 -- 172.21.15.123:0/1903163212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538005040 con 0x7f3548101e40 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f3546ffd700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f353800b3b0 tx=0x7f3538009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353800e040 con 0x7f3548101e40 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354810dbc0 con 0x7f3548101e40 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f353800bbf0 con 0x7f3548101e40 2024-02-20T08:15:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353801c630 con 0x7f3548101e40 2024-02-20T08:15:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.414+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354810e100 con 0x7f3548101e40 2024-02-20T08:15:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.415+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35480738b0 con 0x7f3548101e40 2024-02-20T08:15:36.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.416+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f353800bd60 con 0x7f3548101e40 2024-02-20T08:15:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.416+0000 7f352f7fe700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 0x7f353006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:15:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.416+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f353808e4b0 con 0x7f3548101e40 2024-02-20T08:15:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.416+0000 7f35467fc700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 0x7f353006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:15:36.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.417+0000 7f35467fc700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 0x7f353006fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f353c006fd0 tx=0x7f353c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:15:36.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.421+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f353805b6f0 con 0x7f3548101e40 2024-02-20T08:15:36.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.694+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f354810f060 con 0x7f3548101e40 2024-02-20T08:15:36.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.694+0000 7f352f7fe700 1 -- 172.21.15.123:0/1903163212 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f353805b280 con 0x7f3548101e40 2024-02-20T08:15:36.695 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 6 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:15:36.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 14 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 msgr2=0x7f353006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 0x7f353006fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f353c006fd0 tx=0x7f353c008040 comp rx=0 tx=0).stop 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 msgr2=0x7f3548113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:15:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f353800b3b0 tx=0x7f3538009e30 comp rx=0 tx=0).stop 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 shutdown_connections 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f353006d7e0 0x7f353006fc90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3548101e40 0x7f3548113a80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 --2- 172.21.15.123:0/1903163212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35481027e0 0x7f3548113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 >> 172.21.15.123:0/1903163212 conn(0x7f3548071d90 msgr2=0x7f35480656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 shutdown_connections 2024-02-20T08:15:36.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:15:36.696+0000 7f354d9c0700 1 -- 172.21.15.123:0/1903163212 wait complete. 2024-02-20T08:15:37.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:36 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1903163212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:37.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:36 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1903163212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:15:37.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-20T08:15:37.590 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:38.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:37 smithi123 ceph-mon[112409]: pgmap v223: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:38.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:37 smithi194 ceph-mon[88937]: pgmap v223: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:39.222 INFO:teuthology.orchestra.run.smithi123.stdout:wait for servicemap items w/ changing names to refresh 2024-02-20T08:15:39.842 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:39 smithi123 ceph-mon[112409]: pgmap v224: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:39.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'sleep 60' 2024-02-20T08:15:40.132 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:15:40.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:39 smithi194 ceph-mon[88937]: pgmap v224: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:41 smithi194 ceph-mon[88937]: pgmap v225: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:41 smithi123 ceph-mon[112409]: pgmap v225: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:43 smithi194 ceph-mon[88937]: pgmap v226: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:44.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:43 smithi123 ceph-mon[112409]: pgmap v226: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:45 smithi194 ceph-mon[88937]: pgmap v227: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:45 smithi123 ceph-mon[112409]: pgmap v227: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:48.061 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:47 smithi123 ceph-mon[112409]: pgmap v228: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:47 smithi194 ceph-mon[88937]: pgmap v228: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:49 smithi194 ceph-mon[88937]: pgmap v229: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:49 smithi123 ceph-mon[112409]: pgmap v229: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:51 smithi194 ceph-mon[88937]: pgmap v230: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:51 smithi123 ceph-mon[112409]: pgmap v230: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:53 smithi194 ceph-mon[88937]: pgmap v231: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:54.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:53 smithi123 ceph-mon[112409]: pgmap v231: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:55 smithi194 ceph-mon[88937]: pgmap v232: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:55 smithi123 ceph-mon[112409]: pgmap v232: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:15:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:57 smithi194 ceph-mon[88937]: pgmap v233: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:15:58.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:57 smithi123 ceph-mon[112409]: pgmap v233: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:15:59 smithi194 ceph-mon[88937]: pgmap v234: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:15:59 smithi123 ceph-mon[112409]: pgmap v234: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:01 smithi194 ceph-mon[88937]: pgmap v235: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:01 smithi123 ceph-mon[112409]: pgmap v235: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:03 smithi194 ceph-mon[88937]: pgmap v236: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:03 smithi123 ceph-mon[112409]: pgmap v236: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:05 smithi194 ceph-mon[88937]: pgmap v237: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:05 smithi123 ceph-mon[112409]: pgmap v237: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:08.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:07 smithi194 ceph-mon[88937]: pgmap v238: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:08.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:07 smithi123 ceph-mon[112409]: pgmap v238: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:09 smithi194 ceph-mon[88937]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:09 smithi123 ceph-mon[112409]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:11 smithi194 ceph-mon[88937]: pgmap v240: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:12.262 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:11 smithi123 ceph-mon[112409]: pgmap v240: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:12 smithi194 ceph-mon[88937]: pgmap v241: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:13.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:12 smithi123 ceph-mon[112409]: pgmap v241: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:16.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:15 smithi123 ceph-mon[112409]: pgmap v242: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:15 smithi194 ceph-mon[88937]: pgmap v242: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:18.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:17 smithi123 ceph-mon[112409]: pgmap v243: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:17 smithi194 ceph-mon[88937]: pgmap v243: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:16:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:16:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:19 smithi194 ceph-mon[88937]: pgmap v244: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:16:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:16:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:19 smithi123 ceph-mon[112409]: pgmap v244: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:16:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:16:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:16:22.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:21 smithi194 ceph-mon[88937]: pgmap v245: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:21 smithi123 ceph-mon[112409]: pgmap v245: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:23 smithi194 ceph-mon[88937]: pgmap v246: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:23 smithi123 ceph-mon[112409]: pgmap v246: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:25 smithi194 ceph-mon[88937]: pgmap v247: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:25 smithi123 ceph-mon[112409]: pgmap v247: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:28.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:27 smithi123 ceph-mon[112409]: pgmap v248: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:27 smithi194 ceph-mon[88937]: pgmap v248: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:29 smithi194 ceph-mon[88937]: pgmap v249: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:29 smithi123 ceph-mon[112409]: pgmap v249: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:31 smithi194 ceph-mon[88937]: pgmap v250: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:32.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:31 smithi123 ceph-mon[112409]: pgmap v250: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:33 smithi194 ceph-mon[88937]: pgmap v251: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:33 smithi123 ceph-mon[112409]: pgmap v251: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:36.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:35 smithi123 ceph-mon[112409]: pgmap v252: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:35 smithi194 ceph-mon[88937]: pgmap v252: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:38.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:37 smithi123 ceph-mon[112409]: pgmap v253: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:38.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:37 smithi194 ceph-mon[88937]: pgmap v253: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:39 smithi194 ceph-mon[88937]: pgmap v254: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:39 smithi123 ceph-mon[112409]: pgmap v254: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:41.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:41.879 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:41 smithi123 ceph-mon[112409]: pgmap v255: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:42.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:41 smithi194 ceph-mon[88937]: pgmap v255: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:42.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph orch ps' 2024-02-20T08:16:42.578 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:16:43.853 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:43 smithi123 ceph-mon[112409]: pgmap v256: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- 172.21.15.123:0/3997600808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380102800 msgr2=0x7f73800fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 --2- 172.21.15.123:0/3997600808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380102800 0x7f73800fbe70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7374004940 tx=0x7f7374009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- 172.21.15.123:0/3997600808 shutdown_connections 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 --2- 172.21.15.123:0/3997600808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380102800 0x7f73800fbe70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 --2- 172.21.15.123:0/3997600808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380101e60 0x7f7380102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- 172.21.15.123:0/3997600808 >> 172.21.15.123:0/3997600808 conn(0x7f73800f7a10 msgr2=0x7f73800f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- 172.21.15.123:0/3997600808 shutdown_connections 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- 172.21.15.123:0/3997600808 wait complete. 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 Processor -- start 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.111+0000 7f7384e5f700 1 -- start start 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380102800 0x7f7380114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380114700 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738010d9a0 con 0x7f7380102800 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44054/0 (socket says 172.21.15.123:44054) 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 -- 172.21.15.123:0/1102827074 learned_addr learned my addr 172.21.15.123:0/1102827074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737dd9b700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380102800 0x7f7380114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 -- 172.21.15.123:0/1102827074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380102800 msgr2=0x7f7380114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380102800 0x7f7380114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 -- 172.21.15.123:0/1102827074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374005040 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f737e59c700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f737000b790 tx=0x7f7370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737000f770 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738010dc80 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f737000fda0 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737000d310 con 0x7f7380101e60 2024-02-20T08:16:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.112+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738010e1c0 con 0x7f7380101e60 2024-02-20T08:16:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.113+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73800fb610 con 0x7f7380101e60 2024-02-20T08:16:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.114+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7370010420 con 0x7f7380101e60 2024-02-20T08:16:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.114+0000 7f736effd700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 0x7f736806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.114+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f737008cff0 con 0x7f7380101e60 2024-02-20T08:16:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.114+0000 7f737dd9b700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 0x7f736806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.115+0000 7f737dd9b700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 0x7f736806fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f738010f310 tx=0x7f7374009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.119+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f737005a2d0 con 0x7f7380101e60 2024-02-20T08:16:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:43 smithi194 ceph-mon[88937]: pgmap v256: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:44.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.320+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 --> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f738010f130 con 0x7f736806d7f0 2024-02-20T08:16:44.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.330+0000 7f736effd700 1 -- 172.21.15.123:0/1102827074 <== mgr.34104 v2:172.21.15.123:6800/1892793252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f738010f130 con 0x7f736806d7f0 2024-02-20T08:16:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-20T08:16:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (8m) 2m ago 20m 27.0M - 0.25.0 c8568f914cd2 352327ed4136 2024-02-20T08:16:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (6m) 2m ago 20m 6665k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 37059cb69359 2024-02-20T08:16:44.330 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi194 smithi194 running (6m) 92s ago 19m 6660k - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 151f61790287 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (8m) 2m ago 19m 86.6M - 9.4.12 a0ea5e3c46d9 32849e0c444e 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.gglmsl smithi123 running (2m) 2m ago 14m 11.7M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e48e69346378 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi123.uffypv smithi123 running (2m) 2m ago 14m 11.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 24e5439a92bf 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.icyfny smithi194 running (2m) 92s ago 14m 15.1M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1a856c298641 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mds.cephfs.smithi194.lquaku smithi194 running (95s) 92s ago 14m 12.3M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab e33159a2b85d 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.kwyrtl smithi123 *:8443,9283,8765 running (10m) 2m ago 21m 506M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab cac2147160d6 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi194.pvhorj smithi194 *:8443,9283,8765 running (9m) 92s ago 19m 450M - 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 2cda40b942d7 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (7m) 2m ago 21m 52.8M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab f4d830a071cf 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi194 smithi194 running (6m) 92s ago 18m 43.9M 2048M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4bbf28b07222 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (9m) 2m ago 20m 18.4M - 1.5.0 0da6a335fe13 2e014e8231b8 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi194 smithi194 *:9100 running (9m) 92s ago 19m 16.2M - 1.5.0 0da6a335fe13 f9cb1a1d54d1 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (5m) 2m ago 18m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4a75c51dc4c0 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (5m) 2m ago 17m 110M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 88009b2a7ba9 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (4m) 2m ago 17m 106M 1557M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 41dddae346a5 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi194 running (4m) 92s ago 16m 115M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4027a6b27e20 2024-02-20T08:16:44.331 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi194 running (3m) 92s ago 16m 99.0M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 1cd125d8bd9e 2024-02-20T08:16:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi194 running (3m) 92s ago 15m 106M 2581M 19.0.0-1587-g91ff50e9 fef5ea4fa2ab 4adb558e933b 2024-02-20T08:16:44.332 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (8m) 2m ago 19m 58.4M - 2.43.0 a07b618ecd1d c688374f2fd4 2024-02-20T08:16:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 msgr2=0x7f736806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 0x7f736806fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f738010f310 tx=0x7f7374009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 msgr2=0x7f7380113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f737000b790 tx=0x7f7370009250 comp rx=0 tx=0).stop 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 shutdown_connections 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f736806d7f0 0x7f736806fca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7380101e60 0x7f7380113ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 --2- 172.21.15.123:0/1102827074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7380102800 0x7f7380114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 >> 172.21.15.123:0/1102827074 conn(0x7f73800f7a10 msgr2=0x7f7380065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 shutdown_connections 2024-02-20T08:16:44.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:44.332+0000 7f7384e5f700 1 -- 172.21.15.123:0/1102827074 wait complete. 2024-02-20T08:16:45.017 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions' 2024-02-20T08:16:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:16:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:45 smithi123 ceph-mon[112409]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:16:46.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:45 smithi123 ceph-mon[112409]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:46.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:45 smithi194 ceph-mon[88937]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-20T08:16:46.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:45 smithi194 ceph-mon[88937]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:46.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/70689193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 msgr2=0x7ff9a80fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:46.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/70689193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a80fcf60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff99c004940 tx=0x7ff99c009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:46.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/70689193 shutdown_connections 2024-02-20T08:16:46.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/70689193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a80fcf60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/70689193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/70689193 >> 172.21.15.123:0/70689193 conn(0x7ff9a80f8ae0 msgr2=0x7ff9a80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/70689193 shutdown_connections 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.878+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/70689193 wait complete. 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 Processor -- start 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 -- start start 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8114670 con 0x7ff9a81038f0 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9ad4f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a810d980 con 0x7ff9a8102f50 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9a67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9a67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44080/0 (socket says 172.21.15.123:44080) 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.879+0000 7ff9a67fc700 1 -- 172.21.15.123:0/3547694512 learned_addr learned my addr 172.21.15.123:0/3547694512 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a6ffd700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a67fc700 1 -- 172.21.15.123:0/3547694512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 msgr2=0x7ff9a8113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a67fc700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a67fc700 1 -- 172.21.15.123:0/3547694512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c005040 con 0x7ff9a81038f0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a6ffd700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9a67fc700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0090d0 tx=0x7ff99c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99c00e040 con 0x7ff9a81038f0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a810dc00 con 0x7ff9a81038f0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff99c00bbf0 con 0x7ff9a81038f0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99c01c630 con 0x7ff9a81038f0 2024-02-20T08:16:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.880+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a810e140 con 0x7ff9a81038f0 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.881+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80fc6e0 con 0x7ff9a81038f0 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.882+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff99c00bd60 con 0x7ff9a81038f0 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.882+0000 7ff98f7fe700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 0x7ff99006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.882+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ff99c08e3c0 con 0x7ff9a81038f0 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.882+0000 7ff9a6ffd700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 0x7ff99006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:46.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.882+0000 7ff9a6ffd700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 0x7ff99006fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff998006fd0 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:46.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:46.886+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff99c05b600 con 0x7ff9a81038f0 2024-02-20T08:16:47.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.161+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff9a810f0a0 con 0x7ff9a81038f0 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.162+0000 7ff98f7fe700 1 -- 172.21.15.123:0/3547694512 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ff99c013e60 con 0x7ff9a81038f0 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": { 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": { 2024-02-20T08:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 2 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": { 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 6 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 4 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "overall": { 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)": 14 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-02-20T08:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 msgr2=0x7ff99006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 0x7ff99006fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff998006fd0 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 msgr2=0x7ff9a8113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0090d0 tx=0x7ff99c009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 shutdown_connections 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff99006d7e0 0x7ff99006fc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9a8102f50 0x7ff9a8113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 --2- 172.21.15.123:0/3547694512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9a81038f0 0x7ff9a8113f90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 >> 172.21.15.123:0/3547694512 conn(0x7ff9a80f8ae0 msgr2=0x7ff9a80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 shutdown_connections 2024-02-20T08:16:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:47.164+0000 7ff9ad4f0700 1 -- 172.21.15.123:0/3547694512 wait complete. 2024-02-20T08:16:47.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-20T08:16:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:47 smithi123 ceph-mon[112409]: pgmap v258: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:48.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:47 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3547694512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:48.035 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:16:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:47 smithi194 ceph-mon[88937]: pgmap v258: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:47 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3547694512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- 172.21.15.123:0/697652763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 msgr2=0x7fed380fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/697652763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed380fbe70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed28004940 tx=0x7fed28009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- 172.21.15.123:0/697652763 shutdown_connections 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/697652763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed380fbe70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/697652763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 0x7fed38102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- 172.21.15.123:0/697652763 >> 172.21.15.123:0/697652763 conn(0x7fed380f7a10 msgr2=0x7fed380f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- 172.21.15.123:0/697652763 shutdown_connections 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- 172.21.15.123:0/697652763 wait complete. 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 Processor -- start 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- start start 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 0x7fed38113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38114670 con 0x7fed38102800 2024-02-20T08:16:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.531+0000 7fed3f2fc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3810d9a0 con 0x7fed38101e60 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55672/0 (socket says 172.21.15.123:55672) 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 -- 172.21.15.123:0/2696508269 learned_addr learned my addr 172.21.15.123:0/2696508269 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3d098700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 0x7fed38113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 -- 172.21.15.123:0/2696508269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 msgr2=0x7fed38113ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 0x7fed38113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 -- 172.21.15.123:0/2696508269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28005040 con 0x7fed38102800 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3c897700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed28009100 tx=0x7fed28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2800e040 con 0x7fed38102800 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed28004290 con 0x7fed38102800 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3810dc20 con 0x7fed38102800 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2801c3f0 con 0x7fed38102800 2024-02-20T08:16:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.532+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3810e160 con 0x7fed38102800 2024-02-20T08:16:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.533+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed380fb610 con 0x7fed38102800 2024-02-20T08:16:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.534+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fed2800bbf0 con 0x7fed38102800 2024-02-20T08:16:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.534+0000 7fed2dffb700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 0x7fed2406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.534+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fed2808e3c0 con 0x7fed38102800 2024-02-20T08:16:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.534+0000 7fed3d098700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 0x7fed2406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.535+0000 7fed3d098700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 0x7fed2406fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed34004d60 tx=0x7fed3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:49.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.539+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fed2805b600 con 0x7fed38102800 2024-02-20T08:16:49.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.815+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed3804bed0 con 0x7fed38102800 2024-02-20T08:16:49.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.815+0000 7fed2dffb700 1 -- 172.21.15.123:0/2696508269 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fed2805b190 con 0x7fed38102800 2024-02-20T08:16:49.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 msgr2=0x7fed2406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 0x7fed2406fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed34004d60 tx=0x7fed3400b040 comp rx=0 tx=0).stop 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 msgr2=0x7fed38114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed28009100 tx=0x7fed28009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 shutdown_connections 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fed2406d7f0 0x7fed2406fca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed38101e60 0x7fed38113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 --2- 172.21.15.123:0/2696508269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed38102800 0x7fed38114020 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.817+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 >> 172.21.15.123:0/2696508269 conn(0x7fed380f7a10 msgr2=0x7fed38066050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.818+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 shutdown_connections 2024-02-20T08:16:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:49.818+0000 7fed3f2fc700 1 -- 172.21.15.123:0/2696508269 wait complete. 2024-02-20T08:16:49.827 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-02-20T08:16:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:49 smithi194 ceph-mon[88937]: pgmap v259: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:50.203 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:49 smithi123 ceph-mon[112409]: pgmap v259: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:50.471 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -e sha1=91ff50e903dcc99ee3ecf9523050878eb452da5c -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-20T08:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:16:51.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:50 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2696508269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:50 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2696508269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:52.101 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:51 smithi123 ceph-mon[112409]: pgmap v260: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:51 smithi194 ceph-mon[88937]: pgmap v260: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 -- 172.21.15.123:0/3751269094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac070bc0 msgr2=0x7f1aac1092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/3751269094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac070bc0 0x7f1aac1092d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c004940 tx=0x7f1a9c009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 -- 172.21.15.123:0/3751269094 shutdown_connections 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/3751269094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac070bc0 0x7f1aac1092d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/3751269094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac0702b0 0x7f1aac070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 -- 172.21.15.123:0/3751269094 >> 172.21.15.123:0/3751269094 conn(0x7f1aac0f8af0 msgr2=0x7f1aac0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 -- 172.21.15.123:0/3751269094 shutdown_connections 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 -- 172.21.15.123:0/3751269094 wait complete. 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.483+0000 7f1ab37e0700 1 Processor -- start 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab37e0700 1 -- start start 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab37e0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab37e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 0x7f1aac1161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab37e0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac1168d0 con 0x7f1aac0702b0 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab37e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac10fb50 con 0x7f1aac070bc0 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55692/0 (socket says 172.21.15.123:55692) 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 -- 172.21.15.123:0/740616698 learned_addr learned my addr 172.21.15.123:0/740616698 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab0d7b700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 0x7f1aac1161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 -- 172.21.15.123:0/740616698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 msgr2=0x7f1aac1161f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 0x7f1aac1161f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 -- 172.21.15.123:0/740616698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c005040 con 0x7f1aac0702b0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab0d7b700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 0x7f1aac1161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1ab157c700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800b790 tx=0x7f1aa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.484+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa800f770 con 0x7f1aac0702b0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.485+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac10fdd0 con 0x7f1aac0702b0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.485+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1aa800fda0 con 0x7f1aac0702b0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.485+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa800d310 con 0x7f1aac0702b0 2024-02-20T08:16:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.485+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac110310 con 0x7f1aac0702b0 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.486+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac106990 con 0x7f1aac0702b0 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.486+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1aa8010420 con 0x7f1aac0702b0 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.486+0000 7f1aa1ffb700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 0x7f1a9806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.487+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f1aa808d080 con 0x7f1aac0702b0 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.487+0000 7f1ab0d7b700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 0x7f1a9806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:52.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.487+0000 7f1ab0d7b700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 0x7f1a9806fca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:52.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.491+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1aa805a2c0 con 0x7f1aac0702b0 2024-02-20T08:16:52.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.766+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1aac04bf00 con 0x7f1aac0702b0 2024-02-20T08:16:52.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.766+0000 7f1aa1ffb700 1 -- 172.21.15.123:0/740616698 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1aa8059e50 con 0x7f1aac0702b0 2024-02-20T08:16:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 msgr2=0x7f1a9806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 0x7f1a9806fca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 msgr2=0x7f1aac115cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800b790 tx=0x7f1aa8009250 comp rx=0 tx=0).stop 2024-02-20T08:16:52.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 shutdown_connections 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1a9806d7f0 0x7f1a9806fca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1aac0702b0 0x7f1aac115cb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 --2- 172.21.15.123:0/740616698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac070bc0 0x7f1aac1161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 >> 172.21.15.123:0/740616698 conn(0x7f1aac0f8af0 msgr2=0x7f1aac103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 shutdown_connections 2024-02-20T08:16:52.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:52.768+0000 7f1ab37e0700 1 -- 172.21.15.123:0/740616698 wait complete. 2024-02-20T08:16:52.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph version 19.0.0-1587-g91ff50e9 (91ff50e903dcc99ee3ecf9523050878eb452da5c) squid (dev)" 2024-02-20T08:16:53.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:52 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/740616698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:53.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:52 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/740616698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-20T08:16:53.497 DEBUG:teuthology.parallel:result is None 2024-02-20T08:16:53.497 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-20T08:16:53.511 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T08:16:53.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-20T08:16:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/mon.smithi123/config 2024-02-20T08:16:54.107 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:53 smithi123 ceph-mon[112409]: pgmap v261: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:53 smithi194 ceph-mon[88937]: pgmap v261: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/2013327391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 msgr2=0x7f8e640fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/2013327391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e640fcf50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e58004940 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/2013327391 shutdown_connections 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/2013327391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e640fcf50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/2013327391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 0x7f8e64103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/2013327391 >> 172.21.15.123:0/2013327391 conn(0x7f8e640f8af0 msgr2=0x7f8e640faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/2013327391 shutdown_connections 2024-02-20T08:16:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.437+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/2013327391 wait complete. 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 Processor -- start 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 -- start start 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 0x7f8e64113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e641145f0 con 0x7f8e641038e0 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6c2f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6410d920 con 0x7f8e64102f40 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55714/0 (socket says 172.21.15.123:55714) 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 -- 172.21.15.123:0/534467100 learned_addr learned my addr 172.21.15.123:0/534467100 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e6a095700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 0x7f8e64113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 -- 172.21.15.123:0/534467100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 msgr2=0x7f8e64113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 0x7f8e64113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.438+0000 7f8e69894700 1 -- 172.21.15.123:0/534467100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58005040 con 0x7f8e641038e0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e69894700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e580090d0 tx=0x7f8e58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5800e040 con 0x7f8e641038e0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e5800bbf0 con 0x7f8e641038e0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6410dba0 con 0x7f8e641038e0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5801c630 con 0x7f8e641038e0 2024-02-20T08:16:55.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.439+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6410e0e0 con 0x7f8e641038e0 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.440+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e64105410 con 0x7f8e641038e0 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.440+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8e5800bd60 con 0x7f8e641038e0 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.441+0000 7f8e62ffd700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 0x7f8e4c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.441+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f8e5808e3c0 con 0x7f8e641038e0 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.441+0000 7f8e6a095700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 0x7f8e4c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:55.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.441+0000 7f8e6a095700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 0x7f8e4c06fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004550 tx=0x7f8e5c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.445+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8e5805b600 con 0x7f8e641038e0 2024-02-20T08:16:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.683+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e6410a020 con 0x7f8e641038e0 2024-02-20T08:16:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.683+0000 7f8e62ffd700 1 -- 172.21.15.123:0/534467100 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f8e58013e60 con 0x7f8e641038e0 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:e34 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 34 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-02-20T08:02:09.022635+0000 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-02-20T08:15:16.433576+0000 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-02-20T08:16:55.685 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 92 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:in 0 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=34372} 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-02-20T08:16:55.686 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data enabled 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.gglmsl{0:34372} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.123:6826/3930507890,v1:172.21.15.123:6827/3930507890] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.uffypv{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6828/266272272,v1:172.21.15.123:6829/266272272] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.icyfny{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6824/1865473040,v1:172.21.15.194:6825/1865473040] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:16:55.687 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi194.lquaku{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/1906868462,v1:172.21.15.194:6827/1906868462] compat {c=[1],r=[1],i=[fff]}] 2024-02-20T08:16:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 msgr2=0x7f8e4c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 0x7f8e4c06fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004550 tx=0x7f8e5c009040 comp rx=0 tx=0).stop 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 msgr2=0x7f8e64113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e580090d0 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 shutdown_connections 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8e4c06d7e0 0x7f8e4c06fc90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64102f40 0x7f8e64113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 --2- 172.21.15.123:0/534467100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e641038e0 0x7f8e64113fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 >> 172.21.15.123:0/534467100 conn(0x7f8e640f8af0 msgr2=0x7f8e640fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 shutdown_connections 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:55.685+0000 7f8e6c2f9700 1 -- 172.21.15.123:0/534467100 wait complete. 2024-02-20T08:16:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 34 2024-02-20T08:16:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:55 smithi123 ceph-mon[112409]: pgmap v262: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:55 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/534467100' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:16:56.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:55 smithi194 ceph-mon[88937]: pgmap v262: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:55 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/534467100' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-20T08:16:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:16:56.467 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-20T08:16:56.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 -- 172.21.15.123:0/634286972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80581014a0 msgr2=0x7f8058101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 --2- 172.21.15.123:0/634286972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80581014a0 0x7f8058101870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f80480048d0 tx=0x7f8048009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 -- 172.21.15.123:0/634286972 shutdown_connections 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 --2- 172.21.15.123:0/634286972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580fb460 0x7f80580fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 --2- 172.21.15.123:0/634286972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80581014a0 0x7f8058101870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 -- 172.21.15.123:0/634286972 >> 172.21.15.123:0/634286972 conn(0x7f80580f6fe0 msgr2=0x7f80580f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 -- 172.21.15.123:0/634286972 shutdown_connections 2024-02-20T08:16:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.577+0000 7f805cf9d640 1 -- 172.21.15.123:0/634286972 wait complete. 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 Processor -- start 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 -- start start 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80581014a0 0x7f8058113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058113890 con 0x7f80580fb460 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805810ce20 con 0x7f80581014a0 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55722/0 (socket says 172.21.15.123:55722) 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 -- 172.21.15.123:0/2237085518 learned_addr learned my addr 172.21.15.123:0/2237085518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 -- 172.21.15.123:0/2237085518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80581014a0 msgr2=0x7f8058113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80581014a0 0x7f8058113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 -- 172.21.15.123:0/2237085518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048005040 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805659c640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f804802bda0 tx=0x7f8048009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80480092e0 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f804803d450 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.578+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805810d0a0 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.579+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f804803b640 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.579+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805810d5c0 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.579+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058064480 con 0x7f80580fb460 2024-02-20T08:16:56.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.580+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f804802f070 con 0x7f80580fb460 2024-02-20T08:16:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.580+0000 7f804effd640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 0x7f804406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.581+0000 7f8055d9b640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 0x7f804406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.581+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f80480af4c0 con 0x7f80580fb460 2024-02-20T08:16:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.581+0000 7f8055d9b640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 0x7f804406fc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f805810e610 tx=0x7f804000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:56.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.585+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8048078b50 con 0x7f80580fb460 2024-02-20T08:16:56.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.760+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f805810e350 con 0x7f80580fb460 2024-02-20T08:16:56.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.761+0000 7f804effd640 1 -- 172.21.15.123:0/2237085518 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17362 (secure 0 0 0) 0x7f804807c210 con 0x7f80580fb460 2024-02-20T08:16:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:56.762 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:14:58.834802+0000","last_up_change":"2024-02-20T08:13:49.507285+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-20T08:02:07.859118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-20T08:02:08.249143+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":85,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6803","nonce":3390296229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6805","nonce":3390296229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6809","nonce":3390296229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6807","nonce":3390296229}]},"public_addr":"172.21.15.123:6803/3390296229","cluster_addr":"172.21.15.123:6805/3390296229","heartbeat_back_addr":"172.21.15.123:6809/3390296229","heartbeat_front_addr":"172.21.15.123:6807/3390296229","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":87,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6811","nonce":3638223896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6813","nonce":3638223896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6817","nonce":3638223896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6815","nonce":3638223896}]},"public_addr":"172.21.15.123:6811/3638223896","cluster_addr":"172.21.15.123:6813/3638223896","heartbeat_back_addr":"172.21.15.123:6817/3638223896","heartbeat_front_addr":"172.21.15.123:6815/3638223896","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":84,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6819","nonce":2869727014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6821","nonce":2869727014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6825","nonce":2869727014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6823","nonce":2869727014}]},"public_addr":"172.21.15.123:6819/2869727014","cluster_addr":"172.21.15.123:6821/2869727014","heartbeat_back_addr":"172.21.15.123:6825/2869727014","heartbeat_front_addr":"172.21.15.123:6823/2869727014","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":87,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6801","nonce":3997122390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6803","nonce":3997122390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6807","nonce":3997122390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6805","nonce":3997122390}]},"public_addr":"172.21.15.194:6801/3997122390","cluster_addr":"172.21.15.194:6803/3997122390","heartbeat_back_addr":"172.21.15.194:6807/3997122390","heartbeat_front_addr":"172.21.15.194:6805/3997122390","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":84,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6809","nonce":1371659365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6811","nonce":1371659365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6815","nonce":1371659365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6813","nonce":1371659365}]},"public_addr":"172.21.15.194:6809/1371659365","cluster_addr":"172.21.15.194:6811/1371659365","heartbeat_back_addr":"172.21.15.194:6815/1371659365","heartbeat_front_addr":"172.21.15.194:6813/1371659365","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":84,"up_thru":87,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6817","nonce":3914156420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6819","nonce":3914156420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6823","nonce":3914156420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6821","nonce":3914156420}]},"public_addr":"172.21.15.194:6817/3914156420","cluster_addr":"172.21.15.194:6819/3914156420","heartbeat_back_addr":"172.21.15.194:6823/3914156420","heartbeat_front_addr":"172.21.15.194:6821/3914156420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":5}]},{"pgid":"2.12","mappings":[{"from":0,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":5}]},{"pgid":"2.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":1,"to":5}]},{"pgid":"3.f","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6827/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6826/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6825/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6829/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/2962284630":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2566943054":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1567949854":"2024-02-21T08:04:27.200943+0000","172.21.15.194:0/2566710087":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2980357718":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6824/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6828/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:6826/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/4028843009":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.194:6828/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2184459282":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6829/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1920252283":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.194:0/1235011480":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6827/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/320629054":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2492856937":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6801/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.123:0/3945253827":"2024-02-21T08:09:40.596493+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 msgr2=0x7f804406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 0x7f804406fc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f805810e610 tx=0x7f804000b040 comp rx=0 tx=0).stop 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 msgr2=0x7f8058112d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f804802bda0 tx=0x7f8048009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 shutdown_connections 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f804406d750 0x7f804406fc00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80581014a0 0x7f8058113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 --2- 172.21.15.123:0/2237085518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80580fb460 0x7f8058112d50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 >> 172.21.15.123:0/2237085518 conn(0x7f80580f6fe0 msgr2=0x7f80580ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:56.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 shutdown_connections 2024-02-20T08:16:56.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.763+0000 7f805cf9d640 1 -- 172.21.15.123:0/2237085518 wait complete. 2024-02-20T08:16:56.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-20T07:59:36.763546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-20T08:02:07.859118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-20T08:02:08.249143+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-20T08:16:56.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-20T08:16:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 -- 172.21.15.123:0/3984479681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102370 msgr2=0x7f2980102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 --2- 172.21.15.123:0/3984479681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102370 0x7f2980102740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f29700048d0 tx=0x7f2970009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 -- 172.21.15.123:0/3984479681 shutdown_connections 2024-02-20T08:16:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 --2- 172.21.15.123:0/3984479681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102d10 0x7f29800fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 --2- 172.21.15.123:0/3984479681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102370 0x7f2980102740 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 -- 172.21.15.123:0/3984479681 >> 172.21.15.123:0/3984479681 conn(0x7f29800f7f20 msgr2=0x7f29800fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 -- 172.21.15.123:0/3984479681 shutdown_connections 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.876+0000 7f298679d640 1 -- 172.21.15.123:0/3984479681 wait complete. 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 Processor -- start 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 -- start start 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 0x7f298006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980070220 con 0x7f2980102d10 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f298679d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980070390 con 0x7f2980102370 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55744/0 (socket says 172.21.15.123:55744) 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 -- 172.21.15.123:0/1878516147 learned_addr learned my addr 172.21.15.123:0/1878516147 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297ffff640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 0x7f298006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 -- 172.21.15.123:0/1878516147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 msgr2=0x7f298006f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 0x7f298006f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297f7fe640 1 -- 172.21.15.123:0/1878516147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970005040 con 0x7f2980102d10 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.877+0000 7f297ffff640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 0x7f298006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f297f7fe640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f297400b790 tx=0x7f29740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297400c700 con 0x7f2980102d10 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f297400cd30 con 0x7f2980102d10 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2974013370 con 0x7f2980102d10 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29801190e0 con 0x7f2980102d10 2024-02-20T08:16:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.878+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2980119410 con 0x7f2980102d10 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.879+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980064480 con 0x7f2980102d10 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.879+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2974012070 con 0x7f2980102d10 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.880+0000 7f297cff9640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 0x7f296806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.880+0000 7f297ffff640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 0x7f296806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.880+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f297408cbc0 con 0x7f2980102d10 2024-02-20T08:16:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.880+0000 7f297ffff640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 0x7f296806fc00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f297002bda0 tx=0x7f2970009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:56.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:56.884+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f29740562d0 con 0x7f2980102d10 2024-02-20T08:16:57.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.056+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2980070550 con 0x7f2980102d10 2024-02-20T08:16:57.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.057+0000 7f297cff9640 1 -- 172.21.15.123:0/1878516147 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2974059990 con 0x7f2980102d10 2024-02-20T08:16:57.058 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 msgr2=0x7f296806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 0x7f296806fc00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f297002bda0 tx=0x7f2970009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 msgr2=0x7f298006fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f297400b790 tx=0x7f29740091d0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 shutdown_connections 2024-02-20T08:16:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f296806d750 0x7f296806fc00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2980102d10 0x7f298006fce0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 --2- 172.21.15.123:0/1878516147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980102370 0x7f298006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 >> 172.21.15.123:0/1878516147 conn(0x7f29800f7f20 msgr2=0x7f29800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 shutdown_connections 2024-02-20T08:16:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.059+0000 7f298679d640 1 -- 172.21.15.123:0/1878516147 wait complete. 2024-02-20T08:16:57.069 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:56 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2237085518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:16:57.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-20T08:16:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:56 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2237085518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:16:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.169+0000 7fcc8486e640 1 -- 172.21.15.123:0/2116943946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc800644b0 msgr2=0x7fcc800648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.169+0000 7fcc8486e640 1 --2- 172.21.15.123:0/2116943946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc800644b0 0x7fcc800648e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc700048d0 tx=0x7fcc70009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- 172.21.15.123:0/2116943946 shutdown_connections 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 --2- 172.21.15.123:0/2116943946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc800644b0 0x7fcc800648e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 --2- 172.21.15.123:0/2116943946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc801023e0 0x7fcc801027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- 172.21.15.123:0/2116943946 >> 172.21.15.123:0/2116943946 conn(0x7fcc80071230 msgr2=0x7fcc80071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- 172.21.15.123:0/2116943946 shutdown_connections 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- 172.21.15.123:0/2116943946 wait complete. 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 Processor -- start 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- start start 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc800644b0 0x7fcc80112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801137c0 con 0x7fcc801023e0 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc8486e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8010ccc0 con 0x7fcc800644b0 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc7dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc7dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55762/0 (socket says 172.21.15.123:55762) 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.170+0000 7fcc7dd9b640 1 -- 172.21.15.123:0/4026412397 learned_addr learned my addr 172.21.15.123:0/4026412397 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc7dd9b640 1 -- 172.21.15.123:0/4026412397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc800644b0 msgr2=0x7fcc80112bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc7dd9b640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc800644b0 0x7fcc80112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc7dd9b640 1 -- 172.21.15.123:0/4026412397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70005040 con 0x7fcc801023e0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc7dd9b640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc70031720 tx=0x7fcc70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc700094c0 con 0x7fcc801023e0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc70009620 con 0x7fcc801023e0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8010cf40 con 0x7fcc801023e0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7003b640 con 0x7fcc801023e0 2024-02-20T08:16:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.171+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8010d460 con 0x7fcc801023e0 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.172+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80064030 con 0x7fcc801023e0 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.172+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fcc7002f070 con 0x7fcc801023e0 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.173+0000 7fcc6effd640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 0x7fcc6806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.173+0000 7fcc7e59c640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 0x7fcc6806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.173+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fcc700af630 con 0x7fcc801023e0 2024-02-20T08:16:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.173+0000 7fcc7e59c640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 0x7fcc6806fc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc740097e0 tx=0x7fcc74006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.178+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcc70078cc0 con 0x7fcc801023e0 2024-02-20T08:16:57.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.353+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fcc80109510 con 0x7fcc801023e0 2024-02-20T08:16:57.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.354+0000 7fcc6effd640 1 -- 172.21.15.123:0/4026412397 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcc7007c380 con 0x7fcc801023e0 2024-02-20T08:16:57.355 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:16:57.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 msgr2=0x7fcc6806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 0x7fcc6806fc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc740097e0 tx=0x7fcc74006d20 comp rx=0 tx=0).stop 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 msgr2=0x7fcc80113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc70031720 tx=0x7fcc70009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 shutdown_connections 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcc6806d750 0x7fcc6806fc00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc801023e0 0x7fcc80113130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 --2- 172.21.15.123:0/4026412397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc800644b0 0x7fcc80112bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 >> 172.21.15.123:0/4026412397 conn(0x7fcc80071230 msgr2=0x7fcc800fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 shutdown_connections 2024-02-20T08:16:57.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.356+0000 7fcc8486e640 1 -- 172.21.15.123:0/4026412397 wait complete. 2024-02-20T08:16:57.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 -- 172.21.15.123:0/635455831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 msgr2=0x7f2b8c106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 --2- 172.21.15.123:0/635455831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c106400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0048d0 tx=0x7f2b7c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 -- 172.21.15.123:0/635455831 shutdown_connections 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 --2- 172.21.15.123:0/635455831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c106400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 --2- 172.21.15.123:0/635455831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c0fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 -- 172.21.15.123:0/635455831 >> 172.21.15.123:0/635455831 conn(0x7f2b8c0f6e10 msgr2=0x7f2b8c0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 -- 172.21.15.123:0/635455831 shutdown_connections 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.468+0000 7f2b93c25640 1 -- 172.21.15.123:0/635455831 wait complete. 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 Processor -- start 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 -- start start 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c113780 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b93c25640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c10cd10 con 0x7f2b8c0fd390 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55774/0 (socket says 172.21.15.123:55774) 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 -- 172.21.15.123:0/3461333561 learned_addr learned my addr 172.21.15.123:0/3461333561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b919c1640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 -- 172.21.15.123:0/3461333561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 msgr2=0x7f2b8c112c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c112c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 -- 172.21.15.123:0/3461333561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c005040 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b919c1640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.469+0000 7f2b911c0640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0316d0 tx=0x7f2b7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.470+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c0094c0 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.470+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c10cf90 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.470+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b7c032e70 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.470+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c03b640 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.470+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c10d4b0 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.471+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c064480 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.471+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2b7c02f070 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.471+0000 7f2b827fc640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 0x7f2b7806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.471+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f2b7c0af5e0 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.472+0000 7f2b919c1640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 0x7f2b7806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.472+0000 7f2b919c1640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 0x7f2b7806fc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b88004c80 tx=0x7f2b88009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.476+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b7c078c70 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.647+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f2b8c109430 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.648+0000 7f2b827fc640 1 -- 172.21.15.123:0/3461333561 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2b7c07c330 con 0x7f2b8c0fdd30 2024-02-20T08:16:57.650 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:16:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.649+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 msgr2=0x7f2b7806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.649+0000 7f2b93c25640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 0x7f2b7806fc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b88004c80 tx=0x7f2b88009040 comp rx=0 tx=0).stop 2024-02-20T08:16:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.649+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 msgr2=0x7f2b8c113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.649+0000 7f2b93c25640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0316d0 tx=0x7f2b7c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.649+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 shutdown_connections 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b7806d750 0x7f2b7806fc00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b8c0fdd30 0x7f2b8c113180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 --2- 172.21.15.123:0/3461333561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b8c0fd390 0x7f2b8c112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 >> 172.21.15.123:0/3461333561 conn(0x7f2b8c0f6e10 msgr2=0x7f2b8c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 shutdown_connections 2024-02-20T08:16:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.650+0000 7f2b93c25640 1 -- 172.21.15.123:0/3461333561 wait complete. 2024-02-20T08:16:57.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 -- 172.21.15.123:0/903074752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102290 msgr2=0x7f8644102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 --2- 172.21.15.123:0/903074752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102290 0x7f8644102660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f86340048d0 tx=0x7f8634009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 -- 172.21.15.123:0/903074752 shutdown_connections 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 --2- 172.21.15.123:0/903074752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102c30 0x7f8644064480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 --2- 172.21.15.123:0/903074752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102290 0x7f8644102660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 -- 172.21.15.123:0/903074752 >> 172.21.15.123:0/903074752 conn(0x7f8644071290 msgr2=0x7f8644071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 -- 172.21.15.123:0/903074752 shutdown_connections 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.757+0000 7f864ac2e640 1 -- 172.21.15.123:0/903074752 wait complete. 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 Processor -- start 2024-02-20T08:16:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 -- start start 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102290 0x7f8644112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441137a0 con 0x7f8644102c30 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f864ac2e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864410cd30 con 0x7f8644102290 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f8643fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f8643fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55784/0 (socket says 172.21.15.123:55784) 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.758+0000 7f8643fff640 1 -- 172.21.15.123:0/2995968421 learned_addr learned my addr 172.21.15.123:0/2995968421 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f86489ca640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102290 0x7f8644112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f8643fff640 1 -- 172.21.15.123:0/2995968421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102290 msgr2=0x7f8644112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f8643fff640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102290 0x7f8644112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f8643fff640 1 -- 172.21.15.123:0/2995968421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634005040 con 0x7f8644102c30 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f8643fff640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f863800c740 tx=0x7f86380043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8638012810 con 0x7f8644102c30 2024-02-20T08:16:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8638012e40 con 0x7f8644102c30 2024-02-20T08:16:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864410d010 con 0x7f8644102c30 2024-02-20T08:16:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863800a370 con 0x7f8644102c30 2024-02-20T08:16:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.759+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864410d530 con 0x7f8644102c30 2024-02-20T08:16:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.760+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644064030 con 0x7f8644102c30 2024-02-20T08:16:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.760+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8638011380 con 0x7f8644102c30 2024-02-20T08:16:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.761+0000 7f86417fa640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 0x7f862c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.761+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f863808d560 con 0x7f8644102c30 2024-02-20T08:16:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.761+0000 7f86489ca640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 0x7f862c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.761+0000 7f86489ca640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 0x7f862c06fc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:57.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.765+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8638056bf0 con 0x7f8644102c30 2024-02-20T08:16:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.976+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f864410d7b0 con 0x7f8644102c30 2024-02-20T08:16:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.977+0000 7f86417fa640 1 -- 172.21.15.123:0/2995968421 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+5005 (secure 0 0 0) 0x7f863805a2b0 con 0x7f8644102c30 2024-02-20T08:16:57.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:57.978 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/1906868462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1906868462},{"type":"v1","addr":"172.21.15.194:6827","nonce":1906868462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:15:16.433576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 34 2024-02-20T08:16:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 msgr2=0x7f862c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 0x7f862c06fc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 msgr2=0x7f86441131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f863800c740 tx=0x7f86380043c0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 shutdown_connections 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f862c06d750 0x7f862c06fc00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8644102c30 0x7f86441131a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 --2- 172.21.15.123:0/2995968421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644102290 0x7f8644112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 >> 172.21.15.123:0/2995968421 conn(0x7f8644071290 msgr2=0x7f86440fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 shutdown_connections 2024-02-20T08:16:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:57.979+0000 7f864ac2e640 1 -- 172.21.15.123:0/2995968421 wait complete. 2024-02-20T08:16:57.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:57 smithi123 ceph-mon[112409]: pgmap v263: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:57.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:57 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1878516147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:16:57.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:57 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/4026412397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:16:57.990 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:57 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3461333561' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:16:57.992 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-02-20T08:16:57.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-20T08:16:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 -- 172.21.15.123:0/1440104181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 msgr2=0x7fcd68102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/1440104181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd68102750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009c50 tx=0x7fcd58004d10 comp rx=0 tx=0).stop 2024-02-20T08:16:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 -- 172.21.15.123:0/1440104181 shutdown_connections 2024-02-20T08:16:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/1440104181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd68102d20 0x7fcd680fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/1440104181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd68102750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 -- 172.21.15.123:0/1440104181 >> 172.21.15.123:0/1440104181 conn(0x7fcd680f7fb0 msgr2=0x7fcd680fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.091+0000 7fcd6ca58640 1 -- 172.21.15.123:0/1440104181 shutdown_connections 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 -- 172.21.15.123:0/1440104181 wait complete. 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 Processor -- start 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 -- start start 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd68102d20 0x7fcd6806fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68071740 con 0x7fcd68102380 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6ca58640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68070220 con 0x7fcd68102d20 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55788/0 (socket says 172.21.15.123:55788) 2024-02-20T08:16:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 -- 172.21.15.123:0/2219586918 learned_addr learned my addr 172.21.15.123:0/2219586918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 -- 172.21.15.123:0/2219586918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd68102d20 msgr2=0x7fcd6806fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd68102d20 0x7fcd6806fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.092+0000 7fcd6659c640 1 -- 172.21.15.123:0/2219586918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580098b0 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd6659c640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd58003400 tx=0x7fcd58004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd5803a070 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68070470 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd58035b20 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd5803eb60 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.093+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd681192a0 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.094+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd68064030 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.094+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fcd58032070 con 0x7fcd68102380 2024-02-20T08:16:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.095+0000 7fcd5effd640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 0x7fcd5406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.095+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fcd580af400 con 0x7fcd68102380 2024-02-20T08:16:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.095+0000 7fcd65d9b640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 0x7fcd5406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.095+0000 7fcd65d9b640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 0x7fcd5406fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd68070f90 tx=0x7fcd50007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.099+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcd58078a90 con 0x7fcd68102380 2024-02-20T08:16:58.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:57 smithi194 ceph-mon[88937]: pgmap v263: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:57 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1878516147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:16:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:57 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/4026412397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:16:58.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:57 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3461333561' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:16:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.306+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fcd68119510 con 0x7fcd68102380 2024-02-20T08:16:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.306+0000 7fcd5effd640 1 -- 172.21.15.123:0/2219586918 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v34) v1 ==== 107+0+4052 (secure 0 0 0) 0x7fcd5807c150 con 0x7fcd68102380 2024-02-20T08:16:58.308 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:58.308 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:02:26.035784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi123.uffypv","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6829/3850080893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3850080893},{"type":"v1","addr":"172.21.15.123:6829","nonce":3850080893}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 16 2024-02-20T08:16:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 msgr2=0x7fcd5406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 0x7fcd5406fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd68070f90 tx=0x7fcd50007c30 comp rx=0 tx=0).stop 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 msgr2=0x7fcd6806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd58003400 tx=0x7fcd58004d10 comp rx=0 tx=0).stop 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 shutdown_connections 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fcd5406d750 0x7fcd5406fc00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd68102d20 0x7fcd6806fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 --2- 172.21.15.123:0/2219586918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd68102380 0x7fcd6806f7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.308+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 >> 172.21.15.123:0/2219586918 conn(0x7fcd680f7fb0 msgr2=0x7fcd680f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.309+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 shutdown_connections 2024-02-20T08:16:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.309+0000 7fcd6ca58640 1 -- 172.21.15.123:0/2219586918 wait complete. 2024-02-20T08:16:58.320 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-20T08:16:58.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 -- 172.21.15.123:0/3310619879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 msgr2=0x7f83341016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 --2- 172.21.15.123:0/3310619879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341016a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f832c0048d0 tx=0x7f832c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 -- 172.21.15.123:0/3310619879 shutdown_connections 2024-02-20T08:16:58.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 --2- 172.21.15.123:0/3310619879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 0x7f83340fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 --2- 172.21.15.123:0/3310619879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341016a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 -- 172.21.15.123:0/3310619879 >> 172.21.15.123:0/3310619879 conn(0x7f8334071230 msgr2=0x7f8334071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 -- 172.21.15.123:0/3310619879 shutdown_connections 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.418+0000 7f833c79d640 1 -- 172.21.15.123:0/3310619879 wait complete. 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 Processor -- start 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 -- start start 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 0x7f8334111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334112770 con 0x7f83341012d0 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833c79d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833410bcb0 con 0x7f83340fb2b0 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55812/0 (socket says 172.21.15.123:55812) 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 -- 172.21.15.123:0/1629086269 learned_addr learned my addr 172.21.15.123:0/1629086269 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:58.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f833a539640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 0x7f8334111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 -- 172.21.15.123:0/1629086269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 msgr2=0x7f8334111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 0x7f8334111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.419+0000 7f8339d38640 1 -- 172.21.15.123:0/1629086269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c005040 con 0x7f83341012d0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f8339d38640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f832800b790 tx=0x7f83280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f832800c700 con 0x7f83341012d0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f832800cd30 con 0x7f83341012d0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833410bf90 con 0x7f83341012d0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8328013370 con 0x7f83341012d0 2024-02-20T08:16:58.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.420+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833410c4b0 con 0x7f83341012d0 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.421+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8334064030 con 0x7f83341012d0 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.421+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8328012070 con 0x7f83341012d0 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.422+0000 7f8332ffd640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 0x7f831c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.422+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f832808cc50 con 0x7f83341012d0 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.422+0000 7f833a539640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 0x7f831c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.422+0000 7f833a539640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 0x7f831c06fc00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f832c004540 tx=0x7f832c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.426+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f83280562e0 con 0x7f83341012d0 2024-02-20T08:16:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.635+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f8334108420 con 0x7f83341012d0 2024-02-20T08:16:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.636+0000 7f8332ffd640 1 -- 172.21.15.123:0/1629086269 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v34) v1 ==== 107+0+4868 (secure 0 0 0) 0x7f83280599a0 con 0x7f83341012d0 2024-02-20T08:16:58.637 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:58.637 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:02:26.035784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi123.uffypv","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.123:6829/3850080893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":3850080893},{"type":"v1","addr":"172.21.15.123:6829","nonce":3850080893}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-02-20T08:16:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 msgr2=0x7f831c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 0x7f831c06fc00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f832c004540 tx=0x7f832c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 msgr2=0x7f83341120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f832800b790 tx=0x7f83280091d0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 shutdown_connections 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f831c06d750 0x7f831c06fc00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341012d0 0x7f83341120e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 --2- 172.21.15.123:0/1629086269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83340fb2b0 0x7f8334111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 >> 172.21.15.123:0/1629086269 conn(0x7f8334071230 msgr2=0x7f83340fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 shutdown_connections 2024-02-20T08:16:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.638+0000 7f833c79d640 1 -- 172.21.15.123:0/1629086269 wait complete. 2024-02-20T08:16:58.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-20T08:16:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 -- 172.21.15.123:0/920151830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 msgr2=0x7f54680fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 --2- 172.21.15.123:0/920151830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f54680fb700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f545c0048d0 tx=0x7f545c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 -- 172.21.15.123:0/920151830 shutdown_connections 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 --2- 172.21.15.123:0/920151830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f54680fb700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 --2- 172.21.15.123:0/920151830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f54681016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 -- 172.21.15.123:0/920151830 >> 172.21.15.123:0/920151830 conn(0x7f5468071230 msgr2=0x7f5468071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 -- 172.21.15.123:0/920151830 shutdown_connections 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.746+0000 7f546f62e640 1 -- 172.21.15.123:0/920151830 wait complete. 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 Processor -- start 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 -- start start 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f546810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546810e7a0 con 0x7f54680fb2b0 2024-02-20T08:16:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546f62e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546810e8e0 con 0x7f54681012d0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546d3ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546d3ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53834/0 (socket says 172.21.15.123:53834) 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.747+0000 7f546d3ca640 1 -- 172.21.15.123:0/3048237546 learned_addr learned my addr 172.21.15.123:0/3048237546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546cbc9640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f546810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546d3ca640 1 -- 172.21.15.123:0/3048237546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 msgr2=0x7f546810e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546d3ca640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f546810e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546d3ca640 1 -- 172.21.15.123:0/3048237546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f54680fb2b0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546cbc9640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f546810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546d3ca640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f545800cb10 tx=0x7f5458007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5458004200 con 0x7f54680fb2b0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f545800acf0 con 0x7f54680fb2b0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5458003e40 con 0x7f54680fb2b0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5468116d90 con 0x7f54680fb2b0 2024-02-20T08:16:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.748+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5468117170 con 0x7f54680fb2b0 2024-02-20T08:16:58.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.749+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5468064030 con 0x7f54680fb2b0 2024-02-20T08:16:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.750+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f545800a820 con 0x7f54680fb2b0 2024-02-20T08:16:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.750+0000 7f5465ffb640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 0x7f545006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.750+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f545808d7a0 con 0x7f54680fb2b0 2024-02-20T08:16:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.750+0000 7f546cbc9640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 0x7f545006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.750+0000 7f546cbc9640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 0x7f545006fb90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5468064d30 tx=0x7f545c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:58.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.754+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5458056e30 con 0x7f54680fb2b0 2024-02-20T08:16:58.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.966+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f54681083c0 con 0x7f54680fb2b0 2024-02-20T08:16:58.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.966+0000 7f5465ffb640 1 -- 172.21.15.123:0/3048237546 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v34) v1 ==== 107+0+4075 (secure 0 0 0) 0x7f545800ae60 con 0x7f54680fb2b0 2024-02-20T08:16:58.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:58.968 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:13.781767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 18 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 msgr2=0x7f545006fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 0x7f545006fb90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5468064d30 tx=0x7f545c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 msgr2=0x7f546810dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f545800cb10 tx=0x7f5458007ee0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 shutdown_connections 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f545006d6e0 0x7f545006fb90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54681012d0 0x7f546810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 --2- 172.21.15.123:0/3048237546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54680fb2b0 0x7f546810dd20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.968+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 >> 172.21.15.123:0/3048237546 conn(0x7f5468071230 msgr2=0x7f54680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.969+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 shutdown_connections 2024-02-20T08:16:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:58.969+0000 7f546f62e640 1 -- 172.21.15.123:0/3048237546 wait complete. 2024-02-20T08:16:58.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:58 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2995968421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:16:58.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:58 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2219586918' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-20T08:16:58.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:58 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1629086269' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-20T08:16:58.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-20T08:16:59.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- 172.21.15.123:0/2242617384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 msgr2=0x7ffb5c102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/2242617384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c102760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009c50 tx=0x7ffb54004d10 comp rx=0 tx=0).stop 2024-02-20T08:16:59.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- 172.21.15.123:0/2242617384 shutdown_connections 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/2242617384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5c102d30 0x7ffb5c0fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/2242617384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c102760 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- 172.21.15.123:0/2242617384 >> 172.21.15.123:0/2242617384 conn(0x7ffb5c0f7fa0 msgr2=0x7ffb5c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- 172.21.15.123:0/2242617384 shutdown_connections 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- 172.21.15.123:0/2242617384 wait complete. 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 Processor -- start 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 -- start start 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.078+0000 7ffb62f9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb62f9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5c102d30 0x7ffb5c113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb62f9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c113720 con 0x7ffb5c102390 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb62f9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c10ccb0 con 0x7ffb5c102d30 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53854/0 (socket says 172.21.15.123:53854) 2024-02-20T08:16:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 -- 172.21.15.123:0/3716621148 learned_addr learned my addr 172.21.15.123:0/3716621148 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 -- 172.21.15.123:0/3716621148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5c102d30 msgr2=0x7ffb5c113120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5c102d30 0x7ffb5c113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 -- 172.21.15.123:0/3716621148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540098b0 con 0x7ffb5c102390 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb60d39640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffb54003400 tx=0x7ffb54004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb5403a070 con 0x7ffb5c102390 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb54035b20 con 0x7ffb5c102390 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c10cf30 con 0x7ffb5c102390 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb5403eb60 con 0x7ffb5c102390 2024-02-20T08:16:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.079+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c10d4d0 con 0x7ffb5c102390 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.080+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c064030 con 0x7ffb5c102390 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.081+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ffb54032070 con 0x7ffb5c102390 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.081+0000 7ffb597fa640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 0x7ffb4806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.081+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ffb540af450 con 0x7ffb5c102390 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.081+0000 7ffb5bfff640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 0x7ffb4806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.082+0000 7ffb5bfff640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 0x7ffb4806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c10e4a0 tx=0x7ffb4c007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.086+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb54078ae0 con 0x7ffb5c102390 2024-02-20T08:16:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:58 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2995968421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-20T08:16:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:58 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2219586918' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-20T08:16:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:58 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1629086269' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-20T08:16:59.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.296+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7ffb5c10e1e0 con 0x7ffb5c102390 2024-02-20T08:16:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.297+0000 7ffb597fa640 1 -- 172.21.15.123:0/3716621148 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v34) v1 ==== 107+0+4086 (secure 0 0 0) 0x7ffb5407c1a0 con 0x7ffb5c102390 2024-02-20T08:16:59.298 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:59.298 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:13.791110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":0,"incarnation":19,"state":"up:replay","state_seq":3,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 19 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 msgr2=0x7ffb4806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 0x7ffb4806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c10e4a0 tx=0x7ffb4c007c30 comp rx=0 tx=0).stop 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 msgr2=0x7ffb5c112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffb54003400 tx=0x7ffb54004d10 comp rx=0 tx=0).stop 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 shutdown_connections 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb4806d750 0x7ffb4806fc00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5c102d30 0x7ffb5c113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 --2- 172.21.15.123:0/3716621148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb5c102390 0x7ffb5c112be0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 >> 172.21.15.123:0/3716621148 conn(0x7ffb5c0f7fa0 msgr2=0x7ffb5c0f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 shutdown_connections 2024-02-20T08:16:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.299+0000 7ffb62f9d640 1 -- 172.21.15.123:0/3716621148 wait complete. 2024-02-20T08:16:59.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 -- 172.21.15.123:0/2789247251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 msgr2=0x7fa5100fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 --2- 172.21.15.123:0/2789247251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa5100fbfe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0048d0 tx=0x7fa50c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 -- 172.21.15.123:0/2789247251 shutdown_connections 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 --2- 172.21.15.123:0/2789247251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa5100fbfe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 --2- 172.21.15.123:0/2789247251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa510101330 0x7fa510101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 -- 172.21.15.123:0/2789247251 >> 172.21.15.123:0/2789247251 conn(0x7fa5100718c0 msgr2=0x7fa510071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 -- 172.21.15.123:0/2789247251 shutdown_connections 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 -- 172.21.15.123:0/2789247251 wait complete. 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.407+0000 7fa51862e640 1 Processor -- start 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa51862e640 1 -- start start 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa51862e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa51862e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa510101330 0x7fa510111fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa51862e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101125d0 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa51862e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51010bb60 con 0x7fa510101330 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53872/0 (socket says 172.21.15.123:53872) 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 -- 172.21.15.123:0/515039126 learned_addr learned my addr 172.21.15.123:0/515039126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 -- 172.21.15.123:0/515039126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa510101330 msgr2=0x7fa510111fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa510101330 0x7fa510111fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 -- 172.21.15.123:0/515039126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c005040 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa5163ca640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa500002a80 tx=0x7fa500004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa500007c30 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.408+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa50000f040 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.409+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51010be40 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.409+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5000096b0 con 0x7fa5100fbb90 2024-02-20T08:16:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.409+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51010c360 con 0x7fa5100fbb90 2024-02-20T08:16:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.409+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa510064480 con 0x7fa5100fbb90 2024-02-20T08:16:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.410+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa50000d6b0 con 0x7fa5100fbb90 2024-02-20T08:16:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.410+0000 7fa506ffd640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 0x7fa4fc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.410+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fa50008cac0 con 0x7fa5100fbb90 2024-02-20T08:16:59.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.410+0000 7fa515bc9640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 0x7fa4fc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.411+0000 7fa515bc9640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 0x7fa4fc06fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009a10 tx=0x7fa50c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.415+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa500056150 con 0x7fa5100fbb90 2024-02-20T08:16:59.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.621+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fa5101083f0 con 0x7fa5100fbb90 2024-02-20T08:16:59.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.622+0000 7fa506ffd640 1 -- 172.21.15.123:0/515039126 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v34) v1 ==== 107+0+4904 (secure 0 0 0) 0x7fa500059810 con 0x7fa5100fbb90 2024-02-20T08:16:59.623 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:59.623 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:23.006595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":183,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:59.623 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 20 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 msgr2=0x7fa4fc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 0x7fa4fc06fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009a10 tx=0x7fa50c009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 msgr2=0x7fa510111a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa500002a80 tx=0x7fa500004600 comp rx=0 tx=0).stop 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 shutdown_connections 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fa4fc06d750 0x7fa4fc06fc00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa510101330 0x7fa510111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 --2- 172.21.15.123:0/515039126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5100fbb90 0x7fa510111a90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 >> 172.21.15.123:0/515039126 conn(0x7fa5100718c0 msgr2=0x7fa5100f97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 shutdown_connections 2024-02-20T08:16:59.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.624+0000 7fa51862e640 1 -- 172.21.15.123:0/515039126 wait complete. 2024-02-20T08:16:59.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 -- 172.21.15.123:0/491463667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 msgr2=0x7f1cc0106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 --2- 172.21.15.123:0/491463667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc0106390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80048d0 tx=0x7f1ca8009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 -- 172.21.15.123:0/491463667 shutdown_connections 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 --2- 172.21.15.123:0/491463667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc0106390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 --2- 172.21.15.123:0/491463667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 0x7f1cc00fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 -- 172.21.15.123:0/491463667 >> 172.21.15.123:0/491463667 conn(0x7f1cc00f6e00 msgr2=0x7f1cc00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 -- 172.21.15.123:0/491463667 shutdown_connections 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.732+0000 7f1cc619d640 1 -- 172.21.15.123:0/491463667 wait complete. 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 Processor -- start 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 -- start start 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 0x7f1cc00fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00fd180 con 0x7f1cc00fdd50 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cc619d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00fbc60 con 0x7f1cc00fd3b0 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53892/0 (socket says 172.21.15.123:53892) 2024-02-20T08:16:59.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 -- 172.21.15.123:0/3640161304 learned_addr learned my addr 172.21.15.123:0/3640161304 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cbf7fe640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 0x7f1cc00fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 -- 172.21.15.123:0/3640161304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 msgr2=0x7f1cc00fb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 0x7f1cc00fb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.733+0000 7f1cb6ffd640 1 -- 172.21.15.123:0/3640161304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8005040 con 0x7f1cc00fdd50 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cb6ffd640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8031720 tx=0x7f1ca8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca80094c0 con 0x7f1cc00fdd50 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ca8009620 con 0x7f1cc00fdd50 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca803b640 con 0x7f1cc00fdd50 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00fbeb0 con 0x7f1cc00fdd50 2024-02-20T08:16:59.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.734+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc01192d0 con 0x7f1cc00fdd50 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.735+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc0064480 con 0x7f1cc00fdd50 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.735+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1ca802f070 con 0x7f1cc00fdd50 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.735+0000 7f1cbcff9640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 0x7f1cac06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.735+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f1ca80af630 con 0x7f1cc00fdd50 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.736+0000 7f1cbf7fe640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 0x7f1cac06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:16:59.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.736+0000 7f1cbf7fe640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 0x7f1cac06fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00041d0 tx=0x7f1cb0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:16:59.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.740+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1ca8078cc0 con 0x7f1cc00fdd50 2024-02-20T08:16:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.949+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f1cc00fc710 con 0x7f1cc00fdd50 2024-02-20T08:16:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.950+0000 7f1cbcff9640 1 -- 172.21.15.123:0/3640161304 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v34) v1 ==== 107+0+4901 (secure 0 0 0) 0x7f1ca807c380 con 0x7f1cc00fdd50 2024-02-20T08:16:59.951 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:16:59.951 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:23.823971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":184,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:16:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 msgr2=0x7f1cac06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 0x7f1cac06fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00041d0 tx=0x7f1cb0009040 comp rx=0 tx=0).stop 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 msgr2=0x7f1cc00fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8031720 tx=0x7f1ca8009da0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 shutdown_connections 2024-02-20T08:16:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1cac06d750 0x7f1cac06fc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc00fdd50 0x7f1cc00fb720 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 --2- 172.21.15.123:0/3640161304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00fd3b0 0x7f1cc00fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:16:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 >> 172.21.15.123:0/3640161304 conn(0x7f1cc00f6e00 msgr2=0x7f1cc0100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:16:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 shutdown_connections 2024-02-20T08:16:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:16:59.952+0000 7f1cc619d640 1 -- 172.21.15.123:0/3640161304 wait complete. 2024-02-20T08:16:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:59 smithi123 ceph-mon[112409]: pgmap v264: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:16:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:59 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3048237546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-20T08:16:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:59 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3716621148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-20T08:16:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:16:59 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/515039126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-20T08:16:59.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-20T08:17:00.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 -- 172.21.15.123:0/3336376441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101270 msgr2=0x7f8a88101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/3336376441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101270 0x7f8a88101640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a780048d0 tx=0x7f8a78009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 -- 172.21.15.123:0/3336376441 shutdown_connections 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/3336376441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101c10 0x7f8a880fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/3336376441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101270 0x7f8a88101640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 -- 172.21.15.123:0/3336376441 >> 172.21.15.123:0/3336376441 conn(0x7f8a880f6de0 msgr2=0x7f8a880f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 -- 172.21.15.123:0/3336376441 shutdown_connections 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.061+0000 7f8a8cd14640 1 -- 172.21.15.123:0/3336376441 wait complete. 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 Processor -- start 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 -- start start 2024-02-20T08:17:00.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101270 0x7f8a8810dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8810e7b0 con 0x7f8a88101c10 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8810e920 con 0x7f8a88101270 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53920/0 (socket says 172.21.15.123:53920) 2024-02-20T08:17:00.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 -- 172.21.15.123:0/760348214 learned_addr learned my addr 172.21.15.123:0/760348214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8659c640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101270 0x7f8a8810dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 -- 172.21.15.123:0/760348214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101270 msgr2=0x7f8a8810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101270 0x7f8a8810dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 -- 172.21.15.123:0/760348214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78005040 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7ffff640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a70002a50 tx=0x7f8a70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a70007c30 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a7000f040 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a88116da0 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.062+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7000db50 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.063+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a881170d0 con 0x7f8a88101c10 2024-02-20T08:17:00.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.063+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a88064480 con 0x7f8a88101c10 2024-02-20T08:17:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.064+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8a7001c400 con 0x7f8a88101c10 2024-02-20T08:17:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.064+0000 7f8a7effd640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 0x7f8a7406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.064+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f8a7008c940 con 0x7f8a88101c10 2024-02-20T08:17:00.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.064+0000 7f8a8659c640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 0x7f8a7406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.065+0000 7f8a8659c640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 0x7f8a7406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a78004540 tx=0x7f8a78009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.069+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8a70055fd0 con 0x7f8a88101c10 2024-02-20T08:17:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:59 smithi194 ceph-mon[88937]: pgmap v264: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:59 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3048237546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-20T08:17:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:59 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3716621148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-20T08:17:00.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:16:59 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/515039126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-20T08:17:00.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.277+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f8a881083d0 con 0x7f8a88101c10 2024-02-20T08:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.277+0000 7f8a7effd640 1 -- 172.21.15.123:0/760348214 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v34) v1 ==== 107+0+4901 (secure 0 0 0) 0x7f8a70059690 con 0x7f8a88101c10 2024-02-20T08:17:00.278 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:00.278 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:24.888103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi194.icyfny","rank":0,"incarnation":19,"state":"up:active","state_seq":185,"addr":"172.21.15.194:6825/235540453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":235540453},{"type":"v1","addr":"172.21.15.194:6825","nonce":235540453}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 22 2024-02-20T08:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 msgr2=0x7f8a7406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 0x7f8a7406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a78004540 tx=0x7f8a78009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 msgr2=0x7f8a8810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a70002a50 tx=0x7f8a70004600 comp rx=0 tx=0).stop 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 shutdown_connections 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f8a7406d750 0x7f8a7406fc00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88101c10 0x7f8a8810e270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 --2- 172.21.15.123:0/760348214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a88101270 0x7f8a8810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 >> 172.21.15.123:0/760348214 conn(0x7f8a880f6de0 msgr2=0x7f8a880f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 shutdown_connections 2024-02-20T08:17:00.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.279+0000 7f8a8cd14640 1 -- 172.21.15.123:0/760348214 wait complete. 2024-02-20T08:17:00.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-20T08:17:00.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 -- 172.21.15.123:0/2247292433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101240 msgr2=0x7fe848101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 --2- 172.21.15.123:0/2247292433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101240 0x7fe848101610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe8440048d0 tx=0x7fe844009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 -- 172.21.15.123:0/2247292433 shutdown_connections 2024-02-20T08:17:00.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 --2- 172.21.15.123:0/2247292433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101be0 0x7fe8480fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 --2- 172.21.15.123:0/2247292433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101240 0x7fe848101610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 -- 172.21.15.123:0/2247292433 >> 172.21.15.123:0/2247292433 conn(0x7fe8480f6e10 msgr2=0x7fe8480f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 -- 172.21.15.123:0/2247292433 shutdown_connections 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.387+0000 7fe84f858640 1 -- 172.21.15.123:0/2247292433 wait complete. 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 Processor -- start 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 -- start start 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101240 0x7fe848112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe848113820 con 0x7fe848101be0 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84f858640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810cd20 con 0x7fe848101240 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53944/0 (socket says 172.21.15.123:53944) 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 -- 172.21.15.123:0/2893459137 learned_addr learned my addr 172.21.15.123:0/2893459137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84d5f4640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101240 0x7fe848112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 -- 172.21.15.123:0/2893459137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101240 msgr2=0x7fe848112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101240 0x7fe848112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.388+0000 7fe84cdf3640 1 -- 172.21.15.123:0/2893459137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844005040 con 0x7fe848101be0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe84cdf3640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b790 tx=0x7fe8380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83800c700 con 0x7fe848101be0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe83800cd30 con 0x7fe848101be0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84810d000 con 0x7fe848101be0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838013370 con 0x7fe848101be0 2024-02-20T08:17:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.389+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84810d520 con 0x7fe848101be0 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.390+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848064480 con 0x7fe848101be0 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.390+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe838012070 con 0x7fe848101be0 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.391+0000 7fe83dffb640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 0x7fe83406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.391+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fe83808cce0 con 0x7fe848101be0 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.391+0000 7fe84d5f4640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 0x7fe83406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.391+0000 7fe84d5f4640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 0x7fe83406fc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe844000c00 tx=0x7fe844009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.395+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe838056370 con 0x7fe848101be0 2024-02-20T08:17:00.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.606+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fe848108400 con 0x7fe848101be0 2024-02-20T08:17:00.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.607+0000 7fe83dffb640 1 -- 172.21.15.123:0/2893459137 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v34) v1 ==== 107+0+4109 (secure 0 0 0) 0x7fe838059a30 con 0x7fe848101be0 2024-02-20T08:17:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:00.608 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:35.934409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:00.608 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 23 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 msgr2=0x7fe83406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 0x7fe83406fc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe844000c00 tx=0x7fe844009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 msgr2=0x7fe848113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b790 tx=0x7fe8380091d0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 shutdown_connections 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fe83406d750 0x7fe83406fc00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe848101be0 0x7fe848113190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 --2- 172.21.15.123:0/2893459137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe848101240 0x7fe848112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 >> 172.21.15.123:0/2893459137 conn(0x7fe8480f6e10 msgr2=0x7fe848065710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 shutdown_connections 2024-02-20T08:17:00.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.609+0000 7fe84f858640 1 -- 172.21.15.123:0/2893459137 wait complete. 2024-02-20T08:17:00.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-20T08:17:00.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- 172.21.15.123:0/2252728397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 msgr2=0x7f011c1016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 --2- 172.21.15.123:0/2252728397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c1016a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f010c0048d0 tx=0x7f010c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- 172.21.15.123:0/2252728397 shutdown_connections 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 --2- 172.21.15.123:0/2252728397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 0x7f011c0fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 --2- 172.21.15.123:0/2252728397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c1016a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- 172.21.15.123:0/2252728397 >> 172.21.15.123:0/2252728397 conn(0x7f011c071230 msgr2=0x7f011c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- 172.21.15.123:0/2252728397 shutdown_connections 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- 172.21.15.123:0/2252728397 wait complete. 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 Processor -- start 2024-02-20T08:17:00.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.718+0000 7f012366e640 1 -- start start 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 0x7f011c10bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0653f0 con 0x7f011c1012d0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c10c660 con 0x7f011c0fb2b0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53964/0 (socket says 172.21.15.123:53964) 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 -- 172.21.15.123:0/1502065587 learned_addr learned my addr 172.21.15.123:0/1502065587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012140a640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 0x7f011c10bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 -- 172.21.15.123:0/1502065587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 msgr2=0x7f011c10bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 0x7f011c10bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 -- 172.21.15.123:0/1502065587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c005040 con 0x7f011c1012d0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0120c09640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f011800b790 tx=0x7f01180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f011800c700 con 0x7f011c1012d0 2024-02-20T08:17:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c10c910 con 0x7f011c1012d0 2024-02-20T08:17:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f011800cd30 con 0x7f011c1012d0 2024-02-20T08:17:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0118013370 con 0x7f011c1012d0 2024-02-20T08:17:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.719+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c119440 con 0x7f011c1012d0 2024-02-20T08:17:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.721+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c064030 con 0x7f011c1012d0 2024-02-20T08:17:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.721+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0118012070 con 0x7f011c1012d0 2024-02-20T08:17:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.721+0000 7f0111ffb640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 0x7f010806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.721+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f011808cc60 con 0x7f011c1012d0 2024-02-20T08:17:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.721+0000 7f012140a640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 0x7f010806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.722+0000 7f012140a640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 0x7f010806fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f010c000c00 tx=0x7f010c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:00.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.726+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f01180562f0 con 0x7f011c1012d0 2024-02-20T08:17:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.940+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f011c108420 con 0x7f011c1012d0 2024-02-20T08:17:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.941+0000 7f0111ffb640 1 -- 172.21.15.123:0/1502065587 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v34) v1 ==== 107+0+4120 (secure 0 0 0) 0x7f01180599b0 con 0x7f011c1012d0 2024-02-20T08:17:00.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:00.942 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:35.943945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 24 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 msgr2=0x7f010806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 0x7f010806fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f010c000c00 tx=0x7f010c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 msgr2=0x7f011c10c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f011800b790 tx=0x7f01180091d0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 shutdown_connections 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f010806d750 0x7f010806fc00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011c1012d0 0x7f011c10c120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 --2- 172.21.15.123:0/1502065587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f011c0fb2b0 0x7f011c10bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 >> 172.21.15.123:0/1502065587 conn(0x7f011c071230 msgr2=0x7f011c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 shutdown_connections 2024-02-20T08:17:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:00.943+0000 7f012366e640 1 -- 172.21.15.123:0/1502065587 wait complete. 2024-02-20T08:17:00.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:00 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3640161304' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-20T08:17:00.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:00 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/760348214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-20T08:17:00.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:00 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2893459137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-20T08:17:00.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-20T08:17:01.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 -- 172.21.15.123:0/796226159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101c30 msgr2=0x7f2b800fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 --2- 172.21.15.123:0/796226159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101c30 0x7f2b800fb2c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b680048d0 tx=0x7f2b68009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 -- 172.21.15.123:0/796226159 shutdown_connections 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 --2- 172.21.15.123:0/796226159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101c30 0x7f2b800fb2c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 --2- 172.21.15.123:0/796226159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101290 0x7f2b80101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 -- 172.21.15.123:0/796226159 >> 172.21.15.123:0/796226159 conn(0x7f2b800f6e80 msgr2=0x7f2b800f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 -- 172.21.15.123:0/796226159 shutdown_connections 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.051+0000 7f2b84954640 1 -- 172.21.15.123:0/796226159 wait complete. 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 Processor -- start 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 -- start start 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 0x7f2b801131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80113850 con 0x7f2b80101290 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b84954640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8010cd50 con 0x7f2b80101c30 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53978/0 (socket says 172.21.15.123:53978) 2024-02-20T08:17:01.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 -- 172.21.15.123:0/1836647278 learned_addr learned my addr 172.21.15.123:0/1836647278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b77fff640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 0x7f2b801131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 -- 172.21.15.123:0/1836647278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 msgr2=0x7f2b801131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 0x7f2b801131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b7e59c640 1 -- 172.21.15.123:0/1836647278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68005040 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.052+0000 7f2b77fff640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 0x7f2b801131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b7e59c640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000b790 tx=0x7f2b700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7000c700 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b7000cd30 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b70013370 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8010d030 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.053+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8010d520 con 0x7f2b80101290 2024-02-20T08:17:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.054+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b800637a0 con 0x7f2b80101290 2024-02-20T08:17:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.054+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2b70012070 con 0x7f2b80101290 2024-02-20T08:17:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.055+0000 7f2b76ffd640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 0x7f2b6c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.055+0000 7f2b77fff640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 0x7f2b6c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.055+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f2b7008cc60 con 0x7f2b80101290 2024-02-20T08:17:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.055+0000 7f2b77fff640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 0x7f2b6c06fcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b8010de90 tx=0x7f2b68009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.059+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b700562d0 con 0x7f2b80101290 2024-02-20T08:17:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:00 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3640161304' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-20T08:17:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:00 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/760348214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-20T08:17:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:00 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2893459137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-20T08:17:01.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.268+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f2b80108450 con 0x7f2b80101290 2024-02-20T08:17:01.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.268+0000 7f2b76ffd640 1 -- 172.21.15.123:0/1836647278 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v34) v1 ==== 107+0+4936 (secure 0 0 0) 0x7f2b70059990 con 0x7f2b80101290 2024-02-20T08:17:01.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:35.943945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:01.271 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 msgr2=0x7f2b6c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 0x7f2b6c06fcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b8010de90 tx=0x7f2b68009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 msgr2=0x7f2b80112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000b790 tx=0x7f2b700091d0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 shutdown_connections 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f2b6c06d820 0x7f2b6c06fcd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b80101c30 0x7f2b801131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 --2- 172.21.15.123:0/1836647278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b80101290 0x7f2b80112c80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 >> 172.21.15.123:0/1836647278 conn(0x7f2b800f6e80 msgr2=0x7f2b80104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 shutdown_connections 2024-02-20T08:17:01.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.270+0000 7f2b84954640 1 -- 172.21.15.123:0/1836647278 wait complete. 2024-02-20T08:17:01.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 -- 172.21.15.123:0/529816884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 msgr2=0x7ff9000fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 --2- 172.21.15.123:0/529816884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff9000fd780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0048d0 tx=0x7ff8fc009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 -- 172.21.15.123:0/529816884 shutdown_connections 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 --2- 172.21.15.123:0/529816884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9000fdd50 0x7ff900106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 --2- 172.21.15.123:0/529816884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff9000fd780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 -- 172.21.15.123:0/529816884 >> 172.21.15.123:0/529816884 conn(0x7ff9000f6e00 msgr2=0x7ff9000f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 -- 172.21.15.123:0/529816884 shutdown_connections 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.384+0000 7ff90726e640 1 -- 172.21.15.123:0/529816884 wait complete. 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 Processor -- start 2024-02-20T08:17:01.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 -- start start 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9000fdd50 0x7ff9001131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9001137a0 con 0x7ff9000fd3b0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90010cd30 con 0x7ff9000fdd50 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53988/0 (socket says 172.21.15.123:53988) 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 -- 172.21.15.123:0/1919062393 learned_addr learned my addr 172.21.15.123:0/1919062393 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 -- 172.21.15.123:0/1919062393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9000fdd50 msgr2=0x7ff9001131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9000fdd50 0x7ff9001131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 -- 172.21.15.123:0/1919062393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc005040 con 0x7ff9000fd3b0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90500a640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc031720 tx=0x7ff8fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8fc0094c0 con 0x7ff9000fd3b0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8fc009620 con 0x7ff9000fd3b0 2024-02-20T08:17:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8fc03b640 con 0x7ff9000fd3b0 2024-02-20T08:17:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.385+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90010cfb0 con 0x7ff9000fd3b0 2024-02-20T08:17:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.386+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90010d4d0 con 0x7ff9000fd3b0 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.387+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff900064480 con 0x7ff9000fd3b0 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.387+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff8fc02f070 con 0x7ff9000fd3b0 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.387+0000 7ff8f5ffb640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 0x7ff8ec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.388+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ff8fc0af580 con 0x7ff9000fd3b0 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.388+0000 7ff904809640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 0x7ff8ec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.388+0000 7ff904809640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 0x7ff8ec06fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff90010e520 tx=0x7ff8f0009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.392+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff8fc078c10 con 0x7ff9000fd3b0 2024-02-20T08:17:01.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.600+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7ff90010e260 con 0x7ff9000fd3b0 2024-02-20T08:17:01.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.601+0000 7ff8f5ffb640 1 -- 172.21.15.123:0/1919062393 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v34) v1 ==== 107+0+4941 (secure 0 0 0) 0x7ff8fc07c2d0 con 0x7ff9000fd3b0 2024-02-20T08:17:01.602 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:01.602 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:45.737174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":188,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:01.602 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 msgr2=0x7ff8ec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 0x7ff8ec06fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff90010e520 tx=0x7ff8f0009c50 comp rx=0 tx=0).stop 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 msgr2=0x7ff900112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc031720 tx=0x7ff8fc009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 shutdown_connections 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff8ec06d750 0x7ff8ec06fc00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9000fdd50 0x7ff9001131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 --2- 172.21.15.123:0/1919062393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9000fd3b0 0x7ff900112c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 >> 172.21.15.123:0/1919062393 conn(0x7ff9000f6e00 msgr2=0x7ff900100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 shutdown_connections 2024-02-20T08:17:01.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.603+0000 7ff90726e640 1 -- 172.21.15.123:0/1919062393 wait complete. 2024-02-20T08:17:01.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 -- 172.21.15.123:0/2919820985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fdd30 msgr2=0x7f3c5c106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2919820985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fdd30 0x7f3c5c106370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0048d0 tx=0x7f3c4c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 -- 172.21.15.123:0/2919820985 shutdown_connections 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2919820985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fdd30 0x7f3c5c106370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2919820985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c0fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 -- 172.21.15.123:0/2919820985 >> 172.21.15.123:0/2919820985 conn(0x7f3c5c0f6e40 msgr2=0x7f3c5c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 -- 172.21.15.123:0/2919820985 shutdown_connections 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.711+0000 7f3c6422e640 1 -- 172.21.15.123:0/2919820985 wait complete. 2024-02-20T08:17:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 Processor -- start 2024-02-20T08:17:01.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 -- start start 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0fdd30 0x7f3c5c113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c113770 con 0x7f3c5c0fd390 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c6422e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10cd00 con 0x7f3c5c0fdd30 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c61fca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c61fca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54006/0 (socket says 172.21.15.123:54006) 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.712+0000 7f3c61fca640 1 -- 172.21.15.123:0/2267934243 learned_addr learned my addr 172.21.15.123:0/2267934243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c61fca640 1 -- 172.21.15.123:0/2267934243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0fdd30 msgr2=0x7f3c5c113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c61fca640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0fdd30 0x7f3c5c113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c61fca640 1 -- 172.21.15.123:0/2267934243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c005040 con 0x7f3c5c0fd390 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c61fca640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c58002a50 tx=0x7f3c58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c58007c30 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c5800f040 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c10cfe0 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5800db50 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.713+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c10d500 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.714+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c064480 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.714+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3c5800dcf0 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.715+0000 7f3c527fc640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 0x7f3c4806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.715+0000 7f3c617c9640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 0x7f3c4806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.715+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f3c5808c8f0 con 0x7f3c5c0fd390 2024-02-20T08:17:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.715+0000 7f3c617c9640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 0x7f3c4806fc00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c034040 tx=0x7f3c4c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:01.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.719+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c58056000 con 0x7f3c5c0fd390 2024-02-20T08:17:01.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.929+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f3c5c10e230 con 0x7f3c5c0fd390 2024-02-20T08:17:01.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.930+0000 7f3c527fc640 1 -- 172.21.15.123:0/2267934243 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v34) v1 ==== 107+0+4938 (secure 0 0 0) 0x7f3c580596c0 con 0x7f3c5c0fd390 2024-02-20T08:17:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:01.931 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:45.754981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":189,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:01.931 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 msgr2=0x7f3c4806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 0x7f3c4806fc00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c034040 tx=0x7f3c4c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 msgr2=0x7f3c5c112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c58002a50 tx=0x7f3c58004600 comp rx=0 tx=0).stop 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 shutdown_connections 2024-02-20T08:17:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f3c4806d750 0x7f3c4806fc00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0fdd30 0x7f3c5c113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 --2- 172.21.15.123:0/2267934243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c0fd390 0x7f3c5c112c30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:01.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 >> 172.21.15.123:0/2267934243 conn(0x7f3c5c0f6e40 msgr2=0x7f3c5c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:01.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 shutdown_connections 2024-02-20T08:17:01.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:01.932+0000 7f3c6422e640 1 -- 172.21.15.123:0/2267934243 wait complete. 2024-02-20T08:17:01.943 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:01 smithi123 ceph-mon[112409]: pgmap v265: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:01.943 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:01 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1502065587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-20T08:17:01.943 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:01 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1836647278' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-20T08:17:01.943 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:01 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1919062393' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-20T08:17:01.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-20T08:17:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/4206312103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 msgr2=0x7ffb780648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/4206312103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780648e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0048d0 tx=0x7ffb6c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/4206312103 shutdown_connections 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/4206312103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780648e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/4206312103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 0x7ffb781027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/4206312103 >> 172.21.15.123:0/4206312103 conn(0x7ffb78071230 msgr2=0x7ffb78071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.041+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/4206312103 shutdown_connections 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/4206312103 wait complete. 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 Processor -- start 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 -- start start 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 0x7ffb780fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780fbe00 con 0x7ffb780644b0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7ca6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780fbf70 con 0x7ffb781023e0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54030/0 (socket says 172.21.15.123:54030) 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 -- 172.21.15.123:0/1659830755 learned_addr learned my addr 172.21.15.123:0/1659830755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb75d9b640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 0x7ffb780fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 -- 172.21.15.123:0/1659830755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 msgr2=0x7ffb780fb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 0x7ffb780fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.042+0000 7ffb7659c640 1 -- 172.21.15.123:0/1659830755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c005040 con 0x7ffb780644b0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb7659c640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800bbb0 tx=0x7ffb68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb6800c9c0 con 0x7ffb780644b0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb680092e0 con 0x7ffb780644b0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78119090 con 0x7ffb780644b0 2024-02-20T08:17:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb68007640 con 0x7ffb780644b0 2024-02-20T08:17:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.043+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb781193c0 con 0x7ffb780644b0 2024-02-20T08:17:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.044+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78064030 con 0x7ffb780644b0 2024-02-20T08:17:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.044+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ffb68012070 con 0x7ffb780644b0 2024-02-20T08:17:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.044+0000 7ffb66ffd640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 0x7ffb6006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.045+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ffb6808d190 con 0x7ffb780644b0 2024-02-20T08:17:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.045+0000 7ffb75d9b640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 0x7ffb6006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.045+0000 7ffb75d9b640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 0x7ffb6006fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c02bda0 tx=0x7ffb6c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.049+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb68056820 con 0x7ffb780644b0 2024-02-20T08:17:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:01 smithi194 ceph-mon[88937]: pgmap v265: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:01 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1502065587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-20T08:17:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:01 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1836647278' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-20T08:17:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:01 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1919062393' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-20T08:17:02.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.258+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ffb78109510 con 0x7ffb780644b0 2024-02-20T08:17:02.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.258+0000 7ffb66ffd640 1 -- 172.21.15.123:0/1659830755 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v34) v1 ==== 107+0+4938 (secure 0 0 0) 0x7ffb68059ee0 con 0x7ffb780644b0 2024-02-20T08:17:02.259 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:02.260 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:46.839776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi194.lquaku","rank":0,"incarnation":24,"state":"up:active","state_seq":190,"addr":"172.21.15.194:6827/2264298744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2264298744},{"type":"v1","addr":"172.21.15.194:6827","nonce":2264298744}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 msgr2=0x7ffb6006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 0x7ffb6006fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c02bda0 tx=0x7ffb6c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 msgr2=0x7ffb780fb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800bbb0 tx=0x7ffb68009840 comp rx=0 tx=0).stop 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 shutdown_connections 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ffb6006d750 0x7ffb6006fc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb781023e0 0x7ffb780fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 --2- 172.21.15.123:0/1659830755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb780644b0 0x7ffb780fb380 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 >> 172.21.15.123:0/1659830755 conn(0x7ffb78071230 msgr2=0x7ffb780fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 shutdown_connections 2024-02-20T08:17:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.261+0000 7ffb7ca6e640 1 -- 172.21.15.123:0/1659830755 wait complete. 2024-02-20T08:17:02.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-20T08:17:02.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.369+0000 7f9342807640 1 -- 172.21.15.123:0/537870285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 msgr2=0x7f933c1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.369+0000 7f9342807640 1 --2- 172.21.15.123:0/537870285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c1027b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93300048d0 tx=0x7f9330009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- 172.21.15.123:0/537870285 shutdown_connections 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 --2- 172.21.15.123:0/537870285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 --2- 172.21.15.123:0/537870285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c1027b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- 172.21.15.123:0/537870285 >> 172.21.15.123:0/537870285 conn(0x7f933c071230 msgr2=0x7f933c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- 172.21.15.123:0/537870285 shutdown_connections 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- 172.21.15.123:0/537870285 wait complete. 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 Processor -- start 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- start start 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0fbe00 con 0x7f933c1023e0 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.370+0000 7f9342807640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0fbf70 con 0x7f933c0644b0 2024-02-20T08:17:02.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54058/0 (socket says 172.21.15.123:54058) 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 -- 172.21.15.123:0/994129058 learned_addr learned my addr 172.21.15.123:0/994129058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933bfff640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 -- 172.21.15.123:0/994129058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 msgr2=0x7f933c0fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 -- 172.21.15.123:0/994129058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330005040 con 0x7f933c1023e0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933bfff640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f933b7fe640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f932c00b790 tx=0x7f932c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c00c700 con 0x7f933c1023e0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c119050 con 0x7f933c1023e0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f932c00cd30 con 0x7f933c1023e0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c013370 con 0x7f933c1023e0 2024-02-20T08:17:02.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.371+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c119380 con 0x7f933c1023e0 2024-02-20T08:17:02.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.372+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c064030 con 0x7f933c1023e0 2024-02-20T08:17:02.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.372+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f932c012070 con 0x7f933c1023e0 2024-02-20T08:17:02.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.373+0000 7f9338ff9640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 0x7f932406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.373+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f932c08cd60 con 0x7f933c1023e0 2024-02-20T08:17:02.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.373+0000 7f933bfff640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 0x7f932406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.373+0000 7f933bfff640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 0x7f932406fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f933002bda0 tx=0x7f9330009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.377+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f932c0563f0 con 0x7f933c1023e0 2024-02-20T08:17:02.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.590+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f933c1195d0 con 0x7f933c1023e0 2024-02-20T08:17:02.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.591+0000 7f9338ff9640 1 -- 172.21.15.123:0/994129058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v34) v1 ==== 107+0+4143 (secure 0 0 0) 0x7f932c059ab0 con 0x7f933c1023e0 2024-02-20T08:17:02.592 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:02.592 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:58.834776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:02.593 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 29 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 msgr2=0x7f932406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 0x7f932406fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f933002bda0 tx=0x7f9330009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 msgr2=0x7f933c0fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f932c00b790 tx=0x7f932c0091d0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 shutdown_connections 2024-02-20T08:17:02.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f932406d750 0x7f932406fc00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f933c1023e0 0x7f933c0fb8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 --2- 172.21.15.123:0/994129058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f933c0644b0 0x7f933c0fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 >> 172.21.15.123:0/994129058 conn(0x7f933c071230 msgr2=0x7f933c0fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 shutdown_connections 2024-02-20T08:17:02.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.593+0000 7f9342807640 1 -- 172.21.15.123:0/994129058 wait complete. 2024-02-20T08:17:02.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-20T08:17:02.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/1091058498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 msgr2=0x7fbc140fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/1091058498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc140fc390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc040048d0 tx=0x7fbc04009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/1091058498 shutdown_connections 2024-02-20T08:17:02.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/1091058498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc140fc390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/1091058498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 0x7fbc14102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/1091058498 >> 172.21.15.123:0/1091058498 conn(0x7fbc140f7ef0 msgr2=0x7fbc140fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/1091058498 shutdown_connections 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.701+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/1091058498 wait complete. 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 Processor -- start 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 -- start start 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 0x7fbc1406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14071740 con 0x7fbc14102d00 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc1ab9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14070220 con 0x7fbc14102360 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54072/0 (socket says 172.21.15.123:54072) 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.702+0000 7fbc0bfff640 1 -- 172.21.15.123:0/3442975652 learned_addr learned my addr 172.21.15.123:0/3442975652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:02.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc0bfff640 1 -- 172.21.15.123:0/3442975652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 msgr2=0x7fbc1406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc18939640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 0x7fbc1406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc0bfff640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 0x7fbc1406f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc0bfff640 1 -- 172.21.15.123:0/3442975652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04005040 con 0x7fbc14102d00 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc0bfff640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031720 tx=0x7fbc04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc040094c0 con 0x7fbc14102d00 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc04009620 con 0x7fbc14102d00 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc14070470 con 0x7fbc14102d00 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0403b640 con 0x7fbc14102d00 2024-02-20T08:17:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.703+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc14119230 con 0x7fbc14102d00 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.704+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc14064480 con 0x7fbc14102d00 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.704+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fbc0402f070 con 0x7fbc14102d00 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.705+0000 7fbc097fa640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 0x7fbbfc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.705+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fbc040af690 con 0x7fbc14102d00 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.705+0000 7fbc18939640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 0x7fbbfc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.705+0000 7fbc18939640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 0x7fbbfc06fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc10004bc0 tx=0x7fbc10009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:02.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.709+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc04078d20 con 0x7fbc14102d00 2024-02-20T08:17:02.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.921+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fbc141094a0 con 0x7fbc14102d00 2024-02-20T08:17:02.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.921+0000 7fbc097fa640 1 -- 172.21.15.123:0/3442975652 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v34) v1 ==== 107+0+4188 (secure 0 0 0) 0x7fbc0407c3e0 con 0x7fbc14102d00 2024-02-20T08:17:02.923 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:02.923 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:14:58.840597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:02.923 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 30 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.923+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 msgr2=0x7fbbfc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.923+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 0x7fbbfc06fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc10004bc0 tx=0x7fbc10009040 comp rx=0 tx=0).stop 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.923+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 msgr2=0x7fbc1406fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.923+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031720 tx=0x7fbc04009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 shutdown_connections 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7fbbfc06d750 0x7fbbfc06fc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc14102d00 0x7fbc1406fce0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 --2- 172.21.15.123:0/3442975652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc14102360 0x7fbc1406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 >> 172.21.15.123:0/3442975652 conn(0x7fbc140f7ef0 msgr2=0x7fbc140f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 shutdown_connections 2024-02-20T08:17:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:02.924+0000 7fbc1ab9d640 1 -- 172.21.15.123:0/3442975652 wait complete. 2024-02-20T08:17:02.934 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:02 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2267934243' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-20T08:17:02.934 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:02 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1659830755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-20T08:17:02.934 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:02 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/994129058' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-20T08:17:02.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-20T08:17:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 -- 172.21.15.123:0/122690019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 msgr2=0x7f60b0102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/122690019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0102720 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0048d0 tx=0x7f60ac009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 -- 172.21.15.123:0/122690019 shutdown_connections 2024-02-20T08:17:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/122690019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 0x7f60b00fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/122690019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0102720 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 -- 172.21.15.123:0/122690019 >> 172.21.15.123:0/122690019 conn(0x7f60b00f7ee0 msgr2=0x7f60b00fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 -- 172.21.15.123:0/122690019 shutdown_connections 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.032+0000 7f60b7d5d640 1 -- 172.21.15.123:0/122690019 wait complete. 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 Processor -- start 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 -- start start 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 0x7f60b01131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01137e0 con 0x7f60b0102350 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b7d5d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b010cd70 con 0x7f60b0102cf0 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54100/0 (socket says 172.21.15.123:54100) 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 -- 172.21.15.123:0/1247697517 learned_addr learned my addr 172.21.15.123:0/1247697517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b52f8640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 0x7f60b01131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 -- 172.21.15.123:0/1247697517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 msgr2=0x7f60b01131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 0x7f60b01131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.033+0000 7f60b5af9640 1 -- 172.21.15.123:0/1247697517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac005040 con 0x7f60b0102350 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60b5af9640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60ac031720 tx=0x7f60ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ac0094c0 con 0x7f60b0102350 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b010cff0 con 0x7f60b0102350 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60ac009620 con 0x7f60b0102350 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ac03b640 con 0x7f60b0102350 2024-02-20T08:17:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.034+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b010d510 con 0x7f60b0102350 2024-02-20T08:17:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.035+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0064480 con 0x7f60b0102350 2024-02-20T08:17:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.035+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f60ac02f070 con 0x7f60b0102350 2024-02-20T08:17:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.036+0000 7f60a67fc640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 0x7f609c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.036+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f60ac0af580 con 0x7f60b0102350 2024-02-20T08:17:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.036+0000 7f60b52f8640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 0x7f609c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.036+0000 7f60b52f8640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 0x7f609c06fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007fd0 tx=0x7f60a0009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.041+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60ac078c10 con 0x7f60b0102350 2024-02-20T08:17:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:02 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2267934243' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-20T08:17:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:02 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1659830755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-20T08:17:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:02 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/994129058' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-20T08:17:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.251+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f60b010e330 con 0x7f60b0102350 2024-02-20T08:17:03.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.252+0000 7f60a67fc640 1 -- 172.21.15.123:0/1247697517 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v34) v1 ==== 107+0+4192 (secure 0 0 0) 0x7f60ac07c2d0 con 0x7f60b0102350 2024-02-20T08:17:03.253 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:03.253 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:15:07.980777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:03.253 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 31 2024-02-20T08:17:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 msgr2=0x7f609c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 0x7f609c06fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007fd0 tx=0x7f60a0009e90 comp rx=0 tx=0).stop 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 msgr2=0x7f60b0112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60ac031720 tx=0x7f60ac009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 shutdown_connections 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f609c06d750 0x7f609c06fc00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60b0102cf0 0x7f60b01131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 --2- 172.21.15.123:0/1247697517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0102350 0x7f60b0112ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 >> 172.21.15.123:0/1247697517 conn(0x7f60b00f7ee0 msgr2=0x7f60b00f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 shutdown_connections 2024-02-20T08:17:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.254+0000 7f60b7d5d640 1 -- 172.21.15.123:0/1247697517 wait complete. 2024-02-20T08:17:03.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-20T08:17:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 -- 172.21.15.123:0/3687396193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102cf0 msgr2=0x7f84300fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 --2- 172.21.15.123:0/3687396193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102cf0 0x7f84300fc380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84240048d0 tx=0x7f8424009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 -- 172.21.15.123:0/3687396193 shutdown_connections 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 --2- 172.21.15.123:0/3687396193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102cf0 0x7f84300fc380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 --2- 172.21.15.123:0/3687396193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102350 0x7f8430102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 -- 172.21.15.123:0/3687396193 >> 172.21.15.123:0/3687396193 conn(0x7f84300f7ee0 msgr2=0x7f84300fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 -- 172.21.15.123:0/3687396193 shutdown_connections 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.364+0000 7f8436b9d640 1 -- 172.21.15.123:0/3687396193 wait complete. 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 Processor -- start 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 -- start start 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102cf0 0x7f8430113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301138c0 con 0x7f8430102350 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8436b9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843010cdc0 con 0x7f8430102cf0 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8434939640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8434939640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54112/0 (socket says 172.21.15.123:54112) 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.365+0000 7f8434939640 1 -- 172.21.15.123:0/2444747125 learned_addr learned my addr 172.21.15.123:0/2444747125 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f842ffff640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102cf0 0x7f8430113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8434939640 1 -- 172.21.15.123:0/2444747125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102cf0 msgr2=0x7f8430113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8434939640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102cf0 0x7f8430113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8434939640 1 -- 172.21.15.123:0/2444747125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424005040 con 0x7f8430102350 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8434939640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f842000b790 tx=0x7f84200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f842000c700 con 0x7f8430102350 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843010d0a0 con 0x7f8430102350 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f842000cd30 con 0x7f8430102350 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8420013370 con 0x7f8430102350 2024-02-20T08:17:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.366+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843010d5c0 con 0x7f8430102350 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.367+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8430064480 con 0x7f8430102350 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.367+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8420012070 con 0x7f8430102350 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.368+0000 7f842d7fa640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 0x7f841806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.368+0000 7f842ffff640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 0x7f841806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.368+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f842008cce0 con 0x7f8430102350 2024-02-20T08:17:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.368+0000 7f842ffff640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 0x7f841806fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f842402bda0 tx=0x7f8424009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.373+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8420056370 con 0x7f8430102350 2024-02-20T08:17:03.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.584+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f8430109510 con 0x7f8430102350 2024-02-20T08:17:03.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.585+0000 7f842d7fa640 1 -- 172.21.15.123:0/2444747125 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v34) v1 ==== 107+0+5005 (secure 0 0 0) 0x7f8420059a30 con 0x7f8430102350 2024-02-20T08:17:03.586 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:03.586 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/1906868462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1906868462},{"type":"v1","addr":"172.21.15.194:6827","nonce":1906868462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:15:08.774807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:03.587 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-02-20T08:17:03.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 msgr2=0x7f841806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 0x7f841806fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f842402bda0 tx=0x7f8424009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 msgr2=0x7f8430112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f842000b790 tx=0x7f84200091d0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 shutdown_connections 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f841806d750 0x7f841806fc00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8430102cf0 0x7f8430113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 --2- 172.21.15.123:0/2444747125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8430102350 0x7f8430112cf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 >> 172.21.15.123:0/2444747125 conn(0x7f84300f7ee0 msgr2=0x7f84300f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 shutdown_connections 2024-02-20T08:17:03.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.587+0000 7f8436b9d640 1 -- 172.21.15.123:0/2444747125 wait complete. 2024-02-20T08:17:03.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-20T08:17:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 -- 172.21.15.123:0/4119346775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 msgr2=0x7ff3c00fe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4119346775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c00fe6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00048d0 tx=0x7ff3b0009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 -- 172.21.15.123:0/4119346775 shutdown_connections 2024-02-20T08:17:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4119346775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c00faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4119346775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c00fe6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 -- 172.21.15.123:0/4119346775 >> 172.21.15.123:0/4119346775 conn(0x7ff3c0071950 msgr2=0x7ff3c0071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 -- 172.21.15.123:0/4119346775 shutdown_connections 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.699+0000 7ff3c679d640 1 -- 172.21.15.123:0/4119346775 wait complete. 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 Processor -- start 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 -- start start 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c0112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0113720 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3c679d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c010ccb0 con 0x7ff3c00faa70 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54130/0 (socket says 172.21.15.123:54130) 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/4010874092 learned_addr learned my addr 172.21.15.123:0/4010874092 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/4010874092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 msgr2=0x7ff3c0112be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.700+0000 7ff3bffff640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c0112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bf7fe640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c0112be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/4010874092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0005040 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bffff640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c0112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bf7fe640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c790 tx=0x7ff3b40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3b400a820 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3b400ae50 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c010cf90 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3b40115e0 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.701+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c010d4b0 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.702+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c0064480 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.702+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff3b4012400 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.703+0000 7ff3bcff9640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 0x7ff3a806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.703+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ff3b408d210 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.703+0000 7ff3bffff640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 0x7ff3a806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.703+0000 7ff3bffff640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 0x7ff3a806fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002bda0 tx=0x7ff3b0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.708+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff3b4056920 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.918+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7ff3c010d730 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.919+0000 7ff3bcff9640 1 -- 172.21.15.123:0/4010874092 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v34) v1 ==== 107+0+5005 (secure 0 0 0) 0x7ff3b4059fe0 con 0x7ff3c00fe2f0 2024-02-20T08:17:03.919 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:03.919 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi123.uffypv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6829/266272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":266272272},{"type":"v1","addr":"172.21.15.123:6829","nonce":266272272}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44273,"name":"cephfs.smithi194.icyfny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/1865473040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1865473040},{"type":"v1","addr":"172.21.15.194:6825","nonce":1865473040}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi194.lquaku","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/1906868462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1906868462},{"type":"v1","addr":"172.21.15.194:6827","nonce":1906868462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-20T08:02:09.022635+0000","modified":"2024-02-20T08:15:09.845690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi123.gglmsl","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.123:6827/3930507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":3930507890},{"type":"v1","addr":"172.21.15.123:6827","nonce":3930507890}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-20T08:17:03.919 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 33 2024-02-20T08:17:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 msgr2=0x7ff3a806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 0x7ff3a806fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002bda0 tx=0x7ff3b0009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 msgr2=0x7ff3c0113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c790 tx=0x7ff3b40043c0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 shutdown_connections 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7ff3a806d750 0x7ff3a806fc00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00fe2f0 0x7ff3c0113120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 --2- 172.21.15.123:0/4010874092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c00faa70 0x7ff3c0112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 >> 172.21.15.123:0/4010874092 conn(0x7ff3c0071950 msgr2=0x7ff3c00f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 shutdown_connections 2024-02-20T08:17:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:03.921+0000 7ff3c679d640 1 -- 172.21.15.123:0/4010874092 wait complete. 2024-02-20T08:17:03.932 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-20T08:17:03.945 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-20T08:17:03.946 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T08:17:03.946 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-20T08:17:03.962 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T08:17:03.962 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-20T08:17:04.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-20T08:17:04.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:03 smithi194 ceph-mon[88937]: pgmap v266: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:03 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3442975652' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-20T08:17:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:03 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1247697517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-20T08:17:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:03 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2444747125' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-20T08:17:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 -- 172.21.15.123:0/211080786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 msgr2=0x7f24181028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 --2- 172.21.15.123:0/211080786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f24181028f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24140048d0 tx=0x7f2414009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 -- 172.21.15.123:0/211080786 shutdown_connections 2024-02-20T08:17:04.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 --2- 172.21.15.123:0/211080786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 0x7f24180fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 --2- 172.21.15.123:0/211080786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f24181028f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.160+0000 7f241fe58640 1 -- 172.21.15.123:0/211080786 >> 172.21.15.123:0/211080786 conn(0x7f24180f8060 msgr2=0x7f24180fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 -- 172.21.15.123:0/211080786 shutdown_connections 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 -- 172.21.15.123:0/211080786 wait complete. 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 Processor -- start 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 -- start start 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 0x7f2418112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418113870 con 0x7f2418102520 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241fe58640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241810ce00 con 0x7f24180fc4e0 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241d3f3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241d3f3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54156/0 (socket says 172.21.15.123:54156) 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241d3f3640 1 -- 172.21.15.123:0/2496395648 learned_addr learned my addr 172.21.15.123:0/2496395648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:04.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.161+0000 7f241dbf4640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 0x7f2418112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241d3f3640 1 -- 172.21.15.123:0/2496395648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 msgr2=0x7f2418112d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241d3f3640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 0x7f2418112d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241d3f3640 1 -- 172.21.15.123:0/2496395648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414005040 con 0x7f2418102520 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241d3f3640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f240800c830 tx=0x7f2408004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240800a850 con 0x7f2418102520 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241810d0e0 con 0x7f2418102520 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f240800ae80 con 0x7f2418102520 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2408012ea0 con 0x7f2418102520 2024-02-20T08:17:04.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.162+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241810d600 con 0x7f2418102520 2024-02-20T08:17:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.163+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2418064480 con 0x7f2418102520 2024-02-20T08:17:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.163+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2408012400 con 0x7f2418102520 2024-02-20T08:17:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.164+0000 7f240e7fc640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 0x7f240406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.164+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f240808d250 con 0x7f2418102520 2024-02-20T08:17:04.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.164+0000 7f241dbf4640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 0x7f240406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.164+0000 7f241dbf4640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 0x7f240406fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2414000c00 tx=0x7f2414009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.168+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2408056960 con 0x7f2418102520 2024-02-20T08:17:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:03 smithi123 ceph-mon[112409]: pgmap v266: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:03 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3442975652' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-20T08:17:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:03 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1247697517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-20T08:17:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:03 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2444747125' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-20T08:17:04.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.342+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24181095f0 con 0x7f2418102520 2024-02-20T08:17:04.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.343+0000 7f240e7fc640 1 -- 172.21.15.123:0/2496395648 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17362 (secure 0 0 0) 0x7f24080126b0 con 0x7f2418102520 2024-02-20T08:17:04.344 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:04.344 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:14:58.834802+0000","last_up_change":"2024-02-20T08:13:49.507285+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-20T08:02:07.859118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-20T08:02:08.249143+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":85,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6803","nonce":3390296229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6805","nonce":3390296229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6809","nonce":3390296229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6807","nonce":3390296229}]},"public_addr":"172.21.15.123:6803/3390296229","cluster_addr":"172.21.15.123:6805/3390296229","heartbeat_back_addr":"172.21.15.123:6809/3390296229","heartbeat_front_addr":"172.21.15.123:6807/3390296229","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":87,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6811","nonce":3638223896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6813","nonce":3638223896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6817","nonce":3638223896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6815","nonce":3638223896}]},"public_addr":"172.21.15.123:6811/3638223896","cluster_addr":"172.21.15.123:6813/3638223896","heartbeat_back_addr":"172.21.15.123:6817/3638223896","heartbeat_front_addr":"172.21.15.123:6815/3638223896","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":84,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6819","nonce":2869727014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6821","nonce":2869727014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6825","nonce":2869727014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6823","nonce":2869727014}]},"public_addr":"172.21.15.123:6819/2869727014","cluster_addr":"172.21.15.123:6821/2869727014","heartbeat_back_addr":"172.21.15.123:6825/2869727014","heartbeat_front_addr":"172.21.15.123:6823/2869727014","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":87,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6801","nonce":3997122390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6803","nonce":3997122390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6807","nonce":3997122390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6805","nonce":3997122390}]},"public_addr":"172.21.15.194:6801/3997122390","cluster_addr":"172.21.15.194:6803/3997122390","heartbeat_back_addr":"172.21.15.194:6807/3997122390","heartbeat_front_addr":"172.21.15.194:6805/3997122390","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":84,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6809","nonce":1371659365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6811","nonce":1371659365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6815","nonce":1371659365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6813","nonce":1371659365}]},"public_addr":"172.21.15.194:6809/1371659365","cluster_addr":"172.21.15.194:6811/1371659365","heartbeat_back_addr":"172.21.15.194:6815/1371659365","heartbeat_front_addr":"172.21.15.194:6813/1371659365","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":84,"up_thru":87,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6817","nonce":3914156420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6819","nonce":3914156420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6823","nonce":3914156420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6821","nonce":3914156420}]},"public_addr":"172.21.15.194:6817/3914156420","cluster_addr":"172.21.15.194:6819/3914156420","heartbeat_back_addr":"172.21.15.194:6823/3914156420","heartbeat_front_addr":"172.21.15.194:6821/3914156420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":5}]},{"pgid":"2.12","mappings":[{"from":0,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":5}]},{"pgid":"2.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":1,"to":5}]},{"pgid":"3.f","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6827/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6826/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6825/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6829/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/2962284630":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2566943054":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1567949854":"2024-02-21T08:04:27.200943+0000","172.21.15.194:0/2566710087":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2980357718":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6824/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6828/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:6826/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/4028843009":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.194:6828/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2184459282":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6829/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1920252283":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.194:0/1235011480":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6827/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/320629054":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2492856937":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6801/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.123:0/3945253827":"2024-02-21T08:09:40.596493+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:17:04.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 msgr2=0x7f240406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 0x7f240406fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2414000c00 tx=0x7f2414009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 msgr2=0x7f2418113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f240800c830 tx=0x7f2408004430 comp rx=0 tx=0).stop 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 shutdown_connections 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f240406d750 0x7f240406fc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2418102520 0x7f2418113270 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 --2- 172.21.15.123:0/2496395648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24180fc4e0 0x7f2418112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 >> 172.21.15.123:0/2496395648 conn(0x7f24180f8060 msgr2=0x7f24180f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 shutdown_connections 2024-02-20T08:17:04.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.345+0000 7f241fe58640 1 -- 172.21.15.123:0/2496395648 wait complete. 2024-02-20T08:17:04.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-20T07:59:36.763546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-20T08:02:07.859118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-20T08:02:08.249143+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-20T08:17:04.357 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-20T08:17:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 -- 172.21.15.123:0/3166964047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c0faa60 msgr2=0x7f678c0faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 --2- 172.21.15.123:0/3166964047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c0faa60 0x7f678c0faed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f677c0048d0 tx=0x7f677c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 -- 172.21.15.123:0/3166964047 shutdown_connections 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 --2- 172.21.15.123:0/3166964047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c0faa60 0x7f678c0faed0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 --2- 172.21.15.123:0/3166964047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c1023f0 0x7f678c1027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 -- 172.21.15.123:0/3166964047 >> 172.21.15.123:0/3166964047 conn(0x7f678c071880 msgr2=0x7f678c071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.460+0000 7f679366e640 1 -- 172.21.15.123:0/3166964047 shutdown_connections 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 -- 172.21.15.123:0/3166964047 wait complete. 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 Processor -- start 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 -- start start 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c0faa60 0x7f678c112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c113790 con 0x7f678c1023f0 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679366e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c10cd20 con 0x7f678c0faa60 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f6790c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f6790c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54172/0 (socket says 172.21.15.123:54172) 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f6790c09640 1 -- 172.21.15.123:0/1814864030 learned_addr learned my addr 172.21.15.123:0/1814864030 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.461+0000 7f679140a640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c0faa60 0x7f678c112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6790c09640 1 -- 172.21.15.123:0/1814864030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c0faa60 msgr2=0x7f678c112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6790c09640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c0faa60 0x7f678c112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6790c09640 1 -- 172.21.15.123:0/1814864030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c005040 con 0x7f678c1023f0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6790c09640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f677c031720 tx=0x7f677c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c0094c0 con 0x7f678c1023f0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f677c009620 con 0x7f678c1023f0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c10cfa0 con 0x7f678c1023f0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c03b640 con 0x7f678c1023f0 2024-02-20T08:17:04.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.462+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c10d4c0 con 0x7f678c1023f0 2024-02-20T08:17:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.463+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c064480 con 0x7f678c1023f0 2024-02-20T08:17:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.464+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f677c02f070 con 0x7f678c1023f0 2024-02-20T08:17:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.464+0000 7f6781ffb640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 0x7f677806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.464+0000 7f679140a640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 0x7f677806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.464+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f677c0af4e0 con 0x7f678c1023f0 2024-02-20T08:17:04.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.465+0000 7f679140a640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 0x7f677806fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f678c065200 tx=0x7f678800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.469+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f677c078b70 con 0x7f678c1023f0 2024-02-20T08:17:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.641+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f678c10e250 con 0x7f678c1023f0 2024-02-20T08:17:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.641+0000 7f6781ffb640 1 -- 172.21.15.123:0/1814864030 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f677c07c230 con 0x7f678c1023f0 2024-02-20T08:17:04.641 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 msgr2=0x7f677806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 0x7f677806fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f678c065200 tx=0x7f678800b040 comp rx=0 tx=0).stop 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 msgr2=0x7f678c113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f677c031720 tx=0x7f677c009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 shutdown_connections 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f677806d750 0x7f677806fc00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1023f0 0x7f678c113190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 --2- 172.21.15.123:0/1814864030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678c0faa60 0x7f678c112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 >> 172.21.15.123:0/1814864030 conn(0x7f678c071880 msgr2=0x7f678c105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 shutdown_connections 2024-02-20T08:17:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.643+0000 7f679366e640 1 -- 172.21.15.123:0/1814864030 wait complete. 2024-02-20T08:17:04.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-20T08:17:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- 172.21.15.123:0/227884125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16780faa80 msgr2=0x7f16780faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 --2- 172.21.15.123:0/227884125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16780faa80 0x7f16780faef0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16640048d0 tx=0x7f1664009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- 172.21.15.123:0/227884125 shutdown_connections 2024-02-20T08:17:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 --2- 172.21.15.123:0/227884125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16780faa80 0x7f16780faef0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 --2- 172.21.15.123:0/227884125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1678102410 0x7f16781027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- 172.21.15.123:0/227884125 >> 172.21.15.123:0/227884125 conn(0x7f16780718c0 msgr2=0x7f1678071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- 172.21.15.123:0/227884125 shutdown_connections 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- 172.21.15.123:0/227884125 wait complete. 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 Processor -- start 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.755+0000 7f167eb9d640 1 -- start start 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167eb9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 0x7f1678112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167eb9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167eb9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678113780 con 0x7f1678102410 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167eb9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167810cd10 con 0x7f16780faa80 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54194/0 (socket says 172.21.15.123:54194) 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 -- 172.21.15.123:0/343868602 learned_addr learned my addr 172.21.15.123:0/343868602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:04.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167c939640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 0x7f1678112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 -- 172.21.15.123:0/343868602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 msgr2=0x7f1678112c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 0x7f1678112c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 -- 172.21.15.123:0/343868602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664005040 con 0x7f1678102410 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167c939640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 0x7f1678112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f1677fff640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1664031720 tx=0x7f1664009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16640094c0 con 0x7f1678102410 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1664009620 con 0x7f1678102410 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167810cf90 con 0x7f1678102410 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.756+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166403b640 con 0x7f1678102410 2024-02-20T08:17:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.757+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167810d4b0 con 0x7f1678102410 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.758+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1678064480 con 0x7f1678102410 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.758+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f166402f070 con 0x7f1678102410 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.758+0000 7f16757fa640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 0x7f166806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.759+0000 7f167c939640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 0x7f166806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.759+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f16640af630 con 0x7f1678102410 2024-02-20T08:17:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.759+0000 7f167c939640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 0x7f166806fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f166c0041d0 tx=0x7f166c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:04.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.763+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1664078cc0 con 0x7f1678102410 2024-02-20T08:17:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.937+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f167810e240 con 0x7f1678102410 2024-02-20T08:17:04.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.937+0000 7f16757fa640 1 -- 172.21.15.123:0/343868602 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f166407c380 con 0x7f1678102410 2024-02-20T08:17:04.938 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:17:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 msgr2=0x7f166806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 0x7f166806fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f166c0041d0 tx=0x7f166c009040 comp rx=0 tx=0).stop 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 msgr2=0x7f1678113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1664031720 tx=0x7f1664009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 shutdown_connections 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f166806d750 0x7f166806fc00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678102410 0x7f1678113180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 --2- 172.21.15.123:0/343868602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16780faa80 0x7f1678112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 >> 172.21.15.123:0/343868602 conn(0x7f16780718c0 msgr2=0x7f16781053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 shutdown_connections 2024-02-20T08:17:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:04.939+0000 7f167eb9d640 1 -- 172.21.15.123:0/343868602 wait complete. 2024-02-20T08:17:04.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:04 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/4010874092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-20T08:17:04.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:04 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2496395648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:17:04.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:04 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1814864030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:17:04.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-20T08:17:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- 172.21.15.123:0/3965250657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0faa70 msgr2=0x7f480c0faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 --2- 172.21.15.123:0/3965250657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0faa70 0x7f480c0faee0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0048d0 tx=0x7f47fc009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- 172.21.15.123:0/3965250657 shutdown_connections 2024-02-20T08:17:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 --2- 172.21.15.123:0/3965250657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0faa70 0x7f480c0faee0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 --2- 172.21.15.123:0/3965250657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0fe300 0x7f480c0fe6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- 172.21.15.123:0/3965250657 >> 172.21.15.123:0/3965250657 conn(0x7f480c071950 msgr2=0x7f480c071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- 172.21.15.123:0/3965250657 shutdown_connections 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- 172.21.15.123:0/3965250657 wait complete. 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 Processor -- start 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.063+0000 7f4811a58640 1 -- start start 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 0x7f480c112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c113710 con 0x7f480c0fe300 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c113880 con 0x7f480c0faa70 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54204/0 (socket says 172.21.15.123:54204) 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 -- 172.21.15.123:0/1242055731 learned_addr learned my addr 172.21.15.123:0/1242055731 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f480affd640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 0x7f480c112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 -- 172.21.15.123:0/1242055731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 msgr2=0x7f480c112bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 0x7f480c112bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 -- 172.21.15.123:0/1242055731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc005040 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f480affd640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 0x7f480c112bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f48027fc640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47fc031720 tx=0x7f47fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47fc0094c0 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47fc009620 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c10cdf0 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47fc03b640 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.064+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c10d310 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.065+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c064480 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.066+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f47fc02f070 con 0x7f480c0fe300 2024-02-20T08:17:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.066+0000 7f4803fff640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 0x7f47ec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.066+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f47fc0af630 con 0x7f480c0fe300 2024-02-20T08:17:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.066+0000 7f480affd640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 0x7f47ec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.067+0000 7f480affd640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 0x7f47ec06fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47f4004d80 tx=0x7f47f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.071+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f47fc078cc0 con 0x7f480c0fe300 2024-02-20T08:17:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:04 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/4010874092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-20T08:17:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:04 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2496395648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:17:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:04 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1814864030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:17:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.241+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f480c10e210 con 0x7f480c0fe300 2024-02-20T08:17:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.241+0000 7f4803fff640 1 -- 172.21.15.123:0/1242055731 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f47fc07c380 con 0x7f480c0fe300 2024-02-20T08:17:05.242 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:17:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 msgr2=0x7f47ec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 0x7f47ec06fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47f4004d80 tx=0x7f47f400b040 comp rx=0 tx=0).stop 2024-02-20T08:17:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 msgr2=0x7f480c113110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47fc031720 tx=0x7f47fc009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 shutdown_connections 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f47ec06d750 0x7f47ec06fc00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f480c0fe300 0x7f480c113110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 --2- 172.21.15.123:0/1242055731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f480c0faa70 0x7f480c112bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.243+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 >> 172.21.15.123:0/1242055731 conn(0x7f480c071950 msgr2=0x7f480c0f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.244+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 shutdown_connections 2024-02-20T08:17:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.244+0000 7f4811a58640 1 -- 172.21.15.123:0/1242055731 wait complete. 2024-02-20T08:17:05.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 -- 172.21.15.123:0/81278393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 msgr2=0x7f4e500fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/81278393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e500fb2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e380048d0 tx=0x7f4e38009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 -- 172.21.15.123:0/81278393 shutdown_connections 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/81278393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e500fb2c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/81278393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 0x7f4e50101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 -- 172.21.15.123:0/81278393 >> 172.21.15.123:0/81278393 conn(0x7f4e500f6e60 msgr2=0x7f4e500f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 -- 172.21.15.123:0/81278393 shutdown_connections 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.359+0000 7f4e54f5d640 1 -- 172.21.15.123:0/81278393 wait complete. 2024-02-20T08:17:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 Processor -- start 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 -- start start 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 0x7f4e50112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e501136d0 con 0x7f4e50101c30 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e54f5d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5010cc60 con 0x7f4e50101290 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54218/0 (socket says 172.21.15.123:54218) 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 -- 172.21.15.123:0/3761929692 learned_addr learned my addr 172.21.15.123:0/3761929692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e4e59c640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 0x7f4e50112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 -- 172.21.15.123:0/3761929692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 msgr2=0x7f4e50112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 0x7f4e50112b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.360+0000 7f4e45d9b640 1 -- 172.21.15.123:0/3761929692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38005040 con 0x7f4e50101c30 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e45d9b640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e38031720 tx=0x7f4e38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e380094c0 con 0x7f4e50101c30 2024-02-20T08:17:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e38009620 con 0x7f4e50101c30 2024-02-20T08:17:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5010cee0 con 0x7f4e50101c30 2024-02-20T08:17:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3803b640 con 0x7f4e50101c30 2024-02-20T08:17:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.361+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5010d400 con 0x7f4e50101c30 2024-02-20T08:17:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.362+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e50064480 con 0x7f4e50101c30 2024-02-20T08:17:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.362+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4e3802f070 con 0x7f4e50101c30 2024-02-20T08:17:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.363+0000 7f4e477fe640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 0x7f4e3c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.363+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f4e380af5e0 con 0x7f4e50101c30 2024-02-20T08:17:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.363+0000 7f4e4e59c640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 0x7f4e3c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.363+0000 7f4e4e59c640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 0x7f4e3c06fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e400041d0 tx=0x7f4e40004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.367+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e38078c70 con 0x7f4e50101c30 2024-02-20T08:17:05.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.552+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e5010d590 con 0x7f4e50101c30 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.553+0000 7f4e477fe640 1 -- 172.21.15.123:0/3761929692 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v92) v1 ==== 81+0+2467 (secure 0 0 0) 0x7f4e3807c330 con 0x7f4e50101c30 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6827/2264298744 2024-02-21T08:14:58.834731+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6826/2264298744 2024-02-21T08:14:58.834731+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6825/235540453 2024-02-21T08:14:35.934389+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6829/3850080893 2024-02-21T08:14:13.781744+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3144234587 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/2962284630 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.553 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2566943054 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/677202268 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1567949854 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/2566710087 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2980357718 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1821605986 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/2877296499 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6824/235540453 2024-02-21T08:14:35.934389+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6828/3850080893 2024-02-21T08:14:13.781744+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6826/1747553083 2024-02-21T08:02:23.026518+0000 2024-02-20T08:17:05.554 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3280802372 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/4028843009 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1761482255 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6828/987094579 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4292438522 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/4006637556 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2184459282 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6829/987094579 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.555 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1920252283 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/41210014 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3515696519 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/1235011480 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2386522260 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/1899432870 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/4006637556 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6827/1747553083 2024-02-21T08:02:23.026518+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/41210014 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/946040318 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/946040318 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/320629054 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/1899432870 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4119566115 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2492856937 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/2877296499 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3945253827 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:listed 41 entries 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.554+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 msgr2=0x7f4e3c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.554+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 0x7f4e3c06fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e400041d0 tx=0x7f4e40004330 comp rx=0 tx=0).stop 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 msgr2=0x7f4e501130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e38031720 tx=0x7f4e38009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 shutdown_connections 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f4e3c06d750 0x7f4e3c06fc00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50101c30 0x7f4e501130d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 --2- 172.21.15.123:0/3761929692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50101290 0x7f4e50112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 >> 172.21.15.123:0/3761929692 conn(0x7f4e500f6e60 msgr2=0x7f4e50065690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 shutdown_connections 2024-02-20T08:17:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.555+0000 7f4e54f5d640 1 -- 172.21.15.123:0/3761929692 wait complete. 2024-02-20T08:17:05.565 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-02-20T08:17:05.566 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-20T08:17:05.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-20T08:17:05.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 -- 172.21.15.123:0/3090846634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102c20 msgr2=0x7f32300fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3090846634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102c20 0x7f32300fc2b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f32200048d0 tx=0x7f3220009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 -- 172.21.15.123:0/3090846634 shutdown_connections 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3090846634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102c20 0x7f32300fc2b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3090846634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102280 0x7f3230102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 -- 172.21.15.123:0/3090846634 >> 172.21.15.123:0/3090846634 conn(0x7f32300f7e50 msgr2=0x7f32300fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 -- 172.21.15.123:0/3090846634 shutdown_connections 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.729+0000 7f3237c6e640 1 -- 172.21.15.123:0/3090846634 wait complete. 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 Processor -- start 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 -- start start 2024-02-20T08:17:05.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102c20 0x7f32301130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301136c0 con 0x7f3230102280 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3237c6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323010cc50 con 0x7f3230102c20 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54244/0 (socket says 172.21.15.123:54244) 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 -- 172.21.15.123:0/3065200906 learned_addr learned my addr 172.21.15.123:0/3065200906 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235209640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102c20 0x7f32301130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 -- 172.21.15.123:0/3065200906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102c20 msgr2=0x7f32301130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102c20 0x7f32301130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.730+0000 7f3235a0a640 1 -- 172.21.15.123:0/3065200906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3220005040 con 0x7f3230102280 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f3235a0a640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f322800db80 tx=0x7f3228004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322800b950 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f322800f040 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323010cf30 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32280123b0 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.731+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323010d420 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.732+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230064030 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.732+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3228013430 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.733+0000 7f32267fc640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 0x7f321c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.733+0000 7f3235209640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 0x7f321c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.733+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f322808d2e0 con 0x7f3230102280 2024-02-20T08:17:05.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.733+0000 7f3235209640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 0x7f321c06fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f323010dd90 tx=0x7f3220009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.737+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f322805a4a0 con 0x7f3230102280 2024-02-20T08:17:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.913+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323010e180 con 0x7f3230102280 2024-02-20T08:17:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.915+0000 7f32267fc640 1 -- 172.21.15.123:0/3065200906 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17362 (secure 0 0 0) 0x7f322805a030 con 0x7f3230102280 2024-02-20T08:17:05.916 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-02-20T08:17:05.916 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"1f99de10-cfc5-11ee-95bb-87774f69a715","created":"2024-02-20T07:54:54.106366+0000","modified":"2024-02-20T08:14:58.834802+0000","last_up_change":"2024-02-20T08:13:49.507285+0000","last_in_change":"2024-02-20T08:00:34.067126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-20T07:59:36.763546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-20T08:02:07.859118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-20T08:02:08.249143+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e3cf13df-1d84-4a10-ab38-47332903619f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":85,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6803","nonce":3390296229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6805","nonce":3390296229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6809","nonce":3390296229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3390296229},{"type":"v1","addr":"172.21.15.123:6807","nonce":3390296229}]},"public_addr":"172.21.15.123:6803/3390296229","cluster_addr":"172.21.15.123:6805/3390296229","heartbeat_back_addr":"172.21.15.123:6809/3390296229","heartbeat_front_addr":"172.21.15.123:6807/3390296229","state":["exists","up"]},{"osd":1,"uuid":"750e4ff7-40b2-405d-a9ee-f03102332544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":87,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6811","nonce":3638223896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6813","nonce":3638223896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6817","nonce":3638223896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3638223896},{"type":"v1","addr":"172.21.15.123:6815","nonce":3638223896}]},"public_addr":"172.21.15.123:6811/3638223896","cluster_addr":"172.21.15.123:6813/3638223896","heartbeat_back_addr":"172.21.15.123:6817/3638223896","heartbeat_front_addr":"172.21.15.123:6815/3638223896","state":["exists","up"]},{"osd":2,"uuid":"c7d20260-3e6a-47f3-a055-f6bd8b0ecf22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":84,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6819","nonce":2869727014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6821","nonce":2869727014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6825","nonce":2869727014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2869727014},{"type":"v1","addr":"172.21.15.123:6823","nonce":2869727014}]},"public_addr":"172.21.15.123:6819/2869727014","cluster_addr":"172.21.15.123:6821/2869727014","heartbeat_back_addr":"172.21.15.123:6825/2869727014","heartbeat_front_addr":"172.21.15.123:6823/2869727014","state":["exists","up"]},{"osd":3,"uuid":"e5455da3-b3a2-4204-94ec-1d4a73d3f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":87,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6801","nonce":3997122390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6803","nonce":3997122390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6807","nonce":3997122390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3997122390},{"type":"v1","addr":"172.21.15.194:6805","nonce":3997122390}]},"public_addr":"172.21.15.194:6801/3997122390","cluster_addr":"172.21.15.194:6803/3997122390","heartbeat_back_addr":"172.21.15.194:6807/3997122390","heartbeat_front_addr":"172.21.15.194:6805/3997122390","state":["exists","up"]},{"osd":4,"uuid":"82e0e899-c58d-4be5-9ad8-2612862c87a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":84,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6809","nonce":1371659365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6811","nonce":1371659365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6815","nonce":1371659365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1371659365},{"type":"v1","addr":"172.21.15.194:6813","nonce":1371659365}]},"public_addr":"172.21.15.194:6809/1371659365","cluster_addr":"172.21.15.194:6811/1371659365","heartbeat_back_addr":"172.21.15.194:6815/1371659365","heartbeat_front_addr":"172.21.15.194:6813/1371659365","state":["exists","up"]},{"osd":5,"uuid":"19386ed7-00c6-4412-92da-95b40c4acb32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":84,"up_thru":87,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6817","nonce":3914156420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6819","nonce":3914156420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6823","nonce":3914156420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":3914156420},{"type":"v1","addr":"172.21.15.194:6821","nonce":3914156420}]},"public_addr":"172.21.15.194:6817/3914156420","cluster_addr":"172.21.15.194:6819/3914156420","heartbeat_back_addr":"172.21.15.194:6823/3914156420","heartbeat_front_addr":"172.21.15.194:6821/3914156420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:58:35.370719+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:05.406387+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:33.635478+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T07:59:59.087285+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:25.597848+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-20T08:00:51.530307+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":5}]},{"pgid":"2.12","mappings":[{"from":0,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":5}]},{"pgid":"2.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":1,"to":5}]},{"pgid":"3.f","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6827/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6826/2264298744":"2024-02-21T08:14:58.834731+0000","172.21.15.194:6825/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6829/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:0/3144234587":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/2962284630":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2566943054":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/677202268":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/1567949854":"2024-02-21T08:04:27.200943+0000","172.21.15.194:0/2566710087":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2980357718":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/1821605986":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6824/235540453":"2024-02-21T08:14:35.934389+0000","172.21.15.123:6828/3850080893":"2024-02-21T08:14:13.781744+0000","172.21.15.123:6826/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:0/3280802372":"2024-02-21T07:55:53.327606+0000","172.21.15.194:0/4028843009":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1761482255":"2024-02-21T07:57:18.430027+0000","172.21.15.194:6828/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/4292438522":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6800/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2184459282":"2024-02-21T08:09:40.596493+0000","172.21.15.194:6829/987094579":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/1920252283":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:0/3515696519":"2024-02-21T07:55:23.308559+0000","172.21.15.194:0/1235011480":"2024-02-21T08:06:30.252382+0000","172.21.15.123:0/2386522260":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:6801/4006637556":"2024-02-21T07:55:53.327606+0000","172.21.15.123:6827/1747553083":"2024-02-21T08:02:23.026518+0000","172.21.15.123:6800/41210014":"2024-02-21T07:57:18.430027+0000","172.21.15.123:6800/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:6801/946040318":"2024-02-21T08:04:27.200943+0000","172.21.15.123:0/320629054":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6800/1899432870":"2024-02-21T07:55:23.308559+0000","172.21.15.123:0/4119566115":"2024-02-21T07:55:53.327606+0000","172.21.15.123:0/2492856937":"2024-02-21T08:09:40.596493+0000","172.21.15.123:6801/2877296499":"2024-02-21T08:09:40.596493+0000","172.21.15.123:0/3945253827":"2024-02-21T08:09:40.596493+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-20T08:17:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 msgr2=0x7f321c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 0x7f321c06fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f323010dd90 tx=0x7f3220009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 msgr2=0x7f3230112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f322800db80 tx=0x7f3228004f00 comp rx=0 tx=0).stop 2024-02-20T08:17:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 shutdown_connections 2024-02-20T08:17:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f321c06d750 0x7f321c06fc00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3230102c20 0x7f32301130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 --2- 172.21.15.123:0/3065200906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3230102280 0x7f3230112b80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 >> 172.21.15.123:0/3065200906 conn(0x7f32300f7e50 msgr2=0x7f32300f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 shutdown_connections 2024-02-20T08:17:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:05.917+0000 7f3237c6e640 1 -- 172.21.15.123:0/3065200906 wait complete. 2024-02-20T08:17:05.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-20T07:59:36.763546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-20T08:02:07.859118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-20T08:02:08.249143+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-20T08:17:05.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-20T08:17:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- 172.21.15.123:0/3721632472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6444101330 msgr2=0x7f6444101700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 --2- 172.21.15.123:0/3721632472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6444101330 0x7f6444101700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f64340048d0 tx=0x7f6434009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- 172.21.15.123:0/3721632472 shutdown_connections 2024-02-20T08:17:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 --2- 172.21.15.123:0/3721632472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64440fbb90 0x7f64440fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 --2- 172.21.15.123:0/3721632472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6444101330 0x7f6444101700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- 172.21.15.123:0/3721632472 >> 172.21.15.123:0/3721632472 conn(0x7f64440718c0 msgr2=0x7f6444071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- 172.21.15.123:0/3721632472 shutdown_connections 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- 172.21.15.123:0/3721632472 wait complete. 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 Processor -- start 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.036+0000 7f6449d1d640 1 -- start start 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6444101330 0x7f644410e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644410e8a0 con 0x7f64440fbb90 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644410ea10 con 0x7f6444101330 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54274/0 (socket says 172.21.15.123:54274) 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 -- 172.21.15.123:0/2211466024 learned_addr learned my addr 172.21.15.123:0/2211466024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6442ffd640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6444101330 0x7f644410e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 -- 172.21.15.123:0/2211466024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6444101330 msgr2=0x7f644410e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6444101330 0x7f644410e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 -- 172.21.15.123:0/2211466024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434005040 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f64437fe640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f643402be30 tx=0x7f6434009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64340092e0 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6434009440 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64340436d0 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6444116e00 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.037+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64441171e0 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.038+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6444064480 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.039+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f643403bad0 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.039+0000 7f642bfff640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 0x7f642c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.039+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f64340afe90 con 0x7f64440fbb90 2024-02-20T08:17:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.039+0000 7f6442ffd640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 0x7f642c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.040+0000 7f6442ffd640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 0x7f642c06fc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6438006fd0 tx=0x7f6438008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.044+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f64340795a0 con 0x7f64440fbb90 2024-02-20T08:17:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:05 smithi194 ceph-mon[88937]: pgmap v267: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:05 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/343868602' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:17:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:05 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1242055731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:17:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:05 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3761929692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-20T08:17:06.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.214+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64440fb200 con 0x7f64440fbb90 2024-02-20T08:17:06.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.215+0000 7f642bfff640 1 -- 172.21.15.123:0/2211466024 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f643407cc60 con 0x7f64440fbb90 2024-02-20T08:17:06.215 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.216+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 msgr2=0x7f642c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.216+0000 7f6449d1d640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 0x7f642c06fc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6438006fd0 tx=0x7f6438008040 comp rx=0 tx=0).stop 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.216+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 msgr2=0x7f644410dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.216+0000 7f6449d1d640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f643402be30 tx=0x7f6434009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 shutdown_connections 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f642c06d760 0x7f642c06fc10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6444101330 0x7f644410e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 --2- 172.21.15.123:0/2211466024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64440fbb90 0x7f644410dd90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 >> 172.21.15.123:0/2211466024 conn(0x7f64440718c0 msgr2=0x7f64440f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 shutdown_connections 2024-02-20T08:17:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.217+0000 7f6449d1d640 1 -- 172.21.15.123:0/2211466024 wait complete. 2024-02-20T08:17:06.226 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:05 smithi123 ceph-mon[112409]: pgmap v267: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:06.227 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:05 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/343868602' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:17:06.227 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:05 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1242055731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:17:06.227 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:05 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3761929692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-20T08:17:06.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 -- 172.21.15.123:0/3480049600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 msgr2=0x7f1f28102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 --2- 172.21.15.123:0/3480049600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28102770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f240048d0 tx=0x7f1f24009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 -- 172.21.15.123:0/3480049600 shutdown_connections 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 --2- 172.21.15.123:0/3480049600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f280fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 --2- 172.21.15.123:0/3480049600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28102770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 -- 172.21.15.123:0/3480049600 >> 172.21.15.123:0/3480049600 conn(0x7f1f280f7f90 msgr2=0x7f1f280fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 -- 172.21.15.123:0/3480049600 shutdown_connections 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.336+0000 7f1f2f825640 1 -- 172.21.15.123:0/3480049600 wait complete. 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 Processor -- start 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 -- start start 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f28113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28113a50 con 0x7f1f281023a0 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2f825640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2810cfe0 con 0x7f1f28102d40 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54294/0 (socket says 172.21.15.123:54294) 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 -- 172.21.15.123:0/371539044 learned_addr learned my addr 172.21.15.123:0/371539044 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2cdc0640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f28113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 -- 172.21.15.123:0/371539044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 msgr2=0x7f1f28113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f28113450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 -- 172.21.15.123:0/371539044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24005040 con 0x7f1f281023a0 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2cdc0640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f28113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.337+0000 7f1f2d5c1640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f24031720 tx=0x7f1f24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.338+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f240094c0 con 0x7f1f281023a0 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.338+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2810d260 con 0x7f1f281023a0 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.338+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f24009620 con 0x7f1f281023a0 2024-02-20T08:17:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.338+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2403b640 con 0x7f1f281023a0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.338+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2810d780 con 0x7f1f281023a0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.339+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f28064030 con 0x7f1f281023a0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.339+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1f2402f070 con 0x7f1f281023a0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.340+0000 7f1f1dffb640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 0x7f1f1406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.340+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f1f240af5e0 con 0x7f1f281023a0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.340+0000 7f1f2cdc0640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 0x7f1f1406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.340+0000 7f1f2cdc0640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 0x7f1f1406fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.349+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f24078c70 con 0x7f1f281023a0 2024-02-20T08:17:06.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.527+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1f2810e510 con 0x7f1f281023a0 2024-02-20T08:17:06.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.527+0000 7f1f1dffb640 1 -- 172.21.15.123:0/371539044 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1f2407c330 con 0x7f1f281023a0 2024-02-20T08:17:06.527 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 msgr2=0x7f1f1406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 0x7f1f1406fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18009e90 comp rx=0 tx=0).stop 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 msgr2=0x7f1f28112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f24031720 tx=0x7f1f24009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 shutdown_connections 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f1f1406d750 0x7f1f1406fc00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f28102d40 0x7f1f28113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 --2- 172.21.15.123:0/371539044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f281023a0 0x7f1f28112f10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 >> 172.21.15.123:0/371539044 conn(0x7f1f280f7f90 msgr2=0x7f1f280f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 shutdown_connections 2024-02-20T08:17:06.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.529+0000 7f1f2f825640 1 -- 172.21.15.123:0/371539044 wait complete. 2024-02-20T08:17:06.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-20T08:17:06.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.644+0000 7f0f5695d640 1 -- 172.21.15.123:0/1063092825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 msgr2=0x7f0f500fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.644+0000 7f0f5695d640 1 --2- 172.21.15.123:0/1063092825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f500fc3a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0f440048d0 tx=0x7f0f44009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.644+0000 7f0f5695d640 1 -- 172.21.15.123:0/1063092825 shutdown_connections 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.644+0000 7f0f5695d640 1 --2- 172.21.15.123:0/1063092825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f500fc3a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.644+0000 7f0f5695d640 1 --2- 172.21.15.123:0/1063092825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f50102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- 172.21.15.123:0/1063092825 >> 172.21.15.123:0/1063092825 conn(0x7f0f500f7f60 msgr2=0x7f0f500fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- 172.21.15.123:0/1063092825 shutdown_connections 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- 172.21.15.123:0/1063092825 wait complete. 2024-02-20T08:17:06.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 Processor -- start 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- start start 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f500712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5006fd50 con 0x7f0f50102d10 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f5695d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5006fec0 con 0x7f0f50102370 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f4f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f4f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54316/0 (socket says 172.21.15.123:54316) 2024-02-20T08:17:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.645+0000 7f0f4f7fe640 1 -- 172.21.15.123:0/2150275070 learned_addr learned my addr 172.21.15.123:0/2150275070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4ffff640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f500712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4f7fe640 1 -- 172.21.15.123:0/2150275070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 msgr2=0x7f0f500712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4f7fe640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f500712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4f7fe640 1 -- 172.21.15.123:0/2150275070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44005040 con 0x7f0f50102d10 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4ffff640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f500712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4f7fe640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0f44031720 tx=0x7f0f44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f440094c0 con 0x7f0f50102d10 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f50070140 con 0x7f0f50102d10 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f44009620 con 0x7f0f50102d10 2024-02-20T08:17:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4403b640 con 0x7f0f50102d10 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.646+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5011d7e0 con 0x7f0f50102d10 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.647+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f500637a0 con 0x7f0f50102d10 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.648+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0f4402f070 con 0x7f0f50102d10 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.648+0000 7f0f4cff9640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 0x7f0f3806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.648+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f0f440af580 con 0x7f0f50102d10 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.648+0000 7f0f4ffff640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 0x7f0f3806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.648+0000 7f0f4ffff640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 0x7f0f3806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f40004d60 tx=0x7f0f4000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.655+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f44078c10 con 0x7f0f50102d10 2024-02-20T08:17:06.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.833+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f0f501094b0 con 0x7f0f50102d10 2024-02-20T08:17:06.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.833+0000 7f0f4cff9640 1 -- 172.21.15.123:0/2150275070 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0f4407c2d0 con 0x7f0f50102d10 2024-02-20T08:17:06.834 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-02-20T08:17:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 msgr2=0x7f0f3806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 0x7f0f3806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f40004d60 tx=0x7f0f4000b040 comp rx=0 tx=0).stop 2024-02-20T08:17:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 msgr2=0x7f0f5006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0f44031720 tx=0x7f0f44009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 shutdown_connections 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0f3806d750 0x7f0f3806fc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f50102d10 0x7f0f5006f7a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 --2- 172.21.15.123:0/2150275070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f50102370 0x7f0f500712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 >> 172.21.15.123:0/2150275070 conn(0x7f0f500f7f60 msgr2=0x7f0f500f99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 shutdown_connections 2024-02-20T08:17:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.835+0000 7f0f5695d640 1 -- 172.21.15.123:0/2150275070 wait complete. 2024-02-20T08:17:06.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-20T08:17:06.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1643332610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b480644b0 msgr2=0x7f0b480648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1643332610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b480644b0 0x7f0b480648e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0b300048d0 tx=0x7f0b30009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1643332610 shutdown_connections 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1643332610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b480644b0 0x7f0b480648e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1643332610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b481023e0 0x7f0b481027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1643332610 >> 172.21.15.123:0/1643332610 conn(0x7f0b48071230 msgr2=0x7f0b48071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1643332610 shutdown_connections 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1643332610 wait complete. 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.950+0000 7f0b4d59d640 1 Processor -- start 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b4d59d640 1 -- start start 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b4d59d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 0x7f0b48112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b4d59d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b4d59d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481137b0 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b4d59d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4810ccb0 con 0x7f0b480644b0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54340/0 (socket says 172.21.15.123:54340) 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 -- 172.21.15.123:0/1972624903 learned_addr learned my addr 172.21.15.123:0/1972624903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 0x7f0b48112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 -- 172.21.15.123:0/1972624903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 msgr2=0x7f0b48112be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 0x7f0b48112be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 -- 172.21.15.123:0/1972624903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30005040 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 0x7f0b48112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3ffff640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b30031720 tx=0x7f0b30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b300094c0 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b30009620 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.951+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3003b640 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.952+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4810cf30 con 0x7f0b481023e0 2024-02-20T08:17:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.952+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4810d450 con 0x7f0b481023e0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.953+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b48064030 con 0x7f0b481023e0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.953+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0b3002f070 con 0x7f0b481023e0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.953+0000 7f0b3f7fe640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 0x7f0b3406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.953+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f0b300af560 con 0x7f0b481023e0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.953+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 0x7f0b3406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.954+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 0x7f0b3406fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009a80 tx=0x7f0b38008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-20T08:17:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:06.958+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b30078c70 con 0x7f0b481023e0 2024-02-20T08:17:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:06 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/3065200906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:17:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:06 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2211466024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:06 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/371539044' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:06 smithi194 ceph-mon[88937]: pgmap v268: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:06 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/2150275070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.149+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b48109510 con 0x7f0b481023e0 2024-02-20T08:17:07.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.150+0000 7f0b3f7fe640 1 -- 172.21.15.123:0/1972624903 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v92) v1 ==== 81+0+2467 (secure 0 0 0) 0x7f0b3007c330 con 0x7f0b481023e0 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6827/2264298744 2024-02-21T08:14:58.834731+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6826/2264298744 2024-02-21T08:14:58.834731+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6825/235540453 2024-02-21T08:14:35.934389+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6829/3850080893 2024-02-21T08:14:13.781744+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3144234587 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/2962284630 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2566943054 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/677202268 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1567949854 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/2566710087 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.150 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2980357718 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1821605986 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/2877296499 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6824/235540453 2024-02-21T08:14:35.934389+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6828/3850080893 2024-02-21T08:14:13.781744+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6826/1747553083 2024-02-21T08:02:23.026518+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3280802372 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/4028843009 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1761482255 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6828/987094579 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4292438522 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/4006637556 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2184459282 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:6829/987094579 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.151 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1920252283 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/41210014 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3515696519 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.194:0/1235011480 2024-02-21T08:06:30.252382+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2386522260 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/1899432870 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/4006637556 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6827/1747553083 2024-02-21T08:02:23.026518+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/41210014 2024-02-21T07:57:18.430027+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/946040318 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/946040318 2024-02-21T08:04:27.200943+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/320629054 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/1899432870 2024-02-21T07:55:23.308559+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4119566115 2024-02-21T07:55:53.327606+0000 2024-02-20T08:17:07.152 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2492856937 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.153 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/2877296499 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.153 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3945253827 2024-02-21T08:09:40.596493+0000 2024-02-20T08:17:07.153 INFO:teuthology.orchestra.run.smithi123.stderr:listed 41 entries 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.151+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 msgr2=0x7f0b3406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.151+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 0x7f0b3406fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009a80 tx=0x7f0b38008040 comp rx=0 tx=0).stop 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.151+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 msgr2=0x7f0b48113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.151+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b30031720 tx=0x7f0b30009da0 comp rx=0 tx=0).stop 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 shutdown_connections 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:6800/1892793252,v1:172.21.15.123:6801/1892793252] conn(0x7f0b3406d750 0x7f0b3406fc00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481023e0 0x7f0b48113120 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 --2- 172.21.15.123:0/1972624903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b480644b0 0x7f0b48112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 >> 172.21.15.123:0/1972624903 conn(0x7f0b48071230 msgr2=0x7f0b480fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 shutdown_connections 2024-02-20T08:17:07.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-02-20T08:17:07.152+0000 7f0b4d59d640 1 -- 172.21.15.123:0/1972624903 wait complete. 2024-02-20T08:17:07.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:06 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/3065200906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-20T08:17:07.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:06 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2211466024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:06 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/371539044' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:06 smithi123 ceph-mon[112409]: pgmap v268: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:07.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:06 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/2150275070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-20T08:17:07.162 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-02-20T08:17:07.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-20T08:17:07.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-20T08:17:07.190 INFO:teuthology.orchestra.run:waiting for 300 2024-02-20T08:17:08.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:07 smithi194 ceph-mon[88937]: from='client.? 172.21.15.123:0/1972624903' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-20T08:17:08.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:07 smithi123 ceph-mon[112409]: from='client.? 172.21.15.123:0/1972624903' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-20T08:17:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:08 smithi194 ceph-mon[88937]: pgmap v269: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:09.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:08 smithi123 ceph-mon[112409]: pgmap v269: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:12.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:11 smithi194 ceph-mon[88937]: pgmap v270: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:11 smithi123 ceph-mon[112409]: pgmap v270: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:13 smithi194 ceph-mon[88937]: pgmap v271: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:13 smithi123 ceph-mon[112409]: pgmap v271: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:15 smithi194 ceph-mon[88937]: pgmap v272: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:15 smithi123 ceph-mon[112409]: pgmap v272: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:18.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:17 smithi123 ceph-mon[112409]: pgmap v273: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:17 smithi194 ceph-mon[88937]: pgmap v273: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:19 smithi194 ceph-mon[88937]: pgmap v274: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:17:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:17:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:17:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:19 smithi123 ceph-mon[112409]: pgmap v274: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:17:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:17:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:17:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:17:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:17:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:21 smithi194 ceph-mon[88937]: pgmap v275: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:21 smithi123 ceph-mon[112409]: pgmap v275: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:23 smithi194 ceph-mon[88937]: pgmap v276: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:23 smithi123 ceph-mon[112409]: pgmap v276: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:25 smithi194 ceph-mon[88937]: pgmap v277: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:25 smithi123 ceph-mon[112409]: pgmap v277: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:28.061 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:27 smithi123 ceph-mon[112409]: pgmap v278: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:28.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:27 smithi194 ceph-mon[88937]: pgmap v278: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:29 smithi194 ceph-mon[88937]: pgmap v279: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:29 smithi123 ceph-mon[112409]: pgmap v279: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:31 smithi194 ceph-mon[88937]: pgmap v280: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:32.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:31 smithi123 ceph-mon[112409]: pgmap v280: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:33 smithi194 ceph-mon[88937]: pgmap v281: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:33 smithi123 ceph-mon[112409]: pgmap v281: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:36.061 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:35 smithi123 ceph-mon[112409]: pgmap v282: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:35 smithi194 ceph-mon[88937]: pgmap v282: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:38.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:37 smithi194 ceph-mon[88937]: pgmap v283: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:38.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:37 smithi123 ceph-mon[112409]: pgmap v283: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:39 smithi194 ceph-mon[88937]: pgmap v284: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:39 smithi123 ceph-mon[112409]: pgmap v284: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:42.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:41 smithi194 ceph-mon[88937]: pgmap v285: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:42.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:41 smithi123 ceph-mon[112409]: pgmap v285: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:44.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:43 smithi194 ceph-mon[88937]: pgmap v286: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:44.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:43 smithi123 ceph-mon[112409]: pgmap v286: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:46.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:45 smithi194 ceph-mon[88937]: pgmap v287: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:46.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:45 smithi123 ceph-mon[112409]: pgmap v287: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:48.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:47 smithi123 ceph-mon[112409]: pgmap v288: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:48.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:47 smithi194 ceph-mon[88937]: pgmap v288: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:50.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:49 smithi194 ceph-mon[88937]: pgmap v289: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:50.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:49 smithi123 ceph-mon[112409]: pgmap v289: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:52.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:51 smithi194 ceph-mon[88937]: pgmap v290: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:52.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:51 smithi123 ceph-mon[112409]: pgmap v290: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:54.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:53 smithi194 ceph-mon[88937]: pgmap v291: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:54.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:53 smithi123 ceph-mon[112409]: pgmap v291: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:55 smithi194 ceph-mon[88937]: pgmap v292: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:55 smithi123 ceph-mon[112409]: pgmap v292: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:17:58.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:57 smithi194 ceph-mon[88937]: pgmap v293: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:17:58.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:57 smithi123 ceph-mon[112409]: pgmap v293: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:00.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:17:59 smithi194 ceph-mon[88937]: pgmap v294: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:00.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:17:59 smithi123 ceph-mon[112409]: pgmap v294: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:02.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:01 smithi194 ceph-mon[88937]: pgmap v295: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:02.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:01 smithi123 ceph-mon[112409]: pgmap v295: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:04.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:03 smithi194 ceph-mon[88937]: pgmap v296: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:04.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:03 smithi123 ceph-mon[112409]: pgmap v296: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:06.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:05 smithi194 ceph-mon[88937]: pgmap v297: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:06.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:05 smithi123 ceph-mon[112409]: pgmap v297: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:08.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:07 smithi194 ceph-mon[88937]: pgmap v298: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:08.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:07 smithi123 ceph-mon[112409]: pgmap v298: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:10.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:09 smithi194 ceph-mon[88937]: pgmap v299: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:09 smithi123 ceph-mon[112409]: pgmap v299: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:10 smithi194 ceph-mon[88937]: pgmap v300: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:10 smithi123 ceph-mon[112409]: pgmap v300: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:14.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:13 smithi194 ceph-mon[88937]: pgmap v301: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:14.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:13 smithi123 ceph-mon[112409]: pgmap v301: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:16.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:15 smithi194 ceph-mon[88937]: pgmap v302: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:16.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:15 smithi123 ceph-mon[112409]: pgmap v302: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:18.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:17 smithi123 ceph-mon[112409]: pgmap v303: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:18.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:17 smithi194 ceph-mon[88937]: pgmap v303: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:20.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:19 smithi194 ceph-mon[88937]: pgmap v304: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:20.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:19 smithi123 ceph-mon[112409]: pgmap v304: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:18:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:18:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:22.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:21 smithi194 ceph-mon[88937]: pgmap v305: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:22.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:18:22.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:18:22.167 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:21 smithi123 ceph-mon[112409]: pgmap v305: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:18:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:18:22.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:18:24.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:23 smithi194 ceph-mon[88937]: pgmap v306: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:24.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:23 smithi123 ceph-mon[112409]: pgmap v306: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:25 smithi194 ceph-mon[88937]: pgmap v307: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:25 smithi123 ceph-mon[112409]: pgmap v307: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:28.060 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:27 smithi123 ceph-mon[112409]: pgmap v308: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:28.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:27 smithi194 ceph-mon[88937]: pgmap v308: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:30.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:29 smithi194 ceph-mon[88937]: pgmap v309: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:30.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:29 smithi123 ceph-mon[112409]: pgmap v309: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:32.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:31 smithi194 ceph-mon[88937]: pgmap v310: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:32.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:31 smithi123 ceph-mon[112409]: pgmap v310: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:34.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:33 smithi194 ceph-mon[88937]: pgmap v311: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:34.257 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:33 smithi123 ceph-mon[112409]: pgmap v311: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:36.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:35 smithi194 ceph-mon[88937]: pgmap v312: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:36.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:35 smithi123 ceph-mon[112409]: pgmap v312: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:38.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:37 smithi194 ceph-mon[88937]: pgmap v313: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:38.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:37 smithi123 ceph-mon[112409]: pgmap v313: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:40.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:39 smithi194 ceph-mon[88937]: pgmap v314: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:40.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:39 smithi123 ceph-mon[112409]: pgmap v314: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:43.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:42 smithi194 ceph-mon[88937]: pgmap v315: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:42 smithi123 ceph-mon[112409]: pgmap v315: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:44 smithi194 ceph-mon[88937]: pgmap v316: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:44 smithi123 ceph-mon[112409]: pgmap v316: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:46.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:46 smithi194 ceph-mon[88937]: pgmap v317: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:46 smithi123 ceph-mon[112409]: pgmap v317: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:49.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:48 smithi194 ceph-mon[88937]: pgmap v318: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:48 smithi123 ceph-mon[112409]: pgmap v318: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:51.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:50 smithi194 ceph-mon[88937]: pgmap v319: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:50 smithi123 ceph-mon[112409]: pgmap v319: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:53.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:52 smithi194 ceph-mon[88937]: pgmap v320: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:53.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:52 smithi123 ceph-mon[112409]: pgmap v320: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:55.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:54 smithi194 ceph-mon[88937]: pgmap v321: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:55.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:54 smithi123 ceph-mon[112409]: pgmap v321: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:18:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:56 smithi194 ceph-mon[88937]: pgmap v322: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:57.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:56 smithi123 ceph-mon[112409]: pgmap v322: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:18:58 smithi194 ceph-mon[88937]: pgmap v323: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:18:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:18:58 smithi123 ceph-mon[112409]: pgmap v323: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:00 smithi194 ceph-mon[88937]: pgmap v324: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:01.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:00 smithi123 ceph-mon[112409]: pgmap v324: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:02 smithi194 ceph-mon[88937]: pgmap v325: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:03.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:02 smithi123 ceph-mon[112409]: pgmap v325: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:04 smithi194 ceph-mon[88937]: pgmap v326: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:04 smithi123 ceph-mon[112409]: pgmap v326: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:06 smithi194 ceph-mon[88937]: pgmap v327: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:07.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:06 smithi123 ceph-mon[112409]: pgmap v327: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:09.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:08 smithi194 ceph-mon[88937]: pgmap v328: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:09.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:08 smithi123 ceph-mon[112409]: pgmap v328: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:10.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:09 smithi123 ceph-mon[112409]: pgmap v329: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:10.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:09 smithi194 ceph-mon[88937]: pgmap v329: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:11.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:12.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:11 smithi123 ceph-mon[112409]: pgmap v330: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:12.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:11 smithi194 ceph-mon[88937]: pgmap v330: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:14.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:14 smithi194 ceph-mon[88937]: pgmap v331: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:14.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:14 smithi123 ceph-mon[112409]: pgmap v331: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:16.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:16 smithi194 ceph-mon[88937]: pgmap v332: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:16.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:16 smithi123 ceph-mon[112409]: pgmap v332: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:18.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:18 smithi194 ceph-mon[88937]: pgmap v333: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:18.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:18 smithi123 ceph-mon[112409]: pgmap v333: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:20.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:20 smithi194 ceph-mon[88937]: pgmap v334: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:20.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:20 smithi123 ceph-mon[112409]: pgmap v334: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:22 smithi194 ceph-mon[88937]: pgmap v335: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:19:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:19:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:19:22.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:19:22.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:22 smithi123 ceph-mon[112409]: pgmap v335: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:22.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:19:22.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:19:22.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:19:22.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:19:24.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:24 smithi194 ceph-mon[88937]: pgmap v336: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:24.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:24 smithi123 ceph-mon[112409]: pgmap v336: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:26 smithi194 ceph-mon[88937]: pgmap v337: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:26.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:26 smithi123 ceph-mon[112409]: pgmap v337: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:26.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:28.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:28 smithi194 ceph-mon[88937]: pgmap v338: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:28.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:28 smithi123 ceph-mon[112409]: pgmap v338: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:30.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:30 smithi194 ceph-mon[88937]: pgmap v339: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:30.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:30 smithi123 ceph-mon[112409]: pgmap v339: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:32.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:32 smithi194 ceph-mon[88937]: pgmap v340: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:32.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:32 smithi123 ceph-mon[112409]: pgmap v340: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:34 smithi194 ceph-mon[88937]: pgmap v341: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:34.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:34 smithi123 ceph-mon[112409]: pgmap v341: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:36.393 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:36 smithi194 ceph-mon[88937]: pgmap v342: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:36.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:36 smithi123 ceph-mon[112409]: pgmap v342: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:38.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:38 smithi123 ceph-mon[112409]: pgmap v343: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:38.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:38 smithi194 ceph-mon[88937]: pgmap v343: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:40.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:40 smithi123 ceph-mon[112409]: pgmap v344: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:40 smithi194 ceph-mon[88937]: pgmap v344: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:41.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:41.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:42.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:42 smithi123 ceph-mon[112409]: pgmap v345: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:42.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:42 smithi194 ceph-mon[88937]: pgmap v345: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:44.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:44 smithi123 ceph-mon[112409]: pgmap v346: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:44.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:44 smithi194 ceph-mon[88937]: pgmap v346: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:46.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:46 smithi123 ceph-mon[112409]: pgmap v347: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:46.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:46 smithi194 ceph-mon[88937]: pgmap v347: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:48.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:48 smithi123 ceph-mon[112409]: pgmap v348: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:48 smithi194 ceph-mon[88937]: pgmap v348: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:50.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:50 smithi123 ceph-mon[112409]: pgmap v349: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:50.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:50 smithi194 ceph-mon[88937]: pgmap v349: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:52.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:52 smithi123 ceph-mon[112409]: pgmap v350: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:52 smithi194 ceph-mon[88937]: pgmap v350: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:54.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:54 smithi123 ceph-mon[112409]: pgmap v351: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:54.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:54 smithi194 ceph-mon[88937]: pgmap v351: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:56.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:56 smithi123 ceph-mon[112409]: pgmap v352: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:56.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:56 smithi194 ceph-mon[88937]: pgmap v352: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:19:58.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:19:58 smithi123 ceph-mon[112409]: pgmap v353: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:19:58.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:19:58 smithi194 ceph-mon[88937]: pgmap v353: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:00.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:00 smithi123 ceph-mon[112409]: pgmap v354: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:00.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:20:00.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:00 smithi194 ceph-mon[88937]: pgmap v354: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:00.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:20:02.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:02 smithi123 ceph-mon[112409]: pgmap v355: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:02.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:02 smithi194 ceph-mon[88937]: pgmap v355: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:04.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:04 smithi123 ceph-mon[112409]: pgmap v356: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:04.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:04 smithi194 ceph-mon[88937]: pgmap v356: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:06.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:06 smithi123 ceph-mon[112409]: pgmap v357: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:06 smithi194 ceph-mon[88937]: pgmap v357: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:08.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:08 smithi123 ceph-mon[112409]: pgmap v358: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:08.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:08 smithi194 ceph-mon[88937]: pgmap v358: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:10.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:10 smithi123 ceph-mon[112409]: pgmap v359: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:10 smithi194 ceph-mon[88937]: pgmap v359: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:11.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:11.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:12.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:12 smithi123 ceph-mon[112409]: pgmap v360: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:12.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:12 smithi194 ceph-mon[88937]: pgmap v360: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:14.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:14 smithi123 ceph-mon[112409]: pgmap v361: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:14.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:14 smithi194 ceph-mon[88937]: pgmap v361: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:16.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:16 smithi123 ceph-mon[112409]: pgmap v362: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:16.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:16 smithi194 ceph-mon[88937]: pgmap v362: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:18.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:18 smithi123 ceph-mon[112409]: pgmap v363: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:18.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:18 smithi194 ceph-mon[88937]: pgmap v363: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:20.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:20 smithi123 ceph-mon[112409]: pgmap v364: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:20.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:20 smithi194 ceph-mon[88937]: pgmap v364: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:22 smithi123 ceph-mon[112409]: pgmap v365: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:22.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:20:22.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:22 smithi194 ceph-mon[88937]: pgmap v365: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:22.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:20:23.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:20:23.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:20:23.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:20:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:20:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:20:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:20:24.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:24 smithi123 ceph-mon[112409]: pgmap v366: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:24.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:24 smithi194 ceph-mon[88937]: pgmap v366: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:26 smithi123 ceph-mon[112409]: pgmap v367: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:26.758 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:26.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:26 smithi194 ceph-mon[88937]: pgmap v367: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:28.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:28 smithi194 ceph-mon[88937]: pgmap v368: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:28 smithi123 ceph-mon[112409]: pgmap v368: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:30.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:30 smithi194 ceph-mon[88937]: pgmap v369: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:30 smithi123 ceph-mon[112409]: pgmap v369: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:32.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:32 smithi194 ceph-mon[88937]: pgmap v370: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:32 smithi123 ceph-mon[112409]: pgmap v370: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:34 smithi194 ceph-mon[88937]: pgmap v371: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:34 smithi123 ceph-mon[112409]: pgmap v371: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:36.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:36 smithi194 ceph-mon[88937]: pgmap v372: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:37.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:36 smithi123 ceph-mon[112409]: pgmap v372: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:38.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:38 smithi194 ceph-mon[88937]: pgmap v373: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:39.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:38 smithi123 ceph-mon[112409]: pgmap v373: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:40.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:40 smithi194 ceph-mon[88937]: pgmap v374: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:40 smithi123 ceph-mon[112409]: pgmap v374: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:41.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:42.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:42 smithi194 ceph-mon[88937]: pgmap v375: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:42 smithi123 ceph-mon[112409]: pgmap v375: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:44.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:44 smithi194 ceph-mon[88937]: pgmap v376: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:45.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:44 smithi123 ceph-mon[112409]: pgmap v376: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:46.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:46 smithi194 ceph-mon[88937]: pgmap v377: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:46 smithi123 ceph-mon[112409]: pgmap v377: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:48 smithi194 ceph-mon[88937]: pgmap v378: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:48 smithi123 ceph-mon[112409]: pgmap v378: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:50.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:50 smithi194 ceph-mon[88937]: pgmap v379: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:51.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:50 smithi123 ceph-mon[112409]: pgmap v379: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:52.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:52 smithi194 ceph-mon[88937]: pgmap v380: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:53.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:52 smithi123 ceph-mon[112409]: pgmap v380: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:54.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:54 smithi194 ceph-mon[88937]: pgmap v381: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:54 smithi123 ceph-mon[112409]: pgmap v381: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:56 smithi194 ceph-mon[88937]: pgmap v382: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:56.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:56 smithi123 ceph-mon[112409]: pgmap v382: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:20:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:20:58 smithi194 ceph-mon[88937]: pgmap v383: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:20:59.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:20:58 smithi123 ceph-mon[112409]: pgmap v383: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:00.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:00 smithi194 ceph-mon[88937]: pgmap v384: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:00 smithi123 ceph-mon[112409]: pgmap v384: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:02.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:02 smithi194 ceph-mon[88937]: pgmap v385: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:03.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:02 smithi123 ceph-mon[112409]: pgmap v385: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:04.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:04 smithi194 ceph-mon[88937]: pgmap v386: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:04 smithi123 ceph-mon[112409]: pgmap v386: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:06.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:06 smithi194 ceph-mon[88937]: pgmap v387: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:07.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:06 smithi123 ceph-mon[112409]: pgmap v387: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:08.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:08 smithi194 ceph-mon[88937]: pgmap v388: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:09.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:08 smithi123 ceph-mon[112409]: pgmap v388: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:10.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:10 smithi194 ceph-mon[88937]: pgmap v389: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:10 smithi123 ceph-mon[112409]: pgmap v389: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:11.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:12.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:12 smithi194 ceph-mon[88937]: pgmap v390: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:12 smithi123 ceph-mon[112409]: pgmap v390: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:14.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:14 smithi194 ceph-mon[88937]: pgmap v391: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:14 smithi123 ceph-mon[112409]: pgmap v391: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:16.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:16 smithi194 ceph-mon[88937]: pgmap v392: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:17.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:16 smithi123 ceph-mon[112409]: pgmap v392: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:18.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:18 smithi194 ceph-mon[88937]: pgmap v393: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:18 smithi123 ceph-mon[112409]: pgmap v393: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:20.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:20 smithi194 ceph-mon[88937]: pgmap v394: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:21.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:20 smithi123 ceph-mon[112409]: pgmap v394: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:22.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:22 smithi194 ceph-mon[88937]: pgmap v395: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:22.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:21:23.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:22 smithi123 ceph-mon[112409]: pgmap v395: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:23.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:21:23.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:21:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:21:23.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:21:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:21:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:21:24.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:21:24.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:24 smithi194 ceph-mon[88937]: pgmap v396: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:25.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:24 smithi123 ceph-mon[112409]: pgmap v396: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:26.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:26 smithi194 ceph-mon[88937]: pgmap v397: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:26.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:27.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:26 smithi123 ceph-mon[112409]: pgmap v397: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:27.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:28.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:28 smithi194 ceph-mon[88937]: pgmap v398: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:28 smithi123 ceph-mon[112409]: pgmap v398: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:30.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:30 smithi194 ceph-mon[88937]: pgmap v399: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:30 smithi123 ceph-mon[112409]: pgmap v399: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:32.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:32 smithi194 ceph-mon[88937]: pgmap v400: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:32 smithi123 ceph-mon[112409]: pgmap v400: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:34.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:34 smithi194 ceph-mon[88937]: pgmap v401: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:34 smithi123 ceph-mon[112409]: pgmap v401: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:36.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:36 smithi194 ceph-mon[88937]: pgmap v402: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:37.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:36 smithi123 ceph-mon[112409]: pgmap v402: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:38.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:38 smithi194 ceph-mon[88937]: pgmap v403: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:39.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:38 smithi123 ceph-mon[112409]: pgmap v403: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:40.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:40 smithi194 ceph-mon[88937]: pgmap v404: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:41.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:40 smithi123 ceph-mon[112409]: pgmap v404: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:41.893 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:42.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:42 smithi123 ceph-mon[112409]: pgmap v405: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:43.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:42 smithi194 ceph-mon[88937]: pgmap v405: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:45.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:44 smithi123 ceph-mon[112409]: pgmap v406: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:45.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:44 smithi194 ceph-mon[88937]: pgmap v406: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:46 smithi123 ceph-mon[112409]: pgmap v407: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:47.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:46 smithi194 ceph-mon[88937]: pgmap v407: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:48 smithi123 ceph-mon[112409]: pgmap v408: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:49.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:48 smithi194 ceph-mon[88937]: pgmap v408: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:51.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:50 smithi123 ceph-mon[112409]: pgmap v409: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:51.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:50 smithi194 ceph-mon[88937]: pgmap v409: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:53.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:52 smithi123 ceph-mon[112409]: pgmap v410: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:53.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:52 smithi194 ceph-mon[88937]: pgmap v410: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:54 smithi123 ceph-mon[112409]: pgmap v411: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:55.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:54 smithi194 ceph-mon[88937]: pgmap v411: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:56 smithi123 ceph-mon[112409]: pgmap v412: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:57.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:57.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:56 smithi194 ceph-mon[88937]: pgmap v412: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:57.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:21:59.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:21:58 smithi123 ceph-mon[112409]: pgmap v413: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:21:59.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:21:58 smithi194 ceph-mon[88937]: pgmap v413: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:01.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:00 smithi123 ceph-mon[112409]: pgmap v414: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:00 smithi194 ceph-mon[88937]: pgmap v414: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:03.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:02 smithi123 ceph-mon[112409]: pgmap v415: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:03.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:02 smithi194 ceph-mon[88937]: pgmap v415: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:05.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:04 smithi123 ceph-mon[112409]: pgmap v416: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:05.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:04 smithi194 ceph-mon[88937]: pgmap v416: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:06.260 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-20T08:22:06.261 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-20T08:22:06.262 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-02-20T08:22:06.274 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-02-20T08:22:06.275 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-02-20T08:22:06.945 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:06 smithi194 ceph-mon[88937]: pgmap v417: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:07.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:06 smithi123 ceph-mon[112409]: pgmap v417: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:09.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:08 smithi123 ceph-mon[112409]: pgmap v418: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:09.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:08 smithi194 ceph-mon[88937]: pgmap v418: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:11.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:10 smithi123 ceph-mon[112409]: pgmap v419: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:11.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:10 smithi194 ceph-mon[88937]: pgmap v419: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:12.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:12.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:13.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:12 smithi123 ceph-mon[112409]: pgmap v420: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:13.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:12 smithi194 ceph-mon[88937]: pgmap v420: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:15.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:14 smithi123 ceph-mon[112409]: pgmap v421: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:15.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:14 smithi194 ceph-mon[88937]: pgmap v421: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:17.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:16 smithi123 ceph-mon[112409]: pgmap v422: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:17.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:16 smithi194 ceph-mon[88937]: pgmap v422: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:19.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:18 smithi123 ceph-mon[112409]: pgmap v423: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:19.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:18 smithi194 ceph-mon[88937]: pgmap v423: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:21.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:20 smithi123 ceph-mon[112409]: pgmap v424: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:20 smithi194 ceph-mon[88937]: pgmap v424: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:23.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:22 smithi123 ceph-mon[112409]: pgmap v425: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:22 smithi194 ceph-mon[88937]: pgmap v425: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:24.007 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:23 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:22:24.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:23 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:22:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:24 smithi123 ceph-mon[112409]: pgmap v426: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:22:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:22:25.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:22:25.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:24 smithi194 ceph-mon[88937]: pgmap v426: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:22:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:22:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:22:26.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:26.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:27.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:26 smithi123 ceph-mon[112409]: pgmap v427: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:27.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:26 smithi194 ceph-mon[88937]: pgmap v427: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:29.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:28 smithi123 ceph-mon[112409]: pgmap v428: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:29.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:28 smithi194 ceph-mon[88937]: pgmap v428: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:31.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:30 smithi123 ceph-mon[112409]: pgmap v429: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:31.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:30 smithi194 ceph-mon[88937]: pgmap v429: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:33.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:32 smithi123 ceph-mon[112409]: pgmap v430: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:33.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:32 smithi194 ceph-mon[88937]: pgmap v430: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:35.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:34 smithi123 ceph-mon[112409]: pgmap v431: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:35.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:34 smithi194 ceph-mon[88937]: pgmap v431: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:37.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:36 smithi123 ceph-mon[112409]: pgmap v432: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:37.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:36 smithi194 ceph-mon[88937]: pgmap v432: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:39.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:38 smithi123 ceph-mon[112409]: pgmap v433: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:39.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:38 smithi194 ceph-mon[88937]: pgmap v433: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:40 smithi123 ceph-mon[112409]: pgmap v434: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:41.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:40 smithi194 ceph-mon[88937]: pgmap v434: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:43.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:42 smithi123 ceph-mon[112409]: pgmap v435: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:43.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:42 smithi194 ceph-mon[88937]: pgmap v435: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:45.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:44 smithi123 ceph-mon[112409]: pgmap v436: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:45.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:44 smithi194 ceph-mon[88937]: pgmap v436: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:47.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:46 smithi123 ceph-mon[112409]: pgmap v437: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:46 smithi194 ceph-mon[88937]: pgmap v437: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:49.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:48 smithi123 ceph-mon[112409]: pgmap v438: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:49.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:48 smithi194 ceph-mon[88937]: pgmap v438: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:51.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:50 smithi123 ceph-mon[112409]: pgmap v439: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:51.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:50 smithi194 ceph-mon[88937]: pgmap v439: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:53.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:52 smithi123 ceph-mon[112409]: pgmap v440: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:53.143 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:52 smithi194 ceph-mon[88937]: pgmap v440: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:55.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:54 smithi194 ceph-mon[88937]: pgmap v441: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:55.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:54 smithi123 ceph-mon[112409]: pgmap v441: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:22:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:56 smithi194 ceph-mon[88937]: pgmap v442: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:57.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:56 smithi123 ceph-mon[112409]: pgmap v442: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:22:58 smithi194 ceph-mon[88937]: pgmap v443: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:22:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:22:58 smithi123 ceph-mon[112409]: pgmap v443: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:00 smithi194 ceph-mon[88937]: pgmap v444: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:01.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:00 smithi123 ceph-mon[112409]: pgmap v444: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:02 smithi194 ceph-mon[88937]: pgmap v445: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:03.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:02 smithi123 ceph-mon[112409]: pgmap v445: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:04 smithi194 ceph-mon[88937]: pgmap v446: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:04 smithi123 ceph-mon[112409]: pgmap v446: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:06 smithi194 ceph-mon[88937]: pgmap v447: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:07.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:06 smithi123 ceph-mon[112409]: pgmap v447: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:08 smithi194 ceph-mon[88937]: pgmap v448: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:09.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:08 smithi123 ceph-mon[112409]: pgmap v448: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:10 smithi194 ceph-mon[88937]: pgmap v449: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:10 smithi123 ceph-mon[112409]: pgmap v449: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:12 smithi194 ceph-mon[88937]: pgmap v450: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:13.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:12 smithi123 ceph-mon[112409]: pgmap v450: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:14 smithi194 ceph-mon[88937]: pgmap v451: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:15.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:14 smithi123 ceph-mon[112409]: pgmap v451: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:16 smithi194 ceph-mon[88937]: pgmap v452: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:16 smithi123 ceph-mon[112409]: pgmap v452: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:19.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:18 smithi194 ceph-mon[88937]: pgmap v453: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:18 smithi123 ceph-mon[112409]: pgmap v453: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:21.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:20 smithi194 ceph-mon[88937]: pgmap v454: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:20 smithi123 ceph-mon[112409]: pgmap v454: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:23.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:22 smithi194 ceph-mon[88937]: pgmap v455: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:22 smithi123 ceph-mon[112409]: pgmap v455: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:24 smithi194 ceph-mon[88937]: pgmap v456: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:23:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:23:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:23:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:23:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:24 smithi123 ceph-mon[112409]: pgmap v456: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:23:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:23:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:23:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:23:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:27.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:26 smithi194 ceph-mon[88937]: pgmap v457: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:27.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:26 smithi123 ceph-mon[112409]: pgmap v457: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:28 smithi194 ceph-mon[88937]: pgmap v458: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:29.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:28 smithi123 ceph-mon[112409]: pgmap v458: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:31.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:30 smithi194 ceph-mon[88937]: pgmap v459: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:31.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:30 smithi123 ceph-mon[112409]: pgmap v459: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:32 smithi194 ceph-mon[88937]: pgmap v460: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:33.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:32 smithi123 ceph-mon[112409]: pgmap v460: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:34 smithi194 ceph-mon[88937]: pgmap v461: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:34 smithi123 ceph-mon[112409]: pgmap v461: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:37.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:36 smithi194 ceph-mon[88937]: pgmap v462: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:36 smithi123 ceph-mon[112409]: pgmap v462: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:39.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:38 smithi194 ceph-mon[88937]: pgmap v463: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:39.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:38 smithi123 ceph-mon[112409]: pgmap v463: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:40 smithi194 ceph-mon[88937]: pgmap v464: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:40 smithi123 ceph-mon[112409]: pgmap v464: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:41.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:43.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:42 smithi194 ceph-mon[88937]: pgmap v465: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:43.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:42 smithi123 ceph-mon[112409]: pgmap v465: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:44 smithi194 ceph-mon[88937]: pgmap v466: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:44 smithi123 ceph-mon[112409]: pgmap v466: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:46 smithi194 ceph-mon[88937]: pgmap v467: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:46 smithi123 ceph-mon[112409]: pgmap v467: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:49.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:48 smithi194 ceph-mon[88937]: pgmap v468: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:48 smithi123 ceph-mon[112409]: pgmap v468: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:50 smithi194 ceph-mon[88937]: pgmap v469: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:51.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:50 smithi123 ceph-mon[112409]: pgmap v469: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:53.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:52 smithi194 ceph-mon[88937]: pgmap v470: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:53.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:52 smithi123 ceph-mon[112409]: pgmap v470: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:55.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:54 smithi194 ceph-mon[88937]: pgmap v471: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:55.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:54 smithi123 ceph-mon[112409]: pgmap v471: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:23:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:56 smithi194 ceph-mon[88937]: pgmap v472: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:57.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:56 smithi123 ceph-mon[112409]: pgmap v472: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:23:58 smithi194 ceph-mon[88937]: pgmap v473: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:23:59.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:23:58 smithi123 ceph-mon[112409]: pgmap v473: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:00 smithi194 ceph-mon[88937]: pgmap v474: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:01.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:00 smithi123 ceph-mon[112409]: pgmap v474: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:03.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:02 smithi194 ceph-mon[88937]: pgmap v475: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:03.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:02 smithi123 ceph-mon[112409]: pgmap v475: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:04 smithi194 ceph-mon[88937]: pgmap v476: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:04 smithi123 ceph-mon[112409]: pgmap v476: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:06 smithi194 ceph-mon[88937]: pgmap v477: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:07.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:06 smithi123 ceph-mon[112409]: pgmap v477: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:09.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:08 smithi194 ceph-mon[88937]: pgmap v478: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:09.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:08 smithi123 ceph-mon[112409]: pgmap v478: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:10 smithi194 ceph-mon[88937]: pgmap v479: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:10 smithi123 ceph-mon[112409]: pgmap v479: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:12 smithi194 ceph-mon[88937]: pgmap v480: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:13.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:12 smithi123 ceph-mon[112409]: pgmap v480: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:15.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:14 smithi123 ceph-mon[112409]: pgmap v481: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:15.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:14 smithi194 ceph-mon[88937]: pgmap v481: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:16 smithi123 ceph-mon[112409]: pgmap v482: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:17.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:16 smithi194 ceph-mon[88937]: pgmap v482: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:19.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:18 smithi123 ceph-mon[112409]: pgmap v483: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:19.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:18 smithi194 ceph-mon[88937]: pgmap v483: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:20 smithi123 ceph-mon[112409]: pgmap v484: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:21.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:20 smithi194 ceph-mon[88937]: pgmap v484: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:23.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:22 smithi123 ceph-mon[112409]: pgmap v485: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:23.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:22 smithi194 ceph-mon[88937]: pgmap v485: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:24 smithi123 ceph-mon[112409]: pgmap v486: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:25.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:24:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:24 smithi194 ceph-mon[88937]: pgmap v486: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:25.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:24:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:24:26.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:24:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:24:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:24:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:24:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:24:26.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:27.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:26 smithi123 ceph-mon[112409]: pgmap v487: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:26 smithi194 ceph-mon[88937]: pgmap v487: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:29.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:28 smithi123 ceph-mon[112409]: pgmap v488: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:28 smithi194 ceph-mon[88937]: pgmap v488: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:31.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:30 smithi123 ceph-mon[112409]: pgmap v489: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:30 smithi194 ceph-mon[88937]: pgmap v489: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:33.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:32 smithi123 ceph-mon[112409]: pgmap v490: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:33.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:32 smithi194 ceph-mon[88937]: pgmap v490: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:34.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:33 smithi123 ceph-mon[112409]: pgmap v491: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:34.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:33 smithi194 ceph-mon[88937]: pgmap v491: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:36.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:36 smithi194 ceph-mon[88937]: pgmap v492: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:36.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:36 smithi123 ceph-mon[112409]: pgmap v492: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:38.311 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:38 smithi123 ceph-mon[112409]: pgmap v493: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:38.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:38 smithi194 ceph-mon[88937]: pgmap v493: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:40.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:40 smithi194 ceph-mon[88937]: pgmap v494: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:40.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:40 smithi123 ceph-mon[112409]: pgmap v494: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:41.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:42.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:42 smithi194 ceph-mon[88937]: pgmap v495: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:42.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:42 smithi123 ceph-mon[112409]: pgmap v495: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:44.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:44 smithi194 ceph-mon[88937]: pgmap v496: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:44.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:44 smithi123 ceph-mon[112409]: pgmap v496: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:46.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:46 smithi194 ceph-mon[88937]: pgmap v497: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:46.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:46 smithi123 ceph-mon[112409]: pgmap v497: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:48.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:48 smithi194 ceph-mon[88937]: pgmap v498: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:48.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:48 smithi123 ceph-mon[112409]: pgmap v498: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:50.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:50 smithi194 ceph-mon[88937]: pgmap v499: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:50.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:50 smithi123 ceph-mon[112409]: pgmap v499: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:52.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:52 smithi194 ceph-mon[88937]: pgmap v500: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:52.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:52 smithi123 ceph-mon[112409]: pgmap v500: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:54.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:54 smithi194 ceph-mon[88937]: pgmap v501: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:54.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:54 smithi123 ceph-mon[112409]: pgmap v501: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:56 smithi194 ceph-mon[88937]: pgmap v502: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:56.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:56.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:56 smithi123 ceph-mon[112409]: pgmap v502: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:24:58.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:24:58 smithi123 ceph-mon[112409]: pgmap v503: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:24:58.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:24:58 smithi194 ceph-mon[88937]: pgmap v503: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:00.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:00 smithi123 ceph-mon[112409]: pgmap v504: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:00.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:00 smithi194 ceph-mon[88937]: pgmap v504: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:02.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:02 smithi123 ceph-mon[112409]: pgmap v505: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:02.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:02 smithi194 ceph-mon[88937]: pgmap v505: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:04.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:04 smithi123 ceph-mon[112409]: pgmap v506: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:04.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:04 smithi194 ceph-mon[88937]: pgmap v506: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:06.446 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:06 smithi194 ceph-mon[88937]: pgmap v507: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:06.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:06 smithi123 ceph-mon[112409]: pgmap v507: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:08.311 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:08 smithi123 ceph-mon[112409]: pgmap v508: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:08.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:08 smithi194 ceph-mon[88937]: pgmap v508: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:10.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:10 smithi123 ceph-mon[112409]: pgmap v509: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:10.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:10 smithi194 ceph-mon[88937]: pgmap v509: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:11.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:11.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:12.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:12 smithi123 ceph-mon[112409]: pgmap v510: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:12.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:12 smithi194 ceph-mon[88937]: pgmap v510: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:14.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:14 smithi123 ceph-mon[112409]: pgmap v511: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:14.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:14 smithi194 ceph-mon[88937]: pgmap v511: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:16.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:16 smithi123 ceph-mon[112409]: pgmap v512: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:16.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:16 smithi194 ceph-mon[88937]: pgmap v512: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:18.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:18 smithi123 ceph-mon[112409]: pgmap v513: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:18.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:18 smithi194 ceph-mon[88937]: pgmap v513: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:20.508 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:20 smithi123 ceph-mon[112409]: pgmap v514: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:20.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:20 smithi194 ceph-mon[88937]: pgmap v514: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:22.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:22 smithi123 ceph-mon[112409]: pgmap v515: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:22.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:22 smithi194 ceph-mon[88937]: pgmap v515: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:24 smithi123 ceph-mon[112409]: pgmap v516: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:24.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:24 smithi194 ceph-mon[88937]: pgmap v516: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:26.487 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:26 smithi123 ceph-mon[112409]: pgmap v517: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:26.487 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:25:26.487 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:26.520 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:26 smithi194 ceph-mon[88937]: pgmap v517: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:26.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:25:26.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:28 smithi194 ceph-mon[88937]: pgmap v518: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:29.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:29.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:29.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:28 smithi123 ceph-mon[112409]: pgmap v518: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:29.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:29.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: pgmap v519: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:25:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:25:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: pgmap v519: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:25:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:25:33.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:32 smithi194 ceph-mon[88937]: pgmap v520: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:33.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:32 smithi123 ceph-mon[112409]: pgmap v520: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:35.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:34 smithi194 ceph-mon[88937]: pgmap v521: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:35.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:34 smithi123 ceph-mon[112409]: pgmap v521: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:37.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:36 smithi194 ceph-mon[88937]: pgmap v522: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:37.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:36 smithi123 ceph-mon[112409]: pgmap v522: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:39.137 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:38 smithi194 ceph-mon[88937]: pgmap v523: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:39.179 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:38 smithi123 ceph-mon[112409]: pgmap v523: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:41.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:40 smithi194 ceph-mon[88937]: pgmap v524: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:41.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:40 smithi123 ceph-mon[112409]: pgmap v524: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:41.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:43.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:42 smithi194 ceph-mon[88937]: pgmap v525: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:43.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:42 smithi123 ceph-mon[112409]: pgmap v525: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:45.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:44 smithi194 ceph-mon[88937]: pgmap v526: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:45.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:44 smithi123 ceph-mon[112409]: pgmap v526: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:47.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:46 smithi194 ceph-mon[88937]: pgmap v527: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:47.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:46 smithi123 ceph-mon[112409]: pgmap v527: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:48.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:48 smithi194 ceph-mon[88937]: pgmap v528: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:49.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:48 smithi123 ceph-mon[112409]: pgmap v528: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:51.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:50 smithi194 ceph-mon[88937]: pgmap v529: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:51.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:50 smithi123 ceph-mon[112409]: pgmap v529: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:53.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:52 smithi194 ceph-mon[88937]: pgmap v530: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:53.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:52 smithi123 ceph-mon[112409]: pgmap v530: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:55.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:54 smithi194 ceph-mon[88937]: pgmap v531: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:55.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:54 smithi123 ceph-mon[112409]: pgmap v531: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:56.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:56.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:25:57.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:56 smithi194 ceph-mon[88937]: pgmap v532: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:57.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:56 smithi123 ceph-mon[112409]: pgmap v532: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:59.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:25:58 smithi194 ceph-mon[88937]: pgmap v533: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:25:59.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:25:58 smithi123 ceph-mon[112409]: pgmap v533: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:01.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:00 smithi194 ceph-mon[88937]: pgmap v534: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:01.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:00 smithi123 ceph-mon[112409]: pgmap v534: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:02 smithi194 ceph-mon[88937]: pgmap v535: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:03.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:02 smithi123 ceph-mon[112409]: pgmap v535: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:05.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:04 smithi194 ceph-mon[88937]: pgmap v536: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:05.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:04 smithi123 ceph-mon[112409]: pgmap v536: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:07.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:06 smithi194 ceph-mon[88937]: pgmap v537: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:07.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:06 smithi123 ceph-mon[112409]: pgmap v537: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:08 smithi194 ceph-mon[88937]: pgmap v538: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:08 smithi123 ceph-mon[112409]: pgmap v538: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:11.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:10 smithi194 ceph-mon[88937]: pgmap v539: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:11.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:11.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:10 smithi123 ceph-mon[112409]: pgmap v539: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:11.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:13.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:12 smithi194 ceph-mon[88937]: pgmap v540: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:13.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:12 smithi123 ceph-mon[112409]: pgmap v540: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:15.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:14 smithi194 ceph-mon[88937]: pgmap v541: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:15.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:14 smithi123 ceph-mon[112409]: pgmap v541: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:17.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:16 smithi194 ceph-mon[88937]: pgmap v542: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:17.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:16 smithi123 ceph-mon[112409]: pgmap v542: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:18 smithi194 ceph-mon[88937]: pgmap v543: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:19.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:18 smithi123 ceph-mon[112409]: pgmap v543: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:20 smithi194 ceph-mon[88937]: pgmap v544: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:21.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:20 smithi123 ceph-mon[112409]: pgmap v544: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:23.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:22 smithi194 ceph-mon[88937]: pgmap v545: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:23.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:22 smithi123 ceph-mon[112409]: pgmap v545: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:25.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:24 smithi194 ceph-mon[88937]: pgmap v546: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:25.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:24 smithi123 ceph-mon[112409]: pgmap v546: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:26.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:26.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:27.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:26 smithi123 ceph-mon[112409]: pgmap v547: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:27.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:26 smithi194 ceph-mon[88937]: pgmap v547: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:29.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:28 smithi123 ceph-mon[112409]: pgmap v548: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:29.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:28 smithi194 ceph-mon[88937]: pgmap v548: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:31.258 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:30 smithi123 ceph-mon[112409]: pgmap v549: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:26:31.394 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:30 smithi194 ceph-mon[88937]: pgmap v549: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:31.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: pgmap v550: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:26:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: pgmap v550: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:26:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:26:34.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:34 smithi123 ceph-mon[112409]: pgmap v551: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:34.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:34 smithi194 ceph-mon[88937]: pgmap v551: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:36.447 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:36 smithi194 ceph-mon[88937]: pgmap v552: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:36.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:36 smithi123 ceph-mon[112409]: pgmap v552: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:38.312 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:38 smithi123 ceph-mon[112409]: pgmap v553: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:38.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:38 smithi194 ceph-mon[88937]: pgmap v553: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:40.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:40 smithi123 ceph-mon[112409]: pgmap v554: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:40.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:40 smithi194 ceph-mon[88937]: pgmap v554: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:41.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:42.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:42 smithi123 ceph-mon[112409]: pgmap v555: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:42.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:42 smithi194 ceph-mon[88937]: pgmap v555: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:44.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:44 smithi123 ceph-mon[112409]: pgmap v556: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:44.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:44 smithi194 ceph-mon[88937]: pgmap v556: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:46.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:46 smithi123 ceph-mon[112409]: pgmap v557: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:46 smithi194 ceph-mon[88937]: pgmap v557: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:48.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:48 smithi123 ceph-mon[112409]: pgmap v558: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:48.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:48 smithi194 ceph-mon[88937]: pgmap v558: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:50.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:50 smithi123 ceph-mon[112409]: pgmap v559: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:50.644 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:50 smithi194 ceph-mon[88937]: pgmap v559: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:52.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:52 smithi123 ceph-mon[112409]: pgmap v560: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:52 smithi194 ceph-mon[88937]: pgmap v560: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:54 smithi123 ceph-mon[112409]: pgmap v561: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:54.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:54 smithi194 ceph-mon[88937]: pgmap v561: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:56 smithi123 ceph-mon[112409]: pgmap v562: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:56 smithi194 ceph-mon[88937]: pgmap v562: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:26:58.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:26:58 smithi123 ceph-mon[112409]: pgmap v563: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:26:58.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:26:58 smithi194 ceph-mon[88937]: pgmap v563: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:00.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:00 smithi123 ceph-mon[112409]: pgmap v564: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:00.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:00 smithi194 ceph-mon[88937]: pgmap v564: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:02.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:02 smithi123 ceph-mon[112409]: pgmap v565: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:02.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:02 smithi194 ceph-mon[88937]: pgmap v565: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:04.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:04 smithi123 ceph-mon[112409]: pgmap v566: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:04.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:04 smithi194 ceph-mon[88937]: pgmap v566: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:06.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:06 smithi123 ceph-mon[112409]: pgmap v567: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:06 smithi194 ceph-mon[88937]: pgmap v567: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:08.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:08 smithi123 ceph-mon[112409]: pgmap v568: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:08 smithi194 ceph-mon[88937]: pgmap v568: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:10.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:10 smithi123 ceph-mon[112409]: pgmap v569: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:10.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:10 smithi194 ceph-mon[88937]: pgmap v569: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:11.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:12.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:12 smithi123 ceph-mon[112409]: pgmap v570: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:12.894 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:12 smithi194 ceph-mon[88937]: pgmap v570: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:14.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:14 smithi123 ceph-mon[112409]: pgmap v571: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:14.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:14 smithi194 ceph-mon[88937]: pgmap v571: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:16.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:16 smithi123 ceph-mon[112409]: pgmap v572: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:16.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:16 smithi194 ceph-mon[88937]: pgmap v572: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:18.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:18 smithi123 ceph-mon[112409]: pgmap v573: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:18 smithi194 ceph-mon[88937]: pgmap v573: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:20.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:20 smithi194 ceph-mon[88937]: pgmap v574: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:20 smithi123 ceph-mon[112409]: pgmap v574: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:22.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:22 smithi194 ceph-mon[88937]: pgmap v575: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:23.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:22 smithi123 ceph-mon[112409]: pgmap v575: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:24 smithi194 ceph-mon[88937]: pgmap v576: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:24 smithi123 ceph-mon[112409]: pgmap v576: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:26 smithi194 ceph-mon[88937]: pgmap v577: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:26 smithi123 ceph-mon[112409]: pgmap v577: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:28 smithi194 ceph-mon[88937]: pgmap v578: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:28 smithi123 ceph-mon[112409]: pgmap v578: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:30.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:30 smithi194 ceph-mon[88937]: pgmap v579: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:30 smithi123 ceph-mon[112409]: pgmap v579: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:32 smithi194 ceph-mon[88937]: pgmap v580: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:27:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:32 smithi123 ceph-mon[112409]: pgmap v580: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:27:33.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:27:33.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:27:33.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:27:34.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:27:34.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:27:34.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:27:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:34 smithi194 ceph-mon[88937]: pgmap v581: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:34 smithi123 ceph-mon[112409]: pgmap v581: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:36.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:36 smithi194 ceph-mon[88937]: pgmap v582: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:37.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:36 smithi123 ceph-mon[112409]: pgmap v582: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:38.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:38 smithi194 ceph-mon[88937]: pgmap v583: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:39.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:38 smithi123 ceph-mon[112409]: pgmap v583: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:40 smithi194 ceph-mon[88937]: pgmap v584: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:40 smithi123 ceph-mon[112409]: pgmap v584: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:41.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:42.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:42 smithi194 ceph-mon[88937]: pgmap v585: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:43.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:42 smithi123 ceph-mon[112409]: pgmap v585: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:44 smithi194 ceph-mon[88937]: pgmap v586: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:45.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:44 smithi123 ceph-mon[112409]: pgmap v586: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:46.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:46 smithi194 ceph-mon[88937]: pgmap v587: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:47.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:46 smithi123 ceph-mon[112409]: pgmap v587: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:48.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:48 smithi194 ceph-mon[88937]: pgmap v588: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:49.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:48 smithi123 ceph-mon[112409]: pgmap v588: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:50 smithi194 ceph-mon[88937]: pgmap v589: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:51.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:50 smithi123 ceph-mon[112409]: pgmap v589: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:52 smithi194 ceph-mon[88937]: pgmap v590: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:52 smithi123 ceph-mon[112409]: pgmap v590: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:54.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:54 smithi194 ceph-mon[88937]: pgmap v591: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:55.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:54 smithi123 ceph-mon[112409]: pgmap v591: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:56.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:56 smithi194 ceph-mon[88937]: pgmap v592: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:56.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:56 smithi123 ceph-mon[112409]: pgmap v592: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:57.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:27:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:27:58 smithi194 ceph-mon[88937]: pgmap v593: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:27:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:27:58 smithi123 ceph-mon[112409]: pgmap v593: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:00.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:00 smithi194 ceph-mon[88937]: pgmap v594: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:00 smithi123 ceph-mon[112409]: pgmap v594: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:02.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:02 smithi194 ceph-mon[88937]: pgmap v595: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:03.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:02 smithi123 ceph-mon[112409]: pgmap v595: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:04.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:04 smithi194 ceph-mon[88937]: pgmap v596: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:05.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:04 smithi123 ceph-mon[112409]: pgmap v596: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:06 smithi194 ceph-mon[88937]: pgmap v597: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:07.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:06 smithi123 ceph-mon[112409]: pgmap v597: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:08 smithi194 ceph-mon[88937]: pgmap v598: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:09.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:08 smithi123 ceph-mon[112409]: pgmap v598: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:10 smithi194 ceph-mon[88937]: pgmap v599: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:11.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:10 smithi123 ceph-mon[112409]: pgmap v599: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:11.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:12.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:12.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:12 smithi194 ceph-mon[88937]: pgmap v600: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:13.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:12 smithi123 ceph-mon[112409]: pgmap v600: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:14.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:14 smithi194 ceph-mon[88937]: pgmap v601: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:15.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:14 smithi123 ceph-mon[112409]: pgmap v601: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:16.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:16 smithi194 ceph-mon[88937]: pgmap v602: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:17.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:16 smithi123 ceph-mon[112409]: pgmap v602: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:18 smithi194 ceph-mon[88937]: pgmap v603: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:18 smithi123 ceph-mon[112409]: pgmap v603: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:20.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:20 smithi194 ceph-mon[88937]: pgmap v604: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:21.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:20 smithi123 ceph-mon[112409]: pgmap v604: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:22.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:22 smithi194 ceph-mon[88937]: pgmap v605: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:23.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:22 smithi123 ceph-mon[112409]: pgmap v605: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:24 smithi194 ceph-mon[88937]: pgmap v606: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:25.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:24 smithi123 ceph-mon[112409]: pgmap v606: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:26 smithi194 ceph-mon[88937]: pgmap v607: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:26 smithi123 ceph-mon[112409]: pgmap v607: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:28 smithi194 ceph-mon[88937]: pgmap v608: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:29.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:28 smithi123 ceph-mon[112409]: pgmap v608: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:30.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:30 smithi194 ceph-mon[88937]: pgmap v609: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:30 smithi123 ceph-mon[112409]: pgmap v609: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:32 smithi194 ceph-mon[88937]: pgmap v610: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:28:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:32 smithi123 ceph-mon[112409]: pgmap v610: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:33.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:28:34.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: pgmap v611: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:34.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:34.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:34.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:28:34.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:28:34.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: pgmap v611: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:28:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:28:36.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:36 smithi194 ceph-mon[88937]: pgmap v612: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:36.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:36 smithi123 ceph-mon[112409]: pgmap v612: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:38.312 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:38 smithi123 ceph-mon[112409]: pgmap v613: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:38.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:38 smithi194 ceph-mon[88937]: pgmap v613: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:40.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:40 smithi123 ceph-mon[112409]: pgmap v614: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:40.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:40 smithi194 ceph-mon[88937]: pgmap v614: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:41.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:42.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:42 smithi123 ceph-mon[112409]: pgmap v615: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:42.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:42 smithi194 ceph-mon[88937]: pgmap v615: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:44.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:44 smithi123 ceph-mon[112409]: pgmap v616: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:44.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:44 smithi194 ceph-mon[88937]: pgmap v616: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:46.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:46 smithi123 ceph-mon[112409]: pgmap v617: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:46.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:46 smithi194 ceph-mon[88937]: pgmap v617: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:48.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:48 smithi123 ceph-mon[112409]: pgmap v618: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:48 smithi194 ceph-mon[88937]: pgmap v618: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:50.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:50 smithi123 ceph-mon[112409]: pgmap v619: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:50.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:50 smithi194 ceph-mon[88937]: pgmap v619: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:52.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:52 smithi123 ceph-mon[112409]: pgmap v620: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:52.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:52 smithi194 ceph-mon[88937]: pgmap v620: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:54.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:54 smithi123 ceph-mon[112409]: pgmap v621: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:54.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:54 smithi194 ceph-mon[88937]: pgmap v621: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:56 smithi123 ceph-mon[112409]: pgmap v622: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:56 smithi194 ceph-mon[88937]: pgmap v622: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:28:58.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:28:58 smithi123 ceph-mon[112409]: pgmap v623: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:28:58.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:28:58 smithi194 ceph-mon[88937]: pgmap v623: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:00.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:00 smithi123 ceph-mon[112409]: pgmap v624: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:00.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:00 smithi194 ceph-mon[88937]: pgmap v624: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:02.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:02 smithi123 ceph-mon[112409]: pgmap v625: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:02.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:02 smithi194 ceph-mon[88937]: pgmap v625: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:04.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:04 smithi123 ceph-mon[112409]: pgmap v626: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:04.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:04 smithi194 ceph-mon[88937]: pgmap v626: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:06.446 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:06 smithi194 ceph-mon[88937]: pgmap v627: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:06.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:06 smithi123 ceph-mon[112409]: pgmap v627: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:08.312 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:08 smithi123 ceph-mon[112409]: pgmap v628: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:08.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:08 smithi194 ceph-mon[88937]: pgmap v628: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:10.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:10 smithi123 ceph-mon[112409]: pgmap v629: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:10.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:10 smithi194 ceph-mon[88937]: pgmap v629: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:12.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:12 smithi123 ceph-mon[112409]: pgmap v630: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:12.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:12 smithi194 ceph-mon[88937]: pgmap v630: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:14.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:14 smithi123 ceph-mon[112409]: pgmap v631: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:14.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:14 smithi194 ceph-mon[88937]: pgmap v631: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:16.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:16 smithi123 ceph-mon[112409]: pgmap v632: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:16.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:16 smithi194 ceph-mon[88937]: pgmap v632: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:18.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:18 smithi123 ceph-mon[112409]: pgmap v633: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:18.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:18 smithi194 ceph-mon[88937]: pgmap v633: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:20.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:20 smithi123 ceph-mon[112409]: pgmap v634: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:20.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:20 smithi194 ceph-mon[88937]: pgmap v634: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:22.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:22 smithi123 ceph-mon[112409]: pgmap v635: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:22.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:22 smithi194 ceph-mon[88937]: pgmap v635: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:24.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:24 smithi123 ceph-mon[112409]: pgmap v636: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:24.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:24 smithi194 ceph-mon[88937]: pgmap v636: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:26.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:26 smithi123 ceph-mon[112409]: pgmap v637: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:26 smithi194 ceph-mon[88937]: pgmap v637: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:28.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:28 smithi123 ceph-mon[112409]: pgmap v638: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:28.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:28 smithi194 ceph-mon[88937]: pgmap v638: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:30.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:30 smithi123 ceph-mon[112409]: pgmap v639: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:30 smithi194 ceph-mon[88937]: pgmap v639: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:32.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:32 smithi123 ceph-mon[112409]: pgmap v640: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:32.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:32 smithi194 ceph-mon[88937]: pgmap v640: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:34.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:34 smithi123 ceph-mon[112409]: pgmap v641: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:29:34.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:34 smithi194 ceph-mon[88937]: pgmap v641: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:34.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:29:35.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:29:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:29:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:29:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:29:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:29:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:29:36.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:36 smithi123 ceph-mon[112409]: pgmap v642: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:36.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:36 smithi194 ceph-mon[88937]: pgmap v642: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:38 smithi123 ceph-mon[112409]: pgmap v643: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:38.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:38 smithi194 ceph-mon[88937]: pgmap v643: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:40.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:40 smithi123 ceph-mon[112409]: pgmap v644: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:40 smithi194 ceph-mon[88937]: pgmap v644: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:41.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:41.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:42 smithi123 ceph-mon[112409]: pgmap v645: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:42 smithi194 ceph-mon[88937]: pgmap v645: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:44 smithi123 ceph-mon[112409]: pgmap v646: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:44 smithi194 ceph-mon[88937]: pgmap v646: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:46.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:46 smithi123 ceph-mon[112409]: pgmap v647: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:46.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:46 smithi194 ceph-mon[88937]: pgmap v647: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:48.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:48 smithi123 ceph-mon[112409]: pgmap v648: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:48.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:48 smithi194 ceph-mon[88937]: pgmap v648: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:50.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:50 smithi123 ceph-mon[112409]: pgmap v649: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:50 smithi194 ceph-mon[88937]: pgmap v649: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:52.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:52 smithi123 ceph-mon[112409]: pgmap v650: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:52 smithi194 ceph-mon[88937]: pgmap v650: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:54.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:54 smithi123 ceph-mon[112409]: pgmap v651: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:54.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:54 smithi194 ceph-mon[88937]: pgmap v651: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:56 smithi123 ceph-mon[112409]: pgmap v652: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:56.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:56 smithi194 ceph-mon[88937]: pgmap v652: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:56.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:29:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:29:58 smithi194 ceph-mon[88937]: pgmap v653: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:29:59.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:29:58 smithi123 ceph-mon[112409]: pgmap v653: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:00.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:00 smithi194 ceph-mon[88937]: pgmap v654: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:00.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:30:01.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:00 smithi123 ceph-mon[112409]: pgmap v654: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:30:02.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:02 smithi194 ceph-mon[88937]: pgmap v655: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:03.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:02 smithi123 ceph-mon[112409]: pgmap v655: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:04.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:04 smithi194 ceph-mon[88937]: pgmap v656: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:05.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:04 smithi123 ceph-mon[112409]: pgmap v656: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:06 smithi194 ceph-mon[88937]: pgmap v657: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:06 smithi123 ceph-mon[112409]: pgmap v657: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:08 smithi194 ceph-mon[88937]: pgmap v658: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:08 smithi123 ceph-mon[112409]: pgmap v658: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:10 smithi194 ceph-mon[88937]: pgmap v659: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:10 smithi123 ceph-mon[112409]: pgmap v659: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:11.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:12.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:12.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:12 smithi194 ceph-mon[88937]: pgmap v660: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:13.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:12 smithi123 ceph-mon[112409]: pgmap v660: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:14.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:14 smithi194 ceph-mon[88937]: pgmap v661: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:14 smithi123 ceph-mon[112409]: pgmap v661: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:16.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:16 smithi194 ceph-mon[88937]: pgmap v662: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:17.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:16 smithi123 ceph-mon[112409]: pgmap v662: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:18.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:18 smithi194 ceph-mon[88937]: pgmap v663: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:19.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:18 smithi123 ceph-mon[112409]: pgmap v663: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:20.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:20 smithi194 ceph-mon[88937]: pgmap v664: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:20 smithi123 ceph-mon[112409]: pgmap v664: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:22.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:22 smithi194 ceph-mon[88937]: pgmap v665: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:23.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:22 smithi123 ceph-mon[112409]: pgmap v665: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:24.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:24 smithi194 ceph-mon[88937]: pgmap v666: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:24 smithi123 ceph-mon[112409]: pgmap v666: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:26 smithi194 ceph-mon[88937]: pgmap v667: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:26.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:27.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:26 smithi123 ceph-mon[112409]: pgmap v667: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:28.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:28 smithi194 ceph-mon[88937]: pgmap v668: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:29.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:28 smithi123 ceph-mon[112409]: pgmap v668: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:30.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:30 smithi194 ceph-mon[88937]: pgmap v669: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:31.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:30 smithi123 ceph-mon[112409]: pgmap v669: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:32.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:32 smithi194 ceph-mon[88937]: pgmap v670: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:32 smithi123 ceph-mon[112409]: pgmap v670: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:34 smithi194 ceph-mon[88937]: pgmap v671: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:34.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:30:35.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:34 smithi123 ceph-mon[112409]: pgmap v671: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:30:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:30:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:30:35.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:30:36.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:30:36.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:30:36.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:30:36.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:36 smithi194 ceph-mon[88937]: pgmap v672: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:37.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:36 smithi123 ceph-mon[112409]: pgmap v672: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:38.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:38 smithi194 ceph-mon[88937]: pgmap v673: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:39.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:38 smithi123 ceph-mon[112409]: pgmap v673: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:40.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:40 smithi194 ceph-mon[88937]: pgmap v674: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:41.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:40 smithi123 ceph-mon[112409]: pgmap v674: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:41.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:42.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:42 smithi194 ceph-mon[88937]: pgmap v675: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:43.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:42 smithi123 ceph-mon[112409]: pgmap v675: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:44 smithi194 ceph-mon[88937]: pgmap v676: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:44 smithi123 ceph-mon[112409]: pgmap v676: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:46.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:46 smithi194 ceph-mon[88937]: pgmap v677: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:47.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:46 smithi123 ceph-mon[112409]: pgmap v677: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:48.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:48 smithi194 ceph-mon[88937]: pgmap v678: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:49.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:48 smithi123 ceph-mon[112409]: pgmap v678: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:50 smithi194 ceph-mon[88937]: pgmap v679: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:50 smithi123 ceph-mon[112409]: pgmap v679: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:52 smithi194 ceph-mon[88937]: pgmap v680: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:52 smithi123 ceph-mon[112409]: pgmap v680: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:54.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:54 smithi194 ceph-mon[88937]: pgmap v681: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:55.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:54 smithi123 ceph-mon[112409]: pgmap v681: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:56.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:56 smithi194 ceph-mon[88937]: pgmap v682: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:56 smithi123 ceph-mon[112409]: pgmap v682: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:30:58.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:30:58 smithi194 ceph-mon[88937]: pgmap v683: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:30:59.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:30:58 smithi123 ceph-mon[112409]: pgmap v683: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:00.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:00 smithi194 ceph-mon[88937]: pgmap v684: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:00 smithi123 ceph-mon[112409]: pgmap v684: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:02.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:02 smithi194 ceph-mon[88937]: pgmap v685: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:03.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:02 smithi123 ceph-mon[112409]: pgmap v685: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:04.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:04 smithi194 ceph-mon[88937]: pgmap v686: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:05.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:04 smithi123 ceph-mon[112409]: pgmap v686: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:06.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:06 smithi194 ceph-mon[88937]: pgmap v687: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:06 smithi123 ceph-mon[112409]: pgmap v687: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:08 smithi194 ceph-mon[88937]: pgmap v688: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:08 smithi123 ceph-mon[112409]: pgmap v688: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:10.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:10 smithi194 ceph-mon[88937]: pgmap v689: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:10 smithi123 ceph-mon[112409]: pgmap v689: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:11.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:12.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:12.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:12 smithi194 ceph-mon[88937]: pgmap v690: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:13.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:12 smithi123 ceph-mon[112409]: pgmap v690: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:14.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:14 smithi194 ceph-mon[88937]: pgmap v691: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:14 smithi123 ceph-mon[112409]: pgmap v691: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:17.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:16 smithi123 ceph-mon[112409]: pgmap v692: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:16 smithi194 ceph-mon[88937]: pgmap v692: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:18 smithi123 ceph-mon[112409]: pgmap v693: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:18 smithi194 ceph-mon[88937]: pgmap v693: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:20 smithi123 ceph-mon[112409]: pgmap v694: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:20 smithi194 ceph-mon[88937]: pgmap v694: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:23.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:22 smithi123 ceph-mon[112409]: pgmap v695: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:23.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:22 smithi194 ceph-mon[88937]: pgmap v695: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:24 smithi123 ceph-mon[112409]: pgmap v696: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:24 smithi194 ceph-mon[88937]: pgmap v696: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:26 smithi123 ceph-mon[112409]: pgmap v697: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:27.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:26 smithi194 ceph-mon[88937]: pgmap v697: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:27.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:29.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:28 smithi123 ceph-mon[112409]: pgmap v698: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:29.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:28 smithi194 ceph-mon[88937]: pgmap v698: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:31.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:30 smithi123 ceph-mon[112409]: pgmap v699: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:30 smithi194 ceph-mon[88937]: pgmap v699: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:32 smithi123 ceph-mon[112409]: pgmap v700: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:33.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:32 smithi194 ceph-mon[88937]: pgmap v700: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:34 smithi123 ceph-mon[112409]: pgmap v701: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:34 smithi194 ceph-mon[88937]: pgmap v701: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:36.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:31:36.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:31:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:36 smithi123 ceph-mon[112409]: pgmap v702: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:31:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:31:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:31:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:36 smithi194 ceph-mon[88937]: pgmap v702: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:31:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:31:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:31:39.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:38 smithi123 ceph-mon[112409]: pgmap v703: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:39.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:38 smithi194 ceph-mon[88937]: pgmap v703: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:40 smithi123 ceph-mon[112409]: pgmap v704: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:41.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:40 smithi194 ceph-mon[88937]: pgmap v704: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:42.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:42.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:43.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:42 smithi123 ceph-mon[112409]: pgmap v705: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:43.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:42 smithi194 ceph-mon[88937]: pgmap v705: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:44 smithi123 ceph-mon[112409]: pgmap v706: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:45.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:44 smithi194 ceph-mon[88937]: pgmap v706: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:47.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:46 smithi123 ceph-mon[112409]: pgmap v707: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:47.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:46 smithi194 ceph-mon[88937]: pgmap v707: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:49.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:48 smithi123 ceph-mon[112409]: pgmap v708: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:49.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:48 smithi194 ceph-mon[88937]: pgmap v708: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:50 smithi123 ceph-mon[112409]: pgmap v709: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:50 smithi194 ceph-mon[88937]: pgmap v709: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:52 smithi123 ceph-mon[112409]: pgmap v710: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:53.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:52 smithi194 ceph-mon[88937]: pgmap v710: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:55.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:54 smithi123 ceph-mon[112409]: pgmap v711: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:55.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:54 smithi194 ceph-mon[88937]: pgmap v711: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:56 smithi123 ceph-mon[112409]: pgmap v712: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:56 smithi194 ceph-mon[88937]: pgmap v712: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:31:59.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:31:58 smithi123 ceph-mon[112409]: pgmap v713: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:31:59.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:31:58 smithi194 ceph-mon[88937]: pgmap v713: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:00 smithi123 ceph-mon[112409]: pgmap v714: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:00 smithi194 ceph-mon[88937]: pgmap v714: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:03.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:02 smithi123 ceph-mon[112409]: pgmap v715: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:02 smithi194 ceph-mon[88937]: pgmap v715: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:05.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:04 smithi123 ceph-mon[112409]: pgmap v716: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:05.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:04 smithi194 ceph-mon[88937]: pgmap v716: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:06 smithi123 ceph-mon[112409]: pgmap v717: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:07.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:06 smithi194 ceph-mon[88937]: pgmap v717: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:08 smithi123 ceph-mon[112409]: pgmap v718: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:08 smithi194 ceph-mon[88937]: pgmap v718: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:10 smithi123 ceph-mon[112409]: pgmap v719: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:11.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:10 smithi194 ceph-mon[88937]: pgmap v719: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:13.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:12 smithi123 ceph-mon[112409]: pgmap v720: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:12 smithi194 ceph-mon[88937]: pgmap v720: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:14 smithi123 ceph-mon[112409]: pgmap v721: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:14 smithi194 ceph-mon[88937]: pgmap v721: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:17.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:16 smithi123 ceph-mon[112409]: pgmap v722: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:17.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:16 smithi194 ceph-mon[88937]: pgmap v722: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:18 smithi123 ceph-mon[112409]: pgmap v723: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:18 smithi194 ceph-mon[88937]: pgmap v723: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:20 smithi123 ceph-mon[112409]: pgmap v724: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:20 smithi194 ceph-mon[88937]: pgmap v724: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:23.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:22 smithi123 ceph-mon[112409]: pgmap v725: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:23.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:22 smithi194 ceph-mon[88937]: pgmap v725: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:24 smithi123 ceph-mon[112409]: pgmap v726: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:24 smithi194 ceph-mon[88937]: pgmap v726: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:26.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:27.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:26 smithi194 ceph-mon[88937]: pgmap v727: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:26 smithi123 ceph-mon[112409]: pgmap v727: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:28 smithi194 ceph-mon[88937]: pgmap v728: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:28 smithi123 ceph-mon[112409]: pgmap v728: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:30 smithi194 ceph-mon[88937]: pgmap v729: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:30 smithi123 ceph-mon[112409]: pgmap v729: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:32 smithi194 ceph-mon[88937]: pgmap v730: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:32 smithi123 ceph-mon[112409]: pgmap v730: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:34 smithi194 ceph-mon[88937]: pgmap v731: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:34 smithi123 ceph-mon[112409]: pgmap v731: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:36 smithi194 ceph-mon[88937]: pgmap v732: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:32:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:32:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:32:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:32:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:36 smithi123 ceph-mon[112409]: pgmap v732: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:32:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:32:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:32:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:32:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:38 smithi194 ceph-mon[88937]: pgmap v733: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:38 smithi123 ceph-mon[112409]: pgmap v733: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:40 smithi194 ceph-mon[88937]: pgmap v734: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:40 smithi123 ceph-mon[112409]: pgmap v734: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:42 smithi194 ceph-mon[88937]: pgmap v735: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:42 smithi123 ceph-mon[112409]: pgmap v735: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:44 smithi194 ceph-mon[88937]: pgmap v736: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:44 smithi123 ceph-mon[112409]: pgmap v736: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:46 smithi194 ceph-mon[88937]: pgmap v737: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:46 smithi123 ceph-mon[112409]: pgmap v737: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:48 smithi194 ceph-mon[88937]: pgmap v738: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:48 smithi123 ceph-mon[112409]: pgmap v738: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:50 smithi194 ceph-mon[88937]: pgmap v739: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:50 smithi123 ceph-mon[112409]: pgmap v739: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:52 smithi194 ceph-mon[88937]: pgmap v740: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:52 smithi123 ceph-mon[112409]: pgmap v740: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:54 smithi194 ceph-mon[88937]: pgmap v741: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:54 smithi123 ceph-mon[112409]: pgmap v741: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:32:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:56 smithi194 ceph-mon[88937]: pgmap v742: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:56 smithi123 ceph-mon[112409]: pgmap v742: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:59.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:32:58 smithi194 ceph-mon[88937]: pgmap v743: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:32:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:32:58 smithi123 ceph-mon[112409]: pgmap v743: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:00 smithi194 ceph-mon[88937]: pgmap v744: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:00 smithi123 ceph-mon[112409]: pgmap v744: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:02 smithi194 ceph-mon[88937]: pgmap v745: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:02 smithi123 ceph-mon[112409]: pgmap v745: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:04 smithi194 ceph-mon[88937]: pgmap v746: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:04 smithi123 ceph-mon[112409]: pgmap v746: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:06 smithi194 ceph-mon[88937]: pgmap v747: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:06 smithi123 ceph-mon[112409]: pgmap v747: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:08 smithi194 ceph-mon[88937]: pgmap v748: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:08 smithi123 ceph-mon[112409]: pgmap v748: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:10 smithi194 ceph-mon[88937]: pgmap v749: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:10 smithi123 ceph-mon[112409]: pgmap v749: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:12 smithi194 ceph-mon[88937]: pgmap v750: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:12 smithi123 ceph-mon[112409]: pgmap v750: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:14 smithi194 ceph-mon[88937]: pgmap v751: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:14 smithi123 ceph-mon[112409]: pgmap v751: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:16 smithi194 ceph-mon[88937]: pgmap v752: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:16 smithi123 ceph-mon[112409]: pgmap v752: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:18 smithi194 ceph-mon[88937]: pgmap v753: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:18 smithi123 ceph-mon[112409]: pgmap v753: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:21.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:20 smithi194 ceph-mon[88937]: pgmap v754: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:20 smithi123 ceph-mon[112409]: pgmap v754: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:22 smithi194 ceph-mon[88937]: pgmap v755: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:22 smithi123 ceph-mon[112409]: pgmap v755: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:24 smithi194 ceph-mon[88937]: pgmap v756: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:24 smithi123 ceph-mon[112409]: pgmap v756: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:26.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:26 smithi194 ceph-mon[88937]: pgmap v757: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:26 smithi123 ceph-mon[112409]: pgmap v757: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:28 smithi194 ceph-mon[88937]: pgmap v758: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:28 smithi123 ceph-mon[112409]: pgmap v758: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:30 smithi194 ceph-mon[88937]: pgmap v759: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:30 smithi123 ceph-mon[112409]: pgmap v759: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:32 smithi194 ceph-mon[88937]: pgmap v760: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:32 smithi123 ceph-mon[112409]: pgmap v760: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:34 smithi194 ceph-mon[88937]: pgmap v761: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:34 smithi123 ceph-mon[112409]: pgmap v761: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:36 smithi194 ceph-mon[88937]: pgmap v762: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:33:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:36 smithi123 ceph-mon[112409]: pgmap v762: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:33:38.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:33:38.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:33:38.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:33:38.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:33:38.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:33:38.161 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:33:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:38 smithi194 ceph-mon[88937]: pgmap v763: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:38 smithi123 ceph-mon[112409]: pgmap v763: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:40 smithi194 ceph-mon[88937]: pgmap v764: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:40 smithi123 ceph-mon[112409]: pgmap v764: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:42 smithi194 ceph-mon[88937]: pgmap v765: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:42 smithi123 ceph-mon[112409]: pgmap v765: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:44 smithi123 ceph-mon[112409]: pgmap v766: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:44 smithi194 ceph-mon[88937]: pgmap v766: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:46 smithi123 ceph-mon[112409]: pgmap v767: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:46 smithi194 ceph-mon[88937]: pgmap v767: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:48 smithi123 ceph-mon[112409]: pgmap v768: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:48 smithi194 ceph-mon[88937]: pgmap v768: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:50 smithi123 ceph-mon[112409]: pgmap v769: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:50 smithi194 ceph-mon[88937]: pgmap v769: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:52 smithi123 ceph-mon[112409]: pgmap v770: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:52 smithi194 ceph-mon[88937]: pgmap v770: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:54 smithi123 ceph-mon[112409]: pgmap v771: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:54 smithi194 ceph-mon[88937]: pgmap v771: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:33:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:56 smithi123 ceph-mon[112409]: pgmap v772: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:56 smithi194 ceph-mon[88937]: pgmap v772: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:33:58 smithi123 ceph-mon[112409]: pgmap v773: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:33:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:33:58 smithi194 ceph-mon[88937]: pgmap v773: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:00 smithi123 ceph-mon[112409]: pgmap v774: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:00 smithi194 ceph-mon[88937]: pgmap v774: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:02 smithi123 ceph-mon[112409]: pgmap v775: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:02 smithi194 ceph-mon[88937]: pgmap v775: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:04 smithi123 ceph-mon[112409]: pgmap v776: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:04 smithi194 ceph-mon[88937]: pgmap v776: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:07.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:06 smithi194 ceph-mon[88937]: pgmap v777: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:06 smithi123 ceph-mon[112409]: pgmap v777: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:08 smithi123 ceph-mon[112409]: pgmap v778: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:08 smithi194 ceph-mon[88937]: pgmap v778: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:10 smithi123 ceph-mon[112409]: pgmap v779: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:10 smithi194 ceph-mon[88937]: pgmap v779: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:12 smithi123 ceph-mon[112409]: pgmap v780: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:12 smithi194 ceph-mon[88937]: pgmap v780: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:14 smithi123 ceph-mon[112409]: pgmap v781: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:14 smithi194 ceph-mon[88937]: pgmap v781: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:16 smithi123 ceph-mon[112409]: pgmap v782: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:16 smithi194 ceph-mon[88937]: pgmap v782: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:18 smithi123 ceph-mon[112409]: pgmap v783: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:18 smithi194 ceph-mon[88937]: pgmap v783: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:20 smithi123 ceph-mon[112409]: pgmap v784: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:20 smithi194 ceph-mon[88937]: pgmap v784: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:22 smithi123 ceph-mon[112409]: pgmap v785: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:22 smithi194 ceph-mon[88937]: pgmap v785: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:24 smithi123 ceph-mon[112409]: pgmap v786: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:24 smithi194 ceph-mon[88937]: pgmap v786: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:26 smithi123 ceph-mon[112409]: pgmap v787: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:26 smithi194 ceph-mon[88937]: pgmap v787: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:28 smithi123 ceph-mon[112409]: pgmap v788: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:28 smithi194 ceph-mon[88937]: pgmap v788: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:30 smithi123 ceph-mon[112409]: pgmap v789: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:30 smithi194 ceph-mon[88937]: pgmap v789: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:32 smithi123 ceph-mon[112409]: pgmap v790: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:32 smithi194 ceph-mon[88937]: pgmap v790: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:34 smithi123 ceph-mon[112409]: pgmap v791: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:34 smithi194 ceph-mon[88937]: pgmap v791: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:36 smithi123 ceph-mon[112409]: pgmap v792: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:36 smithi194 ceph-mon[88937]: pgmap v792: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:38.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:37 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:34:38.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:37 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:34:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:38 smithi123 ceph-mon[112409]: pgmap v793: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:38 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:34:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:38 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:34:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:38 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:34:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:38 smithi194 ceph-mon[88937]: pgmap v793: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:38 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:34:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:38 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:34:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:38 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:34:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:40 smithi123 ceph-mon[112409]: pgmap v794: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:40 smithi194 ceph-mon[88937]: pgmap v794: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:42 smithi123 ceph-mon[112409]: pgmap v795: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:42 smithi194 ceph-mon[88937]: pgmap v795: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:45 smithi123 ceph-mon[112409]: pgmap v796: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:45 smithi194 ceph-mon[88937]: pgmap v796: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:47 smithi123 ceph-mon[112409]: pgmap v797: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:47 smithi194 ceph-mon[88937]: pgmap v797: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:49 smithi123 ceph-mon[112409]: pgmap v798: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:49 smithi194 ceph-mon[88937]: pgmap v798: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:51 smithi194 ceph-mon[88937]: pgmap v799: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:51 smithi123 ceph-mon[112409]: pgmap v799: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:53 smithi194 ceph-mon[88937]: pgmap v800: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:53 smithi123 ceph-mon[112409]: pgmap v800: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:55 smithi194 ceph-mon[88937]: pgmap v801: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:55 smithi123 ceph-mon[112409]: pgmap v801: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:34:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:57 smithi194 ceph-mon[88937]: pgmap v802: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:57 smithi123 ceph-mon[112409]: pgmap v802: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:34:58 smithi194 ceph-mon[88937]: pgmap v803: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:34:59.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:34:58 smithi123 ceph-mon[112409]: pgmap v803: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:00 smithi194 ceph-mon[88937]: pgmap v804: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:00 smithi123 ceph-mon[112409]: pgmap v804: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:02 smithi194 ceph-mon[88937]: pgmap v805: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:03.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:02 smithi123 ceph-mon[112409]: pgmap v805: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:04.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:04 smithi194 ceph-mon[88937]: pgmap v806: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:05.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:04 smithi123 ceph-mon[112409]: pgmap v806: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:06 smithi194 ceph-mon[88937]: pgmap v807: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:06 smithi123 ceph-mon[112409]: pgmap v807: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:08 smithi194 ceph-mon[88937]: pgmap v808: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:08 smithi123 ceph-mon[112409]: pgmap v808: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:10.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:10 smithi194 ceph-mon[88937]: pgmap v809: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:10 smithi123 ceph-mon[112409]: pgmap v809: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:11.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:12.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:12 smithi194 ceph-mon[88937]: pgmap v810: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:13.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:12 smithi123 ceph-mon[112409]: pgmap v810: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:14 smithi194 ceph-mon[88937]: pgmap v811: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:14 smithi123 ceph-mon[112409]: pgmap v811: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:16 smithi194 ceph-mon[88937]: pgmap v812: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:17.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:16 smithi123 ceph-mon[112409]: pgmap v812: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:18 smithi194 ceph-mon[88937]: pgmap v813: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:18 smithi123 ceph-mon[112409]: pgmap v813: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:20 smithi194 ceph-mon[88937]: pgmap v814: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:20 smithi123 ceph-mon[112409]: pgmap v814: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:22 smithi194 ceph-mon[88937]: pgmap v815: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:23.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:22 smithi123 ceph-mon[112409]: pgmap v815: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:24 smithi194 ceph-mon[88937]: pgmap v816: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:24 smithi123 ceph-mon[112409]: pgmap v816: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:26 smithi194 ceph-mon[88937]: pgmap v817: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:26 smithi123 ceph-mon[112409]: pgmap v817: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:28 smithi194 ceph-mon[88937]: pgmap v818: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:29.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:28 smithi123 ceph-mon[112409]: pgmap v818: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:30 smithi194 ceph-mon[88937]: pgmap v819: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:31.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:30 smithi123 ceph-mon[112409]: pgmap v819: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:32 smithi194 ceph-mon[88937]: pgmap v820: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:32 smithi123 ceph-mon[112409]: pgmap v820: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:34 smithi194 ceph-mon[88937]: pgmap v821: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:34 smithi123 ceph-mon[112409]: pgmap v821: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:36 smithi194 ceph-mon[88937]: pgmap v822: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:36 smithi123 ceph-mon[112409]: pgmap v822: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:38 smithi194 ceph-mon[88937]: pgmap v823: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:38 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:35:39.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:38 smithi123 ceph-mon[112409]: pgmap v823: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:39.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:38 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:35:40.884 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:40 smithi123 ceph-mon[112409]: pgmap v824: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:40.884 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:40.884 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:40 smithi194 ceph-mon[88937]: pgmap v824: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:41.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:42.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:42 smithi194 ceph-mon[88937]: pgmap v825: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:43.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:42 smithi123 ceph-mon[112409]: pgmap v825: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:44.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:44.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:44.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:35:44.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:35:44.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:44.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:44.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:44.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:35:44.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:35:44.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:35:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:44 smithi194 ceph-mon[88937]: pgmap v826: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:44 smithi123 ceph-mon[112409]: pgmap v826: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:46 smithi194 ceph-mon[88937]: pgmap v827: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:46 smithi123 ceph-mon[112409]: pgmap v827: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:48 smithi194 ceph-mon[88937]: pgmap v828: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:48 smithi123 ceph-mon[112409]: pgmap v828: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:50 smithi194 ceph-mon[88937]: pgmap v829: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:50 smithi123 ceph-mon[112409]: pgmap v829: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:52 smithi194 ceph-mon[88937]: pgmap v830: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:52 smithi123 ceph-mon[112409]: pgmap v830: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:54 smithi194 ceph-mon[88937]: pgmap v831: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:54 smithi123 ceph-mon[112409]: pgmap v831: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:35:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:56 smithi194 ceph-mon[88937]: pgmap v832: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:56 smithi123 ceph-mon[112409]: pgmap v832: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:35:58 smithi194 ceph-mon[88937]: pgmap v833: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:35:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:35:58 smithi123 ceph-mon[112409]: pgmap v833: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:00 smithi194 ceph-mon[88937]: pgmap v834: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:00 smithi123 ceph-mon[112409]: pgmap v834: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:02 smithi194 ceph-mon[88937]: pgmap v835: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:02 smithi123 ceph-mon[112409]: pgmap v835: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:04 smithi194 ceph-mon[88937]: pgmap v836: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:04 smithi123 ceph-mon[112409]: pgmap v836: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:06 smithi194 ceph-mon[88937]: pgmap v837: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:06 smithi123 ceph-mon[112409]: pgmap v837: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:08 smithi194 ceph-mon[88937]: pgmap v838: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:08 smithi123 ceph-mon[112409]: pgmap v838: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:10 smithi194 ceph-mon[88937]: pgmap v839: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:10 smithi123 ceph-mon[112409]: pgmap v839: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:12 smithi194 ceph-mon[88937]: pgmap v840: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:12 smithi123 ceph-mon[112409]: pgmap v840: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:14 smithi194 ceph-mon[88937]: pgmap v841: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:14 smithi123 ceph-mon[112409]: pgmap v841: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:16 smithi194 ceph-mon[88937]: pgmap v842: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:16 smithi123 ceph-mon[112409]: pgmap v842: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:19.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:18 smithi194 ceph-mon[88937]: pgmap v843: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:18 smithi123 ceph-mon[112409]: pgmap v843: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:20 smithi123 ceph-mon[112409]: pgmap v844: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:20 smithi194 ceph-mon[88937]: pgmap v844: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:22 smithi123 ceph-mon[112409]: pgmap v845: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:22 smithi194 ceph-mon[88937]: pgmap v845: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:24 smithi123 ceph-mon[112409]: pgmap v846: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:24 smithi194 ceph-mon[88937]: pgmap v846: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:26 smithi123 ceph-mon[112409]: pgmap v847: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:26 smithi194 ceph-mon[88937]: pgmap v847: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:28 smithi123 ceph-mon[112409]: pgmap v848: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:28 smithi194 ceph-mon[88937]: pgmap v848: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:30 smithi123 ceph-mon[112409]: pgmap v849: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:30 smithi194 ceph-mon[88937]: pgmap v849: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:32 smithi123 ceph-mon[112409]: pgmap v850: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:32 smithi194 ceph-mon[88937]: pgmap v850: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:34 smithi123 ceph-mon[112409]: pgmap v851: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:34 smithi194 ceph-mon[88937]: pgmap v851: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:36 smithi123 ceph-mon[112409]: pgmap v852: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:36 smithi194 ceph-mon[88937]: pgmap v852: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:39.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:38 smithi194 ceph-mon[88937]: pgmap v853: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:38 smithi123 ceph-mon[112409]: pgmap v853: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:40 smithi123 ceph-mon[112409]: pgmap v854: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:40 smithi194 ceph-mon[88937]: pgmap v854: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:42 smithi123 ceph-mon[112409]: pgmap v855: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:42 smithi194 ceph-mon[88937]: pgmap v855: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:44.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:36:44.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: pgmap v856: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:36:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: pgmap v856: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:36:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:36:45.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:36:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:47 smithi194 ceph-mon[88937]: pgmap v857: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:47 smithi123 ceph-mon[112409]: pgmap v857: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:49 smithi194 ceph-mon[88937]: pgmap v858: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:49 smithi123 ceph-mon[112409]: pgmap v858: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:50.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:50 smithi194 ceph-mon[88937]: pgmap v859: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:50.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:50 smithi123 ceph-mon[112409]: pgmap v859: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:52 smithi194 ceph-mon[88937]: pgmap v860: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:52 smithi123 ceph-mon[112409]: pgmap v860: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:54.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:54 smithi194 ceph-mon[88937]: pgmap v861: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:54.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:54 smithi123 ceph-mon[112409]: pgmap v861: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:56 smithi194 ceph-mon[88937]: pgmap v862: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:56 smithi123 ceph-mon[112409]: pgmap v862: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:36:58.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:36:58 smithi123 ceph-mon[112409]: pgmap v863: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:36:58.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:36:58 smithi194 ceph-mon[88937]: pgmap v863: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:00.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:00 smithi194 ceph-mon[88937]: pgmap v864: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:00.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:00 smithi123 ceph-mon[112409]: pgmap v864: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:02.650 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:02 smithi194 ceph-mon[88937]: pgmap v865: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:02.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:02 smithi123 ceph-mon[112409]: pgmap v865: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:04.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:04 smithi194 ceph-mon[88937]: pgmap v866: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:04.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:04 smithi123 ceph-mon[112409]: pgmap v866: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:06.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:06 smithi194 ceph-mon[88937]: pgmap v867: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:06.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:06 smithi123 ceph-mon[112409]: pgmap v867: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:08.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:08 smithi194 ceph-mon[88937]: pgmap v868: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:08.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:08 smithi123 ceph-mon[112409]: pgmap v868: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:10.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:10 smithi194 ceph-mon[88937]: pgmap v869: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:10.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:10 smithi123 ceph-mon[112409]: pgmap v869: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:12.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:12 smithi194 ceph-mon[88937]: pgmap v870: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:12.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:12 smithi123 ceph-mon[112409]: pgmap v870: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:14.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:14 smithi194 ceph-mon[88937]: pgmap v871: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:14.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:14 smithi123 ceph-mon[112409]: pgmap v871: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:16.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:16 smithi194 ceph-mon[88937]: pgmap v872: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:16.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:16 smithi123 ceph-mon[112409]: pgmap v872: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:18.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:18 smithi194 ceph-mon[88937]: pgmap v873: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:18 smithi123 ceph-mon[112409]: pgmap v873: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:20.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:20 smithi194 ceph-mon[88937]: pgmap v874: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:20.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:20 smithi123 ceph-mon[112409]: pgmap v874: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:22.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:22 smithi194 ceph-mon[88937]: pgmap v875: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:22 smithi123 ceph-mon[112409]: pgmap v875: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:24.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:24 smithi194 ceph-mon[88937]: pgmap v876: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:24.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:24 smithi123 ceph-mon[112409]: pgmap v876: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:26 smithi194 ceph-mon[88937]: pgmap v877: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:26 smithi123 ceph-mon[112409]: pgmap v877: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:26.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:28.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:28 smithi194 ceph-mon[88937]: pgmap v878: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:28.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:28 smithi123 ceph-mon[112409]: pgmap v878: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:30 smithi194 ceph-mon[88937]: pgmap v879: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:30 smithi123 ceph-mon[112409]: pgmap v879: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:32.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:32 smithi194 ceph-mon[88937]: pgmap v880: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:32 smithi123 ceph-mon[112409]: pgmap v880: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:34.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:34 smithi194 ceph-mon[88937]: pgmap v881: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:34.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:34 smithi123 ceph-mon[112409]: pgmap v881: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:36.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:36 smithi194 ceph-mon[88937]: pgmap v882: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:36.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:36 smithi123 ceph-mon[112409]: pgmap v882: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:38 smithi194 ceph-mon[88937]: pgmap v883: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:38 smithi123 ceph-mon[112409]: pgmap v883: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:40.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:40 smithi194 ceph-mon[88937]: pgmap v884: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:40.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:40 smithi123 ceph-mon[112409]: pgmap v884: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:42.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:42 smithi194 ceph-mon[88937]: pgmap v885: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:42 smithi123 ceph-mon[112409]: pgmap v885: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:44.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:44 smithi194 ceph-mon[88937]: pgmap v886: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:44 smithi123 ceph-mon[112409]: pgmap v886: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:37:45.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:37:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:46 smithi194 ceph-mon[88937]: pgmap v887: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:46 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:37:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:46 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:37:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:46 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:37:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:46 smithi123 ceph-mon[112409]: pgmap v887: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:37:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:37:46.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:46 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:37:48.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:48 smithi194 ceph-mon[88937]: pgmap v888: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:48.764 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:48 smithi123 ceph-mon[112409]: pgmap v888: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:50.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:50 smithi194 ceph-mon[88937]: pgmap v889: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:50 smithi123 ceph-mon[112409]: pgmap v889: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:52 smithi123 ceph-mon[112409]: pgmap v890: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:52 smithi194 ceph-mon[88937]: pgmap v890: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:54.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:54 smithi123 ceph-mon[112409]: pgmap v891: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:54 smithi194 ceph-mon[88937]: pgmap v891: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:56 smithi123 ceph-mon[112409]: pgmap v892: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:56 smithi194 ceph-mon[88937]: pgmap v892: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:37:58.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:37:58 smithi123 ceph-mon[112409]: pgmap v893: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:37:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:37:58 smithi194 ceph-mon[88937]: pgmap v893: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:00.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:00 smithi123 ceph-mon[112409]: pgmap v894: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:00 smithi194 ceph-mon[88937]: pgmap v894: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:02.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:02 smithi123 ceph-mon[112409]: pgmap v895: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:02 smithi194 ceph-mon[88937]: pgmap v895: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:04.763 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:04 smithi123 ceph-mon[112409]: pgmap v896: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:04.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:04 smithi194 ceph-mon[88937]: pgmap v896: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:06.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:06 smithi123 ceph-mon[112409]: pgmap v897: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:06 smithi194 ceph-mon[88937]: pgmap v897: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:08.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:08 smithi123 ceph-mon[112409]: pgmap v898: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:08 smithi194 ceph-mon[88937]: pgmap v898: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:10.698 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:10 smithi194 ceph-mon[88937]: pgmap v899: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:10.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:10 smithi123 ceph-mon[112409]: pgmap v899: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:11.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:12.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:12 smithi123 ceph-mon[112409]: pgmap v900: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:12 smithi194 ceph-mon[88937]: pgmap v900: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:14.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:14 smithi123 ceph-mon[112409]: pgmap v901: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:14 smithi194 ceph-mon[88937]: pgmap v901: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:16.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:16 smithi123 ceph-mon[112409]: pgmap v902: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:16 smithi194 ceph-mon[88937]: pgmap v902: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:18 smithi123 ceph-mon[112409]: pgmap v903: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:18 smithi194 ceph-mon[88937]: pgmap v903: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:20.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:20 smithi123 ceph-mon[112409]: pgmap v904: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:20 smithi194 ceph-mon[88937]: pgmap v904: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:22 smithi123 ceph-mon[112409]: pgmap v905: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:22 smithi194 ceph-mon[88937]: pgmap v905: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:24.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:24 smithi123 ceph-mon[112409]: pgmap v906: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:24 smithi194 ceph-mon[88937]: pgmap v906: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:26 smithi123 ceph-mon[112409]: pgmap v907: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:26 smithi194 ceph-mon[88937]: pgmap v907: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:28.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:28 smithi123 ceph-mon[112409]: pgmap v908: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:28 smithi194 ceph-mon[88937]: pgmap v908: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:30 smithi123 ceph-mon[112409]: pgmap v909: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:30 smithi194 ceph-mon[88937]: pgmap v909: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:32 smithi123 ceph-mon[112409]: pgmap v910: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:32 smithi194 ceph-mon[88937]: pgmap v910: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:34.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:34 smithi123 ceph-mon[112409]: pgmap v911: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:34 smithi194 ceph-mon[88937]: pgmap v911: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:36.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:36 smithi123 ceph-mon[112409]: pgmap v912: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:36 smithi194 ceph-mon[88937]: pgmap v912: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:38 smithi123 ceph-mon[112409]: pgmap v913: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:38 smithi194 ceph-mon[88937]: pgmap v913: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:40.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:40 smithi123 ceph-mon[112409]: pgmap v914: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:40 smithi194 ceph-mon[88937]: pgmap v914: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:42 smithi123 ceph-mon[112409]: pgmap v915: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:42 smithi194 ceph-mon[88937]: pgmap v915: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:44 smithi194 ceph-mon[88937]: pgmap v916: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:44 smithi123 ceph-mon[112409]: pgmap v916: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:45.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:45 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:38:46.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:45 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:38:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: pgmap v917: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:38:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:38:47.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: pgmap v917: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:38:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:38:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:38:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:49 smithi194 ceph-mon[88937]: pgmap v918: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:49 smithi123 ceph-mon[112409]: pgmap v918: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:51 smithi194 ceph-mon[88937]: pgmap v919: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:51 smithi123 ceph-mon[112409]: pgmap v919: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:53 smithi194 ceph-mon[88937]: pgmap v920: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:53 smithi123 ceph-mon[112409]: pgmap v920: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:55 smithi194 ceph-mon[88937]: pgmap v921: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:55 smithi123 ceph-mon[112409]: pgmap v921: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:38:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:57 smithi194 ceph-mon[88937]: pgmap v922: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:57 smithi123 ceph-mon[112409]: pgmap v922: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:38:59 smithi194 ceph-mon[88937]: pgmap v923: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:38:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:38:59 smithi123 ceph-mon[112409]: pgmap v923: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:01 smithi194 ceph-mon[88937]: pgmap v924: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:01 smithi123 ceph-mon[112409]: pgmap v924: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:03 smithi194 ceph-mon[88937]: pgmap v925: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:03 smithi123 ceph-mon[112409]: pgmap v925: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:05 smithi194 ceph-mon[88937]: pgmap v926: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:05 smithi123 ceph-mon[112409]: pgmap v926: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:07 smithi194 ceph-mon[88937]: pgmap v927: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:07.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:07 smithi123 ceph-mon[112409]: pgmap v927: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:09 smithi194 ceph-mon[88937]: pgmap v928: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:09 smithi123 ceph-mon[112409]: pgmap v928: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:11 smithi194 ceph-mon[88937]: pgmap v929: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:11 smithi123 ceph-mon[112409]: pgmap v929: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:13 smithi194 ceph-mon[88937]: pgmap v930: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:13 smithi123 ceph-mon[112409]: pgmap v930: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:15 smithi194 ceph-mon[88937]: pgmap v931: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:15 smithi123 ceph-mon[112409]: pgmap v931: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:17 smithi194 ceph-mon[88937]: pgmap v932: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:17 smithi123 ceph-mon[112409]: pgmap v932: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:19 smithi194 ceph-mon[88937]: pgmap v933: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:19 smithi123 ceph-mon[112409]: pgmap v933: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:21 smithi194 ceph-mon[88937]: pgmap v934: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:21 smithi123 ceph-mon[112409]: pgmap v934: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:22.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:22 smithi194 ceph-mon[88937]: pgmap v935: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:22.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:22 smithi123 ceph-mon[112409]: pgmap v935: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:24.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:24 smithi194 ceph-mon[88937]: pgmap v936: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:24.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:24 smithi123 ceph-mon[112409]: pgmap v936: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:26 smithi194 ceph-mon[88937]: pgmap v937: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:26 smithi123 ceph-mon[112409]: pgmap v937: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:28.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:28 smithi194 ceph-mon[88937]: pgmap v938: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:28.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:28 smithi123 ceph-mon[112409]: pgmap v938: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:30 smithi194 ceph-mon[88937]: pgmap v939: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:30 smithi123 ceph-mon[112409]: pgmap v939: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:32.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:32 smithi194 ceph-mon[88937]: pgmap v940: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:32 smithi123 ceph-mon[112409]: pgmap v940: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:34.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:34 smithi194 ceph-mon[88937]: pgmap v941: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:34.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:34 smithi123 ceph-mon[112409]: pgmap v941: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:36.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:36 smithi194 ceph-mon[88937]: pgmap v942: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:36.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:36 smithi123 ceph-mon[112409]: pgmap v942: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:38.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:38 smithi194 ceph-mon[88937]: pgmap v943: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:38 smithi123 ceph-mon[112409]: pgmap v943: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:40.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:40 smithi194 ceph-mon[88937]: pgmap v944: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:40.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:40 smithi123 ceph-mon[112409]: pgmap v944: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:41.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:42.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:42 smithi194 ceph-mon[88937]: pgmap v945: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:42 smithi123 ceph-mon[112409]: pgmap v945: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:44.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:44 smithi194 ceph-mon[88937]: pgmap v946: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:44 smithi123 ceph-mon[112409]: pgmap v946: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:46 smithi194 ceph-mon[88937]: pgmap v947: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:46 smithi123 ceph-mon[112409]: pgmap v947: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:39:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:39:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:39:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:39:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:39:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:39:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:39:47.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:39:48.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:48 smithi194 ceph-mon[88937]: pgmap v948: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:48.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:48 smithi123 ceph-mon[112409]: pgmap v948: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:50.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:50 smithi194 ceph-mon[88937]: pgmap v949: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:50 smithi123 ceph-mon[112409]: pgmap v949: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:52.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:52 smithi194 ceph-mon[88937]: pgmap v950: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:52 smithi123 ceph-mon[112409]: pgmap v950: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:54.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:54 smithi194 ceph-mon[88937]: pgmap v951: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:54.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:54 smithi123 ceph-mon[112409]: pgmap v951: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:56 smithi194 ceph-mon[88937]: pgmap v952: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:56 smithi123 ceph-mon[112409]: pgmap v952: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:39:58.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:39:58 smithi194 ceph-mon[88937]: pgmap v953: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:39:58.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:39:58 smithi123 ceph-mon[112409]: pgmap v953: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:00.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:00 smithi194 ceph-mon[88937]: pgmap v954: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:00.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:40:00.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:00 smithi123 ceph-mon[112409]: pgmap v954: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:00.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:40:02.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:02 smithi123 ceph-mon[112409]: pgmap v955: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:02 smithi194 ceph-mon[88937]: pgmap v955: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:04.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:04 smithi123 ceph-mon[112409]: pgmap v956: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:04.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:04 smithi194 ceph-mon[88937]: pgmap v956: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:06.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:06 smithi123 ceph-mon[112409]: pgmap v957: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:06 smithi194 ceph-mon[88937]: pgmap v957: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:08.678 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:08 smithi123 ceph-mon[112409]: pgmap v958: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:08 smithi194 ceph-mon[88937]: pgmap v958: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:10.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:10 smithi123 ceph-mon[112409]: pgmap v959: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:10.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:10 smithi194 ceph-mon[88937]: pgmap v959: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:11.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:12.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:12 smithi123 ceph-mon[112409]: pgmap v960: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:12 smithi194 ceph-mon[88937]: pgmap v960: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:14.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:14 smithi123 ceph-mon[112409]: pgmap v961: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:14 smithi194 ceph-mon[88937]: pgmap v961: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:16.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:16 smithi123 ceph-mon[112409]: pgmap v962: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:16 smithi194 ceph-mon[88937]: pgmap v962: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:18.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:18 smithi123 ceph-mon[112409]: pgmap v963: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:18 smithi194 ceph-mon[88937]: pgmap v963: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:20.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:20 smithi123 ceph-mon[112409]: pgmap v964: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:20 smithi194 ceph-mon[88937]: pgmap v964: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:22 smithi123 ceph-mon[112409]: pgmap v965: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:22 smithi194 ceph-mon[88937]: pgmap v965: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:24.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:24 smithi123 ceph-mon[112409]: pgmap v966: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:24 smithi194 ceph-mon[88937]: pgmap v966: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:26 smithi123 ceph-mon[112409]: pgmap v967: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:26 smithi194 ceph-mon[88937]: pgmap v967: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:28.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:28 smithi123 ceph-mon[112409]: pgmap v968: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:28 smithi194 ceph-mon[88937]: pgmap v968: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:30 smithi123 ceph-mon[112409]: pgmap v969: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:30 smithi194 ceph-mon[88937]: pgmap v969: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:32 smithi123 ceph-mon[112409]: pgmap v970: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:32 smithi194 ceph-mon[88937]: pgmap v970: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:34.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:34 smithi123 ceph-mon[112409]: pgmap v971: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:34 smithi194 ceph-mon[88937]: pgmap v971: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:36.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:36 smithi123 ceph-mon[112409]: pgmap v972: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:36 smithi194 ceph-mon[88937]: pgmap v972: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:38 smithi123 ceph-mon[112409]: pgmap v973: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:38 smithi194 ceph-mon[88937]: pgmap v973: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:40.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:40 smithi123 ceph-mon[112409]: pgmap v974: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:40 smithi194 ceph-mon[88937]: pgmap v974: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:41.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:42 smithi123 ceph-mon[112409]: pgmap v975: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:42 smithi194 ceph-mon[88937]: pgmap v975: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:44 smithi123 ceph-mon[112409]: pgmap v976: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:44 smithi194 ceph-mon[88937]: pgmap v976: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:46 smithi123 ceph-mon[112409]: pgmap v977: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:46.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:46 smithi194 ceph-mon[88937]: pgmap v977: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:40:47.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:40:48.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:48 smithi123 ceph-mon[112409]: pgmap v978: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:48.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:40:48.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:40:48.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:40:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:48 smithi194 ceph-mon[88937]: pgmap v978: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:40:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:40:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:40:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:50 smithi123 ceph-mon[112409]: pgmap v979: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:50 smithi194 ceph-mon[88937]: pgmap v979: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:52.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:52 smithi123 ceph-mon[112409]: pgmap v980: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:52 smithi194 ceph-mon[88937]: pgmap v980: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:54.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:54 smithi123 ceph-mon[112409]: pgmap v981: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:54 smithi194 ceph-mon[88937]: pgmap v981: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:56.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:56 smithi123 ceph-mon[112409]: pgmap v982: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:56.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:56 smithi194 ceph-mon[88937]: pgmap v982: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:40:58.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:40:58 smithi123 ceph-mon[112409]: pgmap v983: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:40:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:40:58 smithi194 ceph-mon[88937]: pgmap v983: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:00.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:00 smithi123 ceph-mon[112409]: pgmap v984: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:00 smithi194 ceph-mon[88937]: pgmap v984: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:02.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:02 smithi123 ceph-mon[112409]: pgmap v985: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:02 smithi194 ceph-mon[88937]: pgmap v985: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:04.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:04 smithi123 ceph-mon[112409]: pgmap v986: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:04.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:04 smithi194 ceph-mon[88937]: pgmap v986: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:06 smithi194 ceph-mon[88937]: pgmap v987: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:06 smithi123 ceph-mon[112409]: pgmap v987: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:08 smithi194 ceph-mon[88937]: pgmap v988: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:08 smithi123 ceph-mon[112409]: pgmap v988: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:10.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:10 smithi194 ceph-mon[88937]: pgmap v989: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:10 smithi123 ceph-mon[112409]: pgmap v989: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:11.798 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:12.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:12 smithi194 ceph-mon[88937]: pgmap v990: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:13.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:12 smithi123 ceph-mon[112409]: pgmap v990: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:14 smithi194 ceph-mon[88937]: pgmap v991: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:14 smithi123 ceph-mon[112409]: pgmap v991: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:16 smithi194 ceph-mon[88937]: pgmap v992: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:17.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:16 smithi123 ceph-mon[112409]: pgmap v992: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:18 smithi194 ceph-mon[88937]: pgmap v993: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:18 smithi123 ceph-mon[112409]: pgmap v993: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:20 smithi194 ceph-mon[88937]: pgmap v994: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:20 smithi123 ceph-mon[112409]: pgmap v994: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:22 smithi194 ceph-mon[88937]: pgmap v995: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:23.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:22 smithi123 ceph-mon[112409]: pgmap v995: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:24 smithi194 ceph-mon[88937]: pgmap v996: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:24 smithi123 ceph-mon[112409]: pgmap v996: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:26 smithi194 ceph-mon[88937]: pgmap v997: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:26 smithi123 ceph-mon[112409]: pgmap v997: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:27.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:28 smithi194 ceph-mon[88937]: pgmap v998: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:29.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:28 smithi123 ceph-mon[112409]: pgmap v998: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:30 smithi194 ceph-mon[88937]: pgmap v999: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:31.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:30 smithi123 ceph-mon[112409]: pgmap v999: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:32 smithi194 ceph-mon[88937]: pgmap v1000: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:32 smithi123 ceph-mon[112409]: pgmap v1000: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:34 smithi194 ceph-mon[88937]: pgmap v1001: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:35.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:34 smithi123 ceph-mon[112409]: pgmap v1001: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:36 smithi194 ceph-mon[88937]: pgmap v1002: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:36 smithi123 ceph-mon[112409]: pgmap v1002: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:38 smithi194 ceph-mon[88937]: pgmap v1003: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:39.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:38 smithi123 ceph-mon[112409]: pgmap v1003: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:40 smithi194 ceph-mon[88937]: pgmap v1004: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:40 smithi123 ceph-mon[112409]: pgmap v1004: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:42.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:42 smithi194 ceph-mon[88937]: pgmap v1005: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:43.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:42 smithi123 ceph-mon[112409]: pgmap v1005: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:44 smithi194 ceph-mon[88937]: pgmap v1006: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:44 smithi123 ceph-mon[112409]: pgmap v1006: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:46.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:46 smithi194 ceph-mon[88937]: pgmap v1007: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:47.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:46 smithi123 ceph-mon[112409]: pgmap v1007: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:48 smithi194 ceph-mon[88937]: pgmap v1008: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:41:49.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:48 smithi123 ceph-mon[112409]: pgmap v1008: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:49.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:41:49.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:41:49.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:41:49.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:41:50.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:41:50.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:41:50.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:41:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:50 smithi194 ceph-mon[88937]: pgmap v1009: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:50 smithi123 ceph-mon[112409]: pgmap v1009: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:52 smithi194 ceph-mon[88937]: pgmap v1010: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:52 smithi123 ceph-mon[112409]: pgmap v1010: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:54 smithi194 ceph-mon[88937]: pgmap v1011: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:54 smithi123 ceph-mon[112409]: pgmap v1011: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:41:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:56 smithi194 ceph-mon[88937]: pgmap v1012: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:56 smithi123 ceph-mon[112409]: pgmap v1012: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:41:58 smithi194 ceph-mon[88937]: pgmap v1013: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:41:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:41:58 smithi123 ceph-mon[112409]: pgmap v1013: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:00 smithi194 ceph-mon[88937]: pgmap v1014: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:00 smithi123 ceph-mon[112409]: pgmap v1014: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:02 smithi194 ceph-mon[88937]: pgmap v1015: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:02 smithi123 ceph-mon[112409]: pgmap v1015: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:04 smithi194 ceph-mon[88937]: pgmap v1016: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:04 smithi123 ceph-mon[112409]: pgmap v1016: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:06 smithi194 ceph-mon[88937]: pgmap v1017: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:06 smithi123 ceph-mon[112409]: pgmap v1017: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:08 smithi194 ceph-mon[88937]: pgmap v1018: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:08 smithi123 ceph-mon[112409]: pgmap v1018: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:10 smithi194 ceph-mon[88937]: pgmap v1019: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:10 smithi123 ceph-mon[112409]: pgmap v1019: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:12 smithi194 ceph-mon[88937]: pgmap v1020: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:12 smithi123 ceph-mon[112409]: pgmap v1020: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:14 smithi194 ceph-mon[88937]: pgmap v1021: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:14 smithi123 ceph-mon[112409]: pgmap v1021: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:16 smithi194 ceph-mon[88937]: pgmap v1022: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:16 smithi123 ceph-mon[112409]: pgmap v1022: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:18 smithi123 ceph-mon[112409]: pgmap v1023: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:18 smithi194 ceph-mon[88937]: pgmap v1023: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:20 smithi123 ceph-mon[112409]: pgmap v1024: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:20 smithi194 ceph-mon[88937]: pgmap v1024: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:22 smithi123 ceph-mon[112409]: pgmap v1025: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:22 smithi194 ceph-mon[88937]: pgmap v1025: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:24 smithi123 ceph-mon[112409]: pgmap v1026: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:24 smithi194 ceph-mon[88937]: pgmap v1026: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:26 smithi123 ceph-mon[112409]: pgmap v1027: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:26 smithi194 ceph-mon[88937]: pgmap v1027: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:28 smithi123 ceph-mon[112409]: pgmap v1028: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:28 smithi194 ceph-mon[88937]: pgmap v1028: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:30 smithi123 ceph-mon[112409]: pgmap v1029: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:30 smithi194 ceph-mon[88937]: pgmap v1029: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:32 smithi123 ceph-mon[112409]: pgmap v1030: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:32 smithi194 ceph-mon[88937]: pgmap v1030: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:34 smithi123 ceph-mon[112409]: pgmap v1031: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:34 smithi194 ceph-mon[88937]: pgmap v1031: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:36 smithi123 ceph-mon[112409]: pgmap v1032: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:36 smithi194 ceph-mon[88937]: pgmap v1032: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:38 smithi123 ceph-mon[112409]: pgmap v1033: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:38 smithi194 ceph-mon[88937]: pgmap v1033: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:40 smithi123 ceph-mon[112409]: pgmap v1034: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:40 smithi194 ceph-mon[88937]: pgmap v1034: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:43.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:42 smithi194 ceph-mon[88937]: pgmap v1035: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:42 smithi123 ceph-mon[112409]: pgmap v1035: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:45.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:44 smithi123 ceph-mon[112409]: pgmap v1036: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:44 smithi194 ceph-mon[88937]: pgmap v1036: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:46 smithi123 ceph-mon[112409]: pgmap v1037: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:46 smithi194 ceph-mon[88937]: pgmap v1037: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:48 smithi123 ceph-mon[112409]: pgmap v1038: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:42:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:48 smithi194 ceph-mon[88937]: pgmap v1038: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:42:50.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:42:50.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:42:50.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:42:50.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:42:50.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:42:50.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:42:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:50 smithi123 ceph-mon[112409]: pgmap v1039: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:50 smithi194 ceph-mon[88937]: pgmap v1039: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:52 smithi123 ceph-mon[112409]: pgmap v1040: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:52 smithi194 ceph-mon[88937]: pgmap v1040: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:54 smithi123 ceph-mon[112409]: pgmap v1041: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:54 smithi194 ceph-mon[88937]: pgmap v1041: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:42:57.264 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:56 smithi123 ceph-mon[112409]: pgmap v1042: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:56 smithi194 ceph-mon[88937]: pgmap v1042: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:42:58 smithi123 ceph-mon[112409]: pgmap v1043: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:42:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:42:58 smithi194 ceph-mon[88937]: pgmap v1043: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:00 smithi123 ceph-mon[112409]: pgmap v1044: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:00 smithi194 ceph-mon[88937]: pgmap v1044: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:02 smithi123 ceph-mon[112409]: pgmap v1045: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:02 smithi194 ceph-mon[88937]: pgmap v1045: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:04 smithi123 ceph-mon[112409]: pgmap v1046: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:04 smithi194 ceph-mon[88937]: pgmap v1046: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:06 smithi123 ceph-mon[112409]: pgmap v1047: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:06 smithi194 ceph-mon[88937]: pgmap v1047: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:08 smithi123 ceph-mon[112409]: pgmap v1048: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:08 smithi194 ceph-mon[88937]: pgmap v1048: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:10 smithi123 ceph-mon[112409]: pgmap v1049: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:10 smithi194 ceph-mon[88937]: pgmap v1049: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:12 smithi123 ceph-mon[112409]: pgmap v1050: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:12 smithi194 ceph-mon[88937]: pgmap v1050: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:14 smithi123 ceph-mon[112409]: pgmap v1051: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:14 smithi194 ceph-mon[88937]: pgmap v1051: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:16 smithi123 ceph-mon[112409]: pgmap v1052: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:16 smithi194 ceph-mon[88937]: pgmap v1052: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:18 smithi123 ceph-mon[112409]: pgmap v1053: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:18 smithi194 ceph-mon[88937]: pgmap v1053: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:21 smithi123 ceph-mon[112409]: pgmap v1054: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:21 smithi194 ceph-mon[88937]: pgmap v1054: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:23 smithi123 ceph-mon[112409]: pgmap v1055: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:23 smithi194 ceph-mon[88937]: pgmap v1055: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:25.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:25 smithi123 ceph-mon[112409]: pgmap v1056: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:25 smithi194 ceph-mon[88937]: pgmap v1056: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:27 smithi194 ceph-mon[88937]: pgmap v1057: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:27 smithi123 ceph-mon[112409]: pgmap v1057: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:29 smithi194 ceph-mon[88937]: pgmap v1058: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:29.512 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:29 smithi123 ceph-mon[112409]: pgmap v1058: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:31 smithi194 ceph-mon[88937]: pgmap v1059: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:31 smithi123 ceph-mon[112409]: pgmap v1059: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:33 smithi194 ceph-mon[88937]: pgmap v1060: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:33 smithi123 ceph-mon[112409]: pgmap v1060: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:35 smithi194 ceph-mon[88937]: pgmap v1061: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:35 smithi123 ceph-mon[112409]: pgmap v1061: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:37 smithi194 ceph-mon[88937]: pgmap v1062: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:37 smithi123 ceph-mon[112409]: pgmap v1062: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:39 smithi194 ceph-mon[88937]: pgmap v1063: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:39 smithi123 ceph-mon[112409]: pgmap v1063: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:41 smithi194 ceph-mon[88937]: pgmap v1064: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:41 smithi123 ceph-mon[112409]: pgmap v1064: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:43 smithi194 ceph-mon[88937]: pgmap v1065: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:43 smithi123 ceph-mon[112409]: pgmap v1065: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:45 smithi194 ceph-mon[88937]: pgmap v1066: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:45 smithi123 ceph-mon[112409]: pgmap v1066: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:47 smithi194 ceph-mon[88937]: pgmap v1067: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:47 smithi123 ceph-mon[112409]: pgmap v1067: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:49 smithi194 ceph-mon[88937]: pgmap v1068: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:49 smithi123 ceph-mon[112409]: pgmap v1068: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:50.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:43:50.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:43:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:51 smithi194 ceph-mon[88937]: pgmap v1069: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:51.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:43:51.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:43:51.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:43:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:51 smithi123 ceph-mon[112409]: pgmap v1069: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:43:51.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:43:51.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:43:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:53 smithi194 ceph-mon[88937]: pgmap v1070: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:53 smithi123 ceph-mon[112409]: pgmap v1070: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:55 smithi194 ceph-mon[88937]: pgmap v1071: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:55 smithi123 ceph-mon[112409]: pgmap v1071: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:43:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:57 smithi194 ceph-mon[88937]: pgmap v1072: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:57 smithi123 ceph-mon[112409]: pgmap v1072: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:43:59 smithi194 ceph-mon[88937]: pgmap v1073: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:43:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:43:59 smithi123 ceph-mon[112409]: pgmap v1073: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:01 smithi194 ceph-mon[88937]: pgmap v1074: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:01 smithi123 ceph-mon[112409]: pgmap v1074: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:03 smithi194 ceph-mon[88937]: pgmap v1075: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:03 smithi123 ceph-mon[112409]: pgmap v1075: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:05 smithi194 ceph-mon[88937]: pgmap v1076: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:05 smithi123 ceph-mon[112409]: pgmap v1076: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:07 smithi194 ceph-mon[88937]: pgmap v1077: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:07 smithi123 ceph-mon[112409]: pgmap v1077: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:09 smithi194 ceph-mon[88937]: pgmap v1078: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:09 smithi123 ceph-mon[112409]: pgmap v1078: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:11 smithi194 ceph-mon[88937]: pgmap v1079: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:11 smithi123 ceph-mon[112409]: pgmap v1079: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:13 smithi194 ceph-mon[88937]: pgmap v1080: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:13 smithi123 ceph-mon[112409]: pgmap v1080: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:15 smithi194 ceph-mon[88937]: pgmap v1081: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:15 smithi123 ceph-mon[112409]: pgmap v1081: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:17 smithi194 ceph-mon[88937]: pgmap v1082: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:17.512 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:17 smithi123 ceph-mon[112409]: pgmap v1082: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:19 smithi194 ceph-mon[88937]: pgmap v1083: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:19 smithi123 ceph-mon[112409]: pgmap v1083: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:21 smithi194 ceph-mon[88937]: pgmap v1084: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:21 smithi123 ceph-mon[112409]: pgmap v1084: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:23 smithi194 ceph-mon[88937]: pgmap v1085: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:23.515 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:23 smithi123 ceph-mon[112409]: pgmap v1085: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:25 smithi194 ceph-mon[88937]: pgmap v1086: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:25.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:25 smithi123 ceph-mon[112409]: pgmap v1086: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:27 smithi194 ceph-mon[88937]: pgmap v1087: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:27 smithi123 ceph-mon[112409]: pgmap v1087: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:28 smithi194 ceph-mon[88937]: pgmap v1088: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:28.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:28 smithi123 ceph-mon[112409]: pgmap v1088: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:30 smithi123 ceph-mon[112409]: pgmap v1089: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:30 smithi194 ceph-mon[88937]: pgmap v1089: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:32 smithi123 ceph-mon[112409]: pgmap v1090: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:32 smithi194 ceph-mon[88937]: pgmap v1090: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:34.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:34 smithi123 ceph-mon[112409]: pgmap v1091: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:34 smithi194 ceph-mon[88937]: pgmap v1091: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:36.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:36 smithi123 ceph-mon[112409]: pgmap v1092: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:36 smithi194 ceph-mon[88937]: pgmap v1092: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:38 smithi123 ceph-mon[112409]: pgmap v1093: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:38 smithi194 ceph-mon[88937]: pgmap v1093: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:40.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:40 smithi123 ceph-mon[112409]: pgmap v1094: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:40.899 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:40 smithi194 ceph-mon[88937]: pgmap v1094: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:41.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:42 smithi123 ceph-mon[112409]: pgmap v1095: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:42 smithi194 ceph-mon[88937]: pgmap v1095: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:44.698 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:44 smithi194 ceph-mon[88937]: pgmap v1096: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:44 smithi123 ceph-mon[112409]: pgmap v1096: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:46.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:46 smithi123 ceph-mon[112409]: pgmap v1097: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:46.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:46 smithi194 ceph-mon[88937]: pgmap v1097: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:48.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:48 smithi123 ceph-mon[112409]: pgmap v1098: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:48 smithi194 ceph-mon[88937]: pgmap v1098: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:50 smithi123 ceph-mon[112409]: pgmap v1099: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:50.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:44:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:50 smithi194 ceph-mon[88937]: pgmap v1099: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:44:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:52 smithi123 ceph-mon[112409]: pgmap v1100: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:52 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:52 smithi194 ceph-mon[88937]: pgmap v1100: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:52 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:54.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:54 smithi123 ceph-mon[112409]: pgmap v1101: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:54 smithi194 ceph-mon[88937]: pgmap v1101: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: pgmap v1102: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:44:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:44:56.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:44:56.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: pgmap v1102: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:56.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:44:58.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:44:58 smithi123 ceph-mon[112409]: pgmap v1103: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:44:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:44:58 smithi194 ceph-mon[88937]: pgmap v1103: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:00.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:00 smithi123 ceph-mon[112409]: pgmap v1104: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:00 smithi194 ceph-mon[88937]: pgmap v1104: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:02.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:02 smithi123 ceph-mon[112409]: pgmap v1105: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:02 smithi194 ceph-mon[88937]: pgmap v1105: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:04.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:04 smithi123 ceph-mon[112409]: pgmap v1106: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:04.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:04 smithi194 ceph-mon[88937]: pgmap v1106: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:06.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:06 smithi123 ceph-mon[112409]: pgmap v1107: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:06 smithi194 ceph-mon[88937]: pgmap v1107: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:08.711 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:08 smithi123 ceph-mon[112409]: pgmap v1108: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:08 smithi194 ceph-mon[88937]: pgmap v1108: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:10.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:10 smithi123 ceph-mon[112409]: pgmap v1109: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:10.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:10 smithi194 ceph-mon[88937]: pgmap v1109: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:11.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:11.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:12.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:12 smithi123 ceph-mon[112409]: pgmap v1110: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:12 smithi194 ceph-mon[88937]: pgmap v1110: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:14.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:14 smithi123 ceph-mon[112409]: pgmap v1111: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:14 smithi194 ceph-mon[88937]: pgmap v1111: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:16.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:16 smithi123 ceph-mon[112409]: pgmap v1112: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:16 smithi194 ceph-mon[88937]: pgmap v1112: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:18.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:18 smithi123 ceph-mon[112409]: pgmap v1113: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:18 smithi194 ceph-mon[88937]: pgmap v1113: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:20.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:20 smithi123 ceph-mon[112409]: pgmap v1114: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:20 smithi194 ceph-mon[88937]: pgmap v1114: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:22 smithi123 ceph-mon[112409]: pgmap v1115: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:22 smithi194 ceph-mon[88937]: pgmap v1115: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:24.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:24 smithi123 ceph-mon[112409]: pgmap v1116: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:24 smithi194 ceph-mon[88937]: pgmap v1116: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:26 smithi123 ceph-mon[112409]: pgmap v1117: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:26.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:26 smithi194 ceph-mon[88937]: pgmap v1117: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:26.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:28.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:28 smithi123 ceph-mon[112409]: pgmap v1118: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:28 smithi194 ceph-mon[88937]: pgmap v1118: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:30 smithi123 ceph-mon[112409]: pgmap v1119: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:30 smithi194 ceph-mon[88937]: pgmap v1119: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:32.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:32 smithi123 ceph-mon[112409]: pgmap v1120: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:32 smithi194 ceph-mon[88937]: pgmap v1120: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:34.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:34 smithi123 ceph-mon[112409]: pgmap v1121: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:34 smithi194 ceph-mon[88937]: pgmap v1121: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:36.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:36 smithi123 ceph-mon[112409]: pgmap v1122: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:36 smithi194 ceph-mon[88937]: pgmap v1122: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:38.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:38 smithi123 ceph-mon[112409]: pgmap v1123: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:38 smithi194 ceph-mon[88937]: pgmap v1123: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:40.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:40 smithi123 ceph-mon[112409]: pgmap v1124: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:40 smithi194 ceph-mon[88937]: pgmap v1124: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:41.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:42 smithi123 ceph-mon[112409]: pgmap v1125: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:42 smithi194 ceph-mon[88937]: pgmap v1125: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:44.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:44 smithi123 ceph-mon[112409]: pgmap v1126: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:44 smithi194 ceph-mon[88937]: pgmap v1126: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:46.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:46 smithi123 ceph-mon[112409]: pgmap v1127: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:46.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:46 smithi194 ceph-mon[88937]: pgmap v1127: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:48.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:48 smithi123 ceph-mon[112409]: pgmap v1128: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:48 smithi194 ceph-mon[88937]: pgmap v1128: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:50 smithi123 ceph-mon[112409]: pgmap v1129: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:50 smithi194 ceph-mon[88937]: pgmap v1129: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:52 smithi194 ceph-mon[88937]: pgmap v1130: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:53.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:52 smithi123 ceph-mon[112409]: pgmap v1130: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:54 smithi194 ceph-mon[88937]: pgmap v1131: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:55.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:54 smithi123 ceph-mon[112409]: pgmap v1131: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:55.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:45:56.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:45:56.837 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:56 smithi194 ceph-mon[88937]: pgmap v1132: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:56.837 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:56.942 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:56 smithi123 ceph-mon[112409]: pgmap v1132: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:56.942 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:45:58.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:58 smithi123 ceph-mon[112409]: pgmap v1133: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:58.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:45:58.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:58 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:45:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:58 smithi194 ceph-mon[88937]: pgmap v1133: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:45:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:45:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:58 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:45:59.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:59 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:45:59.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:45:59 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:00.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:59 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:00.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:45:59 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:00 smithi194 ceph-mon[88937]: pgmap v1134: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:00 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:00 smithi123 ceph-mon[112409]: pgmap v1134: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:00 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: pgmap v1135: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:02.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:02.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:02.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:46:02.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:46:02.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: pgmap v1135: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:46:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:46:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:46:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:04 smithi194 ceph-mon[88937]: pgmap v1136: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:04 smithi123 ceph-mon[112409]: pgmap v1136: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:06 smithi194 ceph-mon[88937]: pgmap v1137: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:06 smithi123 ceph-mon[112409]: pgmap v1137: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:08 smithi194 ceph-mon[88937]: pgmap v1138: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:08 smithi123 ceph-mon[112409]: pgmap v1138: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:10 smithi194 ceph-mon[88937]: pgmap v1139: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:10 smithi123 ceph-mon[112409]: pgmap v1139: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:12 smithi194 ceph-mon[88937]: pgmap v1140: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:12 smithi123 ceph-mon[112409]: pgmap v1140: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:14 smithi194 ceph-mon[88937]: pgmap v1141: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:14 smithi123 ceph-mon[112409]: pgmap v1141: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:16 smithi194 ceph-mon[88937]: pgmap v1142: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:16 smithi123 ceph-mon[112409]: pgmap v1142: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:18 smithi194 ceph-mon[88937]: pgmap v1143: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:18 smithi123 ceph-mon[112409]: pgmap v1143: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:21.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:20 smithi194 ceph-mon[88937]: pgmap v1144: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:20 smithi123 ceph-mon[112409]: pgmap v1144: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:22 smithi194 ceph-mon[88937]: pgmap v1145: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:23.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:22 smithi123 ceph-mon[112409]: pgmap v1145: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:24 smithi194 ceph-mon[88937]: pgmap v1146: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:25.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:24 smithi123 ceph-mon[112409]: pgmap v1146: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:25.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:26.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:26 smithi194 ceph-mon[88937]: pgmap v1147: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:27.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:26 smithi123 ceph-mon[112409]: pgmap v1147: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:28 smithi194 ceph-mon[88937]: pgmap v1148: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:28 smithi123 ceph-mon[112409]: pgmap v1148: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:30 smithi194 ceph-mon[88937]: pgmap v1149: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:30 smithi123 ceph-mon[112409]: pgmap v1149: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:32 smithi194 ceph-mon[88937]: pgmap v1150: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:33.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:32 smithi123 ceph-mon[112409]: pgmap v1150: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:34 smithi194 ceph-mon[88937]: pgmap v1151: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:34 smithi123 ceph-mon[112409]: pgmap v1151: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:36 smithi194 ceph-mon[88937]: pgmap v1152: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:36 smithi123 ceph-mon[112409]: pgmap v1152: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:38 smithi194 ceph-mon[88937]: pgmap v1153: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:39.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:38 smithi123 ceph-mon[112409]: pgmap v1153: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:40 smithi194 ceph-mon[88937]: pgmap v1154: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:40 smithi123 ceph-mon[112409]: pgmap v1154: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:42 smithi194 ceph-mon[88937]: pgmap v1155: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:43.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:42 smithi123 ceph-mon[112409]: pgmap v1155: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:44 smithi194 ceph-mon[88937]: pgmap v1156: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:44 smithi123 ceph-mon[112409]: pgmap v1156: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:46 smithi194 ceph-mon[88937]: pgmap v1157: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:46 smithi123 ceph-mon[112409]: pgmap v1157: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:48 smithi194 ceph-mon[88937]: pgmap v1158: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:49.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:48 smithi123 ceph-mon[112409]: pgmap v1158: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:50 smithi194 ceph-mon[88937]: pgmap v1159: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:50 smithi123 ceph-mon[112409]: pgmap v1159: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:52 smithi194 ceph-mon[88937]: pgmap v1160: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:53.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:52 smithi123 ceph-mon[112409]: pgmap v1160: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:54 smithi194 ceph-mon[88937]: pgmap v1161: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:54 smithi123 ceph-mon[112409]: pgmap v1161: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:56.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:46:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:56 smithi194 ceph-mon[88937]: pgmap v1162: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:56 smithi123 ceph-mon[112409]: pgmap v1162: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:46:58 smithi194 ceph-mon[88937]: pgmap v1163: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:46:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:46:58 smithi123 ceph-mon[112409]: pgmap v1163: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:01.149 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:00 smithi194 ceph-mon[88937]: pgmap v1164: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:00 smithi123 ceph-mon[112409]: pgmap v1164: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:02 smithi194 ceph-mon[88937]: pgmap v1165: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:47:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:02 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:02 smithi123 ceph-mon[112409]: pgmap v1165: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:47:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:02 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:04.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:04.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:47:04.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:47:04.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:04.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:04.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:47:04.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:47:04.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:47:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:04 smithi194 ceph-mon[88937]: pgmap v1166: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:04 smithi123 ceph-mon[112409]: pgmap v1166: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:06 smithi194 ceph-mon[88937]: pgmap v1167: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:06 smithi123 ceph-mon[112409]: pgmap v1167: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:08 smithi194 ceph-mon[88937]: pgmap v1168: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:08 smithi123 ceph-mon[112409]: pgmap v1168: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:10 smithi123 ceph-mon[112409]: pgmap v1169: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:10 smithi194 ceph-mon[88937]: pgmap v1169: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:12 smithi123 ceph-mon[112409]: pgmap v1170: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:12 smithi194 ceph-mon[88937]: pgmap v1170: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:15.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:14 smithi194 ceph-mon[88937]: pgmap v1171: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:15.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:14 smithi123 ceph-mon[112409]: pgmap v1171: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:17.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:16 smithi123 ceph-mon[112409]: pgmap v1172: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:16 smithi194 ceph-mon[88937]: pgmap v1172: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:19.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:18 smithi123 ceph-mon[112409]: pgmap v1173: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:18 smithi194 ceph-mon[88937]: pgmap v1173: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:20 smithi123 ceph-mon[112409]: pgmap v1174: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:20 smithi194 ceph-mon[88937]: pgmap v1174: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:23.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:22 smithi123 ceph-mon[112409]: pgmap v1175: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:23.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:22 smithi194 ceph-mon[88937]: pgmap v1175: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:25.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:24 smithi123 ceph-mon[112409]: pgmap v1176: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:24 smithi194 ceph-mon[88937]: pgmap v1176: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:26.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:27.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:26 smithi123 ceph-mon[112409]: pgmap v1177: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:26 smithi194 ceph-mon[88937]: pgmap v1177: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:28 smithi123 ceph-mon[112409]: pgmap v1178: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:28 smithi194 ceph-mon[88937]: pgmap v1178: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:31.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:30 smithi123 ceph-mon[112409]: pgmap v1179: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:30 smithi194 ceph-mon[88937]: pgmap v1179: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:33.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:32 smithi123 ceph-mon[112409]: pgmap v1180: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:32 smithi194 ceph-mon[88937]: pgmap v1180: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:35.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:34 smithi123 ceph-mon[112409]: pgmap v1181: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:34 smithi194 ceph-mon[88937]: pgmap v1181: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:36 smithi123 ceph-mon[112409]: pgmap v1182: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:36 smithi194 ceph-mon[88937]: pgmap v1182: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:38 smithi123 ceph-mon[112409]: pgmap v1183: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:38 smithi194 ceph-mon[88937]: pgmap v1183: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:40 smithi123 ceph-mon[112409]: pgmap v1184: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:40 smithi194 ceph-mon[88937]: pgmap v1184: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:43.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:42 smithi123 ceph-mon[112409]: pgmap v1185: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:42 smithi194 ceph-mon[88937]: pgmap v1185: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:44 smithi123 ceph-mon[112409]: pgmap v1186: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:44 smithi194 ceph-mon[88937]: pgmap v1186: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:47.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:46 smithi123 ceph-mon[112409]: pgmap v1187: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:46 smithi194 ceph-mon[88937]: pgmap v1187: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:49.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:48 smithi123 ceph-mon[112409]: pgmap v1188: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:48 smithi194 ceph-mon[88937]: pgmap v1188: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:51.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:50 smithi123 ceph-mon[112409]: pgmap v1189: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:50 smithi194 ceph-mon[88937]: pgmap v1189: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:53.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:52 smithi123 ceph-mon[112409]: pgmap v1190: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:52 smithi194 ceph-mon[88937]: pgmap v1190: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:55.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:54 smithi123 ceph-mon[112409]: pgmap v1191: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:54 smithi194 ceph-mon[88937]: pgmap v1191: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:56.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:47:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:56 smithi123 ceph-mon[112409]: pgmap v1192: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:56 smithi194 ceph-mon[88937]: pgmap v1192: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:47:58 smithi123 ceph-mon[112409]: pgmap v1193: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:47:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:47:58 smithi194 ceph-mon[88937]: pgmap v1193: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:00 smithi123 ceph-mon[112409]: pgmap v1194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:00 smithi194 ceph-mon[88937]: pgmap v1194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:02 smithi123 ceph-mon[112409]: pgmap v1195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:02 smithi194 ceph-mon[88937]: pgmap v1195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:04.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:03 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:48:04.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:03 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:48:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:04 smithi123 ceph-mon[112409]: pgmap v1196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:04 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:48:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:04 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:48:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:04 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:48:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:04 smithi194 ceph-mon[88937]: pgmap v1196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:04 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:48:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:04 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:48:05.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:04 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:48:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:06 smithi123 ceph-mon[112409]: pgmap v1197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:06 smithi194 ceph-mon[88937]: pgmap v1197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:09.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:09 smithi123 ceph-mon[112409]: pgmap v1198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:09 smithi194 ceph-mon[88937]: pgmap v1198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:11 smithi123 ceph-mon[112409]: pgmap v1199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:11 smithi194 ceph-mon[88937]: pgmap v1199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:13 smithi123 ceph-mon[112409]: pgmap v1200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:13 smithi194 ceph-mon[88937]: pgmap v1200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:15 smithi194 ceph-mon[88937]: pgmap v1201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:15 smithi123 ceph-mon[112409]: pgmap v1201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:17.389 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:17 smithi194 ceph-mon[88937]: pgmap v1202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:17 smithi123 ceph-mon[112409]: pgmap v1202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:19 smithi194 ceph-mon[88937]: pgmap v1203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:19 smithi123 ceph-mon[112409]: pgmap v1203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:21 smithi194 ceph-mon[88937]: pgmap v1204: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:21 smithi123 ceph-mon[112409]: pgmap v1204: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:23 smithi194 ceph-mon[88937]: pgmap v1205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:23 smithi123 ceph-mon[112409]: pgmap v1205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:25 smithi194 ceph-mon[88937]: pgmap v1206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:25 smithi123 ceph-mon[112409]: pgmap v1206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:26.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:27 smithi194 ceph-mon[88937]: pgmap v1207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:27 smithi123 ceph-mon[112409]: pgmap v1207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:29 smithi194 ceph-mon[88937]: pgmap v1208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:29 smithi123 ceph-mon[112409]: pgmap v1208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:31 smithi194 ceph-mon[88937]: pgmap v1209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:31 smithi123 ceph-mon[112409]: pgmap v1209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:33 smithi194 ceph-mon[88937]: pgmap v1210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:33 smithi123 ceph-mon[112409]: pgmap v1210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:35 smithi194 ceph-mon[88937]: pgmap v1211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:35 smithi123 ceph-mon[112409]: pgmap v1211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:37 smithi194 ceph-mon[88937]: pgmap v1212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:37.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:37 smithi123 ceph-mon[112409]: pgmap v1212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:39 smithi194 ceph-mon[88937]: pgmap v1213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:39.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:39 smithi123 ceph-mon[112409]: pgmap v1213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:41 smithi194 ceph-mon[88937]: pgmap v1214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:41 smithi123 ceph-mon[112409]: pgmap v1214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:43 smithi194 ceph-mon[88937]: pgmap v1215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:43 smithi123 ceph-mon[112409]: pgmap v1215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:45.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:45 smithi194 ceph-mon[88937]: pgmap v1216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:45.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:45 smithi123 ceph-mon[112409]: pgmap v1216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:47 smithi194 ceph-mon[88937]: pgmap v1217: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:47 smithi123 ceph-mon[112409]: pgmap v1217: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:49 smithi194 ceph-mon[88937]: pgmap v1218: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:49.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:49 smithi123 ceph-mon[112409]: pgmap v1218: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:51 smithi194 ceph-mon[88937]: pgmap v1219: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:51.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:51 smithi123 ceph-mon[112409]: pgmap v1219: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:53 smithi194 ceph-mon[88937]: pgmap v1220: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:53 smithi123 ceph-mon[112409]: pgmap v1220: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:55 smithi194 ceph-mon[88937]: pgmap v1221: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:55.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:55 smithi123 ceph-mon[112409]: pgmap v1221: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:48:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:57 smithi194 ceph-mon[88937]: pgmap v1222: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:57.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:57 smithi123 ceph-mon[112409]: pgmap v1222: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:48:59 smithi194 ceph-mon[88937]: pgmap v1223: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:48:59.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:48:59 smithi123 ceph-mon[112409]: pgmap v1223: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:01 smithi194 ceph-mon[88937]: pgmap v1224: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:01 smithi123 ceph-mon[112409]: pgmap v1224: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:03 smithi194 ceph-mon[88937]: pgmap v1225: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:03 smithi123 ceph-mon[112409]: pgmap v1225: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:05 smithi194 ceph-mon[88937]: pgmap v1226: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:49:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:05.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:05 smithi123 ceph-mon[112409]: pgmap v1226: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:05.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:49:05.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:05.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:06.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:49:06.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:49:06.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:06.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:49:06.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:49:06.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:49:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:07 smithi194 ceph-mon[88937]: pgmap v1227: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:07.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:07 smithi123 ceph-mon[112409]: pgmap v1227: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:09 smithi194 ceph-mon[88937]: pgmap v1228: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:09.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:09 smithi123 ceph-mon[112409]: pgmap v1228: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:11 smithi194 ceph-mon[88937]: pgmap v1229: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:11 smithi123 ceph-mon[112409]: pgmap v1229: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:13 smithi194 ceph-mon[88937]: pgmap v1230: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:13 smithi123 ceph-mon[112409]: pgmap v1230: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:15 smithi194 ceph-mon[88937]: pgmap v1231: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:15 smithi123 ceph-mon[112409]: pgmap v1231: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:17 smithi194 ceph-mon[88937]: pgmap v1232: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:17 smithi123 ceph-mon[112409]: pgmap v1232: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:19 smithi194 ceph-mon[88937]: pgmap v1233: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:19 smithi123 ceph-mon[112409]: pgmap v1233: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:21 smithi194 ceph-mon[88937]: pgmap v1234: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:21 smithi123 ceph-mon[112409]: pgmap v1234: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:23 smithi194 ceph-mon[88937]: pgmap v1235: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:23.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:23 smithi123 ceph-mon[112409]: pgmap v1235: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:25 smithi194 ceph-mon[88937]: pgmap v1236: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:25 smithi123 ceph-mon[112409]: pgmap v1236: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:27 smithi194 ceph-mon[88937]: pgmap v1237: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:27.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:27 smithi123 ceph-mon[112409]: pgmap v1237: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:29 smithi194 ceph-mon[88937]: pgmap v1238: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:29.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:29 smithi123 ceph-mon[112409]: pgmap v1238: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:31 smithi194 ceph-mon[88937]: pgmap v1239: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:31.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:31 smithi123 ceph-mon[112409]: pgmap v1239: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:33.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:33 smithi123 ceph-mon[112409]: pgmap v1240: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:33.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:33 smithi194 ceph-mon[88937]: pgmap v1240: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:35.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:35 smithi123 ceph-mon[112409]: pgmap v1241: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:35.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:35 smithi194 ceph-mon[88937]: pgmap v1241: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:37.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:37 smithi123 ceph-mon[112409]: pgmap v1242: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:37.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:37 smithi194 ceph-mon[88937]: pgmap v1242: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:39.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:39 smithi123 ceph-mon[112409]: pgmap v1243: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:39 smithi194 ceph-mon[88937]: pgmap v1243: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:41 smithi123 ceph-mon[112409]: pgmap v1244: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:41 smithi194 ceph-mon[88937]: pgmap v1244: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:43.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:43 smithi123 ceph-mon[112409]: pgmap v1245: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:43.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:43 smithi194 ceph-mon[88937]: pgmap v1245: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:45.449 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:45 smithi194 ceph-mon[88937]: pgmap v1246: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:45.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:45 smithi123 ceph-mon[112409]: pgmap v1246: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:47 smithi123 ceph-mon[112409]: pgmap v1247: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:47 smithi194 ceph-mon[88937]: pgmap v1247: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:48.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:48 smithi123 ceph-mon[112409]: pgmap v1248: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:48.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:48 smithi194 ceph-mon[88937]: pgmap v1248: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:50.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:50 smithi123 ceph-mon[112409]: pgmap v1249: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:50 smithi194 ceph-mon[88937]: pgmap v1249: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:52.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:52 smithi123 ceph-mon[112409]: pgmap v1250: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:52 smithi194 ceph-mon[88937]: pgmap v1250: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:54.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:54 smithi123 ceph-mon[112409]: pgmap v1251: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:54 smithi194 ceph-mon[88937]: pgmap v1251: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:56.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:56 smithi123 ceph-mon[112409]: pgmap v1252: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:56.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:56 smithi194 ceph-mon[88937]: pgmap v1252: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:49:59.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:49:58 smithi123 ceph-mon[112409]: pgmap v1253: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:49:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:49:58 smithi194 ceph-mon[88937]: pgmap v1253: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:01.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:00 smithi123 ceph-mon[112409]: pgmap v1254: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:01.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:50:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:00 smithi194 ceph-mon[88937]: pgmap v1254: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T08:50:03.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:02 smithi123 ceph-mon[112409]: pgmap v1255: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:02 smithi194 ceph-mon[88937]: pgmap v1255: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:05.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:04 smithi123 ceph-mon[112409]: pgmap v1256: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:04 smithi194 ceph-mon[88937]: pgmap v1256: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:06.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:05 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:50:06.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:05 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:50:07.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:06 smithi123 ceph-mon[112409]: pgmap v1257: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:07.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:50:07.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:50:07.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:50:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:06 smithi194 ceph-mon[88937]: pgmap v1257: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:50:07.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:50:07.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:50:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:08 smithi123 ceph-mon[112409]: pgmap v1258: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:08 smithi194 ceph-mon[88937]: pgmap v1258: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:11.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:10 smithi123 ceph-mon[112409]: pgmap v1259: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:10 smithi194 ceph-mon[88937]: pgmap v1259: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:12.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:12.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:13.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:12 smithi123 ceph-mon[112409]: pgmap v1260: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:12 smithi194 ceph-mon[88937]: pgmap v1260: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:15.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:14 smithi123 ceph-mon[112409]: pgmap v1261: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:14 smithi194 ceph-mon[88937]: pgmap v1261: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:17.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:16 smithi123 ceph-mon[112409]: pgmap v1262: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:16 smithi194 ceph-mon[88937]: pgmap v1262: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:18 smithi123 ceph-mon[112409]: pgmap v1263: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:18 smithi194 ceph-mon[88937]: pgmap v1263: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:21.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:20 smithi123 ceph-mon[112409]: pgmap v1264: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:21.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:20 smithi194 ceph-mon[88937]: pgmap v1264: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:23.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:22 smithi123 ceph-mon[112409]: pgmap v1265: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:22 smithi194 ceph-mon[88937]: pgmap v1265: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:25.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:24 smithi123 ceph-mon[112409]: pgmap v1266: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:24 smithi194 ceph-mon[88937]: pgmap v1266: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:26.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:26 smithi194 ceph-mon[88937]: pgmap v1267: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:27.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:26 smithi123 ceph-mon[112409]: pgmap v1267: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:28 smithi194 ceph-mon[88937]: pgmap v1268: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:29.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:28 smithi123 ceph-mon[112409]: pgmap v1268: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:30 smithi194 ceph-mon[88937]: pgmap v1269: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:31.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:30 smithi123 ceph-mon[112409]: pgmap v1269: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:33.024 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:32 smithi123 ceph-mon[112409]: pgmap v1270: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:32 smithi194 ceph-mon[88937]: pgmap v1270: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:34 smithi194 ceph-mon[88937]: pgmap v1271: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:35.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:34 smithi123 ceph-mon[112409]: pgmap v1271: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:36 smithi194 ceph-mon[88937]: pgmap v1272: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:37.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:36 smithi123 ceph-mon[112409]: pgmap v1272: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:38 smithi194 ceph-mon[88937]: pgmap v1273: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:38 smithi123 ceph-mon[112409]: pgmap v1273: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:40 smithi194 ceph-mon[88937]: pgmap v1274: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:40 smithi123 ceph-mon[112409]: pgmap v1274: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:42 smithi194 ceph-mon[88937]: pgmap v1275: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:43.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:42 smithi123 ceph-mon[112409]: pgmap v1275: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:44 smithi194 ceph-mon[88937]: pgmap v1276: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:45.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:44 smithi123 ceph-mon[112409]: pgmap v1276: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:46 smithi194 ceph-mon[88937]: pgmap v1277: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:47.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:46 smithi123 ceph-mon[112409]: pgmap v1277: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:48 smithi194 ceph-mon[88937]: pgmap v1278: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:49.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:48 smithi123 ceph-mon[112409]: pgmap v1278: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:50 smithi194 ceph-mon[88937]: pgmap v1279: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:51.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:50 smithi123 ceph-mon[112409]: pgmap v1279: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:52 smithi194 ceph-mon[88937]: pgmap v1280: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:53.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:52 smithi123 ceph-mon[112409]: pgmap v1280: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:54 smithi194 ceph-mon[88937]: pgmap v1281: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:55.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:54 smithi123 ceph-mon[112409]: pgmap v1281: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:56.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:50:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:56 smithi194 ceph-mon[88937]: pgmap v1282: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:57.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:56 smithi123 ceph-mon[112409]: pgmap v1282: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:50:58 smithi194 ceph-mon[88937]: pgmap v1283: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:50:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:50:58 smithi123 ceph-mon[112409]: pgmap v1283: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:00 smithi194 ceph-mon[88937]: pgmap v1284: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:00 smithi123 ceph-mon[112409]: pgmap v1284: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:02 smithi194 ceph-mon[88937]: pgmap v1285: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:02 smithi123 ceph-mon[112409]: pgmap v1285: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:04 smithi194 ceph-mon[88937]: pgmap v1286: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:04 smithi123 ceph-mon[112409]: pgmap v1286: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:06 smithi194 ceph-mon[88937]: pgmap v1287: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:07.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:06 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:51:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:06 smithi123 ceph-mon[112409]: pgmap v1287: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:06 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:51:08.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:51:08.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:51:08.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:51:08.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:51:08.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:51:08.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:51:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:09 smithi194 ceph-mon[88937]: pgmap v1288: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:09.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:09 smithi123 ceph-mon[112409]: pgmap v1288: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:11 smithi194 ceph-mon[88937]: pgmap v1289: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:11 smithi123 ceph-mon[112409]: pgmap v1289: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:13 smithi194 ceph-mon[88937]: pgmap v1290: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:13 smithi123 ceph-mon[112409]: pgmap v1290: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:15 smithi194 ceph-mon[88937]: pgmap v1291: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:15.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:15 smithi123 ceph-mon[112409]: pgmap v1291: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:17 smithi194 ceph-mon[88937]: pgmap v1292: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:17 smithi123 ceph-mon[112409]: pgmap v1292: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:19 smithi194 ceph-mon[88937]: pgmap v1293: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:19 smithi123 ceph-mon[112409]: pgmap v1293: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:21 smithi194 ceph-mon[88937]: pgmap v1294: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:21.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:21 smithi123 ceph-mon[112409]: pgmap v1294: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:23 smithi194 ceph-mon[88937]: pgmap v1295: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:23 smithi123 ceph-mon[112409]: pgmap v1295: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:25 smithi194 ceph-mon[88937]: pgmap v1296: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:25.512 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:25 smithi123 ceph-mon[112409]: pgmap v1296: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:26.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:27 smithi194 ceph-mon[88937]: pgmap v1297: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:27.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:27 smithi123 ceph-mon[112409]: pgmap v1297: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:29 smithi194 ceph-mon[88937]: pgmap v1298: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:29.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:29 smithi123 ceph-mon[112409]: pgmap v1298: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:31 smithi194 ceph-mon[88937]: pgmap v1299: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:31.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:31 smithi123 ceph-mon[112409]: pgmap v1299: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:33 smithi194 ceph-mon[88937]: pgmap v1300: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:33 smithi123 ceph-mon[112409]: pgmap v1300: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:35 smithi194 ceph-mon[88937]: pgmap v1301: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:35.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:35 smithi123 ceph-mon[112409]: pgmap v1301: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:37 smithi194 ceph-mon[88937]: pgmap v1302: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:37.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:37 smithi123 ceph-mon[112409]: pgmap v1302: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:39 smithi194 ceph-mon[88937]: pgmap v1303: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:39.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:39 smithi123 ceph-mon[112409]: pgmap v1303: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:41 smithi194 ceph-mon[88937]: pgmap v1304: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:41.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:41 smithi123 ceph-mon[112409]: pgmap v1304: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:43 smithi194 ceph-mon[88937]: pgmap v1305: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:43.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:43 smithi123 ceph-mon[112409]: pgmap v1305: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:45 smithi194 ceph-mon[88937]: pgmap v1306: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:45.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:45 smithi123 ceph-mon[112409]: pgmap v1306: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:47 smithi194 ceph-mon[88937]: pgmap v1307: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:47.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:47 smithi123 ceph-mon[112409]: pgmap v1307: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:49 smithi194 ceph-mon[88937]: pgmap v1308: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:49.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:49 smithi123 ceph-mon[112409]: pgmap v1308: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:51 smithi194 ceph-mon[88937]: pgmap v1309: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:51.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:51 smithi123 ceph-mon[112409]: pgmap v1309: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:53 smithi194 ceph-mon[88937]: pgmap v1310: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:53 smithi123 ceph-mon[112409]: pgmap v1310: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:55 smithi194 ceph-mon[88937]: pgmap v1311: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:55.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:55 smithi123 ceph-mon[112409]: pgmap v1311: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:56.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:51:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:57 smithi194 ceph-mon[88937]: pgmap v1312: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:57.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:57 smithi123 ceph-mon[112409]: pgmap v1312: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:51:59 smithi194 ceph-mon[88937]: pgmap v1313: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:51:59.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:51:59 smithi123 ceph-mon[112409]: pgmap v1313: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:01 smithi194 ceph-mon[88937]: pgmap v1314: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:01 smithi123 ceph-mon[112409]: pgmap v1314: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:03 smithi194 ceph-mon[88937]: pgmap v1315: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:03 smithi123 ceph-mon[112409]: pgmap v1315: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:05 smithi194 ceph-mon[88937]: pgmap v1316: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:05 smithi123 ceph-mon[112409]: pgmap v1316: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:07 smithi194 ceph-mon[88937]: pgmap v1317: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:07.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:07 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:52:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:07 smithi123 ceph-mon[112409]: pgmap v1317: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:07.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:07 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:52:08.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:52:08.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:52:08.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:52:08.412 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:52:08.412 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:52:08.412 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:52:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:09 smithi194 ceph-mon[88937]: pgmap v1318: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:09 smithi123 ceph-mon[112409]: pgmap v1318: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:11 smithi194 ceph-mon[88937]: pgmap v1319: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:11.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:11 smithi123 ceph-mon[112409]: pgmap v1319: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:13 smithi194 ceph-mon[88937]: pgmap v1320: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:13.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:13 smithi123 ceph-mon[112409]: pgmap v1320: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:15.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:15 smithi123 ceph-mon[112409]: pgmap v1321: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:15.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:15 smithi194 ceph-mon[88937]: pgmap v1321: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:17.448 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:17 smithi194 ceph-mon[88937]: pgmap v1322: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:17 smithi123 ceph-mon[112409]: pgmap v1322: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:19 smithi123 ceph-mon[112409]: pgmap v1323: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:19.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:19 smithi194 ceph-mon[88937]: pgmap v1323: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:21.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:21 smithi123 ceph-mon[112409]: pgmap v1324: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:21 smithi194 ceph-mon[88937]: pgmap v1324: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:23 smithi123 ceph-mon[112409]: pgmap v1325: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:23.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:23 smithi194 ceph-mon[88937]: pgmap v1325: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:25.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:25 smithi123 ceph-mon[112409]: pgmap v1326: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:25.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:25 smithi194 ceph-mon[88937]: pgmap v1326: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:26.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:27.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:27 smithi123 ceph-mon[112409]: pgmap v1327: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:27.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:27 smithi194 ceph-mon[88937]: pgmap v1327: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:29.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:29 smithi123 ceph-mon[112409]: pgmap v1328: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:29.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:29 smithi194 ceph-mon[88937]: pgmap v1328: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:31.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:31 smithi123 ceph-mon[112409]: pgmap v1329: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:31 smithi194 ceph-mon[88937]: pgmap v1329: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:33.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:33 smithi123 ceph-mon[112409]: pgmap v1330: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:33.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:33 smithi194 ceph-mon[88937]: pgmap v1330: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:35.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:35 smithi123 ceph-mon[112409]: pgmap v1331: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:35.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:35 smithi194 ceph-mon[88937]: pgmap v1331: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:37.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:37 smithi123 ceph-mon[112409]: pgmap v1332: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:37.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:37 smithi194 ceph-mon[88937]: pgmap v1332: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:39.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:39 smithi123 ceph-mon[112409]: pgmap v1333: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:39 smithi194 ceph-mon[88937]: pgmap v1333: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:41 smithi123 ceph-mon[112409]: pgmap v1334: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:41 smithi194 ceph-mon[88937]: pgmap v1334: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:43 smithi123 ceph-mon[112409]: pgmap v1335: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:43.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:43 smithi194 ceph-mon[88937]: pgmap v1335: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:45.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:45 smithi123 ceph-mon[112409]: pgmap v1336: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:45 smithi194 ceph-mon[88937]: pgmap v1336: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:46.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:46 smithi123 ceph-mon[112409]: pgmap v1337: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:46.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:46 smithi194 ceph-mon[88937]: pgmap v1337: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:48 smithi194 ceph-mon[88937]: pgmap v1338: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:49.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:48 smithi123 ceph-mon[112409]: pgmap v1338: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:50 smithi194 ceph-mon[88937]: pgmap v1339: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:50 smithi123 ceph-mon[112409]: pgmap v1339: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:52 smithi194 ceph-mon[88937]: pgmap v1340: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:53.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:52 smithi123 ceph-mon[112409]: pgmap v1340: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:54 smithi194 ceph-mon[88937]: pgmap v1341: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:55.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:54 smithi123 ceph-mon[112409]: pgmap v1341: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:56 smithi194 ceph-mon[88937]: pgmap v1342: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:56 smithi123 ceph-mon[112409]: pgmap v1342: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:57.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:52:58.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:52:58 smithi194 ceph-mon[88937]: pgmap v1343: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:52:59.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:52:58 smithi123 ceph-mon[112409]: pgmap v1343: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:00.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:00 smithi194 ceph-mon[88937]: pgmap v1344: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:01.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:00 smithi123 ceph-mon[112409]: pgmap v1344: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:02.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:02 smithi194 ceph-mon[88937]: pgmap v1345: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:03.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:02 smithi123 ceph-mon[112409]: pgmap v1345: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:04.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:04 smithi194 ceph-mon[88937]: pgmap v1346: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:05.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:04 smithi123 ceph-mon[112409]: pgmap v1346: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:06.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:06 smithi194 ceph-mon[88937]: pgmap v1347: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:06 smithi123 ceph-mon[112409]: pgmap v1347: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:08 smithi194 ceph-mon[88937]: pgmap v1348: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:53:08.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:53:08.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:53:08.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:53:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:08 smithi123 ceph-mon[112409]: pgmap v1348: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:53:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:53:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:53:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:53:10.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:10 smithi194 ceph-mon[88937]: pgmap v1349: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:11.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:10 smithi123 ceph-mon[112409]: pgmap v1349: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:11.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:12.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:12.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:12 smithi194 ceph-mon[88937]: pgmap v1350: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:13.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:12 smithi123 ceph-mon[112409]: pgmap v1350: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:14.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:14 smithi194 ceph-mon[88937]: pgmap v1351: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:15.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:14 smithi123 ceph-mon[112409]: pgmap v1351: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:16.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:16 smithi194 ceph-mon[88937]: pgmap v1352: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:17.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:16 smithi123 ceph-mon[112409]: pgmap v1352: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:18 smithi194 ceph-mon[88937]: pgmap v1353: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:18 smithi123 ceph-mon[112409]: pgmap v1353: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:20 smithi194 ceph-mon[88937]: pgmap v1354: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:21.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:20 smithi123 ceph-mon[112409]: pgmap v1354: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:22.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:22 smithi194 ceph-mon[88937]: pgmap v1355: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:23.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:22 smithi123 ceph-mon[112409]: pgmap v1355: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:24.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:24 smithi194 ceph-mon[88937]: pgmap v1356: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:24 smithi123 ceph-mon[112409]: pgmap v1356: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:26.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:26 smithi194 ceph-mon[88937]: pgmap v1357: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:26.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:27.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:26 smithi123 ceph-mon[112409]: pgmap v1357: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:27.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:28.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:28 smithi194 ceph-mon[88937]: pgmap v1358: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:29.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:28 smithi123 ceph-mon[112409]: pgmap v1358: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:30.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:30 smithi194 ceph-mon[88937]: pgmap v1359: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:31.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:30 smithi123 ceph-mon[112409]: pgmap v1359: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:32.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:32 smithi194 ceph-mon[88937]: pgmap v1360: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:32 smithi123 ceph-mon[112409]: pgmap v1360: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:34.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:34 smithi194 ceph-mon[88937]: pgmap v1361: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:35.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:34 smithi123 ceph-mon[112409]: pgmap v1361: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:36 smithi194 ceph-mon[88937]: pgmap v1362: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:37.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:36 smithi123 ceph-mon[112409]: pgmap v1362: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:38 smithi194 ceph-mon[88937]: pgmap v1363: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:39.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:38 smithi123 ceph-mon[112409]: pgmap v1363: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:40 smithi194 ceph-mon[88937]: pgmap v1364: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:41.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:40 smithi123 ceph-mon[112409]: pgmap v1364: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:42.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:42 smithi194 ceph-mon[88937]: pgmap v1365: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:43.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:42 smithi123 ceph-mon[112409]: pgmap v1365: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:44 smithi194 ceph-mon[88937]: pgmap v1366: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:45.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:44 smithi123 ceph-mon[112409]: pgmap v1366: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:47.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:46 smithi123 ceph-mon[112409]: pgmap v1367: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:46 smithi194 ceph-mon[88937]: pgmap v1367: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:48.949 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:48 smithi194 ceph-mon[88937]: pgmap v1368: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:49.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:48 smithi123 ceph-mon[112409]: pgmap v1368: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:50 smithi123 ceph-mon[112409]: pgmap v1369: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:50 smithi194 ceph-mon[88937]: pgmap v1369: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:53.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:52 smithi123 ceph-mon[112409]: pgmap v1370: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:52 smithi194 ceph-mon[88937]: pgmap v1370: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:55.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:54 smithi123 ceph-mon[112409]: pgmap v1371: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:54 smithi194 ceph-mon[88937]: pgmap v1371: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:57.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:56 smithi123 ceph-mon[112409]: pgmap v1372: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:57.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:56 smithi194 ceph-mon[88937]: pgmap v1372: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:53:59.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:53:58 smithi123 ceph-mon[112409]: pgmap v1373: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:53:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:53:58 smithi194 ceph-mon[88937]: pgmap v1373: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:01.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:00 smithi123 ceph-mon[112409]: pgmap v1374: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:00 smithi194 ceph-mon[88937]: pgmap v1374: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:03.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:02 smithi123 ceph-mon[112409]: pgmap v1375: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:02 smithi194 ceph-mon[88937]: pgmap v1375: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:05.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:04 smithi123 ceph-mon[112409]: pgmap v1376: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:04 smithi194 ceph-mon[88937]: pgmap v1376: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:07.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:06 smithi123 ceph-mon[112409]: pgmap v1377: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:06 smithi194 ceph-mon[88937]: pgmap v1377: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:08 smithi123 ceph-mon[112409]: pgmap v1378: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:09.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:08 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:54:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:08 smithi194 ceph-mon[88937]: pgmap v1378: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:08 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:54:10.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:54:10.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:54:10.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:54:10.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:54:10.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:54:10.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:54:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:11 smithi123 ceph-mon[112409]: pgmap v1379: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:11 smithi194 ceph-mon[88937]: pgmap v1379: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:13.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:13 smithi123 ceph-mon[112409]: pgmap v1380: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:13.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:13 smithi194 ceph-mon[88937]: pgmap v1380: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:15.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:15 smithi123 ceph-mon[112409]: pgmap v1381: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:15.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:15 smithi194 ceph-mon[88937]: pgmap v1381: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:17 smithi123 ceph-mon[112409]: pgmap v1382: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:17 smithi194 ceph-mon[88937]: pgmap v1382: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:19.449 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:19 smithi194 ceph-mon[88937]: pgmap v1383: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:19 smithi123 ceph-mon[112409]: pgmap v1383: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:21.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:21 smithi123 ceph-mon[112409]: pgmap v1384: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:21 smithi194 ceph-mon[88937]: pgmap v1384: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:23.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:23 smithi123 ceph-mon[112409]: pgmap v1385: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:23.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:23 smithi194 ceph-mon[88937]: pgmap v1385: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:25.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:25 smithi123 ceph-mon[112409]: pgmap v1386: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:25.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:25 smithi194 ceph-mon[88937]: pgmap v1386: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:26.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:27.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:27 smithi123 ceph-mon[112409]: pgmap v1387: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:27.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:27 smithi194 ceph-mon[88937]: pgmap v1387: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:29.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:29 smithi123 ceph-mon[112409]: pgmap v1388: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:29.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:29 smithi194 ceph-mon[88937]: pgmap v1388: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:31.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:31 smithi123 ceph-mon[112409]: pgmap v1389: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:31 smithi194 ceph-mon[88937]: pgmap v1389: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:33.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:33 smithi123 ceph-mon[112409]: pgmap v1390: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:33.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:33 smithi194 ceph-mon[88937]: pgmap v1390: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:34.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:34 smithi194 ceph-mon[88937]: pgmap v1391: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:34.761 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:34 smithi123 ceph-mon[112409]: pgmap v1391: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:36.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:36 smithi194 ceph-mon[88937]: pgmap v1392: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:37.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:36 smithi123 ceph-mon[112409]: pgmap v1392: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:38.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:38 smithi194 ceph-mon[88937]: pgmap v1393: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:39.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:38 smithi123 ceph-mon[112409]: pgmap v1393: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:40.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:40 smithi194 ceph-mon[88937]: pgmap v1394: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:41.012 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:40 smithi123 ceph-mon[112409]: pgmap v1394: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:41.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:42.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:42.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:42 smithi194 ceph-mon[88937]: pgmap v1395: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:43.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:42 smithi123 ceph-mon[112409]: pgmap v1395: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:44.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:44 smithi194 ceph-mon[88937]: pgmap v1396: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:45.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:44 smithi123 ceph-mon[112409]: pgmap v1396: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:46.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:46 smithi194 ceph-mon[88937]: pgmap v1397: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:47.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:46 smithi123 ceph-mon[112409]: pgmap v1397: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:48.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:48 smithi194 ceph-mon[88937]: pgmap v1398: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:49.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:48 smithi123 ceph-mon[112409]: pgmap v1398: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:50.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:50 smithi194 ceph-mon[88937]: pgmap v1399: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:51.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:50 smithi123 ceph-mon[112409]: pgmap v1399: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:52.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:52 smithi194 ceph-mon[88937]: pgmap v1400: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:53.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:52 smithi123 ceph-mon[112409]: pgmap v1400: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:54.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:54 smithi194 ceph-mon[88937]: pgmap v1401: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:55.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:54 smithi123 ceph-mon[112409]: pgmap v1401: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:56.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:56 smithi194 ceph-mon[88937]: pgmap v1402: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:56.897 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:56 smithi123 ceph-mon[112409]: pgmap v1402: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:57.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:54:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:54:58 smithi194 ceph-mon[88937]: pgmap v1403: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:54:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:54:58 smithi123 ceph-mon[112409]: pgmap v1403: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:00 smithi194 ceph-mon[88937]: pgmap v1404: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:00 smithi123 ceph-mon[112409]: pgmap v1404: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:02 smithi194 ceph-mon[88937]: pgmap v1405: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:02 smithi123 ceph-mon[112409]: pgmap v1405: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:04 smithi194 ceph-mon[88937]: pgmap v1406: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:04 smithi123 ceph-mon[112409]: pgmap v1406: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:06 smithi194 ceph-mon[88937]: pgmap v1407: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:06 smithi123 ceph-mon[112409]: pgmap v1407: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:08 smithi194 ceph-mon[88937]: pgmap v1408: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:08 smithi123 ceph-mon[112409]: pgmap v1408: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:10.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:09 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:55:10.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:09 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:55:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:10 smithi194 ceph-mon[88937]: pgmap v1409: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:11.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:55:11.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:55:11.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:55:11.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:10 smithi123 ceph-mon[112409]: pgmap v1409: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:55:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:55:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:55:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:12 smithi194 ceph-mon[88937]: pgmap v1410: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:13.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:12 smithi123 ceph-mon[112409]: pgmap v1410: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:14 smithi194 ceph-mon[88937]: pgmap v1411: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:15.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:14 smithi123 ceph-mon[112409]: pgmap v1411: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:17.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:16 smithi194 ceph-mon[88937]: pgmap v1412: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:16 smithi123 ceph-mon[112409]: pgmap v1412: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:18 smithi194 ceph-mon[88937]: pgmap v1413: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:19.263 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:18 smithi123 ceph-mon[112409]: pgmap v1413: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:21.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:20 smithi194 ceph-mon[88937]: pgmap v1414: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:21.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:20 smithi123 ceph-mon[112409]: pgmap v1414: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:23.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:22 smithi194 ceph-mon[88937]: pgmap v1415: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:23.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:22 smithi123 ceph-mon[112409]: pgmap v1415: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:24 smithi194 ceph-mon[88937]: pgmap v1416: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:25.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:24 smithi123 ceph-mon[112409]: pgmap v1416: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:26.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:26.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:26 smithi194 ceph-mon[88937]: pgmap v1417: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:27.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:26 smithi123 ceph-mon[112409]: pgmap v1417: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:28 smithi194 ceph-mon[88937]: pgmap v1418: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:29.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:28 smithi123 ceph-mon[112409]: pgmap v1418: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:30 smithi194 ceph-mon[88937]: pgmap v1419: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:30 smithi123 ceph-mon[112409]: pgmap v1419: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:32 smithi194 ceph-mon[88937]: pgmap v1420: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:33.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:32 smithi123 ceph-mon[112409]: pgmap v1420: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:34 smithi194 ceph-mon[88937]: pgmap v1421: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:35.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:34 smithi123 ceph-mon[112409]: pgmap v1421: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:36 smithi194 ceph-mon[88937]: pgmap v1422: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:37.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:36 smithi123 ceph-mon[112409]: pgmap v1422: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:38 smithi194 ceph-mon[88937]: pgmap v1423: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:38 smithi123 ceph-mon[112409]: pgmap v1423: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:40 smithi194 ceph-mon[88937]: pgmap v1424: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:41.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:40 smithi123 ceph-mon[112409]: pgmap v1424: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:42 smithi194 ceph-mon[88937]: pgmap v1425: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:42 smithi123 ceph-mon[112409]: pgmap v1425: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:44 smithi194 ceph-mon[88937]: pgmap v1426: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:45.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:44 smithi123 ceph-mon[112409]: pgmap v1426: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:46 smithi194 ceph-mon[88937]: pgmap v1427: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:47.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:46 smithi123 ceph-mon[112409]: pgmap v1427: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:48 smithi194 ceph-mon[88937]: pgmap v1428: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:49.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:48 smithi123 ceph-mon[112409]: pgmap v1428: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:50 smithi194 ceph-mon[88937]: pgmap v1429: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:51.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:50 smithi123 ceph-mon[112409]: pgmap v1429: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:52 smithi194 ceph-mon[88937]: pgmap v1430: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:53.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:52 smithi123 ceph-mon[112409]: pgmap v1430: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:54 smithi194 ceph-mon[88937]: pgmap v1431: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:54 smithi123 ceph-mon[112409]: pgmap v1431: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:56.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:56.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:55:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:56 smithi194 ceph-mon[88937]: pgmap v1432: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:57.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:56 smithi123 ceph-mon[112409]: pgmap v1432: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:55:58 smithi194 ceph-mon[88937]: pgmap v1433: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:55:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:55:58 smithi123 ceph-mon[112409]: pgmap v1433: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:00 smithi194 ceph-mon[88937]: pgmap v1434: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:00 smithi123 ceph-mon[112409]: pgmap v1434: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:02 smithi194 ceph-mon[88937]: pgmap v1435: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:02 smithi123 ceph-mon[112409]: pgmap v1435: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:04 smithi194 ceph-mon[88937]: pgmap v1436: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:04 smithi123 ceph-mon[112409]: pgmap v1436: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:07.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:06 smithi194 ceph-mon[88937]: pgmap v1437: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:06 smithi123 ceph-mon[112409]: pgmap v1437: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:08 smithi194 ceph-mon[88937]: pgmap v1438: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:09.262 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:08 smithi123 ceph-mon[112409]: pgmap v1438: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:10 smithi194 ceph-mon[88937]: pgmap v1439: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:56:11.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:10 smithi123 ceph-mon[112409]: pgmap v1439: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:56:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:12 smithi194 ceph-mon[88937]: pgmap v1440: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:13.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:13.147 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:12 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:13.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:12 smithi123 ceph-mon[112409]: pgmap v1440: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:13.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:13.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:12 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:15.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:14 smithi123 ceph-mon[112409]: pgmap v1441: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:15.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:14 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:15.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:14 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:14 smithi194 ceph-mon[88937]: pgmap v1441: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:14 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:15.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:14 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:16.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:56:16.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:56:16.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:15 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:16.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:56:16.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:56:16.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:15 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:56:17.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:16 smithi123 ceph-mon[112409]: pgmap v1442: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:16 smithi194 ceph-mon[88937]: pgmap v1442: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:19.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:18 smithi123 ceph-mon[112409]: pgmap v1443: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:18 smithi194 ceph-mon[88937]: pgmap v1443: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:21.199 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:20 smithi194 ceph-mon[88937]: pgmap v1444: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:20 smithi123 ceph-mon[112409]: pgmap v1444: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:23.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:22 smithi123 ceph-mon[112409]: pgmap v1445: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:23.387 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:22 smithi194 ceph-mon[88937]: pgmap v1445: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:25.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:24 smithi123 ceph-mon[112409]: pgmap v1446: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:24 smithi194 ceph-mon[88937]: pgmap v1446: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:26.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:27.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:26 smithi123 ceph-mon[112409]: pgmap v1447: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:26 smithi194 ceph-mon[88937]: pgmap v1447: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:29.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:28 smithi123 ceph-mon[112409]: pgmap v1448: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:28 smithi194 ceph-mon[88937]: pgmap v1448: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:31.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:30 smithi123 ceph-mon[112409]: pgmap v1449: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:30 smithi194 ceph-mon[88937]: pgmap v1449: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:32 smithi194 ceph-mon[88937]: pgmap v1450: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:32 smithi123 ceph-mon[112409]: pgmap v1450: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:35.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:34 smithi123 ceph-mon[112409]: pgmap v1451: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:34 smithi194 ceph-mon[88937]: pgmap v1451: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:37.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:36 smithi123 ceph-mon[112409]: pgmap v1452: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:36 smithi194 ceph-mon[88937]: pgmap v1452: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:38 smithi123 ceph-mon[112409]: pgmap v1453: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:38 smithi194 ceph-mon[88937]: pgmap v1453: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:40 smithi123 ceph-mon[112409]: pgmap v1454: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:40 smithi194 ceph-mon[88937]: pgmap v1454: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:43.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:42 smithi123 ceph-mon[112409]: pgmap v1455: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:42 smithi194 ceph-mon[88937]: pgmap v1455: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:45.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:44 smithi123 ceph-mon[112409]: pgmap v1456: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:44 smithi194 ceph-mon[88937]: pgmap v1456: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:47.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:46 smithi123 ceph-mon[112409]: pgmap v1457: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:46 smithi194 ceph-mon[88937]: pgmap v1457: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:49.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:48 smithi123 ceph-mon[112409]: pgmap v1458: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:48 smithi194 ceph-mon[88937]: pgmap v1458: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:51.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:50 smithi123 ceph-mon[112409]: pgmap v1459: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:50 smithi194 ceph-mon[88937]: pgmap v1459: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:53.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:52 smithi123 ceph-mon[112409]: pgmap v1460: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:52 smithi194 ceph-mon[88937]: pgmap v1460: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:55.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:54 smithi123 ceph-mon[112409]: pgmap v1461: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:54 smithi194 ceph-mon[88937]: pgmap v1461: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:56.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:56:57.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:56 smithi123 ceph-mon[112409]: pgmap v1462: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:56 smithi194 ceph-mon[88937]: pgmap v1462: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:59.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:56:58 smithi123 ceph-mon[112409]: pgmap v1463: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:56:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:56:58 smithi194 ceph-mon[88937]: pgmap v1463: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:01.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:00 smithi123 ceph-mon[112409]: pgmap v1464: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:00 smithi194 ceph-mon[88937]: pgmap v1464: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:03.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:02 smithi123 ceph-mon[112409]: pgmap v1465: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:02 smithi194 ceph-mon[88937]: pgmap v1465: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:05.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:04 smithi123 ceph-mon[112409]: pgmap v1466: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:04 smithi194 ceph-mon[88937]: pgmap v1466: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:07.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:06 smithi123 ceph-mon[112409]: pgmap v1467: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:06 smithi194 ceph-mon[88937]: pgmap v1467: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:09.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:08 smithi123 ceph-mon[112409]: pgmap v1468: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:09 smithi194 ceph-mon[88937]: pgmap v1468: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:11 smithi123 ceph-mon[112409]: pgmap v1469: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:11.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:11 smithi194 ceph-mon[88937]: pgmap v1469: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:13.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:13 smithi123 ceph-mon[112409]: pgmap v1470: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:13 smithi194 ceph-mon[88937]: pgmap v1470: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:15 smithi123 ceph-mon[112409]: pgmap v1471: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:15 smithi194 ceph-mon[88937]: pgmap v1471: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:16.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:57:16.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:16.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:16 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:16.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:57:16.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:16.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:16 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:17 smithi194 ceph-mon[88937]: pgmap v1472: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:17.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:57:17.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:57:17.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:17 smithi123 ceph-mon[112409]: pgmap v1472: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:57:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:57:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:57:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:19 smithi194 ceph-mon[88937]: pgmap v1473: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:19.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:19 smithi123 ceph-mon[112409]: pgmap v1473: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:21 smithi194 ceph-mon[88937]: pgmap v1474: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:21.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:21 smithi123 ceph-mon[112409]: pgmap v1474: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:23 smithi194 ceph-mon[88937]: pgmap v1475: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:23 smithi123 ceph-mon[112409]: pgmap v1475: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:25 smithi194 ceph-mon[88937]: pgmap v1476: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:25 smithi123 ceph-mon[112409]: pgmap v1476: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:27 smithi194 ceph-mon[88937]: pgmap v1477: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:27 smithi123 ceph-mon[112409]: pgmap v1477: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:29 smithi194 ceph-mon[88937]: pgmap v1478: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:29 smithi123 ceph-mon[112409]: pgmap v1478: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:31 smithi194 ceph-mon[88937]: pgmap v1479: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:31.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:31 smithi123 ceph-mon[112409]: pgmap v1479: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:33 smithi194 ceph-mon[88937]: pgmap v1480: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:33 smithi123 ceph-mon[112409]: pgmap v1480: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:35 smithi194 ceph-mon[88937]: pgmap v1481: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:35 smithi123 ceph-mon[112409]: pgmap v1481: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:37 smithi194 ceph-mon[88937]: pgmap v1482: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:37 smithi123 ceph-mon[112409]: pgmap v1482: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:39 smithi194 ceph-mon[88937]: pgmap v1483: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:39.431 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:39 smithi123 ceph-mon[112409]: pgmap v1483: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:41 smithi194 ceph-mon[88937]: pgmap v1484: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:41 smithi123 ceph-mon[112409]: pgmap v1484: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:43 smithi194 ceph-mon[88937]: pgmap v1485: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:43 smithi123 ceph-mon[112409]: pgmap v1485: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:45 smithi194 ceph-mon[88937]: pgmap v1486: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:45 smithi123 ceph-mon[112409]: pgmap v1486: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:47 smithi194 ceph-mon[88937]: pgmap v1487: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:47 smithi123 ceph-mon[112409]: pgmap v1487: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:49 smithi194 ceph-mon[88937]: pgmap v1488: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:49 smithi123 ceph-mon[112409]: pgmap v1488: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:51 smithi194 ceph-mon[88937]: pgmap v1489: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:51 smithi123 ceph-mon[112409]: pgmap v1489: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:53 smithi194 ceph-mon[88937]: pgmap v1490: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:53.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:53 smithi123 ceph-mon[112409]: pgmap v1490: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:55 smithi194 ceph-mon[88937]: pgmap v1491: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:55 smithi123 ceph-mon[112409]: pgmap v1491: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:57:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:57 smithi194 ceph-mon[88937]: pgmap v1492: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:57.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:57 smithi123 ceph-mon[112409]: pgmap v1492: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:57:59 smithi194 ceph-mon[88937]: pgmap v1493: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:57:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:57:59 smithi123 ceph-mon[112409]: pgmap v1493: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:01 smithi194 ceph-mon[88937]: pgmap v1494: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:01 smithi123 ceph-mon[112409]: pgmap v1494: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:03 smithi194 ceph-mon[88937]: pgmap v1495: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:03 smithi123 ceph-mon[112409]: pgmap v1495: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:05 smithi194 ceph-mon[88937]: pgmap v1496: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:05 smithi123 ceph-mon[112409]: pgmap v1496: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:07 smithi194 ceph-mon[88937]: pgmap v1497: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:07 smithi123 ceph-mon[112409]: pgmap v1497: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:09 smithi194 ceph-mon[88937]: pgmap v1498: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:09 smithi123 ceph-mon[112409]: pgmap v1498: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:11 smithi194 ceph-mon[88937]: pgmap v1499: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:11 smithi123 ceph-mon[112409]: pgmap v1499: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:13 smithi194 ceph-mon[88937]: pgmap v1500: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:13 smithi123 ceph-mon[112409]: pgmap v1500: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:15 smithi194 ceph-mon[88937]: pgmap v1501: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:15 smithi123 ceph-mon[112409]: pgmap v1501: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:17 smithi194 ceph-mon[88937]: pgmap v1502: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:58:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:58:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:58:17.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:58:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:17 smithi123 ceph-mon[112409]: pgmap v1502: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:58:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:58:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:58:17.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:58:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:19 smithi194 ceph-mon[88937]: pgmap v1503: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:19 smithi123 ceph-mon[112409]: pgmap v1503: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:21 smithi194 ceph-mon[88937]: pgmap v1504: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:21 smithi123 ceph-mon[112409]: pgmap v1504: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:23 smithi194 ceph-mon[88937]: pgmap v1505: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:23 smithi123 ceph-mon[112409]: pgmap v1505: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:25 smithi194 ceph-mon[88937]: pgmap v1506: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:25.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:25 smithi123 ceph-mon[112409]: pgmap v1506: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:27 smithi194 ceph-mon[88937]: pgmap v1507: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:27 smithi123 ceph-mon[112409]: pgmap v1507: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:29 smithi194 ceph-mon[88937]: pgmap v1508: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:29.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:29 smithi123 ceph-mon[112409]: pgmap v1508: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:31 smithi194 ceph-mon[88937]: pgmap v1509: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:31 smithi123 ceph-mon[112409]: pgmap v1509: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:33 smithi194 ceph-mon[88937]: pgmap v1510: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:33 smithi123 ceph-mon[112409]: pgmap v1510: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:35 smithi194 ceph-mon[88937]: pgmap v1511: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:35.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:35 smithi123 ceph-mon[112409]: pgmap v1511: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:37 smithi194 ceph-mon[88937]: pgmap v1512: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:37 smithi123 ceph-mon[112409]: pgmap v1512: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:39 smithi123 ceph-mon[112409]: pgmap v1513: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:39 smithi194 ceph-mon[88937]: pgmap v1513: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:41 smithi123 ceph-mon[112409]: pgmap v1514: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:41.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:41 smithi194 ceph-mon[88937]: pgmap v1514: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:43 smithi123 ceph-mon[112409]: pgmap v1515: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:43.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:43 smithi194 ceph-mon[88937]: pgmap v1515: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:45 smithi123 ceph-mon[112409]: pgmap v1516: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:45 smithi194 ceph-mon[88937]: pgmap v1516: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:47 smithi123 ceph-mon[112409]: pgmap v1517: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:47 smithi194 ceph-mon[88937]: pgmap v1517: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:49 smithi123 ceph-mon[112409]: pgmap v1518: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:49.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:49 smithi194 ceph-mon[88937]: pgmap v1518: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:51.449 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:51 smithi194 ceph-mon[88937]: pgmap v1519: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:51 smithi123 ceph-mon[112409]: pgmap v1519: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:53 smithi123 ceph-mon[112409]: pgmap v1520: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:53.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:53 smithi194 ceph-mon[88937]: pgmap v1520: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:55 smithi123 ceph-mon[112409]: pgmap v1521: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:55.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:55 smithi194 ceph-mon[88937]: pgmap v1521: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:56.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:58:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:57 smithi123 ceph-mon[112409]: pgmap v1522: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:57.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:57 smithi194 ceph-mon[88937]: pgmap v1522: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:59.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:58:59 smithi123 ceph-mon[112409]: pgmap v1523: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:58:59.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:58:59 smithi194 ceph-mon[88937]: pgmap v1523: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:01 smithi123 ceph-mon[112409]: pgmap v1524: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:01.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:01 smithi194 ceph-mon[88937]: pgmap v1524: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:03 smithi123 ceph-mon[112409]: pgmap v1525: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:03.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:03 smithi194 ceph-mon[88937]: pgmap v1525: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:05 smithi123 ceph-mon[112409]: pgmap v1526: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:05.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:05 smithi194 ceph-mon[88937]: pgmap v1526: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:07 smithi123 ceph-mon[112409]: pgmap v1527: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:07.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:07 smithi194 ceph-mon[88937]: pgmap v1527: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:09 smithi123 ceph-mon[112409]: pgmap v1528: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:09.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:09 smithi194 ceph-mon[88937]: pgmap v1528: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:11 smithi123 ceph-mon[112409]: pgmap v1529: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:11 smithi194 ceph-mon[88937]: pgmap v1529: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:13 smithi123 ceph-mon[112409]: pgmap v1530: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:13.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:13 smithi194 ceph-mon[88937]: pgmap v1530: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:15 smithi123 ceph-mon[112409]: pgmap v1531: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:15.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:15 smithi194 ceph-mon[88937]: pgmap v1531: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:17 smithi123 ceph-mon[112409]: pgmap v1532: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:17 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:59:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:17 smithi194 ceph-mon[88937]: pgmap v1532: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:17 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: pgmap v1533: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:59:18.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: pgmap v1533: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T08:59:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T08:59:19.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T08:59:20.896 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:20 smithi194 ceph-mon[88937]: pgmap v1534: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:21.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:20 smithi123 ceph-mon[112409]: pgmap v1534: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:23.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:22 smithi123 ceph-mon[112409]: pgmap v1535: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:22 smithi194 ceph-mon[88937]: pgmap v1535: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:25.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:24 smithi123 ceph-mon[112409]: pgmap v1536: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:24 smithi194 ceph-mon[88937]: pgmap v1536: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:27.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:26 smithi123 ceph-mon[112409]: pgmap v1537: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:27.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:26 smithi194 ceph-mon[88937]: pgmap v1537: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:29.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:28 smithi123 ceph-mon[112409]: pgmap v1538: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:28 smithi194 ceph-mon[88937]: pgmap v1538: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:31.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:30 smithi123 ceph-mon[112409]: pgmap v1539: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:30 smithi194 ceph-mon[88937]: pgmap v1539: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:33.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:32 smithi123 ceph-mon[112409]: pgmap v1540: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:32 smithi194 ceph-mon[88937]: pgmap v1540: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:35.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:34 smithi123 ceph-mon[112409]: pgmap v1541: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:35.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:34 smithi194 ceph-mon[88937]: pgmap v1541: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:36 smithi123 ceph-mon[112409]: pgmap v1542: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:37.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:36 smithi194 ceph-mon[88937]: pgmap v1542: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:39.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:38 smithi123 ceph-mon[112409]: pgmap v1543: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:39.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:38 smithi194 ceph-mon[88937]: pgmap v1543: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:41.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:40 smithi123 ceph-mon[112409]: pgmap v1544: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:40 smithi194 ceph-mon[88937]: pgmap v1544: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:42.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:42.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:43.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:42 smithi123 ceph-mon[112409]: pgmap v1545: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:43.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:42 smithi194 ceph-mon[88937]: pgmap v1545: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:44 smithi123 ceph-mon[112409]: pgmap v1546: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:44 smithi194 ceph-mon[88937]: pgmap v1546: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:47.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:46 smithi123 ceph-mon[112409]: pgmap v1547: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:46 smithi194 ceph-mon[88937]: pgmap v1547: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:49.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:48 smithi123 ceph-mon[112409]: pgmap v1548: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:49.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:48 smithi194 ceph-mon[88937]: pgmap v1548: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:50 smithi123 ceph-mon[112409]: pgmap v1549: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:51.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:50 smithi194 ceph-mon[88937]: pgmap v1549: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:52.948 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:52 smithi194 ceph-mon[88937]: pgmap v1550: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:52 smithi123 ceph-mon[112409]: pgmap v1550: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:55.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:54 smithi123 ceph-mon[112409]: pgmap v1551: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:54 smithi194 ceph-mon[88937]: pgmap v1551: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:56 smithi123 ceph-mon[112409]: pgmap v1552: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:57.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:56 smithi194 ceph-mon[88937]: pgmap v1552: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T08:59:59.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 08:59:58 smithi123 ceph-mon[112409]: pgmap v1553: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T08:59:59.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 08:59:58 smithi194 ceph-mon[88937]: pgmap v1553: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:00 smithi123 ceph-mon[112409]: pgmap v1554: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:01.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:00:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:00 smithi194 ceph-mon[88937]: pgmap v1554: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:01.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:00:03.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:02 smithi123 ceph-mon[112409]: pgmap v1555: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:02 smithi194 ceph-mon[88937]: pgmap v1555: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:05.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:04 smithi123 ceph-mon[112409]: pgmap v1556: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:04 smithi194 ceph-mon[88937]: pgmap v1556: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:06 smithi123 ceph-mon[112409]: pgmap v1557: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:06 smithi194 ceph-mon[88937]: pgmap v1557: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:09.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:08 smithi123 ceph-mon[112409]: pgmap v1558: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:08 smithi194 ceph-mon[88937]: pgmap v1558: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:11.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:10 smithi123 ceph-mon[112409]: pgmap v1559: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:10 smithi194 ceph-mon[88937]: pgmap v1559: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:12.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:12.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:13.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:12 smithi123 ceph-mon[112409]: pgmap v1560: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:13.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:12 smithi194 ceph-mon[88937]: pgmap v1560: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:15.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:14 smithi123 ceph-mon[112409]: pgmap v1561: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:14 smithi194 ceph-mon[88937]: pgmap v1561: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:17.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:16 smithi123 ceph-mon[112409]: pgmap v1562: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:16 smithi194 ceph-mon[88937]: pgmap v1562: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:18 smithi123 ceph-mon[112409]: pgmap v1563: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:19.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:00:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:18 smithi194 ceph-mon[88937]: pgmap v1563: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:19.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:00:20.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:00:20.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:00:20.011 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:00:20.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:00:20.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:00:20.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:00:21.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:20 smithi194 ceph-mon[88937]: pgmap v1564: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:20 smithi123 ceph-mon[112409]: pgmap v1564: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:22 smithi194 ceph-mon[88937]: pgmap v1565: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:22 smithi123 ceph-mon[112409]: pgmap v1565: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:25.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:24 smithi194 ceph-mon[88937]: pgmap v1566: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:24 smithi123 ceph-mon[112409]: pgmap v1566: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:26.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:27.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:26 smithi194 ceph-mon[88937]: pgmap v1567: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:26 smithi123 ceph-mon[112409]: pgmap v1567: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:28 smithi194 ceph-mon[88937]: pgmap v1568: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:28 smithi123 ceph-mon[112409]: pgmap v1568: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:30 smithi194 ceph-mon[88937]: pgmap v1569: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:30 smithi123 ceph-mon[112409]: pgmap v1569: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:32 smithi194 ceph-mon[88937]: pgmap v1570: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:32 smithi123 ceph-mon[112409]: pgmap v1570: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:34 smithi123 ceph-mon[112409]: pgmap v1571: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:34 smithi194 ceph-mon[88937]: pgmap v1571: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:36 smithi123 ceph-mon[112409]: pgmap v1572: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:36 smithi194 ceph-mon[88937]: pgmap v1572: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:38 smithi123 ceph-mon[112409]: pgmap v1573: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:38 smithi194 ceph-mon[88937]: pgmap v1573: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:40 smithi123 ceph-mon[112409]: pgmap v1574: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:41.261 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:40 smithi194 ceph-mon[88937]: pgmap v1574: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:42 smithi123 ceph-mon[112409]: pgmap v1575: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:42 smithi194 ceph-mon[88937]: pgmap v1575: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:44 smithi123 ceph-mon[112409]: pgmap v1576: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:44 smithi194 ceph-mon[88937]: pgmap v1576: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:46 smithi123 ceph-mon[112409]: pgmap v1577: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:46 smithi194 ceph-mon[88937]: pgmap v1577: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:48 smithi123 ceph-mon[112409]: pgmap v1578: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:48 smithi194 ceph-mon[88937]: pgmap v1578: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:50 smithi123 ceph-mon[112409]: pgmap v1579: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:50 smithi194 ceph-mon[88937]: pgmap v1579: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:53.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:52 smithi194 ceph-mon[88937]: pgmap v1580: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:52 smithi123 ceph-mon[112409]: pgmap v1580: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:54 smithi123 ceph-mon[112409]: pgmap v1581: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:54 smithi194 ceph-mon[88937]: pgmap v1581: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:00:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:56 smithi123 ceph-mon[112409]: pgmap v1582: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:56 smithi194 ceph-mon[88937]: pgmap v1582: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:00:58 smithi123 ceph-mon[112409]: pgmap v1583: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:00:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:00:58 smithi194 ceph-mon[88937]: pgmap v1583: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:00 smithi123 ceph-mon[112409]: pgmap v1584: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:00 smithi194 ceph-mon[88937]: pgmap v1584: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:02 smithi123 ceph-mon[112409]: pgmap v1585: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:02 smithi194 ceph-mon[88937]: pgmap v1585: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:04 smithi123 ceph-mon[112409]: pgmap v1586: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:04 smithi194 ceph-mon[88937]: pgmap v1586: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:06 smithi123 ceph-mon[112409]: pgmap v1587: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:06 smithi194 ceph-mon[88937]: pgmap v1587: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:08 smithi123 ceph-mon[112409]: pgmap v1588: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:08 smithi194 ceph-mon[88937]: pgmap v1588: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:10 smithi123 ceph-mon[112409]: pgmap v1589: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:10 smithi194 ceph-mon[88937]: pgmap v1589: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:12 smithi123 ceph-mon[112409]: pgmap v1590: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:12 smithi194 ceph-mon[88937]: pgmap v1590: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:14 smithi123 ceph-mon[112409]: pgmap v1591: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:14 smithi194 ceph-mon[88937]: pgmap v1591: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:16 smithi123 ceph-mon[112409]: pgmap v1592: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:16 smithi194 ceph-mon[88937]: pgmap v1592: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:18 smithi123 ceph-mon[112409]: pgmap v1593: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:18 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:01:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:18 smithi194 ceph-mon[88937]: pgmap v1593: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:18 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:01:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:01:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:01:20.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:19 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:01:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:01:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:01:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:19 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:01:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:20 smithi123 ceph-mon[112409]: pgmap v1594: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:20 smithi194 ceph-mon[88937]: pgmap v1594: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:22 smithi123 ceph-mon[112409]: pgmap v1595: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:22 smithi194 ceph-mon[88937]: pgmap v1595: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:24 smithi123 ceph-mon[112409]: pgmap v1596: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:24 smithi194 ceph-mon[88937]: pgmap v1596: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:26 smithi123 ceph-mon[112409]: pgmap v1597: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:26 smithi194 ceph-mon[88937]: pgmap v1597: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:28 smithi123 ceph-mon[112409]: pgmap v1598: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:28 smithi194 ceph-mon[88937]: pgmap v1598: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:30 smithi123 ceph-mon[112409]: pgmap v1599: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:30 smithi194 ceph-mon[88937]: pgmap v1599: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:32 smithi123 ceph-mon[112409]: pgmap v1600: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:32 smithi194 ceph-mon[88937]: pgmap v1600: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:34 smithi123 ceph-mon[112409]: pgmap v1601: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:34 smithi194 ceph-mon[88937]: pgmap v1601: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:36 smithi123 ceph-mon[112409]: pgmap v1602: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:36 smithi194 ceph-mon[88937]: pgmap v1602: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:39 smithi123 ceph-mon[112409]: pgmap v1603: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:39 smithi194 ceph-mon[88937]: pgmap v1603: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:41 smithi123 ceph-mon[112409]: pgmap v1604: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:41 smithi194 ceph-mon[88937]: pgmap v1604: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:43 smithi123 ceph-mon[112409]: pgmap v1605: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:43 smithi194 ceph-mon[88937]: pgmap v1605: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:45 smithi194 ceph-mon[88937]: pgmap v1606: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:45 smithi123 ceph-mon[112409]: pgmap v1606: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:47 smithi194 ceph-mon[88937]: pgmap v1607: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:47 smithi123 ceph-mon[112409]: pgmap v1607: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:49 smithi194 ceph-mon[88937]: pgmap v1608: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:49 smithi123 ceph-mon[112409]: pgmap v1608: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:51 smithi194 ceph-mon[88937]: pgmap v1609: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:51 smithi123 ceph-mon[112409]: pgmap v1609: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:53 smithi194 ceph-mon[88937]: pgmap v1610: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:53 smithi123 ceph-mon[112409]: pgmap v1610: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:55 smithi194 ceph-mon[88937]: pgmap v1611: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:55 smithi123 ceph-mon[112409]: pgmap v1611: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:01:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:57 smithi194 ceph-mon[88937]: pgmap v1612: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:57 smithi123 ceph-mon[112409]: pgmap v1612: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:01:59 smithi194 ceph-mon[88937]: pgmap v1613: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:01:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:01:59 smithi123 ceph-mon[112409]: pgmap v1613: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:01 smithi194 ceph-mon[88937]: pgmap v1614: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:01 smithi123 ceph-mon[112409]: pgmap v1614: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:03 smithi194 ceph-mon[88937]: pgmap v1615: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:03 smithi123 ceph-mon[112409]: pgmap v1615: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:05.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:05 smithi194 ceph-mon[88937]: pgmap v1616: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:05 smithi123 ceph-mon[112409]: pgmap v1616: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:07.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:07 smithi194 ceph-mon[88937]: pgmap v1617: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:07 smithi123 ceph-mon[112409]: pgmap v1617: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:09 smithi194 ceph-mon[88937]: pgmap v1618: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:09 smithi123 ceph-mon[112409]: pgmap v1618: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:11 smithi194 ceph-mon[88937]: pgmap v1619: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:11 smithi123 ceph-mon[112409]: pgmap v1619: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:11.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:13 smithi194 ceph-mon[88937]: pgmap v1620: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:13 smithi123 ceph-mon[112409]: pgmap v1620: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:15.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:15 smithi194 ceph-mon[88937]: pgmap v1621: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:15 smithi123 ceph-mon[112409]: pgmap v1621: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:17 smithi194 ceph-mon[88937]: pgmap v1622: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:17 smithi123 ceph-mon[112409]: pgmap v1622: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:19 smithi194 ceph-mon[88937]: pgmap v1623: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:19 smithi123 ceph-mon[112409]: pgmap v1623: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:20.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:20 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:02:20.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:20 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:02:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:21 smithi194 ceph-mon[88937]: pgmap v1624: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:02:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:02:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:02:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:21 smithi123 ceph-mon[112409]: pgmap v1624: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:02:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:02:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:02:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:23 smithi194 ceph-mon[88937]: pgmap v1625: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:23 smithi123 ceph-mon[112409]: pgmap v1625: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:25 smithi194 ceph-mon[88937]: pgmap v1626: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:25 smithi123 ceph-mon[112409]: pgmap v1626: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:27 smithi194 ceph-mon[88937]: pgmap v1627: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:27 smithi123 ceph-mon[112409]: pgmap v1627: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:29 smithi194 ceph-mon[88937]: pgmap v1628: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:29 smithi123 ceph-mon[112409]: pgmap v1628: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:31 smithi194 ceph-mon[88937]: pgmap v1629: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:31 smithi123 ceph-mon[112409]: pgmap v1629: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:33 smithi194 ceph-mon[88937]: pgmap v1630: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:33 smithi123 ceph-mon[112409]: pgmap v1630: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:35.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:35 smithi194 ceph-mon[88937]: pgmap v1631: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:35 smithi123 ceph-mon[112409]: pgmap v1631: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:37 smithi194 ceph-mon[88937]: pgmap v1632: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:37 smithi123 ceph-mon[112409]: pgmap v1632: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:39.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:39 smithi194 ceph-mon[88937]: pgmap v1633: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:39 smithi123 ceph-mon[112409]: pgmap v1633: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:41 smithi194 ceph-mon[88937]: pgmap v1634: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:41 smithi123 ceph-mon[112409]: pgmap v1634: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:43 smithi194 ceph-mon[88937]: pgmap v1635: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:43 smithi123 ceph-mon[112409]: pgmap v1635: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:45.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:45 smithi194 ceph-mon[88937]: pgmap v1636: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:45 smithi123 ceph-mon[112409]: pgmap v1636: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:47 smithi194 ceph-mon[88937]: pgmap v1637: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:47 smithi123 ceph-mon[112409]: pgmap v1637: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:49.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:49 smithi194 ceph-mon[88937]: pgmap v1638: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:49 smithi123 ceph-mon[112409]: pgmap v1638: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:51 smithi194 ceph-mon[88937]: pgmap v1639: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:51 smithi123 ceph-mon[112409]: pgmap v1639: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:53 smithi194 ceph-mon[88937]: pgmap v1640: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:53 smithi123 ceph-mon[112409]: pgmap v1640: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:55.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:55 smithi194 ceph-mon[88937]: pgmap v1641: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:55 smithi123 ceph-mon[112409]: pgmap v1641: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:02:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:57 smithi194 ceph-mon[88937]: pgmap v1642: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:57 smithi123 ceph-mon[112409]: pgmap v1642: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:02:59 smithi194 ceph-mon[88937]: pgmap v1643: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:02:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:02:59 smithi123 ceph-mon[112409]: pgmap v1643: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:01 smithi194 ceph-mon[88937]: pgmap v1644: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:01 smithi123 ceph-mon[112409]: pgmap v1644: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:03.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:03 smithi194 ceph-mon[88937]: pgmap v1645: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:03 smithi123 ceph-mon[112409]: pgmap v1645: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:05 smithi123 ceph-mon[112409]: pgmap v1646: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:05.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:05 smithi194 ceph-mon[88937]: pgmap v1646: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:07 smithi123 ceph-mon[112409]: pgmap v1647: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:07.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:07 smithi194 ceph-mon[88937]: pgmap v1647: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:09 smithi123 ceph-mon[112409]: pgmap v1648: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:09.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:09 smithi194 ceph-mon[88937]: pgmap v1648: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:11 smithi123 ceph-mon[112409]: pgmap v1649: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:11 smithi194 ceph-mon[88937]: pgmap v1649: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:13 smithi123 ceph-mon[112409]: pgmap v1650: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:13 smithi194 ceph-mon[88937]: pgmap v1650: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:15 smithi123 ceph-mon[112409]: pgmap v1651: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:15.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:15 smithi194 ceph-mon[88937]: pgmap v1651: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:17 smithi123 ceph-mon[112409]: pgmap v1652: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:17 smithi194 ceph-mon[88937]: pgmap v1652: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:19 smithi123 ceph-mon[112409]: pgmap v1653: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:19.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:19 smithi194 ceph-mon[88937]: pgmap v1653: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:21 smithi123 ceph-mon[112409]: pgmap v1654: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:03:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:03:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:03:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:03:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:21 smithi194 ceph-mon[88937]: pgmap v1654: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:03:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:03:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:03:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:03:23.448 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:23 smithi194 ceph-mon[88937]: pgmap v1655: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:23 smithi123 ceph-mon[112409]: pgmap v1655: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:25 smithi123 ceph-mon[112409]: pgmap v1656: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:25.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:25 smithi194 ceph-mon[88937]: pgmap v1656: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:27 smithi123 ceph-mon[112409]: pgmap v1657: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:27.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:27 smithi194 ceph-mon[88937]: pgmap v1657: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:29 smithi123 ceph-mon[112409]: pgmap v1658: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:29.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:29 smithi194 ceph-mon[88937]: pgmap v1658: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:31 smithi123 ceph-mon[112409]: pgmap v1659: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:31 smithi194 ceph-mon[88937]: pgmap v1659: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:33 smithi123 ceph-mon[112409]: pgmap v1660: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:33.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:33 smithi194 ceph-mon[88937]: pgmap v1660: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:35 smithi123 ceph-mon[112409]: pgmap v1661: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:35.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:35 smithi194 ceph-mon[88937]: pgmap v1661: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:37 smithi123 ceph-mon[112409]: pgmap v1662: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:37.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:37 smithi194 ceph-mon[88937]: pgmap v1662: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:39 smithi123 ceph-mon[112409]: pgmap v1663: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:39 smithi194 ceph-mon[88937]: pgmap v1663: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:41 smithi123 ceph-mon[112409]: pgmap v1664: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:41 smithi194 ceph-mon[88937]: pgmap v1664: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:43 smithi123 ceph-mon[112409]: pgmap v1665: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:43.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:43 smithi194 ceph-mon[88937]: pgmap v1665: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:45 smithi123 ceph-mon[112409]: pgmap v1666: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:45.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:45 smithi194 ceph-mon[88937]: pgmap v1666: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:47 smithi123 ceph-mon[112409]: pgmap v1667: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:47.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:47 smithi194 ceph-mon[88937]: pgmap v1667: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:49 smithi123 ceph-mon[112409]: pgmap v1668: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:49 smithi194 ceph-mon[88937]: pgmap v1668: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:51 smithi123 ceph-mon[112409]: pgmap v1669: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:51.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:51 smithi194 ceph-mon[88937]: pgmap v1669: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:53 smithi123 ceph-mon[112409]: pgmap v1670: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:53.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:53 smithi194 ceph-mon[88937]: pgmap v1670: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:55 smithi123 ceph-mon[112409]: pgmap v1671: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:55.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:55 smithi194 ceph-mon[88937]: pgmap v1671: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:03:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:57 smithi123 ceph-mon[112409]: pgmap v1672: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:57.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:57 smithi194 ceph-mon[88937]: pgmap v1672: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:03:59 smithi123 ceph-mon[112409]: pgmap v1673: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:03:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:03:59 smithi194 ceph-mon[88937]: pgmap v1673: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:01 smithi123 ceph-mon[112409]: pgmap v1674: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:01.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:01 smithi194 ceph-mon[88937]: pgmap v1674: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:03 smithi123 ceph-mon[112409]: pgmap v1675: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:03.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:03 smithi194 ceph-mon[88937]: pgmap v1675: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:05 smithi123 ceph-mon[112409]: pgmap v1676: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:05 smithi194 ceph-mon[88937]: pgmap v1676: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:07 smithi123 ceph-mon[112409]: pgmap v1677: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:07.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:07 smithi194 ceph-mon[88937]: pgmap v1677: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:09 smithi123 ceph-mon[112409]: pgmap v1678: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:09 smithi194 ceph-mon[88937]: pgmap v1678: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:11 smithi194 ceph-mon[88937]: pgmap v1679: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:11 smithi123 ceph-mon[112409]: pgmap v1679: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:13.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:13 smithi194 ceph-mon[88937]: pgmap v1680: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:13.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:13 smithi123 ceph-mon[112409]: pgmap v1680: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:15.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:15 smithi194 ceph-mon[88937]: pgmap v1681: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:15.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:15 smithi123 ceph-mon[112409]: pgmap v1681: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:17 smithi194 ceph-mon[88937]: pgmap v1682: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:17.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:17 smithi123 ceph-mon[112409]: pgmap v1682: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:19.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:19 smithi194 ceph-mon[88937]: pgmap v1683: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:19.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:19 smithi123 ceph-mon[112409]: pgmap v1683: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:21 smithi194 ceph-mon[88937]: pgmap v1684: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:21.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:21 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:04:21.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:21 smithi123 ceph-mon[112409]: pgmap v1684: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:21.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:21 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:04:22.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:04:22.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:04:22.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:04:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:04:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:04:22.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:04:23.547 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:23 smithi194 ceph-mon[88937]: pgmap v1685: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:23 smithi123 ceph-mon[112409]: pgmap v1685: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:25.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:25 smithi194 ceph-mon[88937]: pgmap v1686: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:25.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:25 smithi123 ceph-mon[112409]: pgmap v1686: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:27 smithi194 ceph-mon[88937]: pgmap v1687: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:27.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:27 smithi123 ceph-mon[112409]: pgmap v1687: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:29.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:29 smithi194 ceph-mon[88937]: pgmap v1688: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:29.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:29 smithi123 ceph-mon[112409]: pgmap v1688: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:31 smithi194 ceph-mon[88937]: pgmap v1689: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:31 smithi123 ceph-mon[112409]: pgmap v1689: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:33.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:33 smithi194 ceph-mon[88937]: pgmap v1690: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:33.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:33 smithi123 ceph-mon[112409]: pgmap v1690: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:35.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:35 smithi194 ceph-mon[88937]: pgmap v1691: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:35 smithi123 ceph-mon[112409]: pgmap v1691: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:37 smithi194 ceph-mon[88937]: pgmap v1692: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:37.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:37 smithi123 ceph-mon[112409]: pgmap v1692: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:39.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:39 smithi194 ceph-mon[88937]: pgmap v1693: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:39 smithi123 ceph-mon[112409]: pgmap v1693: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:40.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:40 smithi194 ceph-mon[88937]: pgmap v1694: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:40.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:40 smithi123 ceph-mon[112409]: pgmap v1694: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:42.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:42 smithi194 ceph-mon[88937]: pgmap v1695: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:42.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:42 smithi123 ceph-mon[112409]: pgmap v1695: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:44 smithi123 ceph-mon[112409]: pgmap v1696: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:45.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:44 smithi194 ceph-mon[88937]: pgmap v1696: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:47.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:46 smithi123 ceph-mon[112409]: pgmap v1697: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:47.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:46 smithi194 ceph-mon[88937]: pgmap v1697: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:49.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:48 smithi123 ceph-mon[112409]: pgmap v1698: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:49.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:48 smithi194 ceph-mon[88937]: pgmap v1698: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:51.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:50 smithi123 ceph-mon[112409]: pgmap v1699: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:50 smithi194 ceph-mon[88937]: pgmap v1699: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:53.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:52 smithi123 ceph-mon[112409]: pgmap v1700: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:53.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:52 smithi194 ceph-mon[88937]: pgmap v1700: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:55.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:54 smithi123 ceph-mon[112409]: pgmap v1701: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:55.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:54 smithi194 ceph-mon[88937]: pgmap v1701: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:56 smithi123 ceph-mon[112409]: pgmap v1702: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:57.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:56 smithi194 ceph-mon[88937]: pgmap v1702: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:57.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:04:59.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:04:58 smithi123 ceph-mon[112409]: pgmap v1703: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:04:59.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:04:58 smithi194 ceph-mon[88937]: pgmap v1703: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:01.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:00 smithi123 ceph-mon[112409]: pgmap v1704: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:01.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:00 smithi194 ceph-mon[88937]: pgmap v1704: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:03.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:02 smithi123 ceph-mon[112409]: pgmap v1705: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:03.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:02 smithi194 ceph-mon[88937]: pgmap v1705: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:05.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:04 smithi194 ceph-mon[88937]: pgmap v1706: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:04 smithi123 ceph-mon[112409]: pgmap v1706: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:07.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:06 smithi194 ceph-mon[88937]: pgmap v1707: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:06 smithi123 ceph-mon[112409]: pgmap v1707: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:09.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:08 smithi194 ceph-mon[88937]: pgmap v1708: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:08 smithi123 ceph-mon[112409]: pgmap v1708: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:10 smithi194 ceph-mon[88937]: pgmap v1709: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:10 smithi123 ceph-mon[112409]: pgmap v1709: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:12 smithi194 ceph-mon[88937]: pgmap v1710: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:12 smithi123 ceph-mon[112409]: pgmap v1710: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:15.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:14 smithi194 ceph-mon[88937]: pgmap v1711: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:14 smithi123 ceph-mon[112409]: pgmap v1711: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:16 smithi194 ceph-mon[88937]: pgmap v1712: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:16 smithi123 ceph-mon[112409]: pgmap v1712: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:18 smithi194 ceph-mon[88937]: pgmap v1713: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:18 smithi123 ceph-mon[112409]: pgmap v1713: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:20 smithi194 ceph-mon[88937]: pgmap v1714: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:20 smithi123 ceph-mon[112409]: pgmap v1714: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:22 smithi194 ceph-mon[88937]: pgmap v1715: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:05:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:05:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:05:23.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:05:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:22 smithi123 ceph-mon[112409]: pgmap v1715: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:05:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:05:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:05:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:05:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:24 smithi194 ceph-mon[88937]: pgmap v1716: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:24 smithi123 ceph-mon[112409]: pgmap v1716: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:26.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:27.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:26 smithi194 ceph-mon[88937]: pgmap v1717: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:26 smithi123 ceph-mon[112409]: pgmap v1717: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:29.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:28 smithi194 ceph-mon[88937]: pgmap v1718: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:28 smithi123 ceph-mon[112409]: pgmap v1718: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:31.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:30 smithi194 ceph-mon[88937]: pgmap v1719: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:30 smithi123 ceph-mon[112409]: pgmap v1719: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:33.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:32 smithi194 ceph-mon[88937]: pgmap v1720: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:32 smithi123 ceph-mon[112409]: pgmap v1720: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:34 smithi194 ceph-mon[88937]: pgmap v1721: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:34 smithi123 ceph-mon[112409]: pgmap v1721: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:36 smithi194 ceph-mon[88937]: pgmap v1722: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:36 smithi123 ceph-mon[112409]: pgmap v1722: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:39.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:38 smithi194 ceph-mon[88937]: pgmap v1723: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:38 smithi123 ceph-mon[112409]: pgmap v1723: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:40 smithi194 ceph-mon[88937]: pgmap v1724: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:41.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:40 smithi123 ceph-mon[112409]: pgmap v1724: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:42 smithi123 ceph-mon[112409]: pgmap v1725: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:42 smithi194 ceph-mon[88937]: pgmap v1725: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:44 smithi123 ceph-mon[112409]: pgmap v1726: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:44 smithi194 ceph-mon[88937]: pgmap v1726: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:46 smithi123 ceph-mon[112409]: pgmap v1727: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:46 smithi194 ceph-mon[88937]: pgmap v1727: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:48 smithi123 ceph-mon[112409]: pgmap v1728: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:48 smithi194 ceph-mon[88937]: pgmap v1728: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:50 smithi123 ceph-mon[112409]: pgmap v1729: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:50 smithi194 ceph-mon[88937]: pgmap v1729: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:52 smithi123 ceph-mon[112409]: pgmap v1730: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:53.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:52 smithi194 ceph-mon[88937]: pgmap v1730: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:55.198 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:54 smithi194 ceph-mon[88937]: pgmap v1731: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:54 smithi123 ceph-mon[112409]: pgmap v1731: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:56.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:05:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:56 smithi123 ceph-mon[112409]: pgmap v1732: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:57.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:56 smithi194 ceph-mon[88937]: pgmap v1732: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:05:58 smithi123 ceph-mon[112409]: pgmap v1733: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:05:59.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:05:58 smithi194 ceph-mon[88937]: pgmap v1733: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:00 smithi123 ceph-mon[112409]: pgmap v1734: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:00 smithi194 ceph-mon[88937]: pgmap v1734: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:02 smithi123 ceph-mon[112409]: pgmap v1735: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:02 smithi194 ceph-mon[88937]: pgmap v1735: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:04 smithi123 ceph-mon[112409]: pgmap v1736: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:04 smithi194 ceph-mon[88937]: pgmap v1736: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:06 smithi123 ceph-mon[112409]: pgmap v1737: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:06 smithi194 ceph-mon[88937]: pgmap v1737: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:08 smithi123 ceph-mon[112409]: pgmap v1738: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:09.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:08 smithi194 ceph-mon[88937]: pgmap v1738: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:10 smithi123 ceph-mon[112409]: pgmap v1739: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:10 smithi194 ceph-mon[88937]: pgmap v1739: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:12 smithi123 ceph-mon[112409]: pgmap v1740: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:13.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:12 smithi194 ceph-mon[88937]: pgmap v1740: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:14 smithi123 ceph-mon[112409]: pgmap v1741: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:14 smithi194 ceph-mon[88937]: pgmap v1741: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:16 smithi123 ceph-mon[112409]: pgmap v1742: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:16 smithi194 ceph-mon[88937]: pgmap v1742: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:18 smithi123 ceph-mon[112409]: pgmap v1743: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:19.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:18 smithi194 ceph-mon[88937]: pgmap v1743: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:20 smithi123 ceph-mon[112409]: pgmap v1744: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:21.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:20 smithi194 ceph-mon[88937]: pgmap v1744: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:22 smithi123 ceph-mon[112409]: pgmap v1745: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:22 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:06:23.352 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:22 smithi194 ceph-mon[88937]: pgmap v1745: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:23.353 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:22 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:06:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:24 smithi123 ceph-mon[112409]: pgmap v1746: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:24 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:25.296 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:24 smithi194 ceph-mon[88937]: pgmap v1746: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:25.296 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:25.296 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:24 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:26.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:26 smithi123 ceph-mon[112409]: pgmap v1747: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:27.263 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:27.263 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:26 smithi194 ceph-mon[88937]: pgmap v1747: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:06:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:06:28.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:27 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:06:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:06:28.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:27 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:06:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:28 smithi123 ceph-mon[112409]: pgmap v1748: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:28 smithi194 ceph-mon[88937]: pgmap v1748: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:30 smithi123 ceph-mon[112409]: pgmap v1749: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:31.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:30 smithi194 ceph-mon[88937]: pgmap v1749: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:32 smithi123 ceph-mon[112409]: pgmap v1750: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:32 smithi194 ceph-mon[88937]: pgmap v1750: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:34 smithi123 ceph-mon[112409]: pgmap v1751: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:35.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:34 smithi194 ceph-mon[88937]: pgmap v1751: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:36 smithi123 ceph-mon[112409]: pgmap v1752: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:37.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:36 smithi194 ceph-mon[88937]: pgmap v1752: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:38 smithi123 ceph-mon[112409]: pgmap v1753: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:38 smithi194 ceph-mon[88937]: pgmap v1753: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:40 smithi123 ceph-mon[112409]: pgmap v1754: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:40 smithi194 ceph-mon[88937]: pgmap v1754: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:42 smithi123 ceph-mon[112409]: pgmap v1755: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:43.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:42 smithi194 ceph-mon[88937]: pgmap v1755: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:44 smithi123 ceph-mon[112409]: pgmap v1756: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:44 smithi194 ceph-mon[88937]: pgmap v1756: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:46 smithi123 ceph-mon[112409]: pgmap v1757: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:46 smithi194 ceph-mon[88937]: pgmap v1757: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:49 smithi123 ceph-mon[112409]: pgmap v1758: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:49 smithi194 ceph-mon[88937]: pgmap v1758: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:51 smithi123 ceph-mon[112409]: pgmap v1759: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:51 smithi194 ceph-mon[88937]: pgmap v1759: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:53 smithi123 ceph-mon[112409]: pgmap v1760: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:53 smithi194 ceph-mon[88937]: pgmap v1760: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:55 smithi194 ceph-mon[88937]: pgmap v1761: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:55 smithi123 ceph-mon[112409]: pgmap v1761: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:56.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:06:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:57 smithi194 ceph-mon[88937]: pgmap v1762: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:57 smithi123 ceph-mon[112409]: pgmap v1762: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:06:59 smithi194 ceph-mon[88937]: pgmap v1763: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:06:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:06:59 smithi123 ceph-mon[112409]: pgmap v1763: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:01.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:01 smithi194 ceph-mon[88937]: pgmap v1764: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:01 smithi123 ceph-mon[112409]: pgmap v1764: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:03 smithi194 ceph-mon[88937]: pgmap v1765: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:03 smithi123 ceph-mon[112409]: pgmap v1765: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:05 smithi194 ceph-mon[88937]: pgmap v1766: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:05 smithi123 ceph-mon[112409]: pgmap v1766: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:07 smithi194 ceph-mon[88937]: pgmap v1767: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:07.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:07 smithi123 ceph-mon[112409]: pgmap v1767: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:09.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:09 smithi194 ceph-mon[88937]: pgmap v1768: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:09 smithi123 ceph-mon[112409]: pgmap v1768: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:11 smithi194 ceph-mon[88937]: pgmap v1769: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:11 smithi123 ceph-mon[112409]: pgmap v1769: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:13.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:13 smithi194 ceph-mon[88937]: pgmap v1770: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:13 smithi123 ceph-mon[112409]: pgmap v1770: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:15 smithi194 ceph-mon[88937]: pgmap v1771: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:15 smithi123 ceph-mon[112409]: pgmap v1771: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:17.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:17 smithi194 ceph-mon[88937]: pgmap v1772: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:17 smithi123 ceph-mon[112409]: pgmap v1772: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:19 smithi194 ceph-mon[88937]: pgmap v1773: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:19 smithi123 ceph-mon[112409]: pgmap v1773: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:21.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:21 smithi194 ceph-mon[88937]: pgmap v1774: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:21 smithi123 ceph-mon[112409]: pgmap v1774: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:23.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:23 smithi194 ceph-mon[88937]: pgmap v1775: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:23 smithi123 ceph-mon[112409]: pgmap v1775: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:25.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:25 smithi194 ceph-mon[88937]: pgmap v1776: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:25 smithi123 ceph-mon[112409]: pgmap v1776: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:26.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:27.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:27 smithi194 ceph-mon[88937]: pgmap v1777: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:27 smithi123 ceph-mon[112409]: pgmap v1777: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:28.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:28 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:07:28.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:28 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:07:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: pgmap v1778: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:07:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:07:29.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: pgmap v1778: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:07:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:07:31.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:31 smithi194 ceph-mon[88937]: pgmap v1779: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:31 smithi123 ceph-mon[112409]: pgmap v1779: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:33 smithi194 ceph-mon[88937]: pgmap v1780: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:33 smithi123 ceph-mon[112409]: pgmap v1780: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:35 smithi123 ceph-mon[112409]: pgmap v1781: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:35 smithi194 ceph-mon[88937]: pgmap v1781: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:37 smithi123 ceph-mon[112409]: pgmap v1782: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:37 smithi194 ceph-mon[88937]: pgmap v1782: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:39.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:39 smithi123 ceph-mon[112409]: pgmap v1783: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:39 smithi194 ceph-mon[88937]: pgmap v1783: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:41 smithi123 ceph-mon[112409]: pgmap v1784: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:41 smithi194 ceph-mon[88937]: pgmap v1784: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:43 smithi123 ceph-mon[112409]: pgmap v1785: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:43 smithi194 ceph-mon[88937]: pgmap v1785: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:45 smithi123 ceph-mon[112409]: pgmap v1786: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:45 smithi194 ceph-mon[88937]: pgmap v1786: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:47 smithi123 ceph-mon[112409]: pgmap v1787: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:47 smithi194 ceph-mon[88937]: pgmap v1787: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:49 smithi123 ceph-mon[112409]: pgmap v1788: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:49 smithi194 ceph-mon[88937]: pgmap v1788: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:51 smithi123 ceph-mon[112409]: pgmap v1789: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:51 smithi194 ceph-mon[88937]: pgmap v1789: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:53 smithi123 ceph-mon[112409]: pgmap v1790: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:53 smithi194 ceph-mon[88937]: pgmap v1790: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:55.448 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:55 smithi194 ceph-mon[88937]: pgmap v1791: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:55.511 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:55 smithi123 ceph-mon[112409]: pgmap v1791: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:07:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:57 smithi123 ceph-mon[112409]: pgmap v1792: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:57 smithi194 ceph-mon[88937]: pgmap v1792: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:07:59 smithi123 ceph-mon[112409]: pgmap v1793: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:07:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:07:59 smithi194 ceph-mon[88937]: pgmap v1793: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:01 smithi123 ceph-mon[112409]: pgmap v1794: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:01 smithi194 ceph-mon[88937]: pgmap v1794: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:03 smithi123 ceph-mon[112409]: pgmap v1795: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:03 smithi194 ceph-mon[88937]: pgmap v1795: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:05 smithi123 ceph-mon[112409]: pgmap v1796: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:05 smithi194 ceph-mon[88937]: pgmap v1796: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:07 smithi123 ceph-mon[112409]: pgmap v1797: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:07 smithi194 ceph-mon[88937]: pgmap v1797: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:09 smithi123 ceph-mon[112409]: pgmap v1798: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:09 smithi194 ceph-mon[88937]: pgmap v1798: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:11 smithi123 ceph-mon[112409]: pgmap v1799: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:11 smithi194 ceph-mon[88937]: pgmap v1799: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:13 smithi123 ceph-mon[112409]: pgmap v1800: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:13 smithi194 ceph-mon[88937]: pgmap v1800: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:15 smithi123 ceph-mon[112409]: pgmap v1801: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:15 smithi194 ceph-mon[88937]: pgmap v1801: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:17 smithi123 ceph-mon[112409]: pgmap v1802: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:17 smithi194 ceph-mon[88937]: pgmap v1802: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:19 smithi123 ceph-mon[112409]: pgmap v1803: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:19 smithi194 ceph-mon[88937]: pgmap v1803: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:21 smithi123 ceph-mon[112409]: pgmap v1804: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:21 smithi194 ceph-mon[88937]: pgmap v1804: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:23 smithi123 ceph-mon[112409]: pgmap v1805: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:23 smithi194 ceph-mon[88937]: pgmap v1805: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:25 smithi123 ceph-mon[112409]: pgmap v1806: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:25 smithi194 ceph-mon[88937]: pgmap v1806: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:27 smithi123 ceph-mon[112409]: pgmap v1807: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:27 smithi194 ceph-mon[88937]: pgmap v1807: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:29 smithi123 ceph-mon[112409]: pgmap v1808: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:29 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:08:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:29 smithi194 ceph-mon[88937]: pgmap v1808: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:29 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:08:30.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:08:30.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:08:30.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:08:30.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:08:30.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:08:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:08:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:31 smithi123 ceph-mon[112409]: pgmap v1809: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:31 smithi194 ceph-mon[88937]: pgmap v1809: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:33 smithi123 ceph-mon[112409]: pgmap v1810: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:33 smithi194 ceph-mon[88937]: pgmap v1810: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:35 smithi123 ceph-mon[112409]: pgmap v1811: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:35 smithi194 ceph-mon[88937]: pgmap v1811: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:37 smithi123 ceph-mon[112409]: pgmap v1812: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:37 smithi194 ceph-mon[88937]: pgmap v1812: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:39 smithi123 ceph-mon[112409]: pgmap v1813: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:39 smithi194 ceph-mon[88937]: pgmap v1813: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:41 smithi123 ceph-mon[112409]: pgmap v1814: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:41 smithi194 ceph-mon[88937]: pgmap v1814: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:43 smithi123 ceph-mon[112409]: pgmap v1815: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:43 smithi194 ceph-mon[88937]: pgmap v1815: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:45 smithi194 ceph-mon[88937]: pgmap v1816: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:45.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:45 smithi123 ceph-mon[112409]: pgmap v1816: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:47 smithi194 ceph-mon[88937]: pgmap v1817: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:47 smithi123 ceph-mon[112409]: pgmap v1817: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:49 smithi194 ceph-mon[88937]: pgmap v1818: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:49.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:49 smithi123 ceph-mon[112409]: pgmap v1818: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:51 smithi194 ceph-mon[88937]: pgmap v1819: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:51.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:51 smithi123 ceph-mon[112409]: pgmap v1819: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:53 smithi194 ceph-mon[88937]: pgmap v1820: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:53.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:53 smithi123 ceph-mon[112409]: pgmap v1820: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:55 smithi194 ceph-mon[88937]: pgmap v1821: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:55.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:55 smithi123 ceph-mon[112409]: pgmap v1821: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:08:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:57 smithi194 ceph-mon[88937]: pgmap v1822: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:57.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:57 smithi123 ceph-mon[112409]: pgmap v1822: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:08:59 smithi194 ceph-mon[88937]: pgmap v1823: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:08:59.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:08:59 smithi123 ceph-mon[112409]: pgmap v1823: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:01 smithi194 ceph-mon[88937]: pgmap v1824: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:01.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:01 smithi123 ceph-mon[112409]: pgmap v1824: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:03 smithi194 ceph-mon[88937]: pgmap v1825: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:03.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:03 smithi123 ceph-mon[112409]: pgmap v1825: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:05 smithi194 ceph-mon[88937]: pgmap v1826: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:05.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:05 smithi123 ceph-mon[112409]: pgmap v1826: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:07 smithi194 ceph-mon[88937]: pgmap v1827: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:07.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:07 smithi123 ceph-mon[112409]: pgmap v1827: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:09 smithi194 ceph-mon[88937]: pgmap v1828: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:09.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:09 smithi123 ceph-mon[112409]: pgmap v1828: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:11 smithi194 ceph-mon[88937]: pgmap v1829: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:11.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:11 smithi123 ceph-mon[112409]: pgmap v1829: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:13 smithi194 ceph-mon[88937]: pgmap v1830: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:13.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:13 smithi123 ceph-mon[112409]: pgmap v1830: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:15 smithi194 ceph-mon[88937]: pgmap v1831: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:15.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:15 smithi123 ceph-mon[112409]: pgmap v1831: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:17 smithi194 ceph-mon[88937]: pgmap v1832: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:17.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:17 smithi123 ceph-mon[112409]: pgmap v1832: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:19 smithi194 ceph-mon[88937]: pgmap v1833: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:19.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:19 smithi123 ceph-mon[112409]: pgmap v1833: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:21 smithi194 ceph-mon[88937]: pgmap v1834: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:21.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:21 smithi123 ceph-mon[112409]: pgmap v1834: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:23 smithi194 ceph-mon[88937]: pgmap v1835: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:23 smithi123 ceph-mon[112409]: pgmap v1835: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:25 smithi194 ceph-mon[88937]: pgmap v1836: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:25.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:25 smithi123 ceph-mon[112409]: pgmap v1836: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:26.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:27 smithi194 ceph-mon[88937]: pgmap v1837: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:27.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:27 smithi123 ceph-mon[112409]: pgmap v1837: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:29 smithi194 ceph-mon[88937]: pgmap v1838: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:29.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:29 smithi123 ceph-mon[112409]: pgmap v1838: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:30.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:09:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:30.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:09:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:30.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:31 smithi194 ceph-mon[88937]: pgmap v1839: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:09:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:09:31.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:31 smithi123 ceph-mon[112409]: pgmap v1839: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:09:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:09:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:09:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:33 smithi194 ceph-mon[88937]: pgmap v1840: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:33.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:33 smithi123 ceph-mon[112409]: pgmap v1840: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:35 smithi194 ceph-mon[88937]: pgmap v1841: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:35 smithi123 ceph-mon[112409]: pgmap v1841: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:37 smithi194 ceph-mon[88937]: pgmap v1842: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:37.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:37 smithi123 ceph-mon[112409]: pgmap v1842: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:39 smithi194 ceph-mon[88937]: pgmap v1843: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:39 smithi123 ceph-mon[112409]: pgmap v1843: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:41 smithi194 ceph-mon[88937]: pgmap v1844: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:41 smithi123 ceph-mon[112409]: pgmap v1844: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:43.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:43 smithi194 ceph-mon[88937]: pgmap v1845: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:43.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:43 smithi123 ceph-mon[112409]: pgmap v1845: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:44.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:44 smithi194 ceph-mon[88937]: pgmap v1846: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:44.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:44 smithi123 ceph-mon[112409]: pgmap v1846: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:47.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:46 smithi194 ceph-mon[88937]: pgmap v1847: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:46 smithi123 ceph-mon[112409]: pgmap v1847: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:49.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:48 smithi194 ceph-mon[88937]: pgmap v1848: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:48 smithi123 ceph-mon[112409]: pgmap v1848: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:51.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:50 smithi194 ceph-mon[88937]: pgmap v1849: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:50 smithi123 ceph-mon[112409]: pgmap v1849: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:53.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:52 smithi194 ceph-mon[88937]: pgmap v1850: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:52 smithi123 ceph-mon[112409]: pgmap v1850: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:55.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:54 smithi194 ceph-mon[88937]: pgmap v1851: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:54 smithi123 ceph-mon[112409]: pgmap v1851: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:56.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:09:57.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:56 smithi194 ceph-mon[88937]: pgmap v1852: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:56 smithi123 ceph-mon[112409]: pgmap v1852: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:59.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:09:58 smithi194 ceph-mon[88937]: pgmap v1853: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:09:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:09:58 smithi123 ceph-mon[112409]: pgmap v1853: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:01.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:00 smithi194 ceph-mon[88937]: pgmap v1854: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:01.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:10:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:00 smithi123 ceph-mon[112409]: pgmap v1854: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:10:03.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:02 smithi194 ceph-mon[88937]: pgmap v1855: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:02 smithi123 ceph-mon[112409]: pgmap v1855: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:05.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:04 smithi194 ceph-mon[88937]: pgmap v1856: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:04 smithi123 ceph-mon[112409]: pgmap v1856: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:07.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:06 smithi194 ceph-mon[88937]: pgmap v1857: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:06 smithi123 ceph-mon[112409]: pgmap v1857: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:09.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:08 smithi194 ceph-mon[88937]: pgmap v1858: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:08 smithi123 ceph-mon[112409]: pgmap v1858: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:11.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:10 smithi194 ceph-mon[88937]: pgmap v1859: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:11.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:10 smithi123 ceph-mon[112409]: pgmap v1859: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:13.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:12 smithi194 ceph-mon[88937]: pgmap v1860: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:12 smithi123 ceph-mon[112409]: pgmap v1860: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:15.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:14 smithi194 ceph-mon[88937]: pgmap v1861: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:14 smithi123 ceph-mon[112409]: pgmap v1861: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:17.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:16 smithi194 ceph-mon[88937]: pgmap v1862: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:16 smithi123 ceph-mon[112409]: pgmap v1862: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:19.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:18 smithi194 ceph-mon[88937]: pgmap v1863: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:19.263 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:18 smithi123 ceph-mon[112409]: pgmap v1863: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:21.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:20 smithi194 ceph-mon[88937]: pgmap v1864: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:20 smithi123 ceph-mon[112409]: pgmap v1864: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:23.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:22 smithi194 ceph-mon[88937]: pgmap v1865: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:22 smithi123 ceph-mon[112409]: pgmap v1865: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:25.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:24 smithi194 ceph-mon[88937]: pgmap v1866: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:24 smithi123 ceph-mon[112409]: pgmap v1866: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:26.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:27.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:26 smithi194 ceph-mon[88937]: pgmap v1867: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:26 smithi123 ceph-mon[112409]: pgmap v1867: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:29.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:28 smithi194 ceph-mon[88937]: pgmap v1868: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:28 smithi123 ceph-mon[112409]: pgmap v1868: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:30 smithi194 ceph-mon[88937]: pgmap v1869: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:31.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:30 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:10:31.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:30 smithi123 ceph-mon[112409]: pgmap v1869: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:30 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:10:32.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:10:32.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:10:32.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:10:32.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:10:32.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:10:32.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:10:33.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:32 smithi194 ceph-mon[88937]: pgmap v1870: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:32 smithi123 ceph-mon[112409]: pgmap v1870: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:35.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:34 smithi194 ceph-mon[88937]: pgmap v1871: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:34 smithi123 ceph-mon[112409]: pgmap v1871: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:36 smithi123 ceph-mon[112409]: pgmap v1872: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:36 smithi194 ceph-mon[88937]: pgmap v1872: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:38 smithi123 ceph-mon[112409]: pgmap v1873: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:38 smithi194 ceph-mon[88937]: pgmap v1873: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:40 smithi123 ceph-mon[112409]: pgmap v1874: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:41.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:40 smithi194 ceph-mon[88937]: pgmap v1874: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:43.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:42 smithi123 ceph-mon[112409]: pgmap v1875: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:43.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:42 smithi194 ceph-mon[88937]: pgmap v1875: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:45.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:44 smithi123 ceph-mon[112409]: pgmap v1876: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:44 smithi194 ceph-mon[88937]: pgmap v1876: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:47.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:46 smithi123 ceph-mon[112409]: pgmap v1877: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:46 smithi194 ceph-mon[88937]: pgmap v1877: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:49.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:48 smithi123 ceph-mon[112409]: pgmap v1878: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:48 smithi194 ceph-mon[88937]: pgmap v1878: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:51.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:50 smithi123 ceph-mon[112409]: pgmap v1879: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:50 smithi194 ceph-mon[88937]: pgmap v1879: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:53.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:52 smithi123 ceph-mon[112409]: pgmap v1880: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:52 smithi194 ceph-mon[88937]: pgmap v1880: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:54 smithi123 ceph-mon[112409]: pgmap v1881: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:54 smithi194 ceph-mon[88937]: pgmap v1881: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:56.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:56.296 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:10:57.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:56 smithi123 ceph-mon[112409]: pgmap v1882: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:56 smithi194 ceph-mon[88937]: pgmap v1882: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:10:58 smithi123 ceph-mon[112409]: pgmap v1883: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:10:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:10:58 smithi194 ceph-mon[88937]: pgmap v1883: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:00 smithi123 ceph-mon[112409]: pgmap v1884: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:00 smithi194 ceph-mon[88937]: pgmap v1884: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:03.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:02 smithi123 ceph-mon[112409]: pgmap v1885: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:02 smithi194 ceph-mon[88937]: pgmap v1885: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:04 smithi123 ceph-mon[112409]: pgmap v1886: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:04 smithi194 ceph-mon[88937]: pgmap v1886: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:07.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:06 smithi123 ceph-mon[112409]: pgmap v1887: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:06 smithi194 ceph-mon[88937]: pgmap v1887: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:09.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:08 smithi123 ceph-mon[112409]: pgmap v1888: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:09.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:08 smithi194 ceph-mon[88937]: pgmap v1888: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:10 smithi123 ceph-mon[112409]: pgmap v1889: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:10 smithi194 ceph-mon[88937]: pgmap v1889: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:13.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:12 smithi123 ceph-mon[112409]: pgmap v1890: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:13.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:12 smithi194 ceph-mon[88937]: pgmap v1890: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:15.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:14 smithi123 ceph-mon[112409]: pgmap v1891: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:14 smithi194 ceph-mon[88937]: pgmap v1891: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:17.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:16 smithi123 ceph-mon[112409]: pgmap v1892: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:16 smithi194 ceph-mon[88937]: pgmap v1892: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:18 smithi123 ceph-mon[112409]: pgmap v1893: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:18 smithi194 ceph-mon[88937]: pgmap v1893: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:21.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:20 smithi123 ceph-mon[112409]: pgmap v1894: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:21.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:20 smithi194 ceph-mon[88937]: pgmap v1894: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:23.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:22 smithi123 ceph-mon[112409]: pgmap v1895: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:23.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:22 smithi194 ceph-mon[88937]: pgmap v1895: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:25.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:24 smithi123 ceph-mon[112409]: pgmap v1896: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:25.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:24 smithi194 ceph-mon[88937]: pgmap v1896: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:26.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:25 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:26.297 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:25 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:27.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:26 smithi123 ceph-mon[112409]: pgmap v1897: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:26 smithi194 ceph-mon[88937]: pgmap v1897: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:29.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:28 smithi123 ceph-mon[112409]: pgmap v1898: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:28 smithi194 ceph-mon[88937]: pgmap v1898: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:31.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:30 smithi123 ceph-mon[112409]: pgmap v1899: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:31.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:30 smithi194 ceph-mon[88937]: pgmap v1899: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:32.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:31 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:11:32.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:31 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:11:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:32 smithi123 ceph-mon[112409]: pgmap v1900: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:11:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:11:33.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:32 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:11:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:32 smithi194 ceph-mon[88937]: pgmap v1900: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:11:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:11:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:32 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:11:35.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:35 smithi123 ceph-mon[112409]: pgmap v1901: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:35.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:35 smithi194 ceph-mon[88937]: pgmap v1901: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:37.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:37 smithi123 ceph-mon[112409]: pgmap v1902: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:37 smithi194 ceph-mon[88937]: pgmap v1902: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:39.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:39 smithi123 ceph-mon[112409]: pgmap v1903: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:39 smithi194 ceph-mon[88937]: pgmap v1903: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:41 smithi194 ceph-mon[88937]: pgmap v1904: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:41 smithi123 ceph-mon[112409]: pgmap v1904: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:43.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:43 smithi194 ceph-mon[88937]: pgmap v1905: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:43 smithi123 ceph-mon[112409]: pgmap v1905: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:45 smithi194 ceph-mon[88937]: pgmap v1906: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:45.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:45 smithi123 ceph-mon[112409]: pgmap v1906: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:47 smithi194 ceph-mon[88937]: pgmap v1907: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:47 smithi123 ceph-mon[112409]: pgmap v1907: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:49 smithi194 ceph-mon[88937]: pgmap v1908: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:49 smithi123 ceph-mon[112409]: pgmap v1908: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:51 smithi194 ceph-mon[88937]: pgmap v1909: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:51 smithi123 ceph-mon[112409]: pgmap v1909: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:53 smithi194 ceph-mon[88937]: pgmap v1910: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:53 smithi123 ceph-mon[112409]: pgmap v1910: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:55 smithi194 ceph-mon[88937]: pgmap v1911: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:55 smithi123 ceph-mon[112409]: pgmap v1911: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:56.297 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:11:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:57 smithi194 ceph-mon[88937]: pgmap v1912: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:57.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:57 smithi123 ceph-mon[112409]: pgmap v1912: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:11:59 smithi194 ceph-mon[88937]: pgmap v1913: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:11:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:11:59 smithi123 ceph-mon[112409]: pgmap v1913: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:01 smithi194 ceph-mon[88937]: pgmap v1914: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:01 smithi123 ceph-mon[112409]: pgmap v1914: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:03 smithi194 ceph-mon[88937]: pgmap v1915: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:03.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:03 smithi123 ceph-mon[112409]: pgmap v1915: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:05 smithi194 ceph-mon[88937]: pgmap v1916: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:05.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:05 smithi123 ceph-mon[112409]: pgmap v1916: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:07 smithi194 ceph-mon[88937]: pgmap v1917: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:07 smithi123 ceph-mon[112409]: pgmap v1917: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:09.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:09 smithi194 ceph-mon[88937]: pgmap v1918: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:09 smithi123 ceph-mon[112409]: pgmap v1918: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:11 smithi194 ceph-mon[88937]: pgmap v1919: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:11.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:11 smithi123 ceph-mon[112409]: pgmap v1919: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:13.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:13 smithi194 ceph-mon[88937]: pgmap v1920: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:13 smithi123 ceph-mon[112409]: pgmap v1920: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:15 smithi194 ceph-mon[88937]: pgmap v1921: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:15 smithi123 ceph-mon[112409]: pgmap v1921: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:17 smithi194 ceph-mon[88937]: pgmap v1922: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:17 smithi123 ceph-mon[112409]: pgmap v1922: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:19 smithi194 ceph-mon[88937]: pgmap v1923: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:19 smithi123 ceph-mon[112409]: pgmap v1923: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:21.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:21 smithi194 ceph-mon[88937]: pgmap v1924: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:21.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:21 smithi123 ceph-mon[112409]: pgmap v1924: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:23.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:23 smithi194 ceph-mon[88937]: pgmap v1925: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:23 smithi123 ceph-mon[112409]: pgmap v1925: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:25.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:25 smithi194 ceph-mon[88937]: pgmap v1926: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:25 smithi123 ceph-mon[112409]: pgmap v1926: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:26.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:26.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:27 smithi194 ceph-mon[88937]: pgmap v1927: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:27 smithi123 ceph-mon[112409]: pgmap v1927: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:29 smithi194 ceph-mon[88937]: pgmap v1928: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:29 smithi123 ceph-mon[112409]: pgmap v1928: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:31.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:31 smithi194 ceph-mon[88937]: pgmap v1929: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:31 smithi123 ceph-mon[112409]: pgmap v1929: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:33 smithi194 ceph-mon[88937]: pgmap v1930: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:12:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:12:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:12:33.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:12:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:33 smithi123 ceph-mon[112409]: pgmap v1930: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:12:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:12:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:12:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:12:35.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:35 smithi194 ceph-mon[88937]: pgmap v1931: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:35.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:35 smithi123 ceph-mon[112409]: pgmap v1931: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:37 smithi194 ceph-mon[88937]: pgmap v1932: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:37 smithi123 ceph-mon[112409]: pgmap v1932: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:39 smithi194 ceph-mon[88937]: pgmap v1933: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:39 smithi123 ceph-mon[112409]: pgmap v1933: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:41 smithi194 ceph-mon[88937]: pgmap v1934: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:41.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:41.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:41 smithi123 ceph-mon[112409]: pgmap v1934: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:43.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:43 smithi194 ceph-mon[88937]: pgmap v1935: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:43 smithi123 ceph-mon[112409]: pgmap v1935: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:45 smithi194 ceph-mon[88937]: pgmap v1936: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:45 smithi123 ceph-mon[112409]: pgmap v1936: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:47 smithi194 ceph-mon[88937]: pgmap v1937: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:47.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:47 smithi123 ceph-mon[112409]: pgmap v1937: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:49 smithi194 ceph-mon[88937]: pgmap v1938: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:49 smithi123 ceph-mon[112409]: pgmap v1938: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:51 smithi194 ceph-mon[88937]: pgmap v1939: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:51.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:51 smithi123 ceph-mon[112409]: pgmap v1939: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:53 smithi194 ceph-mon[88937]: pgmap v1940: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:53 smithi123 ceph-mon[112409]: pgmap v1940: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:55 smithi194 ceph-mon[88937]: pgmap v1941: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:55 smithi123 ceph-mon[112409]: pgmap v1941: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:56.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:12:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:57 smithi194 ceph-mon[88937]: pgmap v1942: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:57 smithi123 ceph-mon[112409]: pgmap v1942: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:12:59 smithi194 ceph-mon[88937]: pgmap v1943: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:12:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:12:59 smithi123 ceph-mon[112409]: pgmap v1943: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:01 smithi123 ceph-mon[112409]: pgmap v1944: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:01 smithi194 ceph-mon[88937]: pgmap v1944: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:03 smithi123 ceph-mon[112409]: pgmap v1945: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:03 smithi194 ceph-mon[88937]: pgmap v1945: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:05.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:05 smithi123 ceph-mon[112409]: pgmap v1946: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:05 smithi194 ceph-mon[88937]: pgmap v1946: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:07 smithi123 ceph-mon[112409]: pgmap v1947: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:07 smithi194 ceph-mon[88937]: pgmap v1947: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:09 smithi123 ceph-mon[112409]: pgmap v1948: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:09 smithi194 ceph-mon[88937]: pgmap v1948: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:11 smithi123 ceph-mon[112409]: pgmap v1949: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:11 smithi194 ceph-mon[88937]: pgmap v1949: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:13.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:13 smithi123 ceph-mon[112409]: pgmap v1950: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:13 smithi194 ceph-mon[88937]: pgmap v1950: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:15 smithi123 ceph-mon[112409]: pgmap v1951: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:15 smithi194 ceph-mon[88937]: pgmap v1951: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:17 smithi123 ceph-mon[112409]: pgmap v1952: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:17 smithi194 ceph-mon[88937]: pgmap v1952: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:19.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:19 smithi123 ceph-mon[112409]: pgmap v1953: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:19 smithi194 ceph-mon[88937]: pgmap v1953: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:21.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:21 smithi123 ceph-mon[112409]: pgmap v1954: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:21 smithi194 ceph-mon[88937]: pgmap v1954: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:23 smithi123 ceph-mon[112409]: pgmap v1955: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:23 smithi194 ceph-mon[88937]: pgmap v1955: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:25 smithi123 ceph-mon[112409]: pgmap v1956: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:25 smithi194 ceph-mon[88937]: pgmap v1956: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:26.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:27 smithi123 ceph-mon[112409]: pgmap v1957: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:27 smithi194 ceph-mon[88937]: pgmap v1957: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:29.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:29 smithi123 ceph-mon[112409]: pgmap v1958: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:29 smithi194 ceph-mon[88937]: pgmap v1958: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:31 smithi123 ceph-mon[112409]: pgmap v1959: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:31 smithi194 ceph-mon[88937]: pgmap v1959: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:33.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:33 smithi123 ceph-mon[112409]: pgmap v1960: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:33 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:13:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:33 smithi194 ceph-mon[88937]: pgmap v1960: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:33 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:13:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:13:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:13:34.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:13:34.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:13:34.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:13:34.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:13:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:35 smithi123 ceph-mon[112409]: pgmap v1961: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:35 smithi194 ceph-mon[88937]: pgmap v1961: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:37 smithi123 ceph-mon[112409]: pgmap v1962: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:37 smithi194 ceph-mon[88937]: pgmap v1962: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:39.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:39 smithi123 ceph-mon[112409]: pgmap v1963: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:39.647 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:39 smithi194 ceph-mon[88937]: pgmap v1963: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:41 smithi123 ceph-mon[112409]: pgmap v1964: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:41 smithi194 ceph-mon[88937]: pgmap v1964: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:41.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:43 smithi123 ceph-mon[112409]: pgmap v1965: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:43 smithi194 ceph-mon[88937]: pgmap v1965: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:45.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:45 smithi123 ceph-mon[112409]: pgmap v1966: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:45 smithi194 ceph-mon[88937]: pgmap v1966: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:47.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:47 smithi123 ceph-mon[112409]: pgmap v1967: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:47 smithi194 ceph-mon[88937]: pgmap v1967: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:49 smithi123 ceph-mon[112409]: pgmap v1968: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:49 smithi194 ceph-mon[88937]: pgmap v1968: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:51 smithi123 ceph-mon[112409]: pgmap v1969: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:51 smithi194 ceph-mon[88937]: pgmap v1969: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:53 smithi123 ceph-mon[112409]: pgmap v1970: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:53 smithi194 ceph-mon[88937]: pgmap v1970: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:55 smithi123 ceph-mon[112409]: pgmap v1971: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:55 smithi194 ceph-mon[88937]: pgmap v1971: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:56.545 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:13:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:57 smithi123 ceph-mon[112409]: pgmap v1972: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:57 smithi194 ceph-mon[88937]: pgmap v1972: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:13:59 smithi123 ceph-mon[112409]: pgmap v1973: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:13:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:13:59 smithi194 ceph-mon[88937]: pgmap v1973: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:01 smithi123 ceph-mon[112409]: pgmap v1974: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:01 smithi194 ceph-mon[88937]: pgmap v1974: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:03.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:03 smithi123 ceph-mon[112409]: pgmap v1975: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:03 smithi194 ceph-mon[88937]: pgmap v1975: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:05.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:05 smithi123 ceph-mon[112409]: pgmap v1976: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:05 smithi194 ceph-mon[88937]: pgmap v1976: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:07 smithi123 ceph-mon[112409]: pgmap v1977: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:07 smithi194 ceph-mon[88937]: pgmap v1977: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:09 smithi123 ceph-mon[112409]: pgmap v1978: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:09 smithi194 ceph-mon[88937]: pgmap v1978: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:11 smithi123 ceph-mon[112409]: pgmap v1979: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:11 smithi194 ceph-mon[88937]: pgmap v1979: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:13 smithi194 ceph-mon[88937]: pgmap v1980: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:13 smithi123 ceph-mon[112409]: pgmap v1980: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:15 smithi194 ceph-mon[88937]: pgmap v1981: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:15 smithi123 ceph-mon[112409]: pgmap v1981: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:17.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:17 smithi194 ceph-mon[88937]: pgmap v1982: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:17.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:17 smithi123 ceph-mon[112409]: pgmap v1982: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:19 smithi194 ceph-mon[88937]: pgmap v1983: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:19 smithi123 ceph-mon[112409]: pgmap v1983: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:21 smithi194 ceph-mon[88937]: pgmap v1984: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:21 smithi123 ceph-mon[112409]: pgmap v1984: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:23 smithi194 ceph-mon[88937]: pgmap v1985: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:23.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:23 smithi123 ceph-mon[112409]: pgmap v1985: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:25 smithi194 ceph-mon[88937]: pgmap v1986: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:25.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:25 smithi123 ceph-mon[112409]: pgmap v1986: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:26.547 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:26.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:27 smithi194 ceph-mon[88937]: pgmap v1987: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:27.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:27 smithi123 ceph-mon[112409]: pgmap v1987: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:29 smithi194 ceph-mon[88937]: pgmap v1988: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:29.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:29 smithi123 ceph-mon[112409]: pgmap v1988: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:31 smithi194 ceph-mon[88937]: pgmap v1989: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:31 smithi123 ceph-mon[112409]: pgmap v1989: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:33 smithi194 ceph-mon[88937]: pgmap v1990: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:33.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:33 smithi123 ceph-mon[112409]: pgmap v1990: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:34.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:34 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:14:34.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:34 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:14:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:35 smithi194 ceph-mon[88937]: pgmap v1991: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:14:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:14:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:14:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:35 smithi123 ceph-mon[112409]: pgmap v1991: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:14:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:14:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:14:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:37 smithi194 ceph-mon[88937]: pgmap v1992: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:37.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:37 smithi123 ceph-mon[112409]: pgmap v1992: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:39 smithi194 ceph-mon[88937]: pgmap v1993: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:39 smithi123 ceph-mon[112409]: pgmap v1993: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:41 smithi194 ceph-mon[88937]: pgmap v1994: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:41.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:41 smithi123 ceph-mon[112409]: pgmap v1994: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:41.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:43 smithi194 ceph-mon[88937]: pgmap v1995: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:43.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:43 smithi123 ceph-mon[112409]: pgmap v1995: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:45 smithi194 ceph-mon[88937]: pgmap v1996: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:45.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:45 smithi123 ceph-mon[112409]: pgmap v1996: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:47 smithi194 ceph-mon[88937]: pgmap v1997: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:47 smithi123 ceph-mon[112409]: pgmap v1997: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:49 smithi194 ceph-mon[88937]: pgmap v1998: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:49 smithi123 ceph-mon[112409]: pgmap v1998: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:51 smithi194 ceph-mon[88937]: pgmap v1999: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:51.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:51 smithi123 ceph-mon[112409]: pgmap v1999: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:53.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:53 smithi194 ceph-mon[88937]: pgmap v2000: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:53 smithi123 ceph-mon[112409]: pgmap v2000: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:55 smithi194 ceph-mon[88937]: pgmap v2001: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:55 smithi123 ceph-mon[112409]: pgmap v2001: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:56.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:14:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:57 smithi194 ceph-mon[88937]: pgmap v2002: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:57.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:57 smithi123 ceph-mon[112409]: pgmap v2002: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:14:59 smithi194 ceph-mon[88937]: pgmap v2003: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:14:59.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:14:59 smithi123 ceph-mon[112409]: pgmap v2003: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:01 smithi194 ceph-mon[88937]: pgmap v2004: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:01.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:01 smithi123 ceph-mon[112409]: pgmap v2004: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:03 smithi194 ceph-mon[88937]: pgmap v2005: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:03.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:03 smithi123 ceph-mon[112409]: pgmap v2005: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:05 smithi194 ceph-mon[88937]: pgmap v2006: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:05.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:05 smithi123 ceph-mon[112409]: pgmap v2006: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:07 smithi194 ceph-mon[88937]: pgmap v2007: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:07.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:07 smithi123 ceph-mon[112409]: pgmap v2007: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:09 smithi194 ceph-mon[88937]: pgmap v2008: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:09.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:09 smithi123 ceph-mon[112409]: pgmap v2008: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:11 smithi194 ceph-mon[88937]: pgmap v2009: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:11 smithi123 ceph-mon[112409]: pgmap v2009: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:13 smithi194 ceph-mon[88937]: pgmap v2010: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:13 smithi123 ceph-mon[112409]: pgmap v2010: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:15 smithi194 ceph-mon[88937]: pgmap v2011: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:15 smithi123 ceph-mon[112409]: pgmap v2011: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:17 smithi194 ceph-mon[88937]: pgmap v2012: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:17.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:17 smithi123 ceph-mon[112409]: pgmap v2012: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:19 smithi194 ceph-mon[88937]: pgmap v2013: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:19.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:19 smithi123 ceph-mon[112409]: pgmap v2013: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:21 smithi194 ceph-mon[88937]: pgmap v2014: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:21 smithi123 ceph-mon[112409]: pgmap v2014: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:23 smithi194 ceph-mon[88937]: pgmap v2015: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:23 smithi123 ceph-mon[112409]: pgmap v2015: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:25 smithi194 ceph-mon[88937]: pgmap v2016: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:25.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:25 smithi123 ceph-mon[112409]: pgmap v2016: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:26.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:27.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:27 smithi123 ceph-mon[112409]: pgmap v2017: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:27.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:27 smithi194 ceph-mon[88937]: pgmap v2017: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:29.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:29 smithi123 ceph-mon[112409]: pgmap v2018: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:29.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:29 smithi194 ceph-mon[88937]: pgmap v2018: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:31 smithi123 ceph-mon[112409]: pgmap v2019: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:31.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:31 smithi194 ceph-mon[88937]: pgmap v2019: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:33.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:33 smithi123 ceph-mon[112409]: pgmap v2020: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:33.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:33 smithi194 ceph-mon[88937]: pgmap v2020: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:35.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:35 smithi123 ceph-mon[112409]: pgmap v2021: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:35 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:15:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:35 smithi194 ceph-mon[88937]: pgmap v2021: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:35 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:15:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:36 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:37.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:36 smithi123 ceph-mon[112409]: pgmap v2022: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:36 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:37.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:36 smithi194 ceph-mon[88937]: pgmap v2022: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:39.179 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:38 smithi123 ceph-mon[112409]: pgmap v2023: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:38 smithi194 ceph-mon[88937]: pgmap v2023: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:40.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:40.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:40.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:15:40.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:15:40.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:40.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:40.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:40.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:15:40.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:15:40.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:15:41.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:41 smithi123 ceph-mon[112409]: pgmap v2024: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:41 smithi194 ceph-mon[88937]: pgmap v2024: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:43 smithi123 ceph-mon[112409]: pgmap v2025: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:43 smithi194 ceph-mon[88937]: pgmap v2025: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:45.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:45 smithi123 ceph-mon[112409]: pgmap v2026: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:45 smithi194 ceph-mon[88937]: pgmap v2026: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:47 smithi194 ceph-mon[88937]: pgmap v2027: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:47.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:47 smithi123 ceph-mon[112409]: pgmap v2027: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:49 smithi194 ceph-mon[88937]: pgmap v2028: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:49.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:49 smithi123 ceph-mon[112409]: pgmap v2028: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:51 smithi194 ceph-mon[88937]: pgmap v2029: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:51.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:51 smithi123 ceph-mon[112409]: pgmap v2029: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:53 smithi194 ceph-mon[88937]: pgmap v2030: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:53.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:53 smithi123 ceph-mon[112409]: pgmap v2030: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:55 smithi194 ceph-mon[88937]: pgmap v2031: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:55.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:55 smithi123 ceph-mon[112409]: pgmap v2031: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:56.547 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:56.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:15:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:57 smithi194 ceph-mon[88937]: pgmap v2032: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:57.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:57 smithi123 ceph-mon[112409]: pgmap v2032: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:59.648 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:15:59 smithi194 ceph-mon[88937]: pgmap v2033: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:15:59.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:15:59 smithi123 ceph-mon[112409]: pgmap v2033: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:01 smithi194 ceph-mon[88937]: pgmap v2034: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:01.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:01 smithi123 ceph-mon[112409]: pgmap v2034: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:03 smithi194 ceph-mon[88937]: pgmap v2035: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:03 smithi123 ceph-mon[112409]: pgmap v2035: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:05 smithi194 ceph-mon[88937]: pgmap v2036: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:05.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:05 smithi123 ceph-mon[112409]: pgmap v2036: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:07 smithi194 ceph-mon[88937]: pgmap v2037: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:07.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:07 smithi123 ceph-mon[112409]: pgmap v2037: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:09 smithi194 ceph-mon[88937]: pgmap v2038: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:09.697 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:09 smithi123 ceph-mon[112409]: pgmap v2038: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:11 smithi194 ceph-mon[88937]: pgmap v2039: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:11 smithi123 ceph-mon[112409]: pgmap v2039: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:13 smithi194 ceph-mon[88937]: pgmap v2040: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:13.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:13 smithi123 ceph-mon[112409]: pgmap v2040: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:15 smithi194 ceph-mon[88937]: pgmap v2041: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:15 smithi123 ceph-mon[112409]: pgmap v2041: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:17 smithi194 ceph-mon[88937]: pgmap v2042: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:17.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:17 smithi123 ceph-mon[112409]: pgmap v2042: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:19.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:19 smithi123 ceph-mon[112409]: pgmap v2043: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:19 smithi194 ceph-mon[88937]: pgmap v2043: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:21 smithi194 ceph-mon[88937]: pgmap v2044: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:21.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:21 smithi123 ceph-mon[112409]: pgmap v2044: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:23 smithi194 ceph-mon[88937]: pgmap v2045: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:23 smithi123 ceph-mon[112409]: pgmap v2045: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:25 smithi194 ceph-mon[88937]: pgmap v2046: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:25.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:25 smithi123 ceph-mon[112409]: pgmap v2046: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:26.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:27 smithi194 ceph-mon[88937]: pgmap v2047: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:27.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:27 smithi123 ceph-mon[112409]: pgmap v2047: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:29 smithi194 ceph-mon[88937]: pgmap v2048: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:29.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:29 smithi123 ceph-mon[112409]: pgmap v2048: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:31 smithi194 ceph-mon[88937]: pgmap v2049: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:31 smithi123 ceph-mon[112409]: pgmap v2049: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:33 smithi194 ceph-mon[88937]: pgmap v2050: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:33.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:33 smithi123 ceph-mon[112409]: pgmap v2050: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:35 smithi194 ceph-mon[88937]: pgmap v2051: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:35.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:35 smithi123 ceph-mon[112409]: pgmap v2051: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:37 smithi194 ceph-mon[88937]: pgmap v2052: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:37.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:37 smithi123 ceph-mon[112409]: pgmap v2052: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:39 smithi194 ceph-mon[88937]: pgmap v2053: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:39 smithi123 ceph-mon[112409]: pgmap v2053: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:40.419 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:40 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:16:40.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:40 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:16:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:41 smithi194 ceph-mon[88937]: pgmap v2054: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:41.733 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:41 smithi123 ceph-mon[112409]: pgmap v2054: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:41.734 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:42 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:42.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:42 smithi194 ceph-mon[88937]: pgmap v2055: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:42.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:42.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:42 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:42.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:42 smithi123 ceph-mon[112409]: pgmap v2055: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:43.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:43.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:43 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:44.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:43 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:44 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:44 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:44.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:44 smithi194 ceph-mon[88937]: pgmap v2056: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:44 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:44 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:45.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:44 smithi123 ceph-mon[112409]: pgmap v2056: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: pgmap v2057: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:16:47.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: pgmap v2057: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:16:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:16:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:49 smithi194 ceph-mon[88937]: pgmap v2058: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:49.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:49 smithi123 ceph-mon[112409]: pgmap v2058: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:51 smithi123 ceph-mon[112409]: pgmap v2059: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:51 smithi194 ceph-mon[88937]: pgmap v2059: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:53 smithi123 ceph-mon[112409]: pgmap v2060: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:53 smithi194 ceph-mon[88937]: pgmap v2060: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:55 smithi123 ceph-mon[112409]: pgmap v2061: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:55 smithi194 ceph-mon[88937]: pgmap v2061: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:56.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:16:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:57 smithi194 ceph-mon[88937]: pgmap v2062: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:57.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:57 smithi123 ceph-mon[112409]: pgmap v2062: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:59.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:16:59 smithi123 ceph-mon[112409]: pgmap v2063: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:16:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:16:59 smithi194 ceph-mon[88937]: pgmap v2063: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:01 smithi123 ceph-mon[112409]: pgmap v2064: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:01 smithi194 ceph-mon[88937]: pgmap v2064: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:03 smithi123 ceph-mon[112409]: pgmap v2065: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:03 smithi194 ceph-mon[88937]: pgmap v2065: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:05.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:05 smithi123 ceph-mon[112409]: pgmap v2066: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:05 smithi194 ceph-mon[88937]: pgmap v2066: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:07.454 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:07 smithi194 ceph-mon[88937]: pgmap v2067: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:07.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:07 smithi123 ceph-mon[112409]: pgmap v2067: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:09 smithi123 ceph-mon[112409]: pgmap v2068: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:09 smithi194 ceph-mon[88937]: pgmap v2068: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:11 smithi123 ceph-mon[112409]: pgmap v2069: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:11 smithi194 ceph-mon[88937]: pgmap v2069: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:13 smithi123 ceph-mon[112409]: pgmap v2070: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:13 smithi194 ceph-mon[88937]: pgmap v2070: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:15.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:15 smithi123 ceph-mon[112409]: pgmap v2071: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:15 smithi194 ceph-mon[88937]: pgmap v2071: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:17.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:17 smithi123 ceph-mon[112409]: pgmap v2072: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:17 smithi194 ceph-mon[88937]: pgmap v2072: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:19.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:19 smithi123 ceph-mon[112409]: pgmap v2073: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:19 smithi194 ceph-mon[88937]: pgmap v2073: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:21.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:21 smithi123 ceph-mon[112409]: pgmap v2074: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:21 smithi194 ceph-mon[88937]: pgmap v2074: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:23.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:23 smithi123 ceph-mon[112409]: pgmap v2075: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:23 smithi194 ceph-mon[88937]: pgmap v2075: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:25.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:25 smithi123 ceph-mon[112409]: pgmap v2076: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:25 smithi194 ceph-mon[88937]: pgmap v2076: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:26.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:26.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:27 smithi123 ceph-mon[112409]: pgmap v2077: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:27 smithi194 ceph-mon[88937]: pgmap v2077: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:29 smithi123 ceph-mon[112409]: pgmap v2078: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:29 smithi194 ceph-mon[88937]: pgmap v2078: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:31 smithi123 ceph-mon[112409]: pgmap v2079: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:31 smithi194 ceph-mon[88937]: pgmap v2079: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:33 smithi123 ceph-mon[112409]: pgmap v2080: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:33 smithi194 ceph-mon[88937]: pgmap v2080: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:35 smithi123 ceph-mon[112409]: pgmap v2081: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:35 smithi194 ceph-mon[88937]: pgmap v2081: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:37 smithi123 ceph-mon[112409]: pgmap v2082: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:37 smithi194 ceph-mon[88937]: pgmap v2082: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:39 smithi123 ceph-mon[112409]: pgmap v2083: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:39 smithi194 ceph-mon[88937]: pgmap v2083: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:41 smithi123 ceph-mon[112409]: pgmap v2084: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:41 smithi194 ceph-mon[88937]: pgmap v2084: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:43.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:43 smithi123 ceph-mon[112409]: pgmap v2085: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:43 smithi194 ceph-mon[88937]: pgmap v2085: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:45.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:45 smithi123 ceph-mon[112409]: pgmap v2086: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:45 smithi194 ceph-mon[88937]: pgmap v2086: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:47.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:47 smithi123 ceph-mon[112409]: pgmap v2087: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:17:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:47 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:47 smithi194 ceph-mon[88937]: pgmap v2087: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:17:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:47 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:48.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:17:48.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:17:48.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:17:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:17:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:17:49.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:49 smithi123 ceph-mon[112409]: pgmap v2088: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:49 smithi194 ceph-mon[88937]: pgmap v2088: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:51 smithi123 ceph-mon[112409]: pgmap v2089: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:51 smithi194 ceph-mon[88937]: pgmap v2089: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:53 smithi123 ceph-mon[112409]: pgmap v2090: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:53 smithi194 ceph-mon[88937]: pgmap v2090: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:55 smithi123 ceph-mon[112409]: pgmap v2091: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:55 smithi194 ceph-mon[88937]: pgmap v2091: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:56.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:56.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:17:57.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:57 smithi123 ceph-mon[112409]: pgmap v2092: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:57 smithi194 ceph-mon[88937]: pgmap v2092: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:17:59 smithi123 ceph-mon[112409]: pgmap v2093: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:17:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:17:59 smithi194 ceph-mon[88937]: pgmap v2093: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:01.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:01 smithi123 ceph-mon[112409]: pgmap v2094: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:01 smithi194 ceph-mon[88937]: pgmap v2094: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:03 smithi194 ceph-mon[88937]: pgmap v2095: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:03 smithi123 ceph-mon[112409]: pgmap v2095: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:05 smithi194 ceph-mon[88937]: pgmap v2096: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:05.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:05 smithi123 ceph-mon[112409]: pgmap v2096: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:07 smithi194 ceph-mon[88937]: pgmap v2097: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:07.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:07 smithi123 ceph-mon[112409]: pgmap v2097: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:09 smithi194 ceph-mon[88937]: pgmap v2098: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:09.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:09 smithi123 ceph-mon[112409]: pgmap v2098: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:11 smithi194 ceph-mon[88937]: pgmap v2099: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:11 smithi123 ceph-mon[112409]: pgmap v2099: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:13 smithi194 ceph-mon[88937]: pgmap v2100: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:13.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:13 smithi123 ceph-mon[112409]: pgmap v2100: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:15 smithi194 ceph-mon[88937]: pgmap v2101: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:15.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:15 smithi123 ceph-mon[112409]: pgmap v2101: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:17 smithi194 ceph-mon[88937]: pgmap v2102: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:17.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:17 smithi123 ceph-mon[112409]: pgmap v2102: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:19 smithi194 ceph-mon[88937]: pgmap v2103: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:19 smithi123 ceph-mon[112409]: pgmap v2103: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:21 smithi194 ceph-mon[88937]: pgmap v2104: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:21.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:21 smithi123 ceph-mon[112409]: pgmap v2104: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:23.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:23 smithi194 ceph-mon[88937]: pgmap v2105: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:23 smithi123 ceph-mon[112409]: pgmap v2105: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:25.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:25 smithi194 ceph-mon[88937]: pgmap v2106: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:25.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:25 smithi123 ceph-mon[112409]: pgmap v2106: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:26.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:27.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:27 smithi194 ceph-mon[88937]: pgmap v2107: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:27.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:27 smithi123 ceph-mon[112409]: pgmap v2107: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:29.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:29 smithi194 ceph-mon[88937]: pgmap v2108: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:29.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:29 smithi123 ceph-mon[112409]: pgmap v2108: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:31 smithi194 ceph-mon[88937]: pgmap v2109: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:31.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:31 smithi123 ceph-mon[112409]: pgmap v2109: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:33 smithi194 ceph-mon[88937]: pgmap v2110: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:33.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:33 smithi123 ceph-mon[112409]: pgmap v2110: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:35 smithi194 ceph-mon[88937]: pgmap v2111: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:35 smithi123 ceph-mon[112409]: pgmap v2111: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:37 smithi194 ceph-mon[88937]: pgmap v2112: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:37.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:37 smithi123 ceph-mon[112409]: pgmap v2112: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:39 smithi194 ceph-mon[88937]: pgmap v2113: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:39.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:39 smithi123 ceph-mon[112409]: pgmap v2113: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:41 smithi194 ceph-mon[88937]: pgmap v2114: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:41.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:41 smithi123 ceph-mon[112409]: pgmap v2114: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:43 smithi194 ceph-mon[88937]: pgmap v2115: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:43.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:43 smithi123 ceph-mon[112409]: pgmap v2115: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:45 smithi194 ceph-mon[88937]: pgmap v2116: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:45.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:45 smithi123 ceph-mon[112409]: pgmap v2116: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:47 smithi194 ceph-mon[88937]: pgmap v2117: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:47.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:47 smithi123 ceph-mon[112409]: pgmap v2117: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:18:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:18:48.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:18:48.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:18:48.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:18:48.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:18:48.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:18:48.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:18:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:49 smithi194 ceph-mon[88937]: pgmap v2118: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:49.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:49 smithi123 ceph-mon[112409]: pgmap v2118: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:51 smithi194 ceph-mon[88937]: pgmap v2119: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:51.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:51 smithi123 ceph-mon[112409]: pgmap v2119: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:53.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:53 smithi194 ceph-mon[88937]: pgmap v2120: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:53.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:53 smithi123 ceph-mon[112409]: pgmap v2120: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:55 smithi194 ceph-mon[88937]: pgmap v2121: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:55.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:55 smithi123 ceph-mon[112409]: pgmap v2121: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:56.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:56.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:18:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:57 smithi194 ceph-mon[88937]: pgmap v2122: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:57.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:57 smithi123 ceph-mon[112409]: pgmap v2122: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:18:59 smithi194 ceph-mon[88937]: pgmap v2123: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:18:59.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:18:59 smithi123 ceph-mon[112409]: pgmap v2123: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:01 smithi194 ceph-mon[88937]: pgmap v2124: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:01.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:01 smithi123 ceph-mon[112409]: pgmap v2124: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:03 smithi194 ceph-mon[88937]: pgmap v2125: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:03.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:03 smithi123 ceph-mon[112409]: pgmap v2125: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:05 smithi194 ceph-mon[88937]: pgmap v2126: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:05.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:05 smithi123 ceph-mon[112409]: pgmap v2126: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:07.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:07 smithi194 ceph-mon[88937]: pgmap v2127: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:07.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:07 smithi123 ceph-mon[112409]: pgmap v2127: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:09.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:09 smithi194 ceph-mon[88937]: pgmap v2128: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:09.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:09 smithi123 ceph-mon[112409]: pgmap v2128: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:11 smithi194 ceph-mon[88937]: pgmap v2129: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:11.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:11.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:11 smithi123 ceph-mon[112409]: pgmap v2129: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:11.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:13.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:13 smithi194 ceph-mon[88937]: pgmap v2130: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:13.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:13 smithi123 ceph-mon[112409]: pgmap v2130: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:15.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:15 smithi194 ceph-mon[88937]: pgmap v2131: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:15.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:15 smithi123 ceph-mon[112409]: pgmap v2131: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:17.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:17 smithi194 ceph-mon[88937]: pgmap v2132: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:17.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:17 smithi123 ceph-mon[112409]: pgmap v2132: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:19.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:19 smithi194 ceph-mon[88937]: pgmap v2133: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:19.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:19 smithi123 ceph-mon[112409]: pgmap v2133: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:21.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:21 smithi194 ceph-mon[88937]: pgmap v2134: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:21.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:21 smithi123 ceph-mon[112409]: pgmap v2134: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:23.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:23 smithi123 ceph-mon[112409]: pgmap v2135: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:23.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:23 smithi194 ceph-mon[88937]: pgmap v2135: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:25.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:25 smithi123 ceph-mon[112409]: pgmap v2136: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:25.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:25 smithi194 ceph-mon[88937]: pgmap v2136: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:26.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:26.796 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:27.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:27 smithi123 ceph-mon[112409]: pgmap v2137: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:27.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:27 smithi194 ceph-mon[88937]: pgmap v2137: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:29.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:29 smithi123 ceph-mon[112409]: pgmap v2138: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:29.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:29 smithi194 ceph-mon[88937]: pgmap v2138: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:31.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:31 smithi123 ceph-mon[112409]: pgmap v2139: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:31.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:31 smithi194 ceph-mon[88937]: pgmap v2139: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:33.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:33 smithi123 ceph-mon[112409]: pgmap v2140: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:33.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:33 smithi194 ceph-mon[88937]: pgmap v2140: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:35.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:35 smithi123 ceph-mon[112409]: pgmap v2141: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:35.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:35 smithi194 ceph-mon[88937]: pgmap v2141: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:37.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:37 smithi123 ceph-mon[112409]: pgmap v2142: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:37.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:37 smithi194 ceph-mon[88937]: pgmap v2142: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:39.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:39 smithi123 ceph-mon[112409]: pgmap v2143: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:39.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:39 smithi194 ceph-mon[88937]: pgmap v2143: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:41 smithi123 ceph-mon[112409]: pgmap v2144: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:41.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:41.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:41 smithi194 ceph-mon[88937]: pgmap v2144: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:41.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:43.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:43 smithi123 ceph-mon[112409]: pgmap v2145: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:43.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:43 smithi194 ceph-mon[88937]: pgmap v2145: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:45.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:45 smithi123 ceph-mon[112409]: pgmap v2146: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:45.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:45 smithi194 ceph-mon[88937]: pgmap v2146: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:47.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:47 smithi123 ceph-mon[112409]: pgmap v2147: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:47.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:47 smithi194 ceph-mon[88937]: pgmap v2147: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:48.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:48 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:19:48.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:48 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:19:49.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:49 smithi123 ceph-mon[112409]: pgmap v2148: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:49.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:49.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:49 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:49 smithi194 ceph-mon[88937]: pgmap v2148: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:49.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:49 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:19:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:19:50.760 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:19:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:19:50.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:19:51.759 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:51 smithi123 ceph-mon[112409]: pgmap v2149: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:51.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:51 smithi194 ceph-mon[88937]: pgmap v2149: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:52.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:52 smithi194 ceph-mon[88937]: pgmap v2150: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:53.009 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:52 smithi123 ceph-mon[112409]: pgmap v2150: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:55.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:54 smithi123 ceph-mon[112409]: pgmap v2151: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:54 smithi194 ceph-mon[88937]: pgmap v2151: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:56.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:55 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:56.297 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:55 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:19:57.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:56 smithi123 ceph-mon[112409]: pgmap v2152: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:56 smithi194 ceph-mon[88937]: pgmap v2152: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:59.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:19:58 smithi123 ceph-mon[112409]: pgmap v2153: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:19:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:19:58 smithi194 ceph-mon[88937]: pgmap v2153: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:00 smithi123 ceph-mon[112409]: pgmap v2154: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:01.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:00 smithi123 ceph-mon[112409]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:20:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:00 smithi194 ceph-mon[88937]: pgmap v2154: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:00 smithi194 ceph-mon[88937]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-20T09:20:03.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:02 smithi123 ceph-mon[112409]: pgmap v2155: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:02 smithi194 ceph-mon[88937]: pgmap v2155: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:05.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:04 smithi123 ceph-mon[112409]: pgmap v2156: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:04 smithi194 ceph-mon[88937]: pgmap v2156: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:07.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:06 smithi123 ceph-mon[112409]: pgmap v2157: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:06 smithi194 ceph-mon[88937]: pgmap v2157: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:09.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:08 smithi123 ceph-mon[112409]: pgmap v2158: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:09.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:08 smithi194 ceph-mon[88937]: pgmap v2158: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:10 smithi123 ceph-mon[112409]: pgmap v2159: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:11.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:10 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:10 smithi194 ceph-mon[88937]: pgmap v2159: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:10 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:13.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:12 smithi123 ceph-mon[112409]: pgmap v2160: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:13.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:12 smithi194 ceph-mon[88937]: pgmap v2160: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:15.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:14 smithi123 ceph-mon[112409]: pgmap v2161: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:14 smithi194 ceph-mon[88937]: pgmap v2161: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:17.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:17 smithi123 ceph-mon[112409]: pgmap v2162: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:17 smithi194 ceph-mon[88937]: pgmap v2162: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:19.260 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:19 smithi123 ceph-mon[112409]: pgmap v2163: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:19 smithi194 ceph-mon[88937]: pgmap v2163: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:21.259 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:21 smithi123 ceph-mon[112409]: pgmap v2164: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:21.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:21 smithi194 ceph-mon[88937]: pgmap v2164: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:23.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:23 smithi194 ceph-mon[88937]: pgmap v2165: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:23.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:23 smithi123 ceph-mon[112409]: pgmap v2165: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:25.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:25 smithi194 ceph-mon[88937]: pgmap v2166: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:25 smithi123 ceph-mon[112409]: pgmap v2166: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:26.296 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:26.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:27 smithi194 ceph-mon[88937]: pgmap v2167: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:27.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:27 smithi123 ceph-mon[112409]: pgmap v2167: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:29 smithi194 ceph-mon[88937]: pgmap v2168: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:29 smithi123 ceph-mon[112409]: pgmap v2168: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:31.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:31 smithi194 ceph-mon[88937]: pgmap v2169: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:31.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:31 smithi123 ceph-mon[112409]: pgmap v2169: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:33.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:33 smithi194 ceph-mon[88937]: pgmap v2170: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:33 smithi123 ceph-mon[112409]: pgmap v2170: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:35.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:35 smithi194 ceph-mon[88937]: pgmap v2171: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:35.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:35 smithi123 ceph-mon[112409]: pgmap v2171: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:37.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:37 smithi194 ceph-mon[88937]: pgmap v2172: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:37.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:37 smithi123 ceph-mon[112409]: pgmap v2172: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:39.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:39 smithi194 ceph-mon[88937]: pgmap v2173: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:39 smithi123 ceph-mon[112409]: pgmap v2173: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:41 smithi194 ceph-mon[88937]: pgmap v2174: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:41.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:41.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:41 smithi123 ceph-mon[112409]: pgmap v2174: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:43.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:43 smithi194 ceph-mon[88937]: pgmap v2175: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:43 smithi123 ceph-mon[112409]: pgmap v2175: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:45.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:45 smithi194 ceph-mon[88937]: pgmap v2176: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:45.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:45 smithi123 ceph-mon[112409]: pgmap v2176: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:47.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:47 smithi194 ceph-mon[88937]: pgmap v2177: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:47.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:47 smithi123 ceph-mon[112409]: pgmap v2177: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:49.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:49 smithi194 ceph-mon[88937]: pgmap v2178: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:49.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:49 smithi123 ceph-mon[112409]: pgmap v2178: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:50.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:50 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:20:50.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:50 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:20:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:51 smithi194 ceph-mon[88937]: pgmap v2179: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:20:51.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:20:51.396 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:20:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:51 smithi123 ceph-mon[112409]: pgmap v2179: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:20:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:20:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:20:53.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:53 smithi194 ceph-mon[88937]: pgmap v2180: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:53.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:53 smithi123 ceph-mon[112409]: pgmap v2180: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:55.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:55 smithi194 ceph-mon[88937]: pgmap v2181: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:55.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:55 smithi123 ceph-mon[112409]: pgmap v2181: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:56.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:56.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:20:57.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:57 smithi194 ceph-mon[88937]: pgmap v2182: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:57.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:57 smithi123 ceph-mon[112409]: pgmap v2182: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:59.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:20:59 smithi194 ceph-mon[88937]: pgmap v2183: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:20:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:20:59 smithi123 ceph-mon[112409]: pgmap v2183: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:01.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:01 smithi194 ceph-mon[88937]: pgmap v2184: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:01 smithi123 ceph-mon[112409]: pgmap v2184: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:03.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:03 smithi194 ceph-mon[88937]: pgmap v2185: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:03.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:03 smithi123 ceph-mon[112409]: pgmap v2185: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:05.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:05 smithi194 ceph-mon[88937]: pgmap v2186: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:05.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:05 smithi123 ceph-mon[112409]: pgmap v2186: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:07.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:07 smithi194 ceph-mon[88937]: pgmap v2187: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:07.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:07 smithi123 ceph-mon[112409]: pgmap v2187: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:09.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:09 smithi194 ceph-mon[88937]: pgmap v2188: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:09.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:09 smithi123 ceph-mon[112409]: pgmap v2188: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:11 smithi194 ceph-mon[88937]: pgmap v2189: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:11.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:11 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:11.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:11 smithi123 ceph-mon[112409]: pgmap v2189: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:11.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:11 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:13.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:13 smithi194 ceph-mon[88937]: pgmap v2190: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:13.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:13 smithi123 ceph-mon[112409]: pgmap v2190: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:15.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:15 smithi194 ceph-mon[88937]: pgmap v2191: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:15.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:15 smithi123 ceph-mon[112409]: pgmap v2191: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:17.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:17 smithi194 ceph-mon[88937]: pgmap v2192: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:17.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:17 smithi123 ceph-mon[112409]: pgmap v2192: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:19.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:19 smithi194 ceph-mon[88937]: pgmap v2193: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:19.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:19 smithi123 ceph-mon[112409]: pgmap v2193: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:21.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:21 smithi194 ceph-mon[88937]: pgmap v2194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:21.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:21 smithi123 ceph-mon[112409]: pgmap v2194: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:23.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:23 smithi194 ceph-mon[88937]: pgmap v2195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:23.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:23 smithi123 ceph-mon[112409]: pgmap v2195: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:25.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:25 smithi194 ceph-mon[88937]: pgmap v2196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:25.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:25 smithi123 ceph-mon[112409]: pgmap v2196: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:26.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:26 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:26.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:26 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:27.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:27 smithi194 ceph-mon[88937]: pgmap v2197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:27.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:27 smithi123 ceph-mon[112409]: pgmap v2197: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:29.395 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:29 smithi194 ceph-mon[88937]: pgmap v2198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:29.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:29 smithi123 ceph-mon[112409]: pgmap v2198: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:31.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:31 smithi123 ceph-mon[112409]: pgmap v2199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:31.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:31 smithi194 ceph-mon[88937]: pgmap v2199: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:33.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:33 smithi123 ceph-mon[112409]: pgmap v2200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:33.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:33 smithi194 ceph-mon[88937]: pgmap v2200: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:35.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:35 smithi123 ceph-mon[112409]: pgmap v2201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:35.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:35 smithi194 ceph-mon[88937]: pgmap v2201: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:37.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:37 smithi123 ceph-mon[112409]: pgmap v2202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:37.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:37 smithi194 ceph-mon[88937]: pgmap v2202: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:39.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:39 smithi123 ceph-mon[112409]: pgmap v2203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:39.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:39 smithi194 ceph-mon[88937]: pgmap v2203: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:41 smithi123 ceph-mon[112409]: pgmap v2204: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:41.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:41 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:41 smithi194 ceph-mon[88937]: pgmap v2204: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:41.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:41 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:43.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:43 smithi123 ceph-mon[112409]: pgmap v2205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:43.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:43 smithi194 ceph-mon[88937]: pgmap v2205: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:45.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:45 smithi123 ceph-mon[112409]: pgmap v2206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:45.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:45 smithi194 ceph-mon[88937]: pgmap v2206: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:47.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:47 smithi123 ceph-mon[112409]: pgmap v2207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:47.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:47 smithi194 ceph-mon[88937]: pgmap v2207: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:49.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:49 smithi123 ceph-mon[112409]: pgmap v2208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:49.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:49 smithi194 ceph-mon[88937]: pgmap v2208: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:51 smithi123 ceph-mon[112409]: pgmap v2209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:21:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:21:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:21:51.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:51 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:21:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:51 smithi194 ceph-mon[88937]: pgmap v2209: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:51.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-20T09:21:51.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-20T09:21:51.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-20T09:21:51.646 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:51 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' 2024-02-20T09:21:53.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:53 smithi123 ceph-mon[112409]: pgmap v2210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:53.650 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:53 smithi194 ceph-mon[88937]: pgmap v2210: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:55.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:55 smithi123 ceph-mon[112409]: pgmap v2211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:55.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:55 smithi194 ceph-mon[88937]: pgmap v2211: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:56.512 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:56 smithi123 ceph-mon[112409]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:56.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:56 smithi194 ceph-mon[88937]: from='mgr.34104 172.21.15.123:0/2436958783' entity='mgr.smithi123.kwyrtl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-20T09:21:57.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:57 smithi123 ceph-mon[112409]: pgmap v2212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:57.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:57 smithi194 ceph-mon[88937]: pgmap v2212: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:59.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:21:59 smithi123 ceph-mon[112409]: pgmap v2213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:21:59.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:21:59 smithi194 ceph-mon[88937]: pgmap v2213: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:01.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:01 smithi123 ceph-mon[112409]: pgmap v2214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:01.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:01 smithi194 ceph-mon[88937]: pgmap v2214: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:03.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:03 smithi123 ceph-mon[112409]: pgmap v2215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:03.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:03 smithi194 ceph-mon[88937]: pgmap v2215: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:05.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:05 smithi123 ceph-mon[112409]: pgmap v2216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:05.645 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:05 smithi194 ceph-mon[88937]: pgmap v2216: 65 pgs: 65 active+clean; 255 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail 2024-02-20T09:22:06.276 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-20T09:22:06.291 INFO:tasks.cephadm:Teardown begin 2024-02-20T09:22:06.291 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-20T09:22:06.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-20T09:22:06.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-20T09:22:06.363 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-20T09:22:06.363 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-20T09:22:06.386 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-20T09:22:06.420 INFO:tasks.cephadm:Stopping all daemons... 2024-02-20T09:22:06.420 INFO:tasks.cephadm.mon.smithi123:Stopping mon.smithi123... 2024-02-20T09:22:06.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123 2024-02-20T09:22:06.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:06 smithi123 systemd[1]: Stopping Ceph mon.smithi123 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:06 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[112405]: 2024-02-20T09:22:06.747+0000 7fb1c1498700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi123 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:06 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123[112405]: 2024-02-20T09:22:06.747+0000 7fb1c1498700 -1 mon.smithi123@0(leader) e3 *** Got Signal Terminated *** 2024-02-20T09:22:07.010 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:06 smithi123 podman[170793]: 2024-02-20 09:22:06.942184294 +0000 UTC m=+0.324509214 container died f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-20T09:22:07.509 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:07 smithi123 podman[170793]: 2024-02-20 09:22:07.405914885 +0000 UTC m=+0.788239814 container cleanup f4d830a071cf37fec69d81b791624b13c2f948000bcd960c3f9d45e408dab066 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T09:22:07.510 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:Feb 20 09:22:07 smithi123 bash[170793]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi123 2024-02-20T09:22:07.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi123.service' 2024-02-20T09:22:07.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:07.877 INFO:tasks.cephadm.mon.smithi123:Stopped mon.smithi123 2024-02-20T09:22:07.877 INFO:tasks.cephadm.mon.smithi194:Stopping mon.smithi194... 2024-02-20T09:22:07.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi194 2024-02-20T09:22:08.200 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:07 smithi194 systemd[1]: Stopping Ceph mon.smithi194 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:08.516 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:08 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194[88933]: 2024-02-20T09:22:08.197+0000 7fb462fe0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi194 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:08.516 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:08 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194[88933]: 2024-02-20T09:22:08.197+0000 7fb462fe0700 -1 mon.smithi194@1(peon) e3 *** Got Signal Terminated *** 2024-02-20T09:22:08.517 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:08 smithi194 podman[137692]: 2024-02-20 09:22:08.229143746 +0000 UTC m=+0.155462027 container died 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240214) 2024-02-20T09:22:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:08 smithi194 podman[137692]: 2024-02-20 09:22:08.698421485 +0000 UTC m=+0.624739809 container cleanup 4bbf28b0722264c58884b14fdd3670491905318c6d2b1f368d019f1fdefbdd63 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-20T09:22:08.895 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Feb 20 09:22:08 smithi194 bash[137692]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-mon-smithi194 2024-02-20T09:22:09.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@mon.smithi194.service' 2024-02-20T09:22:09.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:09.227 INFO:tasks.cephadm.mon.smithi194:Stopped mon.smithi194 2024-02-20T09:22:09.227 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-20T09:22:09.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.0 2024-02-20T09:22:09.287 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:09 smithi123 systemd[1]: Stopping Ceph osd.0 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:10.010 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:09 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T09:22:09.564+0000 7fc75687b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:10.010 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:09 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T09:22:09.564+0000 7fc75687b700 -1 osd.0 92 *** Got signal Terminated *** 2024-02-20T09:22:10.010 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:09 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0[123335]: 2024-02-20T09:22:09.564+0000 7fc75687b700 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:15.430 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:15 smithi123 podman[170934]: 2024-02-20 09:22:15.109191034 +0000 UTC m=+5.676455758 container died 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-20T09:22:15.760 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:15 smithi123 podman[170934]: 2024-02-20 09:22:15.5188718 +0000 UTC m=+6.086136534 container cleanup 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-20T09:22:15.760 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:15 smithi123 bash[170934]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0 2024-02-20T09:22:16.196 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:15 smithi123 podman[170961]: 2024-02-20 09:22:15.787156062 +0000 UTC m=+0.674375353 container remove 4a75c51dc4c04d964909865fab9d2191e78a19c2b1d5ff1d9f59e845cb349d7c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-20T09:22:16.459 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.098263855 +0000 UTC m=+0.018037275 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:16.459 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.196189843 +0000 UTC m=+0.115963259 container create 9f49e393da1c5d17e4d19f181facb61f322c1bc11bfe18cf844e46ef1b4268d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-20T09:22:16.754 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.458045617 +0000 UTC m=+0.377819049 container init 9f49e393da1c5d17e4d19f181facb61f322c1bc11bfe18cf844e46ef1b4268d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-20T09:22:16.755 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.461434018 +0000 UTC m=+0.381207442 container start 9f49e393da1c5d17e4d19f181facb61f322c1bc11bfe18cf844e46ef1b4268d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-20T09:22:16.755 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.565896932 +0000 UTC m=+0.485670361 container attach 9f49e393da1c5d17e4d19f181facb61f322c1bc11bfe18cf844e46ef1b4268d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-20T09:22:17.009 INFO:journalctl@ceph.osd.0.smithi123.stdout:Feb 20 09:22:16 smithi123 podman[171055]: 2024-02-20 09:22:16.753739125 +0000 UTC m=+0.673512546 container died 9f49e393da1c5d17e4d19f181facb61f322c1bc11bfe18cf844e46ef1b4268d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-20T09:22:17.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.0.service' 2024-02-20T09:22:17.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:17.439 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-20T09:22:17.440 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-20T09:22:17.440 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.1 2024-02-20T09:22:17.759 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:17 smithi123 systemd[1]: Stopping Ceph osd.1 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:18.061 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:17 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T09:22:17.776+0000 7fc1ce220700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:18.061 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:17 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T09:22:17.776+0000 7fc1ce220700 -1 osd.1 92 *** Got signal Terminated *** 2024-02-20T09:22:18.061 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:17 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1[128709]: 2024-02-20T09:22:17.776+0000 7fc1ce220700 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:23.607 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:23 smithi123 podman[171160]: 2024-02-20 09:22:23.324400736 +0000 UTC m=+5.660541204 container died 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T09:22:23.974 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:23 smithi123 podman[171160]: 2024-02-20 09:22:23.705516163 +0000 UTC m=+6.041656639 container cleanup 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-20T09:22:23.975 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:23 smithi123 bash[171160]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1 2024-02-20T09:22:24.260 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:23 smithi123 podman[171178]: 2024-02-20 09:22:23.973706964 +0000 UTC m=+0.649537389 container remove 88009b2a7ba924fba6b0d34e47f5b8b31637c021cdcd0feb2551ad1009b41094 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-20T09:22:24.645 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.225396027 +0000 UTC m=+0.018054379 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:24.645 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.349827554 +0000 UTC m=+0.142485939 container create af69c18d187fbac30411b0aa677593d09d4cddd990bb3b372c5fb463a162ac06 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T09:22:24.645 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.569175517 +0000 UTC m=+0.361833859 container init af69c18d187fbac30411b0aa677593d09d4cddd990bb3b372c5fb463a162ac06 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-20T09:22:24.645 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.572220154 +0000 UTC m=+0.364878503 container start af69c18d187fbac30411b0aa677593d09d4cddd990bb3b372c5fb463a162ac06 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, org.label-schema.build-date=20240214) 2024-02-20T09:22:24.645 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.643792394 +0000 UTC m=+0.436450746 container attach af69c18d187fbac30411b0aa677593d09d4cddd990bb3b372c5fb463a162ac06 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-20T09:22:25.010 INFO:journalctl@ceph.osd.1.smithi123.stdout:Feb 20 09:22:24 smithi123 podman[171272]: 2024-02-20 09:22:24.864188017 +0000 UTC m=+0.656846365 container died af69c18d187fbac30411b0aa677593d09d4cddd990bb3b372c5fb463a162ac06 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-20T09:22:25.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.1.service' 2024-02-20T09:22:25.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:25.569 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-20T09:22:25.569 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-20T09:22:25.569 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.2 2024-02-20T09:22:25.759 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:25 smithi123 systemd[1]: Stopping Ceph osd.2 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:26.260 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:25 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T09:22:25.891+0000 7f780cb50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:26.260 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:25 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T09:22:25.891+0000 7f780cb50700 -1 osd.2 92 *** Got signal Terminated *** 2024-02-20T09:22:26.260 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:25 smithi123 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2[134236]: 2024-02-20T09:22:25.891+0000 7f780cb50700 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:31.611 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:31 smithi123 podman[171377]: 2024-02-20 09:22:31.330312127 +0000 UTC m=+5.541208064 container died 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-20T09:22:31.977 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:31 smithi123 podman[171377]: 2024-02-20 09:22:31.708567667 +0000 UTC m=+5.919463605 container cleanup 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-02-20T09:22:31.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:31 smithi123 bash[171377]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2 2024-02-20T09:22:32.259 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:31 smithi123 podman[171395]: 2024-02-20 09:22:31.976683879 +0000 UTC m=+0.640380844 container remove 41dddae346a5abcceec06ec9e134bd597824fd930c37e2630131d8f55a94c582 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-20T09:22:32.598 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.185800611 +0000 UTC m=+0.018070054 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:32.599 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.294126618 +0000 UTC m=+0.126396059 container create 41373f7977cf027847cb4b401916026037c82e6868b86ee747bc1779ab15632c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T09:22:32.599 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.513546899 +0000 UTC m=+0.345816341 container init 41373f7977cf027847cb4b401916026037c82e6868b86ee747bc1779ab15632c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T09:22:32.599 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.516924326 +0000 UTC m=+0.349193767 container start 41373f7977cf027847cb4b401916026037c82e6868b86ee747bc1779ab15632c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-20T09:22:32.599 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.597050654 +0000 UTC m=+0.429320106 container attach 41373f7977cf027847cb4b401916026037c82e6868b86ee747bc1779ab15632c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-20T09:22:33.010 INFO:journalctl@ceph.osd.2.smithi123.stdout:Feb 20 09:22:32 smithi123 podman[171491]: 2024-02-20 09:22:32.808187291 +0000 UTC m=+0.640456725 container died 41373f7977cf027847cb4b401916026037c82e6868b86ee747bc1779ab15632c (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-20T09:22:33.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.2.service' 2024-02-20T09:22:33.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:33.510 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-20T09:22:33.510 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-20T09:22:33.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.3 2024-02-20T09:22:33.895 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:33 smithi194 systemd[1]: Stopping Ceph osd.3 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:34.395 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:33 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T09:22:33.934+0000 7fe5579fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:34.395 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:33 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T09:22:33.934+0000 7fe5579fd700 -1 osd.3 92 *** Got signal Terminated *** 2024-02-20T09:22:34.395 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:33 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T09:22:33.934+0000 7fe5579fd700 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:36.395 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:35 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:35.914+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:37.395 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:36 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:36.916+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:38.395 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:37 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T09:22:37.900+0000 7fe5507ea700 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.291796+0000 front 2024-02-20T09:22:12.291860+0000 (oldest deadline 2024-02-20T09:22:37.591758+0000) 2024-02-20T09:22:38.396 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:37 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:37.966+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:38.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:38 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:38.611+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:39.395 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:38 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3[98050]: 2024-02-20T09:22:38.925+0000 7fe5507ea700 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.291796+0000 front 2024-02-20T09:22:12.291860+0000 (oldest deadline 2024-02-20T09:22:37.591758+0000) 2024-02-20T09:22:39.396 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:38 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:38.941+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:39.792 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:39 smithi194 podman[137814]: 2024-02-20 09:22:39.482471003 +0000 UTC m=+5.781533519 container died 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-20T09:22:39.793 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:39 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:39.616+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:40.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:39 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:39.947+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:40.145 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:39 smithi194 podman[137814]: 2024-02-20 09:22:39.79187933 +0000 UTC m=+6.090941852 container cleanup 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T09:22:40.146 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:39 smithi194 bash[137814]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3 2024-02-20T09:22:40.146 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:39 smithi194 podman[137832]: 2024-02-20 09:22:39.976286789 +0000 UTC m=+0.487105733 container remove 4027a6b27e201063b97086d73a3f5d739d8f4d6e3e385bdfe7de78dd7940718d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD) 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:40 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:40.653+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.315516488 +0000 UTC m=+0.018443006 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.427290258 +0000 UTC m=+0.130216776 container create 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.654622125 +0000 UTC m=+0.357548643 container init 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.657864344 +0000 UTC m=+0.360790869 container start 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-20T09:22:40.739 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.738103334 +0000 UTC m=+0.441029865 container attach 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-20T09:22:41.145 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:40 smithi194 podman[137924]: 2024-02-20 09:22:40.950560136 +0000 UTC m=+0.653486657 container died 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e) 2024-02-20T09:22:41.146 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:40 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:40.908+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:41.456 INFO:journalctl@ceph.osd.3.smithi194.stdout:Feb 20 09:22:41 smithi194 podman[137950]: 2024-02-20 09:22:41.441474632 +0000 UTC m=+0.485127839 container remove 8ecb2eee05cc55271da97fa66b9b73e021d080278cdf657f62aa7b96b5c4b9e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-02-20T09:22:41.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.3.service' 2024-02-20T09:22:41.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:41.500 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-20T09:22:41.501 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-20T09:22:41.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.4 2024-02-20T09:22:41.829 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:41 smithi194 systemd[1]: Stopping Ceph osd.4 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:41.830 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:41.684+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:42.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:41.827+0000 7f7289903700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:42.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:41.827+0000 7f7289903700 -1 osd.4 92 *** Got signal Terminated *** 2024-02-20T09:22:42.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:41.827+0000 7f7289903700 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:42.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:41 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:41.957+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:42.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:42 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:42.641+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:43.395 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:42 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:42.920+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:43.930 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:43 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:43.676+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:44.395 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:43 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:43.929+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:45.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:44 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:44.881+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:45.146 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:44 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:44.718+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:45.146 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:44 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:44.718+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:46.145 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:45 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4[103061]: 2024-02-20T09:22:45.903+0000 7f72866f8700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.729917+0000 front 2024-02-20T09:22:12.730024+0000 (oldest deadline 2024-02-20T09:22:35.629714+0000) 2024-02-20T09:22:46.145 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:45 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:45.674+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:46.145 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:45 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:45.674+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:46.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:46 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:46.638+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:46.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:46 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:46.638+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:47.645 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:47 smithi194 podman[138028]: 2024-02-20 09:22:47.364984227 +0000 UTC m=+5.643316033 container died 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T09:22:48.005 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:47 smithi194 podman[138028]: 2024-02-20 09:22:47.735617185 +0000 UTC m=+6.013949001 container cleanup 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-20T09:22:48.005 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:47 smithi194 bash[138028]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4 2024-02-20T09:22:48.005 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:47 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:47.655+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:48.005 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:47 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:47.655+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:48.353 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138045]: 2024-02-20 09:22:48.003805529 +0000 UTC m=+0.636481699 container remove 1cd125d8bd9e35f15aec6ee4896ab859190a68fd4e4c9b03d7b7a028c90ee44d (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T09:22:48.616 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.255425579 +0000 UTC m=+0.017650003 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:48.616 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.371242581 +0000 UTC m=+0.133467002 container create 4a4c878547f4fb866f837faa7d97611cc895d6a2eab5acc1b89a55e00b58b2e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-02-20T09:22:48.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:48 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:48.613+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:48.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:48 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:48.613+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:48.896 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.636260819 +0000 UTC m=+0.398485234 container init 4a4c878547f4fb866f837faa7d97611cc895d6a2eab5acc1b89a55e00b58b2e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T09:22:48.896 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.639473796 +0000 UTC m=+0.401698220 container start 4a4c878547f4fb866f837faa7d97611cc895d6a2eab5acc1b89a55e00b58b2e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2) 2024-02-20T09:22:48.896 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.698660514 +0000 UTC m=+0.460884939 container attach 4a4c878547f4fb866f837faa7d97611cc895d6a2eab5acc1b89a55e00b58b2e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-20T09:22:49.228 INFO:journalctl@ceph.osd.4.smithi194.stdout:Feb 20 09:22:48 smithi194 podman[138138]: 2024-02-20 09:22:48.928287698 +0000 UTC m=+0.690512108 container died 4a4c878547f4fb866f837faa7d97611cc895d6a2eab5acc1b89a55e00b58b2e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-20T09:22:49.508 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.4.service' 2024-02-20T09:22:49.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:49.548 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-20T09:22:49.548 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-20T09:22:49.549 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.5 2024-02-20T09:22:49.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:49.581+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:49.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:49.581+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:49.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 systemd[1]: Stopping Ceph osd.5 for 1f99de10-cfc5-11ee-95bb-87774f69a715... 2024-02-20T09:22:50.395 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:49.903+0000 7fa62b621700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-20T09:22:50.395 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:49.903+0000 7fa62b621700 -1 osd.5 92 *** Got signal Terminated *** 2024-02-20T09:22:50.395 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:49 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:49.903+0000 7fa62b621700 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-20T09:22:50.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:50 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:50.570+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:50.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:50 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:50.570+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:51.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:51 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:51.557+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:51.896 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:51 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:51.557+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:52.896 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:52 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:52.511+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:52.896 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:52 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:52.511+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:53.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:53 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:53.464+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:53.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:53 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:53.464+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:53.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:53 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:53.464+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6822 osd.2 since back 2024-02-20T09:22:26.863477+0000 front 2024-02-20T09:22:26.863508+0000 (oldest deadline 2024-02-20T09:22:52.763328+0000) 2024-02-20T09:22:54.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:54 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:54.484+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-02-20T09:22:12.361497+0000 front 2024-02-20T09:22:12.361510+0000 (oldest deadline 2024-02-20T09:22:38.261446+0000) 2024-02-20T09:22:54.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:54 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:54.484+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-02-20T09:22:18.762238+0000 front 2024-02-20T09:22:18.762209+0000 (oldest deadline 2024-02-20T09:22:44.062196+0000) 2024-02-20T09:22:54.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:54 smithi194 ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5[108361]: 2024-02-20T09:22:54.484+0000 7fa62440e700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.123:6822 osd.2 since back 2024-02-20T09:22:26.863477+0000 front 2024-02-20T09:22:26.863508+0000 (oldest deadline 2024-02-20T09:22:52.763328+0000) 2024-02-20T09:22:55.556 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:55 smithi194 podman[138242]: 2024-02-20 09:22:55.267363306 +0000 UTC m=+5.500730558 container died 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T09:22:55.890 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:55 smithi194 podman[138242]: 2024-02-20 09:22:55.654423784 +0000 UTC m=+5.887791034 container cleanup 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-20T09:22:55.890 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:55 smithi194 bash[138242]: ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5 2024-02-20T09:22:56.145 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:55 smithi194 podman[138263]: 2024-02-20 09:22:55.888793947 +0000 UTC m=+0.612571173 container remove 4adb558e933b2072c63f99900e7f10c068aac6a3bcb584b0aa01bdcf1a685ea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-20T09:22:56.526 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.118292264 +0000 UTC m=+0.018053439 image pull fef5ea4fa2ab3174b836684c6959f575b143aede325172999d6c47c5575cc342 quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024 2024-02-20T09:22:56.526 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.272956786 +0000 UTC m=+0.172718015 container create 9670c3de005d556ab8d23dd5e8d3e6ed3670822288f1113651fca2586f611128 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-20T09:22:56.526 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.441755218 +0000 UTC m=+0.341516381 container init 9670c3de005d556ab8d23dd5e8d3e6ed3670822288f1113651fca2586f611128 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-20T09:22:56.526 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.444921871 +0000 UTC m=+0.344683040 container start 9670c3de005d556ab8d23dd5e8d3e6ed3670822288f1113651fca2586f611128 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-20T09:22:56.526 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.52507976 +0000 UTC m=+0.424840931 container attach 9670c3de005d556ab8d23dd5e8d3e6ed3670822288f1113651fca2586f611128 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240220.022152-91ff50e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-20T09:22:56.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Feb 20 09:22:56 smithi194 podman[138355]: 2024-02-20 09:22:56.729650526 +0000 UTC m=+0.629411694 container died 9670c3de005d556ab8d23dd5e8d3e6ed3670822288f1113651fca2586f611128 (image=quay.ceph.io/ceph-ci/ceph@sha256:0a951893099c32f5b1000756a8c82990a9c3171c476da2a0cf233c4bae101024, name=ceph-1f99de10-cfc5-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240220.022152-91ff50e, org.label-schema.vendor=CentOS) 2024-02-20T09:22:57.369 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f99de10-cfc5-11ee-95bb-87774f69a715@osd.5.service' 2024-02-20T09:22:57.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-20T09:22:57.414 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-20T09:22:57.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-20T09:23:00.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[76854]: fuse finished with error 0 and tester_r 0 2024-02-20T09:23:20.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-20T09:23:31.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-20T09:23:31.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-20T09:23:31.241 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-20T09:23:31.243 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi123/crash 2024-02-20T09:23:31.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash -- . 2024-02-20T09:23:31.280 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-20T09:23:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-02-20T09:23:31.282 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi194/crash 2024-02-20T09:23:31.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash -- . 2024-02-20T09:23:31.310 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-20T09:23:31.310 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-02-20T09:23:31.311 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-20T09:23:31.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-20T09:23:31.360 INFO:tasks.cephadm:Compressing logs... 2024-02-20T09:23:31.361 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-20T09:23:31.403 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-20T09:23:31.428 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-20T09:23:31.428 INFO:teuthology.orchestra.run.smithi123.stderr:: No such file or directory 2024-02-20T09:23:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-20T09:23:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.uffypv.log 2024-02-20T09:23:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.0.log: -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-20T09:23:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.uffypv.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi123.log 2024-02-20T09:23:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.1.log 2024-02-20T09:23:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi123.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi123.kwyrtl.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:: No such file or directory 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi194.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.lquaku.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.icyfny.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi194.log: /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.lquaku.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi194.pvhorj.log 2024-02-20T09:23:31.433 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.icyfny.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-20T09:23:31.434 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi194.pvhorj.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.4.log 2024-02-20T09:23:31.434 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.5.log 2024-02-20T09:23:31.434 INFO:teuthology.orchestra.run.smithi194.stderr: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-20T09:23:31.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.gglmsl.log 2024-02-20T09:23:31.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi123.kwyrtl.log: /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.gglmsl.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.0.log 2024-02-20T09:23:31.435 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-20T09:23:31.436 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-20T09:23:31.442 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-20T09:23:31.443 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-20T09:23:31.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log 2024-02-20T09:23:31.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-20T09:23:31.445 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.2.log 2024-02-20T09:23:31.446 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.3.log 2024-02-20T09:23:31.446 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-20T09:23:31.453 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log: 90.2% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-20T09:23:31.453 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-20T09:23:31.463 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log 2024-02-20T09:23:31.464 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-20T09:23:31.470 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-20T09:23:31.489 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log: /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log: 90.3% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-20T09:23:31.502 INFO:teuthology.orchestra.run.smithi194.stderr: 90.2% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi194.pvhorj.log.gz 2024-02-20T09:23:31.514 INFO:teuthology.orchestra.run.smithi194.stderr: 91.1% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-20T09:23:31.523 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.2.log: /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log: 91.1% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-20T09:23:32.241 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mgr.smithi123.kwyrtl.log.gz 2024-02-20T09:23:32.642 INFO:teuthology.orchestra.run.smithi194.stderr: 92.6% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi194.log.gz 2024-02-20T09:23:34.616 INFO:teuthology.orchestra.run.smithi123.stderr: 90.1% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mon.smithi123.log.gz 2024-02-20T09:23:36.114 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.4.log.gz 2024-02-20T09:23:37.446 INFO:teuthology.orchestra.run.smithi194.stderr: 94.8% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.lquaku.log.gz 2024-02-20T09:23:38.439 INFO:teuthology.orchestra.run.smithi123.stderr: 93.6% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.1.log.gz 2024-02-20T09:23:38.597 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.2.log.gz 2024-02-20T09:23:38.645 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.5.log.gz 2024-02-20T09:23:38.910 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.0.log.gz 2024-02-20T09:23:39.312 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-osd.3.log.gz 2024-02-20T09:23:39.535 INFO:teuthology.orchestra.run.smithi194.stderr: 94.8% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi194.icyfny.log.gz 2024-02-20T09:23:40.295 INFO:teuthology.orchestra.run.smithi123.stderr: 94.8% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.gglmsl.log.gz 2024-02-20T09:23:46.912 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-20T09:23:46.912 INFO:teuthology.orchestra.run.smithi194.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-20T09:23:46.913 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-02-20T09:23:46.913 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m15.497s 2024-02-20T09:23:46.914 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m49.141s 2024-02-20T09:23:46.914 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m1.438s 2024-02-20T09:23:47.707 INFO:teuthology.orchestra.run.smithi123.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-20T09:24:54.265 INFO:teuthology.orchestra.run.smithi123.stderr: 92.9% -- replaced with /var/log/ceph/1f99de10-cfc5-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi123.uffypv.log.gz 2024-02-20T09:24:54.267 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-02-20T09:24:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:real 1m22.851s 2024-02-20T09:24:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:user 2m8.198s 2024-02-20T09:24:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m4.022s 2024-02-20T09:24:54.267 INFO:tasks.cephadm:Archiving logs... 2024-02-20T09:24:54.267 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi123/log 2024-02-20T09:24:54.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-20T09:25:13.590 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi194/log 2024-02-20T09:25:13.591 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-20T09:25:19.796 INFO:tasks.cephadm:Removing cluster... 2024-02-20T09:25:19.796 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 --force 2024-02-20T09:25:20.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f99de10-cfc5-11ee-95bb-87774f69a715 --force 2024-02-20T09:25:20.978 INFO:tasks.cephadm:Removing cephadm ... 2024-02-20T09:25:20.978 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-20T09:25:20.994 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-20T09:25:21.009 INFO:tasks.cephadm:Teardown complete 2024-02-20T09:25:21.009 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-20T09:25:21.024 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-20T09:25:21.025 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-20T09:25:21.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-20T09:25:21.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-20T09:25:21.127 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-20T09:25:21.140 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-20T09:25:21.141 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-20T09:25:21.143 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-20T09:25:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-02-20T09:25:21.157 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +1264us[+1236us] +/- 121ms 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv02.front.sepia.ceph.com 3 7 377 48 -1099us[-1127us] +/- 61ms 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +707us[ +679us] +/- 80ms 2024-02-20T09:25:21.160 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 53 +1242us[+1242us] +/- 121ms 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv02.front.sepia.ceph.com 3 7 377 112 -1178us[-1175us] +/- 60ms 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 113 +673us[ +676us] +/- 79ms 2024-02-20T09:25:21.162 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-20T09:25:21.162 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-20T09:25:21.175 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-20T09:25:21.176 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-20T09:25:21.192 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-20T09:25:21.292 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-20T09:25:21.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-20T09:25:21.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T09:25:21.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-20T09:25:21.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T09:25:21.437 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-20T09:25:21.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-20T09:25:21.465 INFO:teuthology.task.internal:Duration was 5936.614944 seconds 2024-02-20T09:25:21.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-20T09:25:21.482 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-20T09:25:21.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-20T09:25:21.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-20T09:25:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-20T09:25:21.529 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-20T09:25:21.798 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-20T09:25:21.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-02-20T09:25:21.799 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-20T09:25:21.858 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-02-20T09:25:21.858 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-20T09:25:21.882 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-20T09:25:21.882 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-20T09:25:21.901 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-20T09:25:21.950 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-20T09:25:21.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-20T09:25:21.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-20T09:25:22.663 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-20T09:25:22.676 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-20T09:25:22.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-20T09:25:22.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-20T09:25:22.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-20T09:25:22.745 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-20T09:25:22.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-20T09:25:22.771 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-02-20T09:25:22.796 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-02-20T09:25:22.820 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-20T09:25:22.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T09:25:22.871 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-20T09:25:22.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T09:25:22.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-20T09:25:22.909 INFO:teuthology.task.internal:Transferring archived files... 2024-02-20T09:25:22.911 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi123 2024-02-20T09:25:22.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-20T09:25:22.982 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555/remote/smithi194 2024-02-20T09:25:22.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-20T09:25:23.033 INFO:teuthology.task.internal:Removing archive directory... 2024-02-20T09:25:23.033 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-20T09:25:23.036 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-20T09:25:23.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-20T09:25:23.096 INFO:teuthology.task.internal:Not uploading archives. 2024-02-20T09:25:23.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-20T09:25:23.108 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-20T09:25:23.109 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-20T09:25:23.111 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-20T09:25:23.123 INFO:teuthology.orchestra.run.smithi123.stdout: 266032 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 20 09:25 /home/ubuntu/cephtest 2024-02-20T09:25:23.123 INFO:teuthology.orchestra.run.smithi123.stdout: 655641 4 d--------- 2 ubuntu ubuntu 4096 Feb 20 08:02 /home/ubuntu/cephtest/mnt.0 2024-02-20T09:25:23.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-20T09:25:23.124 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-20T09:25:23.124 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-20T09:25:23.125 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_3d72bcfd7affbb4a923c191d212814b4934cfeaa/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-20T09:25:23.125 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-20T09:25:23.140 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-20T09:25:23.157 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-20T09:25:23.157 INFO:teuthology.nuke:Checking targets against current locks 2024-02-20T09:25:23.183 DEBUG:teuthology.nuke:shortname: smithi123 2024-02-20T09:25:23.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-20T09:25:23.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 07:38:13.501796', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjThjwwiWI+uS+mEFY92OsJyaqw6JI4p34FT+L0KMALDmo8tNGaHvyuxwOAE67qv330ikS3xpwdYkYxBJM3FWQ='} 2024-02-20T09:25:23.210 DEBUG:teuthology.nuke:shortname: smithi194 2024-02-20T09:25:23.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-20T09:25:23.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 07:38:13.503238', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkz7roD3V7ksYM2l746nvo4btUKXSZnVhGKtOBk2+4XCKobDCPSabFs8sQN9NDrDp9JxeO2GQWCQKrWV4QyE/o='} 2024-02-20T09:25:23.259 INFO:teuthology.orchestra.console.smithi123:Power off 2024-02-20T09:25:23.259 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T09:25:23.287 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2024-02-20T09:25:23.288 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:23.302 INFO:teuthology.orchestra.console.smithi194:Power off 2024-02-20T09:25:23.302 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T09:25:23.312 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-02-20T09:25:23.325 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-02-20T09:25:23.325 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:23.348 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-02-20T09:25:27.313 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:27.349 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:27.424 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-02-20T09:25:27.459 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-02-20T09:25:31.429 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:31.460 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:31.539 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-02-20T09:25:31.570 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-02-20T09:25:31.671 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-02-20T09:25:35.545 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T09:25:35.655 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-02-20T09:25:35.755 INFO:teuthology.orchestra.console.smithi123:Power off completed 2024-02-20T09:25:35.860 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 5936.614943981171 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-02-20T09:25:35.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:25:35.960 INFO:teuthology.run:FAIL